2024-03-19T05:36:32.002 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-19T05:36:32.002 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647 --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --verbose --name vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi -- /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647/orig.config.yaml 2024-03-19T05:36:32.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T05:36:32.149 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647 branch: wip-vshankar-testing-20240307.022905 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: vshankar@redhat.com first_in_suite: false job_id: '7610647' kernel: flavor: default kdb: true sha1: 908b6b276e8f14e16032b32a9770077cd37b6bd4 last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240307.022905 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240307.022905 sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 6045 sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f sleep_before_teardown: 0 subset: 832/1024 suite: fs suite_branch: wip-vshankar-testing-20240307.022905 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f targets: smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqyZgD4jPKhAzQmn+z4vqr2pRCZq5L7elDiDPYP9mZQv56VJtzXZIVELaCpm/SHteMfmXpQ+KybIByZOudfII8= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO5GF5fwSWAVIVgm5TrCQYWrWEchpHlC7c6rSuj4MHaGSzJSwgmxKOcv+zUsO2QG1/NN7F9ND3ujvHDsZahRdqY= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/vshankar/src/git.ceph.com_ceph-c_wip-vshankar-testing-20240307.022905/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-19_04:59:54 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-03-19T05:36:32.150 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa; will attempt to use it 2024-03-19T05:36:32.150 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks 2024-03-19T05:36:32.151 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-19T05:36:32.152 INFO:teuthology.task.internal:Checking packages... 2024-03-19T05:36:32.177 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f' 2024-03-19T05:36:32.177 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-19T05:36:32.177 INFO:teuthology.packaging:ref: None 2024-03-19T05:36:32.177 INFO:teuthology.packaging:tag: None 2024-03-19T05:36:32.177 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240307.022905 2024-03-19T05:36:32.177 INFO:teuthology.packaging:sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T05:36:32.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240307.022905 2024-03-19T05:36:32.405 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1934.gb0ea271b 2024-03-19T05:36:32.406 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-19T05:36:32.413 INFO:teuthology.task.internal:no buildpackages task found 2024-03-19T05:36:32.413 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-19T05:36:32.430 INFO:teuthology.task.internal:Saving configuration 2024-03-19T05:36:32.450 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-19T05:36:32.456 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-19T05:36:32.482 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-19 05:30:56.042661', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqyZgD4jPKhAzQmn+z4vqr2pRCZq5L7elDiDPYP9mZQv56VJtzXZIVELaCpm/SHteMfmXpQ+KybIByZOudfII8='} 2024-03-19T05:36:32.501 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-19 05:30:56.044279', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO5GF5fwSWAVIVgm5TrCQYWrWEchpHlC7c6rSuj4MHaGSzJSwgmxKOcv+zUsO2QG1/NN7F9ND3ujvHDsZahRdqY='} 2024-03-19T05:36:32.501 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-19T05:36:32.508 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-03-19T05:36:32.508 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-03-19T05:36:32.508 INFO:teuthology.run_tasks:Running task console_log... 2024-03-19T05:36:32.583 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f211fbaf160>, signals=[15]) 2024-03-19T05:36:32.584 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-19T05:36:32.592 INFO:teuthology.task.internal:Opening connections... 2024-03-19T05:36:32.592 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T05:36:32.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:36:32.682 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-03-19T05:36:32.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:36:32.772 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-19T05:36:32.778 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-03-19T05:36:32.796 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-03-19T05:36:32.797 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-03-19T05:36:32.853 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2024-03-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2024-03-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2024-03-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2024-03-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2024-03-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2024-03-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2024-03-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2024-03-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2024-03-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-19T05:36:32.854 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-19T05:36:32.855 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-19T05:36:32.855 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-03-19T05:36:32.879 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-03-19T05:36:32.896 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-03-19T05:36:32.896 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-03-19T05:36:32.952 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-03-19T05:36:32.952 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-03-19T05:36:32.952 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-03-19T05:36:32.952 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-03-19T05:36:32.952 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-03-19T05:36:32.953 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-03-19T05:36:32.953 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-19T05:36:32.953 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-03-19T05:36:32.953 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-03-19T05:36:32.953 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-19T05:36:32.953 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-03-19T05:36:32.953 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-19T05:36:32.953 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-19T05:36:32.953 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-19T05:36:32.953 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-03-19T05:36:32.977 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-19T05:36:32.989 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-19T05:36:32.995 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-19T05:36:32.995 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2024-03-19T05:36:32.997 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-03-19T05:36:33.013 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-19T05:36:33.019 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-19T05:36:33.019 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2024-03-19T05:36:33.054 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-03-19T05:36:33.078 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-19T05:36:33.135 INFO:teuthology.run_tasks:Running task kernel... 2024-03-19T05:36:33.150 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'} 2024-03-19T05:36:33.150 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'}}, timeout 300 2024-03-19T05:36:33.151 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-19T05:36:33.151 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-19T05:36:33.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T05:36:33.167 DEBUG:teuthology.task.kernel:sha1 for host.b is 908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:36:33.167 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "908b6b276e8f14e16032b32a9770077cd37b6bd4"... 2024-03-19T05:36:33.167 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-03-19T05:36:33.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T05:36:33.168 DEBUG:teuthology.task.kernel:sha1 for host.a is 908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:36:33.168 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "908b6b276e8f14e16032b32a9770077cd37b6bd4"... 2024-03-19T05:36:33.168 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-03-19T05:36:33.224 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-361.el9.x86_64 2024-03-19T05:36:33.224 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:36:33.225 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-19T05:36:33.225 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:36:33.228 INFO:teuthology.orchestra.run.smithi072.stdout:5.14.0-361.el9.x86_64 2024-03-19T05:36:33.229 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:36:33.229 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-19T05:36:33.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:36:33.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum upgrade -y linux-firmware 2024-03-19T05:36:33.469 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum upgrade -y linux-firmware 2024-03-19T05:36:35.558 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-03-19T05:36:36.461 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-19T05:36:37.017 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2024-03-19T05:36:37.837 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2024-03-19T05:36:39.156 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.0 MB 00:00 2024-03-19T05:36:40.807 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.0 MB 00:03 2024-03-19T05:36:47.358 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 19 MB 00:07 2024-03-19T05:36:52.418 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.1 MB 00:01 2024-03-19T05:36:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-03-19T05:36:57.014 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-03-19T05:36:57.299 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 6.4 MB/s | 21 MB 00:03 2024-03-19T05:37:02.158 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-19T05:37:03.164 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.1 MB 00:02 2024-03-19T05:37:04.397 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:37:04.412 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:37:04.412 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-03-19T05:37:04.412 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:37:04.413 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2024-03-19T05:37:04.413 INFO:teuthology.orchestra.run.smithi072.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-19T05:37:04.413 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:37:04.413 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:37:04.413 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:37:04.413 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 1 Package 2024-03-19T05:37:04.413 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:37:04.413 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 375 M 2024-03-19T05:37:04.413 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:37:04.940 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 16 kB 00:00 2024-03-19T05:37:14.252 INFO:teuthology.orchestra.run.smithi072.stdout:linux-firmware-20240219-143.el9.noarch.rpm 38 MB/s | 375 MB 00:09 2024-03-19T05:37:14.253 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:37:14.254 INFO:teuthology.orchestra.run.smithi072.stdout:Total 38 MB/s | 375 MB 00:09 2024-03-19T05:37:14.254 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:37:14.353 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:37:14.353 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:37:16.754 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:37:16.754 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:37:25.085 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:37:25.383 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-19T05:37:25.481 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-19T05:37:25.766 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 21 MB 00:20 2024-03-19T05:37:27.413 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-19T05:37:27.413 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-19T05:37:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-19T05:37:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:37:27.799 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2024-03-19T05:37:27.799 INFO:teuthology.orchestra.run.smithi072.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-19T05:37:27.800 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:37:27.800 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:37:28.182 INFO:teuthology.task.kernel:Downloading kernel 908b6b276e8f14e16032b32a9770077cd37b6bd4 on host.a... 2024-03-19T05:37:28.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:37:28.418 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/centos/9/flavors/default/x86_64/ 2024-03-19T05:37:28.419 DEBUG:teuthology.orchestra.run.smithi072:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g908b6b276e8f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-19T05:37:28.421 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi072.front.sepia.ceph.com to complete... 2024-03-19T05:37:30.721 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-03-19T05:37:32.844 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:37:32.852 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:37:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-03-19T05:37:32.852 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:37:32.852 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-03-19T05:37:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-19T05:37:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:37:32.853 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:37:32.853 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:37:32.853 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 1 Package 2024-03-19T05:37:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:37:32.853 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 375 M 2024-03-19T05:37:32.853 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:37:40.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19 05:37:40 URL:https://2.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/centos/9/flavors/default/x86_64/kernel-6.8.0_g908b6b276e8f-1.x86_64.rpm [336362676/336362676] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-19T05:37:40.136 INFO:teuthology.orchestra.run.smithi072.stderr:FINISHED --2024-03-19 05:37:40-- 2024-03-19T05:37:40.136 INFO:teuthology.orchestra.run.smithi072.stderr:Total wall clock time: 12s 2024-03-19T05:37:40.136 INFO:teuthology.orchestra.run.smithi072.stderr:Downloaded: 1 files, 321M in 11s (28.4 MB/s) 2024-03-19T05:37:40.139 INFO:teuthology.task.kernel:Installing kernel 908b6b276e8f14e16032b32a9770077cd37b6bd4 on host.a... 2024-03-19T05:37:40.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-19T05:37:42.068 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying... ######################################## 2024-03-19T05:37:42.145 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing... ######################################## 2024-03-19T05:37:42.225 INFO:teuthology.orchestra.run.smithi072.stdout:Updating / installing... 2024-03-19T05:37:42.588 INFO:teuthology.orchestra.run.smithi172.stdout:linux-firmware-20240219-143.el9.noarch.rpm 39 MB/s | 375 MB 00:09 2024-03-19T05:37:42.589 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:37:42.589 INFO:teuthology.orchestra.run.smithi172.stdout:Total 39 MB/s | 375 MB 00:09 2024-03-19T05:37:42.590 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:37:42.692 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:37:42.692 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:37:45.240 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:37:45.241 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:37:49.748 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-6.8.0_g908b6b276e8f-1 ######################################## 2024-03-19T05:37:51.409 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:37:51.606 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-19T05:37:51.679 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-19T05:37:52.895 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-19T05:37:52.895 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-19T05:37:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-19T05:37:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:37:53.295 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-03-19T05:37:53.295 INFO:teuthology.orchestra.run.smithi172.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-19T05:37:53.296 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:37:53.296 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:37:53.605 INFO:teuthology.task.kernel:Downloading kernel 908b6b276e8f14e16032b32a9770077cd37b6bd4 on host.b... 2024-03-19T05:37:53.606 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:37:53.904 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/centos/9/flavors/default/x86_64/ 2024-03-19T05:37:53.905 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g908b6b276e8f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-19T05:37:53.907 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi172.front.sepia.ceph.com to complete... 2024-03-19T05:38:05.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19 05:38:05 URL:https://2.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/centos/9/flavors/default/x86_64/kernel-6.8.0_g908b6b276e8f-1.x86_64.rpm [336362676/336362676] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-19T05:38:05.321 INFO:teuthology.orchestra.run.smithi172.stderr:FINISHED --2024-03-19 05:38:05-- 2024-03-19T05:38:05.321 INFO:teuthology.orchestra.run.smithi172.stderr:Total wall clock time: 11s 2024-03-19T05:38:05.321 INFO:teuthology.orchestra.run.smithi172.stderr:Downloaded: 1 files, 321M in 11s (28.9 MB/s) 2024-03-19T05:38:05.324 INFO:teuthology.task.kernel:Installing kernel 908b6b276e8f14e16032b32a9770077cd37b6bd4 on host.b... 2024-03-19T05:38:05.324 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-19T05:38:07.266 INFO:teuthology.orchestra.run.smithi172.stdout:Verifying... ######################################## 2024-03-19T05:38:07.348 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing... ######################################## 2024-03-19T05:38:07.429 INFO:teuthology.orchestra.run.smithi172.stdout:Updating / installing... 2024-03-19T05:38:15.024 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-6.8.0_g908b6b276e8f-1 ######################################## 2024-03-19T05:38:20.280 INFO:teuthology.orchestra.run.smithi072.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-19T05:38:31.073 INFO:teuthology.orchestra.run.smithi172.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-19T05:38:44.310 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-19T05:38:44.311 DEBUG:teuthology.orchestra.run.smithi072:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-19T05:38:44.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f 2024-03-19T05:38:44.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/System.map 2024-03-19T05:38:44.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/config 2024-03-19T05:38:44.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel 2024-03-19T05:38:44.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch 2024-03-19T05:38:44.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86 2024-03-19T05:38:44.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto 2024-03-19T05:38:44.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-19T05:38:44.402 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-19T05:38:44.403 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/mce 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm.ko 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ansi_cprng.ko 2024-03-19T05:38:44.404 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/anubis.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/arc4.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_memcpy.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_pq.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_tx.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_xor.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/raid6test.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/authenc.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/authencesn.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blake2b_generic.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blowfish_common.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blowfish_generic.ko 2024-03-19T05:38:44.405 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/camellia_generic.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast5_generic.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast6_generic.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast_common.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ccm.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cmac.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crc32_generic.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_engine.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_user.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cts.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/des_generic.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/dh_generic.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/echainiv.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/essiv.ko 2024-03-19T05:38:44.406 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/fcrypt.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/khazad.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lz4.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lz4hc.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/md4.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/michael_mic.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/pcbc.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/pcrypt.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/rmd160.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/seed.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/serpent_generic.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/tcrypt.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/tea.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/twofish_common.ko 2024-03-19T05:38:44.407 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/twofish_generic.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/vmac.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/wp512.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xcbc.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xor.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xxhash_generic.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_pad.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/custom_method.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/ec_sys.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/platform_profile.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/sbs.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/sbshc.ko 2024-03-19T05:38:44.408 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/video.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/acard-ahci.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ahci_platform.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ata_generic.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/libahci_platform.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_acpi.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ali.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_amd.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_artop.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_atiixp.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_atp867x.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cmd640.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cmd64x.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cypress.ko 2024-03-19T05:38:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_efar.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt366.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt37x.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_it8213.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_it821x.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_jmicron.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_marvell.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_mpiix.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_netcell.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ninja32.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ns87410.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ns87415.ko 2024-03-19T05:38:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_oldpiix.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_opti.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_optidma.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pcmcia.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_piccolo.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_rdc.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sch.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_serverworks.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sil680.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sis.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sl82c105.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_triflex.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_via.ko 2024-03-19T05:38:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pdc_adma.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_inic162x.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_mv.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_nv.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_promise.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_qstor.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sil.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sil24.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sis.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_svw.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sx4.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_uli.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_via.ko 2024-03-19T05:38:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_vsc.ko 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/auxdisplay 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/auxdisplay/ks0108.ko 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base/regmap 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/bcma 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/bcma/bcma.ko 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/aoe 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/aoe/aoe.ko 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/brd.ko 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/drbd 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/drbd/drbd.ko 2024-03-19T05:38:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/floppy.ko 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/loop.ko 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/mtip32xx 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/nbd.ko 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/null_blk 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/null_blk/null_blk.ko 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/pktcdvd.ko 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/rbd.ko 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/virtio_blk.ko 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkback 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkfront.ko 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/zram 2024-03-19T05:38:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/zram/zram.ko 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hangcheck-timer.ko 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/via-rng.ko 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-19T05:38:44.415 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/lp.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/mwave 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/mwave/mwave.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ppdev.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tlclk.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/uv_mmtimer.ko 2024-03-19T05:38:44.416 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/virtio_console.ko 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ccp.ko 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_common 2024-03-19T05:38:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/padlock-aes.ko 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/padlock-sha.ko 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/virtio 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dca 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dca/dca.ko 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/devfreq 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/dw 2024-03-19T05:38:44.418 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ioat 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/amd64_edac.ko 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/e752x_edac.ko 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/edac_mce_amd.ko 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i3000_edac.ko 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i3200_edac.ko 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i5100_edac.ko 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i5400_edac.ko 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i7300_edac.ko 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i7core_edac.ko 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i82975x_edac.ko 2024-03-19T05:38:44.419 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/ie31200_edac.ko 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/sb_edac.ko 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/x38_edac.ko 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/edd.ko 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-ich.ko 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-appleir.ko 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-aureal.ko 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-axff.ko 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-dr.ko 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-elecom.ko 2024-03-19T05:38:44.420 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-elo.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-emsff.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gaff.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gt683r.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gyration.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtekff.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-hyperv.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-icade.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-keytouch.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-kye.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lcpower.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-led.ko 2024-03-19T05:38:44.421 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lenovo.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-multitouch.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-ortek.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-penmount.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-petalynx.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-picolcd.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-pl.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-plantronics.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-primax.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-rmi.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-common.ko 2024-03-19T05:38:44.422 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-saitek.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-samsung.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sjoy.ko 2024-03-19T05:38:44.423 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sony.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-speedlink.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-steelseries.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sunplus.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-tivo.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-tmff.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-topseed.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-twinhan.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-uclogic.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-waltop.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-wiimote.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-xinmo.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-zpff.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-zydacron.ko 2024-03-19T05:38:44.424 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/uhid.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/wacom.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_balloon.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_utils.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_vmbus.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/abituguru.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/abituguru3.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ad7414.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ad7418.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adc128d818.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1025.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1026.ko 2024-03-19T05:38:44.425 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1029.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1031.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm9240.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ads7828.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7410.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7411.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7462.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7470.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7475.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7x10.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/amc6821.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/applesmc.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asb100.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asc7621.ko 2024-03-19T05:38:44.426 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/atxp1.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/coretemp.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/dme1737.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ds1621.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ds620.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc1403.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc6w201.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f71805f.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f71882fg.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f75375s.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/fam15h_power.ko 2024-03-19T05:38:44.427 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/fschmd.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/g760a.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/g762.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/gl518sm.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/gl520sm.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/i5500_temp.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/i5k_amb.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ibmaem.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ibmpex.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ina209.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ina2xx.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/it87.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/k10temp.ko 2024-03-19T05:38:44.428 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/k8temp.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lineage-pem.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm63.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm73.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm75.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm77.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm78.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm80.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm83.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm85.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm87.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm90.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm92.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm93.ko 2024-03-19T05:38:44.429 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95234.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95241.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95245.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc2945.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4151.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4215.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4222.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4245.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4260.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4261.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max16065.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max1619.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max1668.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max197.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6639.ko 2024-03-19T05:38:44.430 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6650.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6697.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/mcp3021.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6683.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6775-core.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6775.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct7802.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pc87360.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pc87427.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pcf8591.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-19T05:38:44.431 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/powr1220.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch5627.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch5636.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sht15.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sht21.ko 2024-03-19T05:38:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/shtc1.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sis5595.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47b397.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47m1.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47m192.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/thmc50.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp102.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp103.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp401.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp421.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/via-cputemp.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/via686a.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/vt1211.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/vt8231.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83627ehf.ko 2024-03-19T05:38:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83627hf.ko 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83781d.ko 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83791d.ko 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83792d.ko 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83793.ko 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83795.ko 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83l785ts.ko 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83l786ng.ko 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-19T05:38:44.434 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-19T05:38:44.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-19T05:38:44.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-19T05:38:44.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-19T05:38:44.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-19T05:38:44.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-19T05:38:44.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-19T05:38:44.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-19T05:38:44.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-19T05:38:44.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-19T05:38:44.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-19T05:38:44.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-19T05:38:44.435 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-19T05:38:44.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-19T05:38:44.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-19T05:38:44.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-19T05:38:44.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-19T05:38:44.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-19T05:38:44.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-19T05:38:44.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-19T05:38:44.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-19T05:38:44.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-19T05:38:44.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-dev.ko 2024-03-19T05:38:44.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-mux.ko 2024-03-19T05:38:44.436 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-smbus.ko 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-stub.ko 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_core.ko 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw 2024-03-19T05:38:44.437 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/cxgb4 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx4 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx5 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mthca 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ipoib 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/iser 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/isert 2024-03-19T05:38:44.438 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srp 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srpt 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/gameport.ko 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/joydev.ko 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-19T05:38:44.439 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse 2024-03-19T05:38:44.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/appletouch.ko 2024-03-19T05:38:44.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/bcm5974.ko 2024-03-19T05:38:44.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/cyapatp.ko 2024-03-19T05:38:44.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-19T05:38:44.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/sermouse.ko 2024-03-19T05:38:44.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-19T05:38:44.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-19T05:38:44.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-19T05:38:44.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/rmi4 2024-03-19T05:38:44.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-19T05:38:44.440 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/altera_ps2.ko 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/arc_ps2.ko 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/serio_raw.ko 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/sparse-keymap.ko 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-blinkm.ko 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lm3530.ko 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lp3944.ko 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-ss4200.ko 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-19T05:38:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/bcache 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/bcache/bcache.ko 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-bio-prison.ko 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-cache-smq.ko 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-cache.ko 2024-03-19T05:38:44.442 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-crypt.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-delay.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-flakey.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-log-userspace.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-multipath.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-queue-length.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-raid.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-round-robin.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-service-time.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-switch.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-thin-pool.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-verity.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/persistent-data 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-19T05:38:44.443 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid0.ko 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid1.ko 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid10.ko 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid456.ko 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptbase.ko 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptctl.ko 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptfc.ko 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptlan.ko 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptsas.ko 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptscsih.ko 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptspi.ko 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lpc_ich.ko 2024-03-19T05:38:44.444 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lpc_sch.ko 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/mfd-core.ko 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/sm501.ko 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/viperboard.ko 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/vx855.ko 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/wl1273-core.ko 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/altera-stapl 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/apds9802als.ko 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/apds990x.ko 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/bh1770glc.ko 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/cb710 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/cb710/cb710.ko 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom 2024-03-19T05:38:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/at24.ko 2024-03-19T05:38:44.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-19T05:38:44.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/max6875.ko 2024-03-19T05:38:44.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/enclosure.ko 2024-03-19T05:38:44.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/hpilo.ko 2024-03-19T05:38:44.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/isl29003.ko 2024-03-19T05:38:44.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/isl29020.ko 2024-03-19T05:38:44.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d 2024-03-19T05:38:44.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-19T05:38:44.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-19T05:38:44.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei 2024-03-19T05:38:44.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei-me.ko 2024-03-19T05:38:44.446 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei-txe.ko 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei.ko 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-gru 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tifm_7xx1.ko 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tifm_core.ko 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tsl2550.ko 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_balloon.ko 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_vmci 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net 2024-03-19T05:38:44.447 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/bonding 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/bonding/bonding.ko 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/b53 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6xxx 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dummy.ko 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/eql.ko 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com 2024-03-19T05:38:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/adaptec 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/agere 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/alteon 2024-03-19T05:38:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/altera 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/alx 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-19T05:38:44.450 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/genet 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade 2024-03-19T05:38:44.451 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/bna 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/enic 2024-03-19T05:38:44.452 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dnet.ko 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/benet 2024-03-19T05:38:44.453 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ethoc.ko 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/fealnx.ko 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000e 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/fm10k 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/i40e 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/iavf 2024-03-19T05:38:44.454 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igb 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igbvf 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/jme.ko 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox 2024-03-19T05:38:44.455 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-19T05:38:44.456 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/neterion 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/nvidia 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rdc 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-19T05:38:44.457 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rocker 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sfc 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/silan 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-19T05:38:44.458 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc 2024-03-19T05:38:44.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-19T05:38:44.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-19T05:38:44.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-19T05:38:44.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-19T05:38:44.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro 2024-03-19T05:38:44.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-19T05:38:44.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-19T05:38:44.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-19T05:38:44.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun 2024-03-19T05:38:44.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-19T05:38:44.459 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/tehuti 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ti 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/xircom 2024-03-19T05:38:44.460 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/geneve.ko 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/hyperv 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ieee802154 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ifb.ko 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ipvlan 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/macvlan.ko 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/macvtap.ko 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio.ko 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-19T05:38:44.461 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mii.ko 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/net_failover.ko 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/netconsole.ko 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/nlmon.ko 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/amd.ko 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm87xx.ko 2024-03-19T05:38:44.462 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/broadcom.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/cicada.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/davicom.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/dp83640.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/et1011c.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/icplus.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/lxt.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/marvell.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/micrel.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/national.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/phylink.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/qsemi.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/realtek.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/smsc.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/ste10Xp.ko 2024-03-19T05:38:44.463 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/vitesse.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_async.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pppoe.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pppox.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pptp.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip/slhc.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip/slip.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/sungem_phy.ko 2024-03-19T05:38:44.464 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/tap.ko 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team.ko 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_random.ko 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/tun.ko 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/veth.ko 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/virtio_net.ko 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vmxnet3 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vxlan 2024-03-19T05:38:44.465 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vxlan/vxlan.ko 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netback 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netfront.ko 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ntb 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ntb/ntb.ko 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/nvme-core.ko 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/nvme.ko 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport.ko 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_cs.ko 2024-03-19T05:38:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_pc.ko 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_serial.ko 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/pcie 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/xen-pcifront.ko 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/i82092.ko 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/pd6729.ko 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/intel 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-19T05:38:44.467 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/acerhdf.ko 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-19T05:38:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/hdaps.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel_ips.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/wmi.ko 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap 2024-03-19T05:38:44.469 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps_parport.ko 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/pps_core.ko 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ptp.ko 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ptp_kvm.ko 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-19T05:38:44.470 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-em3027.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max6900.ko 2024-03-19T05:38:44.471 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-x1205.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-9xxx.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-sas.ko 2024-03-19T05:38:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-xxxx.ko 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/BusLogic.ko 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/a100u2w.ko 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aacraid 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/advansys.ko 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/am53c974.ko 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/arcmsr 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/atp870u.ko 2024-03-19T05:38:44.473 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/be2iscsi 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bfa 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bfa/bfa.ko 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2fc 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2i 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ch.ko 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/csiostor 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-19T05:38:44.474 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/dc395x.ko 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/dmx3191d.ko 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esas2r 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esp_scsi.ko 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-19T05:38:44.475 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fnic 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fnic/fnic.ko 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hpsa.ko 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hptiop.ko 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hv_storvsc.ko 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/initio.ko 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ipr.ko 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ips.ko 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/isci 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/isci/isci.ko 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libfc 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libfc/libfc.ko 2024-03-19T05:38:44.476 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libiscsi.ko 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libsas 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libsas/libsas.ko 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/lpfc 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid.ko 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mpt3sas 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvsas 2024-03-19T05:38:44.477 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvumi.ko 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pm8001 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pmcraid.ko 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla1280.ko 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla4xxx 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/raid_class.ko 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_debug.ko 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-19T05:38:44.478 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ses.ko 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/st.ko 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/stex.ko 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/sym53c8xx_2 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/virtio_scsi.ko 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/wd719x.ko 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ssb 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ssb/ssb.ko 2024-03-19T05:38:44.479 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/iscsi 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/loopback 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_file.ko 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_iblock.ko 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_mod.ko 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_pscsi.ko 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_user.ko 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/tcm_fc 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal 2024-03-19T05:38:44.480 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-19T05:38:44.481 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ipwireless 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/n_gsm.ko 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/n_hdlc.ko 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/nozomi.ko 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-19T05:38:44.482 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/arc_uart.ko 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/jsm 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/core 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio.ko 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_aec.ko 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_cif.ko 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_pci_generic.ko 2024-03-19T05:38:44.483 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_sercos3.ko 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/cdc-acm.ko 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/usblp.ko 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/usbtmc.ko 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/mdc800.ko 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/microtek.ko 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/adutux.ko 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/appledisplay.ko 2024-03-19T05:38:44.484 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/emi26.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/emi62.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ezusb.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/idmouse.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/iowarrior.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ldusb.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/legousbtower.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/sisusbvga 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usb3503.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usblcd.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-19T05:38:44.485 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/uss720.ko 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/yurex.ko 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/phy-generic.ko 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/aircable.ko 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ark3116.ko 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ch341.ko 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cp210x.ko 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cyberjack.ko 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/empeg.ko 2024-03-19T05:38:44.486 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/io_ti.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ipaq.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ipw.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ir-usb.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/keyspan.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mct_u232.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mos7720.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mos7840.ko 2024-03-19T05:38:44.487 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/navman.ko 2024-03-19T05:38:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/omninet.ko 2024-03-19T05:38:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/opticon.ko 2024-03-19T05:38:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/option.ko 2024-03-19T05:38:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/oti6858.ko 2024-03-19T05:38:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/pl2303.ko 2024-03-19T05:38:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/qcaux.ko 2024-03-19T05:38:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/qcserial.ko 2024-03-19T05:38:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/quatech2.ko 2024-03-19T05:38:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/safe_serial.ko 2024-03-19T05:38:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/sierra.ko 2024-03-19T05:38:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-19T05:38:44.488 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ssu100.ko 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/symbolserial.ko 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb_debug.ko 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/visor.ko 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/whiteheat.ko 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/uas.ko 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-19T05:38:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-karma.ko 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/usb-storage.ko 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip 2024-03-19T05:38:44.490 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/vfio.ko 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost.ko 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_net.ko 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_scsi.ko 2024-03-19T05:38:44.491 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/apple_bl.ko 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/lcd.ko 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio.ko 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_balloon.ko 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_mmio.ko 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_pci.ko 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_ring.ko 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1 2024-03-19T05:38:44.492 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ds2482.ko 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ds2490.ko 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-19T05:38:44.493 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/wire.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/hpwdt.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/i6300esb.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ib700wdt.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ibmasr.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-19T05:38:44.494 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/it87_wdt.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/machzwd.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/nv_tco.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/softdog.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/via_wdt.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/wdt_pci.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/xen_wdt.ko 2024-03-19T05:38:44.495 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-evtchn.ko 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-gntalloc.ko 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-gntdev.ko 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-pciback 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-privcmd.ko 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xenfs 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/9p 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/9p/9p.ko 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/affs 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/affs/affs.ko 2024-03-19T05:38:44.496 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/befs 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/befs/befs.ko 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/binfmt_misc.ko 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/btrfs 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/btrfs/btrfs.ko 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cachefiles 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cachefiles/cachefiles.ko 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ceph 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ceph/ceph.ko 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/coda 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/coda/coda.ko 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cramfs 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cramfs/cramfs.ko 2024-03-19T05:38:44.497 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/dlm 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/dlm/dlm.ko 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ecryptfs 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/f2fs 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/f2fs/f2fs.ko 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/fat.ko 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/msdos.ko 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/vfat.ko 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse/cuse.ko 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse/fuse.ko 2024-03-19T05:38:44.498 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/gfs2 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/gfs2/gfs2.ko 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfs 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfs/hfs.ko 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfsplus 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfsplus/hfsplus.ko 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/isofs 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/isofs/isofs.ko 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/jfs 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/jfs/jfs.ko 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/lockd 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/lockd/lockd.ko 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/minix 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/minix/minix.ko 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/netfs 2024-03-19T05:38:44.499 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/netfs/netfs.ko 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/blocklayout 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/filelayout 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/flexfilelayout 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfs.ko 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv3.ko 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv4.ko 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/grace.ko 2024-03-19T05:38:44.500 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/nfs_acl.ko 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfsd 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfsd/nfsd.ko 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nilfs2 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nilfs2/nilfs2.ko 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-celtic.ko 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-centeuro.ko 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-croatian.ko 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-cyrillic.ko 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-gaelic.ko 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-greek.ko 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-iceland.ko 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-inuit.ko 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-roman.ko 2024-03-19T05:38:44.501 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-romanian.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-turkish.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1250.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1251.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1255.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp737.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp775.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp850.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp852.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp855.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp857.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp860.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp861.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp862.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp863.ko 2024-03-19T05:38:44.502 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp864.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp865.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp866.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp869.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp874.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp932.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp936.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp949.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp950.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_euc-jp.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-1.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-13.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-14.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-15.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-2.ko 2024-03-19T05:38:44.503 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-3.ko 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-4.ko 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-5.ko 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-6.ko 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-7.ko 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-9.ko 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-r.ko 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-ru.ko 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-u.ko 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_utf8.ko 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/cluster 2024-03-19T05:38:44.504 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlm 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlmfs 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2.ko 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/overlayfs 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/overlayfs/overlay.ko 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/pstore 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/pstore/ramoops.ko 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/reiserfs 2024-03-19T05:38:44.505 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/reiserfs/reiserfs.ko 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/romfs 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/romfs/romfs.ko 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/client 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/client/cifs.ko 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/cifs_arc4.ko 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/cifs_md4.ko 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/squashfs 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/squashfs/squashfs.ko 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/sysv 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/sysv/sysv.ko 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/udf 2024-03-19T05:38:44.506 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/udf/udf.ko 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ufs 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ufs/ufs.ko 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/xfs 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/xfs/xfs.ko 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/rcu 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/rcu/rcutorture.ko 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/torture.ko 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/trace 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/asn1_encoder.ko 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc-itu-t.ko 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc8.ko 2024-03-19T05:38:44.507 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/libarc4.ko 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/libdes.ko 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/libcrc32c.ko 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lru_cache.ko 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/lz4_compress.ko 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/lz4hc_compress.ko 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/math 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/math/cordic.ko 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/raid6 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/raid6/raid6_pq.ko 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/reed_solomon 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-19T05:38:44.508 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_bm.ko 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_fsm.ko 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_kmp.ko 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/zstd 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/zstd/zstd_compress.ko 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/mm 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/mm/hwpoison-inject.ko 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/6lowpan.ko 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_dest.ko 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_fragment.ko 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_hop.ko 2024-03-19T05:38:44.509 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_mobility.ko 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_routing.ko 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_udp.ko 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/garp.ko 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/mrp.ko 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/p8022.ko 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/psnap.ko 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/stp.ko 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/8021q 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/8021q/8021q.ko 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet.ko 2024-03-19T05:38:44.510 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_fd.ko 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_rdma.ko 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_virtio.ko 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/batman-adv 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/batman-adv/batman-adv.ko 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/br_netfilter.ko 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/bridge.ko 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-19T05:38:44.511 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtables.ko 2024-03-19T05:38:44.512 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ceph 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ceph/libceph.ko 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/core 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/core/failover.ko 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/core/pktgen.ko 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp.ko 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_diag.ko 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_ipv4.ko 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_ipv6.ko 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dns_resolver 2024-03-19T05:38:44.513 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dns_resolver/dns_resolver.ko 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/dsa_core.ko 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_brcm.ko 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_dsa.ko 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_none.ko 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_trailer.ko 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/6lowpan 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ieee802154.ko 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ah4.ko 2024-03-19T05:38:44.514 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/esp4.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/fou.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/gre.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/inet_diag.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_gre.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_tunnel.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_vti.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ipcomp.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ipip.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-19T05:38:44.515 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-19T05:38:44.516 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_bic.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_dctcp.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_diag.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_highspeed.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_htcp.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_hybla.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_illinois.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_lp.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_scalable.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_vegas.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_veno.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_westwood.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_yeah.ko 2024-03-19T05:38:44.517 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tunnel4.ko 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/udp_diag.ko 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/udp_tunnel.ko 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ah6.ko 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/esp6.ko 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/fou6.ko 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_tunnel.ko 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_vti.ko 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ipcomp6.ko 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter 2024-03-19T05:38:44.518 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-19T05:38:44.519 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/sit.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/tunnel6.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/key 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/key/af_key.ko 2024-03-19T05:38:44.520 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_core.ko 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_eth.ko 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ip.ko 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ip6.ko 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_netlink.ko 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ppp.ko 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc/llc.ko 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mac802154 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mac802154/mac802154.ko 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mpls 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mpls/mpls_gso.ko 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter 2024-03-19T05:38:44.521 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set.ko 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-19T05:38:44.522 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-19T05:38:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conncount.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-19T05:38:44.524 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_flow_table.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_log_syslog.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_irc.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_sip.ko 2024-03-19T05:38:44.525 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_tables.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_log.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_chain_nat.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_compat.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_ct.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_fib.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-19T05:38:44.526 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_hash.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_limit.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_log.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_masq.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_nat.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_numgen.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_queue.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_quota.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_redir.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_reject.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_reject_inet.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_socket.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_tunnel.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_AUDIT.ko 2024-03-19T05:38:44.527 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CT.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_DSCP.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_HL.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_HMARK.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_LED.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_LOG.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NETMAP.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NFLOG.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_RATEEST.ko 2024-03-19T05:38:44.528 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_SECMARK.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TEE.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TPROXY.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TRACE.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_addrtype.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_bpf.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cgroup.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cluster.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_comment.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connbytes.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connlabel.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connlimit.ko 2024-03-19T05:38:44.529 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connmark.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_conntrack.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cpu.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_dccp.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_devgroup.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_dscp.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ecn.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_esp.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_hashlimit.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_helper.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_hl.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ipcomp.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_iprange.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ipvs.ko 2024-03-19T05:38:44.530 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_l2tp.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_length.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_limit.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_mac.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_mark.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_multiport.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_nat.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_nfacct.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_osf.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_owner.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_physdev.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_pkttype.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_policy.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_quota.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_rateest.ko 2024-03-19T05:38:44.531 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_realm.ko 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_recent.ko 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_sctp.ko 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_set.ko 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_socket.ko 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_state.ko 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_statistic.ko 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_string.ko 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_tcpmss.ko 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_time.ko 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_u32.ko 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netlink 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netlink/netlink_diag.ko 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/nsh 2024-03-19T05:38:44.532 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/nsh/nsh.ko 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/openvswitch.ko 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-geneve.ko 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-gre.ko 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-vxlan.ko 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/packet 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/packet/af_packet_diag.ko 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds.ko 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds_rdma.ko 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds_tcp.ko 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_csum.ko 2024-03-19T05:38:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_gact.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_mirred.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_nat.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_pedit.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_police.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_simple.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_skbedit.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_vlan.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_basic.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_bpf.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_flow.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_fw.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_route.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_u32.ko 2024-03-19T05:38:44.534 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_cmp.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_ipset.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_meta.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_nbyte.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_text.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_u32.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_choke.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_codel.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_drr.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_fq.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_gred.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_hfsc.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_hhf.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_htb.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_ingress.ko 2024-03-19T05:38:44.535 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_mqprio.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_mqprio_lib.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_multiq.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_netem.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_pie.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_plug.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_prio.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_qfq.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_red.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_sfb.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_sfq.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_tbf.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_teql.ko 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp 2024-03-19T05:38:44.536 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/sctp.ko 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/sctp_diag.ko 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/sunrpc.ko 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/xprtrdma 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/diag.ko 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/tipc.ko 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/unix 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/unix/unix_diag.ko 2024-03-19T05:38:44.537 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock.ko 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/encrypted-keys 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/trusted-keys 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/trusted-keys/trusted.ko 2024-03-19T05:38:44.538 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/virt 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/virt/lib 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/virt/lib/irqbypass.ko 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.alias 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.alias.bin 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin.alias.bin 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin.bin 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin.modinfo 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.dep 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.dep.bin 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.devname 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.order 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.softdep 2024-03-19T05:38:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.symbols 2024-03-19T05:38:44.540 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.symbols.bin 2024-03-19T05:38:44.540 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.8.0-g908b6b276e8f/vmlinuz 2024-03-19T05:38:44.544 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g908b6b276e8f 2024-03-19T05:38:44.544 DEBUG:teuthology.orchestra.run.smithi072:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-19T05:38:44.566 INFO:teuthology.orchestra.run.smithi072.stdout:postinstall scriptlet (using /bin/sh): 2024-03-19T05:38:44.566 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-19T05:38:44.566 INFO:teuthology.orchestra.run.smithi072.stdout: /usr/bin/kernel-install add 6.8.0-g908b6b276e8f /lib/modules/6.8.0-g908b6b276e8f/vmlinuz 2024-03-19T05:38:44.566 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2024-03-19T05:38:44.566 INFO:teuthology.orchestra.run.smithi072.stdout:for file in vmlinuz System.map config; do 2024-03-19T05:38:44.566 INFO:teuthology.orchestra.run.smithi072.stdout: if ! cmp --silent "/lib/modules/6.8.0-g908b6b276e8f/${file}" "/boot/${file}-6.8.0-g908b6b276e8f"; then 2024-03-19T05:38:44.566 INFO:teuthology.orchestra.run.smithi072.stdout: cp "/lib/modules/6.8.0-g908b6b276e8f/${file}" "/boot/${file}-6.8.0-g908b6b276e8f" 2024-03-19T05:38:44.566 INFO:teuthology.orchestra.run.smithi072.stdout: fi 2024-03-19T05:38:44.566 INFO:teuthology.orchestra.run.smithi072.stdout:done 2024-03-19T05:38:44.566 INFO:teuthology.orchestra.run.smithi072.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-19T05:38:44.567 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-19T05:38:44.567 INFO:teuthology.orchestra.run.smithi072.stdout:new-kernel-pkg --remove 6.8.0-g908b6b276e8f --rminitrd --initrdfile=/boot/initramfs-6.8.0-g908b6b276e8f.img 2024-03-19T05:38:44.567 INFO:teuthology.orchestra.run.smithi072.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-19T05:38:44.567 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-install remove 6.8.0-g908b6b276e8f 2024-03-19T05:38:44.567 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2024-03-19T05:38:44.567 INFO:teuthology.orchestra.run.smithi072.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-19T05:38:44.567 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-19T05:38:44.567 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/update-bootloader --remove 6.8.0-g908b6b276e8f 2024-03-19T05:38:44.567 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2024-03-19T05:38:44.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2024-03-19T05:38:44.642 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.06 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 68.el9 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:Group : Unspecified 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 8264254 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-19T05:38:44.643 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : builder@centos.org 2024-03-19T05:38:44.644 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : CentOS 2024-03-19T05:38:44.644 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-19T05:38:44.644 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2024-03-19T05:38:44.644 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2024-03-19T05:38:44.644 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:38:44.644 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-19T05:38:44.644 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-19T05:38:44.644 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-19T05:38:44.644 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2024-03-19T05:38:44.644 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:38:44.644 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2024-03-19T05:38:44.645 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-19T05:38:44.646 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 6.8.0-g908b6b276e8f 2024-03-19T05:38:44.646 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-19T05:38:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2024-03-19T05:38:46.916 INFO:teuthology.orchestra.run.smithi072.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-19T05:38:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:done 2024-03-19T05:38:46.944 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-03-19T05:38:46.968 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.8hwxm5o7jj 2024-03-19T05:38:46.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8hwxm5o7jj 2024-03-19T05:38:47.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.8hwxm5o7jj 2024-03-19T05:38:47.181 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.8hwxm5o7jj is 6KB 2024-03-19T05:38:47.230 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.8hwxm5o7jj 2024-03-19T05:38:47.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2024-03-19T05:38:47.309 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-19T05:38:47.310 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-19T05:38:47.310 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-19T05:38:47.310 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g908b6b276e8f.conf 2024-03-19T05:38:47.311 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g908b6b276e8f 2024-03-19T05:38:47.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2024-03-19T05:38:53.514 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-19T05:38:53.514 DEBUG:teuthology.orchestra.run.smithi172:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-19T05:38:53.587 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f 2024-03-19T05:38:53.587 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/System.map 2024-03-19T05:38:53.587 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/config 2024-03-19T05:38:53.587 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel 2024-03-19T05:38:53.587 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch 2024-03-19T05:38:53.587 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86 2024-03-19T05:38:53.587 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto 2024-03-19T05:38:53.587 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-19T05:38:53.587 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-19T05:38:53.587 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-19T05:38:53.587 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-19T05:38:53.588 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/mce 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm.ko 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ansi_cprng.ko 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/anubis.ko 2024-03-19T05:38:53.589 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/arc4.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_memcpy.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_pq.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_tx.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_xor.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/raid6test.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/authenc.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/authencesn.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blake2b_generic.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blowfish_common.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blowfish_generic.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/camellia_generic.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast5_generic.ko 2024-03-19T05:38:53.590 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast6_generic.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast_common.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ccm.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cmac.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crc32_generic.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_engine.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_user.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cts.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/des_generic.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/dh_generic.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/echainiv.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/essiv.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/fcrypt.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/khazad.ko 2024-03-19T05:38:53.591 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lz4.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lz4hc.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/md4.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/michael_mic.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/pcbc.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/pcrypt.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/rmd160.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/seed.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/serpent_generic.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/tcrypt.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/tea.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/twofish_common.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/twofish_generic.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/vmac.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/wp512.ko 2024-03-19T05:38:53.592 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xcbc.ko 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xor.ko 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xxhash_generic.ko 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_pad.ko 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/custom_method.ko 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/ec_sys.ko 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/platform_profile.ko 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/sbs.ko 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/sbshc.ko 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/video.ko 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata 2024-03-19T05:38:53.593 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/acard-ahci.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ahci_platform.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ata_generic.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/libahci_platform.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_acpi.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ali.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_amd.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_artop.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_atiixp.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_atp867x.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cmd640.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cmd64x.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cypress.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_efar.ko 2024-03-19T05:38:53.594 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt366.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt37x.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_it8213.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_it821x.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_jmicron.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_marvell.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_mpiix.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_netcell.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ninja32.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ns87410.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ns87415.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_oldpiix.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_opti.ko 2024-03-19T05:38:53.595 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_optidma.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pcmcia.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_piccolo.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_rdc.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sch.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_serverworks.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sil680.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sis.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sl82c105.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_triflex.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_via.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pdc_adma.ko 2024-03-19T05:38:53.596 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_inic162x.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_mv.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_nv.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_promise.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_qstor.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sil.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sil24.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sis.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_svw.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sx4.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_uli.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_via.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_vsc.ko 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/auxdisplay 2024-03-19T05:38:53.597 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/auxdisplay/ks0108.ko 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base/regmap 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/bcma 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/bcma/bcma.ko 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/aoe 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/aoe/aoe.ko 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/brd.ko 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/drbd 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/drbd/drbd.ko 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/floppy.ko 2024-03-19T05:38:53.598 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/loop.ko 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/mtip32xx 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/nbd.ko 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/null_blk 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/null_blk/null_blk.ko 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/pktcdvd.ko 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/rbd.ko 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/virtio_blk.ko 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkback 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkfront.ko 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/zram 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/zram/zram.ko 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char 2024-03-19T05:38:53.599 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hangcheck-timer.ko 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/via-rng.ko 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-19T05:38:53.600 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/lp.ko 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/mwave 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/mwave/mwave.ko 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ppdev.ko 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tlclk.ko 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm.ko 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/uv_mmtimer.ko 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/virtio_console.ko 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq 2024-03-19T05:38:53.601 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ccp.ko 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_common 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-19T05:38:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/padlock-aes.ko 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/padlock-sha.ko 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/virtio 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dca 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dca/dca.ko 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/devfreq 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/dw 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ioat 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-19T05:38:53.603 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/amd64_edac.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/e752x_edac.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/edac_mce_amd.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i3000_edac.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i3200_edac.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i5100_edac.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i5400_edac.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i7300_edac.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i7core_edac.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i82975x_edac.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/ie31200_edac.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/sb_edac.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/x38_edac.ko 2024-03-19T05:38:53.604 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/edd.ko 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-ich.ko 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-appleir.ko 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-aureal.ko 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-axff.ko 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-dr.ko 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-elecom.ko 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-elo.ko 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-emsff.ko 2024-03-19T05:38:53.605 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gaff.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gt683r.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gyration.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtekff.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-hyperv.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-icade.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-keytouch.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-kye.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lcpower.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-led.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lenovo.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-19T05:38:53.606 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-multitouch.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-ortek.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-penmount.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-petalynx.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-picolcd.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-pl.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-plantronics.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-primax.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-rmi.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-common.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-19T05:38:53.607 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-saitek.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-samsung.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sjoy.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sony.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-speedlink.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-steelseries.ko 2024-03-19T05:38:53.608 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sunplus.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-tivo.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-tmff.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-topseed.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-twinhan.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-uclogic.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-waltop.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-wiimote.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-xinmo.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-zpff.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-zydacron.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/uhid.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/wacom.ko 2024-03-19T05:38:53.609 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_balloon.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_utils.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_vmbus.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/abituguru.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/abituguru3.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ad7414.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ad7418.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adc128d818.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1025.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1026.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1029.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1031.ko 2024-03-19T05:38:53.610 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm9240.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ads7828.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7410.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7411.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7462.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7470.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7475.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7x10.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/amc6821.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/applesmc.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asb100.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asc7621.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/atxp1.ko 2024-03-19T05:38:53.611 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/coretemp.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/dme1737.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ds1621.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ds620.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc1403.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc6w201.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f71805f.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f71882fg.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f75375s.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/fam15h_power.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/fschmd.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/g760a.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/g762.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/gl518sm.ko 2024-03-19T05:38:53.612 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/gl520sm.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/i5500_temp.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/i5k_amb.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ibmaem.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ibmpex.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ina209.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ina2xx.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/it87.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/k10temp.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/k8temp.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lineage-pem.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm63.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm73.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm75.ko 2024-03-19T05:38:53.613 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm77.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm78.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm80.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm83.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm85.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm87.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm90.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm92.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm93.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95234.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95241.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95245.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc2945.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4151.ko 2024-03-19T05:38:53.614 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4215.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4222.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4245.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4260.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4261.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max16065.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max1619.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max1668.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max197.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6639.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6650.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6697.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/mcp3021.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6683.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6775-core.ko 2024-03-19T05:38:53.615 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6775.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct7802.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pc87360.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pc87427.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pcf8591.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-19T05:38:53.616 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/powr1220.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch5627.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch5636.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sht15.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sht21.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/shtc1.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sis5595.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47b397.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47m1.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47m192.ko 2024-03-19T05:38:53.617 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/thmc50.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp102.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp103.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp401.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp421.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/via-cputemp.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/via686a.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/vt1211.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/vt8231.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83627ehf.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83627hf.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83781d.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83791d.ko 2024-03-19T05:38:53.618 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83792d.ko 2024-03-19T05:38:53.619 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83793.ko 2024-03-19T05:38:53.619 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83795.ko 2024-03-19T05:38:53.619 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83l785ts.ko 2024-03-19T05:38:53.621 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83l786ng.ko 2024-03-19T05:38:53.621 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c 2024-03-19T05:38:53.621 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos 2024-03-19T05:38:53.621 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-19T05:38:53.621 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-19T05:38:53.621 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses 2024-03-19T05:38:53.621 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-19T05:38:53.621 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-19T05:38:53.621 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-19T05:38:53.622 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-dev.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-mux.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-smbus.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-stub.ko 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core 2024-03-19T05:38:53.623 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_core.ko 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/cxgb4 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx4 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx5 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mthca 2024-03-19T05:38:53.624 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ipoib 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/iser 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/isert 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srp 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srpt 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-19T05:38:53.625 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/gameport.ko 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/joydev.ko 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/appletouch.ko 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/bcm5974.ko 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/cyapatp.ko 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/sermouse.ko 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-19T05:38:53.626 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/rmi4 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/altera_ps2.ko 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/arc_ps2.ko 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/serio_raw.ko 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/sparse-keymap.ko 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-blinkm.ko 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lm3530.ko 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lp3944.ko 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-ss4200.ko 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-19T05:38:53.627 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/bcache 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/bcache/bcache.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-bio-prison.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-cache-smq.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-cache.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-crypt.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-delay.ko 2024-03-19T05:38:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-flakey.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-log-userspace.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-multipath.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-queue-length.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-raid.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-round-robin.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-service-time.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-switch.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-thin-pool.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-verity.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/persistent-data 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid0.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid1.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid10.ko 2024-03-19T05:38:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid456.ko 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptbase.ko 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptctl.ko 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptfc.ko 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptlan.ko 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptsas.ko 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptscsih.ko 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptspi.ko 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lpc_ich.ko 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lpc_sch.ko 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/mfd-core.ko 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/sm501.ko 2024-03-19T05:38:53.630 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/viperboard.ko 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/vx855.ko 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/wl1273-core.ko 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/altera-stapl 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/apds9802als.ko 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/apds990x.ko 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/bh1770glc.ko 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/cb710 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/cb710/cb710.ko 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/at24.ko 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/max6875.ko 2024-03-19T05:38:53.631 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/enclosure.ko 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/hpilo.ko 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/isl29003.ko 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/isl29020.ko 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei-me.ko 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei-txe.ko 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei.ko 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-gru 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-19T05:38:53.632 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tifm_7xx1.ko 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tifm_core.ko 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tsl2550.ko 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_balloon.ko 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_vmci 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/bonding 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/bonding/bonding.ko 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/b53 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-19T05:38:53.633 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6xxx 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dummy.ko 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/eql.ko 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-19T05:38:53.634 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/adaptec 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/agere 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/alteon 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/altera 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-19T05:38:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/alx 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-19T05:38:53.636 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/genet 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/bna 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-19T05:38:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/enic 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink 2024-03-19T05:38:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dnet.ko 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/benet 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ethoc.ko 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/fealnx.ko 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000e 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-19T05:38:53.639 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/fm10k 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/i40e 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/iavf 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igb 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igbvf 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/jme.ko 2024-03-19T05:38:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-19T05:38:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/neterion 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/nvidia 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-19T05:38:53.642 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rdc 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rocker 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sfc 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-19T05:38:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/silan 2024-03-19T05:38:53.644 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-19T05:38:53.644 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis 2024-03-19T05:38:53.644 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-19T05:38:53.644 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-19T05:38:53.644 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc 2024-03-19T05:38:53.644 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-19T05:38:53.644 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-19T05:38:53.644 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-19T05:38:53.644 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-19T05:38:53.645 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro 2024-03-19T05:38:53.645 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-19T05:38:53.645 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-19T05:38:53.645 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-19T05:38:53.645 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun 2024-03-19T05:38:53.645 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-19T05:38:53.645 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-19T05:38:53.645 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/tehuti 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ti 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/xircom 2024-03-19T05:38:53.646 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/geneve.ko 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/hyperv 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ieee802154 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ifb.ko 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ipvlan 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/macvlan.ko 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/macvtap.ko 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio.ko 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-19T05:38:53.647 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mii.ko 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/net_failover.ko 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/netconsole.ko 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/nlmon.ko 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/amd.ko 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-19T05:38:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm87xx.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/broadcom.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/cicada.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/davicom.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/dp83640.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/et1011c.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/icplus.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/lxt.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/marvell.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/micrel.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/national.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/phylink.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/qsemi.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/realtek.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/smsc.ko 2024-03-19T05:38:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/ste10Xp.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/vitesse.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_async.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pppoe.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pppox.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pptp.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip/slhc.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip/slip.ko 2024-03-19T05:38:53.650 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/sungem_phy.ko 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/tap.ko 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team.ko 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_random.ko 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/tun.ko 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/veth.ko 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/virtio_net.ko 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vmxnet3 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-19T05:38:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vxlan 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vxlan/vxlan.ko 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netback 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netfront.ko 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ntb 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ntb/ntb.ko 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/nvme-core.ko 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/nvme.ko 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport.ko 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_cs.ko 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_pc.ko 2024-03-19T05:38:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_serial.ko 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/pcie 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/xen-pcifront.ko 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/i82092.ko 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/pd6729.ko 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/intel 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform 2024-03-19T05:38:53.653 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/acerhdf.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/hdaps.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-19T05:38:53.654 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel_ips.ko 2024-03-19T05:38:53.655 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-19T05:38:53.655 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-19T05:38:53.655 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-19T05:38:53.655 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-19T05:38:53.655 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-19T05:38:53.655 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-19T05:38:53.655 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-19T05:38:53.655 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-19T05:38:53.655 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-19T05:38:53.656 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/wmi.ko 2024-03-19T05:38:53.656 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap 2024-03-19T05:38:53.656 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-19T05:38:53.656 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-19T05:38:53.656 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps 2024-03-19T05:38:53.656 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients 2024-03-19T05:38:53.656 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-19T05:38:53.656 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-19T05:38:53.656 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps_parport.ko 2024-03-19T05:38:53.656 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/pps_core.ko 2024-03-19T05:38:53.656 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ptp.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ptp_kvm.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-em3027.ko 2024-03-19T05:38:53.657 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max6900.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-19T05:38:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-x1205.ko 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-9xxx.ko 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-sas.ko 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-xxxx.ko 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/BusLogic.ko 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/a100u2w.ko 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aacraid 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/advansys.ko 2024-03-19T05:38:53.659 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/am53c974.ko 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/arcmsr 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/atp870u.ko 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/be2iscsi 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bfa 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bfa/bfa.ko 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2fc 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2i 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ch.ko 2024-03-19T05:38:53.660 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/csiostor 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/dc395x.ko 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/dmx3191d.ko 2024-03-19T05:38:53.661 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esas2r 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esp_scsi.ko 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fnic 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fnic/fnic.ko 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hpsa.ko 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hptiop.ko 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hv_storvsc.ko 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/initio.ko 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ipr.ko 2024-03-19T05:38:53.662 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ips.ko 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/isci 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/isci/isci.ko 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libfc 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libfc/libfc.ko 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libiscsi.ko 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libsas 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libsas/libsas.ko 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/lpfc 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid 2024-03-19T05:38:53.663 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid.ko 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mpt3sas 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvsas 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvumi.ko 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pm8001 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pmcraid.ko 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla1280.ko 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-19T05:38:53.664 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-19T05:38:53.665 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla4xxx 2024-03-19T05:38:53.665 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-19T05:38:53.665 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/raid_class.ko 2024-03-19T05:38:53.665 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_debug.ko 2024-03-19T05:38:53.665 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-19T05:38:53.665 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-19T05:38:53.665 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-19T05:38:53.665 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-19T05:38:53.665 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-19T05:38:53.665 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ses.ko 2024-03-19T05:38:53.665 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/st.ko 2024-03-19T05:38:53.665 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/stex.ko 2024-03-19T05:38:53.666 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/sym53c8xx_2 2024-03-19T05:38:53.666 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-19T05:38:53.666 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/virtio_scsi.ko 2024-03-19T05:38:53.666 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-19T05:38:53.666 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/wd719x.ko 2024-03-19T05:38:53.666 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ssb 2024-03-19T05:38:53.666 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ssb/ssb.ko 2024-03-19T05:38:53.666 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target 2024-03-19T05:38:53.666 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/iscsi 2024-03-19T05:38:53.666 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-19T05:38:53.666 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/loopback 2024-03-19T05:38:53.666 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_file.ko 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_iblock.ko 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_mod.ko 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_pscsi.ko 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_user.ko 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/tcm_fc 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-19T05:38:53.667 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-19T05:38:53.668 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ipwireless 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/n_gsm.ko 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/n_hdlc.ko 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/nozomi.ko 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/arc_uart.ko 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/jsm 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/core 2024-03-19T05:38:53.669 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio.ko 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_aec.ko 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_cif.ko 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_pci_generic.ko 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_sercos3.ko 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/cdc-acm.ko 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/usblp.ko 2024-03-19T05:38:53.670 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/usbtmc.ko 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/mdc800.ko 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/microtek.ko 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/adutux.ko 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/appledisplay.ko 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/emi26.ko 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/emi62.ko 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ezusb.ko 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/idmouse.ko 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/iowarrior.ko 2024-03-19T05:38:53.671 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ldusb.ko 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/legousbtower.ko 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/sisusbvga 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usb3503.ko 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usblcd.ko 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/uss720.ko 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/yurex.ko 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/phy-generic.ko 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/aircable.ko 2024-03-19T05:38:53.672 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ark3116.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ch341.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cp210x.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cyberjack.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/empeg.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/io_ti.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ipaq.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ipw.ko 2024-03-19T05:38:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ir-usb.ko 2024-03-19T05:38:53.674 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-19T05:38:53.674 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/keyspan.ko 2024-03-19T05:38:53.674 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-19T05:38:53.674 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-19T05:38:53.674 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-19T05:38:53.674 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mct_u232.ko 2024-03-19T05:38:53.674 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mos7720.ko 2024-03-19T05:38:53.674 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mos7840.ko 2024-03-19T05:38:53.674 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/navman.ko 2024-03-19T05:38:53.674 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/omninet.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/opticon.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/option.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/oti6858.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/pl2303.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/qcaux.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/qcserial.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/quatech2.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/safe_serial.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/sierra.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ssu100.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/symbolserial.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-19T05:38:53.675 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb_debug.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/visor.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/whiteheat.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/uas.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-karma.ko 2024-03-19T05:38:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/usb-storage.ko 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/vfio.ko 2024-03-19T05:38:53.677 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost.ko 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_net.ko 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_scsi.ko 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/apple_bl.ko 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/lcd.ko 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio.ko 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_balloon.ko 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_mmio.ko 2024-03-19T05:38:53.678 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_pci.ko 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_ring.ko 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ds2482.ko 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ds2490.ko 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-19T05:38:53.679 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/wire.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/hpwdt.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/i6300esb.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-19T05:38:53.680 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ib700wdt.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ibmasr.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/it87_wdt.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/machzwd.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/nv_tco.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/softdog.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/via_wdt.ko 2024-03-19T05:38:53.681 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/wdt_pci.ko 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/xen_wdt.ko 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-evtchn.ko 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-gntalloc.ko 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-gntdev.ko 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-pciback 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-privcmd.ko 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xenfs 2024-03-19T05:38:53.682 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/9p 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/9p/9p.ko 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/affs 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/affs/affs.ko 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/befs 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/befs/befs.ko 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/binfmt_misc.ko 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/btrfs 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/btrfs/btrfs.ko 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cachefiles 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cachefiles/cachefiles.ko 2024-03-19T05:38:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ceph 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ceph/ceph.ko 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/coda 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/coda/coda.ko 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cramfs 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cramfs/cramfs.ko 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/dlm 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/dlm/dlm.ko 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ecryptfs 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/f2fs 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/f2fs/f2fs.ko 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/fat.ko 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/msdos.ko 2024-03-19T05:38:53.684 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/vfat.ko 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse/cuse.ko 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse/fuse.ko 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/gfs2 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/gfs2/gfs2.ko 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfs 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfs/hfs.ko 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfsplus 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfsplus/hfsplus.ko 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/isofs 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/isofs/isofs.ko 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/jfs 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/jfs/jfs.ko 2024-03-19T05:38:53.685 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/lockd 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/lockd/lockd.ko 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/minix 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/minix/minix.ko 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/netfs 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/netfs/netfs.ko 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/blocklayout 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/filelayout 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/flexfilelayout 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfs.ko 2024-03-19T05:38:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv3.ko 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv4.ko 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/grace.ko 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/nfs_acl.ko 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfsd 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfsd/nfsd.ko 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nilfs2 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nilfs2/nilfs2.ko 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-celtic.ko 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-centeuro.ko 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-croatian.ko 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-cyrillic.ko 2024-03-19T05:38:53.687 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-gaelic.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-greek.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-iceland.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-inuit.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-roman.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-romanian.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-turkish.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1250.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1251.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1255.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp737.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp775.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp850.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp852.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp855.ko 2024-03-19T05:38:53.688 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp857.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp860.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp861.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp862.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp863.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp864.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp865.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp866.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp869.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp874.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp932.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp936.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp949.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp950.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_euc-jp.ko 2024-03-19T05:38:53.689 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-1.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-13.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-14.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-15.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-2.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-3.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-4.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-5.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-6.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-7.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-9.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-r.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-ru.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-u.ko 2024-03-19T05:38:53.690 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_utf8.ko 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/cluster 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlm 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlmfs 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2.ko 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/overlayfs 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/overlayfs/overlay.ko 2024-03-19T05:38:53.691 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/pstore 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/pstore/ramoops.ko 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/reiserfs 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/reiserfs/reiserfs.ko 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/romfs 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/romfs/romfs.ko 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/client 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/client/cifs.ko 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/cifs_arc4.ko 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/cifs_md4.ko 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/squashfs 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/squashfs/squashfs.ko 2024-03-19T05:38:53.692 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/sysv 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/sysv/sysv.ko 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/udf 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/udf/udf.ko 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ufs 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ufs/ufs.ko 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/xfs 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/xfs/xfs.ko 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/rcu 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/rcu/rcutorture.ko 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/torture.ko 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/trace 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib 2024-03-19T05:38:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/asn1_encoder.ko 2024-03-19T05:38:53.694 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc-itu-t.ko 2024-03-19T05:38:53.694 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc8.ko 2024-03-19T05:38:53.694 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto 2024-03-19T05:38:53.694 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/libarc4.ko 2024-03-19T05:38:53.694 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/libdes.ko 2024-03-19T05:38:53.694 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/libcrc32c.ko 2024-03-19T05:38:53.694 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lru_cache.ko 2024-03-19T05:38:53.694 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4 2024-03-19T05:38:53.695 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/lz4_compress.ko 2024-03-19T05:38:53.695 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/lz4hc_compress.ko 2024-03-19T05:38:53.695 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/math 2024-03-19T05:38:53.695 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/math/cordic.ko 2024-03-19T05:38:53.695 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/raid6 2024-03-19T05:38:53.695 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/raid6/raid6_pq.ko 2024-03-19T05:38:53.695 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/reed_solomon 2024-03-19T05:38:53.695 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-19T05:38:53.696 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_bm.ko 2024-03-19T05:38:53.696 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_fsm.ko 2024-03-19T05:38:53.696 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_kmp.ko 2024-03-19T05:38:53.696 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/zstd 2024-03-19T05:38:53.696 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/zstd/zstd_compress.ko 2024-03-19T05:38:53.696 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/mm 2024-03-19T05:38:53.696 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/mm/hwpoison-inject.ko 2024-03-19T05:38:53.696 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/6lowpan.ko 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_dest.ko 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_fragment.ko 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_hop.ko 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_mobility.ko 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_routing.ko 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_udp.ko 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/garp.ko 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/mrp.ko 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/p8022.ko 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/psnap.ko 2024-03-19T05:38:53.697 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/stp.ko 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/8021q 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/8021q/8021q.ko 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet.ko 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_fd.ko 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_rdma.ko 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_virtio.ko 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/batman-adv 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/batman-adv/batman-adv.ko 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/br_netfilter.ko 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/bridge.ko 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter 2024-03-19T05:38:53.698 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-19T05:38:53.699 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtables.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ceph 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ceph/libceph.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/core 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/core/failover.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/core/pktgen.ko 2024-03-19T05:38:53.700 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp.ko 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_diag.ko 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_ipv4.ko 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_ipv6.ko 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dns_resolver 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dns_resolver/dns_resolver.ko 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/dsa_core.ko 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_brcm.ko 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_dsa.ko 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_none.ko 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_trailer.ko 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154 2024-03-19T05:38:53.701 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/6lowpan 2024-03-19T05:38:53.702 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-19T05:38:53.702 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ieee802154.ko 2024-03-19T05:38:53.702 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-19T05:38:53.702 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4 2024-03-19T05:38:53.702 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ah4.ko 2024-03-19T05:38:53.702 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/esp4.ko 2024-03-19T05:38:53.702 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/fou.ko 2024-03-19T05:38:53.702 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/gre.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/inet_diag.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_gre.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_tunnel.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_vti.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ipcomp.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ipip.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-19T05:38:53.703 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-19T05:38:53.704 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-19T05:38:53.705 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_bic.ko 2024-03-19T05:38:53.705 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_dctcp.ko 2024-03-19T05:38:53.705 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_diag.ko 2024-03-19T05:38:53.705 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_highspeed.ko 2024-03-19T05:38:53.705 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_htcp.ko 2024-03-19T05:38:53.705 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_hybla.ko 2024-03-19T05:38:53.705 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_illinois.ko 2024-03-19T05:38:53.705 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_lp.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_scalable.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_vegas.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_veno.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_westwood.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_yeah.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tunnel4.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/udp_diag.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/udp_tunnel.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ah6.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/esp6.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/fou6.ko 2024-03-19T05:38:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_tunnel.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_vti.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ipcomp6.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-19T05:38:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-19T05:38:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/sit.ko 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/tunnel6.ko 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/key 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/key/af_key.ko 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_core.ko 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_eth.ko 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ip.ko 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ip6.ko 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_netlink.ko 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ppp.ko 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc 2024-03-19T05:38:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc/llc.ko 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mac802154 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mac802154/mac802154.ko 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mpls 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mpls/mpls_gso.ko 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set.ko 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-19T05:38:53.710 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-19T05:38:53.711 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conncount.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-19T05:38:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_flow_table.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_log_syslog.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat.ko 2024-03-19T05:38:53.713 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_irc.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_sip.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_tables.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_log.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_chain_nat.ko 2024-03-19T05:38:53.714 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_compat.ko 2024-03-19T05:38:53.715 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_ct.ko 2024-03-19T05:38:53.715 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-19T05:38:53.715 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_fib.ko 2024-03-19T05:38:53.715 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-19T05:38:53.715 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_hash.ko 2024-03-19T05:38:53.715 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_limit.ko 2024-03-19T05:38:53.715 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_log.ko 2024-03-19T05:38:53.715 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_masq.ko 2024-03-19T05:38:53.715 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_nat.ko 2024-03-19T05:38:53.715 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_numgen.ko 2024-03-19T05:38:53.715 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_queue.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_quota.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_redir.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_reject.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_reject_inet.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_socket.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_tunnel.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_AUDIT.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CT.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_DSCP.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_HL.ko 2024-03-19T05:38:53.716 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_HMARK.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_LED.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_LOG.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NETMAP.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NFLOG.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_RATEEST.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_SECMARK.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TEE.ko 2024-03-19T05:38:53.717 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TPROXY.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TRACE.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_addrtype.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_bpf.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cgroup.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cluster.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_comment.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connbytes.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connlabel.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connlimit.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connmark.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_conntrack.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cpu.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_dccp.ko 2024-03-19T05:38:53.718 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_devgroup.ko 2024-03-19T05:38:53.719 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_dscp.ko 2024-03-19T05:38:53.719 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ecn.ko 2024-03-19T05:38:53.719 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_esp.ko 2024-03-19T05:38:53.719 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_hashlimit.ko 2024-03-19T05:38:53.719 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_helper.ko 2024-03-19T05:38:53.719 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_hl.ko 2024-03-19T05:38:53.719 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ipcomp.ko 2024-03-19T05:38:53.719 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_iprange.ko 2024-03-19T05:38:53.719 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ipvs.ko 2024-03-19T05:38:53.719 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_l2tp.ko 2024-03-19T05:38:53.719 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_length.ko 2024-03-19T05:38:53.719 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_limit.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_mac.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_mark.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_multiport.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_nat.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_nfacct.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_osf.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_owner.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_physdev.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_pkttype.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_policy.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_quota.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_rateest.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_realm.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_recent.ko 2024-03-19T05:38:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_sctp.ko 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_set.ko 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_socket.ko 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_state.ko 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_statistic.ko 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_string.ko 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_tcpmss.ko 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_time.ko 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_u32.ko 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netlink 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netlink/netlink_diag.ko 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/nsh 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/nsh/nsh.ko 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch 2024-03-19T05:38:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/openvswitch.ko 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-geneve.ko 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-gre.ko 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-vxlan.ko 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/packet 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/packet/af_packet_diag.ko 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds.ko 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds_rdma.ko 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds_tcp.ko 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_csum.ko 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_gact.ko 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_mirred.ko 2024-03-19T05:38:53.722 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_nat.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_pedit.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_police.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_simple.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_skbedit.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_vlan.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_basic.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_bpf.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_flow.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_fw.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_route.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_u32.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_cmp.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_ipset.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_meta.ko 2024-03-19T05:38:53.723 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_nbyte.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_text.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_u32.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_choke.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_codel.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_drr.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_fq.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_gred.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_hfsc.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_hhf.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_htb.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_ingress.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_mqprio.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_mqprio_lib.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_multiq.ko 2024-03-19T05:38:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_netem.ko 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_pie.ko 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_plug.ko 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_prio.ko 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_qfq.ko 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_red.ko 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_sfb.ko 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_sfq.ko 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_tbf.ko 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_teql.ko 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/sctp.ko 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/sctp_diag.ko 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss 2024-03-19T05:38:53.725 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/sunrpc.ko 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/xprtrdma 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/diag.ko 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/tipc.ko 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/unix 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/unix/unix_diag.ko 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-19T05:38:53.726 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock.ko 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/encrypted-keys 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/trusted-keys 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/trusted-keys/trusted.ko 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/virt 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/virt/lib 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/virt/lib/irqbypass.ko 2024-03-19T05:38:53.727 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.alias 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.alias.bin 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin.alias.bin 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin.bin 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin.modinfo 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.dep 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.dep.bin 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.devname 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.order 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.softdep 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.symbols 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.symbols.bin 2024-03-19T05:38:53.728 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.8.0-g908b6b276e8f/vmlinuz 2024-03-19T05:38:53.732 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g908b6b276e8f 2024-03-19T05:38:53.732 DEBUG:teuthology.orchestra.run.smithi172:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-19T05:38:53.755 INFO:teuthology.orchestra.run.smithi172.stdout:postinstall scriptlet (using /bin/sh): 2024-03-19T05:38:53.755 INFO:teuthology.orchestra.run.smithi172.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-19T05:38:53.755 INFO:teuthology.orchestra.run.smithi172.stdout: /usr/bin/kernel-install add 6.8.0-g908b6b276e8f /lib/modules/6.8.0-g908b6b276e8f/vmlinuz 2024-03-19T05:38:53.755 INFO:teuthology.orchestra.run.smithi172.stdout:fi 2024-03-19T05:38:53.755 INFO:teuthology.orchestra.run.smithi172.stdout:for file in vmlinuz System.map config; do 2024-03-19T05:38:53.755 INFO:teuthology.orchestra.run.smithi172.stdout: if ! cmp --silent "/lib/modules/6.8.0-g908b6b276e8f/${file}" "/boot/${file}-6.8.0-g908b6b276e8f"; then 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout: cp "/lib/modules/6.8.0-g908b6b276e8f/${file}" "/boot/${file}-6.8.0-g908b6b276e8f" 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout: fi 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout:done 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout:new-kernel-pkg --remove 6.8.0-g908b6b276e8f --rminitrd --initrdfile=/boot/initramfs-6.8.0-g908b6b276e8f.img 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-install remove 6.8.0-g908b6b276e8f 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout:fi 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout:/sbin/update-bootloader --remove 6.8.0-g908b6b276e8f 2024-03-19T05:38:53.756 INFO:teuthology.orchestra.run.smithi172.stdout:fi 2024-03-19T05:38:53.757 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -qi grub2-tools 2024-03-19T05:38:53.833 INFO:teuthology.orchestra.run.smithi172.stdout:Name : grub2-tools 2024-03-19T05:38:53.834 INFO:teuthology.orchestra.run.smithi172.stdout:Epoch : 1 2024-03-19T05:38:53.834 INFO:teuthology.orchestra.run.smithi172.stdout:Version : 2.06 2024-03-19T05:38:53.834 INFO:teuthology.orchestra.run.smithi172.stdout:Release : 68.el9 2024-03-19T05:38:53.834 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: x86_64 2024-03-19T05:38:53.834 INFO:teuthology.orchestra.run.smithi172.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-19T05:38:53.834 INFO:teuthology.orchestra.run.smithi172.stdout:Group : Unspecified 2024-03-19T05:38:53.834 INFO:teuthology.orchestra.run.smithi172.stdout:Size : 8264254 2024-03-19T05:38:53.834 INFO:teuthology.orchestra.run.smithi172.stdout:License : GPLv3+ 2024-03-19T05:38:53.834 INFO:teuthology.orchestra.run.smithi172.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-19T05:38:53.834 INFO:teuthology.orchestra.run.smithi172.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout:Packager : builder@centos.org 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout:Vendor : CentOS 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout:Summary : Support tools for GRUB. 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout:Description : 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout:hardware devices. 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:38:53.835 INFO:teuthology.orchestra.run.smithi172.stdout:This subpackage provides tools for support of all platforms. 2024-03-19T05:38:53.836 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-19T05:38:53.837 INFO:teuthology.task.kernel:Updating grub on smithi172 to boot 6.8.0-g908b6b276e8f 2024-03-19T05:38:53.837 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-19T05:38:54.442 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-03-19T05:38:55.871 INFO:teuthology.orchestra.run.smithi172.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-19T05:38:55.908 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-03-19T05:38:55.911 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-03-19T05:38:55.925 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.aC2BKbLfoy 2024-03-19T05:38:55.926 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.aC2BKbLfoy 2024-03-19T05:38:55.994 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.aC2BKbLfoy 2024-03-19T05:38:56.136 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.aC2BKbLfoy is 6KB 2024-03-19T05:38:56.185 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.aC2BKbLfoy 2024-03-19T05:38:56.200 DEBUG:teuthology.orchestra.run.smithi172:> sudo /bin/ls /boot/loader/entries || true 2024-03-19T05:38:56.264 INFO:teuthology.orchestra.run.smithi172.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-19T05:38:56.264 INFO:teuthology.orchestra.run.smithi172.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-19T05:38:56.264 INFO:teuthology.orchestra.run.smithi172.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-19T05:38:56.264 INFO:teuthology.orchestra.run.smithi172.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g908b6b276e8f.conf 2024-03-19T05:38:56.266 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g908b6b276e8f 2024-03-19T05:38:56.447 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-03-19T05:39:17.470 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-03-19T05:39:17.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-19T05:39:17.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:39:26.458 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-03-19T05:39:26.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-19T05:39:26.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:39:35.838 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-03-19T05:39:44.798 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-19T05:39:44.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-19T05:39:44.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:39:47.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-03-19T05:39:53.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-19T05:39:53.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:39:56.866 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-19T05:39:59.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-19T05:39:59.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:40:08.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-19T05:40:08.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:40:18.335 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-03-19T05:40:27.294 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-19T05:40:33.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-19T05:40:33.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:40:40.923 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-03-19T05:40:41.096 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-19T05:40:41.096 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.8.0-g908b6b276e8f"... 2024-03-19T05:40:41.097 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-03-19T05:40:41.141 INFO:teuthology.orchestra.run.smithi072.stdout:6.8.0-g908b6b276e8f 2024-03-19T05:40:41.142 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g908b6b276e8f vs 6.8.0-g908b6b276e8f 2024-03-19T05:40:41.142 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-19T05:40:41.142 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-19T05:40:42.142 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-03-19T05:40:42.143 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-19T05:40:42.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-19T05:40:42.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:40:42.322 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2024-03-19T05:40:42.379 DEBUG:teuthology.parallel:result is None 2024-03-19T05:40:45.378 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-19T05:41:03.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-19T05:41:03.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:41:03.849 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-03-19T05:41:04.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-19T05:41:04.529 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.8.0-g908b6b276e8f"... 2024-03-19T05:41:04.529 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-03-19T05:41:04.571 INFO:teuthology.orchestra.run.smithi172.stdout:6.8.0-g908b6b276e8f 2024-03-19T05:41:04.571 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g908b6b276e8f vs 6.8.0-g908b6b276e8f 2024-03-19T05:41:04.571 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-19T05:41:04.571 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-19T05:41:05.572 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-03-19T05:41:05.572 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-19T05:41:05.700 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-03-19T05:41:05.753 DEBUG:teuthology.parallel:result is None 2024-03-19T05:41:05.753 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-19T05:41:05.769 INFO:teuthology.task.internal:Creating test directory... 2024-03-19T05:41:05.769 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-19T05:41:05.778 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-19T05:41:05.837 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-19T05:41:05.844 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-19T05:41:05.863 INFO:teuthology.task.internal:Creating archive directory... 2024-03-19T05:41:05.863 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-19T05:41:05.870 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-19T05:41:05.933 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-19T05:41:05.940 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-19T05:41:05.941 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-19T05:41:05.946 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-19T05:41:06.041 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-19T05:41:06.049 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-19T05:41:06.082 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-19T05:41:06.090 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-19T05:41:06.095 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-19T05:41:06.105 INFO:teuthology.task.internal:Configuring sudo... 2024-03-19T05:41:06.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-19T05:41:06.112 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-19T05:41:06.211 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-19T05:41:06.221 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-19T05:41:06.221 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-19T05:41:06.226 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-19T05:41:06.280 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-19T05:41:06.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-19T05:41:06.478 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-19T05:41:06.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-19T05:41:06.657 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:41:06.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-19T05:41:06.753 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-19T05:41:06.840 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-19T05:41:06.947 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-19T05:41:07.034 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-19T05:41:07.125 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T05:41:07.125 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-19T05:41:07.216 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2024-03-19T05:41:07.224 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-03-19T05:41:07.351 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-19T05:41:07.383 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-19T05:41:07.738 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-19T05:41:07.746 INFO:teuthology.task.internal:Starting timer... 2024-03-19T05:41:07.746 INFO:teuthology.run_tasks:Running task pcp... 2024-03-19T05:41:07.768 INFO:teuthology.run_tasks:Running task selinux... 2024-03-19T05:41:07.776 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-03-19T05:41:07.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2024-03-19T05:41:07.942 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2024-03-19T05:41:07.946 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-03-19T05:41:08.087 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-03-19T05:41:08.092 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-19T05:41:08.092 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2024-03-19T05:41:08.158 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2024-03-19T05:41:08.158 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-03-19T05:41:08.206 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-03-19T05:41:08.206 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-03-19T05:41:08.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-19T05:41:08.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T05:41:08.299 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-19T05:41:08.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T05:41:08.383 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-19T05:41:08.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2024-03-19T05:41:08.470 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-03-19T05:41:08.562 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-19T05:41:08.572 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-19T05:41:08.578 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-19T05:41:08.728 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-19T05:41:08.746 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-19T05:41:08.747 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-19T05:47:17.938 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-03-19T05:47:17.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-19T05:47:17.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:47:18.085 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-03-19T05:47:18.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-19T05:47:18.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-19T05:47:18.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:47:18.369 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-03-19T05:47:18.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-19T05:47:18.513 INFO:teuthology.run_tasks:Running task clock... 2024-03-19T05:47:18.525 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-19T05:47:18.525 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-19T05:47:18.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-19T05:47:18.533 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-19T05:47:18.534 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-19T05:47:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-19T05:47:18.649 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-19T05:47:18.678 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-19T05:47:18.698 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-19T05:47:18.769 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2024-03-19T05:47:18.794 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-03-19T05:47:18.810 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2024-03-19T05:47:18.834 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-03-19T05:47:18.861 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-19T05:47:18.878 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-19T05:47:18.915 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-19T05:47:18.927 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-19T05:47:19.044 INFO:teuthology.orchestra.run.smithi072.stderr:bash: line 1: ntpq: command not found 2024-03-19T05:47:19.052 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-19T05:47:19.052 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2024-03-19T05:47:19.052 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:47:19.052 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:47:19.052 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:47:19.052 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:47:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-03-19T05:47:19.076 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-19T05:47:19.076 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-03-19T05:47:19.076 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:47:19.076 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:47:19.076 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:47:19.076 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:47:19.078 INFO:teuthology.run_tasks:Running task install... 2024-03-19T05:47:19.087 DEBUG:teuthology.task.install:project ceph 2024-03-19T05:47:19.087 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'}} 2024-03-19T05:47:19.087 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'} 2024-03-19T05:47:19.087 INFO:teuthology.task.install:Using flavor: default 2024-03-19T05:47:19.096 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-19T05:47:19.096 INFO:teuthology.task.install:extra packages: [] 2024-03-19T05:47:19.097 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-03-19T05:47:19.097 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-03-19T05:47:19.097 INFO:teuthology.packaging:ref: None 2024-03-19T05:47:19.097 INFO:teuthology.packaging:tag: v18.2.0 2024-03-19T05:47:19.098 INFO:teuthology.packaging:branch: None 2024-03-19T05:47:19.098 INFO:teuthology.packaging:sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T05:47:19.609 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v18.2.0^{} -> None 2024-03-19T05:47:19.609 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-03-19T05:47:21.562 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-03-19T05:47:21.562 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-03-19T05:47:21.565 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-03-19T05:47:21.565 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-03-19T05:47:21.566 INFO:teuthology.packaging:ref: None 2024-03-19T05:47:21.566 INFO:teuthology.packaging:tag: v18.2.0 2024-03-19T05:47:21.566 INFO:teuthology.packaging:branch: None 2024-03-19T05:47:21.566 INFO:teuthology.packaging:sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T05:47:21.566 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-03-19T05:47:21.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-03-19T05:47:21.835 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-03-19T05:47:21.835 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-03-19T05:47:21.838 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-03-19T05:47:21.838 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-03-19T05:47:21.882 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-19T05:47:21.883 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:47:21.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-19T05:47:21.895 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-19T05:47:21.895 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T05:47:21.896 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-19T05:47:21.984 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-19T05:47:21.984 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-03-19T05:47:21.985 INFO:teuthology.packaging:ref: None 2024-03-19T05:47:21.985 INFO:teuthology.packaging:tag: v18.2.0 2024-03-19T05:47:21.985 INFO:teuthology.packaging:branch: None 2024-03-19T05:47:21.985 INFO:teuthology.packaging:sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T05:47:21.985 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-19T05:47:21.996 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-19T05:47:21.997 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-03-19T05:47:21.997 INFO:teuthology.packaging:ref: None 2024-03-19T05:47:21.997 INFO:teuthology.packaging:tag: v18.2.0 2024-03-19T05:47:21.997 INFO:teuthology.packaging:branch: None 2024-03-19T05:47:21.997 INFO:teuthology.packaging:sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T05:47:21.997 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-19T05:47:22.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-19T05:47:22.137 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-19T05:47:22.259 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-19T05:47:22.262 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-19T05:47:22.344 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2024-03-19T05:47:22.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2024-03-19T05:47:22.349 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-03-19T05:47:22.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-03-19T05:47:22.697 INFO:teuthology.orchestra.run.smithi072.stdout:74 files removed 2024-03-19T05:47:22.727 INFO:teuthology.orchestra.run.smithi172.stdout:74 files removed 2024-03-19T05:47:22.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw 2024-03-19T05:47:22.767 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw 2024-03-19T05:47:23.408 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 448 kB/s | 76 kB 00:00 2024-03-19T05:47:23.434 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 457 kB/s | 76 kB 00:00 2024-03-19T05:47:23.617 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 59 kB/s | 9.3 kB 00:00 2024-03-19T05:47:23.650 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 54 kB/s | 9.3 kB 00:00 2024-03-19T05:47:23.819 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 13 kB/s | 2.2 kB 00:00 2024-03-19T05:47:23.861 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 13 kB/s | 2.2 kB 00:00 2024-03-19T05:47:24.382 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-03-19T05:47:24.383 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-19T05:47:25.932 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2024-03-19T05:47:26.127 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - BaseOS 4.3 MB/s | 2.0 MB 00:00 2024-03-19T05:47:27.650 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 7.1 MB/s | 8.0 MB 00:01 2024-03-19T05:47:28.236 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.0 MB 00:01 2024-03-19T05:47:30.279 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-03-19T05:47:37.338 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 6.1 MB 00:03 2024-03-19T05:47:39.389 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 16 kB 00:00 2024-03-19T05:47:44.119 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-03-19T05:47:49.771 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.1 MB 00:01 2024-03-19T05:47:51.274 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 16 kB 00:00 2024-03-19T05:47:54.278 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 7.3 MB/s | 21 MB 00:02 2024-03-19T05:48:00.079 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-03-19T05:48:00.752 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 998 kB/s | 21 MB 00:21 2024-03-19T05:48:02.876 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:48:02.897 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:48:02.898 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-03-19T05:48:02.898 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:48:02.898 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:48:02.898 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-03-19T05:48:02.898 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2024-03-19T05:48:02.901 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-03-19T05:48:02.901 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-03-19T05:48:02.901 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-03-19T05:48:02.901 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-19T05:48:02.901 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-03-19T05:48:02.901 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-03-19T05:48:02.901 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-03-19T05:48:02.901 INFO:teuthology.orchestra.run.smithi072.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-19T05:48:02.902 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout:Install 28 Packages 2024-03-19T05:48:02.903 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 2 Packages 2024-03-19T05:48:02.904 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:02.904 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 53 M 2024-03-19T05:48:02.904 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:48:03.363 INFO:teuthology.orchestra.run.smithi072.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 13 MB/s | 5.2 MB 00:00 2024-03-19T05:48:03.393 INFO:teuthology.orchestra.run.smithi072.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 841 kB/s | 24 kB 00:00 2024-03-19T05:48:03.451 INFO:teuthology.orchestra.run.smithi072.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 11 MB/s | 653 kB 00:00 2024-03-19T05:48:03.502 INFO:teuthology.orchestra.run.smithi072.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 9.4 MB/s | 474 kB 00:00 2024-03-19T05:48:03.728 INFO:teuthology.orchestra.run.smithi072.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 10 MB/s | 7.6 MB 00:00 2024-03-19T05:48:03.753 INFO:teuthology.orchestra.run.smithi072.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-03-19T05:48:03.787 INFO:teuthology.orchestra.run.smithi072.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 3.6 MB/s | 119 kB 00:00 2024-03-19T05:48:03.821 INFO:teuthology.orchestra.run.smithi072.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 4.6 MB/s | 155 kB 00:00 2024-03-19T05:48:03.872 INFO:teuthology.orchestra.run.smithi072.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-03-19T05:48:03.914 INFO:teuthology.orchestra.run.smithi072.stdout:(10/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 7.1 MB/s | 297 kB 00:00 2024-03-19T05:48:03.949 INFO:teuthology.orchestra.run.smithi072.stdout:(11/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 2.9 MB/s | 99 kB 00:00 2024-03-19T05:48:04.142 INFO:teuthology.orchestra.run.smithi072.stdout:(12/30): librgw2-18.2.0-0.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-03-19T05:48:04.209 INFO:teuthology.orchestra.run.smithi072.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 410 kB/s | 106 kB 00:00 2024-03-19T05:48:04.243 INFO:teuthology.orchestra.run.smithi072.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 159 kB 00:00 2024-03-19T05:48:04.268 INFO:teuthology.orchestra.run.smithi072.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 770 kB/s | 44 kB 00:00 2024-03-19T05:48:04.319 INFO:teuthology.orchestra.run.smithi072.stdout:(16/30): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-19T05:48:04.353 INFO:teuthology.orchestra.run.smithi072.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 282 kB 00:00 2024-03-19T05:48:04.378 INFO:teuthology.orchestra.run.smithi072.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 734 kB/s | 41 kB 00:00 2024-03-19T05:48:04.771 INFO:teuthology.orchestra.run.smithi072.stdout:(19/30): ceph-common-18.2.0-0.el9.x86_64.rpm 10 MB/s | 18 MB 00:01 2024-03-19T05:48:04.913 INFO:teuthology.orchestra.run.smithi072.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 198 kB/s | 111 kB 00:00 2024-03-19T05:48:04.972 INFO:teuthology.orchestra.run.smithi072.stdout:(21/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 521 kB/s | 309 kB 00:00 2024-03-19T05:48:05.030 INFO:teuthology.orchestra.run.smithi072.stdout:(22/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-03-19T05:48:05.081 INFO:teuthology.orchestra.run.smithi072.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 447 kB/s | 49 kB 00:00 2024-03-19T05:48:05.165 INFO:teuthology.orchestra.run.smithi072.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 504 kB/s | 67 kB 00:00 2024-03-19T05:48:05.492 INFO:teuthology.orchestra.run.smithi072.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 587 kB/s | 192 kB 00:00 2024-03-19T05:48:05.659 INFO:teuthology.orchestra.run.smithi072.stdout:(26/30): libarrow-9.0.0-10.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-03-19T05:48:05.743 INFO:teuthology.orchestra.run.smithi072.stdout:(27/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-03-19T05:48:05.902 INFO:teuthology.orchestra.run.smithi072.stdout:(28/30): librbd1-18.2.0-0.el9.x86_64.rpm 19 MB/s | 3.0 MB 00:00 2024-03-19T05:48:05.994 INFO:teuthology.orchestra.run.smithi072.stdout:(29/30): librados2-18.2.0-0.el9.x86_64.rpm 9.8 MB/s | 3.3 MB 00:00 2024-03-19T05:48:06.128 INFO:teuthology.orchestra.run.smithi072.stdout:(30/30): thrift-0.15.0-2.el9.x86_64.rpm 2.5 MB/s | 1.6 MB 00:00 2024-03-19T05:48:06.135 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:48:06.136 INFO:teuthology.orchestra.run.smithi072.stdout:Total 16 MB/s | 53 MB 00:03 2024-03-19T05:48:06.137 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:48:06.214 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:48:06.214 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:48:06.479 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-03-19T05:48:06.718 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:48:06.719 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:48:08.339 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:48:08.449 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-03-19T05:48:08.487 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-03-19T05:48:08.594 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-03-19T05:48:08.989 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-03-19T05:48:09.137 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-03-19T05:48:09.148 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:48:09.165 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:48:09.165 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-03-19T05:48:09.165 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:48:09.165 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:48:09.165 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-03-19T05:48:09.165 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-03-19T05:48:09.165 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-19T05:48:09.166 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-19T05:48:09.167 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-19T05:48:09.167 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-03-19T05:48:09.167 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-19T05:48:09.167 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-03-19T05:48:09.167 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-19T05:48:09.167 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-19T05:48:09.167 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-19T05:48:09.167 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-03-19T05:48:09.167 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-03-19T05:48:09.167 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-03-19T05:48:09.168 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-19T05:48:09.168 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-03-19T05:48:09.168 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-03-19T05:48:09.168 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-03-19T05:48:09.168 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-19T05:48:09.168 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-19T05:48:09.168 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:48:09.168 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:48:09.168 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:48:09.168 INFO:teuthology.orchestra.run.smithi172.stdout:Install 28 Packages 2024-03-19T05:48:09.168 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 2 Packages 2024-03-19T05:48:09.169 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:48:09.169 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 53 M 2024-03-19T05:48:09.169 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:48:09.268 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-03-19T05:48:09.379 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-03-19T05:48:09.407 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-03-19T05:48:09.491 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-03-19T05:48:09.522 INFO:teuthology.orchestra.run.smithi172.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 20 MB/s | 5.2 MB 00:00 2024-03-19T05:48:09.536 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-03-19T05:48:09.547 INFO:teuthology.orchestra.run.smithi172.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 977 kB/s | 24 kB 00:00 2024-03-19T05:48:09.612 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-03-19T05:48:09.657 INFO:teuthology.orchestra.run.smithi172.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 5.8 MB/s | 653 kB 00:00 2024-03-19T05:48:09.707 INFO:teuthology.orchestra.run.smithi172.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 9.7 MB/s | 474 kB 00:00 2024-03-19T05:48:09.721 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-03-19T05:48:09.755 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-03-19T05:48:09.851 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-03-19T05:48:09.874 INFO:teuthology.orchestra.run.smithi172.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 12 MB/s | 7.6 MB 00:00 2024-03-19T05:48:09.906 INFO:teuthology.orchestra.run.smithi172.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.3 MB/s | 45 kB 00:00 2024-03-19T05:48:09.940 INFO:teuthology.orchestra.run.smithi172.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 3.6 MB/s | 119 kB 00:00 2024-03-19T05:48:09.974 INFO:teuthology.orchestra.run.smithi172.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 4.7 MB/s | 155 kB 00:00 2024-03-19T05:48:10.015 INFO:teuthology.orchestra.run.smithi172.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2024-03-19T05:48:10.041 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-03-19T05:48:10.074 INFO:teuthology.orchestra.run.smithi172.stdout:(10/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 5.1 MB/s | 297 kB 00:00 2024-03-19T05:48:10.082 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-03-19T05:48:10.108 INFO:teuthology.orchestra.run.smithi172.stdout:(11/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 3.0 MB/s | 99 kB 00:00 2024-03-19T05:48:10.135 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-03-19T05:48:10.183 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-03-19T05:48:10.226 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-03-19T05:48:10.258 INFO:teuthology.orchestra.run.smithi172.stdout:(12/30): librgw2-18.2.0-0.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-03-19T05:48:10.279 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-03-19T05:48:10.325 INFO:teuthology.orchestra.run.smithi172.stdout:(13/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.5 MB/s | 159 kB 00:00 2024-03-19T05:48:10.333 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-03-19T05:48:10.350 INFO:teuthology.orchestra.run.smithi172.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 439 kB/s | 106 kB 00:00 2024-03-19T05:48:10.375 INFO:teuthology.orchestra.run.smithi172.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 44 kB 00:00 2024-03-19T05:48:10.426 INFO:teuthology.orchestra.run.smithi172.stdout:(16/30): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 661 kB 00:00 2024-03-19T05:48:10.459 INFO:teuthology.orchestra.run.smithi172.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.5 MB/s | 282 kB 00:00 2024-03-19T05:48:10.486 INFO:teuthology.orchestra.run.smithi172.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 742 kB/s | 41 kB 00:00 2024-03-19T05:48:10.739 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-03-19T05:48:10.809 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-03-19T05:48:10.827 INFO:teuthology.orchestra.run.smithi172.stdout:(19/30): ceph-common-18.2.0-0.el9.x86_64.rpm 12 MB/s | 18 MB 00:01 2024-03-19T05:48:10.934 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-03-19T05:48:10.952 INFO:teuthology.orchestra.run.smithi172.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 226 kB/s | 111 kB 00:00 2024-03-19T05:48:10.976 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-03-19T05:48:11.053 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-03-19T05:48:11.539 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-03-19T05:48:11.574 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-03-19T05:48:11.675 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-03-19T05:48:11.786 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-03-19T05:48:11.820 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-03-19T05:48:12.635 INFO:teuthology.orchestra.run.smithi172.stdout:(21/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 144 kB/s | 309 kB 00:02 2024-03-19T05:48:14.241 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-03-19T05:48:14.292 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-03-19T05:48:14.916 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-03-19T05:48:14.977 INFO:teuthology.orchestra.run.smithi172.stdout:(22/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 6.4 kB/s | 26 kB 00:04 2024-03-19T05:48:15.097 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-03-19T05:48:15.263 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-03-19T05:48:15.264 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-19T05:48:15.264 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-19T05:48:15.264 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:15.294 INFO:teuthology.orchestra.run.smithi172.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 18 kB/s | 49 kB 00:02 2024-03-19T05:48:15.306 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-03-19T05:48:21.369 INFO:teuthology.orchestra.run.smithi172.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 11 kB/s | 67 kB 00:06 2024-03-19T05:48:28.078 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-03-19T05:48:28.078 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2024-03-19T05:48:28.078 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2024-03-19T05:48:28.079 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2024-03-19T05:48:28.079 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2024-03-19T05:48:28.079 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2024-03-19T05:48:28.079 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /root 2024-03-19T05:48:28.079 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2024-03-19T05:48:28.079 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:28.884 INFO:teuthology.orchestra.run.smithi172.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 25 kB/s | 192 kB 00:07 2024-03-19T05:48:28.951 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-03-19T05:48:29.035 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-03-19T05:48:29.035 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:48:29.035 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-19T05:48:29.035 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-19T05:48:29.035 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-19T05:48:29.035 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:29.041 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-03-19T05:48:29.157 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-03-19T05:48:29.158 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-03-19T05:48:30.919 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-03-19T05:48:30.919 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-03-19T05:48:30.919 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-03-19T05:48:30.919 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-03-19T05:48:30.919 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-03-19T05:48:30.919 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-03-19T05:48:30.919 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-03-19T05:48:30.920 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-03-19T05:48:30.921 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-03-19T05:48:30.921 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-03-19T05:48:30.921 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-03-19T05:48:30.921 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-03-19T05:48:30.921 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-03-19T05:48:30.921 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-03-19T05:48:30.921 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-03-19T05:48:30.921 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-03-19T05:48:30.921 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-03-19T05:48:30.921 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-03-19T05:48:30.921 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-03-19T05:48:30.921 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-03-19T05:48:31.867 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-03-19T05:48:31.868 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:31.868 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2024-03-19T05:48:31.868 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.868 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:48:31.868 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-19T05:48:31.868 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.868 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.868 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.868 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.868 INFO:teuthology.orchestra.run.smithi072.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-19T05:48:31.868 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.869 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.870 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-19T05:48:31.870 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.870 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.870 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-03-19T05:48:31.870 INFO:teuthology.orchestra.run.smithi072.stdout: re2-1:20211101-3.el9.x86_64 2024-03-19T05:48:31.870 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-19T05:48:31.870 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:31.870 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:48:32.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-test 2024-03-19T05:48:33.184 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:33 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:48:33.356 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:48:33.357 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:48:33.357 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-03-19T05:48:33.357 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:48:33.357 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:48:33.357 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-03-19T05:48:33.358 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-03-19T05:48:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-19T05:48:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-03-19T05:48:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-19T05:48:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-19T05:48:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-19T05:48:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:33.358 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:48:33.358 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:48:33.358 INFO:teuthology.orchestra.run.smithi072.stdout:Install 6 Packages 2024-03-19T05:48:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:33.359 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 40 M 2024-03-19T05:48:33.359 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 167 M 2024-03-19T05:48:33.359 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:48:33.672 INFO:teuthology.orchestra.run.smithi072.stdout:(1/6): libcephsqlite-18.2.0-0.el9.x86_64.rpm 978 kB/s | 161 kB 00:00 2024-03-19T05:48:33.730 INFO:teuthology.orchestra.run.smithi072.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 973 kB/s | 217 kB 00:00 2024-03-19T05:48:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 300 kB 00:00 2024-03-19T05:48:33.806 INFO:teuthology.orchestra.run.smithi072.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 836 kB/s | 63 kB 00:00 2024-03-19T05:48:34.657 INFO:teuthology.orchestra.run.smithi072.stdout:(5/6): ceph-test-18.2.0-0.el9.x86_64.rpm 34 MB/s | 40 MB 00:01 2024-03-19T05:48:34.924 INFO:teuthology.orchestra.run.smithi072.stdout:(6/6): jq-1.6-16.el9.x86_64.rpm 164 kB/s | 187 kB 00:01 2024-03-19T05:48:34.930 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:48:34.931 INFO:teuthology.orchestra.run.smithi072.stdout:Total 26 MB/s | 40 MB 00:01 2024-03-19T05:48:34.971 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:48:35.024 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:48:35.024 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:48:35.435 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:48:35.436 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:48:35.701 INFO:teuthology.orchestra.run.smithi172.stdout:(26/30): libarrow-9.0.0-10.el9.x86_64.rpm 182 kB/s | 4.4 MB 00:24 2024-03-19T05:48:35.834 INFO:teuthology.orchestra.run.smithi172.stdout:(27/30): librados2-18.2.0-0.el9.x86_64.rpm 25 MB/s | 3.3 MB 00:00 2024-03-19T05:48:35.951 INFO:teuthology.orchestra.run.smithi172.stdout:(28/30): librbd1-18.2.0-0.el9.x86_64.rpm 26 MB/s | 3.0 MB 00:00 2024-03-19T05:48:36.164 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:48:36.258 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-19T05:48:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-19T05:48:36.364 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-19T05:48:36.435 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-19T05:48:36.474 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-03-19T05:48:39.668 INFO:teuthology.orchestra.run.smithi172.stdout:(29/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 34 kB/s | 838 kB 00:24 2024-03-19T05:48:40.570 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-03-19T05:48:40.634 INFO:teuthology.orchestra.run.smithi172.stdout:(30/30): thrift-0.15.0-2.el9.x86_64.rpm 138 kB/s | 1.6 MB 00:11 2024-03-19T05:48:40.645 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:48:40.645 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.7 MB/s | 53 MB 00:31 2024-03-19T05:48:40.646 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:48:40.701 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-03-19T05:48:40.724 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:48:40.724 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:48:41.237 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:48:41.237 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:48:42.760 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:48:42.850 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-03-19T05:48:42.917 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-03-19T05:48:43.016 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-03-19T05:48:43.413 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-03-19T05:48:43.454 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-03-19T05:48:43.578 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-03-19T05:48:43.674 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-03-19T05:48:43.706 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-03-19T05:48:43.789 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-03-19T05:48:43.831 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-03-19T05:48:43.916 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-03-19T05:48:44.029 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-03-19T05:48:44.059 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-03-19T05:48:44.135 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-03-19T05:48:44.173 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-03-19T05:48:44.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/6 2024-03-19T05:48:44.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/6 2024-03-19T05:48:44.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-19T05:48:44.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-19T05:48:44.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-19T05:48:44.317 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-03-19T05:48:44.354 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-03-19T05:48:44.403 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-03-19T05:48:44.441 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-03-19T05:48:44.481 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-03-19T05:48:44.522 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-19T05:48:44.523 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:48:44.523 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:18.2.0-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-03-19T05:48:44.523 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:18.2.0-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-03-19T05:48:44.523 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-03-19T05:48:44.523 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:44.523 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:48:44.530 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-03-19T05:48:44.572 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-03-19T05:48:44.911 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph 2024-03-19T05:48:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-03-19T05:48:45.064 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-03-19T05:48:45.182 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-03-19T05:48:45.213 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-03-19T05:48:45.284 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-03-19T05:48:45.757 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:45 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:48:45.766 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-03-19T05:48:45.799 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-03-19T05:48:45.875 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-03-19T05:48:45.927 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:48:45.930 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:48:45.930 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-03-19T05:48:45.930 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:48:45.930 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:48:45.930 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-19T05:48:45.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-19T05:48:45.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-19T05:48:45.933 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-19T05:48:45.933 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-19T05:48:45.933 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-19T05:48:45.933 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-19T05:48:45.933 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-19T05:48:45.933 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-19T05:48:45.933 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-19T05:48:45.933 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:45.933 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:48:45.933 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:48:45.933 INFO:teuthology.orchestra.run.smithi072.stdout:Install 33 Packages 2024-03-19T05:48:45.933 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:48:45.934 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 30 M 2024-03-19T05:48:45.934 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 109 M 2024-03-19T05:48:45.934 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:48:45.973 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-03-19T05:48:46.002 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-03-19T05:48:46.488 INFO:teuthology.orchestra.run.smithi072.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 36 kB/s | 6.4 kB 00:00 2024-03-19T05:48:46.580 INFO:teuthology.orchestra.run.smithi072.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 5.3 MB/s | 1.4 MB 00:00 2024-03-19T05:48:46.672 INFO:teuthology.orchestra.run.smithi072.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 5.7 MB/s | 2.1 MB 00:00 2024-03-19T05:48:46.714 INFO:teuthology.orchestra.run.smithi072.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 5.7 MB/s | 240 kB 00:00 2024-03-19T05:48:46.915 INFO:teuthology.orchestra.run.smithi072.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-03-19T05:48:46.940 INFO:teuthology.orchestra.run.smithi072.stdout:(6/33): python3-mako-1.1.4-6.el9.noarch.rpm 641 kB/s | 144 kB 00:00 2024-03-19T05:48:46.966 INFO:teuthology.orchestra.run.smithi072.stdout:(7/33): python3-markupsafe-1.1.1-12.el9.x86_64. 634 kB/s | 32 kB 00:00 2024-03-19T05:48:46.991 INFO:teuthology.orchestra.run.smithi072.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 948 kB/s | 47 kB 00:00 2024-03-19T05:48:47.027 INFO:teuthology.orchestra.run.smithi072.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 650 kB/s | 39 kB 00:00 2024-03-19T05:48:47.061 INFO:teuthology.orchestra.run.smithi072.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.4 MB/s | 241 kB 00:00 2024-03-19T05:48:47.137 INFO:teuthology.orchestra.run.smithi072.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 11 MB/s | 1.1 MB 00:00 2024-03-19T05:48:47.162 INFO:teuthology.orchestra.run.smithi072.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 103 kB 00:00 2024-03-19T05:48:47.212 INFO:teuthology.orchestra.run.smithi072.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-03-19T05:48:47.288 INFO:teuthology.orchestra.run.smithi072.stdout:(14/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.5 MB/s | 187 kB 00:00 2024-03-19T05:48:47.772 INFO:teuthology.orchestra.run.smithi072.stdout:(15/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 15 MB/s | 18 MB 00:01 2024-03-19T05:48:47.806 INFO:teuthology.orchestra.run.smithi072.stdout:(16/33): python3-requests-2.25.1-8.el9.noarch.r 242 kB/s | 125 kB 00:00 2024-03-19T05:48:48.391 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-03-19T05:48:48.432 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-03-19T05:48:48.548 INFO:teuthology.orchestra.run.smithi072.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 34 kB/s | 43 kB 00:01 2024-03-19T05:48:48.749 INFO:teuthology.orchestra.run.smithi072.stdout:(18/33): python3-cherrypy-18.6.1-2.el9.noarch.r 381 kB/s | 358 kB 00:00 2024-03-19T05:48:49.059 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-03-19T05:48:49.110 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-03-19T05:48:49.266 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-03-19T05:48:49.266 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-19T05:48:49.266 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-19T05:48:49.267 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:48:49.302 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-03-19T05:48:50.616 INFO:teuthology.orchestra.run.smithi072.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 9.5 kB/s | 18 kB 00:01 2024-03-19T05:48:50.641 INFO:teuthology.orchestra.run.smithi072.stdout:(20/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 5.1 kB/s | 11 kB 00:02 2024-03-19T05:48:50.675 INFO:teuthology.orchestra.run.smithi072.stdout:(21/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 59 kB/s | 172 kB 00:02 2024-03-19T05:48:50.767 INFO:teuthology.orchestra.run.smithi072.stdout:(22/33): python3-jaraco-text-3.2.0-6.el9.noarch 214 kB/s | 20 kB 00:00 2024-03-19T05:48:50.843 INFO:teuthology.orchestra.run.smithi072.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 97 kB/s | 19 kB 00:00 2024-03-19T05:48:53.228 INFO:teuthology.orchestra.run.smithi072.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 19 kB/s | 46 kB 00:02 2024-03-19T05:48:53.446 INFO:teuthology.orchestra.run.smithi072.stdout:(25/33): python3-jaraco-collections-3.0.0-8.el9 8.2 kB/s | 23 kB 00:02 2024-03-19T05:48:53.588 INFO:teuthology.orchestra.run.smithi072.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 116 kB/s | 16 kB 00:00 2024-03-19T05:48:53.780 INFO:teuthology.orchestra.run.smithi072.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 495 kB/s | 272 kB 00:00 2024-03-19T05:48:53.880 INFO:teuthology.orchestra.run.smithi072.stdout:(28/33): python3-more-itertools-8.12.0-2.el9.no 26 kB/s | 79 kB 00:03 2024-03-19T05:48:59.947 INFO:teuthology.orchestra.run.smithi072.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 14 kB/s | 90 kB 00:06 2024-03-19T05:48:59.981 INFO:teuthology.orchestra.run.smithi072.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 5.8 kB/s | 36 kB 00:06 2024-03-19T05:49:00.118 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-03-19T05:49:00.118 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-03-19T05:49:00.118 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-03-19T05:49:00.119 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-03-19T05:49:00.119 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-03-19T05:49:00.119 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-03-19T05:49:00.119 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-03-19T05:49:00.119 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-03-19T05:49:00.119 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:00.123 INFO:teuthology.orchestra.run.smithi072.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 142 kB/s | 20 kB 00:00 2024-03-19T05:49:00.265 INFO:teuthology.orchestra.run.smithi072.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.3 MB/s | 427 kB 00:00 2024-03-19T05:49:00.975 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-03-19T05:49:01.044 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-03-19T05:49:01.044 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:49:01.044 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-19T05:49:01.045 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-19T05:49:01.045 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-19T05:49:01.045 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:01.050 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-03-19T05:49:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-03-19T05:49:01.163 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-03-19T05:49:02.722 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-03-19T05:49:02.722 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-03-19T05:49:02.722 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-03-19T05:49:02.722 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-03-19T05:49:02.723 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-03-19T05:49:02.724 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-03-19T05:49:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-03-19T05:49:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:03.564 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-03-19T05:49:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.564 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:49:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-19T05:49:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.564 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-19T05:49:03.565 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-19T05:49:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-19T05:49:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-19T05:49:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-3.el9.x86_64 2024-03-19T05:49:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-19T05:49:03.566 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:03.566 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:49:04.014 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-test 2024-03-19T05:49:04.868 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:58 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:49:05.034 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:49:05.035 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:05.035 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-03-19T05:49:05.035 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:05.035 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:49:05.035 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-03-19T05:49:05.036 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-03-19T05:49:05.036 INFO:teuthology.orchestra.run.smithi172.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-19T05:49:05.036 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-03-19T05:49:05.036 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-19T05:49:05.036 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-19T05:49:05.036 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-19T05:49:05.037 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:05.037 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:49:05.037 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:05.037 INFO:teuthology.orchestra.run.smithi172.stdout:Install 6 Packages 2024-03-19T05:49:05.037 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:05.038 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 40 M 2024-03-19T05:49:05.038 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 167 M 2024-03-19T05:49:05.038 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:49:05.572 INFO:teuthology.orchestra.run.smithi172.stdout:(1/6): libcephsqlite-18.2.0-0.el9.x86_64.rpm 837 kB/s | 161 kB 00:00 2024-03-19T05:49:05.830 INFO:teuthology.orchestra.run.smithi172.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 482 kB/s | 217 kB 00:00 2024-03-19T05:49:05.931 INFO:teuthology.orchestra.run.smithi172.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 841 kB/s | 300 kB 00:00 2024-03-19T05:49:05.956 INFO:teuthology.orchestra.run.smithi172.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 501 kB/s | 63 kB 00:00 2024-03-19T05:49:06.365 INFO:teuthology.orchestra.run.smithi172.stdout:(5/6): ceph-test-18.2.0-0.el9.x86_64.rpm 40 MB/s | 40 MB 00:00 2024-03-19T05:49:06.656 INFO:teuthology.orchestra.run.smithi172.stdout:(6/6): jq-1.6-16.el9.x86_64.rpm 258 kB/s | 187 kB 00:00 2024-03-19T05:49:06.663 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:06.663 INFO:teuthology.orchestra.run.smithi172.stdout:Total 25 MB/s | 40 MB 00:01 2024-03-19T05:49:06.706 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:49:06.760 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:49:06.761 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:49:07.182 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:49:07.182 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:49:07.825 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:49:07.914 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-19T05:49:07.964 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-19T05:49:08.014 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-19T05:49:08.076 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-19T05:49:08.101 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-03-19T05:49:08.182 INFO:teuthology.orchestra.run.smithi072.stdout:(33/33): python3-webob-1.8.7-6.el9.noarch.rpm 16 kB/s | 230 kB 00:14 2024-03-19T05:49:08.188 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:08.189 INFO:teuthology.orchestra.run.smithi072.stdout:Total 1.3 MB/s | 30 MB 00:22 2024-03-19T05:49:08.229 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:49:08.315 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:49:08.315 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:49:08.750 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:49:08.751 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:49:10.195 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:49:10.269 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-03-19T05:49:10.327 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-03-19T05:49:10.372 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-03-19T05:49:10.523 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-03-19T05:49:10.649 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-03-19T05:49:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-03-19T05:49:10.814 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-03-19T05:49:10.954 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-03-19T05:49:11.006 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-03-19T05:49:11.086 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-03-19T05:49:11.169 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-03-19T05:49:11.424 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-03-19T05:49:11.497 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-03-19T05:49:11.544 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-03-19T05:49:11.590 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-03-19T05:49:11.636 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-03-19T05:49:11.757 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-03-19T05:49:11.797 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-03-19T05:49:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-03-19T05:49:11.893 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-03-19T05:49:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-03-19T05:49:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-03-19T05:49:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-03-19T05:49:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-03-19T05:49:12.211 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-03-19T05:49:12.299 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-03-19T05:49:12.349 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-03-19T05:49:12.547 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-03-19T05:49:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-03-19T05:49:12.887 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-03-19T05:49:12.928 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-03-19T05:49:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-03-19T05:49:13.005 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:49:13.005 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-19T05:49:13.005 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-19T05:49:13.005 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-19T05:49:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:14.410 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-03-19T05:49:14.410 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/6 2024-03-19T05:49:14.410 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/6 2024-03-19T05:49:14.410 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-19T05:49:14.410 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-19T05:49:14.410 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-19T05:49:14.673 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-03-19T05:49:14.755 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-03-19T05:49:14.756 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:49:14.756 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-19T05:49:14.756 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-19T05:49:14.756 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-19T05:49:14.756 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-19T05:49:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:14.763 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:49:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:18.2.0-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-03-19T05:49:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:18.2.0-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-03-19T05:49:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-03-19T05:49:14.763 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:14.764 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:49:15.043 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph 2024-03-19T05:49:15.250 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-03-19T05:49:15.319 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-03-19T05:49:15.319 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:49:15.319 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-19T05:49:15.319 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-19T05:49:15.319 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-19T05:49:15.319 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:15.578 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-03-19T05:49:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-03-19T05:49:15.649 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:49:15.649 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-19T05:49:15.649 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-19T05:49:15.649 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-19T05:49:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:15.720 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-03-19T05:49:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-03-19T05:49:15.833 INFO:teuthology.orchestra.run.smithi072.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-19T05:49:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:15.904 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:09 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:49:16.078 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:49:16.080 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:16.080 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-03-19T05:49:16.080 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:16.080 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:49:16.081 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-03-19T05:49:16.081 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-03-19T05:49:16.081 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-03-19T05:49:16.081 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-03-19T05:49:16.081 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-03-19T05:49:16.081 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-03-19T05:49:16.081 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-03-19T05:49:16.081 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-19T05:49:16.081 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-19T05:49:16.081 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-19T05:49:16.081 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-19T05:49:16.081 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-19T05:49:16.082 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-19T05:49:16.082 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-19T05:49:16.082 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-19T05:49:16.082 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-19T05:49:16.082 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-19T05:49:16.082 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-19T05:49:16.082 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-19T05:49:16.082 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-19T05:49:16.082 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-19T05:49:16.082 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-19T05:49:16.082 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-19T05:49:16.082 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout:Install 33 Packages 2024-03-19T05:49:16.083 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:16.084 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 30 M 2024-03-19T05:49:16.084 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 109 M 2024-03-19T05:49:16.084 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:49:16.508 INFO:teuthology.orchestra.run.smithi172.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 37 kB/s | 6.4 kB 00:00 2024-03-19T05:49:16.583 INFO:teuthology.orchestra.run.smithi172.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 5.8 MB/s | 1.4 MB 00:00 2024-03-19T05:49:16.642 INFO:teuthology.orchestra.run.smithi172.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 6.8 MB/s | 2.1 MB 00:00 2024-03-19T05:49:16.675 INFO:teuthology.orchestra.run.smithi172.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 7.2 MB/s | 240 kB 00:00 2024-03-19T05:49:16.867 INFO:teuthology.orchestra.run.smithi172.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-03-19T05:49:16.892 INFO:teuthology.orchestra.run.smithi172.stdout:(6/33): python3-mako-1.1.4-6.el9.noarch.rpm 667 kB/s | 144 kB 00:00 2024-03-19T05:49:16.918 INFO:teuthology.orchestra.run.smithi172.stdout:(7/33): python3-markupsafe-1.1.1-12.el9.x86_64. 646 kB/s | 32 kB 00:00 2024-03-19T05:49:16.943 INFO:teuthology.orchestra.run.smithi172.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 962 kB/s | 47 kB 00:00 2024-03-19T05:49:16.968 INFO:teuthology.orchestra.run.smithi172.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 788 kB/s | 39 kB 00:00 2024-03-19T05:49:17.002 INFO:teuthology.orchestra.run.smithi172.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-03-19T05:49:17.069 INFO:teuthology.orchestra.run.smithi172.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 12 MB/s | 1.1 MB 00:00 2024-03-19T05:49:17.094 INFO:teuthology.orchestra.run.smithi172.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-19T05:49:17.136 INFO:teuthology.orchestra.run.smithi172.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 3.0 MB/s | 124 kB 00:00 2024-03-19T05:49:17.161 INFO:teuthology.orchestra.run.smithi172.stdout:(14/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.8 MB/s | 187 kB 00:00 2024-03-19T05:49:17.278 INFO:teuthology.orchestra.run.smithi172.stdout:(15/33): python3-requests-2.25.1-8.el9.noarch.r 893 kB/s | 125 kB 00:00 2024-03-19T05:49:17.528 INFO:teuthology.orchestra.run.smithi172.stdout:(16/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 19 MB/s | 18 MB 00:00 2024-03-19T05:49:17.553 INFO:teuthology.orchestra.run.smithi172.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 111 kB/s | 43 kB 00:00 2024-03-19T05:49:17.854 INFO:teuthology.orchestra.run.smithi172.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 36 kB/s | 11 kB 00:00 2024-03-19T05:49:17.904 INFO:teuthology.orchestra.run.smithi172.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 359 kB/s | 18 kB 00:00 2024-03-19T05:49:17.929 INFO:teuthology.orchestra.run.smithi172.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 264 kB/s | 172 kB 00:00 2024-03-19T05:49:17.954 INFO:teuthology.orchestra.run.smithi172.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 468 kB/s | 23 kB 00:00 2024-03-19T05:49:17.988 INFO:teuthology.orchestra.run.smithi172.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 782 kB/s | 358 kB 00:00 2024-03-19T05:49:18.013 INFO:teuthology.orchestra.run.smithi172.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 234 kB/s | 19 kB 00:00 2024-03-19T05:49:18.039 INFO:teuthology.orchestra.run.smithi172.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 237 kB/s | 20 kB 00:00 2024-03-19T05:49:18.080 INFO:teuthology.orchestra.run.smithi172.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 507 kB/s | 46 kB 00:00 2024-03-19T05:49:18.297 INFO:teuthology.orchestra.run.smithi172.stdout:(26/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.0 MB/s | 272 kB 00:00 2024-03-19T05:49:18.364 INFO:teuthology.orchestra.run.smithi172.stdout:(27/33): python3-more-itertools-8.12.0-2.el9.no 243 kB/s | 79 kB 00:00 2024-03-19T05:49:18.389 INFO:teuthology.orchestra.run.smithi172.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 53 kB/s | 16 kB 00:00 2024-03-19T05:49:18.415 INFO:teuthology.orchestra.run.smithi172.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 772 kB/s | 90 kB 00:00 2024-03-19T05:49:18.507 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-03-19T05:49:18.507 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-03-19T05:49:18.508 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 15/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-03-19T05:49:18.509 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-03-19T05:49:18.510 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-03-19T05:49:18.510 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-03-19T05:49:18.574 INFO:teuthology.orchestra.run.smithi172.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 195 kB/s | 36 kB 00:00 2024-03-19T05:49:18.791 INFO:teuthology.orchestra.run.smithi172.stdout:(31/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.1 MB/s | 427 kB 00:00 2024-03-19T05:49:18.924 INFO:teuthology.orchestra.run.smithi172.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 431 kB/s | 230 kB 00:00 2024-03-19T05:49:18.957 INFO:teuthology.orchestra.run.smithi172.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 52 kB/s | 20 kB 00:00 2024-03-19T05:49:18.964 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:18.965 INFO:teuthology.orchestra.run.smithi172.stdout:Total 10 MB/s | 30 MB 00:02 2024-03-19T05:49:19.005 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:49:19.090 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:49:19.091 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:49:19.568 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:49:19.569 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:49:19.637 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-03-19T05:49:19.637 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:19.637 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:49:19.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:19.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:19.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:19.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-03-19T05:49:19.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:19.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:19.637 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-19T05:49:19.637 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-19T05:49:19.638 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply-3.11-14.el9.noarch 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:19.639 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:49:20.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-base 2024-03-19T05:49:20.908 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:20 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:49:20.912 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:49:20.969 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-03-19T05:49:21.005 INFO:teuthology.orchestra.run.smithi072.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:49:21.005 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-03-19T05:49:21.049 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-03-19T05:49:21.059 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:49:21.060 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-03-19T05:49:21.060 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:49:21.133 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install cephadm 2024-03-19T05:49:21.187 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-03-19T05:49:21.288 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-03-19T05:49:21.342 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-03-19T05:49:21.436 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-03-19T05:49:21.503 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-03-19T05:49:21.545 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-03-19T05:49:21.611 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-03-19T05:49:21.699 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-03-19T05:49:21.951 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:21 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:49:21.957 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-03-19T05:49:22.017 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-03-19T05:49:22.054 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-03-19T05:49:22.099 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-03-19T05:49:22.100 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 209 k 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 200 k 2024-03-19T05:49:22.101 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:49:22.136 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-03-19T05:49:22.180 INFO:teuthology.orchestra.run.smithi072.stdout:cephadm-18.2.0-0.el9.noarch.rpm 2.6 MB/s | 209 kB 00:00 2024-03-19T05:49:22.181 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:22.181 INFO:teuthology.orchestra.run.smithi072.stdout:Total 2.5 MB/s | 209 kB 00:00 2024-03-19T05:49:22.181 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:49:22.187 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:49:22.187 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:49:22.190 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:49:22.191 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:49:22.241 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-03-19T05:49:22.275 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:49:22.278 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-03-19T05:49:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-03-19T05:49:22.380 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-03-19T05:49:22.437 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-03-19T05:49:22.476 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-03-19T05:49:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-03-19T05:49:22.671 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-03-19T05:49:22.776 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-03-19T05:49:22.889 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-03-19T05:49:22.957 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-03-19T05:49:23.054 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-03-19T05:49:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-03-19T05:49:23.290 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-03-19T05:49:23.321 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-03-19T05:49:23.400 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-03-19T05:49:23.401 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:49:23.401 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-19T05:49:23.401 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-19T05:49:23.401 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-19T05:49:23.401 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:23.532 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-03-19T05:49:23.801 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-03-19T05:49:23.801 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:23.801 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:49:23.801 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-03-19T05:49:23.801 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:23.801 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:49:24.063 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-immutable-object-cache 2024-03-19T05:49:24.910 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:24 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:49:25.047 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-03-19T05:49:25.074 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:49:25.074 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:25.074 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repo Size 2024-03-19T05:49:25.075 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:25.075 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:49:25.075 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-03-19T05:49:25.075 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:25.075 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:49:25.075 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:25.075 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-03-19T05:49:25.075 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:25.076 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 142 k 2024-03-19T05:49:25.076 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 399 k 2024-03-19T05:49:25.076 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:49:25.127 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-03-19T05:49:25.127 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:49:25.127 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-19T05:49:25.127 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-19T05:49:25.127 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-19T05:49:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:25.146 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.0 MB/s | 142 kB 00:00 2024-03-19T05:49:25.146 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:25.147 INFO:teuthology.orchestra.run.smithi072.stdout:Total 1.9 MB/s | 142 kB 00:00 2024-03-19T05:49:25.147 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:49:25.156 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:49:25.156 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:49:25.213 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:49:25.213 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:49:25.375 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:49:25.481 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:49:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:49:25.550 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:49:25.550 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-19T05:49:25.550 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:25.606 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-03-19T05:49:25.677 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-03-19T05:49:25.677 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:49:25.677 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-19T05:49:25.677 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-19T05:49:25.677 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-19T05:49:25.678 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:25.890 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-03-19T05:49:25.962 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-03-19T05:49:25.962 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:49:25.962 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-19T05:49:25.962 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-19T05:49:25.962 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-19T05:49:25.963 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:26.045 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-03-19T05:49:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-03-19T05:49:26.160 INFO:teuthology.orchestra.run.smithi172.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-19T05:49:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:26.918 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:49:26.918 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:26.918 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:49:26.918 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:26.918 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:26.918 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:49:27.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-mgr 2024-03-19T05:49:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-03-19T05:49:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-03-19T05:49:27.931 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 15/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/33 2024-03-19T05:49:27.932 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-03-19T05:49:27.933 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-03-19T05:49:27.934 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-03-19T05:49:28.141 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:28 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:49:28.237 INFO:teuthology.orchestra.run.smithi072.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:49:28.290 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:49:28.291 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-03-19T05:49:28.291 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:49:28.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-mgr-dashboard 2024-03-19T05:49:28.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-03-19T05:49:28.996 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:28.996 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:49:28.996 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:28.996 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:28.996 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-19T05:49:28.997 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-19T05:49:28.998 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-19T05:49:28.999 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-19T05:49:28.999 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:28.999 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:49:29.177 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:29 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:49:29.332 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:49:29.333 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:29.333 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-03-19T05:49:29.333 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:29.333 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:49:29.333 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-03-19T05:49:29.333 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-03-19T05:49:29.333 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-03-19T05:49:29.333 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-03-19T05:49:29.334 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-03-19T05:49:29.334 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-19T05:49:29.334 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-19T05:49:29.334 INFO:teuthology.orchestra.run.smithi072.stdout:Installing weak dependencies: 2024-03-19T05:49:29.334 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-03-19T05:49:29.334 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:29.334 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:49:29.334 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:29.334 INFO:teuthology.orchestra.run.smithi072.stdout:Install 7 Packages 2024-03-19T05:49:29.334 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:29.335 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 2.0 M 2024-03-19T05:49:29.335 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 8.1 M 2024-03-19T05:49:29.335 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:49:29.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-base 2024-03-19T05:49:29.907 INFO:teuthology.orchestra.run.smithi072.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 115 kB/s | 23 kB 00:00 2024-03-19T05:49:29.933 INFO:teuthology.orchestra.run.smithi072.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 65 kB/s | 15 kB 00:00 2024-03-19T05:49:30.017 INFO:teuthology.orchestra.run.smithi072.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 5.5 MB/s | 1.7 MB 00:00 2024-03-19T05:49:30.117 INFO:teuthology.orchestra.run.smithi072.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 43 kB/s | 9.0 kB 00:00 2024-03-19T05:49:30.182 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:24 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:49:30.260 INFO:teuthology.orchestra.run.smithi072.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 126 kB/s | 41 kB 00:00 2024-03-19T05:49:30.278 INFO:teuthology.orchestra.run.smithi172.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:49:30.285 INFO:teuthology.orchestra.run.smithi072.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 115 kB/s | 31 kB 00:00 2024-03-19T05:49:30.332 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:49:30.334 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-03-19T05:49:30.334 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:49:30.443 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install cephadm 2024-03-19T05:49:30.485 INFO:teuthology.orchestra.run.smithi072.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 514 kB/s | 188 kB 00:00 2024-03-19T05:49:30.490 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:30.494 INFO:teuthology.orchestra.run.smithi072.stdout:Total 1.7 MB/s | 2.0 MB 00:01 2024-03-19T05:49:30.494 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:49:30.516 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:49:30.517 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:49:30.653 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:49:30.654 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:49:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:49:31.113 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-03-19T05:49:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-03-19T05:49:31.257 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:25 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:49:31.262 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-03-19T05:49:31.331 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-03-19T05:49:31.379 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-03-19T05:49:31.409 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:49:31.409 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-03-19T05:49:31.410 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:31.410 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:49:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-03-19T05:49:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:31.410 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:49:31.410 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:31.410 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-03-19T05:49:31.410 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:31.410 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 209 k 2024-03-19T05:49:31.410 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 200 k 2024-03-19T05:49:31.410 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:49:31.479 INFO:teuthology.orchestra.run.smithi172.stdout:cephadm-18.2.0-0.el9.noarch.rpm 3.0 MB/s | 209 kB 00:00 2024-03-19T05:49:31.480 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:31.480 INFO:teuthology.orchestra.run.smithi172.stdout:Total 2.9 MB/s | 209 kB 00:00 2024-03-19T05:49:31.480 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:49:31.486 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:49:31.486 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:49:31.490 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:49:31.490 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:49:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:49:31.696 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-03-19T05:49:31.736 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-03-19T05:49:32.173 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-03-19T05:49:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-03-19T05:49:32.501 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-03-19T05:49:32.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-03-19T05:49:32.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-03-19T05:49:32.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-03-19T05:49:32.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-03-19T05:49:32.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-03-19T05:49:32.501 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-03-19T05:49:32.748 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-03-19T05:49:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-03-19T05:49:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:32.861 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:49:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-03-19T05:49:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-03-19T05:49:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-03-19T05:49:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-03-19T05:49:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-03-19T05:49:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-19T05:49:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-19T05:49:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:32.861 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:49:33.072 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-03-19T05:49:33.073 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:33.073 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:49:33.073 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-03-19T05:49:33.073 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:33.073 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:49:33.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-19T05:49:33.355 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-immutable-object-cache 2024-03-19T05:49:34.006 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:34 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:49:34.165 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:49:34.167 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:34.167 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-03-19T05:49:34.167 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:34.167 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:49:34.167 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-03-19T05:49:34.167 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-03-19T05:49:34.167 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-19T05:49:34.167 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-19T05:49:34.167 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-19T05:49:34.167 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-19T05:49:34.167 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-19T05:49:34.168 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-19T05:49:34.168 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-19T05:49:34.168 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-19T05:49:34.168 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-19T05:49:34.168 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-19T05:49:34.168 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-19T05:49:34.168 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:34.168 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:49:34.168 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:34.168 INFO:teuthology.orchestra.run.smithi072.stdout:Install 12 Packages 2024-03-19T05:49:34.168 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:34.169 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 37 M 2024-03-19T05:49:34.169 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 209 M 2024-03-19T05:49:34.169 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:49:34.183 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:28 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:49:34.339 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:49:34.340 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-03-19T05:49:34.340 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:34.340 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:49:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-03-19T05:49:34.340 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:34.340 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:49:34.340 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:34.340 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-03-19T05:49:34.341 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:34.341 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 142 k 2024-03-19T05:49:34.341 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 399 k 2024-03-19T05:49:34.341 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:49:34.417 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 1.8 MB/s | 142 kB 00:00 2024-03-19T05:49:34.418 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:34.418 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.8 MB/s | 142 kB 00:00 2024-03-19T05:49:34.418 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:49:34.427 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:49:34.427 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:49:34.483 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:49:34.484 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:49:34.633 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:49:34.702 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:49:34.727 INFO:teuthology.orchestra.run.smithi072.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 132 kB/s | 32 kB 00:00 2024-03-19T05:49:34.760 INFO:teuthology.orchestra.run.smithi072.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 537 kB/s | 17 kB 00:00 2024-03-19T05:49:34.770 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:49:34.770 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:49:34.770 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-19T05:49:34.771 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:34.936 INFO:teuthology.orchestra.run.smithi072.stdout:(3/12): ceph-mgr-diskprediction-local-18.2.0-0. 17 MB/s | 7.4 MB 00:00 2024-03-19T05:49:35.029 INFO:teuthology.orchestra.run.smithi072.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.5 MB/s | 3.0 MB 00:00 2024-03-19T05:49:35.054 INFO:teuthology.orchestra.run.smithi072.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 118 kB/s | 34 kB 00:00 2024-03-19T05:49:35.204 INFO:teuthology.orchestra.run.smithi072.stdout:(6/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.5 MB/s | 217 kB 00:00 2024-03-19T05:49:35.430 INFO:teuthology.orchestra.run.smithi072.stdout:(7/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 9.7 MB/s | 4.7 MB 00:00 2024-03-19T05:49:35.589 INFO:teuthology.orchestra.run.smithi072.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.0 MB/s | 4.8 MB 00:00 2024-03-19T05:49:35.750 INFO:teuthology.orchestra.run.smithi072.stdout:(9/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-03-19T05:49:35.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:49:35.996 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:35.996 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:49:35.996 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-03-19T05:49:35.997 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:35.997 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:49:36.059 INFO:teuthology.orchestra.run.smithi072.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-03-19T05:49:36.084 INFO:teuthology.orchestra.run.smithi072.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 405 kB/s | 195 kB 00:00 2024-03-19T05:49:36.243 INFO:teuthology.orchestra.run.smithi072.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 510 kB/s | 245 kB 00:00 2024-03-19T05:49:36.247 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:36.248 INFO:teuthology.orchestra.run.smithi072.stdout:Total 18 MB/s | 37 MB 00:02 2024-03-19T05:49:36.289 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr 2024-03-19T05:49:36.365 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:49:36.429 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:49:36.429 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:49:36.974 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:49:36.975 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:49:37.133 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:31 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:49:37.229 INFO:teuthology.orchestra.run.smithi172.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:49:37.285 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:49:37.286 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-03-19T05:49:37.286 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:49:37.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-dashboard 2024-03-19T05:49:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:49:37.930 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-19T05:49:37.966 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-19T05:49:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-19T05:49:38.142 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:32 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:49:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-19T05:49:38.301 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:49:38.301 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:38.301 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-03-19T05:49:38.302 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:38.302 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:49:38.302 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-03-19T05:49:38.302 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-03-19T05:49:38.302 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-03-19T05:49:38.302 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-03-19T05:49:38.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-03-19T05:49:38.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-19T05:49:38.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-19T05:49:38.303 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-03-19T05:49:38.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-03-19T05:49:38.303 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:38.303 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:49:38.303 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:38.303 INFO:teuthology.orchestra.run.smithi172.stdout:Install 7 Packages 2024-03-19T05:49:38.303 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:38.304 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 2.0 M 2024-03-19T05:49:38.304 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 8.1 M 2024-03-19T05:49:38.305 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:49:38.436 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-19T05:49:38.471 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-19T05:49:38.511 INFO:teuthology.orchestra.run.smithi172.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 154 kB/s | 23 kB 00:00 2024-03-19T05:49:38.537 INFO:teuthology.orchestra.run.smithi172.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 83 kB/s | 15 kB 00:00 2024-03-19T05:49:38.582 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-19T05:49:38.595 INFO:teuthology.orchestra.run.smithi172.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 7.3 MB/s | 1.7 MB 00:00 2024-03-19T05:49:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-19T05:49:39.613 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-19T05:49:41.137 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-19T05:49:41.204 INFO:teuthology.orchestra.run.smithi172.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 3.4 kB/s | 9.0 kB 00:02 2024-03-19T05:49:41.321 INFO:teuthology.orchestra.run.smithi172.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 11 kB/s | 31 kB 00:02 2024-03-19T05:49:41.421 INFO:teuthology.orchestra.run.smithi172.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 14 kB/s | 41 kB 00:02 2024-03-19T05:49:41.971 INFO:teuthology.orchestra.run.smithi172.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 247 kB/s | 188 kB 00:00 2024-03-19T05:49:41.981 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:41.982 INFO:teuthology.orchestra.run.smithi172.stdout:Total 555 kB/s | 2.0 MB 00:03 2024-03-19T05:49:41.982 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:49:42.008 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:49:42.008 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:49:42.133 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:49:42.133 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:49:42.313 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-19T05:49:42.352 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-03-19T05:49:42.519 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:49:42.572 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-03-19T05:49:42.621 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-03-19T05:49:42.704 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-03-19T05:49:42.746 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-03-19T05:49:42.794 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-03-19T05:49:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-03-19T05:49:43.149 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-03-19T05:49:43.769 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-03-19T05:49:43.769 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-03-19T05:49:43.770 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-03-19T05:49:43.770 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-03-19T05:49:43.770 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-03-19T05:49:43.770 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-03-19T05:49:43.770 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-03-19T05:49:44.131 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-03-19T05:49:44.131 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:44.132 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:49:44.132 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-03-19T05:49:44.132 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-03-19T05:49:44.132 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-03-19T05:49:44.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-03-19T05:49:44.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-03-19T05:49:44.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-19T05:49:44.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-19T05:49:44.132 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:44.132 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:49:44.426 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-19T05:49:45.269 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:39 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:49:45.428 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:49:45.429 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-03-19T05:49:45.429 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:45.429 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:49:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:49:45.430 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:45.431 INFO:teuthology.orchestra.run.smithi172.stdout:Install 12 Packages 2024-03-19T05:49:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:45.431 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 37 M 2024-03-19T05:49:45.431 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 209 M 2024-03-19T05:49:45.431 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:49:45.794 INFO:teuthology.orchestra.run.smithi172.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 180 kB/s | 32 kB 00:00 2024-03-19T05:49:45.819 INFO:teuthology.orchestra.run.smithi172.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 703 kB/s | 17 kB 00:00 2024-03-19T05:49:45.853 INFO:teuthology.orchestra.run.smithi172.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-03-19T05:49:45.986 INFO:teuthology.orchestra.run.smithi172.stdout:(4/12): ceph-mgr-diskprediction-local-18.2.0-0. 20 MB/s | 7.4 MB 00:00 2024-03-19T05:49:46.128 INFO:teuthology.orchestra.run.smithi172.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.9 MB/s | 3.0 MB 00:00 2024-03-19T05:49:46.303 INFO:teuthology.orchestra.run.smithi172.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2024-03-19T05:49:46.420 INFO:teuthology.orchestra.run.smithi172.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 4.8 MB 00:00 2024-03-19T05:49:46.431 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-03-19T05:49:46.431 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-03-19T05:49:46.431 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-19T05:49:46.431 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-19T05:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-19T05:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-19T05:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-19T05:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-19T05:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-19T05:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-19T05:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-19T05:49:46.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-19T05:49:46.445 INFO:teuthology.orchestra.run.smithi172.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 714 kB/s | 217 kB 00:00 2024-03-19T05:49:46.804 INFO:teuthology.orchestra.run.smithi172.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-03-19T05:49:46.895 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-19T05:49:46.895 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-19T05:49:46.896 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:46.897 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:49:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 403 kB/s | 195 kB 00:00 2024-03-19T05:49:47.013 INFO:teuthology.orchestra.run.smithi172.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-03-19T05:49:47.054 INFO:teuthology.orchestra.run.smithi172.stdout:(12/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2024-03-19T05:49:47.061 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:47.062 INFO:teuthology.orchestra.run.smithi172.stdout:Total 23 MB/s | 37 MB 00:01 2024-03-19T05:49:47.182 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:49:47.246 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:49:47.246 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:49:47.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-mgr-rook 2024-03-19T05:49:47.770 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:49:47.770 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:49:48.254 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:48 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:49:48.420 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:49:48.421 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:48.421 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-03-19T05:49:48.421 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:48.421 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:49:48.421 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-19T05:49:48.422 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:48.423 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:49:48.423 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:48.423 INFO:teuthology.orchestra.run.smithi072.stdout:Install 13 Packages 2024-03-19T05:49:48.423 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:48.423 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 2.0 M 2024-03-19T05:49:48.423 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 26 M 2024-03-19T05:49:48.423 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:49:48.601 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:49:48.695 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-19T05:49:48.728 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-19T05:49:48.878 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-19T05:49:48.923 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-19T05:49:48.986 INFO:teuthology.orchestra.run.smithi072.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 251 kB/s | 47 kB 00:00 2024-03-19T05:49:49.011 INFO:teuthology.orchestra.run.smithi072.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 114 kB/s | 24 kB 00:00 2024-03-19T05:49:49.038 INFO:teuthology.orchestra.run.smithi072.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 75 kB/s | 18 kB 00:00 2024-03-19T05:49:49.072 INFO:teuthology.orchestra.run.smithi072.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 174 kB 00:00 2024-03-19T05:49:49.106 INFO:teuthology.orchestra.run.smithi072.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 132 kB 00:00 2024-03-19T05:49:49.140 INFO:teuthology.orchestra.run.smithi072.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.1 MB/s | 211 kB 00:00 2024-03-19T05:49:49.171 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-19T05:49:49.174 INFO:teuthology.orchestra.run.smithi072.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 436 kB/s | 43 kB 00:00 2024-03-19T05:49:49.212 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-19T05:49:49.320 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-19T05:49:49.474 INFO:teuthology.orchestra.run.smithi072.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 45 kB/s | 15 kB 00:00 2024-03-19T05:49:49.500 INFO:teuthology.orchestra.run.smithi072.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 90 kB/s | 32 kB 00:00 2024-03-19T05:49:49.709 INFO:teuthology.orchestra.run.smithi072.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 284 kB/s | 59 kB 00:00 2024-03-19T05:49:49.926 INFO:teuthology.orchestra.run.smithi072.stdout:(11/13): python3-google-auth-2.28.0-1.el9.noarc 270 kB/s | 203 kB 00:00 2024-03-19T05:49:50.010 INFO:teuthology.orchestra.run.smithi072.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 299 kB/s | 90 kB 00:00 2024-03-19T05:49:50.249 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-19T05:49:50.379 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-19T05:49:51.669 INFO:teuthology.orchestra.run.smithi072.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 477 kB/s | 1.0 MB 00:02 2024-03-19T05:49:51.673 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:51.674 INFO:teuthology.orchestra.run.smithi072.stdout:Total 644 kB/s | 2.0 MB 00:03 2024-03-19T05:49:51.675 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:49:51.717 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:49:51.717 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:49:51.871 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:49:51.877 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:49:51.923 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-19T05:49:52.547 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:49:52.780 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-19T05:49:52.848 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-19T05:49:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-19T05:49:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-19T05:49:53.028 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-19T05:49:53.073 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-19T05:49:53.109 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-03-19T05:49:53.156 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-19T05:49:53.299 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 7/13 2024-03-19T05:49:53.372 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-19T05:49:54.311 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-19T05:49:54.377 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-19T05:49:54.454 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-19T05:49:54.521 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-19T05:49:54.556 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-03-19T05:49:55.715 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-03-19T05:49:55.715 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-03-19T05:49:55.715 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-19T05:49:55.715 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-19T05:49:55.715 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-19T05:49:55.715 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-19T05:49:55.715 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-19T05:49:55.715 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-19T05:49:55.715 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-19T05:49:55.715 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-19T05:49:55.715 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-19T05:49:55.715 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-19T05:49:55.750 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-03-19T05:49:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-03-19T05:49:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-19T05:49:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-19T05:49:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-19T05:49:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-19T05:49:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-19T05:49:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-19T05:49:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-19T05:49:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-19T05:49:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 10/13 2024-03-19T05:49:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-19T05:49:55.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-19T05:49:56.190 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-19T05:49:56.190 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:56.190 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:49:56.190 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-03-19T05:49:56.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-19T05:49:56.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-19T05:49:56.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-19T05:49:56.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-19T05:49:56.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-19T05:49:56.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-19T05:49:56.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-19T05:49:56.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-19T05:49:56.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-19T05:49:56.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-19T05:49:56.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-19T05:49:56.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-19T05:49:56.191 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:56.191 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:49:56.232 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-19T05:49:56.232 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:56.232 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:49:56.232 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-03-19T05:49:56.232 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-19T05:49:56.232 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-19T05:49:56.232 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-19T05:49:56.232 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-19T05:49:56.232 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-19T05:49:56.232 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-19T05:49:56.232 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-19T05:49:56.233 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-19T05:49:56.233 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-19T05:49:56.233 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-19T05:49:56.233 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-19T05:49:56.233 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:56.233 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:49:56.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-mgr-cephadm 2024-03-19T05:49:56.704 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-rook 2024-03-19T05:49:57.443 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:57 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:49:57.535 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:51 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:49:57.601 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:49:57.602 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:57.602 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-03-19T05:49:57.602 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:57.602 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:49:57.602 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-03-19T05:49:57.602 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-03-19T05:49:57.602 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-19T05:49:57.602 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-19T05:49:57.602 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-19T05:49:57.602 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-19T05:49:57.603 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-19T05:49:57.603 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:57.603 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:49:57.603 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:49:57.603 INFO:teuthology.orchestra.run.smithi072.stdout:Install 6 Packages 2024-03-19T05:49:57.603 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:49:57.603 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 6.8 M 2024-03-19T05:49:57.604 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 33 M 2024-03-19T05:49:57.604 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:49:57.694 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:49:57.695 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:57.695 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-19T05:49:57.696 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-19T05:49:57.697 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-19T05:49:57.697 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-19T05:49:57.697 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:57.697 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:49:57.697 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:49:57.697 INFO:teuthology.orchestra.run.smithi172.stdout:Install 13 Packages 2024-03-19T05:49:57.697 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:49:57.698 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 2.0 M 2024-03-19T05:49:57.698 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 26 M 2024-03-19T05:49:57.698 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:49:57.822 INFO:teuthology.orchestra.run.smithi072.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.1 MB/s | 127 kB 00:00 2024-03-19T05:49:57.871 INFO:teuthology.orchestra.run.smithi172.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 411 kB/s | 47 kB 00:00 2024-03-19T05:49:57.896 INFO:teuthology.orchestra.run.smithi172.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 173 kB/s | 24 kB 00:00 2024-03-19T05:49:57.922 INFO:teuthology.orchestra.run.smithi172.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 109 kB/s | 18 kB 00:00 2024-03-19T05:49:57.947 INFO:teuthology.orchestra.run.smithi172.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-03-19T05:49:57.972 INFO:teuthology.orchestra.run.smithi172.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-19T05:49:57.997 INFO:teuthology.orchestra.run.smithi172.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 211 kB 00:00 2024-03-19T05:49:58.023 INFO:teuthology.orchestra.run.smithi172.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 582 kB/s | 43 kB 00:00 2024-03-19T05:49:58.148 INFO:teuthology.orchestra.run.smithi072.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 5.8 MB 00:00 2024-03-19T05:49:58.265 INFO:teuthology.orchestra.run.smithi172.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 56 kB/s | 15 kB 00:00 2024-03-19T05:49:58.290 INFO:teuthology.orchestra.run.smithi072.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 427 kB/s | 248 kB 00:00 2024-03-19T05:49:58.298 INFO:teuthology.orchestra.run.smithi172.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 107 kB/s | 32 kB 00:00 2024-03-19T05:49:58.349 INFO:teuthology.orchestra.run.smithi172.stdout:(10/13): python3-google-auth-2.28.0-1.el9.noarc 624 kB/s | 203 kB 00:00 2024-03-19T05:49:58.466 INFO:teuthology.orchestra.run.smithi172.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 5.1 MB/s | 1.0 MB 00:00 2024-03-19T05:49:58.490 INFO:teuthology.orchestra.run.smithi072.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 169 kB/s | 58 kB 00:00 2024-03-19T05:49:58.491 INFO:teuthology.orchestra.run.smithi172.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 310 kB/s | 59 kB 00:00 2024-03-19T05:49:58.539 INFO:teuthology.orchestra.run.smithi172.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 475 kB/s | 90 kB 00:00 2024-03-19T05:49:58.551 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:58.552 INFO:teuthology.orchestra.run.smithi172.stdout:Total 2.4 MB/s | 2.0 MB 00:00 2024-03-19T05:49:58.553 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:49:58.594 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:49:58.595 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:49:58.616 INFO:teuthology.orchestra.run.smithi072.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 157 kB/s | 51 kB 00:00 2024-03-19T05:49:58.708 INFO:teuthology.orchestra.run.smithi072.stdout:(6/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 620 kB/s | 548 kB 00:00 2024-03-19T05:49:58.716 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:49:58.717 INFO:teuthology.orchestra.run.smithi072.stdout:Total 6.1 MB/s | 6.8 MB 00:01 2024-03-19T05:49:58.749 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:49:58.750 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:49:58.757 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:49:58.791 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:49:58.791 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:49:58.927 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:49:58.928 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:49:59.313 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:49:59.392 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:49:59.523 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-19T05:49:59.584 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-03-19T05:49:59.595 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-19T05:49:59.660 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-19T05:49:59.725 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-19T05:49:59.763 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-19T05:49:59.807 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-19T05:49:59.934 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-19T05:50:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 7/13 2024-03-19T05:50:00.135 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-19T05:50:00.286 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-19T05:50:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-19T05:50:00.466 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-19T05:50:00.495 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-03-19T05:50:01.066 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-19T05:50:01.126 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-19T05:50:01.159 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-19T05:50:01.212 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-19T05:50:01.236 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-03-19T05:50:01.669 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-03-19T05:50:01.669 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-03-19T05:50:01.670 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-19T05:50:01.670 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-19T05:50:01.670 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-03-19T05:50:01.670 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-19T05:50:01.998 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-19T05:50:01.999 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:01.999 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:50:01.999 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-03-19T05:50:01.999 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-19T05:50:01.999 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-19T05:50:01.999 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-19T05:50:01.999 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-19T05:50:01.999 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-19T05:50:01.999 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:01.999 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:02.168 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-03-19T05:50:02.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-03-19T05:50:02.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-19T05:50:02.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-19T05:50:02.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-19T05:50:02.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-19T05:50:02.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-19T05:50:02.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-19T05:50:02.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-19T05:50:02.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-19T05:50:02.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 10/13 2024-03-19T05:50:02.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-19T05:50:02.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-19T05:50:02.425 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-fuse 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-19T05:50:02.592 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-19T05:50:02.593 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-19T05:50:02.593 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-19T05:50:02.593 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-19T05:50:02.593 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:02.593 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:02.937 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-cephadm 2024-03-19T05:50:03.259 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:03 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:03.419 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:03.419 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:03.419 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-03-19T05:50:03.419 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:03.420 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:50:03.420 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-03-19T05:50:03.420 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-03-19T05:50:03.420 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-19T05:50:03.420 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:03.420 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:50:03.420 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:03.420 INFO:teuthology.orchestra.run.smithi072.stdout:Install 2 Packages 2024-03-19T05:50:03.420 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:03.421 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 913 k 2024-03-19T05:50:03.421 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 2.7 M 2024-03-19T05:50:03.421 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:50:03.541 INFO:teuthology.orchestra.run.smithi072.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 6.8 MB/s | 835 kB 00:00 2024-03-19T05:50:03.591 INFO:teuthology.orchestra.run.smithi072.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 463 kB/s | 79 kB 00:00 2024-03-19T05:50:03.595 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:03.595 INFO:teuthology.orchestra.run.smithi072.stdout:Total 5.1 MB/s | 913 kB 00:00 2024-03-19T05:50:03.596 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:50:03.657 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:50:03.657 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:50:03.758 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:50:03.758 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:50:03.760 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:57 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:03.919 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:03.922 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:03.922 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout:Install 6 Packages 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:03.923 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 6.8 M 2024-03-19T05:50:03.924 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 33 M 2024-03-19T05:50:03.924 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:50:04.010 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:50:04.169 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-19T05:50:04.243 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-03-19T05:50:04.484 INFO:teuthology.orchestra.run.smithi172.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 842 kB/s | 127 kB 00:00 2024-03-19T05:50:04.701 INFO:teuthology.orchestra.run.smithi172.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 5.8 MB 00:00 2024-03-19T05:50:04.734 INFO:teuthology.orchestra.run.smithi172.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 618 kB/s | 248 kB 00:00 2024-03-19T05:50:04.801 INFO:teuthology.orchestra.run.smithi172.stdout:(4/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 1.7 MB/s | 548 kB 00:00 2024-03-19T05:50:04.835 INFO:teuthology.orchestra.run.smithi172.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 435 kB/s | 58 kB 00:00 2024-03-19T05:50:04.860 INFO:teuthology.orchestra.run.smithi172.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 410 kB/s | 51 kB 00:00 2024-03-19T05:50:04.864 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:04.866 INFO:teuthology.orchestra.run.smithi172.stdout:Total 7.2 MB/s | 6.8 MB 00:00 2024-03-19T05:50:04.905 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:50:04.942 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:50:04.942 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:50:05.080 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:50:05.081 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:50:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-03-19T05:50:05.260 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-03-19T05:50:05.469 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:50:05.584 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-19T05:50:05.584 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:05.584 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:50:05.584 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-19T05:50:05.584 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:05.584 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:05.683 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-19T05:50:05.743 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-03-19T05:50:05.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install librados-devel 2024-03-19T05:50:06.433 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-19T05:50:06.533 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-19T05:50:06.604 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-19T05:50:06.632 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-03-19T05:50:06.831 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:06 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:06.990 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:06.990 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:06.990 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-03-19T05:50:06.990 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:06.991 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:50:06.991 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-03-19T05:50:06.991 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:06.991 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:50:06.991 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:06.991 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-03-19T05:50:06.991 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:06.991 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 126 k 2024-03-19T05:50:06.991 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 456 k 2024-03-19T05:50:06.991 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:50:07.063 INFO:teuthology.orchestra.run.smithi072.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 1.7 MB/s | 126 kB 00:00 2024-03-19T05:50:07.063 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:07.064 INFO:teuthology.orchestra.run.smithi072.stdout:Total 1.7 MB/s | 126 kB 00:00 2024-03-19T05:50:07.064 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:50:07.070 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:50:07.070 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:50:07.130 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:50:07.131 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:50:07.286 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:50:07.408 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:07.531 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-03-19T05:50:07.531 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-03-19T05:50:07.531 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-19T05:50:07.531 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-19T05:50:07.531 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-03-19T05:50:07.531 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-19T05:50:07.889 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-19T05:50:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:07.890 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:50:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-03-19T05:50:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-19T05:50:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-19T05:50:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-19T05:50:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-19T05:50:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-19T05:50:07.890 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:07.890 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:07.987 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:08.225 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-fuse 2024-03-19T05:50:08.369 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:08.370 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:08.370 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:50:08.370 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-03-19T05:50:08.370 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:08.370 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:08.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install libcephfs2 2024-03-19T05:50:09.066 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:03 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:09.227 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:09.228 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:09.228 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-03-19T05:50:09.228 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:09.228 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:50:09.228 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-03-19T05:50:09.228 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-03-19T05:50:09.228 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-19T05:50:09.228 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:09.228 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:50:09.229 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:09.229 INFO:teuthology.orchestra.run.smithi172.stdout:Install 2 Packages 2024-03-19T05:50:09.229 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:09.229 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 913 k 2024-03-19T05:50:09.229 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 2.7 M 2024-03-19T05:50:09.229 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:50:09.336 INFO:teuthology.orchestra.run.smithi172.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 7.7 MB/s | 835 kB 00:00 2024-03-19T05:50:09.394 INFO:teuthology.orchestra.run.smithi172.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 478 kB/s | 79 kB 00:00 2024-03-19T05:50:09.397 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:09.397 INFO:teuthology.orchestra.run.smithi172.stdout:Total 5.3 MB/s | 913 kB 00:00 2024-03-19T05:50:09.398 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:50:09.455 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:50:09.455 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:50:09.542 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:09 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:09.555 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:50:09.555 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:50:09.643 INFO:teuthology.orchestra.run.smithi072.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:09.698 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:09.699 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-03-19T05:50:09.699 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:09.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install libcephfs-devel 2024-03-19T05:50:09.819 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:50:09.986 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-19T05:50:10.064 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-03-19T05:50:10.592 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:10 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:10.753 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:10.753 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:10.753 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-03-19T05:50:10.753 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:10.753 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:50:10.753 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-03-19T05:50:10.753 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:10.754 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:50:10.754 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:10.754 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-03-19T05:50:10.754 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:10.754 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 30 k 2024-03-19T05:50:10.754 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 137 k 2024-03-19T05:50:10.754 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:50:10.830 INFO:teuthology.orchestra.run.smithi072.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 405 kB/s | 30 kB 00:00 2024-03-19T05:50:10.831 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:10.831 INFO:teuthology.orchestra.run.smithi072.stdout:Total 395 kB/s | 30 kB 00:00 2024-03-19T05:50:10.831 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:50:10.835 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:50:10.836 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:50:10.870 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:50:10.870 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:50:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-03-19T05:50:11.005 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-03-19T05:50:11.006 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:50:11.161 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:11.362 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-19T05:50:11.362 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:11.362 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:50:11.362 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-19T05:50:11.362 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:11.362 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:11.663 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:11.682 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados-devel 2024-03-19T05:50:11.943 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:11.944 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:50:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-03-19T05:50:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:11.944 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:12.209 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install librados2 2024-03-19T05:50:12.512 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:06 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:12.671 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 126 k 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 456 k 2024-03-19T05:50:12.672 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:50:12.743 INFO:teuthology.orchestra.run.smithi172.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 1.8 MB/s | 126 kB 00:00 2024-03-19T05:50:12.743 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:12.743 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.7 MB/s | 126 kB 00:00 2024-03-19T05:50:12.743 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:50:12.750 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:50:12.750 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:50:12.810 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:50:12.810 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:50:12.963 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:50:13.040 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:13 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:13.065 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:13.142 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:13.199 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:13.200 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-03-19T05:50:13.200 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:13.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install librbd1 2024-03-19T05:50:13.654 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:13.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:13.980 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:13.980 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:50:13.980 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-03-19T05:50:13.980 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:13.981 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:14.094 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:14 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:14.197 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:14.254 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:14.255 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-03-19T05:50:14.255 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:14.308 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install libcephfs2 2024-03-19T05:50:14.328 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install python3-rados 2024-03-19T05:50:15.132 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:15 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:15.160 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:09 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:15.233 INFO:teuthology.orchestra.run.smithi072.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:15.260 INFO:teuthology.orchestra.run.smithi172.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:15.290 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:15.291 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-03-19T05:50:15.291 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:15.314 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:15.316 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-03-19T05:50:15.316 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:15.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install python3-rgw 2024-03-19T05:50:15.387 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install libcephfs-devel 2024-03-19T05:50:16.195 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:10 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:16.207 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:16 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:16.306 INFO:teuthology.orchestra.run.smithi072.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:16.353 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:16.353 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:16.353 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-03-19T05:50:16.354 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:16.354 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:50:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-03-19T05:50:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:16.354 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:50:16.354 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:16.354 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-03-19T05:50:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:16.354 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 30 k 2024-03-19T05:50:16.354 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 137 k 2024-03-19T05:50:16.354 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:50:16.361 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:16.363 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-03-19T05:50:16.363 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:16.421 INFO:teuthology.orchestra.run.smithi172.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 461 kB/s | 30 kB 00:00 2024-03-19T05:50:16.422 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:16.422 INFO:teuthology.orchestra.run.smithi172.stdout:Total 449 kB/s | 30 kB 00:00 2024-03-19T05:50:16.422 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:50:16.426 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:50:16.426 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:50:16.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install python3-cephfs 2024-03-19T05:50:16.450 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:50:16.451 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:50:16.575 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:50:16.719 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:17.135 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:17.224 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:17 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:17.327 INFO:teuthology.orchestra.run.smithi072.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:17.382 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:17.383 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-03-19T05:50:17.384 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:17.386 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:50:17.386 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-03-19T05:50:17.387 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:17.387 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:17.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install python3-rbd 2024-03-19T05:50:17.648 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados2 2024-03-19T05:50:18.330 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:18 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:18.437 INFO:teuthology.orchestra.run.smithi072.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:18.472 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:12 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:18.495 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:18.496 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2024-03-19T05:50:18.496 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:18.576 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install rbd-fuse 2024-03-19T05:50:18.577 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:18.633 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:18.634 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-03-19T05:50:18.634 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:18.705 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librbd1 2024-03-19T05:50:19.378 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:19 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:19.537 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:19.538 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:19.538 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-03-19T05:50:19.538 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:19.538 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:50:19.539 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-03-19T05:50:19.539 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:19.539 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:50:19.539 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:19.539 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-03-19T05:50:19.539 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:19.539 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 86 k 2024-03-19T05:50:19.539 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 230 k 2024-03-19T05:50:19.539 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:50:19.546 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:13 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:19.617 INFO:teuthology.orchestra.run.smithi072.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-03-19T05:50:19.618 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:19.618 INFO:teuthology.orchestra.run.smithi072.stdout:Total 1.1 MB/s | 86 kB 00:00 2024-03-19T05:50:19.618 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:50:19.627 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:50:19.627 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:50:19.650 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:19.687 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:50:19.687 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:50:19.707 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:19.708 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-03-19T05:50:19.708 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:19.778 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rados 2024-03-19T05:50:19.841 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:50:19.943 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:20.617 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:14 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:20.718 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:20.774 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:20.775 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-03-19T05:50:20.775 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:20.836 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:20.836 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:20.836 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:50:20.836 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-03-19T05:50:20.836 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:20.836 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:20.841 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rgw 2024-03-19T05:50:21.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install rbd-mirror 2024-03-19T05:50:21.645 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:15 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:21.747 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:21.802 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:21.803 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-03-19T05:50:21.803 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:21.869 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-cephfs 2024-03-19T05:50:22.014 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:22 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:22.171 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:22.172 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:22.172 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-03-19T05:50:22.172 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:22.172 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:50:22.172 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-03-19T05:50:22.172 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:22.172 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:50:22.172 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:22.172 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-03-19T05:50:22.172 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:22.173 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 3.0 M 2024-03-19T05:50:22.173 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 12 M 2024-03-19T05:50:22.173 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:50:22.317 INFO:teuthology.orchestra.run.smithi072.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 21 MB/s | 3.0 MB 00:00 2024-03-19T05:50:22.318 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:22.319 INFO:teuthology.orchestra.run.smithi072.stdout:Total 20 MB/s | 3.0 MB 00:00 2024-03-19T05:50:22.319 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:50:22.329 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:50:22.329 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:50:22.406 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:50:22.407 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:50:22.690 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:16 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:22.792 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:22.848 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:22.849 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-03-19T05:50:22.849 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:22.857 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:50:22.920 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rbd 2024-03-19T05:50:22.921 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:23.016 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:23.016 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:50:23.016 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-19T05:50:23.016 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-19T05:50:23.017 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-19T05:50:23.017 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:23.759 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:17 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:23.860 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-03-19T05:50:23.916 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:23.917 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-03-19T05:50:23.917 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:23.986 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-fuse 2024-03-19T05:50:24.601 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:24.602 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:24.602 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:50:24.602 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-03-19T05:50:24.602 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:24.602 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:24.811 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:18 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:24.975 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:24.975 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:24.975 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-03-19T05:50:24.975 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:24.975 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:50:24.976 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-03-19T05:50:24.976 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:24.976 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:50:24.976 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:24.976 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-03-19T05:50:24.976 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:24.977 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 86 k 2024-03-19T05:50:24.977 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 230 k 2024-03-19T05:50:24.977 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:50:24.998 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install rbd-nbd 2024-03-19T05:50:25.058 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2024-03-19T05:50:25.059 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:25.059 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.0 MB/s | 86 kB 00:00 2024-03-19T05:50:25.059 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:50:25.067 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:50:25.067 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:50:25.127 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:50:25.128 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:50:25.282 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:50:25.381 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:25.834 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:02:25 ago on Tue 19 Mar 2024 05:48:00 AM UTC. 2024-03-19T05:50:25.909 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:25.994 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-19T05:50:25.995 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:25.995 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-03-19T05:50:25.995 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:25.995 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-19T05:50:25.995 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-03-19T05:50:25.995 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:25.996 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-19T05:50:25.996 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-19T05:50:25.996 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2024-03-19T05:50:25.996 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:25.996 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 169 k 2024-03-19T05:50:25.996 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 490 k 2024-03-19T05:50:25.996 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-19T05:50:26.079 INFO:teuthology.orchestra.run.smithi072.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.0 MB/s | 169 kB 00:00 2024-03-19T05:50:26.079 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:26.080 INFO:teuthology.orchestra.run.smithi072.stdout:Total 2.0 MB/s | 169 kB 00:00 2024-03-19T05:50:26.080 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-19T05:50:26.089 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-19T05:50:26.089 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-19T05:50:26.149 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-19T05:50:26.150 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-19T05:50:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:26.191 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:50:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-03-19T05:50:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:26.191 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:26.343 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-19T05:50:26.460 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:26.483 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-mirror 2024-03-19T05:50:27.082 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:27.393 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:21 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:27.402 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:27.402 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:27.402 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-19T05:50:27.402 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-03-19T05:50:27.402 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:50:27.402 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-19T05:50:27.549 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:27.549 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:27.549 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-03-19T05:50:27.549 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:27.549 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:50:27.549 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-03-19T05:50:27.550 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:27.550 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:50:27.550 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:27.550 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-03-19T05:50:27.550 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:27.550 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 3.0 M 2024-03-19T05:50:27.550 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 12 M 2024-03-19T05:50:27.551 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:50:27.669 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 25 MB/s | 3.0 MB 00:00 2024-03-19T05:50:27.669 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:27.670 INFO:teuthology.orchestra.run.smithi172.stdout:Total 25 MB/s | 3.0 MB 00:00 2024-03-19T05:50:27.670 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:50:27.680 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:50:27.681 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:50:27.732 DEBUG:teuthology.parallel:result is None 2024-03-19T05:50:27.758 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:50:27.759 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:50:28.206 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:50:28.261 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:28.329 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:28.330 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T05:50:28.330 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-19T05:50:28.330 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-19T05:50:28.330 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-19T05:50:28.330 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:29.705 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:29.705 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:29.705 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:50:29.705 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-03-19T05:50:29.705 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:29.705 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:30.017 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-nbd 2024-03-19T05:50:30.843 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:24 ago on Tue 19 Mar 2024 05:48:06 AM UTC. 2024-03-19T05:50:31.003 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-19T05:50:31.004 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:31.004 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-03-19T05:50:31.004 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:31.004 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-19T05:50:31.005 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-03-19T05:50:31.005 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:31.005 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-19T05:50:31.005 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-19T05:50:31.005 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-03-19T05:50:31.005 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:31.005 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 169 k 2024-03-19T05:50:31.005 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 490 k 2024-03-19T05:50:31.005 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-19T05:50:31.080 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.2 MB/s | 169 kB 00:00 2024-03-19T05:50:31.080 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:50:31.081 INFO:teuthology.orchestra.run.smithi172.stdout:Total 2.2 MB/s | 169 kB 00:00 2024-03-19T05:50:31.081 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-19T05:50:31.090 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-19T05:50:31.090 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-19T05:50:31.152 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-19T05:50:31.153 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-19T05:50:31.329 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-19T05:50:31.441 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-03-19T05:50:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:32.277 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-19T05:50:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-03-19T05:50:32.277 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:50:32.278 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-19T05:50:32.607 DEBUG:teuthology.parallel:result is None 2024-03-19T05:50:32.607 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-03-19T05:50:32.607 INFO:teuthology.packaging:ref: None 2024-03-19T05:50:32.607 INFO:teuthology.packaging:tag: v18.2.0 2024-03-19T05:50:32.607 INFO:teuthology.packaging:branch: None 2024-03-19T05:50:32.608 INFO:teuthology.packaging:sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T05:50:32.608 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-03-19T05:50:32.608 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-03-19T05:50:32.751 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-19T05:50:32.822 INFO:teuthology.orchestra.run.smithi072.stdout:18.2.0-0.el9 2024-03-19T05:50:32.822 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-03-19T05:50:32.823 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-03-19T05:50:32.824 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-03-19T05:50:32.824 INFO:teuthology.packaging:ref: None 2024-03-19T05:50:32.824 INFO:teuthology.packaging:tag: v18.2.0 2024-03-19T05:50:32.825 INFO:teuthology.packaging:branch: None 2024-03-19T05:50:32.825 INFO:teuthology.packaging:sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T05:50:32.825 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-03-19T05:50:32.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-03-19T05:50:33.045 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-19T05:50:33.116 INFO:teuthology.orchestra.run.smithi172.stdout:18.2.0-0.el9 2024-03-19T05:50:33.116 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-03-19T05:50:33.117 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-03-19T05:50:33.118 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-19T05:50:33.119 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:50:33.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-19T05:50:33.219 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T05:50:33.219 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-19T05:50:33.318 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-19T05:50:33.318 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:50:33.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2024-03-19T05:50:33.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-19T05:50:33.550 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T05:50:33.550 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-03-19T05:50:33.650 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-19T05:50:33.789 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-19T05:50:33.790 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:50:33.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-19T05:50:33.892 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-19T05:50:34.030 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T05:50:34.030 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-19T05:50:34.125 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-19T05:50:34.262 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-19T05:50:34.262 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:50:34.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2024-03-19T05:50:34.359 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-19T05:50:34.451 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T05:50:34.451 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-03-19T05:50:34.549 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-19T05:50:34.857 INFO:teuthology.run_tasks:Running task print... 2024-03-19T05:50:34.868 INFO:teuthology.task.print:**** done install task... 2024-03-19T05:50:34.868 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-19T05:50:34.987 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'} 2024-03-19T05:50:34.988 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-03-19T05:50:34.988 INFO:tasks.cephadm:Cluster fsid is 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:50:34.988 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-19T05:50:34.988 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-03-19T05:50:34.988 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi072': '172.21.15.72', 'mon.smithi172': '172.21.15.172'} 2024-03-19T05:50:34.989 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-19T05:50:34.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname $(hostname -s) 2024-03-19T05:50:35.091 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2024-03-19T05:50:35.182 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-03-19T05:50:35.182 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T05:50:35.408 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77402/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1934-gb0ea271b', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1934.gb0ea271b'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-07 06:33:35.443022', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240307.022905', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-03-19T05:50:35.628 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref reef, sha1 539f0b1d5bf96c2685ece5ec413de92be6f78c14 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-03-19T05:50:35.630 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/reef/539f0b1d5bf96c2685ece5ec413de92be6f78c14/centos/9/x86_64/flavors/default/cephadm 2024-03-19T05:50:35.630 DEBUG:teuthology.orchestra.run.smithi072:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/539f0b1d5bf96c2685ece5ec413de92be6f78c14/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-19T05:50:36.127 INFO:teuthology.orchestra.run.smithi072.stdout:-rw-r--r--. 1 ubuntu ubuntu 215105 Mar 19 05:50 /home/ubuntu/cephtest/cephadm 2024-03-19T05:50:36.128 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/539f0b1d5bf96c2685ece5ec413de92be6f78c14/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-19T05:50:36.766 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r--. 1 ubuntu ubuntu 215105 Mar 19 05:50 /home/ubuntu/cephtest/cephadm 2024-03-19T05:50:36.766 DEBUG:teuthology.orchestra.run.smithi072:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-19T05:50:36.826 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-19T05:50:36.896 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-03-19T05:50:36.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-03-19T05:50:36.903 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-03-19T05:50:37.964 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-03-19T05:50:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-03-19T05:51:01.088 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-03-19T05:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-03-19T05:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-03-19T05:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2024-03-19T05:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-03-19T05:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-03-19T05:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-03-19T05:51:01.089 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-03-19T05:51:02.292 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T05:51:02.292 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-03-19T05:51:02.292 INFO:teuthology.orchestra.run.smithi072.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-03-19T05:51:02.292 INFO:teuthology.orchestra.run.smithi072.stdout: "repo_digests": [ 2024-03-19T05:51:02.292 INFO:teuthology.orchestra.run.smithi072.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-03-19T05:51:02.292 INFO:teuthology.orchestra.run.smithi072.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-03-19T05:51:02.292 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-03-19T05:51:02.292 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T05:51:02.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph 2024-03-19T05:51:02.414 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2024-03-19T05:51:02.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /etc/ceph 2024-03-19T05:51:02.618 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2024-03-19T05:51:02.718 INFO:tasks.cephadm:Writing seed config... 2024-03-19T05:51:02.719 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-03-19T05:51:02.719 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-03-19T05:51:02.719 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-03-19T05:51:02.719 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-03-19T05:51:02.719 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-03-19T05:51:02.719 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-03-19T05:51:02.720 INFO:tasks.cephadm: override: [client] debug client = 20 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-03-19T05:51:02.721 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-03-19T05:51:02.722 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-03-19T05:51:02.722 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-19T05:51:02.722 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-19T05:51:02.722 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-19T05:51:02.722 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-19T05:51:02.722 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-19T05:51:02.722 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-03-19T05:51:02.723 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:51:02.723 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-19T05:51:02.778 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 9ad98512-e5b4-11ee-95c9-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-03-19T05:51:02.778 DEBUG:teuthology.orchestra.run.smithi072:mon.smithi072> sudo journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi072.service 2024-03-19T05:51:02.826 INFO:tasks.cephadm:Bootstrapping... 2024-03-19T05:51:02.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.72 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-19T05:51:03.065 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:51:03.065 INFO:teuthology.orchestra.run.smithi072.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', '9ad98512-e5b4-11ee-95c9-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.72', '--skip-admin-label'] 2024-03-19T05:51:03.118 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-19T05:51:03.119 INFO:teuthology.orchestra.run.smithi072.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-19T05:51:03.119 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying podman|docker is present... 2024-03-19T05:51:03.173 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-19T05:51:03.173 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying lvm2 is present... 2024-03-19T05:51:03.173 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying time synchronization is in place... 2024-03-19T05:51:03.192 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-19T05:51:03.192 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-19T05:51:03.209 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-19T05:51:03.209 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-19T05:51:03.229 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout enabled 2024-03-19T05:51:03.250 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout active 2024-03-19T05:51:03.250 INFO:teuthology.orchestra.run.smithi072.stdout:Unit chronyd.service is enabled and running 2024-03-19T05:51:03.251 INFO:teuthology.orchestra.run.smithi072.stdout:Repeating the final host check... 2024-03-19T05:51:03.306 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-19T05:51:03.306 INFO:teuthology.orchestra.run.smithi072.stdout:podman (/bin/podman) version 4.9.3 is present 2024-03-19T05:51:03.306 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl is present 2024-03-19T05:51:03.306 INFO:teuthology.orchestra.run.smithi072.stdout:lvcreate is present 2024-03-19T05:51:03.322 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-19T05:51:03.322 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-19T05:51:03.337 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-19T05:51:03.337 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-19T05:51:03.356 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout enabled 2024-03-19T05:51:03.378 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout active 2024-03-19T05:51:03.378 INFO:teuthology.orchestra.run.smithi072.stdout:Unit chronyd.service is enabled and running 2024-03-19T05:51:03.380 INFO:teuthology.orchestra.run.smithi072.stdout:Host looks OK 2024-03-19T05:51:03.380 INFO:teuthology.orchestra.run.smithi072.stdout:Cluster fsid: 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:51:03.380 INFO:teuthology.orchestra.run.smithi072.stdout:Acquiring lock 139895217461952 on /run/cephadm/9ad98512-e5b4-11ee-95c9-87774f69a715.lock 2024-03-19T05:51:03.380 INFO:teuthology.orchestra.run.smithi072.stdout:Lock 139895217461952 acquired on /run/cephadm/9ad98512-e5b4-11ee-95c9-87774f69a715.lock 2024-03-19T05:51:03.381 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying IP 172.21.15.72 port 3300 ... 2024-03-19T05:51:03.382 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying IP 172.21.15.72 port 6789 ... 2024-03-19T05:51:03.382 INFO:teuthology.orchestra.run.smithi072.stdout:Base mon IP(s) is [172.21.15.72:3300, 172.21.15.72:6789], mon addrv is [v2:172.21.15.72:3300,v1:172.21.15.72:6789] 2024-03-19T05:51:03.397 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.72 metric 100 2024-03-19T05:51:03.398 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.72 metric 100 2024-03-19T05:51:03.410 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-19T05:51:03.410 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-03-19T05:51:03.411 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1777sec hoplimit 64 pref medium 2024-03-19T05:51:03.422 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-19T05:51:03.422 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-19T05:51:03.422 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-19T05:51:03.422 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-03-19T05:51:03.422 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-03-19T05:51:03.423 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-19T05:51:03.425 INFO:teuthology.orchestra.run.smithi072.stdout:Mon IP `172.21.15.72` is in CIDR network `172.21.0.0/20` 2024-03-19T05:51:03.425 INFO:teuthology.orchestra.run.smithi072.stdout:Mon IP `172.21.15.72` is in CIDR network `172.21.0.0/20` 2024-03-19T05:51:03.426 INFO:teuthology.orchestra.run.smithi072.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-19T05:51:03.428 INFO:teuthology.orchestra.run.smithi072.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-19T05:51:03.430 INFO:teuthology.orchestra.run.smithi072.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-03-19T05:51:04.519 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-03-19T05:51:04.519 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-03-19T05:51:04.519 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stderr Getting image source signatures 2024-03-19T05:51:04.520 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-03-19T05:51:04.520 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-03-19T05:51:04.520 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-03-19T05:51:04.520 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-19T05:51:05.788 INFO:teuthology.orchestra.run.smithi072.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-03-19T05:51:05.789 INFO:teuthology.orchestra.run.smithi072.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-03-19T05:51:05.789 INFO:teuthology.orchestra.run.smithi072.stdout:Extracting ceph user uid/gid from container image... 2024-03-19T05:51:06.825 INFO:teuthology.orchestra.run.smithi072.stdout:stat: stdout 167 167 2024-03-19T05:51:06.826 INFO:teuthology.orchestra.run.smithi072.stdout:Creating initial keys... 2024-03-19T05:51:07.916 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-authtool: stdout AQDLJ/llW2VxEBAAzgStoSNBkz2qWcp5hsOvVg== 2024-03-19T05:51:08.964 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-authtool: stdout AQDMJ/llVxeXFRAAWGkbgWpYyKqdAheG7tlKYA== 2024-03-19T05:51:10.125 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-authtool: stdout AQDNJ/llZPCZGBAAwSIm6uHtHtUMoPxQyyWkvw== 2024-03-19T05:51:10.130 INFO:teuthology.orchestra.run.smithi072.stdout:Creating initial monmap... 2024-03-19T05:51:11.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-19T05:51:11.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-03-19T05:51:11.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:51:11.284 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-19T05:51:11.284 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool for smithi072 [v2:172.21.15.72:3300,v1:172.21.15.72:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-19T05:51:11.284 INFO:teuthology.orchestra.run.smithi072.stdout:setting min_mon_release = pacific 2024-03-19T05:51:11.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: set fsid to 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:51:11.285 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-19T05:51:11.285 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:51:11.285 INFO:teuthology.orchestra.run.smithi072.stdout:Creating mon... 2024-03-19T05:51:12.451 INFO:teuthology.orchestra.run.smithi072.stdout:create mon.smithi072 on 2024-03-19T05:51:12.804 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-19T05:51:13.042 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-19T05:51:13.334 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-9ad98512-e5b4-11ee-95c9-87774f69a715.target → /etc/systemd/system/ceph-9ad98512-e5b4-11ee-95c9-87774f69a715.target. 2024-03-19T05:51:13.334 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-9ad98512-e5b4-11ee-95c9-87774f69a715.target → /etc/systemd/system/ceph-9ad98512-e5b4-11ee-95c9-87774f69a715.target. 2024-03-19T05:51:13.693 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi072 2024-03-19T05:51:13.693 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi072.service: Unit ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi072.service not loaded. 2024-03-19T05:51:13.989 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9ad98512-e5b4-11ee-95c9-87774f69a715.target.wants/ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi072.service → /etc/systemd/system/ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@.service. 2024-03-19T05:51:14.642 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:14 smithi072 podman[28321]: 2024-03-19 05:51:14.27842696 +0000 UTC m=+0.035569988 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-03-19T05:51:14.642 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:14 smithi072 podman[28321]: 2024-03-19 05:51:14.647613997 +0000 UTC m=+0.404757068 container init 91cd9d593b1ef55362a27b1b30447fa66269971d530991ec2e5245d1bce4dfb3 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1) 2024-03-19T05:51:14.752 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-19T05:51:14.753 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout disabled 2024-03-19T05:51:14.771 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-19T05:51:14.771 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-19T05:51:14.771 INFO:teuthology.orchestra.run.smithi072.stdout:firewalld.service is not enabled 2024-03-19T05:51:14.771 INFO:teuthology.orchestra.run.smithi072.stdout:Not possible to enable service . firewalld.service is not available 2024-03-19T05:51:14.772 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mon to start... 2024-03-19T05:51:14.772 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mon... 2024-03-19T05:51:14.917 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:14 smithi072 podman[28321]: 2024-03-19 05:51:14.658011856 +0000 UTC m=+0.415154891 container start 91cd9d593b1ef55362a27b1b30447fa66269971d530991ec2e5245d1bce4dfb3 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD) 2024-03-19T05:51:14.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:14 smithi072 bash[28321]: 91cd9d593b1ef55362a27b1b30447fa66269971d530991ec2e5245d1bce4dfb3 2024-03-19T05:51:14.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:14 smithi072 systemd[1]: Started Ceph mon.smithi072 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T05:51:14.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:14 smithi072 ceph-mon[28340]: mkfs 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:51:14.918 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:14 smithi072 ceph-mon[28340]: mon.smithi072 is new leader, mons smithi072 in quorum (ranks 0) 2024-03-19T05:51:16.030 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:15 smithi072 ceph-mon[28340]: mon.smithi072 is new leader, mons smithi072 in quorum (ranks 0) 2024-03-19T05:51:16.030 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:15 smithi072 ceph-mon[28340]: monmap e1: 1 mons at {smithi072=[v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0]} removed_ranks: {} 2024-03-19T05:51:16.030 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:15 smithi072 ceph-mon[28340]: fsmap 2024-03-19T05:51:16.030 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:15 smithi072 ceph-mon[28340]: osdmap e1: 0 total, 0 up, 0 in 2024-03-19T05:51:16.030 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:15 smithi072 ceph-mon[28340]: mgrmap e1: no daemons active 2024-03-19T05:51:16.031 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:15 smithi072 ceph-mon[28340]: from='client.? 172.21.15.72:0/1667848871' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-19T05:51:16.055 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout cluster: 2024-03-19T05:51:16.055 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout id: 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:51:16.055 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-19T05:51:16.055 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:16.055 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout services: 2024-03-19T05:51:16.055 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi072 (age 0.691517s) 2024-03-19T05:51:16.055 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-19T05:51:16.055 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-19T05:51:16.055 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:16.055 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout data: 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout pgs: 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.333+0000 7f7965200700 1 Processor -- start 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.334+0000 7f7965200700 1 -- start start 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.334+0000 7f7965200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 0x7f7960107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.334+0000 7f7965200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7960108530 con 0x7f7960107be0 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.335+0000 7f795de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 0x7f7960107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.335+0000 7f795de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 0x7f7960107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37740/0 (socket says 172.21.15.72:37740) 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.335+0000 7f795de00700 1 -- 172.21.15.72:0/3896717009 learned_addr learned my addr 172.21.15.72:0/3896717009 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.335+0000 7f795de00700 1 -- 172.21.15.72:0/3896717009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960108670 con 0x7f7960107be0 2024-03-19T05:51:16.056 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.336+0000 7f795de00700 1 --2- 172.21.15.72:0/3896717009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 0x7f7960107ff0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f79500098a0 tx=0x7f7950009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18c0aff5c1e5d9b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.336+0000 7f795d400700 1 -- 172.21.15.72:0/3896717009 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7950004180 con 0x7f7960107be0 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.336+0000 7f795d400700 1 -- 172.21.15.72:0/3896717009 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79500042e0 con 0x7f7960107be0 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.336+0000 7f795d400700 1 -- 172.21.15.72:0/3896717009 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79500036a0 con 0x7f7960107be0 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.336+0000 7f7965200700 1 -- 172.21.15.72:0/3896717009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 msgr2=0x7f7960107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.336+0000 7f7965200700 1 --2- 172.21.15.72:0/3896717009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 0x7f7960107ff0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f79500098a0 tx=0x7f7950009bb0 comp rx=0 tx=0).stop 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.337+0000 7f7965200700 1 -- 172.21.15.72:0/3896717009 shutdown_connections 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.337+0000 7f7965200700 1 --2- 172.21.15.72:0/3896717009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 0x7f7960107ff0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.337+0000 7f7965200700 1 -- 172.21.15.72:0/3896717009 >> 172.21.15.72:0/3896717009 conn(0x7f796007b200 msgr2=0x7f796007b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.337+0000 7f7965200700 1 -- 172.21.15.72:0/3896717009 shutdown_connections 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.337+0000 7f7965200700 1 -- 172.21.15.72:0/3896717009 wait complete. 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.338+0000 7f7965200700 1 Processor -- start 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.338+0000 7f7965200700 1 -- start start 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.338+0000 7f7965200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 0x7f796019b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.338+0000 7f7965200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796019b5f0 con 0x7f7960107be0 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.338+0000 7f795de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 0x7f796019b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.338+0000 7f795de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 0x7f796019b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37746/0 (socket says 172.21.15.72:37746) 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.338+0000 7f795de00700 1 -- 172.21.15.72:0/1667848871 learned_addr learned my addr 172.21.15.72:0/1667848871 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.339+0000 7f795de00700 1 -- 172.21.15.72:0/1667848871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7950009550 con 0x7f7960107be0 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.339+0000 7f795de00700 1 --2- 172.21.15.72:0/1667848871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 0x7f796019b0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7960108910 tx=0x7f7950004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.339+0000 7f7956a00700 1 -- 172.21.15.72:0/1667848871 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7950003ce0 con 0x7f7960107be0 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.339+0000 7f7956a00700 1 -- 172.21.15.72:0/1667848871 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7950020070 con 0x7f7960107be0 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.339+0000 7f7956a00700 1 -- 172.21.15.72:0/1667848871 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7950011630 con 0x7f7960107be0 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.339+0000 7f7965200700 1 -- 172.21.15.72:0/1667848871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796019b7f0 con 0x7f7960107be0 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.340+0000 7f7965200700 1 -- 172.21.15.72:0/1667848871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796019bc90 con 0x7f7960107be0 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.340+0000 7f7956a00700 1 -- 172.21.15.72:0/1667848871 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7950022030 con 0x7f7960107be0 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.340+0000 7f7956a00700 1 -- 172.21.15.72:0/1667848871 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7950025d40 con 0x7f7960107be0 2024-03-19T05:51:16.058 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.341+0000 7f7965200700 1 -- 172.21.15.72:0/1667848871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7960194880 con 0x7f7960107be0 2024-03-19T05:51:16.059 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.344+0000 7f7956a00700 1 -- 172.21.15.72:0/1667848871 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f7950025480 con 0x7f7960107be0 2024-03-19T05:51:16.059 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.422+0000 7f7965200700 1 -- 172.21.15.72:0/1667848871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f7960062380 con 0x7f7960107be0 2024-03-19T05:51:16.059 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.423+0000 7f7956a00700 1 -- 172.21.15.72:0/1667848871 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f7950011bd0 con 0x7f7960107be0 2024-03-19T05:51:16.059 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.424+0000 7f7965200700 1 -- 172.21.15.72:0/1667848871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 msgr2=0x7f796019b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:16.059 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.424+0000 7f7965200700 1 --2- 172.21.15.72:0/1667848871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 0x7f796019b0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7960108910 tx=0x7f7950004750 comp rx=0 tx=0).stop 2024-03-19T05:51:16.059 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.424+0000 7f7965200700 1 -- 172.21.15.72:0/1667848871 shutdown_connections 2024-03-19T05:51:16.059 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.424+0000 7f7965200700 1 --2- 172.21.15.72:0/1667848871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7960107be0 0x7f796019b0b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:16.059 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.424+0000 7f7965200700 1 -- 172.21.15.72:0/1667848871 >> 172.21.15.72:0/1667848871 conn(0x7f796007b200 msgr2=0x7f796018f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:16.059 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.424+0000 7f7965200700 1 -- 172.21.15.72:0/1667848871 shutdown_connections 2024-03-19T05:51:16.059 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:15.424+0000 7f7965200700 1 -- 172.21.15.72:0/1667848871 wait complete. 2024-03-19T05:51:16.059 INFO:teuthology.orchestra.run.smithi072.stdout:mon is available 2024-03-19T05:51:16.059 INFO:teuthology.orchestra.run.smithi072.stdout:Assimilating anything we can from ceph.conf... 2024-03-19T05:51:17.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:16 smithi072 ceph-mon[28340]: from='client.? 172.21.15.72:0/1509402296' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-19T05:51:17.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:16 smithi072 ceph-mon[28340]: from='client.? 172.21.15.72:0/1509402296' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-19T05:51:17.393 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:17.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [global] 2024-03-19T05:51:17.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout fsid = 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:51:17.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.72:3300,v1:172.21.15.72:6789] 2024-03-19T05:51:17.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-19T05:51:17.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-19T05:51:17.394 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-19T05:51:17.395 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-19T05:51:17.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:17.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-19T05:51:17.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-19T05:51:17.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:17.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [osd] 2024-03-19T05:51:17.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-19T05:51:17.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-19T05:51:17.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-19T05:51:17.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-19T05:51:17.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-19T05:51:17.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.620+0000 7ff745a00700 1 Processor -- start 2024-03-19T05:51:17.401 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.620+0000 7ff745a00700 1 -- start start 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.620+0000 7ff745a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 0x7ff740107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.620+0000 7ff745a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff740108530 con 0x7ff740107be0 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.621+0000 7ff73ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 0x7ff740107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.621+0000 7ff73ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 0x7ff740107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37756/0 (socket says 172.21.15.72:37756) 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.621+0000 7ff73ea00700 1 -- 172.21.15.72:0/1643568495 learned_addr learned my addr 172.21.15.72:0/1643568495 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.621+0000 7ff73ea00700 1 -- 172.21.15.72:0/1643568495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740108670 con 0x7ff740107be0 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.622+0000 7ff73ea00700 1 --2- 172.21.15.72:0/1643568495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 0x7ff740107ff0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff7300098a0 tx=0x7ff730009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65aa20d97238f3c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.622+0000 7ff73d600700 1 -- 172.21.15.72:0/1643568495 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff730004180 con 0x7ff740107be0 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.622+0000 7ff73d600700 1 -- 172.21.15.72:0/1643568495 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7300042e0 con 0x7ff740107be0 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.622+0000 7ff73d600700 1 -- 172.21.15.72:0/1643568495 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7300036a0 con 0x7ff740107be0 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.623+0000 7ff745a00700 1 -- 172.21.15.72:0/1643568495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 msgr2=0x7ff740107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.623+0000 7ff745a00700 1 --2- 172.21.15.72:0/1643568495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 0x7ff740107ff0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff7300098a0 tx=0x7ff730009bb0 comp rx=0 tx=0).stop 2024-03-19T05:51:17.402 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.623+0000 7ff745a00700 1 -- 172.21.15.72:0/1643568495 shutdown_connections 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.623+0000 7ff745a00700 1 --2- 172.21.15.72:0/1643568495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 0x7ff740107ff0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.623+0000 7ff745a00700 1 -- 172.21.15.72:0/1643568495 >> 172.21.15.72:0/1643568495 conn(0x7ff74007b200 msgr2=0x7ff74007b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.623+0000 7ff745a00700 1 -- 172.21.15.72:0/1643568495 shutdown_connections 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.623+0000 7ff745a00700 1 -- 172.21.15.72:0/1643568495 wait complete. 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.624+0000 7ff745a00700 1 Processor -- start 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.624+0000 7ff745a00700 1 -- start start 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.625+0000 7ff745a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 0x7ff74019b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.625+0000 7ff745a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74019b5f0 con 0x7ff740107be0 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.625+0000 7ff73ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 0x7ff74019b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.625+0000 7ff73ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 0x7ff74019b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37766/0 (socket says 172.21.15.72:37766) 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.625+0000 7ff73ea00700 1 -- 172.21.15.72:0/1509402296 learned_addr learned my addr 172.21.15.72:0/1509402296 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.625+0000 7ff73ea00700 1 -- 172.21.15.72:0/1509402296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730009550 con 0x7ff740107be0 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.626+0000 7ff73ea00700 1 --2- 172.21.15.72:0/1509402296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 0x7ff74019b0b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff740108910 tx=0x7ff730004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.626+0000 7ff737400700 1 -- 172.21.15.72:0/1509402296 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff730003ce0 con 0x7ff740107be0 2024-03-19T05:51:17.403 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.626+0000 7ff737400700 1 -- 172.21.15.72:0/1509402296 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff730020070 con 0x7ff740107be0 2024-03-19T05:51:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.626+0000 7ff737400700 1 -- 172.21.15.72:0/1509402296 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff730011630 con 0x7ff740107be0 2024-03-19T05:51:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.626+0000 7ff745a00700 1 -- 172.21.15.72:0/1509402296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74019b7f0 con 0x7ff740107be0 2024-03-19T05:51:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.626+0000 7ff745a00700 1 -- 172.21.15.72:0/1509402296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74019bc90 con 0x7ff740107be0 2024-03-19T05:51:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.626+0000 7ff737400700 1 -- 172.21.15.72:0/1509402296 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff730022030 con 0x7ff740107be0 2024-03-19T05:51:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.626+0000 7ff737400700 1 -- 172.21.15.72:0/1509402296 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff730025d40 con 0x7ff740107be0 2024-03-19T05:51:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.627+0000 7ff745a00700 1 -- 172.21.15.72:0/1509402296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff740194880 con 0x7ff740107be0 2024-03-19T05:51:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.630+0000 7ff737400700 1 -- 172.21.15.72:0/1509402296 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ff730025480 con 0x7ff740107be0 2024-03-19T05:51:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.706+0000 7ff745a00700 1 -- 172.21.15.72:0/1509402296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7ff740062380 con 0x7ff740107be0 2024-03-19T05:51:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.717+0000 7ff737400700 1 -- 172.21.15.72:0/1509402296 <== mon.0 v2:172.21.15.72:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff730011bd0 con 0x7ff740107be0 2024-03-19T05:51:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.717+0000 7ff737400700 1 -- 172.21.15.72:0/1509402296 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7ff730036020 con 0x7ff740107be0 2024-03-19T05:51:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.719+0000 7ff745a00700 1 -- 172.21.15.72:0/1509402296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 msgr2=0x7ff74019b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.719+0000 7ff745a00700 1 --2- 172.21.15.72:0/1509402296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 0x7ff74019b0b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff740108910 tx=0x7ff730004750 comp rx=0 tx=0).stop 2024-03-19T05:51:17.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.719+0000 7ff745a00700 1 -- 172.21.15.72:0/1509402296 shutdown_connections 2024-03-19T05:51:17.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.719+0000 7ff745a00700 1 --2- 172.21.15.72:0/1509402296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff740107be0 0x7ff74019b0b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:17.405 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.719+0000 7ff745a00700 1 -- 172.21.15.72:0/1509402296 >> 172.21.15.72:0/1509402296 conn(0x7ff74007b200 msgr2=0x7ff74018f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:17.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.719+0000 7ff745a00700 1 -- 172.21.15.72:0/1509402296 shutdown_connections 2024-03-19T05:51:17.406 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:16.719+0000 7ff745a00700 1 -- 172.21.15.72:0/1509402296 wait complete. 2024-03-19T05:51:17.406 INFO:teuthology.orchestra.run.smithi072.stdout:Generating new minimal ceph.conf... 2024-03-19T05:51:22.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:22 smithi072 ceph-mon[28340]: from='client.? 172.21.15.72:0/2552536053' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:51:22.706 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.960+0000 7f9783600700 1 Processor -- start 2024-03-19T05:51:22.706 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.961+0000 7f9783600700 1 -- start start 2024-03-19T05:51:22.706 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.961+0000 7f9783600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 0x7f977c107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:22.706 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.961+0000 7f9783600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c108530 con 0x7f977c107be0 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.962+0000 7f9780c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 0x7f977c107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.962+0000 7f9780c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 0x7f977c107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37782/0 (socket says 172.21.15.72:37782) 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.962+0000 7f9780c00700 1 -- 172.21.15.72:0/2927030632 learned_addr learned my addr 172.21.15.72:0/2927030632 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.962+0000 7f9780c00700 1 -- 172.21.15.72:0/2927030632 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c108670 con 0x7f977c107be0 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.963+0000 7f9780c00700 1 --2- 172.21.15.72:0/2927030632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 0x7f977c107ff0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f97700098a0 tx=0x7f9770009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684a999f522e782e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.963+0000 7f977b400700 1 -- 172.21.15.72:0/2927030632 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9770004180 con 0x7f977c107be0 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.963+0000 7f977b400700 1 -- 172.21.15.72:0/2927030632 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f97700042e0 con 0x7f977c107be0 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.963+0000 7f977b400700 1 -- 172.21.15.72:0/2927030632 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9770011a50 con 0x7f977c107be0 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.964+0000 7f9783600700 1 -- 172.21.15.72:0/2927030632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 msgr2=0x7f977c107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.964+0000 7f9783600700 1 --2- 172.21.15.72:0/2927030632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 0x7f977c107ff0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f97700098a0 tx=0x7f9770009bb0 comp rx=0 tx=0).stop 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.964+0000 7f9783600700 1 -- 172.21.15.72:0/2927030632 shutdown_connections 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.964+0000 7f9783600700 1 --2- 172.21.15.72:0/2927030632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 0x7f977c107ff0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:22.707 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.964+0000 7f9783600700 1 -- 172.21.15.72:0/2927030632 >> 172.21.15.72:0/2927030632 conn(0x7f977c07b200 msgr2=0x7f977c07b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.964+0000 7f9783600700 1 -- 172.21.15.72:0/2927030632 shutdown_connections 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.964+0000 7f9783600700 1 -- 172.21.15.72:0/2927030632 wait complete. 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.965+0000 7f9783600700 1 Processor -- start 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.965+0000 7f9783600700 1 -- start start 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.965+0000 7f9783600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 0x7f977c19b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.966+0000 7f9783600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c19beb0 con 0x7f977c107be0 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.966+0000 7f9780c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 0x7f977c19b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.966+0000 7f9780c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 0x7f977c19b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37794/0 (socket says 172.21.15.72:37794) 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.966+0000 7f9780c00700 1 -- 172.21.15.72:0/2552536053 learned_addr learned my addr 172.21.15.72:0/2552536053 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.966+0000 7f9780c00700 1 -- 172.21.15.72:0/2552536053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9770009550 con 0x7f977c107be0 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.966+0000 7f9780c00700 1 --2- 172.21.15.72:0/2552536053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 0x7f977c19b970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9770003de0 tx=0x7f9770011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.967+0000 7f9779600700 1 -- 172.21.15.72:0/2552536053 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9770003930 con 0x7f977c107be0 2024-03-19T05:51:22.708 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.967+0000 7f9779600700 1 -- 172.21.15.72:0/2552536053 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9770003a90 con 0x7f977c107be0 2024-03-19T05:51:22.709 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.967+0000 7f9779600700 1 -- 172.21.15.72:0/2552536053 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9770019730 con 0x7f977c107be0 2024-03-19T05:51:22.709 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.967+0000 7f9783600700 1 -- 172.21.15.72:0/2552536053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c19c0b0 con 0x7f977c107be0 2024-03-19T05:51:22.709 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.967+0000 7f9783600700 1 -- 172.21.15.72:0/2552536053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c19c550 con 0x7f977c107be0 2024-03-19T05:51:22.709 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.967+0000 7f9779600700 1 -- 172.21.15.72:0/2552536053 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9770019c60 con 0x7f977c107be0 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.967+0000 7f9779600700 1 -- 172.21.15.72:0/2552536053 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f977002c3a0 con 0x7f977c107be0 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.968+0000 7f9783600700 1 -- 172.21.15.72:0/2552536053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c062380 con 0x7f977c107be0 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:21.971+0000 7f9779600700 1 -- 172.21.15.72:0/2552536053 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f977001abc0 con 0x7f977c107be0 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:22.047+0000 7f9783600700 1 -- 172.21.15.72:0/2552536053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f977c109ad0 con 0x7f977c107be0 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:22.048+0000 7f9779600700 1 -- 172.21.15.72:0/2552536053 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f977001a430 con 0x7f977c107be0 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:22.049+0000 7f9783600700 1 -- 172.21.15.72:0/2552536053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 msgr2=0x7f977c19b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:22.049+0000 7f9783600700 1 --2- 172.21.15.72:0/2552536053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 0x7f977c19b970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9770003de0 tx=0x7f9770011ab0 comp rx=0 tx=0).stop 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:22.050+0000 7f9783600700 1 -- 172.21.15.72:0/2552536053 shutdown_connections 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:22.050+0000 7f9783600700 1 --2- 172.21.15.72:0/2552536053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c107be0 0x7f977c19b970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:22.050+0000 7f9783600700 1 -- 172.21.15.72:0/2552536053 >> 172.21.15.72:0/2552536053 conn(0x7f977c07b200 msgr2=0x7f977c106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:22.050+0000 7f9783600700 1 -- 172.21.15.72:0/2552536053 shutdown_connections 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:22.050+0000 7f9783600700 1 -- 172.21.15.72:0/2552536053 wait complete. 2024-03-19T05:51:22.710 INFO:teuthology.orchestra.run.smithi072.stdout:Restarting the monitor... 2024-03-19T05:51:23.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:22 smithi072 systemd[1]: Stopping Ceph mon.smithi072 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T05:51:23.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:23 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072[28336]: 2024-03-19T05:51:23.198+0000 7f9f8d400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi072 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T05:51:23.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:23 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072[28336]: 2024-03-19T05:51:23.198+0000 7f9f8d400700 -1 mon.smithi072@0(leader) e1 *** Got Signal Terminated *** 2024-03-19T05:51:23.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:23 smithi072 podman[28583]: 2024-03-19 05:51:23.311258584 +0000 UTC m=+0.257953396 container died 91cd9d593b1ef55362a27b1b30447fa66269971d530991ec2e5245d1bce4dfb3 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, ceph=True) 2024-03-19T05:51:24.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:23 smithi072 podman[28583]: 2024-03-19 05:51:23.72551385 +0000 UTC m=+0.672208708 container cleanup 91cd9d593b1ef55362a27b1b30447fa66269971d530991ec2e5245d1bce4dfb3 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, RELEASE=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T05:51:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:23 smithi072 bash[28583]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072 2024-03-19T05:51:28.525 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:28 smithi072 podman[28597]: 2024-03-19 05:51:28.292662082 +0000 UTC m=+4.961738914 container remove 91cd9d593b1ef55362a27b1b30447fa66269971d530991ec2e5245d1bce4dfb3 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, ceph=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-03-19T05:51:28.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:28 smithi072 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi072.service: Deactivated successfully. 2024-03-19T05:51:28.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:28 smithi072 systemd[1]: Stopped Ceph mon.smithi072 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T05:51:28.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:28 smithi072 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi072.service: Consumed 1.692s CPU time. 2024-03-19T05:51:28.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:28 smithi072 systemd[1]: Starting Ceph mon.smithi072 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T05:51:29.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:28 smithi072 podman[28687]: 2024-03-19 05:51:28.8298526 +0000 UTC m=+0.032475338 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-03-19T05:51:37.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:37 smithi072 podman[28687]: 2024-03-19 05:51:37.479811368 +0000 UTC m=+8.682434134 container create 77289e9e2b3345d69c4949dc03bc209e7fe291289093242c0729c127ab64b384 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, ceph=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, RELEASE=HEAD, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-19T05:51:40.884 INFO:teuthology.orchestra.run.smithi072.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-19T05:51:41.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 podman[28687]: 2024-03-19 05:51:40.793869614 +0000 UTC m=+11.996492423 container init 77289e9e2b3345d69c4949dc03bc209e7fe291289093242c0729c127ab64b384 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0) 2024-03-19T05:51:41.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 podman[28687]: 2024-03-19 05:51:40.80435886 +0000 UTC m=+12.006981633 container start 77289e9e2b3345d69c4949dc03bc209e7fe291289093242c0729c127ab64b384 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-19T05:51:41.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: set uid:gid to 167:167 (ceph:ceph) 2024-03-19T05:51:41.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: pidfile_write: ignore empty --pid-file 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: load: jerasure load: lrc 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: RocksDB version: 7.9.2 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Git sha 0 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Compile date 2023-08-03 19:21:13 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: DB SUMMARY 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: DB Session ID: O5BPN4BMTDRK7H07EFFL 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: CURRENT file: CURRENT 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: IDENTITY file: IDENTITY 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi072/store.db dir, Total Num: 1, files: 000008.sst 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi072/store.db: 000009.log size: 97893 ; 2024-03-19T05:51:41.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.error_if_exists: 0 2024-03-19T05:51:41.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.create_if_missing: 0 2024-03-19T05:51:41.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.paranoid_checks: 1 2024-03-19T05:51:41.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-19T05:51:41.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-19T05:51:41.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-19T05:51:41.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.env: 0x558e6ab9b720 2024-03-19T05:51:41.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.fs: PosixFileSystem 2024-03-19T05:51:41.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.info_log: 0x558e6c6db2c0 2024-03-19T05:51:41.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_file_opening_threads: 16 2024-03-19T05:51:41.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.statistics: (nil) 2024-03-19T05:51:41.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.use_fsync: 0 2024-03-19T05:51:41.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_log_file_size: 0 2024-03-19T05:51:41.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-19T05:51:41.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-19T05:51:41.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.keep_log_file_num: 1000 2024-03-19T05:51:41.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.recycle_log_file_num: 0 2024-03-19T05:51:41.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.allow_fallocate: 1 2024-03-19T05:51:41.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.allow_mmap_reads: 0 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.allow_mmap_writes: 0 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.use_direct_reads: 0 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.create_missing_column_families: 0 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.db_log_dir: 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.wal_dir: 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-19T05:51:41.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.advise_random_on_open: 1 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.db_write_buffer_size: 0 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.write_buffer_manager: 0x558e6b94c3c0 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.rate_limiter: (nil) 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.wal_recovery_mode: 2 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.enable_thread_tracking: 0 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.enable_pipelined_write: 0 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.unordered_write: 0 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-19T05:51:41.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.row_cache: None 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.wal_filter: None 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.allow_ingest_behind: 0 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.two_write_queues: 0 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.manual_wal_flush: 0 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.wal_compression: 0 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.atomic_flush: 0 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-19T05:51:41.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.log_readahead_size: 0 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.best_efforts_recovery: 0 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.allow_data_in_errors: 0 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.db_host_id: __hostname__ 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_background_jobs: 2 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_background_compactions: -1 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_subcompactions: 1 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-19T05:51:41.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_total_wal_size: 0 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_open_files: -1 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bytes_per_sync: 0 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_readahead_size: 0 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_background_flushes: -1 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Compression algorithms supported: 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-19T05:51:41.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: kZSTD supported: 0 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: kXpressCompression supported: 0 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: kLZ4HCCompression supported: 1 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: kZlibCompression supported: 1 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: kSnappyCompression supported: 1 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: kLZ4Compression supported: 1 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: kBZip2Compression supported: 0 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi072/store.db/MANIFEST-000010 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.merge_operator: 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_filter: None 2024-03-19T05:51:41.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_filter_factory: None 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.sst_partitioner_factory: None 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558e6c6db3c0) 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: cache_index_and_filter_blocks: 1 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: pin_top_level_index_and_filter: 1 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: index_type: 0 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: data_block_index_type: 0 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: index_shortening: 1 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: checksum: 4 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: no_block_cache: 0 2024-03-19T05:51:41.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache: 0x558e6b9ed350 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache_name: BinnedLRUCache 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache_options: 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: capacity : 536870912 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: num_shard_bits : 4 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: strict_capacity_limit : 0 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: high_pri_pool_ratio: 0.000 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache_compressed: (nil) 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: persistent_cache: (nil) 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_size: 4096 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_size_deviation: 10 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_restart_interval: 16 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: index_block_restart_interval: 1 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: metadata_block_size: 4096 2024-03-19T05:51:41.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: partition_filters: 0 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: use_delta_encoding: 1 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: filter_policy: bloomfilter 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: whole_key_filtering: 1 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: verify_compression: 0 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: read_amp_bytes_per_bit: 0 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: format_version: 5 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: enable_index_compression: 1 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_align: 0 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: max_auto_readahead_size: 262144 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: prepopulate_block_cache: 0 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: initial_auto_readahead_size: 8192 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: num_file_reads_for_auto_readahead: 2 2024-03-19T05:51:41.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.write_buffer_size: 33554432 2024-03-19T05:51:41.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_write_buffer_number: 2 2024-03-19T05:51:41.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compression: NoCompression 2024-03-19T05:51:41.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bottommost_compression: Disabled 2024-03-19T05:51:41.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.prefix_extractor: nullptr 2024-03-19T05:51:41.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-19T05:51:41.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.num_levels: 7 2024-03-19T05:51:41.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-19T05:51:41.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-19T05:51:41.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-19T05:51:41.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-19T05:51:41.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-19T05:51:41.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compression_opts.level: 32767 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compression_opts.strategy: 0 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compression_opts.enabled: false 2024-03-19T05:51:41.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.target_file_size_base: 67108864 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-19T05:51:41.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.arena_block_size: 1048576 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.disable_auto_compactions: 0 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-19T05:51:41.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.table_properties_collectors: 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.inplace_update_support: 0 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.bloom_locality: 0 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.max_successive_merges: 0 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.paranoid_file_checks: 0 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.force_consistency_checks: 1 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.report_bg_io_stats: 0 2024-03-19T05:51:41.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.ttl: 2592000 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.enable_blob_files: false 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.min_blob_size: 0 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.blob_file_size: 268435456 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.blob_file_starting_level: 0 2024-03-19T05:51:41.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi072/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 94566e89-3a9b-4078-bb1c-ca08d6700264 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710827500862399, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710827500864277, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93000, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 319, "table_properties": {"data_size": 91017, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13372, "raw_average_key_size": 49, "raw_value_size": 83718, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 270, "num_filter_entries": 270, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1710827500, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "94566e89-3a9b-4078-bb1c-ca08d6700264", "db_session_id": "O5BPN4BMTDRK7H07EFFL", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710827500864452, "job": 1, "event": "recovery_finished"} 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi072/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558e6ba8a000 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: DB pointer 0x558e6ba76000 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** DB Stats ** 2024-03-19T05:51:41.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** Compaction Stats [default] ** 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: L0 2/0 92.69 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 71.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Sum 2/0 92.69 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 71.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 71.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** Compaction Stats [default] ** 2024-03-19T05:51:41.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 71.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative compaction: 0.00 GB write, 12.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval compaction: 0.00 GB write, 12.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-19T05:51:41.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Block cache BinnedLRUCache@0x558e6b9ed350#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: starting mon.smithi072 rank 0 at public addrs [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] at bind addrs [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi072 fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: mon.smithi072@-1(???) e1 preinit fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: mon.smithi072@-1(???).mds e1 new map 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: mon.smithi072@-1(???).mds e1 print_map 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: e1 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: legacy client fscid: -1 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T05:51:41.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: No filesystems configured 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: mon.smithi072@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: mon.smithi072@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: mon.smithi072@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: mon.smithi072@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: mon.smithi072@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: expand_channel_meta expand map: {default=false} 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: expand_channel_meta from 'false' to 'false' 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: expand_channel_meta expanded map: {default=false} 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: expand_channel_meta expand map: {default=info} 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: expand_channel_meta from 'info' to 'info' 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: expand_channel_meta expanded map: {default=info} 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: expand_channel_meta expand map: {default=daemon} 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: expand_channel_meta from 'daemon' to 'daemon' 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: expand_channel_meta expanded map: {default=daemon} 2024-03-19T05:51:41.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: expand_channel_meta expand map: {default=debug} 2024-03-19T05:51:41.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: expand_channel_meta from 'debug' to 'debug' 2024-03-19T05:51:41.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: expand_channel_meta expanded map: {default=debug} 2024-03-19T05:51:41.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 bash[28687]: 77289e9e2b3345d69c4949dc03bc209e7fe291289093242c0729c127ab64b384 2024-03-19T05:51:41.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 systemd[1]: Started Ceph mon.smithi072 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T05:51:41.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: mon.smithi072 is new leader, mons smithi072 in quorum (ranks 0) 2024-03-19T05:51:41.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: monmap e1: 1 mons at {smithi072=[v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0]} removed_ranks: {} 2024-03-19T05:51:41.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: fsmap 2024-03-19T05:51:41.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: osdmap e1: 0 total, 0 up, 0 in 2024-03-19T05:51:41.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:40 smithi072 ceph-mon[28706]: mgrmap e1: no daemons active 2024-03-19T05:51:42.331 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.589+0000 7efc70a00700 1 Processor -- start 2024-03-19T05:51:42.331 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.589+0000 7efc70a00700 1 -- start start 2024-03-19T05:51:42.331 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.590+0000 7efc70a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 0x7efc6c1085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:42.331 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.590+0000 7efc70a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c108b00 con 0x7efc6c079c70 2024-03-19T05:51:42.331 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.591+0000 7efc69e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 0x7efc6c1085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:42.331 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.591+0000 7efc69e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 0x7efc6c1085c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47312/0 (socket says 172.21.15.72:47312) 2024-03-19T05:51:42.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.591+0000 7efc69e00700 1 -- 172.21.15.72:0/399744056 learned_addr learned my addr 172.21.15.72:0/399744056 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:42.332 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.591+0000 7efc69e00700 1 -- 172.21.15.72:0/399744056 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c108c40 con 0x7efc6c079c70 2024-03-19T05:51:42.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.592+0000 7efc69e00700 1 --2- 172.21.15.72:0/399744056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 0x7efc6c1085c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0098a0 tx=0x7efc5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c1a102d35e226c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:42.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.592+0000 7efc68a00700 1 -- 172.21.15.72:0/399744056 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc5c004180 con 0x7efc6c079c70 2024-03-19T05:51:42.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.592+0000 7efc68a00700 1 -- 172.21.15.72:0/399744056 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efc5c0042e0 con 0x7efc6c079c70 2024-03-19T05:51:42.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.592+0000 7efc68a00700 1 -- 172.21.15.72:0/399744056 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc5c011a50 con 0x7efc6c079c70 2024-03-19T05:51:42.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.593+0000 7efc70a00700 1 -- 172.21.15.72:0/399744056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 msgr2=0x7efc6c1085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:42.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.593+0000 7efc70a00700 1 --2- 172.21.15.72:0/399744056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 0x7efc6c1085c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0098a0 tx=0x7efc5c009bb0 comp rx=0 tx=0).stop 2024-03-19T05:51:42.333 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.593+0000 7efc70a00700 1 -- 172.21.15.72:0/399744056 shutdown_connections 2024-03-19T05:51:42.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.593+0000 7efc70a00700 1 --2- 172.21.15.72:0/399744056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 0x7efc6c1085c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:42.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.593+0000 7efc70a00700 1 -- 172.21.15.72:0/399744056 >> 172.21.15.72:0/399744056 conn(0x7efc6c0ffef0 msgr2=0x7efc6c102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:42.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.593+0000 7efc70a00700 1 -- 172.21.15.72:0/399744056 shutdown_connections 2024-03-19T05:51:42.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.593+0000 7efc70a00700 1 -- 172.21.15.72:0/399744056 wait complete. 2024-03-19T05:51:42.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.594+0000 7efc70a00700 1 Processor -- start 2024-03-19T05:51:42.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.594+0000 7efc70a00700 1 -- start start 2024-03-19T05:51:42.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.594+0000 7efc70a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 0x7efc6c19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:42.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.594+0000 7efc70a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c19bec0 con 0x7efc6c079c70 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.595+0000 7efc69e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 0x7efc6c19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.595+0000 7efc69e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 0x7efc6c19b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47314/0 (socket says 172.21.15.72:47314) 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.595+0000 7efc69e00700 1 -- 172.21.15.72:0/1446064345 learned_addr learned my addr 172.21.15.72:0/1446064345 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.595+0000 7efc69e00700 1 -- 172.21.15.72:0/1446064345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c009550 con 0x7efc6c079c70 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.595+0000 7efc69e00700 1 --2- 172.21.15.72:0/1446064345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 0x7efc6c19b980 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efc5c003de0 tx=0x7efc5c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.596+0000 7efc62a00700 1 -- 172.21.15.72:0/1446064345 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc5c003930 con 0x7efc6c079c70 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.596+0000 7efc62a00700 1 -- 172.21.15.72:0/1446064345 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efc5c003a90 con 0x7efc6c079c70 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.596+0000 7efc70a00700 1 -- 172.21.15.72:0/1446064345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c19c0c0 con 0x7efc6c079c70 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.596+0000 7efc62a00700 1 -- 172.21.15.72:0/1446064345 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc5c0196c0 con 0x7efc6c079c70 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.596+0000 7efc70a00700 1 -- 172.21.15.72:0/1446064345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c19c560 con 0x7efc6c079c70 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.596+0000 7efc62a00700 1 -- 172.21.15.72:0/1446064345 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efc5c019ca0 con 0x7efc6c079c70 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.596+0000 7efc62a00700 1 -- 172.21.15.72:0/1446064345 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efc5c02c3a0 con 0x7efc6c079c70 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.597+0000 7efc70a00700 1 -- 172.21.15.72:0/1446064345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c0623f0 con 0x7efc6c079c70 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.600+0000 7efc62a00700 1 -- 172.21.15.72:0/1446064345 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7efc6c0623f0 con 0x7efc6c079c70 2024-03-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.676+0000 7efc70a00700 1 -- 172.21.15.72:0/1446064345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7efc6c19f100 con 0x7efc6c079c70 2024-03-19T05:51:42.338 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.682+0000 7efc62a00700 1 -- 172.21.15.72:0/1446064345 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7efc5c01abc0 con 0x7efc6c079c70 2024-03-19T05:51:42.338 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.683+0000 7efc70a00700 1 -- 172.21.15.72:0/1446064345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 msgr2=0x7efc6c19b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:42.338 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.683+0000 7efc70a00700 1 --2- 172.21.15.72:0/1446064345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 0x7efc6c19b980 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efc5c003de0 tx=0x7efc5c011ab0 comp rx=0 tx=0).stop 2024-03-19T05:51:42.338 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.683+0000 7efc70a00700 1 -- 172.21.15.72:0/1446064345 shutdown_connections 2024-03-19T05:51:42.338 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.683+0000 7efc70a00700 1 --2- 172.21.15.72:0/1446064345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc6c079c70 0x7efc6c19b980 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:42.339 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.683+0000 7efc70a00700 1 -- 172.21.15.72:0/1446064345 >> 172.21.15.72:0/1446064345 conn(0x7efc6c0ffef0 msgr2=0x7efc6c1015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:42.339 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.684+0000 7efc70a00700 1 -- 172.21.15.72:0/1446064345 shutdown_connections 2024-03-19T05:51:42.339 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:41.684+0000 7efc70a00700 1 -- 172.21.15.72:0/1446064345 wait complete. 2024-03-19T05:51:42.339 INFO:teuthology.orchestra.run.smithi072.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-19T05:51:42.363 INFO:teuthology.orchestra.run.smithi072.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-19T05:51:42.364 INFO:teuthology.orchestra.run.smithi072.stdout:Creating mgr... 2024-03-19T05:51:42.365 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-19T05:51:42.366 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-19T05:51:42.366 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying port 0.0.0.0:8443 ... 2024-03-19T05:51:42.796 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mgr.smithi072.jydpjk 2024-03-19T05:51:42.796 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mgr.smithi072.jydpjk.service: Unit ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mgr.smithi072.jydpjk.service not loaded. 2024-03-19T05:51:43.041 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9ad98512-e5b4-11ee-95c9-87774f69a715.target.wants/ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mgr.smithi072.jydpjk.service → /etc/systemd/system/ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@.service. 2024-03-19T05:51:43.049 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:42 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1446064345' entity='client.admin' 2024-03-19T05:51:43.794 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-19T05:51:43.794 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout disabled 2024-03-19T05:51:43.810 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-19T05:51:43.810 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-19T05:51:43.811 INFO:teuthology.orchestra.run.smithi072.stdout:firewalld.service is not enabled 2024-03-19T05:51:43.811 INFO:teuthology.orchestra.run.smithi072.stdout:Not possible to enable service . firewalld.service is not available 2024-03-19T05:51:43.830 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-19T05:51:43.830 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout disabled 2024-03-19T05:51:43.847 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-19T05:51:43.847 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-19T05:51:43.847 INFO:teuthology.orchestra.run.smithi072.stdout:firewalld.service is not enabled 2024-03-19T05:51:43.848 INFO:teuthology.orchestra.run.smithi072.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-03-19T05:51:43.848 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mgr to start... 2024-03-19T05:51:43.848 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mgr... 2024-03-19T05:51:46.645 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:46.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-19T05:51:46.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsid": "9ad98512-e5b4-11ee-95c9-87774f69a715", 2024-03-19T05:51:46.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "health": { 2024-03-19T05:51:46.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-19T05:51:46.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-19T05:51:46.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-19T05:51:46.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:46.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-19T05:51:46.653 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 0 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "smithi072" 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:46.654 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-19T05:51:46.655 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "restful" 2024-03-19T05:51:46.656 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modified": "2024-03-19T05:51:14.734910+0000", 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.841+0000 7f6fa9400700 1 Processor -- start 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.841+0000 7f6fa9400700 1 -- start start 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.842+0000 7f6fa9400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 0x7f6fa407a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.842+0000 7f6fa9400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa407a7d0 con 0x7f6fa407bd90 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.843+0000 7f6fa2800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 0x7f6fa407a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:46.657 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.843+0000 7f6fa2800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 0x7f6fa407a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34068/0 (socket says 172.21.15.72:34068) 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.843+0000 7f6fa2800700 1 -- 172.21.15.72:0/2634033815 learned_addr learned my addr 172.21.15.72:0/2634033815 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.844+0000 7f6fa2800700 1 -- 172.21.15.72:0/2634033815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa407a910 con 0x7f6fa407bd90 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.844+0000 7f6fa2800700 1 --2- 172.21.15.72:0/2634033815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 0x7f6fa407a290 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6f940098a0 tx=0x7f6f94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c04ccf76e473a9e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.844+0000 7f6fa1400700 1 -- 172.21.15.72:0/2634033815 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f94004180 con 0x7f6fa407bd90 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.844+0000 7f6fa1400700 1 -- 172.21.15.72:0/2634033815 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6f940042e0 con 0x7f6fa407bd90 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.844+0000 7f6fa1400700 1 -- 172.21.15.72:0/2634033815 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f94011a50 con 0x7f6fa407bd90 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.845+0000 7f6fa9400700 1 -- 172.21.15.72:0/2634033815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 msgr2=0x7f6fa407a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.845+0000 7f6fa9400700 1 --2- 172.21.15.72:0/2634033815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 0x7f6fa407a290 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6f940098a0 tx=0x7f6f94009bb0 comp rx=0 tx=0).stop 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.845+0000 7f6fa9400700 1 -- 172.21.15.72:0/2634033815 shutdown_connections 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.845+0000 7f6fa9400700 1 --2- 172.21.15.72:0/2634033815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 0x7f6fa407a290 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.845+0000 7f6fa9400700 1 -- 172.21.15.72:0/2634033815 >> 172.21.15.72:0/2634033815 conn(0x7f6fa4101020 msgr2=0x7f6fa4103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.845+0000 7f6fa9400700 1 -- 172.21.15.72:0/2634033815 shutdown_connections 2024-03-19T05:51:46.658 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.845+0000 7f6fa9400700 1 -- 172.21.15.72:0/2634033815 wait complete. 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.846+0000 7f6fa9400700 1 Processor -- start 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.846+0000 7f6fa9400700 1 -- start start 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.847+0000 7f6fa9400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 0x7f6fa419b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.847+0000 7f6fa9400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa419be30 con 0x7f6fa407bd90 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.847+0000 7f6fa2800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 0x7f6fa419b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.847+0000 7f6fa2800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 0x7f6fa419b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34072/0 (socket says 172.21.15.72:34072) 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.847+0000 7f6fa2800700 1 -- 172.21.15.72:0/737684314 learned_addr learned my addr 172.21.15.72:0/737684314 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.847+0000 7f6fa2800700 1 -- 172.21.15.72:0/737684314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94009550 con 0x7f6fa407bd90 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.848+0000 7f6fa2800700 1 --2- 172.21.15.72:0/737684314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 0x7f6fa419b8f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6f94000c00 tx=0x7f6f94011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.848+0000 7f6f9b400700 1 -- 172.21.15.72:0/737684314 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f94003b90 con 0x7f6fa407bd90 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.848+0000 7f6f9b400700 1 -- 172.21.15.72:0/737684314 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6f940248b0 con 0x7f6fa407bd90 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.848+0000 7f6fa9400700 1 -- 172.21.15.72:0/737684314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa419c030 con 0x7f6fa407bd90 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.848+0000 7f6f9b400700 1 -- 172.21.15.72:0/737684314 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f9401a8e0 con 0x7f6fa407bd90 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.848+0000 7f6fa9400700 1 -- 172.21.15.72:0/737684314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa419c4d0 con 0x7f6fa407bd90 2024-03-19T05:51:46.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.849+0000 7f6f9b400700 1 -- 172.21.15.72:0/737684314 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6f9402d3f0 con 0x7f6fa407bd90 2024-03-19T05:51:46.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.849+0000 7f6f9b400700 1 -- 172.21.15.72:0/737684314 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6f94019400 con 0x7f6fa407bd90 2024-03-19T05:51:46.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.849+0000 7f6fa9400700 1 -- 172.21.15.72:0/737684314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa4062380 con 0x7f6fa407bd90 2024-03-19T05:51:46.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.852+0000 7f6f9b400700 1 -- 172.21.15.72:0/737684314 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f6f94024a20 con 0x7f6fa407bd90 2024-03-19T05:51:46.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.931+0000 7f6fa9400700 1 -- 172.21.15.72:0/737684314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6fa419f1b0 con 0x7f6fa407bd90 2024-03-19T05:51:46.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.932+0000 7f6f9b400700 1 -- 172.21.15.72:0/737684314 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f6f94035090 con 0x7f6fa407bd90 2024-03-19T05:51:46.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.933+0000 7f6fa9400700 1 -- 172.21.15.72:0/737684314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 msgr2=0x7f6fa419b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:46.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.933+0000 7f6fa9400700 1 --2- 172.21.15.72:0/737684314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 0x7f6fa419b8f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6f94000c00 tx=0x7f6f94011ab0 comp rx=0 tx=0).stop 2024-03-19T05:51:46.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.933+0000 7f6fa9400700 1 -- 172.21.15.72:0/737684314 shutdown_connections 2024-03-19T05:51:46.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.933+0000 7f6fa9400700 1 --2- 172.21.15.72:0/737684314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa407bd90 0x7f6fa419b8f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:46.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.933+0000 7f6fa9400700 1 -- 172.21.15.72:0/737684314 >> 172.21.15.72:0/737684314 conn(0x7f6fa4101020 msgr2=0x7f6fa4101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:46.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.933+0000 7f6fa9400700 1 -- 172.21.15.72:0/737684314 shutdown_connections 2024-03-19T05:51:46.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:45.934+0000 7f6fa9400700 1 -- 172.21.15.72:0/737684314 wait complete. 2024-03-19T05:51:46.661 INFO:teuthology.orchestra.run.smithi072.stdout:mgr not available, waiting (1/15)... 2024-03-19T05:51:47.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:46 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/737684314' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-19T05:51:49.698 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:49 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1365272002' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-19T05:51:50.437 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:50.437 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-19T05:51:50.437 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsid": "9ad98512-e5b4-11ee-95c9-87774f69a715", 2024-03-19T05:51:50.438 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "health": { 2024-03-19T05:51:50.438 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-19T05:51:50.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-19T05:51:50.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-19T05:51:50.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:50.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-19T05:51:50.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-19T05:51:50.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 0 2024-03-19T05:51:50.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-19T05:51:50.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-19T05:51:50.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "smithi072" 2024-03-19T05:51:50.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-19T05:51:50.440 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-03-19T05:51:50.440 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-19T05:51:50.440 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:50.440 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-03-19T05:51:50.441 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-19T05:51:50.441 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:50.441 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-19T05:51:50.441 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:50.441 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-19T05:51:50.441 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-19T05:51:50.441 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-19T05:51:50.441 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-19T05:51:50.441 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-19T05:51:50.442 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-19T05:51:50.442 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:50.442 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-19T05:51:50.442 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-19T05:51:50.442 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-19T05:51:50.442 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-19T05:51:50.443 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-19T05:51:50.443 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-19T05:51:50.443 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-19T05:51:50.443 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-19T05:51:50.443 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-19T05:51:50.443 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:50.443 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-19T05:51:50.443 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:50.444 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-19T05:51:50.444 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-19T05:51:50.444 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:50.444 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-19T05:51:50.444 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-19T05:51:50.444 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-19T05:51:50.444 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-19T05:51:50.444 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-19T05:51:50.444 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-19T05:51:50.444 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "restful" 2024-03-19T05:51:50.445 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-19T05:51:50.445 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-19T05:51:50.445 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:50.445 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-19T05:51:50.445 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:50.445 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modified": "2024-03-19T05:51:14.734910+0000", 2024-03-19T05:51:50.445 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-19T05:51:50.445 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:50.446 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-19T05:51:50.446 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-19T05:51:50.446 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.273+0000 7faf5ca00700 1 Processor -- start 2024-03-19T05:51:50.446 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.274+0000 7faf5ca00700 1 -- start start 2024-03-19T05:51:50.446 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.274+0000 7faf5ca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 0x7faf58079180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:50.446 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.274+0000 7faf5ca00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf580796c0 con 0x7faf5807ac80 2024-03-19T05:51:50.446 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.274+0000 7faf57400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 0x7faf58079180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:50.446 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.274+0000 7faf57400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 0x7faf58079180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34074/0 (socket says 172.21.15.72:34074) 2024-03-19T05:51:50.447 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.275+0000 7faf57400700 1 -- 172.21.15.72:0/2213696059 learned_addr learned my addr 172.21.15.72:0/2213696059 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:50.447 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.275+0000 7faf57400700 1 -- 172.21.15.72:0/2213696059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf58079800 con 0x7faf5807ac80 2024-03-19T05:51:50.447 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.275+0000 7faf57400700 1 --2- 172.21.15.72:0/2213696059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 0x7faf58079180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faf480098a0 tx=0x7faf48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ba9959c66a6b6a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:50.447 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.275+0000 7faf56000700 1 -- 172.21.15.72:0/2213696059 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf48004180 con 0x7faf5807ac80 2024-03-19T05:51:50.447 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.276+0000 7faf56000700 1 -- 172.21.15.72:0/2213696059 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7faf480042e0 con 0x7faf5807ac80 2024-03-19T05:51:50.447 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.276+0000 7faf56000700 1 -- 172.21.15.72:0/2213696059 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf48011a50 con 0x7faf5807ac80 2024-03-19T05:51:50.447 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.276+0000 7faf5ca00700 1 -- 172.21.15.72:0/2213696059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 msgr2=0x7faf58079180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.276+0000 7faf5ca00700 1 --2- 172.21.15.72:0/2213696059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 0x7faf58079180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faf480098a0 tx=0x7faf48009bb0 comp rx=0 tx=0).stop 2024-03-19T05:51:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.276+0000 7faf5ca00700 1 -- 172.21.15.72:0/2213696059 shutdown_connections 2024-03-19T05:51:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.276+0000 7faf5ca00700 1 --2- 172.21.15.72:0/2213696059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 0x7faf58079180 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.276+0000 7faf5ca00700 1 -- 172.21.15.72:0/2213696059 >> 172.21.15.72:0/2213696059 conn(0x7faf58100e50 msgr2=0x7faf58103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.277+0000 7faf5ca00700 1 -- 172.21.15.72:0/2213696059 shutdown_connections 2024-03-19T05:51:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.277+0000 7faf5ca00700 1 -- 172.21.15.72:0/2213696059 wait complete. 2024-03-19T05:51:50.448 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.278+0000 7faf5ca00700 1 Processor -- start 2024-03-19T05:51:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.278+0000 7faf5ca00700 1 -- start start 2024-03-19T05:51:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.278+0000 7faf5ca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 0x7faf5819b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.278+0000 7faf5ca00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5819bcd0 con 0x7faf5807ac80 2024-03-19T05:51:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.278+0000 7faf57400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 0x7faf5819b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.278+0000 7faf57400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 0x7faf5819b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34078/0 (socket says 172.21.15.72:34078) 2024-03-19T05:51:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.278+0000 7faf57400700 1 -- 172.21.15.72:0/1365272002 learned_addr learned my addr 172.21.15.72:0/1365272002 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:50.449 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.279+0000 7faf57400700 1 -- 172.21.15.72:0/1365272002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf48009550 con 0x7faf5807ac80 2024-03-19T05:51:50.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.279+0000 7faf57400700 1 --2- 172.21.15.72:0/1365272002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 0x7faf5819b790 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faf48003de0 tx=0x7faf48011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:50.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.279+0000 7faf4fe00700 1 -- 172.21.15.72:0/1365272002 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf48003930 con 0x7faf5807ac80 2024-03-19T05:51:50.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.279+0000 7faf4fe00700 1 -- 172.21.15.72:0/1365272002 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7faf48003a90 con 0x7faf5807ac80 2024-03-19T05:51:50.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.279+0000 7faf4fe00700 1 -- 172.21.15.72:0/1365272002 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf480196c0 con 0x7faf5807ac80 2024-03-19T05:51:50.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.279+0000 7faf5ca00700 1 -- 172.21.15.72:0/1365272002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5819bed0 con 0x7faf5807ac80 2024-03-19T05:51:50.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.279+0000 7faf5ca00700 1 -- 172.21.15.72:0/1365272002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5819c370 con 0x7faf5807ac80 2024-03-19T05:51:50.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.280+0000 7faf4fe00700 1 -- 172.21.15.72:0/1365272002 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faf48019930 con 0x7faf5807ac80 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.280+0000 7faf4fe00700 1 -- 172.21.15.72:0/1365272002 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7faf48024410 con 0x7faf5807ac80 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.280+0000 7faf4d600700 1 -- 172.21.15.72:0/1365272002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf58062380 con 0x7faf5807ac80 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.283+0000 7faf4fe00700 1 -- 172.21.15.72:0/1365272002 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7faf4801a9c0 con 0x7faf5807ac80 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.362+0000 7faf4d600700 1 -- 172.21.15.72:0/1365272002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7faf58061b60 con 0x7faf5807ac80 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.363+0000 7faf4fe00700 1 -- 172.21.15.72:0/1365272002 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7faf48019d80 con 0x7faf5807ac80 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.364+0000 7faf4d600700 1 -- 172.21.15.72:0/1365272002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 msgr2=0x7faf5819b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.364+0000 7faf4d600700 1 --2- 172.21.15.72:0/1365272002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 0x7faf5819b790 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faf48003de0 tx=0x7faf48011ab0 comp rx=0 tx=0).stop 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.364+0000 7faf4d600700 1 -- 172.21.15.72:0/1365272002 shutdown_connections 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.364+0000 7faf4d600700 1 --2- 172.21.15.72:0/1365272002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5807ac80 0x7faf5819b790 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.364+0000 7faf4d600700 1 -- 172.21.15.72:0/1365272002 >> 172.21.15.72:0/1365272002 conn(0x7faf58100e50 msgr2=0x7faf58102550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.364+0000 7faf4d600700 1 -- 172.21.15.72:0/1365272002 shutdown_connections 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:49.364+0000 7faf4d600700 1 -- 172.21.15.72:0/1365272002 wait complete. 2024-03-19T05:51:50.451 INFO:teuthology.orchestra.run.smithi072.stdout:mgr not available, waiting (2/15)... 2024-03-19T05:51:52.767 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:52 smithi072 ceph-mon[28706]: Activating manager daemon smithi072.jydpjk 2024-03-19T05:51:52.767 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:52 smithi072 ceph-mon[28706]: mgrmap e2: smithi072.jydpjk(active, starting, since 0.01019s) 2024-03-19T05:51:52.767 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:52 smithi072 ceph-mon[28706]: from='mgr.14100 172.21.15.72:0/2388930994' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-19T05:51:52.767 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:52 smithi072 ceph-mon[28706]: from='mgr.14100 172.21.15.72:0/2388930994' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-19T05:51:52.767 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:52 smithi072 ceph-mon[28706]: from='mgr.14100 172.21.15.72:0/2388930994' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-19T05:51:52.767 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:52 smithi072 ceph-mon[28706]: from='mgr.14100 172.21.15.72:0/2388930994' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T05:51:52.767 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:52 smithi072 ceph-mon[28706]: from='mgr.14100 172.21.15.72:0/2388930994' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi072.jydpjk", "id": "smithi072.jydpjk"}]: dispatch 2024-03-19T05:51:52.767 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:52 smithi072 ceph-mon[28706]: Manager daemon smithi072.jydpjk is now available 2024-03-19T05:51:52.767 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:52 smithi072 ceph-mon[28706]: from='mgr.14100 172.21.15.72:0/2388930994' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/mirror_snapshot_schedule"}]: dispatch 2024-03-19T05:51:52.767 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:52 smithi072 ceph-mon[28706]: from='mgr.14100 172.21.15.72:0/2388930994' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/trash_purge_schedule"}]: dispatch 2024-03-19T05:51:52.768 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:52 smithi072 ceph-mon[28706]: from='mgr.14100 172.21.15.72:0/2388930994' entity='mgr.smithi072.jydpjk' 2024-03-19T05:51:53.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:53 smithi072 ceph-mon[28706]: from='mgr.14100 172.21.15.72:0/2388930994' entity='mgr.smithi072.jydpjk' 2024-03-19T05:51:53.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:53 smithi072 ceph-mon[28706]: from='mgr.14100 172.21.15.72:0/2388930994' entity='mgr.smithi072.jydpjk' 2024-03-19T05:51:53.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:53 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/921721377' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-19T05:51:53.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:53 smithi072 ceph-mon[28706]: mgrmap e3: smithi072.jydpjk(active, since 1.0222s) 2024-03-19T05:51:53.963 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:53.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsid": "9ad98512-e5b4-11ee-95c9-87774f69a715", 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "health": { 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 0 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "smithi072" 2024-03-19T05:51:53.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-19T05:51:53.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-03-19T05:51:53.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-19T05:51:53.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:53.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-03-19T05:51:53.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-19T05:51:53.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:53.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-19T05:51:53.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:53.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-19T05:51:53.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-19T05:51:53.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-19T05:51:53.975 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-19T05:51:53.975 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:53.976 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "restful" 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-19T05:51:53.977 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modified": "2024-03-19T05:51:14.734910+0000", 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.111+0000 7ff84cc00700 1 Processor -- start 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.112+0000 7ff84cc00700 1 -- start start 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.112+0000 7ff84cc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 0x7ff84807a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.112+0000 7ff84cc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84807a850 con 0x7ff84807be10 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.112+0000 7ff845e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 0x7ff84807a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.112+0000 7ff845e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 0x7ff84807a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34130/0 (socket says 172.21.15.72:34130) 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.112+0000 7ff845e00700 1 -- 172.21.15.72:0/2005799855 learned_addr learned my addr 172.21.15.72:0/2005799855 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.113+0000 7ff845e00700 1 -- 172.21.15.72:0/2005799855 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84807a990 con 0x7ff84807be10 2024-03-19T05:51:53.978 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.113+0000 7ff845e00700 1 --2- 172.21.15.72:0/2005799855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 0x7ff84807a310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff838009870 tx=0x7ff838009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25371fa8f7234b53 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.113+0000 7ff844a00700 1 -- 172.21.15.72:0/2005799855 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff838005c30 con 0x7ff84807be10 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.113+0000 7ff844a00700 1 -- 172.21.15.72:0/2005799855 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff838005d90 con 0x7ff84807be10 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.114+0000 7ff844a00700 1 -- 172.21.15.72:0/2005799855 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff838006030 con 0x7ff84807be10 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.114+0000 7ff84cc00700 1 -- 172.21.15.72:0/2005799855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 msgr2=0x7ff84807a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.114+0000 7ff84cc00700 1 --2- 172.21.15.72:0/2005799855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 0x7ff84807a310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff838009870 tx=0x7ff838009b80 comp rx=0 tx=0).stop 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.114+0000 7ff84cc00700 1 -- 172.21.15.72:0/2005799855 shutdown_connections 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.114+0000 7ff84cc00700 1 --2- 172.21.15.72:0/2005799855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 0x7ff84807a310 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.114+0000 7ff84cc00700 1 -- 172.21.15.72:0/2005799855 >> 172.21.15.72:0/2005799855 conn(0x7ff848101020 msgr2=0x7ff848103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.114+0000 7ff84cc00700 1 -- 172.21.15.72:0/2005799855 shutdown_connections 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.114+0000 7ff84cc00700 1 -- 172.21.15.72:0/2005799855 wait complete. 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.115+0000 7ff84cc00700 1 Processor -- start 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.115+0000 7ff84cc00700 1 -- start start 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.116+0000 7ff84cc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 0x7ff84819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:53.979 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.116+0000 7ff84cc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8481a0270 con 0x7ff84807be10 2024-03-19T05:51:53.980 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.116+0000 7ff845e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 0x7ff84819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:53.980 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.116+0000 7ff845e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 0x7ff84819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34146/0 (socket says 172.21.15.72:34146) 2024-03-19T05:51:53.980 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.116+0000 7ff845e00700 1 -- 172.21.15.72:0/921721377 learned_addr learned my addr 172.21.15.72:0/921721377 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:53.980 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.116+0000 7ff845e00700 1 -- 172.21.15.72:0/921721377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff838009500 con 0x7ff84807be10 2024-03-19T05:51:53.980 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.117+0000 7ff845e00700 1 --2- 172.21.15.72:0/921721377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 0x7ff84819fd30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff8380038f0 tx=0x7ff8380061e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:53.980 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.117+0000 7ff83ea00700 1 -- 172.21.15.72:0/921721377 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff838004310 con 0x7ff84807be10 2024-03-19T05:51:53.980 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.117+0000 7ff83ea00700 1 -- 172.21.15.72:0/921721377 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff838004470 con 0x7ff84807be10 2024-03-19T05:51:53.980 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.117+0000 7ff84cc00700 1 -- 172.21.15.72:0/921721377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8481a0470 con 0x7ff84807be10 2024-03-19T05:51:53.982 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.117+0000 7ff83ea00700 1 -- 172.21.15.72:0/921721377 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff838011c90 con 0x7ff84807be10 2024-03-19T05:51:53.982 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.117+0000 7ff84cc00700 1 -- 172.21.15.72:0/921721377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8481a0910 con 0x7ff84807be10 2024-03-19T05:51:53.982 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.118+0000 7ff84cc00700 1 -- 172.21.15.72:0/921721377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff848199510 con 0x7ff84807be10 2024-03-19T05:51:53.982 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.118+0000 7ff83ea00700 1 -- 172.21.15.72:0/921721377 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 2) v1 ==== 44840+0+0 (secure 0 0 0) 0x7ff838018070 con 0x7ff84807be10 2024-03-19T05:51:53.982 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.119+0000 7ff83ea00700 1 -- 172.21.15.72:0/921721377 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff83804b4c0 con 0x7ff84807be10 2024-03-19T05:51:53.982 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.121+0000 7ff83ea00700 1 -- 172.21.15.72:0/921721377 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ff8380188f0 con 0x7ff84807be10 2024-03-19T05:51:53.982 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.201+0000 7ff84cc00700 1 -- 172.21.15.72:0/921721377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff84802cc30 con 0x7ff84807be10 2024-03-19T05:51:53.982 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.201+0000 7ff83ea00700 1 -- 172.21.15.72:0/921721377 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7ff838018320 con 0x7ff84807be10 2024-03-19T05:51:53.982 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.203+0000 7ff84cc00700 1 -- 172.21.15.72:0/921721377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 msgr2=0x7ff84819fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:53.982 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.203+0000 7ff84cc00700 1 --2- 172.21.15.72:0/921721377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 0x7ff84819fd30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff8380038f0 tx=0x7ff8380061e0 comp rx=0 tx=0).stop 2024-03-19T05:51:53.982 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.203+0000 7ff84cc00700 1 -- 172.21.15.72:0/921721377 shutdown_connections 2024-03-19T05:51:53.983 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.203+0000 7ff84cc00700 1 --2- 172.21.15.72:0/921721377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84807be10 0x7ff84819fd30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:53.983 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.203+0000 7ff84cc00700 1 -- 172.21.15.72:0/921721377 >> 172.21.15.72:0/921721377 conn(0x7ff848101020 msgr2=0x7ff848103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:53.983 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.203+0000 7ff84cc00700 1 -- 172.21.15.72:0/921721377 shutdown_connections 2024-03-19T05:51:53.983 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:53.203+0000 7ff84cc00700 1 -- 172.21.15.72:0/921721377 wait complete. 2024-03-19T05:51:53.983 INFO:teuthology.orchestra.run.smithi072.stdout:mgr not available, waiting (3/15)... 2024-03-19T05:51:55.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:55 smithi072 ceph-mon[28706]: mgrmap e4: smithi072.jydpjk(active, since 2s) 2024-03-19T05:51:57.176 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:56 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3960758898' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-19T05:51:57.478 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:57.478 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-19T05:51:57.478 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsid": "9ad98512-e5b4-11ee-95c9-87774f69a715", 2024-03-19T05:51:57.478 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "health": { 2024-03-19T05:51:57.478 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-19T05:51:57.478 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-19T05:51:57.478 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-19T05:51:57.478 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:57.478 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-19T05:51:57.478 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 0 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "smithi072" 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:57.479 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-19T05:51:57.480 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-19T05:51:57.480 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-19T05:51:57.489 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-19T05:51:57.489 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-19T05:51:57.489 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-19T05:51:57.489 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:57.489 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-19T05:51:57.489 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-19T05:51:57.489 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-19T05:51:57.489 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-19T05:51:57.490 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "restful" 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ], 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "modified": "2024-03-19T05:51:14.734910+0000", 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout }, 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-19T05:51:57.491 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.562+0000 7f648ee00700 1 Processor -- start 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.562+0000 7f648ee00700 1 -- start start 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.563+0000 7f648ee00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 0x7f6488079180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.563+0000 7f648ee00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64880796c0 con 0x7f648807ac80 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.563+0000 7f6487e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 0x7f6488079180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.563+0000 7f6487e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 0x7f6488079180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60536/0 (socket says 172.21.15.72:60536) 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.563+0000 7f6487e00700 1 -- 172.21.15.72:0/1630713108 learned_addr learned my addr 172.21.15.72:0/1630713108 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.563+0000 7f6487e00700 1 -- 172.21.15.72:0/1630713108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6488079800 con 0x7f648807ac80 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.564+0000 7f6487e00700 1 --2- 172.21.15.72:0/1630713108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 0x7f6488079180 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f64780098a0 tx=0x7f6478009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dce9eee9915286 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.564+0000 7f6486a00700 1 -- 172.21.15.72:0/1630713108 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6478004180 con 0x7f648807ac80 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.564+0000 7f6486a00700 1 -- 172.21.15.72:0/1630713108 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f64780042e0 con 0x7f648807ac80 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.564+0000 7f6486a00700 1 -- 172.21.15.72:0/1630713108 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6478011a50 con 0x7f648807ac80 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.565+0000 7f648ee00700 1 -- 172.21.15.72:0/1630713108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 msgr2=0x7f6488079180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.565+0000 7f648ee00700 1 --2- 172.21.15.72:0/1630713108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 0x7f6488079180 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f64780098a0 tx=0x7f6478009bb0 comp rx=0 tx=0).stop 2024-03-19T05:51:57.492 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.565+0000 7f648ee00700 1 -- 172.21.15.72:0/1630713108 shutdown_connections 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.565+0000 7f648ee00700 1 --2- 172.21.15.72:0/1630713108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 0x7f6488079180 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.565+0000 7f648ee00700 1 -- 172.21.15.72:0/1630713108 >> 172.21.15.72:0/1630713108 conn(0x7f6488100fd0 msgr2=0x7f6488103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.565+0000 7f648ee00700 1 -- 172.21.15.72:0/1630713108 shutdown_connections 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.565+0000 7f648ee00700 1 -- 172.21.15.72:0/1630713108 wait complete. 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.566+0000 7f648ee00700 1 Processor -- start 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.566+0000 7f648ee00700 1 -- start start 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.566+0000 7f648ee00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 0x7f648819b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.566+0000 7f648ee00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648819be80 con 0x7f648807ac80 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.567+0000 7f6487e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 0x7f648819b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.567+0000 7f6487e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 0x7f648819b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60548/0 (socket says 172.21.15.72:60548) 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.567+0000 7f6487e00700 1 -- 172.21.15.72:0/3960758898 learned_addr learned my addr 172.21.15.72:0/3960758898 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.567+0000 7f6487e00700 1 -- 172.21.15.72:0/3960758898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6478009550 con 0x7f648807ac80 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.567+0000 7f6487e00700 1 --2- 172.21.15.72:0/3960758898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 0x7f648819b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6478003de0 tx=0x7f6478011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.568+0000 7f6484c00700 1 -- 172.21.15.72:0/3960758898 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6478003930 con 0x7f648807ac80 2024-03-19T05:51:57.493 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.568+0000 7f6484c00700 1 -- 172.21.15.72:0/3960758898 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6478003a90 con 0x7f648807ac80 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.568+0000 7f648ee00700 1 -- 172.21.15.72:0/3960758898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648819c080 con 0x7f648807ac80 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.568+0000 7f6484c00700 1 -- 172.21.15.72:0/3960758898 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64780196c0 con 0x7f648807ac80 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.568+0000 7f648ee00700 1 -- 172.21.15.72:0/3960758898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648819c520 con 0x7f648807ac80 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.569+0000 7f6484c00700 1 -- 172.21.15.72:0/3960758898 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f647801abc0 con 0x7f648807ac80 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.569+0000 7f648ee00700 1 -- 172.21.15.72:0/3960758898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648810bc70 con 0x7f648807ac80 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.569+0000 7f6484c00700 1 --2- 172.21.15.72:0/3960758898 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7f646c0383f0 0x7f646c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.569+0000 7f6484c00700 1 -- 172.21.15.72:0/3960758898 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f647804bfe0 con 0x7f648807ac80 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.570+0000 7f6487400700 1 --2- 172.21.15.72:0/3960758898 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7f646c0383f0 0x7f646c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.570+0000 7f6487400700 1 --2- 172.21.15.72:0/3960758898 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7f646c0383f0 0x7f646c03a8a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6474006fd0 tx=0x7f6474006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.576+0000 7f6484c00700 1 -- 172.21.15.72:0/3960758898 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6478010790 con 0x7f648807ac80 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.859+0000 7f648ee00700 1 -- 172.21.15.72:0/3960758898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f648810be90 con 0x7f648807ac80 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.859+0000 7f6484c00700 1 -- 172.21.15.72:0/3960758898 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f6478018350 con 0x7f648807ac80 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.862+0000 7f648ee00700 1 -- 172.21.15.72:0/3960758898 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7f646c0383f0 msgr2=0x7f646c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.862+0000 7f648ee00700 1 --2- 172.21.15.72:0/3960758898 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7f646c0383f0 0x7f646c03a8a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6474006fd0 tx=0x7f6474006e40 comp rx=0 tx=0).stop 2024-03-19T05:51:57.495 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.862+0000 7f648ee00700 1 -- 172.21.15.72:0/3960758898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 msgr2=0x7f648819b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:57.495 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.862+0000 7f648ee00700 1 --2- 172.21.15.72:0/3960758898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 0x7f648819b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6478003de0 tx=0x7f6478011ab0 comp rx=0 tx=0).stop 2024-03-19T05:51:57.495 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.862+0000 7f648ee00700 1 -- 172.21.15.72:0/3960758898 shutdown_connections 2024-03-19T05:51:57.495 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.862+0000 7f648ee00700 1 --2- 172.21.15.72:0/3960758898 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7f646c0383f0 0x7f646c03a8a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:57.495 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.862+0000 7f648ee00700 1 --2- 172.21.15.72:0/3960758898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f648807ac80 0x7f648819b940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:57.495 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.862+0000 7f648ee00700 1 -- 172.21.15.72:0/3960758898 >> 172.21.15.72:0/3960758898 conn(0x7f6488100fd0 msgr2=0x7f64881026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:57.495 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.862+0000 7f648ee00700 1 -- 172.21.15.72:0/3960758898 shutdown_connections 2024-03-19T05:51:57.495 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:56.862+0000 7f648ee00700 1 -- 172.21.15.72:0/3960758898 wait complete. 2024-03-19T05:51:57.495 INFO:teuthology.orchestra.run.smithi072.stdout:mgr is available 2024-03-19T05:51:58.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:58 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/181053626' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-19T05:51:58.958 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:58.958 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [global] 2024-03-19T05:51:58.959 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout fsid = 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:51:58.959 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-19T05:51:58.959 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-19T05:51:58.959 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-19T05:51:58.959 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-19T05:51:58.959 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:58.960 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-19T05:51:58.960 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-19T05:51:58.961 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 2024-03-19T05:51:58.961 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout [osd] 2024-03-19T05:51:58.961 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-19T05:51:58.961 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-19T05:51:58.961 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-19T05:51:58.961 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-19T05:51:58.961 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-19T05:51:58.962 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.038+0000 7ff813a00700 1 Processor -- start 2024-03-19T05:51:58.962 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.038+0000 7ff813a00700 1 -- start start 2024-03-19T05:51:58.963 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.039+0000 7ff813a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 0x7ff80c107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:58.963 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.039+0000 7ff813a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c108530 con 0x7ff80c107be0 2024-03-19T05:51:58.963 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.039+0000 7ff811000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 0x7ff80c107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:58.963 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.039+0000 7ff811000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 0x7ff80c107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60562/0 (socket says 172.21.15.72:60562) 2024-03-19T05:51:58.963 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.039+0000 7ff811000700 1 -- 172.21.15.72:0/3677705881 learned_addr learned my addr 172.21.15.72:0/3677705881 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:58.963 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.040+0000 7ff811000700 1 -- 172.21.15.72:0/3677705881 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c108670 con 0x7ff80c107be0 2024-03-19T05:51:58.964 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.040+0000 7ff811000700 1 --2- 172.21.15.72:0/3677705881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 0x7ff80c107ff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff8000098a0 tx=0x7ff800009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f923ddaf5ed2b4ec server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:58.964 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.040+0000 7ff80b400700 1 -- 172.21.15.72:0/3677705881 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff800004180 con 0x7ff80c107be0 2024-03-19T05:51:58.964 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.040+0000 7ff80b400700 1 -- 172.21.15.72:0/3677705881 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff8000042e0 con 0x7ff80c107be0 2024-03-19T05:51:58.964 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.040+0000 7ff80b400700 1 -- 172.21.15.72:0/3677705881 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff800011a50 con 0x7ff80c107be0 2024-03-19T05:51:58.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.041+0000 7ff813a00700 1 -- 172.21.15.72:0/3677705881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 msgr2=0x7ff80c107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:58.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.041+0000 7ff813a00700 1 --2- 172.21.15.72:0/3677705881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 0x7ff80c107ff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff8000098a0 tx=0x7ff800009bb0 comp rx=0 tx=0).stop 2024-03-19T05:51:58.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.041+0000 7ff813a00700 1 -- 172.21.15.72:0/3677705881 shutdown_connections 2024-03-19T05:51:58.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.041+0000 7ff813a00700 1 --2- 172.21.15.72:0/3677705881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 0x7ff80c107ff0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:58.965 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.041+0000 7ff813a00700 1 -- 172.21.15.72:0/3677705881 >> 172.21.15.72:0/3677705881 conn(0x7ff80c07b200 msgr2=0x7ff80c07b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:58.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.041+0000 7ff813a00700 1 -- 172.21.15.72:0/3677705881 shutdown_connections 2024-03-19T05:51:58.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.042+0000 7ff813a00700 1 -- 172.21.15.72:0/3677705881 wait complete. 2024-03-19T05:51:58.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.043+0000 7ff813a00700 1 Processor -- start 2024-03-19T05:51:58.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.043+0000 7ff813a00700 1 -- start start 2024-03-19T05:51:58.966 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.043+0000 7ff813a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 0x7ff80c19b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:58.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.043+0000 7ff813a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c19beb0 con 0x7ff80c107be0 2024-03-19T05:51:58.967 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.043+0000 7ff811000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 0x7ff80c19b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:58.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.043+0000 7ff811000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 0x7ff80c19b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60566/0 (socket says 172.21.15.72:60566) 2024-03-19T05:51:58.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.043+0000 7ff811000700 1 -- 172.21.15.72:0/181053626 learned_addr learned my addr 172.21.15.72:0/181053626 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:51:58.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.044+0000 7ff811000700 1 -- 172.21.15.72:0/181053626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800009550 con 0x7ff80c107be0 2024-03-19T05:51:58.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.044+0000 7ff811000700 1 --2- 172.21.15.72:0/181053626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 0x7ff80c19b970 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff800003de0 tx=0x7ff800011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:58.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.044+0000 7ff809600700 1 -- 172.21.15.72:0/181053626 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff800003930 con 0x7ff80c107be0 2024-03-19T05:51:58.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.044+0000 7ff809600700 1 -- 172.21.15.72:0/181053626 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff800003a90 con 0x7ff80c107be0 2024-03-19T05:51:58.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.044+0000 7ff813a00700 1 -- 172.21.15.72:0/181053626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80c19c0b0 con 0x7ff80c107be0 2024-03-19T05:51:58.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.044+0000 7ff809600700 1 -- 172.21.15.72:0/181053626 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff800019730 con 0x7ff80c107be0 2024-03-19T05:51:58.968 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.044+0000 7ff813a00700 1 -- 172.21.15.72:0/181053626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c19c550 con 0x7ff80c107be0 2024-03-19T05:51:58.969 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.045+0000 7ff809600700 1 -- 172.21.15.72:0/181053626 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7ff80001a430 con 0x7ff80c107be0 2024-03-19T05:51:58.969 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.046+0000 7ff813a00700 1 -- 172.21.15.72:0/181053626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80c062380 con 0x7ff80c107be0 2024-03-19T05:51:58.970 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.046+0000 7ff809600700 1 --2- 172.21.15.72:0/181053626 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7ff7f40383f0 0x7ff7f403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:51:58.970 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.046+0000 7ff809600700 1 -- 172.21.15.72:0/181053626 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff80004c090 con 0x7ff80c107be0 2024-03-19T05:51:58.970 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.046+0000 7ff80be00700 1 --2- 172.21.15.72:0/181053626 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7ff7f40383f0 0x7ff7f403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:51:58.970 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.047+0000 7ff80be00700 1 --2- 172.21.15.72:0/181053626 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7ff7f40383f0 0x7ff7f403a8a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8006fd0 tx=0x7ff7f8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:51:58.970 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.051+0000 7ff809600700 1 -- 172.21.15.72:0/181053626 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff80001a6e0 con 0x7ff80c107be0 2024-03-19T05:51:58.970 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.261+0000 7ff813a00700 1 -- 172.21.15.72:0/181053626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7ff80c19f450 con 0x7ff80c107be0 2024-03-19T05:51:58.970 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.264+0000 7ff809600700 1 -- 172.21.15.72:0/181053626 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7ff800010380 con 0x7ff80c107be0 2024-03-19T05:51:58.971 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.267+0000 7ff813a00700 1 -- 172.21.15.72:0/181053626 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7ff7f40383f0 msgr2=0x7ff7f403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:58.971 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.267+0000 7ff813a00700 1 --2- 172.21.15.72:0/181053626 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7ff7f40383f0 0x7ff7f403a8a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8006fd0 tx=0x7ff7f8006e40 comp rx=0 tx=0).stop 2024-03-19T05:51:58.971 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.267+0000 7ff813a00700 1 -- 172.21.15.72:0/181053626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 msgr2=0x7ff80c19b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:51:58.971 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.267+0000 7ff813a00700 1 --2- 172.21.15.72:0/181053626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 0x7ff80c19b970 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff800003de0 tx=0x7ff800011ab0 comp rx=0 tx=0).stop 2024-03-19T05:51:58.971 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.267+0000 7ff813a00700 1 -- 172.21.15.72:0/181053626 shutdown_connections 2024-03-19T05:51:58.971 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.267+0000 7ff813a00700 1 --2- 172.21.15.72:0/181053626 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7ff7f40383f0 0x7ff7f403a8a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:58.972 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.267+0000 7ff813a00700 1 --2- 172.21.15.72:0/181053626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff80c107be0 0x7ff80c19b970 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:51:58.972 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.267+0000 7ff813a00700 1 -- 172.21.15.72:0/181053626 >> 172.21.15.72:0/181053626 conn(0x7ff80c07b200 msgr2=0x7ff80c106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:51:58.972 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.268+0000 7ff813a00700 1 -- 172.21.15.72:0/181053626 shutdown_connections 2024-03-19T05:51:58.972 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:58.268+0000 7ff813a00700 1 -- 172.21.15.72:0/181053626 wait complete. 2024-03-19T05:51:58.973 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling cephadm module... 2024-03-19T05:52:00.278 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:51:59 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2500298768' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-19T05:52:00.634 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.573+0000 7f27acc00700 1 Processor -- start 2024-03-19T05:52:00.634 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.574+0000 7f27acc00700 1 -- start start 2024-03-19T05:52:00.634 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.574+0000 7f27acc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 0x7f27a8107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:00.634 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.574+0000 7f27acc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a8108530 con 0x7f27a8107be0 2024-03-19T05:52:00.634 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.574+0000 7f27a5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 0x7f27a8107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:00.634 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.575+0000 7f27a5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 0x7f27a8107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60576/0 (socket says 172.21.15.72:60576) 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.575+0000 7f27a5e00700 1 -- 172.21.15.72:0/1382996912 learned_addr learned my addr 172.21.15.72:0/1382996912 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.575+0000 7f27a5e00700 1 -- 172.21.15.72:0/1382996912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a8108670 con 0x7f27a8107be0 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.575+0000 7f27a5e00700 1 --2- 172.21.15.72:0/1382996912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 0x7f27a8107ff0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f27980098a0 tx=0x7f2798009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8e519f6ae9ed2d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.576+0000 7f27a4a00700 1 -- 172.21.15.72:0/1382996912 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2798004180 con 0x7f27a8107be0 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.576+0000 7f27a4a00700 1 -- 172.21.15.72:0/1382996912 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f27980042e0 con 0x7f27a8107be0 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.576+0000 7f27a4a00700 1 -- 172.21.15.72:0/1382996912 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2798011a50 con 0x7f27a8107be0 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.576+0000 7f27acc00700 1 -- 172.21.15.72:0/1382996912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 msgr2=0x7f27a8107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.576+0000 7f27acc00700 1 --2- 172.21.15.72:0/1382996912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 0x7f27a8107ff0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f27980098a0 tx=0x7f2798009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.577+0000 7f27acc00700 1 -- 172.21.15.72:0/1382996912 shutdown_connections 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.577+0000 7f27acc00700 1 --2- 172.21.15.72:0/1382996912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 0x7f27a8107ff0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.577+0000 7f27acc00700 1 -- 172.21.15.72:0/1382996912 >> 172.21.15.72:0/1382996912 conn(0x7f27a807b200 msgr2=0x7f27a807b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.577+0000 7f27acc00700 1 -- 172.21.15.72:0/1382996912 shutdown_connections 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.577+0000 7f27acc00700 1 -- 172.21.15.72:0/1382996912 wait complete. 2024-03-19T05:52:00.635 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.578+0000 7f27acc00700 1 Processor -- start 2024-03-19T05:52:00.636 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.578+0000 7f27acc00700 1 -- start start 2024-03-19T05:52:00.636 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.578+0000 7f27acc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 0x7f27a819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:00.636 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.578+0000 7f27acc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a819bed0 con 0x7f27a8107be0 2024-03-19T05:52:00.636 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.579+0000 7f27a5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 0x7f27a819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:00.636 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.579+0000 7f27a5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 0x7f27a819b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60584/0 (socket says 172.21.15.72:60584) 2024-03-19T05:52:00.636 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.579+0000 7f27a5e00700 1 -- 172.21.15.72:0/2500298768 learned_addr learned my addr 172.21.15.72:0/2500298768 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:00.636 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.579+0000 7f27a5e00700 1 -- 172.21.15.72:0/2500298768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2798009550 con 0x7f27a8107be0 2024-03-19T05:52:00.636 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.579+0000 7f27a5e00700 1 --2- 172.21.15.72:0/2500298768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 0x7f27a819b990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2798003de0 tx=0x7f2798011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:00.636 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.579+0000 7f279ea00700 1 -- 172.21.15.72:0/2500298768 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2798003930 con 0x7f27a8107be0 2024-03-19T05:52:00.636 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.580+0000 7f279ea00700 1 -- 172.21.15.72:0/2500298768 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2798003a90 con 0x7f27a8107be0 2024-03-19T05:52:00.636 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.580+0000 7f27acc00700 1 -- 172.21.15.72:0/2500298768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a819c0d0 con 0x7f27a8107be0 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.580+0000 7f279ea00700 1 -- 172.21.15.72:0/2500298768 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2798019730 con 0x7f27a8107be0 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.580+0000 7f27acc00700 1 -- 172.21.15.72:0/2500298768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a819c570 con 0x7f27a8107be0 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.581+0000 7f279ea00700 1 -- 172.21.15.72:0/2500298768 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f279801a430 con 0x7f27a8107be0 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.581+0000 7f27acc00700 1 -- 172.21.15.72:0/2500298768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a8062380 con 0x7f27a8107be0 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.581+0000 7f279ea00700 1 --2- 172.21.15.72:0/2500298768 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7f278c0383f0 0x7f278c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.581+0000 7f279ea00700 1 -- 172.21.15.72:0/2500298768 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f279804c080 con 0x7f27a8107be0 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.582+0000 7f27a5400700 1 --2- 172.21.15.72:0/2500298768 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7f278c0383f0 0x7f278c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.582+0000 7f27a5400700 1 --2- 172.21.15.72:0/2500298768 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7f278c0383f0 0x7f278c03a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2794006fd0 tx=0x7f2794006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.586+0000 7f279ea00700 1 -- 172.21.15.72:0/2500298768 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f279801a6e0 con 0x7f27a8107be0 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.856+0000 7f27acc00700 1 -- 172.21.15.72:0/2500298768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f27a819f6e0 con 0x7f27a8107be0 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.913+0000 7f279ea00700 1 -- 172.21.15.72:0/2500298768 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f279802c3a0 con 0x7f27a8107be0 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.917+0000 7f279ea00700 1 -- 172.21.15.72:0/2500298768 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f279804bde0 con 0x7f27a8107be0 2024-03-19T05:52:00.637 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.921+0000 7f27acc00700 1 -- 172.21.15.72:0/2500298768 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7f278c0383f0 msgr2=0x7f278c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:00.638 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.921+0000 7f27acc00700 1 --2- 172.21.15.72:0/2500298768 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7f278c0383f0 0x7f278c03a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2794006fd0 tx=0x7f2794006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:00.638 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.921+0000 7f27acc00700 1 -- 172.21.15.72:0/2500298768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 msgr2=0x7f27a819b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:00.638 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.921+0000 7f27acc00700 1 --2- 172.21.15.72:0/2500298768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 0x7f27a819b990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2798003de0 tx=0x7f2798011ab0 comp rx=0 tx=0).stop 2024-03-19T05:52:00.638 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.921+0000 7f27acc00700 1 -- 172.21.15.72:0/2500298768 shutdown_connections 2024-03-19T05:52:00.638 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.921+0000 7f27acc00700 1 --2- 172.21.15.72:0/2500298768 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7f278c0383f0 0x7f278c03a8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:00.638 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.921+0000 7f27acc00700 1 --2- 172.21.15.72:0/2500298768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a8107be0 0x7f27a819b990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:00.638 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.921+0000 7f27acc00700 1 -- 172.21.15.72:0/2500298768 >> 172.21.15.72:0/2500298768 conn(0x7f27a807b200 msgr2=0x7f27a8106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:00.638 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.921+0000 7f27acc00700 1 -- 172.21.15.72:0/2500298768 shutdown_connections 2024-03-19T05:52:00.638 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:51:59.921+0000 7f27acc00700 1 -- 172.21.15.72:0/2500298768 wait complete. 2024-03-19T05:52:01.176 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:00 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2500298768' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-19T05:52:01.176 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:00 smithi072 ceph-mon[28706]: mgrmap e5: smithi072.jydpjk(active, since 7s) 2024-03-19T05:52:02.034 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:01 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/4161817778' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-19T05:52:02.153 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-19T05:52:02.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-19T05:52:02.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-19T05:52:02.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "active_name": "smithi072.jydpjk", 2024-03-19T05:52:02.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-19T05:52:02.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-19T05:52:02.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.182+0000 7fe0d2200700 1 Processor -- start 2024-03-19T05:52:02.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.183+0000 7fe0d2200700 1 -- start start 2024-03-19T05:52:02.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.183+0000 7fe0d2200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 0x7fe0cc107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:02.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.183+0000 7fe0d2200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc108530 con 0x7fe0cc107be0 2024-03-19T05:52:02.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.183+0000 7fe0cb400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 0x7fe0cc107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:02.154 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.183+0000 7fe0cb400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 0x7fe0cc107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60614/0 (socket says 172.21.15.72:60614) 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.183+0000 7fe0cb400700 1 -- 172.21.15.72:0/3759423449 learned_addr learned my addr 172.21.15.72:0/3759423449 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.184+0000 7fe0cb400700 1 -- 172.21.15.72:0/3759423449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc108670 con 0x7fe0cc107be0 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.184+0000 7fe0cb400700 1 --2- 172.21.15.72:0/3759423449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 0x7fe0cc107ff0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0098a0 tx=0x7fe0bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86618808c0fa0fb server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.185+0000 7fe0ca000700 1 -- 172.21.15.72:0/3759423449 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0bc004180 con 0x7fe0cc107be0 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.185+0000 7fe0ca000700 1 -- 172.21.15.72:0/3759423449 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe0bc0042e0 con 0x7fe0cc107be0 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.185+0000 7fe0ca000700 1 -- 172.21.15.72:0/3759423449 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0bc011a50 con 0x7fe0cc107be0 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.185+0000 7fe0d2200700 1 -- 172.21.15.72:0/3759423449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 msgr2=0x7fe0cc107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.185+0000 7fe0d2200700 1 --2- 172.21.15.72:0/3759423449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 0x7fe0cc107ff0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0098a0 tx=0x7fe0bc009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.185+0000 7fe0d2200700 1 -- 172.21.15.72:0/3759423449 shutdown_connections 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.185+0000 7fe0d2200700 1 --2- 172.21.15.72:0/3759423449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 0x7fe0cc107ff0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.185+0000 7fe0d2200700 1 -- 172.21.15.72:0/3759423449 >> 172.21.15.72:0/3759423449 conn(0x7fe0cc07b200 msgr2=0x7fe0cc07b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.186+0000 7fe0d2200700 1 -- 172.21.15.72:0/3759423449 shutdown_connections 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.186+0000 7fe0d2200700 1 -- 172.21.15.72:0/3759423449 wait complete. 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.187+0000 7fe0d2200700 1 Processor -- start 2024-03-19T05:52:02.155 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.187+0000 7fe0d2200700 1 -- start start 2024-03-19T05:52:02.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.187+0000 7fe0d2200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 0x7fe0cc19b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:02.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.187+0000 7fe0d2200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc19beb0 con 0x7fe0cc107be0 2024-03-19T05:52:02.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.187+0000 7fe0cb400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 0x7fe0cc19b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:02.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.188+0000 7fe0cb400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 0x7fe0cc19b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60620/0 (socket says 172.21.15.72:60620) 2024-03-19T05:52:02.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.188+0000 7fe0cb400700 1 -- 172.21.15.72:0/4161817778 learned_addr learned my addr 172.21.15.72:0/4161817778 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:02.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.188+0000 7fe0cb400700 1 -- 172.21.15.72:0/4161817778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc009550 con 0x7fe0cc107be0 2024-03-19T05:52:02.156 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.188+0000 7fe0cb400700 1 --2- 172.21.15.72:0/4161817778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 0x7fe0cc19b970 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc003de0 tx=0x7fe0bc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:02.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.189+0000 7fe0c3e00700 1 -- 172.21.15.72:0/4161817778 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0bc003930 con 0x7fe0cc107be0 2024-03-19T05:52:02.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.189+0000 7fe0c3e00700 1 -- 172.21.15.72:0/4161817778 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe0bc003a90 con 0x7fe0cc107be0 2024-03-19T05:52:02.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.189+0000 7fe0d2200700 1 -- 172.21.15.72:0/4161817778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc19c0b0 con 0x7fe0cc107be0 2024-03-19T05:52:02.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.189+0000 7fe0c3e00700 1 -- 172.21.15.72:0/4161817778 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0bc019730 con 0x7fe0cc107be0 2024-03-19T05:52:02.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.189+0000 7fe0d2200700 1 -- 172.21.15.72:0/4161817778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc19c550 con 0x7fe0cc107be0 2024-03-19T05:52:02.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.190+0000 7fe0d2200700 1 -- 172.21.15.72:0/4161817778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc062380 con 0x7fe0cc107be0 2024-03-19T05:52:02.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.190+0000 7fe0c3e00700 1 -- 172.21.15.72:0/4161817778 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fe0bc0199b0 con 0x7fe0cc107be0 2024-03-19T05:52:02.157 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.191+0000 7fe0c3e00700 1 --2- 172.21.15.72:0/4161817778 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fe0b0038440 0x7fe0b003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:02.159 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.191+0000 7fe0c3e00700 1 -- 172.21.15.72:0/4161817778 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe0bc04c140 con 0x7fe0cc107be0 2024-03-19T05:52:02.159 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.191+0000 7fe0caa00700 1 -- 172.21.15.72:0/4161817778 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fe0b0038440 msgr2=0x7fe0b003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3022348314 2024-03-19T05:52:02.159 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.191+0000 7fe0caa00700 1 --2- 172.21.15.72:0/4161817778 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fe0b0038440 0x7fe0b003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.195+0000 7fe0c3e00700 1 -- 172.21.15.72:0/4161817778 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe0bc010dc0 con 0x7fe0cc107be0 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.392+0000 7fe0caa00700 1 -- 172.21.15.72:0/4161817778 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fe0b0038440 msgr2=0x7fe0b003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3022348314 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.392+0000 7fe0caa00700 1 --2- 172.21.15.72:0/4161817778 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fe0b0038440 0x7fe0b003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.464+0000 7fe0d2200700 1 -- 172.21.15.72:0/4161817778 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fe0cc109a50 con 0x7fe0cc107be0 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.465+0000 7fe0c3e00700 1 -- 172.21.15.72:0/4161817778 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fe0bc010380 con 0x7fe0cc107be0 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.468+0000 7fe0d2200700 1 -- 172.21.15.72:0/4161817778 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fe0b0038440 msgr2=0x7fe0b003a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.468+0000 7fe0d2200700 1 --2- 172.21.15.72:0/4161817778 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fe0b0038440 0x7fe0b003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.468+0000 7fe0d2200700 1 -- 172.21.15.72:0/4161817778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 msgr2=0x7fe0cc19b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.468+0000 7fe0d2200700 1 --2- 172.21.15.72:0/4161817778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 0x7fe0cc19b970 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc003de0 tx=0x7fe0bc011ab0 comp rx=0 tx=0).stop 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.468+0000 7fe0d2200700 1 -- 172.21.15.72:0/4161817778 shutdown_connections 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.468+0000 7fe0d2200700 1 --2- 172.21.15.72:0/4161817778 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fe0b0038440 0x7fe0b003a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.468+0000 7fe0d2200700 1 --2- 172.21.15.72:0/4161817778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0cc107be0 0x7fe0cc19b970 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.468+0000 7fe0d2200700 1 -- 172.21.15.72:0/4161817778 >> 172.21.15.72:0/4161817778 conn(0x7fe0cc07b200 msgr2=0x7fe0cc106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.468+0000 7fe0d2200700 1 -- 172.21.15.72:0/4161817778 shutdown_connections 2024-03-19T05:52:02.160 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:01.469+0000 7fe0d2200700 1 -- 172.21.15.72:0/4161817778 wait complete. 2024-03-19T05:52:02.161 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for the mgr to restart... 2024-03-19T05:52:02.161 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mgr epoch 5... 2024-03-19T05:52:08.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:08 smithi072 ceph-mon[28706]: Active manager daemon smithi072.jydpjk restarted 2024-03-19T05:52:08.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:08 smithi072 ceph-mon[28706]: Activating manager daemon smithi072.jydpjk 2024-03-19T05:52:08.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:08 smithi072 ceph-mon[28706]: osdmap e2: 0 total, 0 up, 0 in 2024-03-19T05:52:08.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:08 smithi072 ceph-mon[28706]: mgrmap e6: smithi072.jydpjk(active, starting, since 0.009609s) 2024-03-19T05:52:08.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:08 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T05:52:08.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:08 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi072.jydpjk", "id": "smithi072.jydpjk"}]: dispatch 2024-03-19T05:52:08.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:08 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-19T05:52:08.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:08 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-19T05:52:08.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:08 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-19T05:52:08.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:08 smithi072 ceph-mon[28706]: Manager daemon smithi072.jydpjk is now available 2024-03-19T05:52:08.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:08 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:08.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:08 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:09.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:09 smithi072 ceph-mon[28706]: Found migration_current of "None". Setting to last migration. 2024-03-19T05:52:09.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:09 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:52:09.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:09 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:52:09.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:09 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:52:09.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:09 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/mirror_snapshot_schedule"}]: dispatch 2024-03-19T05:52:09.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:09 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/trash_purge_schedule"}]: dispatch 2024-03-19T05:52:09.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:09 smithi072 ceph-mon[28706]: mgrmap e7: smithi072.jydpjk(active, since 1.01538s) 2024-03-19T05:52:10.204 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-19T05:52:10.204 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-19T05:52:10.204 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-19T05:52:10.204 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-19T05:52:10.204 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.742+0000 7fea9e400700 1 Processor -- start 2024-03-19T05:52:10.204 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.742+0000 7fea9e400700 1 -- start start 2024-03-19T05:52:10.204 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.742+0000 7fea9e400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 0x7fea98105c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.742+0000 7fea9e400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea98106150 con 0x7fea98105800 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.743+0000 7fea9d000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 0x7fea98105c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.743+0000 7fea9d000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 0x7fea98105c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60634/0 (socket says 172.21.15.72:60634) 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.743+0000 7fea9d000700 1 -- 172.21.15.72:0/1351849320 learned_addr learned my addr 172.21.15.72:0/1351849320 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.743+0000 7fea9d000700 1 -- 172.21.15.72:0/1351849320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea98106290 con 0x7fea98105800 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.743+0000 7fea9d000700 1 --2- 172.21.15.72:0/1351849320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 0x7fea98105c10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0098a0 tx=0x7fea8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f40ca92d0647b43 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.744+0000 7fea97400700 1 -- 172.21.15.72:0/1351849320 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea8c004180 con 0x7fea98105800 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.744+0000 7fea97400700 1 -- 172.21.15.72:0/1351849320 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fea8c0042e0 con 0x7fea98105800 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.744+0000 7fea97400700 1 -- 172.21.15.72:0/1351849320 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea8c011a50 con 0x7fea98105800 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.744+0000 7fea9e400700 1 -- 172.21.15.72:0/1351849320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 msgr2=0x7fea98105c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.744+0000 7fea9e400700 1 --2- 172.21.15.72:0/1351849320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 0x7fea98105c10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0098a0 tx=0x7fea8c009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.745+0000 7fea9e400700 1 -- 172.21.15.72:0/1351849320 shutdown_connections 2024-03-19T05:52:10.205 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.745+0000 7fea9e400700 1 --2- 172.21.15.72:0/1351849320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 0x7fea98105c10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.745+0000 7fea9e400700 1 -- 172.21.15.72:0/1351849320 >> 172.21.15.72:0/1351849320 conn(0x7fea98100e50 msgr2=0x7fea98103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.745+0000 7fea9e400700 1 -- 172.21.15.72:0/1351849320 shutdown_connections 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.745+0000 7fea9e400700 1 -- 172.21.15.72:0/1351849320 wait complete. 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.746+0000 7fea9e400700 1 Processor -- start 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.746+0000 7fea9e400700 1 -- start start 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.747+0000 7fea9e400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 0x7fea98199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.747+0000 7fea9e400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea98199a90 con 0x7fea98105800 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.747+0000 7fea9d000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 0x7fea98199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.747+0000 7fea9d000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 0x7fea98199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60648/0 (socket says 172.21.15.72:60648) 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.747+0000 7fea9d000700 1 -- 172.21.15.72:0/2523008512 learned_addr learned my addr 172.21.15.72:0/2523008512 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.748+0000 7fea9d000700 1 -- 172.21.15.72:0/2523008512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c009550 con 0x7fea98105800 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.748+0000 7fea9d000700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 0x7fea98199550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fea8c003de0 tx=0x7fea8c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.748+0000 7fea95600700 1 -- 172.21.15.72:0/2523008512 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea8c003930 con 0x7fea98105800 2024-03-19T05:52:10.206 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.748+0000 7fea95600700 1 -- 172.21.15.72:0/2523008512 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fea8c003a90 con 0x7fea98105800 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.748+0000 7fea95600700 1 -- 172.21.15.72:0/2523008512 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea8c019730 con 0x7fea98105800 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.748+0000 7fea9e400700 1 -- 172.21.15.72:0/2523008512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea98199c90 con 0x7fea98105800 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.748+0000 7fea9e400700 1 -- 172.21.15.72:0/2523008512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9819a130 con 0x7fea98105800 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.749+0000 7fea95600700 1 -- 172.21.15.72:0/2523008512 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fea8c01a430 con 0x7fea98105800 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.750+0000 7fea95600700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 0x7fea8003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.750+0000 7fea95600700 1 -- 172.21.15.72:0/2523008512 --> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea8003b000 con 0x7fea80038440 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.750+0000 7fea95600700 1 -- 172.21.15.72:0/2523008512 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fea8c04c0b0 con 0x7fea98105800 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.750+0000 7fea97e00700 1 -- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 msgr2=0x7fea8003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3022348314 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.750+0000 7fea97e00700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 0x7fea8003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.951+0000 7fea97e00700 1 -- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 msgr2=0x7fea8003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3022348314 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:02.951+0000 7fea97e00700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 0x7fea8003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:03.352+0000 7fea97e00700 1 -- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 msgr2=0x7fea8003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3022348314 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:03.352+0000 7fea97e00700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 0x7fea8003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T05:52:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:04.153+0000 7fea97e00700 1 -- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 msgr2=0x7fea8003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3022348314 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:04.154+0000 7fea97e00700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 0x7fea8003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:05.755+0000 7fea97e00700 1 -- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 msgr2=0x7fea8003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/3022348314 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:05.755+0000 7fea97e00700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 0x7fea8003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:08.440+0000 7fea95600700 1 -- 172.21.15.72:0/2523008512 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mgrmap(e 6) v1 ==== 44851+0+0 (secure 0 0 0) 0x7fea8c02c3a0 con 0x7fea98105800 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:08.440+0000 7fea95600700 1 -- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 msgr2=0x7fea8003a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:08.440+0000 7fea95600700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 0x7fea8003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.443+0000 7fea95600700 1 -- 172.21.15.72:0/2523008512 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7fea8c019910 con 0x7fea98105800 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.443+0000 7fea95600700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fea8003bd10 0x7fea8003e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.444+0000 7fea95600700 1 -- 172.21.15.72:0/2523008512 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea8003b000 con 0x7fea8003bd10 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.445+0000 7fea97e00700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fea8003bd10 0x7fea8003e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.448+0000 7fea97e00700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fea8003bd10 0x7fea8003e0f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fea84003a10 tx=0x7fea840092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.450+0000 7fea95600700 1 -- 172.21.15.72:0/2523008512 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fea8003b000 con 0x7fea8003bd10 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.457+0000 7fea9e400700 1 -- 172.21.15.72:0/2523008512 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fea9819a890 con 0x7fea8003bd10 2024-03-19T05:52:10.208 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.458+0000 7fea95600700 1 -- 172.21.15.72:0/2523008512 <== mgr.14120 v2:172.21.15.72:6800/2294511988 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fea9819a890 con 0x7fea8003bd10 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.458+0000 7fea9e400700 1 -- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fea8003bd10 msgr2=0x7fea8003e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.458+0000 7fea9e400700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fea8003bd10 0x7fea8003e0f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fea84003a10 tx=0x7fea840092b0 comp rx=0 tx=0).stop 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.458+0000 7fea9e400700 1 -- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 msgr2=0x7fea98199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.458+0000 7fea9e400700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 0x7fea98199550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fea8c003de0 tx=0x7fea8c011ab0 comp rx=0 tx=0).stop 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.458+0000 7fea9e400700 1 -- 172.21.15.72:0/2523008512 shutdown_connections 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.458+0000 7fea9e400700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fea8003bd10 0x7fea8003e0f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.458+0000 7fea9e400700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea98105800 0x7fea98199550 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.458+0000 7fea9e400700 1 --2- 172.21.15.72:0/2523008512 >> [v2:172.21.15.72:6800/3022348314,v1:172.21.15.72:6801/3022348314] conn(0x7fea80038440 0x7fea8003a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.458+0000 7fea9e400700 1 -- 172.21.15.72:0/2523008512 >> 172.21.15.72:0/2523008512 conn(0x7fea98100e50 msgr2=0x7fea981024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.459+0000 7fea9e400700 1 -- 172.21.15.72:0/2523008512 shutdown_connections 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:09.459+0000 7fea9e400700 1 -- 172.21.15.72:0/2523008512 wait complete. 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:mgr epoch 5 is available 2024-03-19T05:52:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:Setting orchestrator backend to cephadm... 2024-03-19T05:52:10.820 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:10 smithi072 ceph-mon[28706]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-19T05:52:10.821 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:10 smithi072 ceph-mon[28706]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-19T05:52:10.821 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:10 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:10.821 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:10 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:10.821 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:10 smithi072 ceph-mon[28706]: [19/Mar/2024:05:52:09] ENGINE Bus STARTING 2024-03-19T05:52:10.821 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:10 smithi072 ceph-mon[28706]: [19/Mar/2024:05:52:09] ENGINE Serving on https://172.21.15.72:7150 2024-03-19T05:52:10.821 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:10 smithi072 ceph-mon[28706]: [19/Mar/2024:05:52:09] ENGINE Serving on http://172.21.15.72:8765 2024-03-19T05:52:10.821 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:10 smithi072 ceph-mon[28706]: [19/Mar/2024:05:52:09] ENGINE Bus STARTED 2024-03-19T05:52:10.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:10 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:52:11.789 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:11 smithi072 ceph-mon[28706]: mgrmap e8: smithi072.jydpjk(active, since 2s) 2024-03-19T05:52:11.789 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:11 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:11.789 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:11 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:52:11.798 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.827+0000 7f3aa0200700 1 Processor -- start 2024-03-19T05:52:11.798 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.827+0000 7f3aa0200700 1 -- start start 2024-03-19T05:52:11.798 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.828+0000 7f3aa0200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 0x7f3a98107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:11.798 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.828+0000 7f3aa0200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a98108530 con 0x7f3a98107be0 2024-03-19T05:52:11.798 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.828+0000 7f3a9d800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 0x7f3a98107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:11.798 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.828+0000 7f3a9d800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 0x7f3a98107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36390/0 (socket says 172.21.15.72:36390) 2024-03-19T05:52:11.798 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.828+0000 7f3a9d800700 1 -- 172.21.15.72:0/3546147367 learned_addr learned my addr 172.21.15.72:0/3546147367 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:11.798 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.829+0000 7f3a9d800700 1 -- 172.21.15.72:0/3546147367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98108670 con 0x7f3a98107be0 2024-03-19T05:52:11.798 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.829+0000 7f3a9d800700 1 --2- 172.21.15.72:0/3546147367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 0x7f3a98107ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0098a0 tx=0x7f3a8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7317393ca7023f49 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:11.798 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.829+0000 7f3a97e00700 1 -- 172.21.15.72:0/3546147367 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a8c004180 con 0x7f3a98107be0 2024-03-19T05:52:11.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.829+0000 7f3a97e00700 1 -- 172.21.15.72:0/3546147367 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3a8c0042e0 con 0x7f3a98107be0 2024-03-19T05:52:11.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.829+0000 7f3a97e00700 1 -- 172.21.15.72:0/3546147367 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a8c011a50 con 0x7f3a98107be0 2024-03-19T05:52:11.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.830+0000 7f3aa0200700 1 -- 172.21.15.72:0/3546147367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 msgr2=0x7f3a98107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:11.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.830+0000 7f3aa0200700 1 --2- 172.21.15.72:0/3546147367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 0x7f3a98107ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0098a0 tx=0x7f3a8c009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:11.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.830+0000 7f3aa0200700 1 -- 172.21.15.72:0/3546147367 shutdown_connections 2024-03-19T05:52:11.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.830+0000 7f3aa0200700 1 --2- 172.21.15.72:0/3546147367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 0x7f3a98107ff0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:11.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.830+0000 7f3aa0200700 1 -- 172.21.15.72:0/3546147367 >> 172.21.15.72:0/3546147367 conn(0x7f3a9807b200 msgr2=0x7f3a9807b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:11.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.830+0000 7f3aa0200700 1 -- 172.21.15.72:0/3546147367 shutdown_connections 2024-03-19T05:52:11.803 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.830+0000 7f3aa0200700 1 -- 172.21.15.72:0/3546147367 wait complete. 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.831+0000 7f3aa0200700 1 Processor -- start 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.832+0000 7f3aa0200700 1 -- start start 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.832+0000 7f3aa0200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 0x7f3a9819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.832+0000 7f3aa0200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9819bed0 con 0x7f3a98107be0 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.832+0000 7f3a9d800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 0x7f3a9819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.832+0000 7f3a9d800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 0x7f3a9819b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36406/0 (socket says 172.21.15.72:36406) 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.832+0000 7f3a9d800700 1 -- 172.21.15.72:0/1033895693 learned_addr learned my addr 172.21.15.72:0/1033895693 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.832+0000 7f3a9d800700 1 -- 172.21.15.72:0/1033895693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c009550 con 0x7f3a98107be0 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.833+0000 7f3a9d800700 1 --2- 172.21.15.72:0/1033895693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 0x7f3a9819b990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c003de0 tx=0x7f3a8c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.833+0000 7f3a96000700 1 -- 172.21.15.72:0/1033895693 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a8c003930 con 0x7f3a98107be0 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.833+0000 7f3a96000700 1 -- 172.21.15.72:0/1033895693 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3a8c003a90 con 0x7f3a98107be0 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.833+0000 7f3aa0200700 1 -- 172.21.15.72:0/1033895693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9819c0d0 con 0x7f3a98107be0 2024-03-19T05:52:11.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.833+0000 7f3a96000700 1 -- 172.21.15.72:0/1033895693 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a8c019730 con 0x7f3a98107be0 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.833+0000 7f3aa0200700 1 -- 172.21.15.72:0/1033895693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9819c570 con 0x7f3a98107be0 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.834+0000 7f3aa0200700 1 -- 172.21.15.72:0/1033895693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a98062380 con 0x7f3a98107be0 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.834+0000 7f3a96000700 1 -- 172.21.15.72:0/1033895693 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f3a8c0199b0 con 0x7f3a98107be0 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.835+0000 7f3a96000700 1 --2- 172.21.15.72:0/1033895693 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f3a800383f0 0x7f3a8003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.835+0000 7f3a96000700 1 -- 172.21.15.72:0/1033895693 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3a8c04c530 con 0x7f3a98107be0 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.835+0000 7f3a9ce00700 1 --2- 172.21.15.72:0/1033895693 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f3a800383f0 0x7f3a8003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.836+0000 7f3a9ce00700 1 --2- 172.21.15.72:0/1033895693 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f3a800383f0 0x7f3a8003a8a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3a84006fd0 tx=0x7f3a84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:10.840+0000 7f3a96000700 1 -- 172.21.15.72:0/1033895693 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3a8c010380 con 0x7f3a98107be0 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:11.053+0000 7f3aa0200700 1 -- 172.21.15.72:0/1033895693 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a98106c80 con 0x7f3a800383f0 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:11.068+0000 7f3a96000700 1 -- 172.21.15.72:0/1033895693 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3a98106c80 con 0x7f3a800383f0 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:11.071+0000 7f3aa0200700 1 -- 172.21.15.72:0/1033895693 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f3a800383f0 msgr2=0x7f3a8003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:11.071+0000 7f3aa0200700 1 --2- 172.21.15.72:0/1033895693 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f3a800383f0 0x7f3a8003a8a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3a84006fd0 tx=0x7f3a84006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:11.071+0000 7f3aa0200700 1 -- 172.21.15.72:0/1033895693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 msgr2=0x7f3a9819b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:11.805 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:11.071+0000 7f3aa0200700 1 --2- 172.21.15.72:0/1033895693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 0x7f3a9819b990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c003de0 tx=0x7f3a8c011ab0 comp rx=0 tx=0).stop 2024-03-19T05:52:11.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:11.071+0000 7f3aa0200700 1 -- 172.21.15.72:0/1033895693 shutdown_connections 2024-03-19T05:52:11.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:11.071+0000 7f3aa0200700 1 --2- 172.21.15.72:0/1033895693 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f3a800383f0 0x7f3a8003a8a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:11.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:11.071+0000 7f3aa0200700 1 --2- 172.21.15.72:0/1033895693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a98107be0 0x7f3a9819b990 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:11.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:11.071+0000 7f3aa0200700 1 -- 172.21.15.72:0/1033895693 >> 172.21.15.72:0/1033895693 conn(0x7f3a9807b200 msgr2=0x7f3a98106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:11.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:11.071+0000 7f3aa0200700 1 -- 172.21.15.72:0/1033895693 shutdown_connections 2024-03-19T05:52:11.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:11.071+0000 7f3aa0200700 1 -- 172.21.15.72:0/1033895693 wait complete. 2024-03-19T05:52:12.674 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:12 smithi072 ceph-mon[28706]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:13.373 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.429+0000 7fae6f800700 1 Processor -- start 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.429+0000 7fae6f800700 1 -- start start 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.430+0000 7fae6f800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 0x7fae6807a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.430+0000 7fae6f800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6807a850 con 0x7fae6807be10 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.430+0000 7fae6ce00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 0x7fae6807a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.430+0000 7fae6ce00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 0x7fae6807a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36412/0 (socket says 172.21.15.72:36412) 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.430+0000 7fae6ce00700 1 -- 172.21.15.72:0/2867225193 learned_addr learned my addr 172.21.15.72:0/2867225193 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.431+0000 7fae6ce00700 1 -- 172.21.15.72:0/2867225193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6807a990 con 0x7fae6807be10 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.431+0000 7fae6ce00700 1 --2- 172.21.15.72:0/2867225193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 0x7fae6807a310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009890 tx=0x7fae5c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd639d95f8acb78 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.431+0000 7fae67400700 1 -- 172.21.15.72:0/2867225193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae5c004180 con 0x7fae6807be10 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.432+0000 7fae67400700 1 -- 172.21.15.72:0/2867225193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fae5c0042e0 con 0x7fae6807be10 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.432+0000 7fae67400700 1 -- 172.21.15.72:0/2867225193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae5c011a40 con 0x7fae6807be10 2024-03-19T05:52:13.380 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.432+0000 7fae6f800700 1 -- 172.21.15.72:0/2867225193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 msgr2=0x7fae6807a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.432+0000 7fae6f800700 1 --2- 172.21.15.72:0/2867225193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 0x7fae6807a310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009890 tx=0x7fae5c009ba0 comp rx=0 tx=0).stop 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.432+0000 7fae6f800700 1 -- 172.21.15.72:0/2867225193 shutdown_connections 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.432+0000 7fae6f800700 1 --2- 172.21.15.72:0/2867225193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 0x7fae6807a310 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.432+0000 7fae6f800700 1 -- 172.21.15.72:0/2867225193 >> 172.21.15.72:0/2867225193 conn(0x7fae68101020 msgr2=0x7fae68103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.432+0000 7fae6f800700 1 -- 172.21.15.72:0/2867225193 shutdown_connections 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.432+0000 7fae6f800700 1 -- 172.21.15.72:0/2867225193 wait complete. 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.434+0000 7fae6f800700 1 Processor -- start 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.434+0000 7fae6f800700 1 -- start start 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.434+0000 7fae6f800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 0x7fae6819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.434+0000 7fae6f800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae681a0270 con 0x7fae6807be10 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.434+0000 7fae6ce00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 0x7fae6819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.434+0000 7fae6ce00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 0x7fae6819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36426/0 (socket says 172.21.15.72:36426) 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.434+0000 7fae6ce00700 1 -- 172.21.15.72:0/542763837 learned_addr learned my addr 172.21.15.72:0/542763837 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:13.381 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.435+0000 7fae6ce00700 1 -- 172.21.15.72:0/542763837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c0094f0 con 0x7fae6807be10 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.435+0000 7fae6ce00700 1 --2- 172.21.15.72:0/542763837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 0x7fae6819fd30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae5c006fa0 tx=0x7fae5c003750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.435+0000 7fae65600700 1 -- 172.21.15.72:0/542763837 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae5c003cd0 con 0x7fae6807be10 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.435+0000 7fae65600700 1 -- 172.21.15.72:0/542763837 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fae5c01b8b0 con 0x7fae6807be10 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.435+0000 7fae6f800700 1 -- 172.21.15.72:0/542763837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae681a0470 con 0x7fae6807be10 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.435+0000 7fae65600700 1 -- 172.21.15.72:0/542763837 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae5c019930 con 0x7fae6807be10 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.436+0000 7fae6f800700 1 -- 172.21.15.72:0/542763837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae681a0910 con 0x7fae6807be10 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.437+0000 7fae6f800700 1 -- 172.21.15.72:0/542763837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae68199510 con 0x7fae6807be10 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.437+0000 7fae65600700 1 -- 172.21.15.72:0/542763837 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fae5c01ba20 con 0x7fae6807be10 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.437+0000 7fae65600700 1 --2- 172.21.15.72:0/542763837 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fae500383a0 0x7fae5003a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.437+0000 7fae65600700 1 -- 172.21.15.72:0/542763837 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fae5c04c5e0 con 0x7fae6807be10 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.437+0000 7fae67e00700 1 --2- 172.21.15.72:0/542763837 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fae500383a0 0x7fae5003a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.438+0000 7fae67e00700 1 --2- 172.21.15.72:0/542763837 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fae500383a0 0x7fae5003a850 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fae54006fd0 tx=0x7fae54006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:13.382 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.443+0000 7fae65600700 1 -- 172.21.15.72:0/542763837 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fae5c018940 con 0x7fae6807be10 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.660+0000 7fae6f800700 1 -- 172.21.15.72:0/542763837 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fae68061190 con 0x7fae500383a0 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.661+0000 7fae65600700 1 -- 172.21.15.72:0/542763837 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fae68061190 con 0x7fae500383a0 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.664+0000 7fae6f800700 1 -- 172.21.15.72:0/542763837 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fae500383a0 msgr2=0x7fae5003a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.664+0000 7fae6f800700 1 --2- 172.21.15.72:0/542763837 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fae500383a0 0x7fae5003a850 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fae54006fd0 tx=0x7fae54006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.664+0000 7fae6f800700 1 -- 172.21.15.72:0/542763837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 msgr2=0x7fae6819fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.664+0000 7fae6f800700 1 --2- 172.21.15.72:0/542763837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 0x7fae6819fd30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae5c006fa0 tx=0x7fae5c003750 comp rx=0 tx=0).stop 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.664+0000 7fae6f800700 1 -- 172.21.15.72:0/542763837 shutdown_connections 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.664+0000 7fae6f800700 1 --2- 172.21.15.72:0/542763837 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fae500383a0 0x7fae5003a850 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.664+0000 7fae6f800700 1 --2- 172.21.15.72:0/542763837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae6807be10 0x7fae6819fd30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.664+0000 7fae6f800700 1 -- 172.21.15.72:0/542763837 >> 172.21.15.72:0/542763837 conn(0x7fae68101020 msgr2=0x7fae68103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.664+0000 7fae6f800700 1 -- 172.21.15.72:0/542763837 shutdown_connections 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:12.665+0000 7fae6f800700 1 -- 172.21.15.72:0/542763837 wait complete. 2024-03-19T05:52:13.383 INFO:teuthology.orchestra.run.smithi072.stdout:Generating ssh key... 2024-03-19T05:52:13.663 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:13 smithi072 ceph-mon[28706]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:15.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.976+0000 7f8eb5400700 1 Processor -- start 2024-03-19T05:52:15.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.976+0000 7f8eb5400700 1 -- start start 2024-03-19T05:52:15.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.977+0000 7f8eb5400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 0x7f8eb00791a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:15.225 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.977+0000 7f8eb5400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00796e0 con 0x7f8eb007aca0 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.977+0000 7f8eae800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 0x7f8eb00791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.977+0000 7f8eae800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 0x7f8eb00791a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52944/0 (socket says 172.21.15.72:52944) 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.977+0000 7f8eae800700 1 -- 172.21.15.72:0/19072343 learned_addr learned my addr 172.21.15.72:0/19072343 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.978+0000 7f8eae800700 1 -- 172.21.15.72:0/19072343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb0079820 con 0x7f8eb007aca0 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.978+0000 7f8eae800700 1 --2- 172.21.15.72:0/19072343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 0x7f8eb00791a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00098a0 tx=0x7f8ea0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698d840a6d7b3f0d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.978+0000 7f8eade00700 1 -- 172.21.15.72:0/19072343 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ea0004180 con 0x7f8eb007aca0 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.978+0000 7f8eade00700 1 -- 172.21.15.72:0/19072343 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8ea00042e0 con 0x7f8eb007aca0 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.978+0000 7f8eade00700 1 -- 172.21.15.72:0/19072343 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ea0011a50 con 0x7f8eb007aca0 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.979+0000 7f8eb5400700 1 -- 172.21.15.72:0/19072343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 msgr2=0x7f8eb00791a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.979+0000 7f8eb5400700 1 --2- 172.21.15.72:0/19072343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 0x7f8eb00791a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00098a0 tx=0x7f8ea0009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.979+0000 7f8eb5400700 1 -- 172.21.15.72:0/19072343 shutdown_connections 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.979+0000 7f8eb5400700 1 --2- 172.21.15.72:0/19072343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 0x7f8eb00791a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:15.226 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.979+0000 7f8eb5400700 1 -- 172.21.15.72:0/19072343 >> 172.21.15.72:0/19072343 conn(0x7f8eb0100fd0 msgr2=0x7f8eb0103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.979+0000 7f8eb5400700 1 -- 172.21.15.72:0/19072343 shutdown_connections 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.979+0000 7f8eb5400700 1 -- 172.21.15.72:0/19072343 wait complete. 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.980+0000 7f8eb5400700 1 Processor -- start 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.981+0000 7f8eb5400700 1 -- start start 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.981+0000 7f8eb5400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 0x7f8eb019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.981+0000 7f8eb5400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb019bec0 con 0x7f8eb007aca0 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.981+0000 7f8eae800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 0x7f8eb019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.981+0000 7f8eae800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 0x7f8eb019b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52956/0 (socket says 172.21.15.72:52956) 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.981+0000 7f8eae800700 1 -- 172.21.15.72:0/913867790 learned_addr learned my addr 172.21.15.72:0/913867790 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.982+0000 7f8eae800700 1 -- 172.21.15.72:0/913867790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea0009550 con 0x7f8eb007aca0 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.982+0000 7f8eae800700 1 --2- 172.21.15.72:0/913867790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 0x7f8eb019b980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0003de0 tx=0x7f8ea00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.982+0000 7f8ea7400700 1 -- 172.21.15.72:0/913867790 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ea00038b0 con 0x7f8eb007aca0 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.982+0000 7f8ea7400700 1 -- 172.21.15.72:0/913867790 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8ea0003a10 con 0x7f8eb007aca0 2024-03-19T05:52:15.227 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.982+0000 7f8ea7400700 1 -- 172.21.15.72:0/913867790 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ea0019600 con 0x7f8eb007aca0 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.982+0000 7f8eb5400700 1 -- 172.21.15.72:0/913867790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb019c0c0 con 0x7f8eb007aca0 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.982+0000 7f8eb5400700 1 -- 172.21.15.72:0/913867790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb019c560 con 0x7f8eb007aca0 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.983+0000 7f8ea7400700 1 -- 172.21.15.72:0/913867790 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f8ea001aac0 con 0x7f8eb007aca0 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.984+0000 7f8eb5400700 1 -- 172.21.15.72:0/913867790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb010bcb0 con 0x7f8eb007aca0 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.984+0000 7f8ea7400700 1 --2- 172.21.15.72:0/913867790 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f8e94038440 0x7f8e9403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.984+0000 7f8ea7400700 1 -- 172.21.15.72:0/913867790 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8ea004c2b0 con 0x7f8eb007aca0 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.984+0000 7f8ea7e00700 1 --2- 172.21.15.72:0/913867790 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f8e94038440 0x7f8e9403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.985+0000 7f8ea7e00700 1 --2- 172.21.15.72:0/913867790 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f8e94038440 0x7f8e9403a8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e98006fd0 tx=0x7f8e98006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:13.990+0000 7f8ea7400700 1 -- 172.21.15.72:0/913867790 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8ea0003b80 con 0x7f8eb007aca0 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:14.206+0000 7f8eb5400700 1 -- 172.21.15.72:0/913867790 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f8eb0103300 con 0x7f8e94038440 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:14.534+0000 7f8ea7400700 1 -- 172.21.15.72:0/913867790 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8eb0103300 con 0x7f8e94038440 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:14.537+0000 7f8eb5400700 1 -- 172.21.15.72:0/913867790 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f8e94038440 msgr2=0x7f8e9403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:14.537+0000 7f8eb5400700 1 --2- 172.21.15.72:0/913867790 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f8e94038440 0x7f8e9403a8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e98006fd0 tx=0x7f8e98006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:15.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:14.537+0000 7f8eb5400700 1 -- 172.21.15.72:0/913867790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 msgr2=0x7f8eb019b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:15.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:14.537+0000 7f8eb5400700 1 --2- 172.21.15.72:0/913867790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 0x7f8eb019b980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0003de0 tx=0x7f8ea00047c0 comp rx=0 tx=0).stop 2024-03-19T05:52:15.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:14.537+0000 7f8eb5400700 1 -- 172.21.15.72:0/913867790 shutdown_connections 2024-03-19T05:52:15.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:14.537+0000 7f8eb5400700 1 --2- 172.21.15.72:0/913867790 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f8e94038440 0x7f8e9403a8f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:15.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:14.537+0000 7f8eb5400700 1 --2- 172.21.15.72:0/913867790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb007aca0 0x7f8eb019b980 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:15.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:14.537+0000 7f8eb5400700 1 -- 172.21.15.72:0/913867790 >> 172.21.15.72:0/913867790 conn(0x7f8eb0100fd0 msgr2=0x7f8eb01026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:15.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:14.538+0000 7f8eb5400700 1 -- 172.21.15.72:0/913867790 shutdown_connections 2024-03-19T05:52:15.229 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:14.538+0000 7f8eb5400700 1 -- 172.21.15.72:0/913867790 wait complete. 2024-03-19T05:52:15.780 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:15 smithi072 ceph-mon[28706]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:15.780 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:15 smithi072 ceph-mon[28706]: Generating ssh key... 2024-03-19T05:52:15.780 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:15 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:15.780 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:15 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:16.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqsCmCD9QW3pvkObbdI65kxMLvtvMCGz2B9GzpbCGqGr+T8aHwu+B2y+mghIig0QqdV1mwlfnH7MnJYDSqj70XnP+wU5KV5ozBDVXXWnoHjH6xIZF69cdc4G10GJXDY5IdySHqIYlaqkm3qm88UoE1y2fcw5luREoe+rdjfJEW5ZzJa5gxqXqyhbEjDjX9UXNRa6iIfQHPHt4sxbnUP8l/1Dm3ULh3qCbZBKEybN5x6fvzco7gNz9h1DYxhJoi6iU76xCf4ljXeVqQPp6vLcGl90Wb6q4a+BKrQsDB+r0RJXezKi+afwYG8s5Nxe2Ar+L2I8r+6vknOh1XEO5MmFwESedO4/SzfOKxnNvwySr+xnMzhig+O1ElqfDM+AvVQHbRdHJ49dt5fpI2II/ZMCWeFzOBU38A/Vz59xS1tyV/E9M7bzrds5tgkidR3Yqa6TKWlQMV6baOOyM4wyYPzdoaYeiRUM8M6n0xgsKkhdHB6bZPNNXB3BhheXSIxmq0YUc= ceph-9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:52:16.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.844+0000 7fb997600700 1 Processor -- start 2024-03-19T05:52:16.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.844+0000 7fb997600700 1 -- start start 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.844+0000 7fb997600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 0x7fb990105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.844+0000 7fb997600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb990106310 con 0x7fb9901059c0 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.845+0000 7fb994c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 0x7fb990105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.845+0000 7fb994c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 0x7fb990105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52968/0 (socket says 172.21.15.72:52968) 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.845+0000 7fb994c00700 1 -- 172.21.15.72:0/2739657085 learned_addr learned my addr 172.21.15.72:0/2739657085 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.845+0000 7fb994c00700 1 -- 172.21.15.72:0/2739657085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990106450 con 0x7fb9901059c0 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.846+0000 7fb994c00700 1 --2- 172.21.15.72:0/2739657085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 0x7fb990105dd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb9840098a0 tx=0x7fb984009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a56adebd847c7c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.846+0000 7fb98f400700 1 -- 172.21.15.72:0/2739657085 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb984004180 con 0x7fb9901059c0 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.846+0000 7fb98f400700 1 -- 172.21.15.72:0/2739657085 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb9840042e0 con 0x7fb9901059c0 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.846+0000 7fb98f400700 1 -- 172.21.15.72:0/2739657085 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb984011a50 con 0x7fb9901059c0 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.847+0000 7fb997600700 1 -- 172.21.15.72:0/2739657085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 msgr2=0x7fb990105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.847+0000 7fb997600700 1 --2- 172.21.15.72:0/2739657085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 0x7fb990105dd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb9840098a0 tx=0x7fb984009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.847+0000 7fb997600700 1 -- 172.21.15.72:0/2739657085 shutdown_connections 2024-03-19T05:52:16.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.847+0000 7fb997600700 1 --2- 172.21.15.72:0/2739657085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 0x7fb990105dd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.847+0000 7fb997600700 1 -- 172.21.15.72:0/2739657085 >> 172.21.15.72:0/2739657085 conn(0x7fb990100fd0 msgr2=0x7fb990103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.847+0000 7fb997600700 1 -- 172.21.15.72:0/2739657085 shutdown_connections 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.847+0000 7fb997600700 1 -- 172.21.15.72:0/2739657085 wait complete. 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.848+0000 7fb997600700 1 Processor -- start 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.848+0000 7fb997600700 1 -- start start 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.849+0000 7fb997600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 0x7fb990199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.849+0000 7fb997600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb990199c40 con 0x7fb9901059c0 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.849+0000 7fb994c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 0x7fb990199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.849+0000 7fb994c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 0x7fb990199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52980/0 (socket says 172.21.15.72:52980) 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.849+0000 7fb994c00700 1 -- 172.21.15.72:0/1845283987 learned_addr learned my addr 172.21.15.72:0/1845283987 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.849+0000 7fb994c00700 1 -- 172.21.15.72:0/1845283987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb984009550 con 0x7fb9901059c0 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.850+0000 7fb994c00700 1 --2- 172.21.15.72:0/1845283987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 0x7fb990199700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb984003de0 tx=0x7fb984011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.850+0000 7fb98d600700 1 -- 172.21.15.72:0/1845283987 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb984003930 con 0x7fb9901059c0 2024-03-19T05:52:16.784 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.850+0000 7fb98d600700 1 -- 172.21.15.72:0/1845283987 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb984003a90 con 0x7fb9901059c0 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.850+0000 7fb98d600700 1 -- 172.21.15.72:0/1845283987 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb984019730 con 0x7fb9901059c0 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.850+0000 7fb997600700 1 -- 172.21.15.72:0/1845283987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb990199e40 con 0x7fb9901059c0 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.850+0000 7fb997600700 1 -- 172.21.15.72:0/1845283987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99019a2e0 con 0x7fb9901059c0 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.851+0000 7fb98d600700 1 -- 172.21.15.72:0/1845283987 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fb984019960 con 0x7fb9901059c0 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.851+0000 7fb997600700 1 -- 172.21.15.72:0/1845283987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb990062380 con 0x7fb9901059c0 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.852+0000 7fb98d600700 1 --2- 172.21.15.72:0/1845283987 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fb978038440 0x7fb97803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.852+0000 7fb98d600700 1 -- 172.21.15.72:0/1845283987 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb98404c4f0 con 0x7fb9901059c0 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.852+0000 7fb98fe00700 1 --2- 172.21.15.72:0/1845283987 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fb978038440 0x7fb97803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.853+0000 7fb98fe00700 1 --2- 172.21.15.72:0/1845283987 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fb978038440 0x7fb97803a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb97c006fd0 tx=0x7fb97c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:15.857+0000 7fb98d600700 1 -- 172.21.15.72:0/1845283987 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb98401abc0 con 0x7fb9901059c0 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:16.068+0000 7fb997600700 1 -- 172.21.15.72:0/1845283987 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fb990103330 con 0x7fb978038440 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:16.069+0000 7fb98d600700 1 -- 172.21.15.72:0/1845283987 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fb990103330 con 0x7fb978038440 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:16.073+0000 7fb997600700 1 -- 172.21.15.72:0/1845283987 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fb978038440 msgr2=0x7fb97803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:16.073+0000 7fb997600700 1 --2- 172.21.15.72:0/1845283987 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fb978038440 0x7fb97803a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb97c006fd0 tx=0x7fb97c006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:16.073+0000 7fb997600700 1 -- 172.21.15.72:0/1845283987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 msgr2=0x7fb990199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:16.786 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:16.073+0000 7fb997600700 1 --2- 172.21.15.72:0/1845283987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 0x7fb990199700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb984003de0 tx=0x7fb984011ab0 comp rx=0 tx=0).stop 2024-03-19T05:52:16.786 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:16.073+0000 7fb997600700 1 -- 172.21.15.72:0/1845283987 shutdown_connections 2024-03-19T05:52:16.786 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:16.073+0000 7fb997600700 1 --2- 172.21.15.72:0/1845283987 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fb978038440 0x7fb97803a8f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:16.786 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:16.073+0000 7fb997600700 1 --2- 172.21.15.72:0/1845283987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9901059c0 0x7fb990199700 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:16.786 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:16.073+0000 7fb997600700 1 -- 172.21.15.72:0/1845283987 >> 172.21.15.72:0/1845283987 conn(0x7fb990100fd0 msgr2=0x7fb990102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:16.786 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:16.073+0000 7fb997600700 1 -- 172.21.15.72:0/1845283987 shutdown_connections 2024-03-19T05:52:16.786 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:16.073+0000 7fb997600700 1 -- 172.21.15.72:0/1845283987 wait complete. 2024-03-19T05:52:16.786 INFO:teuthology.orchestra.run.smithi072.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-19T05:52:16.786 INFO:teuthology.orchestra.run.smithi072.stdout:Adding key to root@localhost authorized_keys... 2024-03-19T05:52:16.786 INFO:teuthology.orchestra.run.smithi072.stdout:Adding host smithi072... 2024-03-19T05:52:17.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:17 smithi072 ceph-mon[28706]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:18.291 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:18 smithi072 ceph-mon[28706]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi072", "addr": "172.21.15.72", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:19.317 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:19 smithi072 ceph-mon[28706]: Deploying cephadm binary to smithi072 2024-03-19T05:52:22.823 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Added host 'smithi072' with addr '172.21.15.72' 2024-03-19T05:52:22.825 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.367+0000 7f3793c00700 1 Processor -- start 2024-03-19T05:52:22.825 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.367+0000 7f3793c00700 1 -- start start 2024-03-19T05:52:22.825 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.368+0000 7f3793c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 0x7f378c0791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:22.825 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.368+0000 7f3793c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c079700 con 0x7f378c07acc0 2024-03-19T05:52:22.825 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.368+0000 7f3791200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 0x7f378c0791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:22.825 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.368+0000 7f3791200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 0x7f378c0791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52982/0 (socket says 172.21.15.72:52982) 2024-03-19T05:52:22.825 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.368+0000 7f3791200700 1 -- 172.21.15.72:0/1109210646 learned_addr learned my addr 172.21.15.72:0/1109210646 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:22.826 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.369+0000 7f3791200700 1 -- 172.21.15.72:0/1109210646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c079840 con 0x7f378c07acc0 2024-03-19T05:52:22.826 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.369+0000 7f3791200700 1 --2- 172.21.15.72:0/1109210646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 0x7f378c0791c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f377c0098a0 tx=0x7f377c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8801ea09cb52da4c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:22.826 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.369+0000 7f378be00700 1 -- 172.21.15.72:0/1109210646 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f377c004180 con 0x7f378c07acc0 2024-03-19T05:52:22.826 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.369+0000 7f378be00700 1 -- 172.21.15.72:0/1109210646 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f377c0042e0 con 0x7f378c07acc0 2024-03-19T05:52:22.826 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.369+0000 7f378be00700 1 -- 172.21.15.72:0/1109210646 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f377c011a50 con 0x7f378c07acc0 2024-03-19T05:52:22.826 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.370+0000 7f3793c00700 1 -- 172.21.15.72:0/1109210646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 msgr2=0x7f378c0791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:22.826 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.370+0000 7f3793c00700 1 --2- 172.21.15.72:0/1109210646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 0x7f378c0791c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f377c0098a0 tx=0x7f377c009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:22.830 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.370+0000 7f3793c00700 1 -- 172.21.15.72:0/1109210646 shutdown_connections 2024-03-19T05:52:22.830 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.370+0000 7f3793c00700 1 --2- 172.21.15.72:0/1109210646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 0x7f378c0791c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:22.830 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.370+0000 7f3793c00700 1 -- 172.21.15.72:0/1109210646 >> 172.21.15.72:0/1109210646 conn(0x7f378c100fd0 msgr2=0x7f378c103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:22.830 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.370+0000 7f3793c00700 1 -- 172.21.15.72:0/1109210646 shutdown_connections 2024-03-19T05:52:22.830 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.370+0000 7f3793c00700 1 -- 172.21.15.72:0/1109210646 wait complete. 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.371+0000 7f3793c00700 1 Processor -- start 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.371+0000 7f3793c00700 1 -- start start 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.371+0000 7f3793c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 0x7f378c19b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.371+0000 7f3793c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378c19bea0 con 0x7f378c07acc0 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.372+0000 7f3791200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 0x7f378c19b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.372+0000 7f3791200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 0x7f378c19b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52990/0 (socket says 172.21.15.72:52990) 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.372+0000 7f3791200700 1 -- 172.21.15.72:0/614556094 learned_addr learned my addr 172.21.15.72:0/614556094 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.372+0000 7f3791200700 1 -- 172.21.15.72:0/614556094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c009550 con 0x7f378c07acc0 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.372+0000 7f3791200700 1 --2- 172.21.15.72:0/614556094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 0x7f378c19b960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f377c009520 tx=0x7f377c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.373+0000 7f378a000700 1 -- 172.21.15.72:0/614556094 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f377c003a80 con 0x7f378c07acc0 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.373+0000 7f378a000700 1 -- 172.21.15.72:0/614556094 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f377c003be0 con 0x7f378c07acc0 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.373+0000 7f3793c00700 1 -- 172.21.15.72:0/614556094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378c19c0a0 con 0x7f378c07acc0 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.373+0000 7f378a000700 1 -- 172.21.15.72:0/614556094 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f377c0197b0 con 0x7f378c07acc0 2024-03-19T05:52:22.831 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.373+0000 7f3793c00700 1 -- 172.21.15.72:0/614556094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378c19c540 con 0x7f378c07acc0 2024-03-19T05:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.374+0000 7f378a000700 1 -- 172.21.15.72:0/614556094 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f377c019a70 con 0x7f378c07acc0 2024-03-19T05:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.374+0000 7f3793c00700 1 -- 172.21.15.72:0/614556094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378c10bc90 con 0x7f378c07acc0 2024-03-19T05:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.374+0000 7f378a000700 1 --2- 172.21.15.72:0/614556094 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f37700383a0 0x7f377003a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.374+0000 7f378a000700 1 -- 172.21.15.72:0/614556094 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f377c04c620 con 0x7f378c07acc0 2024-03-19T05:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.375+0000 7f3783e00700 1 --2- 172.21.15.72:0/614556094 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f37700383a0 0x7f377003a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.375+0000 7f3783e00700 1 --2- 172.21.15.72:0/614556094 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f37700383a0 0x7f377003a850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3778006fd0 tx=0x7f3778006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.381+0000 7f378a000700 1 -- 172.21.15.72:0/614556094 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f377c01ac30 con 0x7f378c07acc0 2024-03-19T05:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:17.599+0000 7f3793c00700 1 -- 172.21.15.72:0/614556094 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi072", "addr": "172.21.15.72", "target": ["mon-mgr", ""]}) v1 -- 0x7f378c103330 con 0x7f37700383a0 2024-03-19T05:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:22.142+0000 7f378a000700 1 -- 172.21.15.72:0/614556094 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f378c103330 con 0x7f37700383a0 2024-03-19T05:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:22.146+0000 7f3793c00700 1 -- 172.21.15.72:0/614556094 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f37700383a0 msgr2=0x7f377003a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:22.146+0000 7f3793c00700 1 --2- 172.21.15.72:0/614556094 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f37700383a0 0x7f377003a850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3778006fd0 tx=0x7f3778006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:22.832 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:22.146+0000 7f3793c00700 1 -- 172.21.15.72:0/614556094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 msgr2=0x7f378c19b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:22.146+0000 7f3793c00700 1 --2- 172.21.15.72:0/614556094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 0x7f378c19b960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f377c009520 tx=0x7f377c011ab0 comp rx=0 tx=0).stop 2024-03-19T05:52:22.833 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:22.147+0000 7f3793c00700 1 -- 172.21.15.72:0/614556094 shutdown_connections 2024-03-19T05:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:22.147+0000 7f3793c00700 1 --2- 172.21.15.72:0/614556094 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f37700383a0 0x7f377003a850 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:22.147+0000 7f3793c00700 1 --2- 172.21.15.72:0/614556094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f378c07acc0 0x7f378c19b960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:22.147+0000 7f3793c00700 1 -- 172.21.15.72:0/614556094 >> 172.21.15.72:0/614556094 conn(0x7f378c100fd0 msgr2=0x7f378c102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:22.147+0000 7f3793c00700 1 -- 172.21.15.72:0/614556094 shutdown_connections 2024-03-19T05:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:22.147+0000 7f3793c00700 1 -- 172.21.15.72:0/614556094 wait complete. 2024-03-19T05:52:22.834 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying mon service with default placement... 2024-03-19T05:52:23.399 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:23 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:23.399 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:23 smithi072 ceph-mon[28706]: Added host smithi072 2024-03-19T05:52:23.399 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:23 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:52:24.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-19T05:52:24.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.457+0000 7f6032600700 1 Processor -- start 2024-03-19T05:52:24.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.457+0000 7f6032600700 1 -- start start 2024-03-19T05:52:24.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.457+0000 7f6032600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 0x7f602c0791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:24.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.458+0000 7f6032600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c079700 con 0x7f602c07acc0 2024-03-19T05:52:24.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.458+0000 7f602b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 0x7f602c0791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:24.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.458+0000 7f602b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 0x7f602c0791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52994/0 (socket says 172.21.15.72:52994) 2024-03-19T05:52:24.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.458+0000 7f602b400700 1 -- 172.21.15.72:0/1650384031 learned_addr learned my addr 172.21.15.72:0/1650384031 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:24.804 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.458+0000 7f602b400700 1 -- 172.21.15.72:0/1650384031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c079840 con 0x7f602c07acc0 2024-03-19T05:52:24.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.459+0000 7f602b400700 1 --2- 172.21.15.72:0/1650384031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 0x7f602c0791c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f601c0098a0 tx=0x7f601c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1616cc420d1d2963 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:24.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.459+0000 7f602a000700 1 -- 172.21.15.72:0/1650384031 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f601c004180 con 0x7f602c07acc0 2024-03-19T05:52:24.809 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.459+0000 7f602a000700 1 -- 172.21.15.72:0/1650384031 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f601c0042e0 con 0x7f602c07acc0 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.459+0000 7f602a000700 1 -- 172.21.15.72:0/1650384031 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f601c011a50 con 0x7f602c07acc0 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.459+0000 7f6032600700 1 -- 172.21.15.72:0/1650384031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 msgr2=0x7f602c0791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.459+0000 7f6032600700 1 --2- 172.21.15.72:0/1650384031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 0x7f602c0791c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f601c0098a0 tx=0x7f601c009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.460+0000 7f6032600700 1 -- 172.21.15.72:0/1650384031 shutdown_connections 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.460+0000 7f6032600700 1 --2- 172.21.15.72:0/1650384031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 0x7f602c0791c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.460+0000 7f6032600700 1 -- 172.21.15.72:0/1650384031 >> 172.21.15.72:0/1650384031 conn(0x7f602c100fd0 msgr2=0x7f602c103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.460+0000 7f6032600700 1 -- 172.21.15.72:0/1650384031 shutdown_connections 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.460+0000 7f6032600700 1 -- 172.21.15.72:0/1650384031 wait complete. 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.461+0000 7f6032600700 1 Processor -- start 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.461+0000 7f6032600700 1 -- start start 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.461+0000 7f6032600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 0x7f602c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.461+0000 7f6032600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c19be80 con 0x7f602c07acc0 2024-03-19T05:52:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.461+0000 7f602b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 0x7f602c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.461+0000 7f602b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 0x7f602c19b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52998/0 (socket says 172.21.15.72:52998) 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.461+0000 7f602b400700 1 -- 172.21.15.72:0/3582918469 learned_addr learned my addr 172.21.15.72:0/3582918469 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.462+0000 7f602b400700 1 -- 172.21.15.72:0/3582918469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c009550 con 0x7f602c07acc0 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.462+0000 7f602b400700 1 --2- 172.21.15.72:0/3582918469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 0x7f602c19b940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f601c009520 tx=0x7f601c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.462+0000 7f6023e00700 1 -- 172.21.15.72:0/3582918469 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f601c003a80 con 0x7f602c07acc0 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.462+0000 7f6023e00700 1 -- 172.21.15.72:0/3582918469 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f601c003be0 con 0x7f602c07acc0 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.462+0000 7f6023e00700 1 -- 172.21.15.72:0/3582918469 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f601c0197b0 con 0x7f602c07acc0 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.462+0000 7f6032600700 1 -- 172.21.15.72:0/3582918469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c19c080 con 0x7f602c07acc0 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.462+0000 7f6032600700 1 -- 172.21.15.72:0/3582918469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c19c520 con 0x7f602c07acc0 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.463+0000 7f6023e00700 1 -- 172.21.15.72:0/3582918469 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f601c01a430 con 0x7f602c07acc0 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.464+0000 7f6032600700 1 -- 172.21.15.72:0/3582918469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c10bc90 con 0x7f602c07acc0 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.464+0000 7f6023e00700 1 --2- 172.21.15.72:0/3582918469 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f60100383f0 0x7f601003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.464+0000 7f6023e00700 1 -- 172.21.15.72:0/3582918469 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f601c04c500 con 0x7f602c07acc0 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.464+0000 7f602aa00700 1 --2- 172.21.15.72:0/3582918469 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f60100383f0 0x7f601003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.465+0000 7f602aa00700 1 --2- 172.21.15.72:0/3582918469 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f60100383f0 0x7f601003a8a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6018006fd0 tx=0x7f6018006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.469+0000 7f6023e00700 1 -- 172.21.15.72:0/3582918469 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f601c018530 con 0x7f602c07acc0 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.701+0000 7f6032600700 1 -- 172.21.15.72:0/3582918469 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f602c103310 con 0x7f60100383f0 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.709+0000 7f6023e00700 1 -- 172.21.15.72:0/3582918469 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f602c103310 con 0x7f60100383f0 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.711+0000 7f6032600700 1 -- 172.21.15.72:0/3582918469 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f60100383f0 msgr2=0x7f601003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.711+0000 7f6032600700 1 --2- 172.21.15.72:0/3582918469 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f60100383f0 0x7f601003a8a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6018006fd0 tx=0x7f6018006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.712+0000 7f6032600700 1 -- 172.21.15.72:0/3582918469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 msgr2=0x7f602c19b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.712+0000 7f6032600700 1 --2- 172.21.15.72:0/3582918469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 0x7f602c19b940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f601c009520 tx=0x7f601c011ab0 comp rx=0 tx=0).stop 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.712+0000 7f6032600700 1 -- 172.21.15.72:0/3582918469 shutdown_connections 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.712+0000 7f6032600700 1 --2- 172.21.15.72:0/3582918469 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f60100383f0 0x7f601003a8a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.712+0000 7f6032600700 1 --2- 172.21.15.72:0/3582918469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f602c07acc0 0x7f602c19b940 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.712+0000 7f6032600700 1 -- 172.21.15.72:0/3582918469 >> 172.21.15.72:0/3582918469 conn(0x7f602c100fd0 msgr2=0x7f602c1026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.712+0000 7f6032600700 1 -- 172.21.15.72:0/3582918469 shutdown_connections 2024-03-19T05:52:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:23.712+0000 7f6032600700 1 -- 172.21.15.72:0/3582918469 wait complete. 2024-03-19T05:52:24.813 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying mgr service with default placement... 2024-03-19T05:52:25.010 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:24 smithi072 ceph-mon[28706]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:25.010 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:24 smithi072 ceph-mon[28706]: Saving service mon spec with placement count:5 2024-03-19T05:52:25.010 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:24 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:26.482 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:26 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:26.482 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:26 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:26.482 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:26 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:26.779 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-19T05:52:26.779 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.877+0000 7f328f200700 1 Processor -- start 2024-03-19T05:52:26.779 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.877+0000 7f328f200700 1 -- start start 2024-03-19T05:52:26.779 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.878+0000 7f328f200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 0x7f32880791a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:26.779 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.878+0000 7f328f200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32880796e0 con 0x7f328807aca0 2024-03-19T05:52:26.779 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.878+0000 7f3287e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 0x7f32880791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:26.780 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.878+0000 7f3287e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 0x7f32880791a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43820/0 (socket says 172.21.15.72:43820) 2024-03-19T05:52:26.780 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.878+0000 7f3287e00700 1 -- 172.21.15.72:0/2486203330 learned_addr learned my addr 172.21.15.72:0/2486203330 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:26.780 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.878+0000 7f3287e00700 1 -- 172.21.15.72:0/2486203330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3288079820 con 0x7f328807aca0 2024-03-19T05:52:26.780 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.879+0000 7f3287e00700 1 --2- 172.21.15.72:0/2486203330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 0x7f32880791a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f32780098a0 tx=0x7f3278009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0305362a8a74a7b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:26.780 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.879+0000 7f3286a00700 1 -- 172.21.15.72:0/2486203330 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3278004180 con 0x7f328807aca0 2024-03-19T05:52:26.780 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.879+0000 7f3286a00700 1 -- 172.21.15.72:0/2486203330 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f32780042e0 con 0x7f328807aca0 2024-03-19T05:52:26.780 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.879+0000 7f3286a00700 1 -- 172.21.15.72:0/2486203330 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3278011af0 con 0x7f328807aca0 2024-03-19T05:52:26.780 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.880+0000 7f328f200700 1 -- 172.21.15.72:0/2486203330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 msgr2=0x7f32880791a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:26.780 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.880+0000 7f328f200700 1 --2- 172.21.15.72:0/2486203330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 0x7f32880791a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f32780098a0 tx=0x7f3278009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:26.780 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.880+0000 7f328f200700 1 -- 172.21.15.72:0/2486203330 shutdown_connections 2024-03-19T05:52:26.780 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.880+0000 7f328f200700 1 --2- 172.21.15.72:0/2486203330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 0x7f32880791a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:26.780 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.880+0000 7f328f200700 1 -- 172.21.15.72:0/2486203330 >> 172.21.15.72:0/2486203330 conn(0x7f3288100fd0 msgr2=0x7f3288103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.880+0000 7f328f200700 1 -- 172.21.15.72:0/2486203330 shutdown_connections 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.880+0000 7f328f200700 1 -- 172.21.15.72:0/2486203330 wait complete. 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.881+0000 7f328f200700 1 Processor -- start 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.881+0000 7f328f200700 1 -- start start 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.881+0000 7f328f200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 0x7f328819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.881+0000 7f328f200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328819bed0 con 0x7f328807aca0 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.882+0000 7f3287e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 0x7f328819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.882+0000 7f3287e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 0x7f328819b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43832/0 (socket says 172.21.15.72:43832) 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.882+0000 7f3287e00700 1 -- 172.21.15.72:0/1951195254 learned_addr learned my addr 172.21.15.72:0/1951195254 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.882+0000 7f3287e00700 1 -- 172.21.15.72:0/1951195254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278009550 con 0x7f328807aca0 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.882+0000 7f3287e00700 1 --2- 172.21.15.72:0/1951195254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 0x7f328819b990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3278011670 tx=0x7f3278011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.883+0000 7f3284c00700 1 -- 172.21.15.72:0/1951195254 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32780039f0 con 0x7f328807aca0 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.883+0000 7f3284c00700 1 -- 172.21.15.72:0/1951195254 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3278003b50 con 0x7f328807aca0 2024-03-19T05:52:26.781 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.883+0000 7f3284c00700 1 -- 172.21.15.72:0/1951195254 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32780247c0 con 0x7f328807aca0 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.883+0000 7f328f200700 1 -- 172.21.15.72:0/1951195254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328819c0d0 con 0x7f328807aca0 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.884+0000 7f328f200700 1 -- 172.21.15.72:0/1951195254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328819c570 con 0x7f328807aca0 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.885+0000 7f328f200700 1 -- 172.21.15.72:0/1951195254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328810bd10 con 0x7f328807aca0 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.886+0000 7f3284c00700 1 -- 172.21.15.72:0/1951195254 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f327801ac00 con 0x7f328807aca0 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.887+0000 7f3284c00700 1 --2- 172.21.15.72:0/1951195254 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f326c038440 0x7f326c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.887+0000 7f3284c00700 1 -- 172.21.15.72:0/1951195254 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f327804c760 con 0x7f328807aca0 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.887+0000 7f3287400700 1 --2- 172.21.15.72:0/1951195254 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f326c038440 0x7f326c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.888+0000 7f3287400700 1 --2- 172.21.15.72:0/1951195254 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f326c038440 0x7f326c03a8f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3274006fd0 tx=0x7f3274006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:25.892+0000 7f3284c00700 1 -- 172.21.15.72:0/1951195254 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3278018760 con 0x7f328807aca0 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:26.125+0000 7f328f200700 1 -- 172.21.15.72:0/1951195254 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f3288103300 con 0x7f326c038440 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:26.132+0000 7f3284c00700 1 -- 172.21.15.72:0/1951195254 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3288103300 con 0x7f326c038440 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:26.135+0000 7f328f200700 1 -- 172.21.15.72:0/1951195254 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f326c038440 msgr2=0x7f326c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:26.135+0000 7f328f200700 1 --2- 172.21.15.72:0/1951195254 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f326c038440 0x7f326c03a8f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3274006fd0 tx=0x7f3274006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:26.135+0000 7f328f200700 1 -- 172.21.15.72:0/1951195254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 msgr2=0x7f328819b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:26.135+0000 7f328f200700 1 --2- 172.21.15.72:0/1951195254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 0x7f328819b990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3278011670 tx=0x7f3278011b50 comp rx=0 tx=0).stop 2024-03-19T05:52:26.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:26.135+0000 7f328f200700 1 -- 172.21.15.72:0/1951195254 shutdown_connections 2024-03-19T05:52:26.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:26.135+0000 7f328f200700 1 --2- 172.21.15.72:0/1951195254 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f326c038440 0x7f326c03a8f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:26.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:26.135+0000 7f328f200700 1 --2- 172.21.15.72:0/1951195254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f328807aca0 0x7f328819b990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:26.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:26.135+0000 7f328f200700 1 -- 172.21.15.72:0/1951195254 >> 172.21.15.72:0/1951195254 conn(0x7f3288100fd0 msgr2=0x7f32881026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:26.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:26.135+0000 7f328f200700 1 -- 172.21.15.72:0/1951195254 shutdown_connections 2024-03-19T05:52:26.783 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:26.136+0000 7f328f200700 1 -- 172.21.15.72:0/1951195254 wait complete. 2024-03-19T05:52:26.783 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying crash service with default placement... 2024-03-19T05:52:27.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:27 smithi072 ceph-mon[28706]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:27.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:27 smithi072 ceph-mon[28706]: Saving service mgr spec with placement count:2 2024-03-19T05:52:28.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-03-19T05:52:28.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.338+0000 7f216da00700 1 Processor -- start 2024-03-19T05:52:28.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.339+0000 7f216da00700 1 -- start start 2024-03-19T05:52:28.327 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.339+0000 7f216da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 0x7f2168105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.339+0000 7f216da00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2168106310 con 0x7f21681059c0 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.339+0000 7f2166a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 0x7f2168105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.339+0000 7f2166a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 0x7f2168105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43838/0 (socket says 172.21.15.72:43838) 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.339+0000 7f2166a00700 1 -- 172.21.15.72:0/161647151 learned_addr learned my addr 172.21.15.72:0/161647151 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.340+0000 7f2166a00700 1 -- 172.21.15.72:0/161647151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2168106450 con 0x7f21681059c0 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.340+0000 7f2166a00700 1 --2- 172.21.15.72:0/161647151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 0x7f2168105dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2158009e80 tx=0x7f215800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5ac7ed268ebf14 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.340+0000 7f2165600700 1 -- 172.21.15.72:0/161647151 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f215800e070 con 0x7f21681059c0 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.340+0000 7f2165600700 1 -- 172.21.15.72:0/161647151 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f215800b8c0 con 0x7f21681059c0 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.340+0000 7f2165600700 1 -- 172.21.15.72:0/161647151 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21580044d0 con 0x7f21681059c0 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.341+0000 7f216da00700 1 -- 172.21.15.72:0/161647151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 msgr2=0x7f2168105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.341+0000 7f216da00700 1 --2- 172.21.15.72:0/161647151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 0x7f2168105dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2158009e80 tx=0x7f215800b330 comp rx=0 tx=0).stop 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.341+0000 7f216da00700 1 -- 172.21.15.72:0/161647151 shutdown_connections 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.341+0000 7f216da00700 1 --2- 172.21.15.72:0/161647151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 0x7f2168105dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:28.329 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.341+0000 7f216da00700 1 -- 172.21.15.72:0/161647151 >> 172.21.15.72:0/161647151 conn(0x7f2168100fd0 msgr2=0x7f2168103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:28.330 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.341+0000 7f216da00700 1 -- 172.21.15.72:0/161647151 shutdown_connections 2024-03-19T05:52:28.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.341+0000 7f216da00700 1 -- 172.21.15.72:0/161647151 wait complete. 2024-03-19T05:52:28.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.342+0000 7f216da00700 1 Processor -- start 2024-03-19T05:52:28.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.343+0000 7f216da00700 1 -- start start 2024-03-19T05:52:28.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.343+0000 7f216da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 0x7f216819b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:28.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.343+0000 7f216da00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216819be30 con 0x7f21681059c0 2024-03-19T05:52:28.334 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.343+0000 7f2166a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 0x7f216819b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.343+0000 7f2166a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 0x7f216819b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43846/0 (socket says 172.21.15.72:43846) 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.343+0000 7f2166a00700 1 -- 172.21.15.72:0/3027912400 learned_addr learned my addr 172.21.15.72:0/3027912400 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.344+0000 7f2166a00700 1 -- 172.21.15.72:0/3027912400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158009b30 con 0x7f21681059c0 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.344+0000 7f2166a00700 1 --2- 172.21.15.72:0/3027912400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 0x7f216819b8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2158000f80 tx=0x7f21580049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.344+0000 7f215f400700 1 -- 172.21.15.72:0/3027912400 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f215800e040 con 0x7f21681059c0 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.344+0000 7f215f400700 1 -- 172.21.15.72:0/3027912400 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f215800bd00 con 0x7f21681059c0 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.344+0000 7f215f400700 1 -- 172.21.15.72:0/3027912400 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2158012770 con 0x7f21681059c0 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.344+0000 7f216da00700 1 -- 172.21.15.72:0/3027912400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216819c030 con 0x7f21681059c0 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.344+0000 7f216da00700 1 -- 172.21.15.72:0/3027912400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216819c530 con 0x7f21681059c0 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.345+0000 7f215f400700 1 -- 172.21.15.72:0/3027912400 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f2158019040 con 0x7f21681059c0 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.345+0000 7f215cc00700 1 -- 172.21.15.72:0/3027912400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21400052f0 con 0x7f21681059c0 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.346+0000 7f215f400700 1 --2- 172.21.15.72:0/3027912400 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f214c038440 0x7f214c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.346+0000 7f215f400700 1 -- 172.21.15.72:0/3027912400 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f215804bbe0 con 0x7f21681059c0 2024-03-19T05:52:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.346+0000 7f2166000700 1 --2- 172.21.15.72:0/3027912400 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f214c038440 0x7f214c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.347+0000 7f2166000700 1 --2- 172.21.15.72:0/3027912400 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f214c038440 0x7f214c03a8f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2154006fd0 tx=0x7f2154006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.356+0000 7f215f400700 1 -- 172.21.15.72:0/3027912400 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f21580129a0 con 0x7f21681059c0 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.589+0000 7f215cc00700 1 -- 172.21.15.72:0/3027912400 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f2140000bc0 con 0x7f214c038440 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.600+0000 7f215f400700 1 -- 172.21.15.72:0/3027912400 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f2140000bc0 con 0x7f214c038440 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.603+0000 7f215cc00700 1 -- 172.21.15.72:0/3027912400 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f214c038440 msgr2=0x7f214c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.603+0000 7f215cc00700 1 --2- 172.21.15.72:0/3027912400 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f214c038440 0x7f214c03a8f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2154006fd0 tx=0x7f2154006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.603+0000 7f215cc00700 1 -- 172.21.15.72:0/3027912400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 msgr2=0x7f216819b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.603+0000 7f215cc00700 1 --2- 172.21.15.72:0/3027912400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 0x7f216819b8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2158000f80 tx=0x7f21580049f0 comp rx=0 tx=0).stop 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.603+0000 7f215cc00700 1 -- 172.21.15.72:0/3027912400 shutdown_connections 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.603+0000 7f215cc00700 1 --2- 172.21.15.72:0/3027912400 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f214c038440 0x7f214c03a8f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.603+0000 7f215cc00700 1 --2- 172.21.15.72:0/3027912400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21681059c0 0x7f216819b8f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.603+0000 7f215cc00700 1 -- 172.21.15.72:0/3027912400 >> 172.21.15.72:0/3027912400 conn(0x7f2168100fd0 msgr2=0x7f2168101d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.603+0000 7f215cc00700 1 -- 172.21.15.72:0/3027912400 shutdown_connections 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:27.603+0000 7f215cc00700 1 -- 172.21.15.72:0/3027912400 wait complete. 2024-03-19T05:52:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying ceph-exporter service with default placement... 2024-03-19T05:52:28.947 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:28 smithi072 ceph-mon[28706]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:28.947 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:28 smithi072 ceph-mon[28706]: Saving service crash spec with placement * 2024-03-19T05:52:28.947 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:28 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:30.005 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:29 smithi072 ceph-mon[28706]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:52:30.006 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:29 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:30.316 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-03-19T05:52:30.316 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.390+0000 7ff9c6000700 1 Processor -- start 2024-03-19T05:52:30.316 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.390+0000 7ff9c6000700 1 -- start start 2024-03-19T05:52:30.316 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.390+0000 7ff9c6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 0x7ff9c0105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:30.316 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.390+0000 7ff9c6000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c0106310 con 0x7ff9c01059c0 2024-03-19T05:52:30.316 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.391+0000 7ff9bf400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 0x7ff9c0105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:30.316 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.391+0000 7ff9bf400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 0x7ff9c0105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43858/0 (socket says 172.21.15.72:43858) 2024-03-19T05:52:30.316 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.391+0000 7ff9bf400700 1 -- 172.21.15.72:0/1860390189 learned_addr learned my addr 172.21.15.72:0/1860390189 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:30.316 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.391+0000 7ff9bf400700 1 -- 172.21.15.72:0/1860390189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c0106450 con 0x7ff9c01059c0 2024-03-19T05:52:30.316 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.391+0000 7ff9bf400700 1 --2- 172.21.15.72:0/1860390189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 0x7ff9c0105dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00098a0 tx=0x7ff9b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704150705f0c8d69 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.392+0000 7ff9be000700 1 -- 172.21.15.72:0/1860390189 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9b0004180 con 0x7ff9c01059c0 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.392+0000 7ff9be000700 1 -- 172.21.15.72:0/1860390189 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff9b00042e0 con 0x7ff9c01059c0 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.392+0000 7ff9be000700 1 -- 172.21.15.72:0/1860390189 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9b0011af0 con 0x7ff9c01059c0 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.392+0000 7ff9c6000700 1 -- 172.21.15.72:0/1860390189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 msgr2=0x7ff9c0105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.392+0000 7ff9c6000700 1 --2- 172.21.15.72:0/1860390189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 0x7ff9c0105dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00098a0 tx=0x7ff9b0009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.392+0000 7ff9c6000700 1 -- 172.21.15.72:0/1860390189 shutdown_connections 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.392+0000 7ff9c6000700 1 --2- 172.21.15.72:0/1860390189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 0x7ff9c0105dd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.392+0000 7ff9c6000700 1 -- 172.21.15.72:0/1860390189 >> 172.21.15.72:0/1860390189 conn(0x7ff9c0100fd0 msgr2=0x7ff9c0103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.393+0000 7ff9c6000700 1 -- 172.21.15.72:0/1860390189 shutdown_connections 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.393+0000 7ff9c6000700 1 -- 172.21.15.72:0/1860390189 wait complete. 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.394+0000 7ff9c6000700 1 Processor -- start 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.394+0000 7ff9c6000700 1 -- start start 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.394+0000 7ff9c6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 0x7ff9c019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.394+0000 7ff9c6000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c019be80 con 0x7ff9c01059c0 2024-03-19T05:52:30.317 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.395+0000 7ff9bf400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 0x7ff9c019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.395+0000 7ff9bf400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 0x7ff9c019b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43874/0 (socket says 172.21.15.72:43874) 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.395+0000 7ff9bf400700 1 -- 172.21.15.72:0/4034233801 learned_addr learned my addr 172.21.15.72:0/4034233801 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.395+0000 7ff9bf400700 1 -- 172.21.15.72:0/4034233801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0009550 con 0x7ff9c01059c0 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.396+0000 7ff9bf400700 1 --2- 172.21.15.72:0/4034233801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 0x7ff9c019b940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0011670 tx=0x7ff9b0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.396+0000 7ff9b7e00700 1 -- 172.21.15.72:0/4034233801 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9b0003a40 con 0x7ff9c01059c0 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.396+0000 7ff9b7e00700 1 -- 172.21.15.72:0/4034233801 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff9b0003ba0 con 0x7ff9c01059c0 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.396+0000 7ff9c6000700 1 -- 172.21.15.72:0/4034233801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c019c080 con 0x7ff9c01059c0 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.396+0000 7ff9b7e00700 1 -- 172.21.15.72:0/4034233801 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9b0024790 con 0x7ff9c01059c0 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.396+0000 7ff9c6000700 1 -- 172.21.15.72:0/4034233801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c019c520 con 0x7ff9c01059c0 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.397+0000 7ff9b7e00700 1 -- 172.21.15.72:0/4034233801 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ff9b002d3f0 con 0x7ff9c01059c0 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.398+0000 7ff9b7e00700 1 --2- 172.21.15.72:0/4034233801 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff9a4038440 0x7ff9a403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.398+0000 7ff9c6000700 1 -- 172.21.15.72:0/4034233801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c0062380 con 0x7ff9c01059c0 2024-03-19T05:52:30.318 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.398+0000 7ff9b7e00700 1 -- 172.21.15.72:0/4034233801 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff9b004c670 con 0x7ff9c01059c0 2024-03-19T05:52:30.319 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.398+0000 7ff9bea00700 1 --2- 172.21.15.72:0/4034233801 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff9a4038440 0x7ff9a403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:30.319 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.399+0000 7ff9bea00700 1 --2- 172.21.15.72:0/4034233801 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff9a4038440 0x7ff9a403a8f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac006fd0 tx=0x7ff9ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:30.319 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.403+0000 7ff9b7e00700 1 -- 172.21.15.72:0/4034233801 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff9b0010970 con 0x7ff9c01059c0 2024-03-19T05:52:30.319 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.649+0000 7ff9c6000700 1 -- 172.21.15.72:0/4034233801 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9c01032f0 con 0x7ff9a4038440 2024-03-19T05:52:30.319 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.655+0000 7ff9b7e00700 1 -- 172.21.15.72:0/4034233801 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7ff9c01032f0 con 0x7ff9a4038440 2024-03-19T05:52:30.319 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.658+0000 7ff9c6000700 1 -- 172.21.15.72:0/4034233801 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff9a4038440 msgr2=0x7ff9a403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:30.319 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.658+0000 7ff9c6000700 1 --2- 172.21.15.72:0/4034233801 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff9a4038440 0x7ff9a403a8f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac006fd0 tx=0x7ff9ac006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:30.320 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.658+0000 7ff9c6000700 1 -- 172.21.15.72:0/4034233801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 msgr2=0x7ff9c019b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:30.320 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.658+0000 7ff9c6000700 1 --2- 172.21.15.72:0/4034233801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 0x7ff9c019b940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0011670 tx=0x7ff9b0011b50 comp rx=0 tx=0).stop 2024-03-19T05:52:30.320 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.659+0000 7ff9c6000700 1 -- 172.21.15.72:0/4034233801 shutdown_connections 2024-03-19T05:52:30.320 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.659+0000 7ff9c6000700 1 --2- 172.21.15.72:0/4034233801 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff9a4038440 0x7ff9a403a8f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:30.320 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.659+0000 7ff9c6000700 1 --2- 172.21.15.72:0/4034233801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9c01059c0 0x7ff9c019b940 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:30.320 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.659+0000 7ff9c6000700 1 -- 172.21.15.72:0/4034233801 >> 172.21.15.72:0/4034233801 conn(0x7ff9c0100fd0 msgr2=0x7ff9c01026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:30.320 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.659+0000 7ff9c6000700 1 -- 172.21.15.72:0/4034233801 shutdown_connections 2024-03-19T05:52:30.320 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:29.659+0000 7ff9c6000700 1 -- 172.21.15.72:0/4034233801 wait complete. 2024-03-19T05:52:30.320 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying prometheus service with default placement... 2024-03-19T05:52:30.943 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:30 smithi072 ceph-mon[28706]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:30.943 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:30 smithi072 ceph-mon[28706]: Saving service ceph-exporter spec with placement * 2024-03-19T05:52:30.943 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:30 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:31.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-03-19T05:52:31.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.949+0000 7fbb20400700 1 Processor -- start 2024-03-19T05:52:31.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.949+0000 7fbb20400700 1 -- start start 2024-03-19T05:52:31.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.949+0000 7fbb20400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 0x7fbb18107fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:31.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.949+0000 7fbb20400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18108510 con 0x7fbb18107bc0 2024-03-19T05:52:31.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.950+0000 7fbb1da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 0x7fbb18107fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:31.842 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.950+0000 7fbb1da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 0x7fbb18107fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43880/0 (socket says 172.21.15.72:43880) 2024-03-19T05:52:31.843 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.950+0000 7fbb1da00700 1 -- 172.21.15.72:0/278400325 learned_addr learned my addr 172.21.15.72:0/278400325 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:31.843 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.950+0000 7fbb1da00700 1 -- 172.21.15.72:0/278400325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb18108650 con 0x7fbb18107bc0 2024-03-19T05:52:31.843 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.951+0000 7fbb1da00700 1 --2- 172.21.15.72:0/278400325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 0x7fbb18107fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0098a0 tx=0x7fbb0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824eb2b570349886 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:31.843 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.951+0000 7fbb17e00700 1 -- 172.21.15.72:0/278400325 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb0c004180 con 0x7fbb18107bc0 2024-03-19T05:52:31.843 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.951+0000 7fbb17e00700 1 -- 172.21.15.72:0/278400325 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbb0c0042e0 con 0x7fbb18107bc0 2024-03-19T05:52:31.843 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.951+0000 7fbb17e00700 1 -- 172.21.15.72:0/278400325 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb0c011af0 con 0x7fbb18107bc0 2024-03-19T05:52:31.843 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.952+0000 7fbb20400700 1 -- 172.21.15.72:0/278400325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 msgr2=0x7fbb18107fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:31.845 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.952+0000 7fbb20400700 1 --2- 172.21.15.72:0/278400325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 0x7fbb18107fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0098a0 tx=0x7fbb0c009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.952+0000 7fbb20400700 1 -- 172.21.15.72:0/278400325 shutdown_connections 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.952+0000 7fbb20400700 1 --2- 172.21.15.72:0/278400325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 0x7fbb18107fd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.952+0000 7fbb20400700 1 -- 172.21.15.72:0/278400325 >> 172.21.15.72:0/278400325 conn(0x7fbb18103550 msgr2=0x7fbb18105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.952+0000 7fbb20400700 1 -- 172.21.15.72:0/278400325 shutdown_connections 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.952+0000 7fbb20400700 1 -- 172.21.15.72:0/278400325 wait complete. 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.953+0000 7fbb20400700 1 Processor -- start 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.954+0000 7fbb20400700 1 -- start start 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.954+0000 7fbb20400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 0x7fbb1819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.954+0000 7fbb20400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1819be70 con 0x7fbb18107bc0 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.954+0000 7fbb1da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 0x7fbb1819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.954+0000 7fbb1da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 0x7fbb1819b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43896/0 (socket says 172.21.15.72:43896) 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.954+0000 7fbb1da00700 1 -- 172.21.15.72:0/4250655251 learned_addr learned my addr 172.21.15.72:0/4250655251 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.955+0000 7fbb1da00700 1 -- 172.21.15.72:0/4250655251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c009550 con 0x7fbb18107bc0 2024-03-19T05:52:31.847 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.955+0000 7fbb1da00700 1 --2- 172.21.15.72:0/4250655251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 0x7fbb1819b930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c011670 tx=0x7fbb0c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:31.847 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.955+0000 7fbb16000700 1 -- 172.21.15.72:0/4250655251 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb0c003a40 con 0x7fbb18107bc0 2024-03-19T05:52:31.847 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.955+0000 7fbb16000700 1 -- 172.21.15.72:0/4250655251 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbb0c003ba0 con 0x7fbb18107bc0 2024-03-19T05:52:31.847 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.955+0000 7fbb16000700 1 -- 172.21.15.72:0/4250655251 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb0c024790 con 0x7fbb18107bc0 2024-03-19T05:52:31.847 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.955+0000 7fbb20400700 1 -- 172.21.15.72:0/4250655251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1819c070 con 0x7fbb18107bc0 2024-03-19T05:52:31.847 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.955+0000 7fbb20400700 1 -- 172.21.15.72:0/4250655251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1819c510 con 0x7fbb18107bc0 2024-03-19T05:52:31.847 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.956+0000 7fbb20400700 1 -- 172.21.15.72:0/4250655251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb18062380 con 0x7fbb18107bc0 2024-03-19T05:52:31.847 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.956+0000 7fbb16000700 1 -- 172.21.15.72:0/4250655251 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fbb0c01a430 con 0x7fbb18107bc0 2024-03-19T05:52:31.847 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.957+0000 7fbb16000700 1 --2- 172.21.15.72:0/4250655251 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fbb00038440 0x7fbb0003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:31.847 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.957+0000 7fbb16000700 1 -- 172.21.15.72:0/4250655251 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbb0c04c450 con 0x7fbb18107bc0 2024-03-19T05:52:31.849 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.957+0000 7fbb1d000700 1 --2- 172.21.15.72:0/4250655251 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fbb00038440 0x7fbb0003a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:31.849 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.958+0000 7fbb1d000700 1 --2- 172.21.15.72:0/4250655251 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fbb00038440 0x7fbb0003a8f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbb04006fd0 tx=0x7fbb04006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:31.849 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:30.964+0000 7fbb16000700 1 -- 172.21.15.72:0/4250655251 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbb0c018ba0 con 0x7fbb18107bc0 2024-03-19T05:52:31.849 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:31.191+0000 7fbb20400700 1 -- 172.21.15.72:0/4250655251 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb1819f350 con 0x7fbb00038440 2024-03-19T05:52:31.849 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:31.198+0000 7fbb16000700 1 -- 172.21.15.72:0/4250655251 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fbb1819f350 con 0x7fbb00038440 2024-03-19T05:52:31.849 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:31.201+0000 7fbb20400700 1 -- 172.21.15.72:0/4250655251 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fbb00038440 msgr2=0x7fbb0003a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:31.849 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:31.201+0000 7fbb20400700 1 --2- 172.21.15.72:0/4250655251 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fbb00038440 0x7fbb0003a8f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbb04006fd0 tx=0x7fbb04006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:31.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:31.201+0000 7fbb20400700 1 -- 172.21.15.72:0/4250655251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 msgr2=0x7fbb1819b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:31.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:31.201+0000 7fbb20400700 1 --2- 172.21.15.72:0/4250655251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 0x7fbb1819b930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c011670 tx=0x7fbb0c011b50 comp rx=0 tx=0).stop 2024-03-19T05:52:31.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:31.201+0000 7fbb20400700 1 -- 172.21.15.72:0/4250655251 shutdown_connections 2024-03-19T05:52:31.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:31.201+0000 7fbb20400700 1 --2- 172.21.15.72:0/4250655251 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fbb00038440 0x7fbb0003a8f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:31.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:31.201+0000 7fbb20400700 1 --2- 172.21.15.72:0/4250655251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb18107bc0 0x7fbb1819b930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:31.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:31.201+0000 7fbb20400700 1 -- 172.21.15.72:0/4250655251 >> 172.21.15.72:0/4250655251 conn(0x7fbb18103550 msgr2=0x7fbb18105bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:31.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:31.202+0000 7fbb20400700 1 -- 172.21.15.72:0/4250655251 shutdown_connections 2024-03-19T05:52:31.850 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:31.202+0000 7fbb20400700 1 -- 172.21.15.72:0/4250655251 wait complete. 2024-03-19T05:52:31.850 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying grafana service with default placement... 2024-03-19T05:52:32.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:31 smithi072 ceph-mon[28706]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:52:32.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:31 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:32.170 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:31 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:33.005 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:32 smithi072 ceph-mon[28706]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:33.005 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:32 smithi072 ceph-mon[28706]: Saving service prometheus spec with placement count:1 2024-03-19T05:52:33.006 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:32 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:33.989 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:33 smithi072 ceph-mon[28706]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:52:33.989 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:33 smithi072 ceph-mon[28706]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:33.989 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:33 smithi072 ceph-mon[28706]: Saving service grafana spec with placement count:1 2024-03-19T05:52:34.279 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-03-19T05:52:34.279 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.484+0000 7f8c1ac00700 1 Processor -- start 2024-03-19T05:52:34.279 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.484+0000 7f8c1ac00700 1 -- start start 2024-03-19T05:52:34.279 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.484+0000 7f8c1ac00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 0x7f8c14079180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:34.279 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.484+0000 7f8c1ac00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140796c0 con 0x7f8c1407ac80 2024-03-19T05:52:34.279 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.485+0000 7f8c13e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 0x7f8c14079180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.485+0000 7f8c13e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 0x7f8c14079180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43898/0 (socket says 172.21.15.72:43898) 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.485+0000 7f8c13e00700 1 -- 172.21.15.72:0/4132676961 learned_addr learned my addr 172.21.15.72:0/4132676961 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.485+0000 7f8c13e00700 1 -- 172.21.15.72:0/4132676961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c14079800 con 0x7f8c1407ac80 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.485+0000 7f8c13e00700 1 --2- 172.21.15.72:0/4132676961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 0x7f8c14079180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c040098a0 tx=0x7f8c04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952d9980f4bdc6da server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.486+0000 7f8c12a00700 1 -- 172.21.15.72:0/4132676961 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c04004180 con 0x7f8c1407ac80 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.486+0000 7f8c12a00700 1 -- 172.21.15.72:0/4132676961 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c040042e0 con 0x7f8c1407ac80 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.486+0000 7f8c12a00700 1 -- 172.21.15.72:0/4132676961 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c04011af0 con 0x7f8c1407ac80 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.486+0000 7f8c1ac00700 1 -- 172.21.15.72:0/4132676961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 msgr2=0x7f8c14079180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.486+0000 7f8c1ac00700 1 --2- 172.21.15.72:0/4132676961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 0x7f8c14079180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c040098a0 tx=0x7f8c04009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.487+0000 7f8c1ac00700 1 -- 172.21.15.72:0/4132676961 shutdown_connections 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.487+0000 7f8c1ac00700 1 --2- 172.21.15.72:0/4132676961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 0x7f8c14079180 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.487+0000 7f8c1ac00700 1 -- 172.21.15.72:0/4132676961 >> 172.21.15.72:0/4132676961 conn(0x7f8c14100fd0 msgr2=0x7f8c14103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.487+0000 7f8c1ac00700 1 -- 172.21.15.72:0/4132676961 shutdown_connections 2024-03-19T05:52:34.280 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.487+0000 7f8c1ac00700 1 -- 172.21.15.72:0/4132676961 wait complete. 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.488+0000 7f8c1ac00700 1 Processor -- start 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.489+0000 7f8c1ac00700 1 -- start start 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.489+0000 7f8c1ac00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 0x7f8c1419b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.489+0000 7f8c1ac00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1419bed0 con 0x7f8c1407ac80 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.489+0000 7f8c13e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 0x7f8c1419b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.489+0000 7f8c13e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 0x7f8c1419b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43912/0 (socket says 172.21.15.72:43912) 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.489+0000 7f8c13e00700 1 -- 172.21.15.72:0/666398398 learned_addr learned my addr 172.21.15.72:0/666398398 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.490+0000 7f8c13e00700 1 -- 172.21.15.72:0/666398398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04009550 con 0x7f8c1407ac80 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.490+0000 7f8c13e00700 1 --2- 172.21.15.72:0/666398398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 0x7f8c1419b990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c04011670 tx=0x7f8c04011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.491+0000 7f8c10c00700 1 -- 172.21.15.72:0/666398398 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c040039f0 con 0x7f8c1407ac80 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.491+0000 7f8c10c00700 1 -- 172.21.15.72:0/666398398 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c04003b50 con 0x7f8c1407ac80 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.491+0000 7f8c1ac00700 1 -- 172.21.15.72:0/666398398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1419c0d0 con 0x7f8c1407ac80 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.491+0000 7f8c10c00700 1 -- 172.21.15.72:0/666398398 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c040247c0 con 0x7f8c1407ac80 2024-03-19T05:52:34.281 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.491+0000 7f8c1ac00700 1 -- 172.21.15.72:0/666398398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1419c570 con 0x7f8c1407ac80 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.492+0000 7f8c10c00700 1 -- 172.21.15.72:0/666398398 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f8c0401a430 con 0x7f8c1407ac80 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.492+0000 7f8c1ac00700 1 -- 172.21.15.72:0/666398398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1410bcd0 con 0x7f8c1407ac80 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.493+0000 7f8c10c00700 1 --2- 172.21.15.72:0/666398398 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f8bf8038440 0x7f8bf803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.493+0000 7f8c10c00700 1 -- 172.21.15.72:0/666398398 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8c0404c340 con 0x7f8c1407ac80 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.493+0000 7f8c13400700 1 --2- 172.21.15.72:0/666398398 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f8bf8038440 0x7f8bf803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.494+0000 7f8c13400700 1 --2- 172.21.15.72:0/666398398 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f8bf8038440 0x7f8bf803a8f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8c00006fd0 tx=0x7f8c00006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.498+0000 7f8c10c00700 1 -- 172.21.15.72:0/666398398 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8c04018b40 con 0x7f8c1407ac80 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.727+0000 7f8c1ac00700 1 -- 172.21.15.72:0/666398398 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c14103310 con 0x7f8bf8038440 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.733+0000 7f8c10c00700 1 -- 172.21.15.72:0/666398398 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f8c14103310 con 0x7f8bf8038440 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.735+0000 7f8c1ac00700 1 -- 172.21.15.72:0/666398398 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f8bf8038440 msgr2=0x7f8bf803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.735+0000 7f8c1ac00700 1 --2- 172.21.15.72:0/666398398 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f8bf8038440 0x7f8bf803a8f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8c00006fd0 tx=0x7f8c00006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.735+0000 7f8c1ac00700 1 -- 172.21.15.72:0/666398398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 msgr2=0x7f8c1419b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.735+0000 7f8c1ac00700 1 --2- 172.21.15.72:0/666398398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 0x7f8c1419b990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c04011670 tx=0x7f8c04011b50 comp rx=0 tx=0).stop 2024-03-19T05:52:34.282 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.735+0000 7f8c1ac00700 1 -- 172.21.15.72:0/666398398 shutdown_connections 2024-03-19T05:52:34.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.736+0000 7f8c1ac00700 1 --2- 172.21.15.72:0/666398398 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f8bf8038440 0x7f8bf803a8f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:34.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.736+0000 7f8c1ac00700 1 --2- 172.21.15.72:0/666398398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1407ac80 0x7f8c1419b990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:34.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.736+0000 7f8c1ac00700 1 -- 172.21.15.72:0/666398398 >> 172.21.15.72:0/666398398 conn(0x7f8c14100fd0 msgr2=0x7f8c141026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:34.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.736+0000 7f8c1ac00700 1 -- 172.21.15.72:0/666398398 shutdown_connections 2024-03-19T05:52:34.283 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:32.736+0000 7f8c1ac00700 1 -- 172.21.15.72:0/666398398 wait complete. 2024-03-19T05:52:34.283 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying node-exporter service with default placement... 2024-03-19T05:52:35.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-03-19T05:52:35.835 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.927+0000 7ff579000700 1 Processor -- start 2024-03-19T05:52:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.927+0000 7ff579000700 1 -- start start 2024-03-19T05:52:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.928+0000 7ff579000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 0x7ff574107e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.928+0000 7ff579000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff574108360 con 0x7ff574107a10 2024-03-19T05:52:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.928+0000 7ff573400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 0x7ff574107e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.928+0000 7ff573400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 0x7ff574107e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48300/0 (socket says 172.21.15.72:48300) 2024-03-19T05:52:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.928+0000 7ff573400700 1 -- 172.21.15.72:0/3531327575 learned_addr learned my addr 172.21.15.72:0/3531327575 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.929+0000 7ff573400700 1 -- 172.21.15.72:0/3531327575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5741084a0 con 0x7ff574107a10 2024-03-19T05:52:35.836 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.929+0000 7ff573400700 1 --2- 172.21.15.72:0/3531327575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 0x7ff574107e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff5640098a0 tx=0x7ff564009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e618822b1165d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:35.839 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.929+0000 7ff572000700 1 -- 172.21.15.72:0/3531327575 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff564004180 con 0x7ff574107a10 2024-03-19T05:52:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.929+0000 7ff572000700 1 -- 172.21.15.72:0/3531327575 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff5640042e0 con 0x7ff574107a10 2024-03-19T05:52:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.929+0000 7ff572000700 1 -- 172.21.15.72:0/3531327575 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff564011af0 con 0x7ff574107a10 2024-03-19T05:52:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.930+0000 7ff579000700 1 -- 172.21.15.72:0/3531327575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 msgr2=0x7ff574107e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.930+0000 7ff579000700 1 --2- 172.21.15.72:0/3531327575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 0x7ff574107e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff5640098a0 tx=0x7ff564009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.930+0000 7ff579000700 1 -- 172.21.15.72:0/3531327575 shutdown_connections 2024-03-19T05:52:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.930+0000 7ff579000700 1 --2- 172.21.15.72:0/3531327575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 0x7ff574107e20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.930+0000 7ff579000700 1 -- 172.21.15.72:0/3531327575 >> 172.21.15.72:0/3531327575 conn(0x7ff57407ae80 msgr2=0x7ff57407b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.930+0000 7ff579000700 1 -- 172.21.15.72:0/3531327575 shutdown_connections 2024-03-19T05:52:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.930+0000 7ff579000700 1 -- 172.21.15.72:0/3531327575 wait complete. 2024-03-19T05:52:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.931+0000 7ff579000700 1 Processor -- start 2024-03-19T05:52:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.931+0000 7ff579000700 1 -- start start 2024-03-19T05:52:35.840 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.932+0000 7ff579000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 0x7ff57419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.932+0000 7ff579000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57419bce0 con 0x7ff574107a10 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.932+0000 7ff573400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 0x7ff57419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.932+0000 7ff573400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 0x7ff57419b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48302/0 (socket says 172.21.15.72:48302) 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.932+0000 7ff573400700 1 -- 172.21.15.72:0/1658763232 learned_addr learned my addr 172.21.15.72:0/1658763232 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.932+0000 7ff573400700 1 -- 172.21.15.72:0/1658763232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009550 con 0x7ff574107a10 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.933+0000 7ff573400700 1 --2- 172.21.15.72:0/1658763232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 0x7ff57419b7a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff564011670 tx=0x7ff564011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.933+0000 7ff56be00700 1 -- 172.21.15.72:0/1658763232 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff564003a40 con 0x7ff574107a10 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.933+0000 7ff56be00700 1 -- 172.21.15.72:0/1658763232 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff564003ba0 con 0x7ff574107a10 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.933+0000 7ff56be00700 1 -- 172.21.15.72:0/1658763232 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff564024790 con 0x7ff574107a10 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.933+0000 7ff579000700 1 -- 172.21.15.72:0/1658763232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57419bee0 con 0x7ff574107a10 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.933+0000 7ff579000700 1 -- 172.21.15.72:0/1658763232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57419c380 con 0x7ff574107a10 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.934+0000 7ff56be00700 1 -- 172.21.15.72:0/1658763232 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ff56401a430 con 0x7ff574107a10 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.934+0000 7ff579000700 1 -- 172.21.15.72:0/1658763232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff574062380 con 0x7ff574107a10 2024-03-19T05:52:35.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.935+0000 7ff56be00700 1 --2- 172.21.15.72:0/1658763232 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff558038440 0x7ff55803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:35.842 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.935+0000 7ff56be00700 1 -- 172.21.15.72:0/1658763232 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff56404c530 con 0x7ff574107a10 2024-03-19T05:52:35.843 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.935+0000 7ff572a00700 1 --2- 172.21.15.72:0/1658763232 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff558038440 0x7ff55803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:35.843 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.936+0000 7ff572a00700 1 --2- 172.21.15.72:0/1658763232 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff558038440 0x7ff55803a8f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff560006fd0 tx=0x7ff560006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:34.940+0000 7ff56be00700 1 -- 172.21.15.72:0/1658763232 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff564010380 con 0x7ff574107a10 2024-03-19T05:52:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:35.165+0000 7ff579000700 1 -- 172.21.15.72:0/1658763232 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7ff574106cf0 con 0x7ff558038440 2024-03-19T05:52:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:35.174+0000 7ff56be00700 1 -- 172.21.15.72:0/1658763232 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7ff574106cf0 con 0x7ff558038440 2024-03-19T05:52:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:35.177+0000 7ff579000700 1 -- 172.21.15.72:0/1658763232 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff558038440 msgr2=0x7ff55803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:35.177+0000 7ff579000700 1 --2- 172.21.15.72:0/1658763232 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff558038440 0x7ff55803a8f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff560006fd0 tx=0x7ff560006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:35.177+0000 7ff579000700 1 -- 172.21.15.72:0/1658763232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 msgr2=0x7ff57419b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:35.177+0000 7ff579000700 1 --2- 172.21.15.72:0/1658763232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 0x7ff57419b7a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff564011670 tx=0x7ff564011b50 comp rx=0 tx=0).stop 2024-03-19T05:52:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:35.177+0000 7ff579000700 1 -- 172.21.15.72:0/1658763232 shutdown_connections 2024-03-19T05:52:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:35.177+0000 7ff579000700 1 --2- 172.21.15.72:0/1658763232 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff558038440 0x7ff55803a8f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:35.177+0000 7ff579000700 1 --2- 172.21.15.72:0/1658763232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff574107a10 0x7ff57419b7a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:35.177+0000 7ff579000700 1 -- 172.21.15.72:0/1658763232 >> 172.21.15.72:0/1658763232 conn(0x7ff57407ae80 msgr2=0x7ff5741060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:35.178+0000 7ff579000700 1 -- 172.21.15.72:0/1658763232 shutdown_connections 2024-03-19T05:52:35.845 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:35.178+0000 7ff579000700 1 -- 172.21.15.72:0/1658763232 wait complete. 2024-03-19T05:52:35.845 INFO:teuthology.orchestra.run.smithi072.stdout:Deploying alertmanager service with default placement... 2024-03-19T05:52:36.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:35 smithi072 ceph-mon[28706]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:52:36.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:35 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:37.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:36 smithi072 ceph-mon[28706]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:37.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:36 smithi072 ceph-mon[28706]: Saving service node-exporter spec with placement * 2024-03-19T05:52:37.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:36 smithi072 ceph-mon[28706]: from='mgr.14120 172.21.15.72:0/4011971040' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:37.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-03-19T05:52:37.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.457+0000 7f60b6e00700 1 Processor -- start 2024-03-19T05:52:37.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.457+0000 7f60b6e00700 1 -- start start 2024-03-19T05:52:37.439 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.458+0000 7f60b6e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 0x7f60b0079200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:37.440 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.458+0000 7f60b6e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b0079740 con 0x7f60b007ad00 2024-03-19T05:52:37.440 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.458+0000 7f60afe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 0x7f60b0079200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:37.440 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.458+0000 7f60afe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 0x7f60b0079200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48310/0 (socket says 172.21.15.72:48310) 2024-03-19T05:52:37.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.458+0000 7f60afe00700 1 -- 172.21.15.72:0/1072595845 learned_addr learned my addr 172.21.15.72:0/1072595845 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:37.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.459+0000 7f60afe00700 1 -- 172.21.15.72:0/1072595845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b0079880 con 0x7f60b007ad00 2024-03-19T05:52:37.451 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.459+0000 7f60afe00700 1 --2- 172.21.15.72:0/1072595845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 0x7f60b0079200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f60a00098a0 tx=0x7f60a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9462c4bc6f3bb7bd server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:37.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.459+0000 7f60aea00700 1 -- 172.21.15.72:0/1072595845 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60a0004180 con 0x7f60b007ad00 2024-03-19T05:52:37.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.459+0000 7f60aea00700 1 -- 172.21.15.72:0/1072595845 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f60a00042e0 con 0x7f60b007ad00 2024-03-19T05:52:37.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.460+0000 7f60aea00700 1 -- 172.21.15.72:0/1072595845 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60a0011af0 con 0x7f60b007ad00 2024-03-19T05:52:37.452 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.460+0000 7f60b6e00700 1 -- 172.21.15.72:0/1072595845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 msgr2=0x7f60b0079200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:37.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.460+0000 7f60b6e00700 1 --2- 172.21.15.72:0/1072595845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 0x7f60b0079200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f60a00098a0 tx=0x7f60a0009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:37.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.460+0000 7f60b6e00700 1 -- 172.21.15.72:0/1072595845 shutdown_connections 2024-03-19T05:52:37.453 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.460+0000 7f60b6e00700 1 --2- 172.21.15.72:0/1072595845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 0x7f60b0079200 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.460+0000 7f60b6e00700 1 -- 172.21.15.72:0/1072595845 >> 172.21.15.72:0/1072595845 conn(0x7f60b0100fd0 msgr2=0x7f60b0103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.460+0000 7f60b6e00700 1 -- 172.21.15.72:0/1072595845 shutdown_connections 2024-03-19T05:52:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.460+0000 7f60b6e00700 1 -- 172.21.15.72:0/1072595845 wait complete. 2024-03-19T05:52:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.461+0000 7f60b6e00700 1 Processor -- start 2024-03-19T05:52:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.461+0000 7f60b6e00700 1 -- start start 2024-03-19T05:52:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.462+0000 7f60b6e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 0x7f60b019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.462+0000 7f60b6e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b01a02d0 con 0x7f60b007ad00 2024-03-19T05:52:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.462+0000 7f60afe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 0x7f60b019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.462+0000 7f60afe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 0x7f60b019fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48320/0 (socket says 172.21.15.72:48320) 2024-03-19T05:52:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.462+0000 7f60afe00700 1 -- 172.21.15.72:0/3200235322 learned_addr learned my addr 172.21.15.72:0/3200235322 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.462+0000 7f60afe00700 1 -- 172.21.15.72:0/3200235322 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0009550 con 0x7f60b007ad00 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.463+0000 7f60afe00700 1 --2- 172.21.15.72:0/3200235322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 0x7f60b019fd90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f60a0011670 tx=0x7f60a0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.463+0000 7f60acc00700 1 -- 172.21.15.72:0/3200235322 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60a00039f0 con 0x7f60b007ad00 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.463+0000 7f60acc00700 1 -- 172.21.15.72:0/3200235322 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f60a0003b50 con 0x7f60b007ad00 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.463+0000 7f60b6e00700 1 -- 172.21.15.72:0/3200235322 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b01a04d0 con 0x7f60b007ad00 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.463+0000 7f60acc00700 1 -- 172.21.15.72:0/3200235322 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60a00247c0 con 0x7f60b007ad00 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.463+0000 7f60b6e00700 1 -- 172.21.15.72:0/3200235322 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b01a0970 con 0x7f60b007ad00 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.464+0000 7f60acc00700 1 -- 172.21.15.72:0/3200235322 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f60a001ac00 con 0x7f60b007ad00 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.464+0000 7f60b6e00700 1 -- 172.21.15.72:0/3200235322 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b01078a0 con 0x7f60b007ad00 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.465+0000 7f60acc00700 1 --2- 172.21.15.72:0/3200235322 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f60940383f0 0x7f609403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.465+0000 7f60acc00700 1 -- 172.21.15.72:0/3200235322 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f60a004c4a0 con 0x7f60b007ad00 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.465+0000 7f60af400700 1 --2- 172.21.15.72:0/3200235322 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f60940383f0 0x7f609403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.465+0000 7f60af400700 1 --2- 172.21.15.72:0/3200235322 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f60940383f0 0x7f609403a8a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f609c006fd0 tx=0x7f609c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.470+0000 7f60acc00700 1 -- 172.21.15.72:0/3200235322 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f60a001a430 con 0x7f60b007ad00 2024-03-19T05:52:37.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.696+0000 7f60b6e00700 1 -- 172.21.15.72:0/3200235322 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f60b0102cd0 con 0x7f60940383f0 2024-03-19T05:52:37.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.703+0000 7f60acc00700 1 -- 172.21.15.72:0/3200235322 <== mgr.14120 v2:172.21.15.72:6800/2294511988 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f60b0102cd0 con 0x7f60940383f0 2024-03-19T05:52:37.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.706+0000 7f60b6e00700 1 -- 172.21.15.72:0/3200235322 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f60940383f0 msgr2=0x7f609403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:37.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.706+0000 7f60b6e00700 1 --2- 172.21.15.72:0/3200235322 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f60940383f0 0x7f609403a8a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f609c006fd0 tx=0x7f609c006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:37.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.706+0000 7f60b6e00700 1 -- 172.21.15.72:0/3200235322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 msgr2=0x7f60b019fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:37.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.706+0000 7f60b6e00700 1 --2- 172.21.15.72:0/3200235322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 0x7f60b019fd90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f60a0011670 tx=0x7f60a0011b50 comp rx=0 tx=0).stop 2024-03-19T05:52:37.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.706+0000 7f60b6e00700 1 -- 172.21.15.72:0/3200235322 shutdown_connections 2024-03-19T05:52:37.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.706+0000 7f60b6e00700 1 --2- 172.21.15.72:0/3200235322 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f60940383f0 0x7f609403a8a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:37.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.706+0000 7f60b6e00700 1 --2- 172.21.15.72:0/3200235322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b007ad00 0x7f60b019fd90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:37.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.706+0000 7f60b6e00700 1 -- 172.21.15.72:0/3200235322 >> 172.21.15.72:0/3200235322 conn(0x7f60b0100fd0 msgr2=0x7f60b0106bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:37.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.706+0000 7f60b6e00700 1 -- 172.21.15.72:0/3200235322 shutdown_connections 2024-03-19T05:52:37.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:36.706+0000 7f60b6e00700 1 -- 172.21.15.72:0/3200235322 wait complete. 2024-03-19T05:52:38.051 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:37 smithi072 ceph-mon[28706]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:52:38.051 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:37 smithi072 ceph-mon[28706]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:38.052 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:37 smithi072 ceph-mon[28706]: Saving service alertmanager spec with placement count:1 2024-03-19T05:52:39.060 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.124+0000 7f1efd400700 1 Processor -- start 2024-03-19T05:52:39.060 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.124+0000 7f1efd400700 1 -- start start 2024-03-19T05:52:39.060 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.124+0000 7f1efd400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef8080210 0x7f1ef810ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:39.060 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.124+0000 7f1efd400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef810f1f0 con 0x7f1ef8080210 2024-03-19T05:52:39.060 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.125+0000 7f1ef6800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef8080210 0x7f1ef810ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:39.060 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.125+0000 7f1ef6800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef8080210 0x7f1ef810ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48334/0 (socket says 172.21.15.72:48334) 2024-03-19T05:52:39.061 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.125+0000 7f1ef6800700 1 -- 172.21.15.72:0/3657289851 learned_addr learned my addr 172.21.15.72:0/3657289851 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:39.061 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.125+0000 7f1ef6800700 1 -- 172.21.15.72:0/3657289851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef810f330 con 0x7f1ef8080210 2024-03-19T05:52:39.061 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.126+0000 7f1ef6800700 1 --2- 172.21.15.72:0/3657289851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef8080210 0x7f1ef810ecb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80098a0 tx=0x7f1ee8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4aa6d7fef4ff41a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:39.061 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.127+0000 7f1ef5400700 1 -- 172.21.15.72:0/3657289851 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ee8004180 con 0x7f1ef8080210 2024-03-19T05:52:39.061 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.127+0000 7f1ef5400700 1 -- 172.21.15.72:0/3657289851 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1ee80042e0 con 0x7f1ef8080210 2024-03-19T05:52:39.065 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.127+0000 7f1ef5400700 1 -- 172.21.15.72:0/3657289851 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ee8011af0 con 0x7f1ef8080210 2024-03-19T05:52:39.065 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.127+0000 7f1efd400700 1 -- 172.21.15.72:0/3657289851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef8080210 msgr2=0x7f1ef810ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:39.065 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.127+0000 7f1efd400700 1 --2- 172.21.15.72:0/3657289851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef8080210 0x7f1ef810ecb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ee80098a0 tx=0x7f1ee8009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:39.065 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.127+0000 7f1efd400700 1 -- 172.21.15.72:0/3657289851 shutdown_connections 2024-03-19T05:52:39.065 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.127+0000 7f1efd400700 1 --2- 172.21.15.72:0/3657289851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef8080210 0x7f1ef810ecb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:39.066 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.127+0000 7f1efd400700 1 -- 172.21.15.72:0/3657289851 >> 172.21.15.72:0/3657289851 conn(0x7f1ef807b200 msgr2=0x7f1ef807d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:39.066 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.128+0000 7f1efd400700 1 -- 172.21.15.72:0/3657289851 shutdown_connections 2024-03-19T05:52:39.066 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.128+0000 7f1efd400700 1 -- 172.21.15.72:0/3657289851 wait complete. 2024-03-19T05:52:39.066 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.129+0000 7f1efd400700 1 Processor -- start 2024-03-19T05:52:39.066 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.129+0000 7f1efd400700 1 -- start start 2024-03-19T05:52:39.066 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.129+0000 7f1efd400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef819ff80 0x7f1ef81a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:39.066 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.129+0000 7f1efd400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef81a08d0 con 0x7f1ef819ff80 2024-03-19T05:52:39.066 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.130+0000 7f1ef6800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef819ff80 0x7f1ef81a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:39.066 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.130+0000 7f1ef6800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef819ff80 0x7f1ef81a0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48338/0 (socket says 172.21.15.72:48338) 2024-03-19T05:52:39.066 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.130+0000 7f1ef6800700 1 -- 172.21.15.72:0/4061751079 learned_addr learned my addr 172.21.15.72:0/4061751079 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:39.066 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.130+0000 7f1ef6800700 1 -- 172.21.15.72:0/4061751079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee8009550 con 0x7f1ef819ff80 2024-03-19T05:52:39.066 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.130+0000 7f1ef6800700 1 --2- 172.21.15.72:0/4061751079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef819ff80 0x7f1ef81a0390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8011670 tx=0x7f1ee8011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.130+0000 7f1eef400700 1 -- 172.21.15.72:0/4061751079 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ee80038b0 con 0x7f1ef819ff80 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.130+0000 7f1eef400700 1 -- 172.21.15.72:0/4061751079 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1ee8003a10 con 0x7f1ef819ff80 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.131+0000 7f1eef400700 1 -- 172.21.15.72:0/4061751079 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ee801b5b0 con 0x7f1ef819ff80 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.131+0000 7f1efd400700 1 -- 172.21.15.72:0/4061751079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef81a0ad0 con 0x7f1ef819ff80 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.131+0000 7f1efd400700 1 -- 172.21.15.72:0/4061751079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef81a3730 con 0x7f1ef819ff80 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.132+0000 7f1eef400700 1 -- 172.21.15.72:0/4061751079 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f1ee801a440 con 0x7f1ef819ff80 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.132+0000 7f1efd400700 1 -- 172.21.15.72:0/4061751079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef8199e60 con 0x7f1ef819ff80 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.132+0000 7f1eef400700 1 --2- 172.21.15.72:0/4061751079 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1edc038400 0x7f1edc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.132+0000 7f1eef400700 1 -- 172.21.15.72:0/4061751079 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1ee8021030 con 0x7f1ef819ff80 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.133+0000 7f1ef5e00700 1 --2- 172.21.15.72:0/4061751079 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1edc038400 0x7f1edc03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.133+0000 7f1ef5e00700 1 --2- 172.21.15.72:0/4061751079 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1edc038400 0x7f1edc03a8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4006fd0 tx=0x7f1ee4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.137+0000 7f1eef400700 1 -- 172.21.15.72:0/4061751079 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1ee800bbd0 con 0x7f1ef819ff80 2024-03-19T05:52:39.067 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.351+0000 7f1efd400700 1 -- 172.21.15.72:0/4061751079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f1ef802cc30 con 0x7f1ef819ff80 2024-03-19T05:52:39.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.356+0000 7f1eef400700 1 -- 172.21.15.72:0/4061751079 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f1ee800bbd0 con 0x7f1ef819ff80 2024-03-19T05:52:39.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.359+0000 7f1efd400700 1 -- 172.21.15.72:0/4061751079 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1edc038400 msgr2=0x7f1edc03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:39.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.359+0000 7f1efd400700 1 --2- 172.21.15.72:0/4061751079 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1edc038400 0x7f1edc03a8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4006fd0 tx=0x7f1ee4006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:39.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.359+0000 7f1efd400700 1 -- 172.21.15.72:0/4061751079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef819ff80 msgr2=0x7f1ef81a0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:39.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.359+0000 7f1efd400700 1 --2- 172.21.15.72:0/4061751079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef819ff80 0x7f1ef81a0390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8011670 tx=0x7f1ee8011870 comp rx=0 tx=0).stop 2024-03-19T05:52:39.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.359+0000 7f1efd400700 1 -- 172.21.15.72:0/4061751079 shutdown_connections 2024-03-19T05:52:39.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.359+0000 7f1efd400700 1 --2- 172.21.15.72:0/4061751079 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1edc038400 0x7f1edc03a8b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:39.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.359+0000 7f1efd400700 1 --2- 172.21.15.72:0/4061751079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef819ff80 0x7f1ef81a0390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:39.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.359+0000 7f1efd400700 1 -- 172.21.15.72:0/4061751079 >> 172.21.15.72:0/4061751079 conn(0x7f1ef807b200 msgr2=0x7f1ef807da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:39.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.359+0000 7f1efd400700 1 -- 172.21.15.72:0/4061751079 shutdown_connections 2024-03-19T05:52:39.068 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:38.360+0000 7f1efd400700 1 -- 172.21.15.72:0/4061751079 wait complete. 2024-03-19T05:52:39.641 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:39 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/4061751079' entity='client.admin' 2024-03-19T05:52:39.641 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:39 smithi072 ceph-mon[28706]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:52:40.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.711+0000 7f5f89e00700 1 Processor -- start 2024-03-19T05:52:40.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.711+0000 7f5f89e00700 1 -- start start 2024-03-19T05:52:40.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.712+0000 7f5f89e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 0x7f5f8407a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:40.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.712+0000 7f5f89e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8407a7d0 con 0x7f5f8407bd90 2024-03-19T05:52:40.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.712+0000 7f5f82a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 0x7f5f8407a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:40.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.712+0000 7f5f82a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 0x7f5f8407a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48340/0 (socket says 172.21.15.72:48340) 2024-03-19T05:52:40.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.712+0000 7f5f82a00700 1 -- 172.21.15.72:0/4199877080 learned_addr learned my addr 172.21.15.72:0/4199877080 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:40.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.713+0000 7f5f82a00700 1 -- 172.21.15.72:0/4199877080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8407a910 con 0x7f5f8407bd90 2024-03-19T05:52:40.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.713+0000 7f5f82a00700 1 --2- 172.21.15.72:0/4199877080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 0x7f5f8407a290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f740098a0 tx=0x7f5f74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f16c792c4ef497 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:40.659 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.713+0000 7f5f81600700 1 -- 172.21.15.72:0/4199877080 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f74004180 con 0x7f5f8407bd90 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.713+0000 7f5f81600700 1 -- 172.21.15.72:0/4199877080 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f740042e0 con 0x7f5f8407bd90 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.713+0000 7f5f81600700 1 -- 172.21.15.72:0/4199877080 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f74011af0 con 0x7f5f8407bd90 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.714+0000 7f5f89e00700 1 -- 172.21.15.72:0/4199877080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 msgr2=0x7f5f8407a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.714+0000 7f5f89e00700 1 --2- 172.21.15.72:0/4199877080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 0x7f5f8407a290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f740098a0 tx=0x7f5f74009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.714+0000 7f5f89e00700 1 -- 172.21.15.72:0/4199877080 shutdown_connections 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.714+0000 7f5f89e00700 1 --2- 172.21.15.72:0/4199877080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 0x7f5f8407a290 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.714+0000 7f5f89e00700 1 -- 172.21.15.72:0/4199877080 >> 172.21.15.72:0/4199877080 conn(0x7f5f84101020 msgr2=0x7f5f84103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.714+0000 7f5f89e00700 1 -- 172.21.15.72:0/4199877080 shutdown_connections 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.714+0000 7f5f89e00700 1 -- 172.21.15.72:0/4199877080 wait complete. 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.715+0000 7f5f89e00700 1 Processor -- start 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.716+0000 7f5f89e00700 1 -- start start 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.716+0000 7f5f89e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 0x7f5f8419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:40.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.716+0000 7f5f89e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8419be50 con 0x7f5f8407bd90 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.716+0000 7f5f82a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 0x7f5f8419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.716+0000 7f5f82a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 0x7f5f8419b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48356/0 (socket says 172.21.15.72:48356) 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.716+0000 7f5f82a00700 1 -- 172.21.15.72:0/258020426 learned_addr learned my addr 172.21.15.72:0/258020426 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.717+0000 7f5f82a00700 1 -- 172.21.15.72:0/258020426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74009550 con 0x7f5f8407bd90 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.717+0000 7f5f82a00700 1 --2- 172.21.15.72:0/258020426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 0x7f5f8419b910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5f74011670 tx=0x7f5f74011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.717+0000 7f5f88a00700 1 -- 172.21.15.72:0/258020426 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f740039f0 con 0x7f5f8407bd90 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.717+0000 7f5f88a00700 1 -- 172.21.15.72:0/258020426 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f74003b50 con 0x7f5f8407bd90 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.717+0000 7f5f89e00700 1 -- 172.21.15.72:0/258020426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8419c050 con 0x7f5f8407bd90 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.717+0000 7f5f88a00700 1 -- 172.21.15.72:0/258020426 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5f740247c0 con 0x7f5f8407bd90 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.718+0000 7f5f89e00700 1 -- 172.21.15.72:0/258020426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8419c4f0 con 0x7f5f8407bd90 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.719+0000 7f5f88a00700 1 -- 172.21.15.72:0/258020426 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f5f7401ac00 con 0x7f5f8407bd90 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.719+0000 7f5f89e00700 1 -- 172.21.15.72:0/258020426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8410bcc0 con 0x7f5f8407bd90 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.719+0000 7f5f88a00700 1 --2- 172.21.15.72:0/258020426 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f5f68038440 0x7f5f6803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.719+0000 7f5f88a00700 1 -- 172.21.15.72:0/258020426 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5f7404c470 con 0x7f5f8407bd90 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.720+0000 7f5f82000700 1 --2- 172.21.15.72:0/258020426 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f5f68038440 0x7f5f6803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.720+0000 7f5f82000700 1 --2- 172.21.15.72:0/258020426 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f5f68038440 0x7f5f6803a8f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5f70006fd0 tx=0x7f5f70006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.724+0000 7f5f88a00700 1 -- 172.21.15.72:0/258020426 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5f7401a430 con 0x7f5f8407bd90 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.938+0000 7f5f89e00700 1 -- 172.21.15.72:0/258020426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f5f8419f2d0 con 0x7f5f8407bd90 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.945+0000 7f5f88a00700 1 -- 172.21.15.72:0/258020426 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f5f74018b40 con 0x7f5f8407bd90 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.948+0000 7f5f89e00700 1 -- 172.21.15.72:0/258020426 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f5f68038440 msgr2=0x7f5f6803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.948+0000 7f5f89e00700 1 --2- 172.21.15.72:0/258020426 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f5f68038440 0x7f5f6803a8f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5f70006fd0 tx=0x7f5f70006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.948+0000 7f5f89e00700 1 -- 172.21.15.72:0/258020426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 msgr2=0x7f5f8419b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.948+0000 7f5f89e00700 1 --2- 172.21.15.72:0/258020426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 0x7f5f8419b910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5f74011670 tx=0x7f5f74011b50 comp rx=0 tx=0).stop 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.948+0000 7f5f89e00700 1 -- 172.21.15.72:0/258020426 shutdown_connections 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.948+0000 7f5f89e00700 1 --2- 172.21.15.72:0/258020426 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f5f68038440 0x7f5f6803a8f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.948+0000 7f5f89e00700 1 --2- 172.21.15.72:0/258020426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8407bd90 0x7f5f8419b910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:40.662 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.948+0000 7f5f89e00700 1 -- 172.21.15.72:0/258020426 >> 172.21.15.72:0/258020426 conn(0x7f5f84101020 msgr2=0x7f5f841026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:40.663 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.949+0000 7f5f89e00700 1 -- 172.21.15.72:0/258020426 shutdown_connections 2024-03-19T05:52:40.663 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:39.949+0000 7f5f89e00700 1 -- 172.21.15.72:0/258020426 wait complete. 2024-03-19T05:52:40.663 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling the dashboard module... 2024-03-19T05:52:41.202 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:40 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/258020426' entity='client.admin' 2024-03-19T05:52:42.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:41 smithi072 ceph-mon[28706]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:52:42.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:41 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3647029' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-19T05:52:42.715 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.238+0000 7fdd1cc00700 1 Processor -- start 2024-03-19T05:52:42.715 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.238+0000 7fdd1cc00700 1 -- start start 2024-03-19T05:52:42.715 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.239+0000 7fdd1cc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 0x7fdd18105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:42.715 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.239+0000 7fdd1cc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18106310 con 0x7fdd181059c0 2024-03-19T05:52:42.715 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.239+0000 7fdd15e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 0x7fdd18105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:42.715 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.239+0000 7fdd15e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 0x7fdd18105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48368/0 (socket says 172.21.15.72:48368) 2024-03-19T05:52:42.715 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.239+0000 7fdd15e00700 1 -- 172.21.15.72:0/3614698596 learned_addr learned my addr 172.21.15.72:0/3614698596 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:42.715 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.240+0000 7fdd15e00700 1 -- 172.21.15.72:0/3614698596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18106450 con 0x7fdd181059c0 2024-03-19T05:52:42.715 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.240+0000 7fdd15e00700 1 --2- 172.21.15.72:0/3614698596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 0x7fdd18105dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd080098a0 tx=0x7fdd08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb44e5cf0399329 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:42.715 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.240+0000 7fdd14a00700 1 -- 172.21.15.72:0/3614698596 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd08004180 con 0x7fdd181059c0 2024-03-19T05:52:42.715 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.240+0000 7fdd14a00700 1 -- 172.21.15.72:0/3614698596 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdd080042e0 con 0x7fdd181059c0 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.240+0000 7fdd14a00700 1 -- 172.21.15.72:0/3614698596 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd08011af0 con 0x7fdd181059c0 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.241+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3614698596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 msgr2=0x7fdd18105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.241+0000 7fdd1cc00700 1 --2- 172.21.15.72:0/3614698596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 0x7fdd18105dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd080098a0 tx=0x7fdd08009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.241+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3614698596 shutdown_connections 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.241+0000 7fdd1cc00700 1 --2- 172.21.15.72:0/3614698596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 0x7fdd18105dd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.241+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3614698596 >> 172.21.15.72:0/3614698596 conn(0x7fdd18100fd0 msgr2=0x7fdd18103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.241+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3614698596 shutdown_connections 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.241+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3614698596 wait complete. 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.242+0000 7fdd1cc00700 1 Processor -- start 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.242+0000 7fdd1cc00700 1 -- start start 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.243+0000 7fdd1cc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 0x7fdd1819b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.243+0000 7fdd1cc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1819beb0 con 0x7fdd181059c0 2024-03-19T05:52:42.716 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.243+0000 7fdd15e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 0x7fdd1819b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.243+0000 7fdd15e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 0x7fdd1819b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48376/0 (socket says 172.21.15.72:48376) 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.243+0000 7fdd15e00700 1 -- 172.21.15.72:0/3647029 learned_addr learned my addr 172.21.15.72:0/3647029 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.243+0000 7fdd15e00700 1 -- 172.21.15.72:0/3647029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd08009550 con 0x7fdd181059c0 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.244+0000 7fdd15e00700 1 --2- 172.21.15.72:0/3647029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 0x7fdd1819b970 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd08011670 tx=0x7fdd08011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.244+0000 7fdd0ea00700 1 -- 172.21.15.72:0/3647029 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd08003a40 con 0x7fdd181059c0 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.244+0000 7fdd0ea00700 1 -- 172.21.15.72:0/3647029 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdd08003ba0 con 0x7fdd181059c0 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.244+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3647029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1819c0b0 con 0x7fdd181059c0 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.244+0000 7fdd0ea00700 1 -- 172.21.15.72:0/3647029 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd08024820 con 0x7fdd181059c0 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.244+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3647029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1819c550 con 0x7fdd181059c0 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.245+0000 7fdd0ea00700 1 -- 172.21.15.72:0/3647029 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fdd0801ac70 con 0x7fdd181059c0 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.245+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3647029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd18062380 con 0x7fdd181059c0 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.245+0000 7fdd0ea00700 1 --2- 172.21.15.72:0/3647029 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fdcfc0383b0 0x7fdcfc03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.246+0000 7fdd0ea00700 1 -- 172.21.15.72:0/3647029 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdd0804c420 con 0x7fdd181059c0 2024-03-19T05:52:42.717 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.246+0000 7fdd15400700 1 --2- 172.21.15.72:0/3647029 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fdcfc0383b0 0x7fdcfc03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.247+0000 7fdd15400700 1 --2- 172.21.15.72:0/3647029 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fdcfc0383b0 0x7fdcfc03a860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdd04006fd0 tx=0x7fdd04006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.251+0000 7fdd0ea00700 1 -- 172.21.15.72:0/3647029 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdd0802cb40 con 0x7fdd181059c0 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.522+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3647029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fdd18107870 con 0x7fdd181059c0 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.957+0000 7fdd0ea00700 1 -- 172.21.15.72:0/3647029 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fdd0801a430 con 0x7fdd181059c0 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.961+0000 7fdd0ea00700 1 -- 172.21.15.72:0/3647029 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fdd0804bd70 con 0x7fdd181059c0 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.964+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3647029 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fdcfc0383b0 msgr2=0x7fdcfc03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.964+0000 7fdd1cc00700 1 --2- 172.21.15.72:0/3647029 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fdcfc0383b0 0x7fdcfc03a860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdd04006fd0 tx=0x7fdd04006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.964+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3647029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 msgr2=0x7fdd1819b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.964+0000 7fdd1cc00700 1 --2- 172.21.15.72:0/3647029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 0x7fdd1819b970 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd08011670 tx=0x7fdd08011aa0 comp rx=0 tx=0).stop 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.964+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3647029 shutdown_connections 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.964+0000 7fdd1cc00700 1 --2- 172.21.15.72:0/3647029 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7fdcfc0383b0 0x7fdcfc03a860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.964+0000 7fdd1cc00700 1 --2- 172.21.15.72:0/3647029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd181059c0 0x7fdd1819b970 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:42.718 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.964+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3647029 >> 172.21.15.72:0/3647029 conn(0x7fdd18100fd0 msgr2=0x7fdd181026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:42.719 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.964+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3647029 shutdown_connections 2024-03-19T05:52:42.719 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:41.964+0000 7fdd1cc00700 1 -- 172.21.15.72:0/3647029 wait complete. 2024-03-19T05:52:43.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:42 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3647029' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-19T05:52:43.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:42 smithi072 ceph-mon[28706]: mgrmap e9: smithi072.jydpjk(active, since 33s) 2024-03-19T05:52:44.211 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:43 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1126565219' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-19T05:52:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-19T05:52:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-19T05:52:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-19T05:52:44.409 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "active_name": "smithi072.jydpjk", 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.369+0000 7ff98c600700 1 Processor -- start 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.369+0000 7ff98c600700 1 -- start start 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.370+0000 7ff98c600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 0x7ff9840791e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.370+0000 7ff98c600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff984079720 con 0x7ff98407ace0 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.370+0000 7ff989c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 0x7ff9840791e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.370+0000 7ff989c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 0x7ff9840791e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48398/0 (socket says 172.21.15.72:48398) 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.370+0000 7ff989c00700 1 -- 172.21.15.72:0/1375879570 learned_addr learned my addr 172.21.15.72:0/1375879570 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.371+0000 7ff989c00700 1 -- 172.21.15.72:0/1375879570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff984079860 con 0x7ff98407ace0 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.371+0000 7ff989c00700 1 --2- 172.21.15.72:0/1375879570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 0x7ff9840791e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff9780098a0 tx=0x7ff978009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e741abc173e3ed2 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.371+0000 7ff983e00700 1 -- 172.21.15.72:0/1375879570 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff978004180 con 0x7ff98407ace0 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.371+0000 7ff983e00700 1 -- 172.21.15.72:0/1375879570 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff9780042e0 con 0x7ff98407ace0 2024-03-19T05:52:44.410 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.371+0000 7ff983e00700 1 -- 172.21.15.72:0/1375879570 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff978011af0 con 0x7ff98407ace0 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.372+0000 7ff98c600700 1 -- 172.21.15.72:0/1375879570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 msgr2=0x7ff9840791e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.372+0000 7ff98c600700 1 --2- 172.21.15.72:0/1375879570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 0x7ff9840791e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff9780098a0 tx=0x7ff978009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.372+0000 7ff98c600700 1 -- 172.21.15.72:0/1375879570 shutdown_connections 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.372+0000 7ff98c600700 1 --2- 172.21.15.72:0/1375879570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 0x7ff9840791e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.372+0000 7ff98c600700 1 -- 172.21.15.72:0/1375879570 >> 172.21.15.72:0/1375879570 conn(0x7ff984100fd0 msgr2=0x7ff984103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.372+0000 7ff98c600700 1 -- 172.21.15.72:0/1375879570 shutdown_connections 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.372+0000 7ff98c600700 1 -- 172.21.15.72:0/1375879570 wait complete. 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.373+0000 7ff98c600700 1 Processor -- start 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.373+0000 7ff98c600700 1 -- start start 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.374+0000 7ff98c600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 0x7ff98419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.374+0000 7ff98c600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98419bee0 con 0x7ff98407ace0 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.374+0000 7ff989c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 0x7ff98419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:44.411 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.374+0000 7ff989c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 0x7ff98419b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48412/0 (socket says 172.21.15.72:48412) 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.374+0000 7ff989c00700 1 -- 172.21.15.72:0/1126565219 learned_addr learned my addr 172.21.15.72:0/1126565219 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.374+0000 7ff989c00700 1 -- 172.21.15.72:0/1126565219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff978009550 con 0x7ff98407ace0 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.374+0000 7ff989c00700 1 --2- 172.21.15.72:0/1126565219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 0x7ff98419b9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff978011670 tx=0x7ff978011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.375+0000 7ff982000700 1 -- 172.21.15.72:0/1126565219 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9780039c0 con 0x7ff98407ace0 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.375+0000 7ff98c600700 1 -- 172.21.15.72:0/1126565219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98419c0e0 con 0x7ff98407ace0 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.375+0000 7ff982000700 1 -- 172.21.15.72:0/1126565219 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff978003b20 con 0x7ff98407ace0 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.375+0000 7ff982000700 1 -- 172.21.15.72:0/1126565219 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9780247f0 con 0x7ff98407ace0 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.375+0000 7ff98c600700 1 -- 172.21.15.72:0/1126565219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98419c580 con 0x7ff98407ace0 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.376+0000 7ff98c600700 1 -- 172.21.15.72:0/1126565219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98410bcd0 con 0x7ff98407ace0 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.376+0000 7ff982000700 1 -- 172.21.15.72:0/1126565219 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7ff97801ac70 con 0x7ff98407ace0 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.377+0000 7ff982000700 1 --2- 172.21.15.72:0/1126565219 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff96c038450 0x7ff96c03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.377+0000 7ff982000700 1 -- 172.21.15.72:0/1126565219 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff97804c3c0 con 0x7ff98407ace0 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.377+0000 7ff989200700 1 -- 172.21.15.72:0/1126565219 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff96c038450 msgr2=0x7ff96c03a900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2294511988 2024-03-19T05:52:44.412 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.377+0000 7ff989200700 1 --2- 172.21.15.72:0/1126565219 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff96c038450 0x7ff96c03a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.381+0000 7ff982000700 1 -- 172.21.15.72:0/1126565219 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff978018760 con 0x7ff98407ace0 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.578+0000 7ff989200700 1 -- 172.21.15.72:0/1126565219 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff96c038450 msgr2=0x7ff96c03a900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2294511988 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.578+0000 7ff989200700 1 --2- 172.21.15.72:0/1126565219 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff96c038450 0x7ff96c03a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.647+0000 7ff98c600700 1 -- 172.21.15.72:0/1126565219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff98419f360 con 0x7ff98407ace0 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.648+0000 7ff982000700 1 -- 172.21.15.72:0/1126565219 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7ff97802c350 con 0x7ff98407ace0 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.652+0000 7ff98c600700 1 -- 172.21.15.72:0/1126565219 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff96c038450 msgr2=0x7ff96c03a900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.652+0000 7ff98c600700 1 --2- 172.21.15.72:0/1126565219 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff96c038450 0x7ff96c03a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.652+0000 7ff98c600700 1 -- 172.21.15.72:0/1126565219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 msgr2=0x7ff98419b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.652+0000 7ff98c600700 1 --2- 172.21.15.72:0/1126565219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 0x7ff98419b9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff978011670 tx=0x7ff978011aa0 comp rx=0 tx=0).stop 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.652+0000 7ff98c600700 1 -- 172.21.15.72:0/1126565219 shutdown_connections 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.652+0000 7ff98c600700 1 --2- 172.21.15.72:0/1126565219 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7ff96c038450 0x7ff96c03a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.652+0000 7ff98c600700 1 --2- 172.21.15.72:0/1126565219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff98407ace0 0x7ff98419b9a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.652+0000 7ff98c600700 1 -- 172.21.15.72:0/1126565219 >> 172.21.15.72:0/1126565219 conn(0x7ff984100fd0 msgr2=0x7ff9841026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.652+0000 7ff98c600700 1 -- 172.21.15.72:0/1126565219 shutdown_connections 2024-03-19T05:52:44.413 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:43.652+0000 7ff98c600700 1 -- 172.21.15.72:0/1126565219 wait complete. 2024-03-19T05:52:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for the mgr to restart... 2024-03-19T05:52:44.414 INFO:teuthology.orchestra.run.smithi072.stdout:Waiting for mgr epoch 9... 2024-03-19T05:52:51.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:50 smithi072 ceph-mon[28706]: Active manager daemon smithi072.jydpjk restarted 2024-03-19T05:52:51.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:50 smithi072 ceph-mon[28706]: Activating manager daemon smithi072.jydpjk 2024-03-19T05:52:51.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:50 smithi072 ceph-mon[28706]: osdmap e3: 0 total, 0 up, 0 in 2024-03-19T05:52:51.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:50 smithi072 ceph-mon[28706]: mgrmap e10: smithi072.jydpjk(active, starting, since 0.00873536s) 2024-03-19T05:52:51.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:50 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T05:52:51.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:50 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi072.jydpjk", "id": "smithi072.jydpjk"}]: dispatch 2024-03-19T05:52:51.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:50 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-19T05:52:51.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:50 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-19T05:52:51.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:50 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-19T05:52:51.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:50 smithi072 ceph-mon[28706]: Manager daemon smithi072.jydpjk is now available 2024-03-19T05:52:51.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:50 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:52:51.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:50 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:52:52.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:51 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/mirror_snapshot_schedule"}]: dispatch 2024-03-19T05:52:52.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:51 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/trash_purge_schedule"}]: dispatch 2024-03-19T05:52:52.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:51 smithi072 ceph-mon[28706]: mgrmap e11: smithi072.jydpjk(active, since 1.01066s) 2024-03-19T05:52:53.023 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:52 smithi072 ceph-mon[28706]: [19/Mar/2024:05:52:51] ENGINE Bus STARTING 2024-03-19T05:52:53.024 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:52 smithi072 ceph-mon[28706]: [19/Mar/2024:05:52:51] ENGINE Serving on http://172.21.15.72:8765 2024-03-19T05:52:53.024 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:52 smithi072 ceph-mon[28706]: [19/Mar/2024:05:52:51] ENGINE Serving on https://172.21.15.72:7150 2024-03-19T05:52:53.024 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:52 smithi072 ceph-mon[28706]: [19/Mar/2024:05:52:51] ENGINE Bus STARTED 2024-03-19T05:52:53.024 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:52 smithi072 ceph-mon[28706]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-19T05:52:53.024 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:52 smithi072 ceph-mon[28706]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-19T05:52:53.033 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout { 2024-03-19T05:52:53.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-19T05:52:53.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-19T05:52:53.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout } 2024-03-19T05:52:53.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.044+0000 7f1d1cc00700 1 Processor -- start 2024-03-19T05:52:53.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.044+0000 7f1d1cc00700 1 -- start start 2024-03-19T05:52:53.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.044+0000 7f1d1cc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 0x7f1d18105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:53.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.044+0000 7f1d1cc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18106310 con 0x7f1d181059c0 2024-03-19T05:52:53.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.045+0000 7f1d15e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 0x7f1d18105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:53.042 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.045+0000 7f1d15e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 0x7f1d18105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50784/0 (socket says 172.21.15.72:50784) 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.045+0000 7f1d15e00700 1 -- 172.21.15.72:0/1428116520 learned_addr learned my addr 172.21.15.72:0/1428116520 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.045+0000 7f1d15e00700 1 -- 172.21.15.72:0/1428116520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d18106450 con 0x7f1d181059c0 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.046+0000 7f1d15e00700 1 --2- 172.21.15.72:0/1428116520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 0x7f1d18105dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d080098a0 tx=0x7f1d08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707ad1625ca7a998 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.046+0000 7f1d14a00700 1 -- 172.21.15.72:0/1428116520 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d08004180 con 0x7f1d181059c0 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.046+0000 7f1d14a00700 1 -- 172.21.15.72:0/1428116520 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d080042e0 con 0x7f1d181059c0 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.046+0000 7f1d14a00700 1 -- 172.21.15.72:0/1428116520 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d08011af0 con 0x7f1d181059c0 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.047+0000 7f1d1cc00700 1 -- 172.21.15.72:0/1428116520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 msgr2=0x7f1d18105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.047+0000 7f1d1cc00700 1 --2- 172.21.15.72:0/1428116520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 0x7f1d18105dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d080098a0 tx=0x7f1d08009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.047+0000 7f1d1cc00700 1 -- 172.21.15.72:0/1428116520 shutdown_connections 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.047+0000 7f1d1cc00700 1 --2- 172.21.15.72:0/1428116520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 0x7f1d18105dd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.047+0000 7f1d1cc00700 1 -- 172.21.15.72:0/1428116520 >> 172.21.15.72:0/1428116520 conn(0x7f1d18100fd0 msgr2=0x7f1d18103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.047+0000 7f1d1cc00700 1 -- 172.21.15.72:0/1428116520 shutdown_connections 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.047+0000 7f1d1cc00700 1 -- 172.21.15.72:0/1428116520 wait complete. 2024-03-19T05:52:53.043 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.048+0000 7f1d1cc00700 1 Processor -- start 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.048+0000 7f1d1cc00700 1 -- start start 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.048+0000 7f1d1cc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 0x7f1d1819b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.048+0000 7f1d1cc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1819be80 con 0x7f1d181059c0 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.048+0000 7f1d15e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 0x7f1d1819b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.048+0000 7f1d15e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 0x7f1d1819b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50796/0 (socket says 172.21.15.72:50796) 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.048+0000 7f1d15e00700 1 -- 172.21.15.72:0/2864120957 learned_addr learned my addr 172.21.15.72:0/2864120957 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.049+0000 7f1d15e00700 1 -- 172.21.15.72:0/2864120957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d08009550 con 0x7f1d181059c0 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.049+0000 7f1d15e00700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 0x7f1d1819b940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d08011670 tx=0x7f1d08011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.049+0000 7f1d0ea00700 1 -- 172.21.15.72:0/2864120957 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d08003a40 con 0x7f1d181059c0 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.049+0000 7f1d0ea00700 1 -- 172.21.15.72:0/2864120957 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d08003ba0 con 0x7f1d181059c0 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.049+0000 7f1d1cc00700 1 -- 172.21.15.72:0/2864120957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1819c080 con 0x7f1d181059c0 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.049+0000 7f1d1cc00700 1 -- 172.21.15.72:0/2864120957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1819c520 con 0x7f1d181059c0 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.050+0000 7f1d0ea00700 1 -- 172.21.15.72:0/2864120957 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d08024790 con 0x7f1d181059c0 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.051+0000 7f1d0ea00700 1 -- 172.21.15.72:0/2864120957 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f1d0802d3f0 con 0x7f1d181059c0 2024-03-19T05:52:53.044 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.051+0000 7f1d0ea00700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 0x7f1cfc03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.051+0000 7f1d0ea00700 1 -- 172.21.15.72:0/2864120957 --> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1cfc03b000 con 0x7f1cfc038440 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.051+0000 7f1d0ea00700 1 -- 172.21.15.72:0/2864120957 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1d0804c830 con 0x7f1d181059c0 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.051+0000 7f1d15400700 1 -- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 msgr2=0x7f1cfc03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2294511988 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.051+0000 7f1d15400700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 0x7f1cfc03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.252+0000 7f1d15400700 1 -- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 msgr2=0x7f1cfc03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2294511988 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.252+0000 7f1d15400700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 0x7f1cfc03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.653+0000 7f1d15400700 1 -- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 msgr2=0x7f1cfc03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2294511988 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:45.653+0000 7f1d15400700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 0x7f1cfc03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:46.454+0000 7f1d15400700 1 -- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 msgr2=0x7f1cfc03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2294511988 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:46.454+0000 7f1d15400700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 0x7f1cfc03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:48.056+0000 7f1d15400700 1 -- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 msgr2=0x7f1cfc03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2294511988 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:48.056+0000 7f1d15400700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 0x7f1cfc03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-19T05:52:53.045 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:50.600+0000 7f1d0ea00700 1 -- 172.21.15.72:0/2864120957 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mgrmap(e 10) v1 ==== 44864+0+0 (secure 0 0 0) 0x7f1d08019460 con 0x7f1d181059c0 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:50.600+0000 7f1d0ea00700 1 -- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 msgr2=0x7f1cfc03a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:50.600+0000 7f1d0ea00700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 0x7f1cfc03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.603+0000 7f1d0ea00700 1 -- 172.21.15.72:0/2864120957 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7f1d0804c100 con 0x7f1d181059c0 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.604+0000 7f1d0ea00700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1cfc03bea0 0x7f1cfc03e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.604+0000 7f1d0ea00700 1 -- 172.21.15.72:0/2864120957 --> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1cfc03b000 con 0x7f1cfc03bea0 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.605+0000 7f1d15400700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1cfc03bea0 0x7f1cfc03e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.606+0000 7f1d15400700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1cfc03bea0 0x7f1cfc03e280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1d04003a10 tx=0x7f1d040092b0 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.607+0000 7f1d0ea00700 1 -- 172.21.15.72:0/2864120957 <== mgr.14164 v2:172.21.15.72:6800/1922058375 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f1cfc03b000 con 0x7f1cfc03bea0 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.615+0000 7f1d1cc00700 1 -- 172.21.15.72:0/2864120957 --> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f1cf8002630 con 0x7f1cfc03bea0 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.615+0000 7f1d0ea00700 1 -- 172.21.15.72:0/2864120957 <== mgr.14164 v2:172.21.15.72:6800/1922058375 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f1cf8002630 con 0x7f1cfc03bea0 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.616+0000 7f1d1cc00700 1 -- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1cfc03bea0 msgr2=0x7f1cfc03e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.616+0000 7f1d1cc00700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1cfc03bea0 0x7f1cfc03e280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1d04003a10 tx=0x7f1d040092b0 comp rx=0 tx=0).stop 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.616+0000 7f1d1cc00700 1 -- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 msgr2=0x7f1d1819b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:53.046 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.616+0000 7f1d1cc00700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 0x7f1d1819b940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d08011670 tx=0x7f1d08011b50 comp rx=0 tx=0).stop 2024-03-19T05:52:53.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.616+0000 7f1d1cc00700 1 -- 172.21.15.72:0/2864120957 shutdown_connections 2024-03-19T05:52:53.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.616+0000 7f1d1cc00700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1cfc03bea0 0x7f1cfc03e280 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:53.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.616+0000 7f1d1cc00700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d181059c0 0x7f1d1819b940 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:53.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.616+0000 7f1d1cc00700 1 --2- 172.21.15.72:0/2864120957 >> [v2:172.21.15.72:6800/2294511988,v1:172.21.15.72:6801/2294511988] conn(0x7f1cfc038440 0x7f1cfc03a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:53.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.616+0000 7f1d1cc00700 1 -- 172.21.15.72:0/2864120957 >> 172.21.15.72:0/2864120957 conn(0x7f1d18100fd0 msgr2=0x7f1d181026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:53.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.616+0000 7f1d1cc00700 1 -- 172.21.15.72:0/2864120957 shutdown_connections 2024-03-19T05:52:53.047 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:51.616+0000 7f1d1cc00700 1 -- 172.21.15.72:0/2864120957 wait complete. 2024-03-19T05:52:53.047 INFO:teuthology.orchestra.run.smithi072.stdout:mgr epoch 9 is available 2024-03-19T05:52:53.047 INFO:teuthology.orchestra.run.smithi072.stdout:Generating a dashboard self-signed certificate... 2024-03-19T05:52:54.008 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:53 smithi072 ceph-mon[28706]: mgrmap e12: smithi072.jydpjk(active, since 2s) 2024-03-19T05:52:54.008 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:53 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:54.745 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-19T05:52:54.745 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.648+0000 7f1ac0a00700 1 Processor -- start 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.648+0000 7f1ac0a00700 1 -- start start 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.649+0000 7f1ac0a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 0x7f1abc079180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.649+0000 7f1ac0a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc0796c0 con 0x7f1abc07ac80 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.649+0000 7f1ab9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 0x7f1abc079180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.649+0000 7f1ab9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 0x7f1abc079180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50872/0 (socket says 172.21.15.72:50872) 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.649+0000 7f1ab9e00700 1 -- 172.21.15.72:0/4183443394 learned_addr learned my addr 172.21.15.72:0/4183443394 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.650+0000 7f1ab9e00700 1 -- 172.21.15.72:0/4183443394 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc079800 con 0x7f1abc07ac80 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.650+0000 7f1ab9e00700 1 --2- 172.21.15.72:0/4183443394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 0x7f1abc079180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0098a0 tx=0x7f1aac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9622fe84ce5e06fe server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.650+0000 7f1ab9400700 1 -- 172.21.15.72:0/4183443394 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1aac004180 con 0x7f1abc07ac80 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.650+0000 7f1ab9400700 1 -- 172.21.15.72:0/4183443394 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1aac0042e0 con 0x7f1abc07ac80 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.650+0000 7f1ab9400700 1 -- 172.21.15.72:0/4183443394 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1aac011af0 con 0x7f1abc07ac80 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.651+0000 7f1ac0a00700 1 -- 172.21.15.72:0/4183443394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 msgr2=0x7f1abc079180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:54.746 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.651+0000 7f1ac0a00700 1 --2- 172.21.15.72:0/4183443394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 0x7f1abc079180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0098a0 tx=0x7f1aac009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.651+0000 7f1ac0a00700 1 -- 172.21.15.72:0/4183443394 shutdown_connections 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.651+0000 7f1ac0a00700 1 --2- 172.21.15.72:0/4183443394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 0x7f1abc079180 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.651+0000 7f1ac0a00700 1 -- 172.21.15.72:0/4183443394 >> 172.21.15.72:0/4183443394 conn(0x7f1abc100fd0 msgr2=0x7f1abc103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.651+0000 7f1ac0a00700 1 -- 172.21.15.72:0/4183443394 shutdown_connections 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.651+0000 7f1ac0a00700 1 -- 172.21.15.72:0/4183443394 wait complete. 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.652+0000 7f1ac0a00700 1 Processor -- start 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.653+0000 7f1ac0a00700 1 -- start start 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.653+0000 7f1ac0a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 0x7f1abc19b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.653+0000 7f1ac0a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc19bed0 con 0x7f1abc07ac80 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.653+0000 7f1ab9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 0x7f1abc19b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.653+0000 7f1ab9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 0x7f1abc19b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50888/0 (socket says 172.21.15.72:50888) 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.653+0000 7f1ab9e00700 1 -- 172.21.15.72:0/684652329 learned_addr learned my addr 172.21.15.72:0/684652329 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.654+0000 7f1ab9e00700 1 -- 172.21.15.72:0/684652329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac009550 con 0x7f1abc07ac80 2024-03-19T05:52:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.654+0000 7f1ab9e00700 1 --2- 172.21.15.72:0/684652329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 0x7f1abc19b990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1aac011670 tx=0x7f1aac011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.654+0000 7f1ab2a00700 1 -- 172.21.15.72:0/684652329 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1aac0039c0 con 0x7f1abc07ac80 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.654+0000 7f1ab2a00700 1 -- 172.21.15.72:0/684652329 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1aac003b20 con 0x7f1abc07ac80 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.654+0000 7f1ab2a00700 1 -- 172.21.15.72:0/684652329 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1aac0247f0 con 0x7f1abc07ac80 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.654+0000 7f1ac0a00700 1 -- 172.21.15.72:0/684652329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1abc19c0d0 con 0x7f1abc07ac80 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.654+0000 7f1ac0a00700 1 -- 172.21.15.72:0/684652329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc19c570 con 0x7f1abc07ac80 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.656+0000 7f1ac0a00700 1 -- 172.21.15.72:0/684652329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1abc10bcd0 con 0x7f1abc07ac80 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.656+0000 7f1ab2a00700 1 -- 172.21.15.72:0/684652329 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f1aac01ac70 con 0x7f1abc07ac80 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.656+0000 7f1ab2a00700 1 --2- 172.21.15.72:0/684652329 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1aa0038450 0x7f1aa003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.656+0000 7f1ab2a00700 1 -- 172.21.15.72:0/684652329 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1aac04c3e0 con 0x7f1abc07ac80 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.657+0000 7f1ab3e00700 1 --2- 172.21.15.72:0/684652329 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1aa0038450 0x7f1aa003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.657+0000 7f1ab3e00700 1 --2- 172.21.15.72:0/684652329 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1aa0038450 0x7f1aa003a900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4006fd0 tx=0x7f1aa4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.662+0000 7f1ab2a00700 1 -- 172.21.15.72:0/684652329 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1aac018760 con 0x7f1abc07ac80 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:53.883+0000 7f1ac0a00700 1 -- 172.21.15.72:0/684652329 --> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f1abc103310 con 0x7f1aa0038450 2024-03-19T05:52:54.748 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:54.015+0000 7f1ab2a00700 1 -- 172.21.15.72:0/684652329 <== mgr.14164 v2:172.21.15.72:6800/1922058375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f1abc103310 con 0x7f1aa0038450 2024-03-19T05:52:54.749 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:54.018+0000 7f1ac0a00700 1 -- 172.21.15.72:0/684652329 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1aa0038450 msgr2=0x7f1aa003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:54.749 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:54.018+0000 7f1ac0a00700 1 --2- 172.21.15.72:0/684652329 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1aa0038450 0x7f1aa003a900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4006fd0 tx=0x7f1aa4006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:54.749 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:54.018+0000 7f1ac0a00700 1 -- 172.21.15.72:0/684652329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 msgr2=0x7f1abc19b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:54.749 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:54.018+0000 7f1ac0a00700 1 --2- 172.21.15.72:0/684652329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 0x7f1abc19b990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1aac011670 tx=0x7f1aac011aa0 comp rx=0 tx=0).stop 2024-03-19T05:52:54.749 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:54.019+0000 7f1ac0a00700 1 -- 172.21.15.72:0/684652329 shutdown_connections 2024-03-19T05:52:54.749 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:54.019+0000 7f1ac0a00700 1 --2- 172.21.15.72:0/684652329 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1aa0038450 0x7f1aa003a900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:54.749 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:54.019+0000 7f1ac0a00700 1 --2- 172.21.15.72:0/684652329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1abc07ac80 0x7f1abc19b990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:54.749 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:54.019+0000 7f1ac0a00700 1 -- 172.21.15.72:0/684652329 >> 172.21.15.72:0/684652329 conn(0x7f1abc100fd0 msgr2=0x7f1abc1026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:54.749 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:54.019+0000 7f1ac0a00700 1 -- 172.21.15.72:0/684652329 shutdown_connections 2024-03-19T05:52:54.749 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:54.019+0000 7f1ac0a00700 1 -- 172.21.15.72:0/684652329 wait complete. 2024-03-19T05:52:54.749 INFO:teuthology.orchestra.run.smithi072.stdout:Creating initial admin user... 2024-03-19T05:52:55.286 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:55 smithi072 ceph-mon[28706]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:55.286 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:55 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:55.286 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:55 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:55.286 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:55 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:57.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:56 smithi072 ceph-mon[28706]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:52:57.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:56 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:52:57.449 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$bnz4AZujwgXO8YdfXTOw1.9J.RFumjo0pC2ePZGLTPxPTqqm9ckKW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1710827575, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-19T05:52:57.449 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.372+0000 7f988b800700 1 Processor -- start 2024-03-19T05:52:57.449 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.372+0000 7f988b800700 1 -- start start 2024-03-19T05:52:57.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.372+0000 7f988b800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 0x7f98840791e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:57.450 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.372+0000 7f988b800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9884079720 con 0x7f988407ace0 2024-03-19T05:52:57.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.373+0000 7f9888e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 0x7f98840791e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:57.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.373+0000 7f9888e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 0x7f98840791e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36234/0 (socket says 172.21.15.72:36234) 2024-03-19T05:52:57.455 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.373+0000 7f9888e00700 1 -- 172.21.15.72:0/2992161050 learned_addr learned my addr 172.21.15.72:0/2992161050 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:57.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.373+0000 7f9888e00700 1 -- 172.21.15.72:0/2992161050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9884079860 con 0x7f988407ace0 2024-03-19T05:52:57.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.373+0000 7f9888e00700 1 --2- 172.21.15.72:0/2992161050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 0x7f98840791e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98780098a0 tx=0x7f9878009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633191eb8a015e91 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:57.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.374+0000 7f9883400700 1 -- 172.21.15.72:0/2992161050 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9878004180 con 0x7f988407ace0 2024-03-19T05:52:57.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.374+0000 7f9883400700 1 -- 172.21.15.72:0/2992161050 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f98780042e0 con 0x7f988407ace0 2024-03-19T05:52:57.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.374+0000 7f9883400700 1 -- 172.21.15.72:0/2992161050 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9878011af0 con 0x7f988407ace0 2024-03-19T05:52:57.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.375+0000 7f988b800700 1 -- 172.21.15.72:0/2992161050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 msgr2=0x7f98840791e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:57.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.375+0000 7f988b800700 1 --2- 172.21.15.72:0/2992161050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 0x7f98840791e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98780098a0 tx=0x7f9878009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:57.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.375+0000 7f988b800700 1 -- 172.21.15.72:0/2992161050 shutdown_connections 2024-03-19T05:52:57.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.375+0000 7f988b800700 1 --2- 172.21.15.72:0/2992161050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 0x7f98840791e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:57.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.375+0000 7f988b800700 1 -- 172.21.15.72:0/2992161050 >> 172.21.15.72:0/2992161050 conn(0x7f9884100fd0 msgr2=0x7f9884103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:57.456 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.375+0000 7f988b800700 1 -- 172.21.15.72:0/2992161050 shutdown_connections 2024-03-19T05:52:57.457 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.375+0000 7f988b800700 1 -- 172.21.15.72:0/2992161050 wait complete. 2024-03-19T05:52:57.457 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.376+0000 7f988b800700 1 Processor -- start 2024-03-19T05:52:57.457 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.376+0000 7f988b800700 1 -- start start 2024-03-19T05:52:57.457 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.377+0000 7f988b800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 0x7f988419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:57.457 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.377+0000 7f988b800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988419bf30 con 0x7f988407ace0 2024-03-19T05:52:57.457 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.377+0000 7f9888e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 0x7f988419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:57.457 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.377+0000 7f9888e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 0x7f988419b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36242/0 (socket says 172.21.15.72:36242) 2024-03-19T05:52:57.458 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.377+0000 7f9888e00700 1 -- 172.21.15.72:0/2528479593 learned_addr learned my addr 172.21.15.72:0/2528479593 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:57.458 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.377+0000 7f9888e00700 1 -- 172.21.15.72:0/2528479593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9878009550 con 0x7f988407ace0 2024-03-19T05:52:57.458 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.377+0000 7f9888e00700 1 --2- 172.21.15.72:0/2528479593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 0x7f988419b9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9878011670 tx=0x7f9878011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:57.458 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.378+0000 7f9881600700 1 -- 172.21.15.72:0/2528479593 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98780039f0 con 0x7f988407ace0 2024-03-19T05:52:57.458 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.378+0000 7f9881600700 1 -- 172.21.15.72:0/2528479593 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9878003b50 con 0x7f988407ace0 2024-03-19T05:52:57.458 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.378+0000 7f9881600700 1 -- 172.21.15.72:0/2528479593 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98780247c0 con 0x7f988407ace0 2024-03-19T05:52:57.458 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.378+0000 7f988b800700 1 -- 172.21.15.72:0/2528479593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988419c130 con 0x7f988407ace0 2024-03-19T05:52:57.458 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.378+0000 7f988b800700 1 -- 172.21.15.72:0/2528479593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988419c5d0 con 0x7f988407ace0 2024-03-19T05:52:57.458 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.379+0000 7f988b800700 1 -- 172.21.15.72:0/2528479593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988410bcd0 con 0x7f988407ace0 2024-03-19T05:52:57.458 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.379+0000 7f9881600700 1 -- 172.21.15.72:0/2528479593 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f987801ac00 con 0x7f988407ace0 2024-03-19T05:52:57.458 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.380+0000 7f9881600700 1 --2- 172.21.15.72:0/2528479593 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f986c038490 0x7f986c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:57.459 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.380+0000 7f9881600700 1 -- 172.21.15.72:0/2528479593 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f987804c4e0 con 0x7f988407ace0 2024-03-19T05:52:57.459 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.380+0000 7f9883e00700 1 --2- 172.21.15.72:0/2528479593 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f986c038490 0x7f986c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:57.459 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.381+0000 7f9883e00700 1 --2- 172.21.15.72:0/2528479593 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f986c038490 0x7f986c03a940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9870006fd0 tx=0x7f9870006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:57.459 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.385+0000 7f9881600700 1 -- 172.21.15.72:0/2528479593 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9878010380 con 0x7f988407ace0 2024-03-19T05:52:57.459 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.622+0000 7f988b800700 1 -- 172.21.15.72:0/2528479593 --> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f98840621a0 con 0x7f986c038490 2024-03-19T05:52:57.459 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.875+0000 7f9881600700 1 -- 172.21.15.72:0/2528479593 <== mgr.14164 v2:172.21.15.72:6800/1922058375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f98840621a0 con 0x7f986c038490 2024-03-19T05:52:57.459 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.878+0000 7f988b800700 1 -- 172.21.15.72:0/2528479593 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f986c038490 msgr2=0x7f986c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:57.459 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.878+0000 7f988b800700 1 --2- 172.21.15.72:0/2528479593 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f986c038490 0x7f986c03a940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9870006fd0 tx=0x7f9870006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:57.459 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.878+0000 7f988b800700 1 -- 172.21.15.72:0/2528479593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 msgr2=0x7f988419b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:57.459 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.878+0000 7f988b800700 1 --2- 172.21.15.72:0/2528479593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 0x7f988419b9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9878011670 tx=0x7f9878011b50 comp rx=0 tx=0).stop 2024-03-19T05:52:57.459 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.879+0000 7f988b800700 1 -- 172.21.15.72:0/2528479593 shutdown_connections 2024-03-19T05:52:57.459 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.879+0000 7f988b800700 1 --2- 172.21.15.72:0/2528479593 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f986c038490 0x7f986c03a940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:57.460 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.879+0000 7f988b800700 1 --2- 172.21.15.72:0/2528479593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f988407ace0 0x7f988419b9f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:57.460 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.879+0000 7f988b800700 1 -- 172.21.15.72:0/2528479593 >> 172.21.15.72:0/2528479593 conn(0x7f9884100fd0 msgr2=0x7f9884102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:57.460 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.879+0000 7f988b800700 1 -- 172.21.15.72:0/2528479593 shutdown_connections 2024-03-19T05:52:57.460 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:55.879+0000 7f988b800700 1 -- 172.21.15.72:0/2528479593 wait complete. 2024-03-19T05:52:57.460 INFO:teuthology.orchestra.run.smithi072.stdout:Fetching dashboard port number... 2024-03-19T05:52:58.313 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:57 smithi072 ceph-mon[28706]: mgrmap e13: smithi072.jydpjk(active, since 6s) 2024-03-19T05:52:59.008 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:52:58 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3195681368' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-19T05:52:59.025 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stdout 8443 2024-03-19T05:52:59.025 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.095+0000 7f7914800700 1 Processor -- start 2024-03-19T05:52:59.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.095+0000 7f7914800700 1 -- start start 2024-03-19T05:52:59.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.095+0000 7f7914800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 0x7f790c10ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:59.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.095+0000 7f7914800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c10f1f0 con 0x7f790c080210 2024-03-19T05:52:59.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.096+0000 7f7911e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 0x7f790c10ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:59.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.096+0000 7f7911e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 0x7f790c10ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36258/0 (socket says 172.21.15.72:36258) 2024-03-19T05:52:59.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.096+0000 7f7911e00700 1 -- 172.21.15.72:0/2950049823 learned_addr learned my addr 172.21.15.72:0/2950049823 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:59.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.096+0000 7f7911e00700 1 -- 172.21.15.72:0/2950049823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c10f330 con 0x7f790c080210 2024-03-19T05:52:59.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.096+0000 7f7911e00700 1 --2- 172.21.15.72:0/2950049823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 0x7f790c10ecb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f79000098a0 tx=0x7f7900009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd17933eb92da2f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:59.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.097+0000 7f7910a00700 1 -- 172.21.15.72:0/2950049823 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7900004180 con 0x7f790c080210 2024-03-19T05:52:59.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.097+0000 7f7910a00700 1 -- 172.21.15.72:0/2950049823 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f79000042e0 con 0x7f790c080210 2024-03-19T05:52:59.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.097+0000 7f7910a00700 1 -- 172.21.15.72:0/2950049823 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7900011af0 con 0x7f790c080210 2024-03-19T05:52:59.026 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.097+0000 7f7914800700 1 -- 172.21.15.72:0/2950049823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 msgr2=0x7f790c10ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.097+0000 7f7914800700 1 --2- 172.21.15.72:0/2950049823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 0x7f790c10ecb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f79000098a0 tx=0x7f7900009bb0 comp rx=0 tx=0).stop 2024-03-19T05:52:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.098+0000 7f7914800700 1 -- 172.21.15.72:0/2950049823 shutdown_connections 2024-03-19T05:52:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.098+0000 7f7914800700 1 --2- 172.21.15.72:0/2950049823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 0x7f790c10ecb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.098+0000 7f7914800700 1 -- 172.21.15.72:0/2950049823 >> 172.21.15.72:0/2950049823 conn(0x7f790c07b200 msgr2=0x7f790c07d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.098+0000 7f7914800700 1 -- 172.21.15.72:0/2950049823 shutdown_connections 2024-03-19T05:52:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.098+0000 7f7914800700 1 -- 172.21.15.72:0/2950049823 wait complete. 2024-03-19T05:52:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.099+0000 7f7914800700 1 Processor -- start 2024-03-19T05:52:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.099+0000 7f7914800700 1 -- start start 2024-03-19T05:52:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.099+0000 7f7914800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 0x7f790c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.099+0000 7f7914800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c1a0310 con 0x7f790c080210 2024-03-19T05:52:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.099+0000 7f7911e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 0x7f790c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.099+0000 7f7911e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 0x7f790c19fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36270/0 (socket says 172.21.15.72:36270) 2024-03-19T05:52:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.099+0000 7f7911e00700 1 -- 172.21.15.72:0/3195681368 learned_addr learned my addr 172.21.15.72:0/3195681368 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:52:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.100+0000 7f7911e00700 1 -- 172.21.15.72:0/3195681368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900009550 con 0x7f790c080210 2024-03-19T05:52:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.100+0000 7f7911e00700 1 --2- 172.21.15.72:0/3195681368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 0x7f790c19fdd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7900011670 tx=0x7f7900011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.100+0000 7f7906a00700 1 -- 172.21.15.72:0/3195681368 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79000039c0 con 0x7f790c080210 2024-03-19T05:52:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.100+0000 7f7906a00700 1 -- 172.21.15.72:0/3195681368 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7900003b20 con 0x7f790c080210 2024-03-19T05:52:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.100+0000 7f7906a00700 1 -- 172.21.15.72:0/3195681368 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79000247f0 con 0x7f790c080210 2024-03-19T05:52:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.100+0000 7f7914800700 1 -- 172.21.15.72:0/3195681368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c1a0510 con 0x7f790c080210 2024-03-19T05:52:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.100+0000 7f7914800700 1 -- 172.21.15.72:0/3195681368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c1a09b0 con 0x7f790c080210 2024-03-19T05:52:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.101+0000 7f7906a00700 1 -- 172.21.15.72:0/3195681368 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f790001ac70 con 0x7f790c080210 2024-03-19T05:52:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.101+0000 7f7914800700 1 -- 172.21.15.72:0/3195681368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c1100b0 con 0x7f790c080210 2024-03-19T05:52:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.102+0000 7f7906a00700 1 --2- 172.21.15.72:0/3195681368 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f78f40384f0 0x7f78f403a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:52:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.102+0000 7f7906a00700 1 -- 172.21.15.72:0/3195681368 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f790004c4b0 con 0x7f790c080210 2024-03-19T05:52:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.102+0000 7f7911400700 1 --2- 172.21.15.72:0/3195681368 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f78f40384f0 0x7f78f403a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:52:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.103+0000 7f7911400700 1 --2- 172.21.15.72:0/3195681368 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f78f40384f0 0x7f78f403a9a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f78fc006fd0 tx=0x7f78fc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:52:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.107+0000 7f7906a00700 1 -- 172.21.15.72:0/3195681368 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7900018740 con 0x7f790c080210 2024-03-19T05:52:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.320+0000 7f7914800700 1 -- 172.21.15.72:0/3195681368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f790c1102d0 con 0x7f790c080210 2024-03-19T05:52:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.321+0000 7f7906a00700 1 -- 172.21.15.72:0/3195681368 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f7900018350 con 0x7f790c080210 2024-03-19T05:52:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.324+0000 7f7914800700 1 -- 172.21.15.72:0/3195681368 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f78f40384f0 msgr2=0x7f78f403a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.324+0000 7f7914800700 1 --2- 172.21.15.72:0/3195681368 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f78f40384f0 0x7f78f403a9a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f78fc006fd0 tx=0x7f78fc006e40 comp rx=0 tx=0).stop 2024-03-19T05:52:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.324+0000 7f7914800700 1 -- 172.21.15.72:0/3195681368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 msgr2=0x7f790c19fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:52:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.324+0000 7f7914800700 1 --2- 172.21.15.72:0/3195681368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 0x7f790c19fdd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7900011670 tx=0x7f7900011aa0 comp rx=0 tx=0).stop 2024-03-19T05:52:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.324+0000 7f7914800700 1 -- 172.21.15.72:0/3195681368 shutdown_connections 2024-03-19T05:52:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.324+0000 7f7914800700 1 --2- 172.21.15.72:0/3195681368 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f78f40384f0 0x7f78f403a9a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.324+0000 7f7914800700 1 --2- 172.21.15.72:0/3195681368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f790c080210 0x7f790c19fdd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:52:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.324+0000 7f7914800700 1 -- 172.21.15.72:0/3195681368 >> 172.21.15.72:0/3195681368 conn(0x7f790c07b200 msgr2=0x7f790c07d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:52:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.324+0000 7f7914800700 1 -- 172.21.15.72:0/3195681368 shutdown_connections 2024-03-19T05:52:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:58.325+0000 7f7914800700 1 -- 172.21.15.72:0/3195681368 wait complete. 2024-03-19T05:52:59.057 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-19T05:52:59.057 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout disabled 2024-03-19T05:52:59.080 INFO:teuthology.orchestra.run.smithi072.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-19T05:52:59.080 INFO:teuthology.orchestra.run.smithi072.stdout:systemctl: stdout inactive 2024-03-19T05:52:59.081 INFO:teuthology.orchestra.run.smithi072.stdout:firewalld.service is not enabled 2024-03-19T05:52:59.081 INFO:teuthology.orchestra.run.smithi072.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-19T05:52:59.085 INFO:teuthology.orchestra.run.smithi072.stdout:Ceph Dashboard is now available at: 2024-03-19T05:52:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:52:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: URL: https://smithi072.front.sepia.ceph.com:8443/ 2024-03-19T05:52:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: User: admin 2024-03-19T05:52:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: Password: 9250rpckr2 2024-03-19T05:52:59.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:52:59.086 INFO:teuthology.orchestra.run.smithi072.stdout:Saving cluster configuration to /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config directory 2024-03-19T05:52:59.087 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling autotune for osd_memory_target 2024-03-19T05:53:00.614 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.716+0000 7ff1a7800700 1 Processor -- start 2024-03-19T05:53:00.615 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.716+0000 7ff1a7800700 1 -- start start 2024-03-19T05:53:00.615 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.716+0000 7ff1a7800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 0x7ff1a0107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:00.616 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.716+0000 7ff1a7800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a0108530 con 0x7ff1a0107be0 2024-03-19T05:53:00.616 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.717+0000 7ff1a4e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 0x7ff1a0107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:00.616 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.717+0000 7ff1a4e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 0x7ff1a0107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36286/0 (socket says 172.21.15.72:36286) 2024-03-19T05:53:00.616 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.717+0000 7ff1a4e00700 1 -- 172.21.15.72:0/1133402970 learned_addr learned my addr 172.21.15.72:0/1133402970 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:53:00.616 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.717+0000 7ff1a4e00700 1 -- 172.21.15.72:0/1133402970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a0108670 con 0x7ff1a0107be0 2024-03-19T05:53:00.616 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.718+0000 7ff1a4e00700 1 --2- 172.21.15.72:0/1133402970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 0x7ff1a0107ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1940098a0 tx=0x7ff194009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d0f19be60a6a23 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:00.616 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.718+0000 7ff19f400700 1 -- 172.21.15.72:0/1133402970 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff194004180 con 0x7ff1a0107be0 2024-03-19T05:53:00.616 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.718+0000 7ff19f400700 1 -- 172.21.15.72:0/1133402970 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff1940042e0 con 0x7ff1a0107be0 2024-03-19T05:53:00.620 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.718+0000 7ff19f400700 1 -- 172.21.15.72:0/1133402970 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff194011af0 con 0x7ff1a0107be0 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.719+0000 7ff1a7800700 1 -- 172.21.15.72:0/1133402970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 msgr2=0x7ff1a0107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.719+0000 7ff1a7800700 1 --2- 172.21.15.72:0/1133402970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 0x7ff1a0107ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1940098a0 tx=0x7ff194009bb0 comp rx=0 tx=0).stop 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.719+0000 7ff1a7800700 1 -- 172.21.15.72:0/1133402970 shutdown_connections 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.719+0000 7ff1a7800700 1 --2- 172.21.15.72:0/1133402970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 0x7ff1a0107ff0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.719+0000 7ff1a7800700 1 -- 172.21.15.72:0/1133402970 >> 172.21.15.72:0/1133402970 conn(0x7ff1a007b200 msgr2=0x7ff1a007b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.719+0000 7ff1a7800700 1 -- 172.21.15.72:0/1133402970 shutdown_connections 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.719+0000 7ff1a7800700 1 -- 172.21.15.72:0/1133402970 wait complete. 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.720+0000 7ff1a7800700 1 Processor -- start 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.720+0000 7ff1a7800700 1 -- start start 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.720+0000 7ff1a7800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 0x7ff1a019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.721+0000 7ff1a7800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a019bf10 con 0x7ff1a0107be0 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.721+0000 7ff1a4e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 0x7ff1a019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.721+0000 7ff1a4e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 0x7ff1a019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36298/0 (socket says 172.21.15.72:36298) 2024-03-19T05:53:00.621 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.721+0000 7ff1a4e00700 1 -- 172.21.15.72:0/1648417809 learned_addr learned my addr 172.21.15.72:0/1648417809 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:53:00.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.721+0000 7ff1a4e00700 1 -- 172.21.15.72:0/1648417809 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff194009550 con 0x7ff1a0107be0 2024-03-19T05:53:00.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.721+0000 7ff1a4e00700 1 --2- 172.21.15.72:0/1648417809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 0x7ff1a019b9d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff194011670 tx=0x7ff194011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:00.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.722+0000 7ff19d600700 1 -- 172.21.15.72:0/1648417809 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff194003a40 con 0x7ff1a0107be0 2024-03-19T05:53:00.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.722+0000 7ff19d600700 1 -- 172.21.15.72:0/1648417809 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff194003ba0 con 0x7ff1a0107be0 2024-03-19T05:53:00.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.722+0000 7ff19d600700 1 -- 172.21.15.72:0/1648417809 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff194024790 con 0x7ff1a0107be0 2024-03-19T05:53:00.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.722+0000 7ff1a7800700 1 -- 172.21.15.72:0/1648417809 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a019c110 con 0x7ff1a0107be0 2024-03-19T05:53:00.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.722+0000 7ff1a7800700 1 -- 172.21.15.72:0/1648417809 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a019c5b0 con 0x7ff1a0107be0 2024-03-19T05:53:00.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.723+0000 7ff19d600700 1 -- 172.21.15.72:0/1648417809 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7ff19401a430 con 0x7ff1a0107be0 2024-03-19T05:53:00.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.723+0000 7ff1a7800700 1 -- 172.21.15.72:0/1648417809 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a0062380 con 0x7ff1a0107be0 2024-03-19T05:53:00.622 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.723+0000 7ff19d600700 1 --2- 172.21.15.72:0/1648417809 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff188038580 0x7ff18803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.724+0000 7ff19d600700 1 -- 172.21.15.72:0/1648417809 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff19404c740 con 0x7ff1a0107be0 2024-03-19T05:53:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.724+0000 7ff19fe00700 1 --2- 172.21.15.72:0/1648417809 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff188038580 0x7ff18803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.724+0000 7ff19fe00700 1 --2- 172.21.15.72:0/1648417809 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff188038580 0x7ff18803aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff18c006fd0 tx=0x7ff18c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.728+0000 7ff19d600700 1 -- 172.21.15.72:0/1648417809 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff19401ac50 con 0x7ff1a0107be0 2024-03-19T05:53:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.942+0000 7ff1a7800700 1 -- 172.21.15.72:0/1648417809 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ff1a019f790 con 0x7ff1a0107be0 2024-03-19T05:53:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.943+0000 7ff19d600700 1 -- 172.21.15.72:0/1648417809 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ff194018b00 con 0x7ff1a0107be0 2024-03-19T05:53:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.946+0000 7ff1a7800700 1 -- 172.21.15.72:0/1648417809 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff188038580 msgr2=0x7ff18803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.946+0000 7ff1a7800700 1 --2- 172.21.15.72:0/1648417809 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff188038580 0x7ff18803aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff18c006fd0 tx=0x7ff18c006e40 comp rx=0 tx=0).stop 2024-03-19T05:53:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.946+0000 7ff1a7800700 1 -- 172.21.15.72:0/1648417809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 msgr2=0x7ff1a019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.946+0000 7ff1a7800700 1 --2- 172.21.15.72:0/1648417809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 0x7ff1a019b9d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff194011670 tx=0x7ff194011b50 comp rx=0 tx=0).stop 2024-03-19T05:53:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.946+0000 7ff1a7800700 1 -- 172.21.15.72:0/1648417809 shutdown_connections 2024-03-19T05:53:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.946+0000 7ff1a7800700 1 --2- 172.21.15.72:0/1648417809 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff188038580 0x7ff18803aa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:00.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.946+0000 7ff1a7800700 1 --2- 172.21.15.72:0/1648417809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1a0107be0 0x7ff1a019b9d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:00.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.946+0000 7ff1a7800700 1 -- 172.21.15.72:0/1648417809 >> 172.21.15.72:0/1648417809 conn(0x7ff1a007b200 msgr2=0x7ff1a0106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:00.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.946+0000 7ff1a7800700 1 -- 172.21.15.72:0/1648417809 shutdown_connections 2024-03-19T05:53:00.624 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:52:59.947+0000 7ff1a7800700 1 -- 172.21.15.72:0/1648417809 wait complete. 2024-03-19T05:53:02.251 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.198+0000 7f4ffa600700 1 Processor -- start 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.198+0000 7f4ffa600700 1 -- start start 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.199+0000 7f4ffa600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 0x7f4ff40791a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.199+0000 7f4ffa600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff40796e0 con 0x7f4ff407aca0 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.199+0000 7f4ff3400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 0x7f4ff40791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.199+0000 7f4ff3400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 0x7f4ff40791a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36304/0 (socket says 172.21.15.72:36304) 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.199+0000 7f4ff3400700 1 -- 172.21.15.72:0/1763123904 learned_addr learned my addr 172.21.15.72:0/1763123904 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.200+0000 7f4ff3400700 1 -- 172.21.15.72:0/1763123904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff4079820 con 0x7f4ff407aca0 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.200+0000 7f4ff3400700 1 --2- 172.21.15.72:0/1763123904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 0x7f4ff40791a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40098a0 tx=0x7f4fe4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7602903b6f80da server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.201+0000 7f4ff2000700 1 -- 172.21.15.72:0/1763123904 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fe4004180 con 0x7f4ff407aca0 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.201+0000 7f4ff2000700 1 -- 172.21.15.72:0/1763123904 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4fe40042e0 con 0x7f4ff407aca0 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.201+0000 7f4ff2000700 1 -- 172.21.15.72:0/1763123904 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fe4011af0 con 0x7f4ff407aca0 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.201+0000 7f4ffa600700 1 -- 172.21.15.72:0/1763123904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 msgr2=0x7f4ff40791a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.201+0000 7f4ffa600700 1 --2- 172.21.15.72:0/1763123904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 0x7f4ff40791a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40098a0 tx=0x7f4fe4009bb0 comp rx=0 tx=0).stop 2024-03-19T05:53:02.252 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.201+0000 7f4ffa600700 1 -- 172.21.15.72:0/1763123904 shutdown_connections 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.201+0000 7f4ffa600700 1 --2- 172.21.15.72:0/1763123904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 0x7f4ff40791a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.201+0000 7f4ffa600700 1 -- 172.21.15.72:0/1763123904 >> 172.21.15.72:0/1763123904 conn(0x7f4ff4100fd0 msgr2=0x7f4ff4103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.202+0000 7f4ffa600700 1 -- 172.21.15.72:0/1763123904 shutdown_connections 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.202+0000 7f4ffa600700 1 -- 172.21.15.72:0/1763123904 wait complete. 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.203+0000 7f4ffa600700 1 Processor -- start 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.203+0000 7f4ffa600700 1 -- start start 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.203+0000 7f4ffa600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 0x7f4ff419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.203+0000 7f4ffa600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff419bf20 con 0x7f4ff407aca0 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.203+0000 7f4ff3400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 0x7f4ff419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.203+0000 7f4ff3400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 0x7f4ff419b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36306/0 (socket says 172.21.15.72:36306) 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.203+0000 7f4ff3400700 1 -- 172.21.15.72:0/2234401313 learned_addr learned my addr 172.21.15.72:0/2234401313 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.204+0000 7f4ff3400700 1 -- 172.21.15.72:0/2234401313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe4009550 con 0x7f4ff407aca0 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.204+0000 7f4ff3400700 1 --2- 172.21.15.72:0/2234401313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 0x7f4ff419b9e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4011670 tx=0x7f4fe4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.204+0000 7f4febe00700 1 -- 172.21.15.72:0/2234401313 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fe40039f0 con 0x7f4ff407aca0 2024-03-19T05:53:02.253 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.204+0000 7f4febe00700 1 -- 172.21.15.72:0/2234401313 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4fe4003b50 con 0x7f4ff407aca0 2024-03-19T05:53:02.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.204+0000 7f4ffa600700 1 -- 172.21.15.72:0/2234401313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff419c120 con 0x7f4ff407aca0 2024-03-19T05:53:02.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.204+0000 7f4febe00700 1 -- 172.21.15.72:0/2234401313 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fe40247c0 con 0x7f4ff407aca0 2024-03-19T05:53:02.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.205+0000 7f4ffa600700 1 -- 172.21.15.72:0/2234401313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff419c5c0 con 0x7f4ff407aca0 2024-03-19T05:53:02.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.206+0000 7f4febe00700 1 -- 172.21.15.72:0/2234401313 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f4fe401a430 con 0x7f4ff407aca0 2024-03-19T05:53:02.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.206+0000 7f4ffa600700 1 -- 172.21.15.72:0/2234401313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff410bd10 con 0x7f4ff407aca0 2024-03-19T05:53:02.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.206+0000 7f4febe00700 1 --2- 172.21.15.72:0/2234401313 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f4fd8038530 0x7f4fd803a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:02.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.206+0000 7f4febe00700 1 -- 172.21.15.72:0/2234401313 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4fe404c650 con 0x7f4ff407aca0 2024-03-19T05:53:02.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.206+0000 7f4ff2a00700 1 --2- 172.21.15.72:0/2234401313 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f4fd8038530 0x7f4fd803a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:02.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.207+0000 7f4ff2a00700 1 --2- 172.21.15.72:0/2234401313 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f4fd8038530 0x7f4fd803a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0006fd0 tx=0x7f4fe0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:02.254 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.211+0000 7f4febe00700 1 -- 172.21.15.72:0/2234401313 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4fe4018b40 con 0x7f4ff407aca0 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.543+0000 7f4ffa600700 1 -- 172.21.15.72:0/2234401313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f4ff419f400 con 0x7f4ff407aca0 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.547+0000 7f4febe00700 1 -- 172.21.15.72:0/2234401313 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f4fe4018b40 con 0x7f4ff407aca0 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.550+0000 7f4ffa600700 1 -- 172.21.15.72:0/2234401313 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f4fd8038530 msgr2=0x7f4fd803a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.550+0000 7f4ffa600700 1 --2- 172.21.15.72:0/2234401313 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f4fd8038530 0x7f4fd803a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0006fd0 tx=0x7f4fe0006e40 comp rx=0 tx=0).stop 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.550+0000 7f4ffa600700 1 -- 172.21.15.72:0/2234401313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 msgr2=0x7f4ff419b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.550+0000 7f4ffa600700 1 --2- 172.21.15.72:0/2234401313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 0x7f4ff419b9e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4011670 tx=0x7f4fe4011b50 comp rx=0 tx=0).stop 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.550+0000 7f4ffa600700 1 -- 172.21.15.72:0/2234401313 shutdown_connections 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.550+0000 7f4ffa600700 1 --2- 172.21.15.72:0/2234401313 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f4fd8038530 0x7f4fd803a9e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.550+0000 7f4ffa600700 1 --2- 172.21.15.72:0/2234401313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff407aca0 0x7f4ff419b9e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.550+0000 7f4ffa600700 1 -- 172.21.15.72:0/2234401313 >> 172.21.15.72:0/2234401313 conn(0x7f4ff4100fd0 msgr2=0x7f4ff4102720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.550+0000 7f4ffa600700 1 -- 172.21.15.72:0/2234401313 shutdown_connections 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr 2024-03-19T05:53:01.550+0000 7f4ffa600700 1 -- 172.21.15.72:0/2234401313 wait complete. 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-19T05:53:02.255 INFO:teuthology.orchestra.run.smithi072.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout:Or, if you are only running a single cluster on this host: 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: ceph telemetry on 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout:For more information see: 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-19T05:53:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:53:02.257 INFO:teuthology.orchestra.run.smithi072.stdout:Bootstrap complete. 2024-03-19T05:53:02.322 INFO:tasks.cephadm:Fetching config... 2024-03-19T05:53:02.322 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:53:02.322 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-19T05:53:02.366 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-19T05:53:02.367 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:53:02.367 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-19T05:53:02.445 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-19T05:53:02.445 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:53:02.445 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/keyring of=/dev/stdout 2024-03-19T05:53:02.579 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-19T05:53:02.579 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:53:02.579 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-19T05:53:02.671 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-19T05:53:02.671 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqsCmCD9QW3pvkObbdI65kxMLvtvMCGz2B9GzpbCGqGr+T8aHwu+B2y+mghIig0QqdV1mwlfnH7MnJYDSqj70XnP+wU5KV5ozBDVXXWnoHjH6xIZF69cdc4G10GJXDY5IdySHqIYlaqkm3qm88UoE1y2fcw5luREoe+rdjfJEW5ZzJa5gxqXqyhbEjDjX9UXNRa6iIfQHPHt4sxbnUP8l/1Dm3ULh3qCbZBKEybN5x6fvzco7gNz9h1DYxhJoi6iU76xCf4ljXeVqQPp6vLcGl90Wb6q4a+BKrQsDB+r0RJXezKi+afwYG8s5Nxe2Ar+L2I8r+6vknOh1XEO5MmFwESedO4/SzfOKxnNvwySr+xnMzhig+O1ElqfDM+AvVQHbRdHJ49dt5fpI2II/ZMCWeFzOBU38A/Vz59xS1tyV/E9M7bzrds5tgkidR3Yqa6TKWlQMV6baOOyM4wyYPzdoaYeiRUM8M6n0xgsKkhdHB6bZPNNXB3BhheXSIxmq0YUc= ceph-9ad98512-e5b4-11ee-95c9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-19T05:53:02.780 INFO:teuthology.orchestra.run.smithi072.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqsCmCD9QW3pvkObbdI65kxMLvtvMCGz2B9GzpbCGqGr+T8aHwu+B2y+mghIig0QqdV1mwlfnH7MnJYDSqj70XnP+wU5KV5ozBDVXXWnoHjH6xIZF69cdc4G10GJXDY5IdySHqIYlaqkm3qm88UoE1y2fcw5luREoe+rdjfJEW5ZzJa5gxqXqyhbEjDjX9UXNRa6iIfQHPHt4sxbnUP8l/1Dm3ULh3qCbZBKEybN5x6fvzco7gNz9h1DYxhJoi6iU76xCf4ljXeVqQPp6vLcGl90Wb6q4a+BKrQsDB+r0RJXezKi+afwYG8s5Nxe2Ar+L2I8r+6vknOh1XEO5MmFwESedO4/SzfOKxnNvwySr+xnMzhig+O1ElqfDM+AvVQHbRdHJ49dt5fpI2II/ZMCWeFzOBU38A/Vz59xS1tyV/E9M7bzrds5tgkidR3Yqa6TKWlQMV6baOOyM4wyYPzdoaYeiRUM8M6n0xgsKkhdHB6bZPNNXB3BhheXSIxmq0YUc= ceph-9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:53:02.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:02 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2234401313' entity='client.admin' 2024-03-19T05:53:02.845 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqsCmCD9QW3pvkObbdI65kxMLvtvMCGz2B9GzpbCGqGr+T8aHwu+B2y+mghIig0QqdV1mwlfnH7MnJYDSqj70XnP+wU5KV5ozBDVXXWnoHjH6xIZF69cdc4G10GJXDY5IdySHqIYlaqkm3qm88UoE1y2fcw5luREoe+rdjfJEW5ZzJa5gxqXqyhbEjDjX9UXNRa6iIfQHPHt4sxbnUP8l/1Dm3ULh3qCbZBKEybN5x6fvzco7gNz9h1DYxhJoi6iU76xCf4ljXeVqQPp6vLcGl90Wb6q4a+BKrQsDB+r0RJXezKi+afwYG8s5Nxe2Ar+L2I8r+6vknOh1XEO5MmFwESedO4/SzfOKxnNvwySr+xnMzhig+O1ElqfDM+AvVQHbRdHJ49dt5fpI2II/ZMCWeFzOBU38A/Vz59xS1tyV/E9M7bzrds5tgkidR3Yqa6TKWlQMV6baOOyM4wyYPzdoaYeiRUM8M6n0xgsKkhdHB6bZPNNXB3BhheXSIxmq0YUc= ceph-9ad98512-e5b4-11ee-95c9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-19T05:53:02.983 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqsCmCD9QW3pvkObbdI65kxMLvtvMCGz2B9GzpbCGqGr+T8aHwu+B2y+mghIig0QqdV1mwlfnH7MnJYDSqj70XnP+wU5KV5ozBDVXXWnoHjH6xIZF69cdc4G10GJXDY5IdySHqIYlaqkm3qm88UoE1y2fcw5luREoe+rdjfJEW5ZzJa5gxqXqyhbEjDjX9UXNRa6iIfQHPHt4sxbnUP8l/1Dm3ULh3qCbZBKEybN5x6fvzco7gNz9h1DYxhJoi6iU76xCf4ljXeVqQPp6vLcGl90Wb6q4a+BKrQsDB+r0RJXezKi+afwYG8s5Nxe2Ar+L2I8r+6vknOh1XEO5MmFwESedO4/SzfOKxnNvwySr+xnMzhig+O1ElqfDM+AvVQHbRdHJ49dt5fpI2II/ZMCWeFzOBU38A/Vz59xS1tyV/E9M7bzrds5tgkidR3Yqa6TKWlQMV6baOOyM4wyYPzdoaYeiRUM8M6n0xgsKkhdHB6bZPNNXB3BhheXSIxmq0YUc= ceph-9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:53:03.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-19T05:53:03.422 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:53:06.250 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:05 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:06.251 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:05 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:06.251 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:05 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd/host:smithi072", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:53:06.251 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:05 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:06.251 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:05 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T05:53:06.251 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:05 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-03-19T05:53:06.251 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:05 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:53:06.251 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:05 smithi072 ceph-mon[28706]: Deploying daemon ceph-exporter.smithi072 on smithi072 2024-03-19T05:53:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.415+0000 7f541a200700 1 -- 172.21.15.72:0/2157616389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54140ffe20 msgr2=0x7f5414100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.415+0000 7f541a200700 1 --2- 172.21.15.72:0/2157616389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54140ffe20 0x7f5414100230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5404009910 tx=0x7f5404009c20 comp rx=0 tx=0).stop 2024-03-19T05:53:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.415+0000 7f541a200700 1 -- 172.21.15.72:0/2157616389 shutdown_connections 2024-03-19T05:53:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.415+0000 7f541a200700 1 --2- 172.21.15.72:0/2157616389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54140ffe20 0x7f5414100230 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.415+0000 7f541a200700 1 -- 172.21.15.72:0/2157616389 >> 172.21.15.72:0/2157616389 conn(0x7f54140fb3d0 msgr2=0x7f54140fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.415+0000 7f541a200700 1 -- 172.21.15.72:0/2157616389 shutdown_connections 2024-03-19T05:53:06.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.415+0000 7f541a200700 1 -- 172.21.15.72:0/2157616389 wait complete. 2024-03-19T05:53:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.416+0000 7f541a200700 1 Processor -- start 2024-03-19T05:53:06.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.416+0000 7f541a200700 1 -- start start 2024-03-19T05:53:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.417+0000 7f541a200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54140ffe20 0x7f5414197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.417+0000 7f541a200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54141976b0 con 0x7f54140ffe20 2024-03-19T05:53:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.417+0000 7f5413400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54140ffe20 0x7f5414197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.417+0000 7f5413400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54140ffe20 0x7f5414197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34442/0 (socket says 172.21.15.72:34442) 2024-03-19T05:53:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.417+0000 7f5413400700 1 -- 172.21.15.72:0/536864938 learned_addr learned my addr 172.21.15.72:0/536864938 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:53:06.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.417+0000 7f5413400700 1 -- 172.21.15.72:0/536864938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54040095f0 con 0x7f54140ffe20 2024-03-19T05:53:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.418+0000 7f5413400700 1 --2- 172.21.15.72:0/536864938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54140ffe20 0x7f5414197170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f54040092e0 tx=0x7f5404009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.418+0000 7f540be00700 1 -- 172.21.15.72:0/536864938 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f540401d070 con 0x7f54140ffe20 2024-03-19T05:53:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.418+0000 7f540be00700 1 -- 172.21.15.72:0/536864938 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f540400be10 con 0x7f54140ffe20 2024-03-19T05:53:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.418+0000 7f541a200700 1 -- 172.21.15.72:0/536864938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54141978b0 con 0x7f54140ffe20 2024-03-19T05:53:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.418+0000 7f540be00700 1 -- 172.21.15.72:0/536864938 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f540400f460 con 0x7f54140ffe20 2024-03-19T05:53:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.418+0000 7f541a200700 1 -- 172.21.15.72:0/536864938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5414197d50 con 0x7f54140ffe20 2024-03-19T05:53:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.419+0000 7f540be00700 1 -- 172.21.15.72:0/536864938 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f5404022470 con 0x7f54140ffe20 2024-03-19T05:53:06.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.419+0000 7f541a200700 1 -- 172.21.15.72:0/536864938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5414190e80 con 0x7f54140ffe20 2024-03-19T05:53:06.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.420+0000 7f540be00700 1 --2- 172.21.15.72:0/536864938 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f53f8038490 0x7f53f803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:06.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.420+0000 7f540be00700 1 -- 172.21.15.72:0/536864938 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f540404c3b0 con 0x7f54140ffe20 2024-03-19T05:53:06.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.420+0000 7f5412a00700 1 --2- 172.21.15.72:0/536864938 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f53f8038490 0x7f53f803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:06.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.420+0000 7f5412a00700 1 --2- 172.21.15.72:0/536864938 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f53f8038490 0x7f53f803a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5400006fd0 tx=0x7f5400006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:06.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.425+0000 7f540be00700 1 -- 172.21.15.72:0/536864938 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f540400b960 con 0x7f54140ffe20 2024-03-19T05:53:06.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.636+0000 7f541a200700 1 -- 172.21.15.72:0/536864938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f54141008b0 con 0x7f54140ffe20 2024-03-19T05:53:06.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.640+0000 7f540be00700 1 -- 172.21.15.72:0/536864938 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f54141008b0 con 0x7f54140ffe20 2024-03-19T05:53:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.643+0000 7f541a200700 1 -- 172.21.15.72:0/536864938 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f53f8038490 msgr2=0x7f53f803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.643+0000 7f541a200700 1 --2- 172.21.15.72:0/536864938 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f53f8038490 0x7f53f803a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5400006fd0 tx=0x7f5400006e40 comp rx=0 tx=0).stop 2024-03-19T05:53:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.643+0000 7f541a200700 1 -- 172.21.15.72:0/536864938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54140ffe20 msgr2=0x7f5414197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.643+0000 7f541a200700 1 --2- 172.21.15.72:0/536864938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54140ffe20 0x7f5414197170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f54040092e0 tx=0x7f5404009e60 comp rx=0 tx=0).stop 2024-03-19T05:53:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.643+0000 7f541a200700 1 -- 172.21.15.72:0/536864938 shutdown_connections 2024-03-19T05:53:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.643+0000 7f541a200700 1 --2- 172.21.15.72:0/536864938 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f53f8038490 0x7f53f803a940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.643+0000 7f541a200700 1 --2- 172.21.15.72:0/536864938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54140ffe20 0x7f5414197170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.643+0000 7f541a200700 1 -- 172.21.15.72:0/536864938 >> 172.21.15.72:0/536864938 conn(0x7f54140fb3d0 msgr2=0x7f54140fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.643+0000 7f541a200700 1 -- 172.21.15.72:0/536864938 shutdown_connections 2024-03-19T05:53:06.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:06.644+0000 7f541a200700 1 -- 172.21.15.72:0/536864938 wait complete. 2024-03-19T05:53:07.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:07 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/536864938' entity='client.admin' 2024-03-19T05:53:07.981 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-19T05:53:07.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-19T05:53:09.266 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:53:11.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.539+0000 7f33f1000700 1 -- 172.21.15.72:0/3323859690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33ec1008b0 msgr2=0x7f33ec102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:11.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.539+0000 7f33f1000700 1 --2- 172.21.15.72:0/3323859690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33ec1008b0 0x7f33ec102c90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009910 tx=0x7f33dc009c20 comp rx=0 tx=0).stop 2024-03-19T05:53:11.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.539+0000 7f33f1000700 1 -- 172.21.15.72:0/3323859690 shutdown_connections 2024-03-19T05:53:11.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.539+0000 7f33f1000700 1 --2- 172.21.15.72:0/3323859690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33ec1008b0 0x7f33ec102c90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:11.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.539+0000 7f33f1000700 1 -- 172.21.15.72:0/3323859690 >> 172.21.15.72:0/3323859690 conn(0x7f33ec0fa2b0 msgr2=0x7f33ec0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:11.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.540+0000 7f33f1000700 1 -- 172.21.15.72:0/3323859690 shutdown_connections 2024-03-19T05:53:11.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.540+0000 7f33f1000700 1 -- 172.21.15.72:0/3323859690 wait complete. 2024-03-19T05:53:11.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.541+0000 7f33f1000700 1 Processor -- start 2024-03-19T05:53:11.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.541+0000 7f33f1000700 1 -- start start 2024-03-19T05:53:11.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.542+0000 7f33f1000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33ec1008b0 0x7f33ec194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:11.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.542+0000 7f33f1000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec1954e0 con 0x7f33ec1008b0 2024-03-19T05:53:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.542+0000 7f33e9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33ec1008b0 0x7f33ec194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.542+0000 7f33e9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33ec1008b0 0x7f33ec194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34464/0 (socket says 172.21.15.72:34464) 2024-03-19T05:53:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.542+0000 7f33e9e00700 1 -- 172.21.15.72:0/3183263584 learned_addr learned my addr 172.21.15.72:0/3183263584 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:53:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.542+0000 7f33e9e00700 1 -- 172.21.15.72:0/3183263584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc0095f0 con 0x7f33ec1008b0 2024-03-19T05:53:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.543+0000 7f33e9e00700 1 --2- 172.21.15.72:0/3183263584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33ec1008b0 0x7f33ec194fa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f33dc005b40 tx=0x7f33dc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.543+0000 7f33e2a00700 1 -- 172.21.15.72:0/3183263584 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33dc01d070 con 0x7f33ec1008b0 2024-03-19T05:53:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.543+0000 7f33e2a00700 1 -- 172.21.15.72:0/3183263584 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f33dc00be10 con 0x7f33ec1008b0 2024-03-19T05:53:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.543+0000 7f33e2a00700 1 -- 172.21.15.72:0/3183263584 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33dc00f460 con 0x7f33ec1008b0 2024-03-19T05:53:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.543+0000 7f33f1000700 1 -- 172.21.15.72:0/3183263584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec1956e0 con 0x7f33ec1008b0 2024-03-19T05:53:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.543+0000 7f33f1000700 1 -- 172.21.15.72:0/3183263584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec195b80 con 0x7f33ec1008b0 2024-03-19T05:53:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.544+0000 7f33e2a00700 1 -- 172.21.15.72:0/3183263584 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f33dc0227e0 con 0x7f33ec1008b0 2024-03-19T05:53:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.544+0000 7f33f1000700 1 -- 172.21.15.72:0/3183263584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec18eb00 con 0x7f33ec1008b0 2024-03-19T05:53:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.545+0000 7f33e2a00700 1 --2- 172.21.15.72:0/3183263584 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f33d00384e0 0x7f33d003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.545+0000 7f33e2a00700 1 -- 172.21.15.72:0/3183263584 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f33dc04c450 con 0x7f33ec1008b0 2024-03-19T05:53:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.545+0000 7f33e9400700 1 --2- 172.21.15.72:0/3183263584 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f33d00384e0 0x7f33d003a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:11.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.546+0000 7f33e9400700 1 --2- 172.21.15.72:0/3183263584 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f33d00384e0 0x7f33d003a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f33d8006fd0 tx=0x7f33d8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:11.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.550+0000 7f33e2a00700 1 -- 172.21.15.72:0/3183263584 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f33dc02ba00 con 0x7f33ec1008b0 2024-03-19T05:53:11.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.781+0000 7f33f1000700 1 -- 172.21.15.72:0/3183263584 --> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f33ec061220 con 0x7f33d00384e0 2024-03-19T05:53:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.788+0000 7f33e2a00700 1 -- 172.21.15.72:0/3183263584 <== mgr.14164 v2:172.21.15.72:6800/1922058375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f33ec061220 con 0x7f33d00384e0 2024-03-19T05:53:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.790+0000 7f33f1000700 1 -- 172.21.15.72:0/3183263584 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f33d00384e0 msgr2=0x7f33d003a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.790+0000 7f33f1000700 1 --2- 172.21.15.72:0/3183263584 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f33d00384e0 0x7f33d003a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f33d8006fd0 tx=0x7f33d8006e40 comp rx=0 tx=0).stop 2024-03-19T05:53:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.790+0000 7f33f1000700 1 -- 172.21.15.72:0/3183263584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33ec1008b0 msgr2=0x7f33ec194fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.790+0000 7f33f1000700 1 --2- 172.21.15.72:0/3183263584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33ec1008b0 0x7f33ec194fa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f33dc005b40 tx=0x7f33dc004740 comp rx=0 tx=0).stop 2024-03-19T05:53:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.791+0000 7f33f1000700 1 -- 172.21.15.72:0/3183263584 shutdown_connections 2024-03-19T05:53:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.791+0000 7f33f1000700 1 --2- 172.21.15.72:0/3183263584 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f33d00384e0 0x7f33d003a990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.791+0000 7f33f1000700 1 --2- 172.21.15.72:0/3183263584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33ec1008b0 0x7f33ec194fa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.791+0000 7f33f1000700 1 -- 172.21.15.72:0/3183263584 >> 172.21.15.72:0/3183263584 conn(0x7f33ec0fa2b0 msgr2=0x7f33ec0faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:11.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.791+0000 7f33f1000700 1 -- 172.21.15.72:0/3183263584 shutdown_connections 2024-03-19T05:53:11.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:11.791+0000 7f33f1000700 1 -- 172.21.15.72:0/3183263584 wait complete. 2024-03-19T05:53:12.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:11 smithi072 ceph-mon[28706]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:12.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:11 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:12.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:11 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:12.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:11 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:12.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:11 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:12.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:11 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T05:53:12.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:11 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-03-19T05:53:12.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:11 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:53:12.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:11 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:12.557 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2024-03-19T05:53:12.557 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T05:53:12.557 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2024-03-19T05:53:12.613 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T05:53:12.613 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-19T05:53:12.706 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2024-03-19T05:53:12.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph orch host add smithi172 2024-03-19T05:53:13.050 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:12 smithi072 ceph-mon[28706]: Deploying daemon crash.smithi072 on smithi072 2024-03-19T05:53:13.050 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:12 smithi072 ceph-mon[28706]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:53:14.061 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:53:14.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:13 smithi072 ceph-mon[28706]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.096+0000 7ff59de00700 1 -- 172.21.15.72:0/2948296345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5980ffe20 msgr2=0x7ff598100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.096+0000 7ff59de00700 1 --2- 172.21.15.72:0/2948296345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5980ffe20 0x7ff598100230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff588009910 tx=0x7ff588009c20 comp rx=0 tx=0).stop 2024-03-19T05:53:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.096+0000 7ff59de00700 1 -- 172.21.15.72:0/2948296345 shutdown_connections 2024-03-19T05:53:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.096+0000 7ff59de00700 1 --2- 172.21.15.72:0/2948296345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5980ffe20 0x7ff598100230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.096+0000 7ff59de00700 1 -- 172.21.15.72:0/2948296345 >> 172.21.15.72:0/2948296345 conn(0x7ff5980fb3d0 msgr2=0x7ff5980fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.096+0000 7ff59de00700 1 -- 172.21.15.72:0/2948296345 shutdown_connections 2024-03-19T05:53:16.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.096+0000 7ff59de00700 1 -- 172.21.15.72:0/2948296345 wait complete. 2024-03-19T05:53:16.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.098+0000 7ff59de00700 1 Processor -- start 2024-03-19T05:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.098+0000 7ff59de00700 1 -- start start 2024-03-19T05:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.098+0000 7ff59de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5980ffe20 0x7ff598194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.098+0000 7ff59de00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5981954c0 con 0x7ff5980ffe20 2024-03-19T05:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.099+0000 7ff596a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5980ffe20 0x7ff598194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.099+0000 7ff596a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5980ffe20 0x7ff598194f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53652/0 (socket says 172.21.15.72:53652) 2024-03-19T05:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.099+0000 7ff596a00700 1 -- 172.21.15.72:0/428947110 learned_addr learned my addr 172.21.15.72:0/428947110 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.099+0000 7ff596a00700 1 -- 172.21.15.72:0/428947110 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5880095f0 con 0x7ff5980ffe20 2024-03-19T05:53:16.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.099+0000 7ff596a00700 1 --2- 172.21.15.72:0/428947110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5980ffe20 0x7ff598194f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff5880092e0 tx=0x7ff588009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.100+0000 7ff59ca00700 1 -- 172.21.15.72:0/428947110 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff58801d070 con 0x7ff5980ffe20 2024-03-19T05:53:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.100+0000 7ff59ca00700 1 -- 172.21.15.72:0/428947110 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff58800be10 con 0x7ff5980ffe20 2024-03-19T05:53:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.100+0000 7ff59de00700 1 -- 172.21.15.72:0/428947110 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5981956c0 con 0x7ff5980ffe20 2024-03-19T05:53:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.100+0000 7ff59ca00700 1 -- 172.21.15.72:0/428947110 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff58800f460 con 0x7ff5980ffe20 2024-03-19T05:53:16.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.100+0000 7ff59de00700 1 -- 172.21.15.72:0/428947110 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff598195b60 con 0x7ff5980ffe20 2024-03-19T05:53:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.101+0000 7ff59ca00700 1 -- 172.21.15.72:0/428947110 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7ff58800b960 con 0x7ff5980ffe20 2024-03-19T05:53:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.101+0000 7ff59de00700 1 -- 172.21.15.72:0/428947110 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59818ea80 con 0x7ff5980ffe20 2024-03-19T05:53:16.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.101+0000 7ff59ca00700 1 --2- 172.21.15.72:0/428947110 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff57c038490 0x7ff57c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:16.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.101+0000 7ff59ca00700 1 -- 172.21.15.72:0/428947110 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff58804c2b0 con 0x7ff5980ffe20 2024-03-19T05:53:16.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.102+0000 7ff596000700 1 --2- 172.21.15.72:0/428947110 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff57c038490 0x7ff57c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:16.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.102+0000 7ff596000700 1 --2- 172.21.15.72:0/428947110 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff57c038490 0x7ff57c03a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff584006fd0 tx=0x7ff584006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:16.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.107+0000 7ff59ca00700 1 -- 172.21.15.72:0/428947110 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff588005c00 con 0x7ff5980ffe20 2024-03-19T05:53:16.213 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:15 smithi072 ceph-mon[28706]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:16.213 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:15 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:16.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:16.328+0000 7ff59de00700 1 -- 172.21.15.72:0/428947110 --> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5981008b0 con 0x7ff57c038490 2024-03-19T05:53:17.948 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:17 smithi072 ceph-mon[28706]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:53:17.948 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:17 smithi072 ceph-mon[28706]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:17.948 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:17 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:17.948 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:17 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:17.948 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:17 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:17.948 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:17 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:17.948 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:17 smithi072 ceph-mon[28706]: Deploying daemon node-exporter.smithi072 on smithi072 2024-03-19T05:53:19.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:18 smithi072 ceph-mon[28706]: Deploying cephadm binary to smithi172 2024-03-19T05:53:20.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:19 smithi072 ceph-mon[28706]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:21.022 INFO:teuthology.orchestra.run.smithi072.stdout:Added host 'smithi172' with addr '172.21.15.172' 2024-03-19T05:53:21.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:21.025+0000 7ff59ca00700 1 -- 172.21.15.72:0/428947110 <== mgr.14164 v2:172.21.15.72:6800/1922058375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ff5981008b0 con 0x7ff57c038490 2024-03-19T05:53:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:21.030+0000 7ff59de00700 1 -- 172.21.15.72:0/428947110 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff57c038490 msgr2=0x7ff57c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:21.030+0000 7ff59de00700 1 --2- 172.21.15.72:0/428947110 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff57c038490 0x7ff57c03a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff584006fd0 tx=0x7ff584006e40 comp rx=0 tx=0).stop 2024-03-19T05:53:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:21.030+0000 7ff59de00700 1 -- 172.21.15.72:0/428947110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5980ffe20 msgr2=0x7ff598194f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:21.030+0000 7ff59de00700 1 --2- 172.21.15.72:0/428947110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5980ffe20 0x7ff598194f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff5880092e0 tx=0x7ff588009e60 comp rx=0 tx=0).stop 2024-03-19T05:53:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:21.030+0000 7ff59de00700 1 -- 172.21.15.72:0/428947110 shutdown_connections 2024-03-19T05:53:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:21.030+0000 7ff59de00700 1 --2- 172.21.15.72:0/428947110 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff57c038490 0x7ff57c03a940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:21.030+0000 7ff59de00700 1 --2- 172.21.15.72:0/428947110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5980ffe20 0x7ff598194f80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:21.030+0000 7ff59de00700 1 -- 172.21.15.72:0/428947110 >> 172.21.15.72:0/428947110 conn(0x7ff5980fb3d0 msgr2=0x7ff5980fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:21.030+0000 7ff59de00700 1 -- 172.21.15.72:0/428947110 shutdown_connections 2024-03-19T05:53:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:21.030+0000 7ff59de00700 1 -- 172.21.15.72:0/428947110 wait complete. 2024-03-19T05:53:21.960 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:21 smithi072 ceph-mon[28706]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:21.960 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:21 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:21.960 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:21 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:21.960 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:21 smithi072 ceph-mon[28706]: Added host smithi172 2024-03-19T05:53:22.294 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph orch host ls --format=json 2024-03-19T05:53:22.687 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:53:24.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:23 smithi072 ceph-mon[28706]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:24.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:23 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:23 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:23 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:23 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:23 smithi072 ceph-mon[28706]: Deploying daemon alertmanager.smithi072 on smithi072 2024-03-19T05:53:25.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.337+0000 7f5870400700 1 -- 172.21.15.72:0/2383735257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5868102040 msgr2=0x7f5868102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:25.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.337+0000 7f5870400700 1 --2- 172.21.15.72:0/2383735257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5868102040 0x7f5868102450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f585c009910 tx=0x7f585c009c20 comp rx=0 tx=0).stop 2024-03-19T05:53:25.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.337+0000 7f5870400700 1 -- 172.21.15.72:0/2383735257 shutdown_connections 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.337+0000 7f5870400700 1 --2- 172.21.15.72:0/2383735257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5868102040 0x7f5868102450 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.337+0000 7f5870400700 1 -- 172.21.15.72:0/2383735257 >> 172.21.15.72:0/2383735257 conn(0x7f58680fd700 msgr2=0x7f58680ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.337+0000 7f5870400700 1 -- 172.21.15.72:0/2383735257 shutdown_connections 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.337+0000 7f5870400700 1 -- 172.21.15.72:0/2383735257 wait complete. 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.339+0000 7f5870400700 1 Processor -- start 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.339+0000 7f5870400700 1 -- start start 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.339+0000 7f5870400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5868102040 0x7f58681971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.339+0000 7f5870400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5868197700 con 0x7f5868102040 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.339+0000 7f586da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5868102040 0x7f58681971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.339+0000 7f586da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5868102040 0x7f58681971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57316/0 (socket says 172.21.15.72:57316) 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.339+0000 7f586da00700 1 -- 172.21.15.72:0/4003997329 learned_addr learned my addr 172.21.15.72:0/4003997329 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.340+0000 7f586da00700 1 -- 172.21.15.72:0/4003997329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0095f0 con 0x7f5868102040 2024-03-19T05:53:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.340+0000 7f586da00700 1 --2- 172.21.15.72:0/4003997329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5868102040 0x7f58681971c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f585c005950 tx=0x7f585c009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.340+0000 7f5866000700 1 -- 172.21.15.72:0/4003997329 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f585c01d070 con 0x7f5868102040 2024-03-19T05:53:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.340+0000 7f5866000700 1 -- 172.21.15.72:0/4003997329 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f585c00be10 con 0x7f5868102040 2024-03-19T05:53:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.340+0000 7f5870400700 1 -- 172.21.15.72:0/4003997329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5868197900 con 0x7f5868102040 2024-03-19T05:53:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.340+0000 7f5866000700 1 -- 172.21.15.72:0/4003997329 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f585c00f460 con 0x7f5868102040 2024-03-19T05:53:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.340+0000 7f5870400700 1 -- 172.21.15.72:0/4003997329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5868197da0 con 0x7f5868102040 2024-03-19T05:53:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.341+0000 7f5866000700 1 -- 172.21.15.72:0/4003997329 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f585c0227c0 con 0x7f5868102040 2024-03-19T05:53:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.341+0000 7f5870400700 1 -- 172.21.15.72:0/4003997329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5868190d20 con 0x7f5868102040 2024-03-19T05:53:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.342+0000 7f5866000700 1 --2- 172.21.15.72:0/4003997329 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f5850038490 0x7f585003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.342+0000 7f5866000700 1 -- 172.21.15.72:0/4003997329 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f585c04c4f0 con 0x7f5868102040 2024-03-19T05:53:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.342+0000 7f586d000700 1 --2- 172.21.15.72:0/4003997329 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f5850038490 0x7f585003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.343+0000 7f586d000700 1 --2- 172.21.15.72:0/4003997329 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f5850038490 0x7f585003a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5854006fd0 tx=0x7f5854006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.347+0000 7f5866000700 1 -- 172.21.15.72:0/4003997329 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f585c02bba0 con 0x7f5868102040 2024-03-19T05:53:25.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.581+0000 7f5870400700 1 -- 172.21.15.72:0/4003997329 --> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5868061190 con 0x7f5850038490 2024-03-19T05:53:25.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.584+0000 7f5866000700 1 -- 172.21.15.72:0/4003997329 <== mgr.14164 v2:172.21.15.72:6800/1922058375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f5868061190 con 0x7f5850038490 2024-03-19T05:53:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:53:25.578 INFO:teuthology.orchestra.run.smithi072.stdout:[{"addr": "172.21.15.72", "hostname": "smithi072", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2024-03-19T05:53:25.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.587+0000 7f5870400700 1 -- 172.21.15.72:0/4003997329 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f5850038490 msgr2=0x7f585003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:25.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.587+0000 7f5870400700 1 --2- 172.21.15.72:0/4003997329 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f5850038490 0x7f585003a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5854006fd0 tx=0x7f5854006e40 comp rx=0 tx=0).stop 2024-03-19T05:53:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.587+0000 7f5870400700 1 -- 172.21.15.72:0/4003997329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5868102040 msgr2=0x7f58681971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.587+0000 7f5870400700 1 --2- 172.21.15.72:0/4003997329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5868102040 0x7f58681971c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f585c005950 tx=0x7f585c009e60 comp rx=0 tx=0).stop 2024-03-19T05:53:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.588+0000 7f5870400700 1 -- 172.21.15.72:0/4003997329 shutdown_connections 2024-03-19T05:53:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.588+0000 7f5870400700 1 --2- 172.21.15.72:0/4003997329 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f5850038490 0x7f585003a940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.588+0000 7f5870400700 1 --2- 172.21.15.72:0/4003997329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5868102040 0x7f58681971c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.588+0000 7f5870400700 1 -- 172.21.15.72:0/4003997329 >> 172.21.15.72:0/4003997329 conn(0x7f58680fd700 msgr2=0x7f58680ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.588+0000 7f5870400700 1 -- 172.21.15.72:0/4003997329 shutdown_connections 2024-03-19T05:53:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:25.588+0000 7f5870400700 1 -- 172.21.15.72:0/4003997329 wait complete. 2024-03-19T05:53:26.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:25 smithi072 ceph-mon[28706]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:26.696 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-19T05:53:26.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph osd crush tunables default 2024-03-19T05:53:27.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:26 smithi072 ceph-mon[28706]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-19T05:53:27.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:26 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:28.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:27 smithi072 ceph-mon[28706]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:28.496 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:53:30.120 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:29 smithi072 ceph-mon[28706]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:32.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:31 smithi072 ceph-mon[28706]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:32.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.947+0000 7fd37b600700 1 -- 172.21.15.72:0/3608863445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd374074d20 msgr2=0x7fd374073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:32.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.947+0000 7fd37b600700 1 --2- 172.21.15.72:0/3608863445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd374074d20 0x7fd374073180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd368009910 tx=0x7fd368009c20 comp rx=0 tx=0).stop 2024-03-19T05:53:32.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.947+0000 7fd37b600700 1 -- 172.21.15.72:0/3608863445 shutdown_connections 2024-03-19T05:53:32.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.947+0000 7fd37b600700 1 --2- 172.21.15.72:0/3608863445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd374074d20 0x7fd374073180 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:32.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.947+0000 7fd37b600700 1 -- 172.21.15.72:0/3608863445 >> 172.21.15.72:0/3608863445 conn(0x7fd3740fb3d0 msgr2=0x7fd3740fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:32.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.947+0000 7fd37b600700 1 -- 172.21.15.72:0/3608863445 shutdown_connections 2024-03-19T05:53:32.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.947+0000 7fd37b600700 1 -- 172.21.15.72:0/3608863445 wait complete. 2024-03-19T05:53:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.948+0000 7fd37b600700 1 Processor -- start 2024-03-19T05:53:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.948+0000 7fd37b600700 1 -- start start 2024-03-19T05:53:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.949+0000 7fd37b600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd374074d20 0x7fd3741971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.949+0000 7fd37b600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3741976e0 con 0x7fd374074d20 2024-03-19T05:53:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.949+0000 7fd378c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd374074d20 0x7fd3741971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.949+0000 7fd378c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd374074d20 0x7fd3741971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57342/0 (socket says 172.21.15.72:57342) 2024-03-19T05:53:32.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.949+0000 7fd378c00700 1 -- 172.21.15.72:0/1777827236 learned_addr learned my addr 172.21.15.72:0/1777827236 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:53:32.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.949+0000 7fd378c00700 1 -- 172.21.15.72:0/1777827236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3680095f0 con 0x7fd374074d20 2024-03-19T05:53:32.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.950+0000 7fd378c00700 1 --2- 172.21.15.72:0/1777827236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd374074d20 0x7fd3741971a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd3680092e0 tx=0x7fd368009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:32.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.950+0000 7fd371600700 1 -- 172.21.15.72:0/1777827236 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd36801d070 con 0x7fd374074d20 2024-03-19T05:53:32.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.950+0000 7fd371600700 1 -- 172.21.15.72:0/1777827236 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd36800be10 con 0x7fd374074d20 2024-03-19T05:53:32.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.950+0000 7fd37b600700 1 -- 172.21.15.72:0/1777827236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3741978e0 con 0x7fd374074d20 2024-03-19T05:53:32.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.950+0000 7fd371600700 1 -- 172.21.15.72:0/1777827236 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd36800f460 con 0x7fd374074d20 2024-03-19T05:53:32.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.950+0000 7fd37b600700 1 -- 172.21.15.72:0/1777827236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd374197d80 con 0x7fd374074d20 2024-03-19T05:53:32.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.951+0000 7fd371600700 1 -- 172.21.15.72:0/1777827236 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fd368022470 con 0x7fd374074d20 2024-03-19T05:53:32.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.951+0000 7fd37b600700 1 -- 172.21.15.72:0/1777827236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd374190cf0 con 0x7fd374074d20 2024-03-19T05:53:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.952+0000 7fd371600700 1 --2- 172.21.15.72:0/1777827236 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd35c0384e0 0x7fd35c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.952+0000 7fd371600700 1 -- 172.21.15.72:0/1777827236 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd36804c510 con 0x7fd374074d20 2024-03-19T05:53:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.952+0000 7fd373e00700 1 --2- 172.21.15.72:0/1777827236 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd35c0384e0 0x7fd35c03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:32.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.953+0000 7fd373e00700 1 --2- 172.21.15.72:0/1777827236 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd35c0384e0 0x7fd35c03a990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd360006fd0 tx=0x7fd360006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:32.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:32.957+0000 7fd371600700 1 -- 172.21.15.72:0/1777827236 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd36800b960 con 0x7fd374074d20 2024-03-19T05:53:33.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:33.184+0000 7fd37b600700 1 -- 172.21.15.72:0/1777827236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd37402cc30 con 0x7fd374074d20 2024-03-19T05:53:33.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:33.928+0000 7fd371600700 1 -- 172.21.15.72:0/1777827236 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd368027070 con 0x7fd374074d20 2024-03-19T05:53:33.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:33.931+0000 7fd37b600700 1 -- 172.21.15.72:0/1777827236 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd35c0384e0 msgr2=0x7fd35c03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:33.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:33.932+0000 7fd37b600700 1 --2- 172.21.15.72:0/1777827236 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd35c0384e0 0x7fd35c03a990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd360006fd0 tx=0x7fd360006e40 comp rx=0 tx=0).stop 2024-03-19T05:53:33.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:33.932+0000 7fd37b600700 1 -- 172.21.15.72:0/1777827236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd374074d20 msgr2=0x7fd3741971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:33.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:33.932+0000 7fd37b600700 1 --2- 172.21.15.72:0/1777827236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd374074d20 0x7fd3741971a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd3680092e0 tx=0x7fd368009e60 comp rx=0 tx=0).stop 2024-03-19T05:53:33.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:33.932+0000 7fd37b600700 1 -- 172.21.15.72:0/1777827236 shutdown_connections 2024-03-19T05:53:33.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:33.932+0000 7fd37b600700 1 --2- 172.21.15.72:0/1777827236 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd35c0384e0 0x7fd35c03a990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:33.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:33.932+0000 7fd37b600700 1 --2- 172.21.15.72:0/1777827236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd374074d20 0x7fd3741971a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:33.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:33.932+0000 7fd37b600700 1 -- 172.21.15.72:0/1777827236 >> 172.21.15.72:0/1777827236 conn(0x7fd3740fb3d0 msgr2=0x7fd3740fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:33.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:33.932+0000 7fd37b600700 1 -- 172.21.15.72:0/1777827236 shutdown_connections 2024-03-19T05:53:33.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:53:33.932+0000 7fd37b600700 1 -- 172.21.15.72:0/1777827236 wait complete. 2024-03-19T05:53:33.927 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2024-03-19T05:53:34.201 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:33 smithi072 ceph-mon[28706]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:34.201 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:33 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1777827236' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-19T05:53:35.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:34 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1777827236' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-19T05:53:35.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:34 smithi072 ceph-mon[28706]: osdmap e4: 0 total, 0 up, 0 in 2024-03-19T05:53:35.756 INFO:tasks.cephadm:Adding mon.smithi072 on smithi072 2024-03-19T05:53:35.756 INFO:tasks.cephadm:Adding mon.smithi172 on smithi172 2024-03-19T05:53:35.756 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph orch apply mon '2;smithi072:172.21.15.72=smithi072;smithi172:172.21.15.172=smithi172' 2024-03-19T05:53:35.987 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:35 smithi072 ceph-mon[28706]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:36.144 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:53:36.239 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:53:38.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:37 smithi072 ceph-mon[28706]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:38.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:37 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:38.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:37 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:38.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:37 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:38.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:37 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:38.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:37 smithi072 ceph-mon[28706]: Regenerating cephadm self-signed grafana TLS certificates 2024-03-19T05:53:38.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:37 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:38.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:37 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:38.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:37 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-19T05:53:38.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:37 smithi072 ceph-mon[28706]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-19T05:53:38.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:37 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:38.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:37 smithi072 ceph-mon[28706]: Deploying daemon grafana.smithi072 on smithi072 2024-03-19T05:53:38.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.262+0000 7fa63ac00700 1 -- 172.21.15.172:0/4039089358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6341008b0 msgr2=0x7fa634102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:38.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.262+0000 7fa63ac00700 1 --2- 172.21.15.172:0/4039089358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6341008b0 0x7fa634102c90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa624009910 tx=0x7fa624009c20 comp rx=0 tx=0).stop 2024-03-19T05:53:38.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.262+0000 7fa63ac00700 1 -- 172.21.15.172:0/4039089358 shutdown_connections 2024-03-19T05:53:38.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.262+0000 7fa63ac00700 1 --2- 172.21.15.172:0/4039089358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6341008b0 0x7fa634102c90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:38.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.262+0000 7fa63ac00700 1 -- 172.21.15.172:0/4039089358 >> 172.21.15.172:0/4039089358 conn(0x7fa6340fa2b0 msgr2=0x7fa6340fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:38.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.262+0000 7fa63ac00700 1 -- 172.21.15.172:0/4039089358 shutdown_connections 2024-03-19T05:53:38.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.262+0000 7fa63ac00700 1 -- 172.21.15.172:0/4039089358 wait complete. 2024-03-19T05:53:38.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.263+0000 7fa63ac00700 1 Processor -- start 2024-03-19T05:53:38.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.263+0000 7fa63ac00700 1 -- start start 2024-03-19T05:53:38.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.264+0000 7fa63ac00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6341008b0 0x7fa634197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:38.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.264+0000 7fa63ac00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6341976c0 con 0x7fa6341008b0 2024-03-19T05:53:38.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.264+0000 7fa633e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6341008b0 0x7fa634197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:38.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.264+0000 7fa633e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6341008b0 0x7fa634197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:46038/0 (socket says 172.21.15.172:46038) 2024-03-19T05:53:38.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.264+0000 7fa633e00700 1 -- 172.21.15.172:0/2989383314 learned_addr learned my addr 172.21.15.172:0/2989383314 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:53:38.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.265+0000 7fa633e00700 1 -- 172.21.15.172:0/2989383314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6240095f0 con 0x7fa6341008b0 2024-03-19T05:53:38.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.266+0000 7fa633e00700 1 --2- 172.21.15.172:0/2989383314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6341008b0 0x7fa634197180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa6240092e0 tx=0x7fa624009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:38.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.266+0000 7fa631600700 1 -- 172.21.15.172:0/2989383314 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa62401d070 con 0x7fa6341008b0 2024-03-19T05:53:38.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.266+0000 7fa63ac00700 1 -- 172.21.15.172:0/2989383314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6341978c0 con 0x7fa6341008b0 2024-03-19T05:53:38.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.266+0000 7fa631600700 1 -- 172.21.15.172:0/2989383314 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa62400be10 con 0x7fa6341008b0 2024-03-19T05:53:38.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.266+0000 7fa631600700 1 -- 172.21.15.172:0/2989383314 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa62400f460 con 0x7fa6341008b0 2024-03-19T05:53:38.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.266+0000 7fa63ac00700 1 -- 172.21.15.172:0/2989383314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa634197d60 con 0x7fa6341008b0 2024-03-19T05:53:38.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.267+0000 7fa63ac00700 1 -- 172.21.15.172:0/2989383314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa634190f00 con 0x7fa6341008b0 2024-03-19T05:53:38.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.268+0000 7fa631600700 1 -- 172.21.15.172:0/2989383314 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fa624022470 con 0x7fa6341008b0 2024-03-19T05:53:38.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.268+0000 7fa631600700 1 --2- 172.21.15.172:0/2989383314 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fa618038490 0x7fa61803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:38.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.268+0000 7fa631600700 1 -- 172.21.15.172:0/2989383314 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa62404c560 con 0x7fa6341008b0 2024-03-19T05:53:38.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.269+0000 7fa62be00700 1 --2- 172.21.15.172:0/2989383314 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fa618038490 0x7fa61803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:38.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.270+0000 7fa62be00700 1 --2- 172.21.15.172:0/2989383314 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fa618038490 0x7fa61803a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa61c006fd0 tx=0x7fa61c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:38.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.285+0000 7fa631600700 1 -- 172.21.15.172:0/2989383314 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa62400b960 con 0x7fa6341008b0 2024-03-19T05:53:38.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.512+0000 7fa63ac00700 1 -- 172.21.15.172:0/2989383314 --> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi072:172.21.15.72=smithi072;smithi172:172.21.15.172=smithi172", "target": ["mon-mgr", ""]}) v1 -- 0x7fa634061300 con 0x7fa618038490 2024-03-19T05:53:38.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.527+0000 7fa631600700 1 -- 172.21.15.172:0/2989383314 <== mgr.14164 v2:172.21.15.72:6800/1922058375 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa634061300 con 0x7fa618038490 2024-03-19T05:53:38.521 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mon update... 2024-03-19T05:53:38.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.530+0000 7fa63ac00700 1 -- 172.21.15.172:0/2989383314 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fa618038490 msgr2=0x7fa61803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:38.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.530+0000 7fa63ac00700 1 --2- 172.21.15.172:0/2989383314 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fa618038490 0x7fa61803a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa61c006fd0 tx=0x7fa61c006e40 comp rx=0 tx=0).stop 2024-03-19T05:53:38.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.530+0000 7fa63ac00700 1 -- 172.21.15.172:0/2989383314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6341008b0 msgr2=0x7fa634197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:38.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.530+0000 7fa63ac00700 1 --2- 172.21.15.172:0/2989383314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6341008b0 0x7fa634197180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa6240092e0 tx=0x7fa624009e60 comp rx=0 tx=0).stop 2024-03-19T05:53:38.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.530+0000 7fa63ac00700 1 -- 172.21.15.172:0/2989383314 shutdown_connections 2024-03-19T05:53:38.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.530+0000 7fa63ac00700 1 --2- 172.21.15.172:0/2989383314 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fa618038490 0x7fa61803a940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:38.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.530+0000 7fa63ac00700 1 --2- 172.21.15.172:0/2989383314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6341008b0 0x7fa634197180 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:38.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.530+0000 7fa63ac00700 1 -- 172.21.15.172:0/2989383314 >> 172.21.15.172:0/2989383314 conn(0x7fa6340fa2b0 msgr2=0x7fa6340fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:38.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.530+0000 7fa63ac00700 1 -- 172.21.15.172:0/2989383314 shutdown_connections 2024-03-19T05:53:38.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:38.530+0000 7fa63ac00700 1 -- 172.21.15.172:0/2989383314 wait complete. 2024-03-19T05:53:39.228 DEBUG:teuthology.orchestra.run.smithi172:mon.smithi172> sudo journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi172.service 2024-03-19T05:53:39.239 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:53:39.239 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:53:39.632 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:53:39.726 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:53:39.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:39 smithi072 ceph-mon[28706]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi072:172.21.15.72=smithi072;smithi172:172.21.15.172=smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:53:39.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:39 smithi072 ceph-mon[28706]: Saving service mon spec with placement smithi072:172.21.15.72=smithi072;smithi172:172.21.15.172=smithi172;count:2 2024-03-19T05:53:39.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:39 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:39.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:39 smithi072 ceph-mon[28706]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:41.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.649+0000 7f1a36400700 1 -- 172.21.15.172:0/2253819722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a300ffe20 msgr2=0x7f1a30100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:41.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.649+0000 7f1a36400700 1 --2- 172.21.15.172:0/2253819722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a300ffe20 0x7f1a30100230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009910 tx=0x7f1a20009c20 comp rx=0 tx=0).stop 2024-03-19T05:53:41.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.649+0000 7f1a36400700 1 -- 172.21.15.172:0/2253819722 shutdown_connections 2024-03-19T05:53:41.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.649+0000 7f1a36400700 1 --2- 172.21.15.172:0/2253819722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a300ffe20 0x7f1a30100230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:41.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.650+0000 7f1a36400700 1 -- 172.21.15.172:0/2253819722 >> 172.21.15.172:0/2253819722 conn(0x7f1a300fb3d0 msgr2=0x7f1a300fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:41.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.650+0000 7f1a36400700 1 -- 172.21.15.172:0/2253819722 shutdown_connections 2024-03-19T05:53:41.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.650+0000 7f1a36400700 1 -- 172.21.15.172:0/2253819722 wait complete. 2024-03-19T05:53:41.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.651+0000 7f1a36400700 1 Processor -- start 2024-03-19T05:53:41.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.651+0000 7f1a36400700 1 -- start start 2024-03-19T05:53:41.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.652+0000 7f1a36400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a300ffe20 0x7f1a30074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.652+0000 7f1a36400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a30075030 con 0x7f1a300ffe20 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.652+0000 7f1a2f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a300ffe20 0x7f1a30074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.653+0000 7f1a2f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a300ffe20 0x7f1a30074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:49254/0 (socket says 172.21.15.172:49254) 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.653+0000 7f1a2f400700 1 -- 172.21.15.172:0/1407196639 learned_addr learned my addr 172.21.15.172:0/1407196639 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.653+0000 7f1a2f400700 1 -- 172.21.15.172:0/1407196639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a200095f0 con 0x7f1a300ffe20 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.654+0000 7f1a2f400700 1 --2- 172.21.15.172:0/1407196639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a300ffe20 0x7f1a30074af0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1a200092e0 tx=0x7f1a20009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.654+0000 7f1a2cc00700 1 -- 172.21.15.172:0/1407196639 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a2001d070 con 0x7f1a300ffe20 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.654+0000 7f1a2cc00700 1 -- 172.21.15.172:0/1407196639 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1a2000be10 con 0x7f1a300ffe20 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.654+0000 7f1a36400700 1 -- 172.21.15.172:0/1407196639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a30073140 con 0x7f1a300ffe20 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.654+0000 7f1a2cc00700 1 -- 172.21.15.172:0/1407196639 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a2000f460 con 0x7f1a300ffe20 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.654+0000 7f1a36400700 1 -- 172.21.15.172:0/1407196639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a300735e0 con 0x7f1a300ffe20 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.656+0000 7f1a36400700 1 -- 172.21.15.172:0/1407196639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a30062380 con 0x7f1a300ffe20 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.656+0000 7f1a2cc00700 1 -- 172.21.15.172:0/1407196639 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f1a20022470 con 0x7f1a300ffe20 2024-03-19T05:53:41.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.656+0000 7f1a2cc00700 1 --2- 172.21.15.172:0/1407196639 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1a140384e0 0x7f1a1403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:41.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.656+0000 7f1a2cc00700 1 -- 172.21.15.172:0/1407196639 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1a2004c2a0 con 0x7f1a300ffe20 2024-03-19T05:53:41.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.657+0000 7f1a26a00700 1 --2- 172.21.15.172:0/1407196639 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1a140384e0 0x7f1a1403a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:41.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.658+0000 7f1a26a00700 1 --2- 172.21.15.172:0/1407196639 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1a140384e0 0x7f1a1403a990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1a18006fd0 tx=0x7f1a18006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:41.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.668+0000 7f1a2cc00700 1 -- 172.21.15.172:0/1407196639 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1a2000b960 con 0x7f1a300ffe20 2024-03-19T05:53:41.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.958+0000 7f1a36400700 1 -- 172.21.15.172:0/1407196639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1a3018e460 con 0x7f1a300ffe20 2024-03-19T05:53:41.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.960+0000 7f1a2cc00700 1 -- 172.21.15.172:0/1407196639 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f1a20027030 con 0x7f1a300ffe20 2024-03-19T05:53:41.952 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:53:41.953 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:53:41.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.962+0000 7f1a36400700 1 -- 172.21.15.172:0/1407196639 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1a140384e0 msgr2=0x7f1a1403a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:41.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.962+0000 7f1a36400700 1 --2- 172.21.15.172:0/1407196639 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1a140384e0 0x7f1a1403a990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1a18006fd0 tx=0x7f1a18006e40 comp rx=0 tx=0).stop 2024-03-19T05:53:41.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.962+0000 7f1a36400700 1 -- 172.21.15.172:0/1407196639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a300ffe20 msgr2=0x7f1a30074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:41.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.962+0000 7f1a36400700 1 --2- 172.21.15.172:0/1407196639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a300ffe20 0x7f1a30074af0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1a200092e0 tx=0x7f1a20009e60 comp rx=0 tx=0).stop 2024-03-19T05:53:41.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.962+0000 7f1a36400700 1 -- 172.21.15.172:0/1407196639 shutdown_connections 2024-03-19T05:53:41.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.962+0000 7f1a36400700 1 --2- 172.21.15.172:0/1407196639 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f1a140384e0 0x7f1a1403a990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:41.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.962+0000 7f1a36400700 1 --2- 172.21.15.172:0/1407196639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a300ffe20 0x7f1a30074af0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:41.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.962+0000 7f1a36400700 1 -- 172.21.15.172:0/1407196639 >> 172.21.15.172:0/1407196639 conn(0x7f1a300fb3d0 msgr2=0x7f1a300fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:41.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.962+0000 7f1a36400700 1 -- 172.21.15.172:0/1407196639 shutdown_connections 2024-03-19T05:53:41.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:41.963+0000 7f1a36400700 1 -- 172.21.15.172:0/1407196639 wait complete. 2024-03-19T05:53:41.956 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:53:42.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:41 smithi072 ceph-mon[28706]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:42.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:41 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:43.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:42 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/1407196639' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:53:43.811 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:53:43.812 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:53:44.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:43 smithi072 ceph-mon[28706]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:44.188 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:53:44.286 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:53:46.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:45 smithi072 ceph-mon[28706]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:46.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.632+0000 7f1313600700 1 -- 172.21.15.172:0/3900654548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f130c0ffe20 msgr2=0x7f130c100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:46.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.632+0000 7f1313600700 1 --2- 172.21.15.172:0/3900654548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f130c0ffe20 0x7f130c100230 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1300009910 tx=0x7f1300009c20 comp rx=0 tx=0).stop 2024-03-19T05:53:46.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.632+0000 7f1313600700 1 -- 172.21.15.172:0/3900654548 shutdown_connections 2024-03-19T05:53:46.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.632+0000 7f1313600700 1 --2- 172.21.15.172:0/3900654548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f130c0ffe20 0x7f130c100230 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:46.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.632+0000 7f1313600700 1 -- 172.21.15.172:0/3900654548 >> 172.21.15.172:0/3900654548 conn(0x7f130c0fb3d0 msgr2=0x7f130c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:46.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.632+0000 7f1313600700 1 -- 172.21.15.172:0/3900654548 shutdown_connections 2024-03-19T05:53:46.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.632+0000 7f1313600700 1 -- 172.21.15.172:0/3900654548 wait complete. 2024-03-19T05:53:46.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.633+0000 7f1313600700 1 Processor -- start 2024-03-19T05:53:46.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.633+0000 7f1313600700 1 -- start start 2024-03-19T05:53:46.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.634+0000 7f1313600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f130c0ffe20 0x7f130c197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:46.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.634+0000 7f1313600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c1976b0 con 0x7f130c0ffe20 2024-03-19T05:53:46.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.634+0000 7f1310c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f130c0ffe20 0x7f130c197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:46.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.634+0000 7f1310c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f130c0ffe20 0x7f130c197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:49272/0 (socket says 172.21.15.172:49272) 2024-03-19T05:53:46.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.634+0000 7f1310c00700 1 -- 172.21.15.172:0/2676292349 learned_addr learned my addr 172.21.15.172:0/2676292349 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:53:46.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.635+0000 7f1310c00700 1 -- 172.21.15.172:0/2676292349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000095f0 con 0x7f130c0ffe20 2024-03-19T05:53:46.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.635+0000 7f1310c00700 1 --2- 172.21.15.172:0/2676292349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f130c0ffe20 0x7f130c197170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f13000092e0 tx=0x7f1300009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:46.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.636+0000 7f1309600700 1 -- 172.21.15.172:0/2676292349 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f130001d070 con 0x7f130c0ffe20 2024-03-19T05:53:46.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.636+0000 7f1309600700 1 -- 172.21.15.172:0/2676292349 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f130000be10 con 0x7f130c0ffe20 2024-03-19T05:53:46.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.636+0000 7f1309600700 1 -- 172.21.15.172:0/2676292349 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f130000f460 con 0x7f130c0ffe20 2024-03-19T05:53:46.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.636+0000 7f1313600700 1 -- 172.21.15.172:0/2676292349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130c1978b0 con 0x7f130c0ffe20 2024-03-19T05:53:46.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.636+0000 7f1313600700 1 -- 172.21.15.172:0/2676292349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c197d50 con 0x7f130c0ffe20 2024-03-19T05:53:46.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.637+0000 7f1313600700 1 -- 172.21.15.172:0/2676292349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130c190e80 con 0x7f130c0ffe20 2024-03-19T05:53:46.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.637+0000 7f1309600700 1 -- 172.21.15.172:0/2676292349 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f1300022470 con 0x7f130c0ffe20 2024-03-19T05:53:46.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.638+0000 7f1309600700 1 --2- 172.21.15.172:0/2676292349 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f12f40384e0 0x7f12f403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:46.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.638+0000 7f1309600700 1 -- 172.21.15.172:0/2676292349 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f130004c2a0 con 0x7f130c0ffe20 2024-03-19T05:53:46.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.638+0000 7f130be00700 1 --2- 172.21.15.172:0/2676292349 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f12f40384e0 0x7f12f403a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:46.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.639+0000 7f130be00700 1 --2- 172.21.15.172:0/2676292349 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f12f40384e0 0x7f12f403a990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f12f8006fd0 tx=0x7f12f8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:46.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.649+0000 7f1309600700 1 -- 172.21.15.172:0/2676292349 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f130000b960 con 0x7f130c0ffe20 2024-03-19T05:53:46.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.951+0000 7f1313600700 1 -- 172.21.15.172:0/2676292349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f130c02cc30 con 0x7f130c0ffe20 2024-03-19T05:53:46.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.952+0000 7f1309600700 1 -- 172.21.15.172:0/2676292349 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f1300027030 con 0x7f130c0ffe20 2024-03-19T05:53:46.945 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:53:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:53:46.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.955+0000 7f1313600700 1 -- 172.21.15.172:0/2676292349 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f12f40384e0 msgr2=0x7f12f403a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:46.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.955+0000 7f1313600700 1 --2- 172.21.15.172:0/2676292349 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f12f40384e0 0x7f12f403a990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f12f8006fd0 tx=0x7f12f8006e40 comp rx=0 tx=0).stop 2024-03-19T05:53:46.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.955+0000 7f1313600700 1 -- 172.21.15.172:0/2676292349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f130c0ffe20 msgr2=0x7f130c197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:46.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.955+0000 7f1313600700 1 --2- 172.21.15.172:0/2676292349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f130c0ffe20 0x7f130c197170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f13000092e0 tx=0x7f1300009e60 comp rx=0 tx=0).stop 2024-03-19T05:53:46.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.955+0000 7f1313600700 1 -- 172.21.15.172:0/2676292349 shutdown_connections 2024-03-19T05:53:46.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.955+0000 7f1313600700 1 --2- 172.21.15.172:0/2676292349 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f12f40384e0 0x7f12f403a990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:46.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.955+0000 7f1313600700 1 --2- 172.21.15.172:0/2676292349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f130c0ffe20 0x7f130c197170 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:46.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.955+0000 7f1313600700 1 -- 172.21.15.172:0/2676292349 >> 172.21.15.172:0/2676292349 conn(0x7f130c0fb3d0 msgr2=0x7f130c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:46.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.956+0000 7f1313600700 1 -- 172.21.15.172:0/2676292349 shutdown_connections 2024-03-19T05:53:46.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:46.956+0000 7f1313600700 1 -- 172.21.15.172:0/2676292349 wait complete. 2024-03-19T05:53:46.949 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:53:48.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:47 smithi072 ceph-mon[28706]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:48.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:47 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/2676292349' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:53:48.898 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:53:48.898 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:53:49.273 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:53:49.386 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:53:50.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:49 smithi072 ceph-mon[28706]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:51.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.314+0000 7fbe09400700 1 -- 172.21.15.172:0/1705451117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe04102020 msgr2=0x7fbe04102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:51.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.314+0000 7fbe09400700 1 --2- 172.21.15.172:0/1705451117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe04102020 0x7fbe04102430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009910 tx=0x7fbdf4009c20 comp rx=0 tx=0).stop 2024-03-19T05:53:51.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.314+0000 7fbe09400700 1 -- 172.21.15.172:0/1705451117 shutdown_connections 2024-03-19T05:53:51.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.314+0000 7fbe09400700 1 --2- 172.21.15.172:0/1705451117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe04102020 0x7fbe04102430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:51.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.314+0000 7fbe09400700 1 -- 172.21.15.172:0/1705451117 >> 172.21.15.172:0/1705451117 conn(0x7fbe040fd700 msgr2=0x7fbe040ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:51.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.314+0000 7fbe09400700 1 -- 172.21.15.172:0/1705451117 shutdown_connections 2024-03-19T05:53:51.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.314+0000 7fbe09400700 1 -- 172.21.15.172:0/1705451117 wait complete. 2024-03-19T05:53:51.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.315+0000 7fbe09400700 1 Processor -- start 2024-03-19T05:53:51.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.315+0000 7fbe09400700 1 -- start start 2024-03-19T05:53:51.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.315+0000 7fbe09400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe04102020 0x7fbe041971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:51.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.315+0000 7fbe09400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe041976e0 con 0x7fbe04102020 2024-03-19T05:53:51.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.316+0000 7fbe02800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe04102020 0x7fbe041971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:51.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.316+0000 7fbe02800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe04102020 0x7fbe041971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:38084/0 (socket says 172.21.15.172:38084) 2024-03-19T05:53:51.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.316+0000 7fbe02800700 1 -- 172.21.15.172:0/4135613537 learned_addr learned my addr 172.21.15.172:0/4135613537 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:53:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.317+0000 7fbe02800700 1 -- 172.21.15.172:0/4135613537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf40095f0 con 0x7fbe04102020 2024-03-19T05:53:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.317+0000 7fbe02800700 1 --2- 172.21.15.172:0/4135613537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe04102020 0x7fbe041971a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005950 tx=0x7fbdf4009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.318+0000 7fbdfb400700 1 -- 172.21.15.172:0/4135613537 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdf401d070 con 0x7fbe04102020 2024-03-19T05:53:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.318+0000 7fbe09400700 1 -- 172.21.15.172:0/4135613537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe041978e0 con 0x7fbe04102020 2024-03-19T05:53:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.318+0000 7fbe09400700 1 -- 172.21.15.172:0/4135613537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe04197d80 con 0x7fbe04102020 2024-03-19T05:53:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.318+0000 7fbdfb400700 1 -- 172.21.15.172:0/4135613537 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbdf400be10 con 0x7fbe04102020 2024-03-19T05:53:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.318+0000 7fbdfb400700 1 -- 172.21.15.172:0/4135613537 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdf4017440 con 0x7fbe04102020 2024-03-19T05:53:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.319+0000 7fbe09400700 1 -- 172.21.15.172:0/4135613537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe04190d00 con 0x7fbe04102020 2024-03-19T05:53:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.320+0000 7fbdfb400700 1 -- 172.21.15.172:0/4135613537 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fbdf400b960 con 0x7fbe04102020 2024-03-19T05:53:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.320+0000 7fbdfb400700 1 --2- 172.21.15.172:0/4135613537 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fbde8038490 0x7fbde803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:51.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.320+0000 7fbdfb400700 1 -- 172.21.15.172:0/4135613537 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbdf404c7e0 con 0x7fbe04102020 2024-03-19T05:53:51.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.321+0000 7fbe01e00700 1 --2- 172.21.15.172:0/4135613537 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fbde8038490 0x7fbde803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:51.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.322+0000 7fbe01e00700 1 --2- 172.21.15.172:0/4135613537 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fbde8038490 0x7fbde803a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0006fd0 tx=0x7fbdf0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:51.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.338+0000 7fbdfb400700 1 -- 172.21.15.172:0/4135613537 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbdf40213d0 con 0x7fbe04102020 2024-03-19T05:53:51.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.637+0000 7fbe09400700 1 -- 172.21.15.172:0/4135613537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbe0402ce60 con 0x7fbe04102020 2024-03-19T05:53:51.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.638+0000 7fbdfb400700 1 -- 172.21.15.172:0/4135613537 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fbdf4027030 con 0x7fbe04102020 2024-03-19T05:53:51.631 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:53:51.631 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:53:51.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.640+0000 7fbe09400700 1 -- 172.21.15.172:0/4135613537 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fbde8038490 msgr2=0x7fbde803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:51.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.640+0000 7fbe09400700 1 --2- 172.21.15.172:0/4135613537 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fbde8038490 0x7fbde803a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0006fd0 tx=0x7fbdf0006e40 comp rx=0 tx=0).stop 2024-03-19T05:53:51.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.640+0000 7fbe09400700 1 -- 172.21.15.172:0/4135613537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe04102020 msgr2=0x7fbe041971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:51.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.640+0000 7fbe09400700 1 --2- 172.21.15.172:0/4135613537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe04102020 0x7fbe041971a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005950 tx=0x7fbdf4009e60 comp rx=0 tx=0).stop 2024-03-19T05:53:51.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.641+0000 7fbe09400700 1 -- 172.21.15.172:0/4135613537 shutdown_connections 2024-03-19T05:53:51.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.641+0000 7fbe09400700 1 --2- 172.21.15.172:0/4135613537 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fbde8038490 0x7fbde803a940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:51.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.641+0000 7fbe09400700 1 --2- 172.21.15.172:0/4135613537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe04102020 0x7fbe041971a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:51.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.641+0000 7fbe09400700 1 -- 172.21.15.172:0/4135613537 >> 172.21.15.172:0/4135613537 conn(0x7fbe040fd700 msgr2=0x7fbe040ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:51.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.641+0000 7fbe09400700 1 -- 172.21.15.172:0/4135613537 shutdown_connections 2024-03-19T05:53:51.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:51.641+0000 7fbe09400700 1 -- 172.21.15.172:0/4135613537 wait complete. 2024-03-19T05:53:51.635 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:53:52.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:51 smithi072 ceph-mon[28706]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:52.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:51 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/4135613537' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:53:53.312 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:53:53.312 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:53:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:53:53.788 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:53:54.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:53 smithi072 ceph-mon[28706]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:55.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.636+0000 7fa13a000700 1 -- 172.21.15.172:0/1060656562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa134106440 msgr2=0x7fa134106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:55.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.636+0000 7fa13a000700 1 --2- 172.21.15.172:0/1060656562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa134106440 0x7fa134106850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa124009910 tx=0x7fa124009c20 comp rx=0 tx=0).stop 2024-03-19T05:53:55.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.636+0000 7fa13a000700 1 -- 172.21.15.172:0/1060656562 shutdown_connections 2024-03-19T05:53:55.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.636+0000 7fa13a000700 1 --2- 172.21.15.172:0/1060656562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa134106440 0x7fa134106850 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:55.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.636+0000 7fa13a000700 1 -- 172.21.15.172:0/1060656562 >> 172.21.15.172:0/1060656562 conn(0x7fa1340756e0 msgr2=0x7fa134077b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:55.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.636+0000 7fa13a000700 1 -- 172.21.15.172:0/1060656562 shutdown_connections 2024-03-19T05:53:55.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.636+0000 7fa13a000700 1 -- 172.21.15.172:0/1060656562 wait complete. 2024-03-19T05:53:55.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.637+0000 7fa13a000700 1 Processor -- start 2024-03-19T05:53:55.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.638+0000 7fa13a000700 1 -- start start 2024-03-19T05:53:55.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.638+0000 7fa13a000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa134106440 0x7fa13419b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:55.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.638+0000 7fa13a000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13419bae0 con 0x7fa134106440 2024-03-19T05:53:55.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.638+0000 7fa133400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa134106440 0x7fa13419b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:55.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.639+0000 7fa133400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa134106440 0x7fa13419b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:38104/0 (socket says 172.21.15.172:38104) 2024-03-19T05:53:55.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.639+0000 7fa133400700 1 -- 172.21.15.172:0/3628843051 learned_addr learned my addr 172.21.15.172:0/3628843051 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:53:55.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.639+0000 7fa133400700 1 -- 172.21.15.172:0/3628843051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1240095f0 con 0x7fa134106440 2024-03-19T05:53:55.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.639+0000 7fa133400700 1 --2- 172.21.15.172:0/3628843051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa134106440 0x7fa13419b5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa124005950 tx=0x7fa124009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:55.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.640+0000 7fa130c00700 1 -- 172.21.15.172:0/3628843051 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa12401d070 con 0x7fa134106440 2024-03-19T05:53:55.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.640+0000 7fa13a000700 1 -- 172.21.15.172:0/3628843051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13419bce0 con 0x7fa134106440 2024-03-19T05:53:55.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.640+0000 7fa13a000700 1 -- 172.21.15.172:0/3628843051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13419c180 con 0x7fa134106440 2024-03-19T05:53:55.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.640+0000 7fa130c00700 1 -- 172.21.15.172:0/3628843051 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa12400be10 con 0x7fa134106440 2024-03-19T05:53:55.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.640+0000 7fa130c00700 1 -- 172.21.15.172:0/3628843051 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa124017440 con 0x7fa134106440 2024-03-19T05:53:55.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.641+0000 7fa13a000700 1 -- 172.21.15.172:0/3628843051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa134195110 con 0x7fa134106440 2024-03-19T05:53:55.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.642+0000 7fa130c00700 1 -- 172.21.15.172:0/3628843051 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fa12400b960 con 0x7fa134106440 2024-03-19T05:53:55.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.642+0000 7fa130c00700 1 --2- 172.21.15.172:0/3628843051 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fa1180384e0 0x7fa11803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:55.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.642+0000 7fa130c00700 1 -- 172.21.15.172:0/3628843051 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa12404c3e0 con 0x7fa134106440 2024-03-19T05:53:55.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.643+0000 7fa12aa00700 1 --2- 172.21.15.172:0/3628843051 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fa1180384e0 0x7fa11803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:55.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.644+0000 7fa12aa00700 1 --2- 172.21.15.172:0/3628843051 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fa1180384e0 0x7fa11803a990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00ad30 tx=0x7fa11c0093f0 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:55.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.656+0000 7fa130c00700 1 -- 172.21.15.172:0/3628843051 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa12402ad30 con 0x7fa134106440 2024-03-19T05:53:55.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.957+0000 7fa13a000700 1 -- 172.21.15.172:0/3628843051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa13402cc30 con 0x7fa134106440 2024-03-19T05:53:55.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.958+0000 7fa130c00700 1 -- 172.21.15.172:0/3628843051 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa124027070 con 0x7fa134106440 2024-03-19T05:53:55.952 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:53:55.952 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:53:55.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.961+0000 7fa13a000700 1 -- 172.21.15.172:0/3628843051 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fa1180384e0 msgr2=0x7fa11803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:55.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.961+0000 7fa13a000700 1 --2- 172.21.15.172:0/3628843051 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fa1180384e0 0x7fa11803a990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00ad30 tx=0x7fa11c0093f0 comp rx=0 tx=0).stop 2024-03-19T05:53:55.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.961+0000 7fa13a000700 1 -- 172.21.15.172:0/3628843051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa134106440 msgr2=0x7fa13419b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:55.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.961+0000 7fa13a000700 1 --2- 172.21.15.172:0/3628843051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa134106440 0x7fa13419b5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa124005950 tx=0x7fa124009e60 comp rx=0 tx=0).stop 2024-03-19T05:53:55.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.961+0000 7fa13a000700 1 -- 172.21.15.172:0/3628843051 shutdown_connections 2024-03-19T05:53:55.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.961+0000 7fa13a000700 1 --2- 172.21.15.172:0/3628843051 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fa1180384e0 0x7fa11803a990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:55.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.961+0000 7fa13a000700 1 --2- 172.21.15.172:0/3628843051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa134106440 0x7fa13419b5a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:55.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.961+0000 7fa13a000700 1 -- 172.21.15.172:0/3628843051 >> 172.21.15.172:0/3628843051 conn(0x7fa1340756e0 msgr2=0x7fa1340773a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:55.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.961+0000 7fa13a000700 1 -- 172.21.15.172:0/3628843051 shutdown_connections 2024-03-19T05:53:55.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:55.961+0000 7fa13a000700 1 -- 172.21.15.172:0/3628843051 wait complete. 2024-03-19T05:53:55.956 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:53:56.039 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:55 smithi072 ceph-mon[28706]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:57.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:56 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/3628843051' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:53:57.540 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:53:57.540 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:53:57.924 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:53:58.027 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:53:58.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:57 smithi072 ceph-mon[28706]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:53:58.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:57 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:58.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:57 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:58.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:57 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:58.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:57 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:58.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:57 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:58.118 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:57 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:53:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:58 smithi072 ceph-mon[28706]: Deploying daemon prometheus.smithi072 on smithi072 2024-03-19T05:53:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.828+0000 7f864c000700 1 -- 172.21.15.172:0/3966192027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8644075660 msgr2=0x7f8644075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:53:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.828+0000 7f864c000700 1 --2- 172.21.15.172:0/3966192027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8644075660 0x7f8644075a70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8638009910 tx=0x7f8638009c20 comp rx=0 tx=0).stop 2024-03-19T05:53:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.828+0000 7f864c000700 1 -- 172.21.15.172:0/3966192027 shutdown_connections 2024-03-19T05:53:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.828+0000 7f864c000700 1 --2- 172.21.15.172:0/3966192027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8644075660 0x7f8644075a70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:53:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.828+0000 7f864c000700 1 -- 172.21.15.172:0/3966192027 >> 172.21.15.172:0/3966192027 conn(0x7f86440fd700 msgr2=0x7f86440ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:53:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.828+0000 7f864c000700 1 -- 172.21.15.172:0/3966192027 shutdown_connections 2024-03-19T05:53:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.828+0000 7f864c000700 1 -- 172.21.15.172:0/3966192027 wait complete. 2024-03-19T05:53:59.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.829+0000 7f864c000700 1 Processor -- start 2024-03-19T05:53:59.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.829+0000 7f864c000700 1 -- start start 2024-03-19T05:53:59.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.829+0000 7f864c000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8644075660 0x7f864419b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:59.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.829+0000 7f864c000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864419bb00 con 0x7f8644075660 2024-03-19T05:53:59.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.830+0000 7f8649600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8644075660 0x7f864419b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:59.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.830+0000 7f8649600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8644075660 0x7f864419b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:54490/0 (socket says 172.21.15.172:54490) 2024-03-19T05:53:59.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.830+0000 7f8649600700 1 -- 172.21.15.172:0/2966626392 learned_addr learned my addr 172.21.15.172:0/2966626392 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:53:59.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.831+0000 7f8649600700 1 -- 172.21.15.172:0/2966626392 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380095f0 con 0x7f8644075660 2024-03-19T05:53:59.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.831+0000 7f8649600700 1 --2- 172.21.15.172:0/2966626392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8644075660 0x7f864419b5c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8638005950 tx=0x7f8638009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:59.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.831+0000 7f8642000700 1 -- 172.21.15.172:0/2966626392 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f863801d070 con 0x7f8644075660 2024-03-19T05:53:59.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.831+0000 7f864c000700 1 -- 172.21.15.172:0/2966626392 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864419bd00 con 0x7f8644075660 2024-03-19T05:53:59.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.831+0000 7f8642000700 1 -- 172.21.15.172:0/2966626392 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f863800be10 con 0x7f8644075660 2024-03-19T05:53:59.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.832+0000 7f8642000700 1 -- 172.21.15.172:0/2966626392 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f863800f460 con 0x7f8644075660 2024-03-19T05:53:59.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.832+0000 7f864c000700 1 -- 172.21.15.172:0/2966626392 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864419c1a0 con 0x7f8644075660 2024-03-19T05:53:59.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.833+0000 7f864c000700 1 -- 172.21.15.172:0/2966626392 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8644195090 con 0x7f8644075660 2024-03-19T05:53:59.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.833+0000 7f8642000700 1 -- 172.21.15.172:0/2966626392 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f86380227c0 con 0x7f8644075660 2024-03-19T05:53:59.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.834+0000 7f8642000700 1 --2- 172.21.15.172:0/2966626392 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f862c0384e0 0x7f862c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:53:59.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.834+0000 7f8642000700 1 -- 172.21.15.172:0/2966626392 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f863804c4d0 con 0x7f8644075660 2024-03-19T05:53:59.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.834+0000 7f8648c00700 1 --2- 172.21.15.172:0/2966626392 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f862c0384e0 0x7f862c03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:53:59.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.835+0000 7f8648c00700 1 --2- 172.21.15.172:0/2966626392 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f862c0384e0 0x7f862c03a990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8630006fd0 tx=0x7f8630006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:53:59.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:53:59.851+0000 7f8642000700 1 -- 172.21.15.172:0/2966626392 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f863802ba00 con 0x7f8644075660 2024-03-19T05:54:00.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:53:59 smithi072 ceph-mon[28706]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:00.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:00.146+0000 7f864c000700 1 -- 172.21.15.172:0/2966626392 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f864402cc30 con 0x7f8644075660 2024-03-19T05:54:00.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:00.147+0000 7f8642000700 1 -- 172.21.15.172:0/2966626392 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8638027070 con 0x7f8644075660 2024-03-19T05:54:00.141 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:00.142 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:00.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:00.150+0000 7f864c000700 1 -- 172.21.15.172:0/2966626392 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f862c0384e0 msgr2=0x7f862c03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:00.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:00.150+0000 7f864c000700 1 --2- 172.21.15.172:0/2966626392 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f862c0384e0 0x7f862c03a990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8630006fd0 tx=0x7f8630006e40 comp rx=0 tx=0).stop 2024-03-19T05:54:00.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:00.150+0000 7f864c000700 1 -- 172.21.15.172:0/2966626392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8644075660 msgr2=0x7f864419b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:00.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:00.150+0000 7f864c000700 1 --2- 172.21.15.172:0/2966626392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8644075660 0x7f864419b5c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8638005950 tx=0x7f8638009e60 comp rx=0 tx=0).stop 2024-03-19T05:54:00.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:00.150+0000 7f864c000700 1 -- 172.21.15.172:0/2966626392 shutdown_connections 2024-03-19T05:54:00.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:00.150+0000 7f864c000700 1 --2- 172.21.15.172:0/2966626392 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f862c0384e0 0x7f862c03a990 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:00.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:00.150+0000 7f864c000700 1 --2- 172.21.15.172:0/2966626392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8644075660 0x7f864419b5c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:00.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:00.150+0000 7f864c000700 1 -- 172.21.15.172:0/2966626392 >> 172.21.15.172:0/2966626392 conn(0x7f86440fd700 msgr2=0x7f86440fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:00.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:00.151+0000 7f864c000700 1 -- 172.21.15.172:0/2966626392 shutdown_connections 2024-03-19T05:54:00.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:00.151+0000 7f864c000700 1 -- 172.21.15.172:0/2966626392 wait complete. 2024-03-19T05:54:00.145 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:01.196 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:00 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/2966626392' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:01.197 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:00 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:01.719 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:01.719 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:02.099 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:02.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:01 smithi072 ceph-mon[28706]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:04.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.049+0000 7ff4b8000700 1 -- 172.21.15.172:0/2339777252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4b0102020 msgr2=0x7ff4b0102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:04.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.049+0000 7ff4b8000700 1 --2- 172.21.15.172:0/2339777252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4b0102020 0x7ff4b0102430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009910 tx=0x7ff4a0009c20 comp rx=0 tx=0).stop 2024-03-19T05:54:04.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.049+0000 7ff4b8000700 1 -- 172.21.15.172:0/2339777252 shutdown_connections 2024-03-19T05:54:04.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.049+0000 7ff4b8000700 1 --2- 172.21.15.172:0/2339777252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4b0102020 0x7ff4b0102430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:04.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.049+0000 7ff4b8000700 1 -- 172.21.15.172:0/2339777252 >> 172.21.15.172:0/2339777252 conn(0x7ff4b00fd700 msgr2=0x7ff4b00ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:04.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.049+0000 7ff4b8000700 1 -- 172.21.15.172:0/2339777252 shutdown_connections 2024-03-19T05:54:04.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.049+0000 7ff4b8000700 1 -- 172.21.15.172:0/2339777252 wait complete. 2024-03-19T05:54:04.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.050+0000 7ff4b8000700 1 Processor -- start 2024-03-19T05:54:04.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.050+0000 7ff4b8000700 1 -- start start 2024-03-19T05:54:04.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.051+0000 7ff4b8000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4b0102020 0x7ff4b01971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:04.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.051+0000 7ff4b8000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b01976e0 con 0x7ff4b0102020 2024-03-19T05:54:04.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.051+0000 7ff4b5600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4b0102020 0x7ff4b01971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:04.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.051+0000 7ff4b5600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4b0102020 0x7ff4b01971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:54514/0 (socket says 172.21.15.172:54514) 2024-03-19T05:54:04.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.051+0000 7ff4b5600700 1 -- 172.21.15.172:0/235310912 learned_addr learned my addr 172.21.15.172:0/235310912 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:54:04.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.052+0000 7ff4b5600700 1 -- 172.21.15.172:0/235310912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a00095f0 con 0x7ff4b0102020 2024-03-19T05:54:04.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.052+0000 7ff4b5600700 1 --2- 172.21.15.172:0/235310912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4b0102020 0x7ff4b01971a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0005950 tx=0x7ff4a0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:04.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.053+0000 7ff4ae000700 1 -- 172.21.15.172:0/235310912 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4a001d070 con 0x7ff4b0102020 2024-03-19T05:54:04.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.053+0000 7ff4b8000700 1 -- 172.21.15.172:0/235310912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b01978e0 con 0x7ff4b0102020 2024-03-19T05:54:04.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.053+0000 7ff4ae000700 1 -- 172.21.15.172:0/235310912 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff4a000be10 con 0x7ff4b0102020 2024-03-19T05:54:04.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.053+0000 7ff4b8000700 1 -- 172.21.15.172:0/235310912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b0197d80 con 0x7ff4b0102020 2024-03-19T05:54:04.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.053+0000 7ff4ae000700 1 -- 172.21.15.172:0/235310912 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4a0022d70 con 0x7ff4b0102020 2024-03-19T05:54:04.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.054+0000 7ff4b8000700 1 -- 172.21.15.172:0/235310912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b0190d00 con 0x7ff4b0102020 2024-03-19T05:54:04.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.054+0000 7ff4ae000700 1 -- 172.21.15.172:0/235310912 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7ff4a00227c0 con 0x7ff4b0102020 2024-03-19T05:54:04.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.055+0000 7ff4ae000700 1 --2- 172.21.15.172:0/235310912 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff494038490 0x7ff49403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:04.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.055+0000 7ff4ae000700 1 -- 172.21.15.172:0/235310912 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff4a004c9f0 con 0x7ff4b0102020 2024-03-19T05:54:04.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.056+0000 7ff4b4c00700 1 --2- 172.21.15.172:0/235310912 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff494038490 0x7ff49403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:04.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.057+0000 7ff4b4c00700 1 --2- 172.21.15.172:0/235310912 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff494038490 0x7ff49403a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff49c006fd0 tx=0x7ff49c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:04.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.072+0000 7ff4ae000700 1 -- 172.21.15.172:0/235310912 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff4a000b960 con 0x7ff4b0102020 2024-03-19T05:54:04.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:03 smithi072 ceph-mon[28706]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:04.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.373+0000 7ff4b8000700 1 -- 172.21.15.172:0/235310912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff4b002cc30 con 0x7ff4b0102020 2024-03-19T05:54:04.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.374+0000 7ff4ae000700 1 -- 172.21.15.172:0/235310912 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff4a0027070 con 0x7ff4b0102020 2024-03-19T05:54:04.368 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:04.368 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.377+0000 7ff4b8000700 1 -- 172.21.15.172:0/235310912 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff494038490 msgr2=0x7ff49403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.377+0000 7ff4b8000700 1 --2- 172.21.15.172:0/235310912 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff494038490 0x7ff49403a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff49c006fd0 tx=0x7ff49c006e40 comp rx=0 tx=0).stop 2024-03-19T05:54:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.377+0000 7ff4b8000700 1 -- 172.21.15.172:0/235310912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4b0102020 msgr2=0x7ff4b01971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.377+0000 7ff4b8000700 1 --2- 172.21.15.172:0/235310912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4b0102020 0x7ff4b01971a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0005950 tx=0x7ff4a0009e60 comp rx=0 tx=0).stop 2024-03-19T05:54:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.377+0000 7ff4b8000700 1 -- 172.21.15.172:0/235310912 shutdown_connections 2024-03-19T05:54:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.377+0000 7ff4b8000700 1 --2- 172.21.15.172:0/235310912 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ff494038490 0x7ff49403a940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.377+0000 7ff4b8000700 1 --2- 172.21.15.172:0/235310912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4b0102020 0x7ff4b01971a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.377+0000 7ff4b8000700 1 -- 172.21.15.172:0/235310912 >> 172.21.15.172:0/235310912 conn(0x7ff4b00fd700 msgr2=0x7ff4b00ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:04.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.378+0000 7ff4b8000700 1 -- 172.21.15.172:0/235310912 shutdown_connections 2024-03-19T05:54:04.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:04.378+0000 7ff4b8000700 1 -- 172.21.15.172:0/235310912 wait complete. 2024-03-19T05:54:04.373 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:05.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:04 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/235310912' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:06.216 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:05 smithi072 ceph-mon[28706]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:06.234 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:06.234 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:06.620 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:08.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:07 smithi072 ceph-mon[28706]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:08.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.541+0000 7fd79b400700 1 -- 172.21.15.172:0/2312431865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7941008b0 msgr2=0x7fd794102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:08.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.541+0000 7fd79b400700 1 --2- 172.21.15.172:0/2312431865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7941008b0 0x7fd794102c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd788009910 tx=0x7fd788009c20 comp rx=0 tx=0).stop 2024-03-19T05:54:08.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.541+0000 7fd79b400700 1 -- 172.21.15.172:0/2312431865 shutdown_connections 2024-03-19T05:54:08.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.541+0000 7fd79b400700 1 --2- 172.21.15.172:0/2312431865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7941008b0 0x7fd794102c90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:08.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.541+0000 7fd79b400700 1 -- 172.21.15.172:0/2312431865 >> 172.21.15.172:0/2312431865 conn(0x7fd7940fa2b0 msgr2=0x7fd7940fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:08.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.542+0000 7fd79b400700 1 -- 172.21.15.172:0/2312431865 shutdown_connections 2024-03-19T05:54:08.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.542+0000 7fd79b400700 1 -- 172.21.15.172:0/2312431865 wait complete. 2024-03-19T05:54:08.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.543+0000 7fd79b400700 1 Processor -- start 2024-03-19T05:54:08.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.543+0000 7fd79b400700 1 -- start start 2024-03-19T05:54:08.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.543+0000 7fd79b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7941008b0 0x7fd794194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:08.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.543+0000 7fd79b400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7941954e0 con 0x7fd7941008b0 2024-03-19T05:54:08.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.544+0000 7fd798a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7941008b0 0x7fd794194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:08.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.544+0000 7fd798a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7941008b0 0x7fd794194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:54520/0 (socket says 172.21.15.172:54520) 2024-03-19T05:54:08.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.544+0000 7fd798a00700 1 -- 172.21.15.172:0/3975708121 learned_addr learned my addr 172.21.15.172:0/3975708121 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:54:08.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.545+0000 7fd798a00700 1 -- 172.21.15.172:0/3975708121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7880095f0 con 0x7fd7941008b0 2024-03-19T05:54:08.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.545+0000 7fd798a00700 1 --2- 172.21.15.172:0/3975708121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7941008b0 0x7fd794194fa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd7880092e0 tx=0x7fd788009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:08.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.546+0000 7fd791600700 1 -- 172.21.15.172:0/3975708121 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd78801d070 con 0x7fd7941008b0 2024-03-19T05:54:08.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.546+0000 7fd791600700 1 -- 172.21.15.172:0/3975708121 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd78800be10 con 0x7fd7941008b0 2024-03-19T05:54:08.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.546+0000 7fd791600700 1 -- 172.21.15.172:0/3975708121 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd78800f460 con 0x7fd7941008b0 2024-03-19T05:54:08.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.546+0000 7fd79b400700 1 -- 172.21.15.172:0/3975708121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7941956e0 con 0x7fd7941008b0 2024-03-19T05:54:08.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.546+0000 7fd79b400700 1 -- 172.21.15.172:0/3975708121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd794195b80 con 0x7fd7941008b0 2024-03-19T05:54:08.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.547+0000 7fd79b400700 1 -- 172.21.15.172:0/3975708121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79418eb00 con 0x7fd7941008b0 2024-03-19T05:54:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.548+0000 7fd791600700 1 -- 172.21.15.172:0/3975708121 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fd788022470 con 0x7fd7941008b0 2024-03-19T05:54:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.548+0000 7fd791600700 1 --2- 172.21.15.172:0/3975708121 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd77c0384e0 0x7fd77c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:08.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.548+0000 7fd791600700 1 -- 172.21.15.172:0/3975708121 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd78804c450 con 0x7fd7941008b0 2024-03-19T05:54:08.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.549+0000 7fd793e00700 1 --2- 172.21.15.172:0/3975708121 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd77c0384e0 0x7fd77c03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:08.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.550+0000 7fd793e00700 1 --2- 172.21.15.172:0/3975708121 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd77c0384e0 0x7fd77c03a990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd780006fd0 tx=0x7fd780006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:08.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.563+0000 7fd791600700 1 -- 172.21.15.172:0/3975708121 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd78800b960 con 0x7fd7941008b0 2024-03-19T05:54:08.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.859+0000 7fd79b400700 1 -- 172.21.15.172:0/3975708121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd79402cc30 con 0x7fd7941008b0 2024-03-19T05:54:08.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.860+0000 7fd791600700 1 -- 172.21.15.172:0/3975708121 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd788027030 con 0x7fd7941008b0 2024-03-19T05:54:08.854 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:08.855 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:08.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.863+0000 7fd79b400700 1 -- 172.21.15.172:0/3975708121 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd77c0384e0 msgr2=0x7fd77c03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:08.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.863+0000 7fd79b400700 1 --2- 172.21.15.172:0/3975708121 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd77c0384e0 0x7fd77c03a990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd780006fd0 tx=0x7fd780006e40 comp rx=0 tx=0).stop 2024-03-19T05:54:08.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.863+0000 7fd79b400700 1 -- 172.21.15.172:0/3975708121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7941008b0 msgr2=0x7fd794194fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:08.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.863+0000 7fd79b400700 1 --2- 172.21.15.172:0/3975708121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7941008b0 0x7fd794194fa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd7880092e0 tx=0x7fd788009e60 comp rx=0 tx=0).stop 2024-03-19T05:54:08.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.863+0000 7fd79b400700 1 -- 172.21.15.172:0/3975708121 shutdown_connections 2024-03-19T05:54:08.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.863+0000 7fd79b400700 1 --2- 172.21.15.172:0/3975708121 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd77c0384e0 0x7fd77c03a990 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:08.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.863+0000 7fd79b400700 1 --2- 172.21.15.172:0/3975708121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7941008b0 0x7fd794194fa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:08.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.863+0000 7fd79b400700 1 -- 172.21.15.172:0/3975708121 >> 172.21.15.172:0/3975708121 conn(0x7fd7940fa2b0 msgr2=0x7fd7940faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:08.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.864+0000 7fd79b400700 1 -- 172.21.15.172:0/3975708121 shutdown_connections 2024-03-19T05:54:08.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:08.864+0000 7fd79b400700 1 -- 172.21.15.172:0/3975708121 wait complete. 2024-03-19T05:54:08.858 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:09.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:08 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/3975708121' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:10.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:09 smithi072 ceph-mon[28706]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:10.505 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:10.505 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:10.885 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:10.978 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:12.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:11 smithi072 ceph-mon[28706]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:12.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.969+0000 7f919e600700 1 -- 172.21.15.172:0/511757541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91981008b0 msgr2=0x7f9198102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:12.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.969+0000 7f919e600700 1 --2- 172.21.15.172:0/511757541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91981008b0 0x7f9198102c90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9188009910 tx=0x7f9188009c20 comp rx=0 tx=0).stop 2024-03-19T05:54:12.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.969+0000 7f919e600700 1 -- 172.21.15.172:0/511757541 shutdown_connections 2024-03-19T05:54:12.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.969+0000 7f919e600700 1 --2- 172.21.15.172:0/511757541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91981008b0 0x7f9198102c90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:12.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.969+0000 7f919e600700 1 -- 172.21.15.172:0/511757541 >> 172.21.15.172:0/511757541 conn(0x7f91980fa2b0 msgr2=0x7f91980fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:12.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.969+0000 7f919e600700 1 -- 172.21.15.172:0/511757541 shutdown_connections 2024-03-19T05:54:12.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.969+0000 7f919e600700 1 -- 172.21.15.172:0/511757541 wait complete. 2024-03-19T05:54:12.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.970+0000 7f919e600700 1 Processor -- start 2024-03-19T05:54:12.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.971+0000 7f919e600700 1 -- start start 2024-03-19T05:54:12.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.971+0000 7f919e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91981008b0 0x7f9198194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:12.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.971+0000 7f919e600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91981954e0 con 0x7f91981008b0 2024-03-19T05:54:12.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.972+0000 7f9197400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91981008b0 0x7f9198194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:12.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.972+0000 7f9197400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91981008b0 0x7f9198194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:37070/0 (socket says 172.21.15.172:37070) 2024-03-19T05:54:12.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.972+0000 7f9197400700 1 -- 172.21.15.172:0/896447378 learned_addr learned my addr 172.21.15.172:0/896447378 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:54:12.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.972+0000 7f9197400700 1 -- 172.21.15.172:0/896447378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91880095f0 con 0x7f91981008b0 2024-03-19T05:54:12.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.973+0000 7f9197400700 1 --2- 172.21.15.172:0/896447378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91981008b0 0x7f9198194fa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91880092e0 tx=0x7f9188009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:12.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.975+0000 7f918fe00700 1 -- 172.21.15.172:0/896447378 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f918801d070 con 0x7f91981008b0 2024-03-19T05:54:12.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.975+0000 7f919e600700 1 -- 172.21.15.172:0/896447378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91981956e0 con 0x7f91981008b0 2024-03-19T05:54:12.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.975+0000 7f918fe00700 1 -- 172.21.15.172:0/896447378 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f918800be10 con 0x7f91981008b0 2024-03-19T05:54:12.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.975+0000 7f918fe00700 1 -- 172.21.15.172:0/896447378 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f918800f460 con 0x7f91981008b0 2024-03-19T05:54:12.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.975+0000 7f919e600700 1 -- 172.21.15.172:0/896447378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9198195b80 con 0x7f91981008b0 2024-03-19T05:54:12.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.976+0000 7f919e600700 1 -- 172.21.15.172:0/896447378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919818eb00 con 0x7f91981008b0 2024-03-19T05:54:12.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.976+0000 7f918fe00700 1 -- 172.21.15.172:0/896447378 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f9188022470 con 0x7f91981008b0 2024-03-19T05:54:12.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.977+0000 7f918fe00700 1 --2- 172.21.15.172:0/896447378 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f917c0384e0 0x7f917c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:12.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.977+0000 7f918fe00700 1 -- 172.21.15.172:0/896447378 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f918804c510 con 0x7f91981008b0 2024-03-19T05:54:12.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.977+0000 7f9196a00700 1 --2- 172.21.15.172:0/896447378 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f917c0384e0 0x7f917c03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:12.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.979+0000 7f9196a00700 1 --2- 172.21.15.172:0/896447378 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f917c0384e0 0x7f917c03a990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9184006fd0 tx=0x7f9184006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:12.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:12.992+0000 7f918fe00700 1 -- 172.21.15.172:0/896447378 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f918800b960 con 0x7f91981008b0 2024-03-19T05:54:13.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:13.291+0000 7f919e600700 1 -- 172.21.15.172:0/896447378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f919802cc30 con 0x7f91981008b0 2024-03-19T05:54:13.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:13.292+0000 7f918fe00700 1 -- 172.21.15.172:0/896447378 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f9188027030 con 0x7f91981008b0 2024-03-19T05:54:13.286 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:13.286 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:13.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:13.295+0000 7f919e600700 1 -- 172.21.15.172:0/896447378 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f917c0384e0 msgr2=0x7f917c03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:13.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:13.295+0000 7f919e600700 1 --2- 172.21.15.172:0/896447378 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f917c0384e0 0x7f917c03a990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9184006fd0 tx=0x7f9184006e40 comp rx=0 tx=0).stop 2024-03-19T05:54:13.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:13.295+0000 7f919e600700 1 -- 172.21.15.172:0/896447378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91981008b0 msgr2=0x7f9198194fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:13.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:13.295+0000 7f919e600700 1 --2- 172.21.15.172:0/896447378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91981008b0 0x7f9198194fa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91880092e0 tx=0x7f9188009e60 comp rx=0 tx=0).stop 2024-03-19T05:54:13.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:13.295+0000 7f919e600700 1 -- 172.21.15.172:0/896447378 shutdown_connections 2024-03-19T05:54:13.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:13.295+0000 7f919e600700 1 --2- 172.21.15.172:0/896447378 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f917c0384e0 0x7f917c03a990 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:13.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:13.295+0000 7f919e600700 1 --2- 172.21.15.172:0/896447378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91981008b0 0x7f9198194fa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:13.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:13.295+0000 7f919e600700 1 -- 172.21.15.172:0/896447378 >> 172.21.15.172:0/896447378 conn(0x7f91980fa2b0 msgr2=0x7f91980faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:13.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:13.295+0000 7f919e600700 1 -- 172.21.15.172:0/896447378 shutdown_connections 2024-03-19T05:54:13.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:13.295+0000 7f919e600700 1 -- 172.21.15.172:0/896447378 wait complete. 2024-03-19T05:54:13.289 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:14.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:13 smithi072 ceph-mon[28706]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:14.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:14 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/896447378' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:14.912 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:14.913 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:15.298 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:15.407 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:16.252 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:15 smithi072 ceph-mon[28706]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:17.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.344+0000 7fd6fd800700 1 -- 172.21.15.172:0/1854269811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f8102020 msgr2=0x7fd6f8102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:17.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.344+0000 7fd6fd800700 1 --2- 172.21.15.172:0/1854269811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f8102020 0x7fd6f8102430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009910 tx=0x7fd6e8009c20 comp rx=0 tx=0).stop 2024-03-19T05:54:17.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.344+0000 7fd6fd800700 1 -- 172.21.15.172:0/1854269811 shutdown_connections 2024-03-19T05:54:17.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.344+0000 7fd6fd800700 1 --2- 172.21.15.172:0/1854269811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f8102020 0x7fd6f8102430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:17.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.344+0000 7fd6fd800700 1 -- 172.21.15.172:0/1854269811 >> 172.21.15.172:0/1854269811 conn(0x7fd6f80fd700 msgr2=0x7fd6f80ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:17.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.344+0000 7fd6fd800700 1 -- 172.21.15.172:0/1854269811 shutdown_connections 2024-03-19T05:54:17.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.344+0000 7fd6fd800700 1 -- 172.21.15.172:0/1854269811 wait complete. 2024-03-19T05:54:17.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.345+0000 7fd6fd800700 1 Processor -- start 2024-03-19T05:54:17.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.345+0000 7fd6fd800700 1 -- start start 2024-03-19T05:54:17.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.346+0000 7fd6fd800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f8102020 0x7fd6f81971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:17.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.346+0000 7fd6fd800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f81976e0 con 0x7fd6f8102020 2024-03-19T05:54:17.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.346+0000 7fd6f6a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f8102020 0x7fd6f81971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:17.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.346+0000 7fd6f6a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f8102020 0x7fd6f81971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:37096/0 (socket says 172.21.15.172:37096) 2024-03-19T05:54:17.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.346+0000 7fd6f6a00700 1 -- 172.21.15.172:0/3926351770 learned_addr learned my addr 172.21.15.172:0/3926351770 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:54:17.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.347+0000 7fd6f6a00700 1 -- 172.21.15.172:0/3926351770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80095f0 con 0x7fd6f8102020 2024-03-19T05:54:17.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.347+0000 7fd6f6a00700 1 --2- 172.21.15.172:0/3926351770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f8102020 0x7fd6f81971a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8005b40 tx=0x7fd6e8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:17.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.348+0000 7fd6ef400700 1 -- 172.21.15.172:0/3926351770 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6e801d070 con 0x7fd6f8102020 2024-03-19T05:54:17.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.348+0000 7fd6fd800700 1 -- 172.21.15.172:0/3926351770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f81978e0 con 0x7fd6f8102020 2024-03-19T05:54:17.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.348+0000 7fd6fd800700 1 -- 172.21.15.172:0/3926351770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f8197d80 con 0x7fd6f8102020 2024-03-19T05:54:17.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.348+0000 7fd6ef400700 1 -- 172.21.15.172:0/3926351770 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd6e800be10 con 0x7fd6f8102020 2024-03-19T05:54:17.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.348+0000 7fd6ef400700 1 -- 172.21.15.172:0/3926351770 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6e800f460 con 0x7fd6f8102020 2024-03-19T05:54:17.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.349+0000 7fd6fd800700 1 -- 172.21.15.172:0/3926351770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f8190d00 con 0x7fd6f8102020 2024-03-19T05:54:17.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.353+0000 7fd6ef400700 1 -- 172.21.15.172:0/3926351770 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fd6e80227c0 con 0x7fd6f8102020 2024-03-19T05:54:17.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.354+0000 7fd6ef400700 1 --2- 172.21.15.172:0/3926351770 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd6dc0384e0 0x7fd6dc03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:17.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.354+0000 7fd6ef400700 1 -- 172.21.15.172:0/3926351770 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd6e804c6d0 con 0x7fd6f8102020 2024-03-19T05:54:17.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.360+0000 7fd6f6000700 1 --2- 172.21.15.172:0/3926351770 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd6dc0384e0 0x7fd6dc03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:17.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.367+0000 7fd6ef400700 1 -- 172.21.15.172:0/3926351770 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd6e800b960 con 0x7fd6f8102020 2024-03-19T05:54:17.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.387+0000 7fd6f6000700 1 --2- 172.21.15.172:0/3926351770 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd6dc0384e0 0x7fd6dc03a990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4006fd0 tx=0x7fd6e4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:17.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.662+0000 7fd6fd800700 1 -- 172.21.15.172:0/3926351770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd6f802ce60 con 0x7fd6f8102020 2024-03-19T05:54:17.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.663+0000 7fd6ef400700 1 -- 172.21.15.172:0/3926351770 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd6e8027020 con 0x7fd6f8102020 2024-03-19T05:54:17.656 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:17.656 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:17.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.666+0000 7fd6fd800700 1 -- 172.21.15.172:0/3926351770 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd6dc0384e0 msgr2=0x7fd6dc03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:17.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.666+0000 7fd6fd800700 1 --2- 172.21.15.172:0/3926351770 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd6dc0384e0 0x7fd6dc03a990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4006fd0 tx=0x7fd6e4006e40 comp rx=0 tx=0).stop 2024-03-19T05:54:17.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.666+0000 7fd6fd800700 1 -- 172.21.15.172:0/3926351770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f8102020 msgr2=0x7fd6f81971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:17.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.666+0000 7fd6fd800700 1 --2- 172.21.15.172:0/3926351770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f8102020 0x7fd6f81971a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8005b40 tx=0x7fd6e8004740 comp rx=0 tx=0).stop 2024-03-19T05:54:17.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.666+0000 7fd6fd800700 1 -- 172.21.15.172:0/3926351770 shutdown_connections 2024-03-19T05:54:17.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.666+0000 7fd6fd800700 1 --2- 172.21.15.172:0/3926351770 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fd6dc0384e0 0x7fd6dc03a990 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:17.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.666+0000 7fd6fd800700 1 --2- 172.21.15.172:0/3926351770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6f8102020 0x7fd6f81971a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:17.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.666+0000 7fd6fd800700 1 -- 172.21.15.172:0/3926351770 >> 172.21.15.172:0/3926351770 conn(0x7fd6f80fd700 msgr2=0x7fd6f80ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:17.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.666+0000 7fd6fd800700 1 -- 172.21.15.172:0/3926351770 shutdown_connections 2024-03-19T05:54:17.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:17.666+0000 7fd6fd800700 1 -- 172.21.15.172:0/3926351770 wait complete. 2024-03-19T05:54:17.660 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:18.282 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:17 smithi072 ceph-mon[28706]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:18.282 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:17 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/3926351770' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:19.298 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:19.299 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:19.686 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:19.785 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:20.050 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:19 smithi072 ceph-mon[28706]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:21.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.625+0000 7ffaa5400700 1 -- 172.21.15.172:0/1562008983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0102020 msgr2=0x7ffaa0102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:21.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.625+0000 7ffaa5400700 1 --2- 172.21.15.172:0/1562008983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0102020 0x7ffaa0102430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009910 tx=0x7ffa90009c20 comp rx=0 tx=0).stop 2024-03-19T05:54:21.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.625+0000 7ffaa5400700 1 -- 172.21.15.172:0/1562008983 shutdown_connections 2024-03-19T05:54:21.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.625+0000 7ffaa5400700 1 --2- 172.21.15.172:0/1562008983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0102020 0x7ffaa0102430 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:21.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.625+0000 7ffaa5400700 1 -- 172.21.15.172:0/1562008983 >> 172.21.15.172:0/1562008983 conn(0x7ffaa00fd700 msgr2=0x7ffaa00ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:21.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.625+0000 7ffaa5400700 1 -- 172.21.15.172:0/1562008983 shutdown_connections 2024-03-19T05:54:21.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.625+0000 7ffaa5400700 1 -- 172.21.15.172:0/1562008983 wait complete. 2024-03-19T05:54:21.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.626+0000 7ffaa5400700 1 Processor -- start 2024-03-19T05:54:21.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.626+0000 7ffaa5400700 1 -- start start 2024-03-19T05:54:21.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.627+0000 7ffaa5400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0102020 0x7ffaa01971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:21.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.627+0000 7ffaa5400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa01976e0 con 0x7ffaa0102020 2024-03-19T05:54:21.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.627+0000 7ffa9e800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0102020 0x7ffaa01971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:21.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.628+0000 7ffa9e800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0102020 0x7ffaa01971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:39238/0 (socket says 172.21.15.172:39238) 2024-03-19T05:54:21.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.628+0000 7ffa9e800700 1 -- 172.21.15.172:0/2222056203 learned_addr learned my addr 172.21.15.172:0/2222056203 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:54:21.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.628+0000 7ffa9e800700 1 -- 172.21.15.172:0/2222056203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900095f0 con 0x7ffaa0102020 2024-03-19T05:54:21.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.629+0000 7ffa9e800700 1 --2- 172.21.15.172:0/2222056203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0102020 0x7ffaa01971a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa90005950 tx=0x7ffa90009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:21.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.629+0000 7ffa97400700 1 -- 172.21.15.172:0/2222056203 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa9001d070 con 0x7ffaa0102020 2024-03-19T05:54:21.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.629+0000 7ffa97400700 1 -- 172.21.15.172:0/2222056203 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffa9000be10 con 0x7ffaa0102020 2024-03-19T05:54:21.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.629+0000 7ffaa5400700 1 -- 172.21.15.172:0/2222056203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa01978e0 con 0x7ffaa0102020 2024-03-19T05:54:21.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.629+0000 7ffa97400700 1 -- 172.21.15.172:0/2222056203 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa9000f460 con 0x7ffaa0102020 2024-03-19T05:54:21.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.629+0000 7ffaa5400700 1 -- 172.21.15.172:0/2222056203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa0197d80 con 0x7ffaa0102020 2024-03-19T05:54:21.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.630+0000 7ffaa5400700 1 -- 172.21.15.172:0/2222056203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa0190d00 con 0x7ffaa0102020 2024-03-19T05:54:21.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.631+0000 7ffa97400700 1 -- 172.21.15.172:0/2222056203 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7ffa900227c0 con 0x7ffaa0102020 2024-03-19T05:54:21.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.632+0000 7ffa97400700 1 --2- 172.21.15.172:0/2222056203 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ffa84038490 0x7ffa8403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:21.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.632+0000 7ffa97400700 1 -- 172.21.15.172:0/2222056203 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ffa9004ccb0 con 0x7ffaa0102020 2024-03-19T05:54:21.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.632+0000 7ffa9de00700 1 --2- 172.21.15.172:0/2222056203 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ffa84038490 0x7ffa8403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:21.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.634+0000 7ffa9de00700 1 --2- 172.21.15.172:0/2222056203 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ffa84038490 0x7ffa8403a940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c006fd0 tx=0x7ffa8c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:21.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.647+0000 7ffa97400700 1 -- 172.21.15.172:0/2222056203 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffa90005c00 con 0x7ffaa0102020 2024-03-19T05:54:21.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.948+0000 7ffaa5400700 1 -- 172.21.15.172:0/2222056203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ffaa002cc30 con 0x7ffaa0102020 2024-03-19T05:54:21.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.949+0000 7ffa97400700 1 -- 172.21.15.172:0/2222056203 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ffa90027030 con 0x7ffaa0102020 2024-03-19T05:54:21.942 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:21.942 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:21.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.952+0000 7ffaa5400700 1 -- 172.21.15.172:0/2222056203 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ffa84038490 msgr2=0x7ffa8403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:21.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.952+0000 7ffaa5400700 1 --2- 172.21.15.172:0/2222056203 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ffa84038490 0x7ffa8403a940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c006fd0 tx=0x7ffa8c006e40 comp rx=0 tx=0).stop 2024-03-19T05:54:21.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.952+0000 7ffaa5400700 1 -- 172.21.15.172:0/2222056203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0102020 msgr2=0x7ffaa01971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:21.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.952+0000 7ffaa5400700 1 --2- 172.21.15.172:0/2222056203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0102020 0x7ffaa01971a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa90005950 tx=0x7ffa90009e60 comp rx=0 tx=0).stop 2024-03-19T05:54:21.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.952+0000 7ffaa5400700 1 -- 172.21.15.172:0/2222056203 shutdown_connections 2024-03-19T05:54:21.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.952+0000 7ffaa5400700 1 --2- 172.21.15.172:0/2222056203 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7ffa84038490 0x7ffa8403a940 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:21.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.952+0000 7ffaa5400700 1 --2- 172.21.15.172:0/2222056203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0102020 0x7ffaa01971a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:21.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.952+0000 7ffaa5400700 1 -- 172.21.15.172:0/2222056203 >> 172.21.15.172:0/2222056203 conn(0x7ffaa00fd700 msgr2=0x7ffaa00ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:21.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.952+0000 7ffaa5400700 1 -- 172.21.15.172:0/2222056203 shutdown_connections 2024-03-19T05:54:21.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:21.952+0000 7ffaa5400700 1 -- 172.21.15.172:0/2222056203 wait complete. 2024-03-19T05:54:21.946 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:22.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:21 smithi072 ceph-mon[28706]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:22.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:21 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:22.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:21 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:22.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:21 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:22.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:21 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-19T05:54:22.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:21 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/2222056203' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:23.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:23 smithi072 ceph-mon[28706]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-19T05:54:23.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:23 smithi072 ceph-mon[28706]: mgrmap e14: smithi072.jydpjk(active, since 91s) 2024-03-19T05:54:23.668 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:23.668 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:24.048 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:24.146 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:25.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.937+0000 7f15cf200700 1 -- 172.21.15.172:0/3768760206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d0101e70 msgr2=0x7f15d0102280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:25.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.937+0000 7f15cf200700 1 --2- 172.21.15.172:0/3768760206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d0101e70 0x7f15d0102280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009910 tx=0x7f15c0009c20 comp rx=0 tx=0).stop 2024-03-19T05:54:25.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.937+0000 7f15cf200700 1 -- 172.21.15.172:0/3768760206 shutdown_connections 2024-03-19T05:54:25.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.937+0000 7f15cf200700 1 --2- 172.21.15.172:0/3768760206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d0101e70 0x7f15d0102280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:25.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.937+0000 7f15cf200700 1 -- 172.21.15.172:0/3768760206 >> 172.21.15.172:0/3768760206 conn(0x7f15d00fd530 msgr2=0x7f15d00ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:25.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.937+0000 7f15cf200700 1 -- 172.21.15.172:0/3768760206 shutdown_connections 2024-03-19T05:54:25.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.937+0000 7f15cf200700 1 -- 172.21.15.172:0/3768760206 wait complete. 2024-03-19T05:54:25.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.939+0000 7f15cf200700 1 Processor -- start 2024-03-19T05:54:25.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.939+0000 7f15cf200700 1 -- start start 2024-03-19T05:54:25.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.939+0000 7f15cf200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d0101e70 0x7f15d0197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:25.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.939+0000 7f15cf200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d0197540 con 0x7f15d0101e70 2024-03-19T05:54:25.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.940+0000 7f15cde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d0101e70 0x7f15d0197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:25.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.940+0000 7f15cde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d0101e70 0x7f15d0197000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:39246/0 (socket says 172.21.15.172:39246) 2024-03-19T05:54:25.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.940+0000 7f15cde00700 1 -- 172.21.15.172:0/2998681675 learned_addr learned my addr 172.21.15.172:0/2998681675 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:54:25.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.940+0000 7f15cde00700 1 -- 172.21.15.172:0/2998681675 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c00095f0 con 0x7f15d0101e70 2024-03-19T05:54:25.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.940+0000 7f15cde00700 1 --2- 172.21.15.172:0/2998681675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d0101e70 0x7f15d0197000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15c00092e0 tx=0x7f15c0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:25.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.941+0000 7f15c6a00700 1 -- 172.21.15.172:0/2998681675 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15c001d070 con 0x7f15d0101e70 2024-03-19T05:54:25.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.941+0000 7f15cf200700 1 -- 172.21.15.172:0/2998681675 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d0197740 con 0x7f15d0101e70 2024-03-19T05:54:25.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.941+0000 7f15c6a00700 1 -- 172.21.15.172:0/2998681675 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f15c000be10 con 0x7f15d0101e70 2024-03-19T05:54:25.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.941+0000 7f15c6a00700 1 -- 172.21.15.172:0/2998681675 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15c000f460 con 0x7f15d0101e70 2024-03-19T05:54:25.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.941+0000 7f15cf200700 1 -- 172.21.15.172:0/2998681675 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d0197be0 con 0x7f15d0101e70 2024-03-19T05:54:25.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.942+0000 7f15cf200700 1 -- 172.21.15.172:0/2998681675 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d0190ad0 con 0x7f15d0101e70 2024-03-19T05:54:25.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.942+0000 7f15c6a00700 1 -- 172.21.15.172:0/2998681675 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7f15c0022470 con 0x7f15d0101e70 2024-03-19T05:54:25.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.943+0000 7f15c6a00700 1 --2- 172.21.15.172:0/2998681675 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f15b4038530 0x7f15b403a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:25.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.943+0000 7f15c6a00700 1 -- 172.21.15.172:0/2998681675 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f15c004c310 con 0x7f15d0101e70 2024-03-19T05:54:25.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.943+0000 7f15cd400700 1 -- 172.21.15.172:0/2998681675 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f15b4038530 msgr2=0x7f15b403a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/1922058375 2024-03-19T05:54:25.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.943+0000 7f15cd400700 1 --2- 172.21.15.172:0/2998681675 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f15b4038530 0x7f15b403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T05:54:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:25.957+0000 7f15c6a00700 1 -- 172.21.15.172:0/2998681675 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f15c002ba00 con 0x7f15d0101e70 2024-03-19T05:54:26.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.144+0000 7f15cd400700 1 -- 172.21.15.172:0/2998681675 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f15b4038530 msgr2=0x7f15b403a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/1922058375 2024-03-19T05:54:26.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.144+0000 7f15cd400700 1 --2- 172.21.15.172:0/2998681675 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f15b4038530 0x7f15b403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T05:54:26.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.254+0000 7f15cf200700 1 -- 172.21.15.172:0/2998681675 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f15d002cc30 con 0x7f15d0101e70 2024-03-19T05:54:26.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.255+0000 7f15c6a00700 1 -- 172.21.15.172:0/2998681675 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f15c0027020 con 0x7f15d0101e70 2024-03-19T05:54:26.248 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:26.248 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:26.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.258+0000 7f15cf200700 1 -- 172.21.15.172:0/2998681675 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f15b4038530 msgr2=0x7f15b403a9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-19T05:54:26.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.258+0000 7f15cf200700 1 --2- 172.21.15.172:0/2998681675 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f15b4038530 0x7f15b403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:26.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.258+0000 7f15cf200700 1 -- 172.21.15.172:0/2998681675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d0101e70 msgr2=0x7f15d0197000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:26.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.258+0000 7f15cf200700 1 --2- 172.21.15.172:0/2998681675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d0101e70 0x7f15d0197000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15c00092e0 tx=0x7f15c0009e60 comp rx=0 tx=0).stop 2024-03-19T05:54:26.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.258+0000 7f15cf200700 1 -- 172.21.15.172:0/2998681675 shutdown_connections 2024-03-19T05:54:26.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.258+0000 7f15cf200700 1 --2- 172.21.15.172:0/2998681675 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7f15b4038530 0x7f15b403a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:26.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.258+0000 7f15cf200700 1 --2- 172.21.15.172:0/2998681675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d0101e70 0x7f15d0197000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:26.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.258+0000 7f15cf200700 1 -- 172.21.15.172:0/2998681675 >> 172.21.15.172:0/2998681675 conn(0x7f15d00fd530 msgr2=0x7f15d00ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:26.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.258+0000 7f15cf200700 1 -- 172.21.15.172:0/2998681675 shutdown_connections 2024-03-19T05:54:26.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:26.258+0000 7f15cf200700 1 -- 172.21.15.172:0/2998681675 wait complete. 2024-03-19T05:54:26.253 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:27.052 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:26 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/2998681675' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:27.930 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:27.930 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:28.310 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:28.406 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:30.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.227+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1957463466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a0101ea0 msgr2=0x7fb7a01022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:30.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.227+0000 7fb7a4e00700 1 --2- 172.21.15.172:0/1957463466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a0101ea0 0x7fb7a01022b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb790009910 tx=0x7fb790009c20 comp rx=0 tx=0).stop 2024-03-19T05:54:30.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.227+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1957463466 shutdown_connections 2024-03-19T05:54:30.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.227+0000 7fb7a4e00700 1 --2- 172.21.15.172:0/1957463466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a0101ea0 0x7fb7a01022b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:30.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.227+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1957463466 >> 172.21.15.172:0/1957463466 conn(0x7fb7a00fd700 msgr2=0x7fb7a00ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:30.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.227+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1957463466 shutdown_connections 2024-03-19T05:54:30.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.227+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1957463466 wait complete. 2024-03-19T05:54:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.228+0000 7fb7a4e00700 1 Processor -- start 2024-03-19T05:54:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.228+0000 7fb7a4e00700 1 -- start start 2024-03-19T05:54:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.229+0000 7fb7a4e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a0101ea0 0x7fb7a0196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.229+0000 7fb7a4e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a01974f0 con 0x7fb7a0101ea0 2024-03-19T05:54:30.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.229+0000 7fb79f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a0101ea0 0x7fb7a0196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:30.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.229+0000 7fb79f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a0101ea0 0x7fb7a0196fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:44832/0 (socket says 172.21.15.172:44832) 2024-03-19T05:54:30.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.229+0000 7fb79f400700 1 -- 172.21.15.172:0/1385385739 learned_addr learned my addr 172.21.15.172:0/1385385739 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:54:30.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.230+0000 7fb79f400700 1 -- 172.21.15.172:0/1385385739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7900095f0 con 0x7fb7a0101ea0 2024-03-19T05:54:30.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.230+0000 7fb79f400700 1 --2- 172.21.15.172:0/1385385739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a0101ea0 0x7fb7a0196fb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb790005950 tx=0x7fb790009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:30.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.231+0000 7fb797e00700 1 -- 172.21.15.172:0/1385385739 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb79001d070 con 0x7fb7a0101ea0 2024-03-19T05:54:30.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.231+0000 7fb797e00700 1 -- 172.21.15.172:0/1385385739 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb79000be10 con 0x7fb7a0101ea0 2024-03-19T05:54:30.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.231+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1385385739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a01976f0 con 0x7fb7a0101ea0 2024-03-19T05:54:30.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.231+0000 7fb797e00700 1 -- 172.21.15.172:0/1385385739 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb79000f460 con 0x7fb7a0101ea0 2024-03-19T05:54:30.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.231+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1385385739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a0197b90 con 0x7fb7a0101ea0 2024-03-19T05:54:30.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.232+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1385385739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a0190aa0 con 0x7fb7a0101ea0 2024-03-19T05:54:30.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.232+0000 7fb797e00700 1 -- 172.21.15.172:0/1385385739 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7fb7900227c0 con 0x7fb7a0101ea0 2024-03-19T05:54:30.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.232+0000 7fb797e00700 1 --2- 172.21.15.172:0/1385385739 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fb784038530 0x7fb78403a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:30.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.233+0000 7fb797e00700 1 -- 172.21.15.172:0/1385385739 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb79004c450 con 0x7fb7a0101ea0 2024-03-19T05:54:30.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.233+0000 7fb79ea00700 1 -- 172.21.15.172:0/1385385739 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fb784038530 msgr2=0x7fb78403a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/1922058375 2024-03-19T05:54:30.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.233+0000 7fb79ea00700 1 --2- 172.21.15.172:0/1385385739 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fb784038530 0x7fb78403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T05:54:30.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.245+0000 7fb797e00700 1 -- 172.21.15.172:0/1385385739 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb79002ba00 con 0x7fb7a0101ea0 2024-03-19T05:54:30.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.434+0000 7fb79ea00700 1 -- 172.21.15.172:0/1385385739 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fb784038530 msgr2=0x7fb78403a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/1922058375 2024-03-19T05:54:30.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.434+0000 7fb79ea00700 1 --2- 172.21.15.172:0/1385385739 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fb784038530 0x7fb78403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T05:54:30.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.524+0000 7fb797e00700 1 -- 172.21.15.172:0/1385385739 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 15) v1 ==== 44878+0+0 (secure 0 0 0) 0x7fb790017d20 con 0x7fb7a0101ea0 2024-03-19T05:54:30.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.525+0000 7fb797e00700 1 -- 172.21.15.172:0/1385385739 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fb784038530 msgr2=0x7fb78403a9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-19T05:54:30.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.525+0000 7fb797e00700 1 --2- 172.21.15.172:0/1385385739 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fb784038530 0x7fb78403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:30.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.546+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1385385739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb7a002cc30 con 0x7fb7a0101ea0 2024-03-19T05:54:30.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.547+0000 7fb797e00700 1 -- 172.21.15.172:0/1385385739 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb790027070 con 0x7fb7a0101ea0 2024-03-19T05:54:30.540 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:30.540 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:30.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.550+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1385385739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a0101ea0 msgr2=0x7fb7a0196fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:30.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.550+0000 7fb7a4e00700 1 --2- 172.21.15.172:0/1385385739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a0101ea0 0x7fb7a0196fb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb790005950 tx=0x7fb790009e60 comp rx=0 tx=0).stop 2024-03-19T05:54:30.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.550+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1385385739 shutdown_connections 2024-03-19T05:54:30.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.550+0000 7fb7a4e00700 1 --2- 172.21.15.172:0/1385385739 >> [v2:172.21.15.72:6800/1922058375,v1:172.21.15.72:6801/1922058375] conn(0x7fb784038530 0x7fb78403a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:30.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.550+0000 7fb7a4e00700 1 --2- 172.21.15.172:0/1385385739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a0101ea0 0x7fb7a0196fb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:30.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.550+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1385385739 >> 172.21.15.172:0/1385385739 conn(0x7fb7a00fd700 msgr2=0x7fb7a00ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:30.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.551+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1385385739 shutdown_connections 2024-03-19T05:54:30.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:30.551+0000 7fb7a4e00700 1 -- 172.21.15.172:0/1385385739 wait complete. 2024-03-19T05:54:30.545 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:30.760 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:30 smithi072 ceph-mon[28706]: Active manager daemon smithi072.jydpjk restarted 2024-03-19T05:54:30.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:30 smithi072 ceph-mon[28706]: Activating manager daemon smithi072.jydpjk 2024-03-19T05:54:30.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:30 smithi072 ceph-mon[28706]: osdmap e5: 0 total, 0 up, 0 in 2024-03-19T05:54:30.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:30 smithi072 ceph-mon[28706]: mgrmap e15: smithi072.jydpjk(active, starting, since 0.00881115s) 2024-03-19T05:54:30.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T05:54:30.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi072.jydpjk", "id": "smithi072.jydpjk"}]: dispatch 2024-03-19T05:54:30.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-19T05:54:30.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-19T05:54:30.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-19T05:54:30.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:30 smithi072 ceph-mon[28706]: Manager daemon smithi072.jydpjk is now available 2024-03-19T05:54:30.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:30 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/1385385739' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:31.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:54:31.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:54:31.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:31.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:54:31.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/mirror_snapshot_schedule"}]: dispatch 2024-03-19T05:54:31.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/trash_purge_schedule"}]: dispatch 2024-03-19T05:54:31.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:31 smithi072 ceph-mon[28706]: mgrmap e16: smithi072.jydpjk(active, since 1.00876s) 2024-03-19T05:54:32.218 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:32.218 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:32.584 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:32.683 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:32.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:32 smithi072 ceph-mon[28706]: [19/Mar/2024:05:54:31] ENGINE Bus STARTING 2024-03-19T05:54:32.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:32 smithi072 ceph-mon[28706]: [19/Mar/2024:05:54:31] ENGINE Serving on http://172.21.15.72:8765 2024-03-19T05:54:32.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:32 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:32.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:32 smithi072 ceph-mon[28706]: [19/Mar/2024:05:54:31] ENGINE Serving on https://172.21.15.72:7150 2024-03-19T05:54:32.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:32 smithi072 ceph-mon[28706]: [19/Mar/2024:05:54:31] ENGINE Bus STARTED 2024-03-19T05:54:32.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:32 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:34.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.496+0000 7f2965a00700 1 -- 172.21.15.172:0/2451751073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29600fed20 msgr2=0x7f29600ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:34.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.496+0000 7f2965a00700 1 --2- 172.21.15.172:0/2451751073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29600fed20 0x7f29600ff130 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2950009910 tx=0x7f2950009c20 comp rx=0 tx=0).stop 2024-03-19T05:54:34.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.496+0000 7f2965a00700 1 -- 172.21.15.172:0/2451751073 shutdown_connections 2024-03-19T05:54:34.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.496+0000 7f2965a00700 1 --2- 172.21.15.172:0/2451751073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29600fed20 0x7f29600ff130 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:34.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.496+0000 7f2965a00700 1 -- 172.21.15.172:0/2451751073 >> 172.21.15.172:0/2451751073 conn(0x7f29600fa2b0 msgr2=0x7f29600fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:34.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.497+0000 7f2965a00700 1 -- 172.21.15.172:0/2451751073 shutdown_connections 2024-03-19T05:54:34.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.497+0000 7f2965a00700 1 -- 172.21.15.172:0/2451751073 wait complete. 2024-03-19T05:54:34.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.498+0000 7f2965a00700 1 Processor -- start 2024-03-19T05:54:34.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.498+0000 7f2965a00700 1 -- start start 2024-03-19T05:54:34.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.498+0000 7f2965a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29600fed20 0x7f296019b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:34.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.498+0000 7f2965a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296019bb20 con 0x7f29600fed20 2024-03-19T05:54:34.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.499+0000 7f295ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29600fed20 0x7f296019b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:34.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.499+0000 7f295ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29600fed20 0x7f296019b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:44864/0 (socket says 172.21.15.172:44864) 2024-03-19T05:54:34.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.499+0000 7f295ea00700 1 -- 172.21.15.172:0/4279984456 learned_addr learned my addr 172.21.15.172:0/4279984456 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:54:34.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.500+0000 7f295ea00700 1 -- 172.21.15.172:0/4279984456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500095f0 con 0x7f29600fed20 2024-03-19T05:54:34.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.500+0000 7f295ea00700 1 --2- 172.21.15.172:0/4279984456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29600fed20 0x7f296019b5e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2950005950 tx=0x7f2950009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:34.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.501+0000 7f2957400700 1 -- 172.21.15.172:0/4279984456 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f295001d070 con 0x7f29600fed20 2024-03-19T05:54:34.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.501+0000 7f2965a00700 1 -- 172.21.15.172:0/4279984456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296019bd20 con 0x7f29600fed20 2024-03-19T05:54:34.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.501+0000 7f2957400700 1 -- 172.21.15.172:0/4279984456 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f295000be10 con 0x7f29600fed20 2024-03-19T05:54:34.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.501+0000 7f2957400700 1 -- 172.21.15.172:0/4279984456 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2950022ea0 con 0x7f29600fed20 2024-03-19T05:54:34.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.501+0000 7f2965a00700 1 -- 172.21.15.172:0/4279984456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296019c1c0 con 0x7f29600fed20 2024-03-19T05:54:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.502+0000 7f2965a00700 1 -- 172.21.15.172:0/4279984456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2960104b50 con 0x7f29600fed20 2024-03-19T05:54:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.502+0000 7f2957400700 1 -- 172.21.15.172:0/4279984456 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f295000b960 con 0x7f29600fed20 2024-03-19T05:54:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.503+0000 7f2957400700 1 --2- 172.21.15.172:0/4279984456 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2944038580 0x7f294403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.503+0000 7f2957400700 1 -- 172.21.15.172:0/4279984456 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f295004c540 con 0x7f29600fed20 2024-03-19T05:54:34.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.503+0000 7f295e000700 1 --2- 172.21.15.172:0/4279984456 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2944038580 0x7f294403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:34.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.505+0000 7f295e000700 1 --2- 172.21.15.172:0/4279984456 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2944038580 0x7f294403aa30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f294c006fd0 tx=0x7f294c006e40 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:34.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.516+0000 7f2957400700 1 -- 172.21.15.172:0/4279984456 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f295002a780 con 0x7f29600fed20 2024-03-19T05:54:34.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:34 smithi072 ceph-mon[28706]: mgrmap e17: smithi072.jydpjk(active, since 2s) 2024-03-19T05:54:34.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:34 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:34.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.809+0000 7f2965a00700 1 -- 172.21.15.172:0/4279984456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f296019efa0 con 0x7f29600fed20 2024-03-19T05:54:34.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.810+0000 7f2957400700 1 -- 172.21.15.172:0/4279984456 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f2950027020 con 0x7f29600fed20 2024-03-19T05:54:34.804 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:34.804 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.813+0000 7f2965a00700 1 -- 172.21.15.172:0/4279984456 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2944038580 msgr2=0x7f294403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.813+0000 7f2965a00700 1 --2- 172.21.15.172:0/4279984456 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2944038580 0x7f294403aa30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f294c006fd0 tx=0x7f294c006e40 comp rx=0 tx=0).stop 2024-03-19T05:54:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.813+0000 7f2965a00700 1 -- 172.21.15.172:0/4279984456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29600fed20 msgr2=0x7f296019b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.813+0000 7f2965a00700 1 --2- 172.21.15.172:0/4279984456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29600fed20 0x7f296019b5e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2950005950 tx=0x7f2950009e60 comp rx=0 tx=0).stop 2024-03-19T05:54:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.813+0000 7f2965a00700 1 -- 172.21.15.172:0/4279984456 shutdown_connections 2024-03-19T05:54:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.813+0000 7f2965a00700 1 --2- 172.21.15.172:0/4279984456 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2944038580 0x7f294403aa30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:34.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.813+0000 7f2965a00700 1 --2- 172.21.15.172:0/4279984456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29600fed20 0x7f296019b5e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:34.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.813+0000 7f2965a00700 1 -- 172.21.15.172:0/4279984456 >> 172.21.15.172:0/4279984456 conn(0x7f29600fa2b0 msgr2=0x7f29600faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:34.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.813+0000 7f2965a00700 1 -- 172.21.15.172:0/4279984456 shutdown_connections 2024-03-19T05:54:34.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:34.813+0000 7f2965a00700 1 -- 172.21.15.172:0/4279984456 wait complete. 2024-03-19T05:54:34.808 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:35.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:35 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/4279984456' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:37.272 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:37.272 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:37.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:37 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:37.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:37 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:38.171 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:38.270 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-19T05:54:39.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:38 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:39.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:38 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:39.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:38 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd/host:smithi072", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:54:39.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:38 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:39.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:38 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:39.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:38 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:39.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:38 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:39.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:38 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:54:39.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:38 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:54:39.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:38 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:54:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.199+0000 7f1674600700 1 -- 172.21.15.172:0/2397332811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166c106440 msgr2=0x7f166c106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.199+0000 7f1674600700 1 --2- 172.21.15.172:0/2397332811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166c106440 0x7f166c106850 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1660009910 tx=0x7f1660009c20 comp rx=0 tx=0).stop 2024-03-19T05:54:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.199+0000 7f1674600700 1 -- 172.21.15.172:0/2397332811 shutdown_connections 2024-03-19T05:54:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.199+0000 7f1674600700 1 --2- 172.21.15.172:0/2397332811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166c106440 0x7f166c106850 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:40.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.199+0000 7f1674600700 1 -- 172.21.15.172:0/2397332811 >> 172.21.15.172:0/2397332811 conn(0x7f166c0756e0 msgr2=0x7f166c077b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:40.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.199+0000 7f1674600700 1 -- 172.21.15.172:0/2397332811 shutdown_connections 2024-03-19T05:54:40.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.199+0000 7f1674600700 1 -- 172.21.15.172:0/2397332811 wait complete. 2024-03-19T05:54:40.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.200+0000 7f1674600700 1 Processor -- start 2024-03-19T05:54:40.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.200+0000 7f1674600700 1 -- start start 2024-03-19T05:54:40.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.201+0000 7f1674600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166c106440 0x7f166c19b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:40.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.201+0000 7f1674600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c19bae0 con 0x7f166c106440 2024-03-19T05:54:40.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.201+0000 7f1671c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166c106440 0x7f166c19b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:40.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.201+0000 7f1671c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166c106440 0x7f166c19b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:59030/0 (socket says 172.21.15.172:59030) 2024-03-19T05:54:40.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.201+0000 7f1671c00700 1 -- 172.21.15.172:0/3190957102 learned_addr learned my addr 172.21.15.172:0/3190957102 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:54:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.201+0000 7f1671c00700 1 -- 172.21.15.172:0/3190957102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16600095f0 con 0x7f166c106440 2024-03-19T05:54:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.202+0000 7f1671c00700 1 --2- 172.21.15.172:0/3190957102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166c106440 0x7f166c19b5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1660005950 tx=0x7f1660009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.202+0000 7f166a000700 1 -- 172.21.15.172:0/3190957102 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f166001d070 con 0x7f166c106440 2024-03-19T05:54:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.202+0000 7f1674600700 1 -- 172.21.15.172:0/3190957102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166c19bce0 con 0x7f166c106440 2024-03-19T05:54:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.202+0000 7f166a000700 1 -- 172.21.15.172:0/3190957102 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f166000be10 con 0x7f166c106440 2024-03-19T05:54:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.202+0000 7f166a000700 1 -- 172.21.15.172:0/3190957102 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f166000f460 con 0x7f166c106440 2024-03-19T05:54:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.202+0000 7f1674600700 1 -- 172.21.15.172:0/3190957102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c19c180 con 0x7f166c106440 2024-03-19T05:54:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.203+0000 7f1674600700 1 -- 172.21.15.172:0/3190957102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166c195110 con 0x7f166c106440 2024-03-19T05:54:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.203+0000 7f166a000700 1 -- 172.21.15.172:0/3190957102 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f16600227c0 con 0x7f166c106440 2024-03-19T05:54:40.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.204+0000 7f166a000700 1 --2- 172.21.15.172:0/3190957102 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1654038580 0x7f165403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:40.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.204+0000 7f166a000700 1 -- 172.21.15.172:0/3190957102 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f166004c670 con 0x7f166c106440 2024-03-19T05:54:40.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.204+0000 7f1671200700 1 --2- 172.21.15.172:0/3190957102 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1654038580 0x7f165403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:40.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.205+0000 7f1671200700 1 --2- 172.21.15.172:0/3190957102 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1654038580 0x7f165403aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1658006fd0 tx=0x7f1658006e40 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:40.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.217+0000 7f166a000700 1 -- 172.21.15.172:0/3190957102 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f166002bba0 con 0x7f166c106440 2024-03-19T05:54:40.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:39 smithi072 ceph-mon[28706]: Updating smithi072:/etc/ceph/ceph.conf 2024-03-19T05:54:40.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:39 smithi072 ceph-mon[28706]: Updating smithi172:/etc/ceph/ceph.conf 2024-03-19T05:54:40.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.534+0000 7f1674600700 1 -- 172.21.15.172:0/3190957102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f166c02cc30 con 0x7f166c106440 2024-03-19T05:54:40.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.535+0000 7f166a000700 1 -- 172.21.15.172:0/3190957102 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f1660027070 con 0x7f166c106440 2024-03-19T05:54:40.529 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:40.529 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:40.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.538+0000 7f1674600700 1 -- 172.21.15.172:0/3190957102 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1654038580 msgr2=0x7f165403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:40.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.538+0000 7f1674600700 1 --2- 172.21.15.172:0/3190957102 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1654038580 0x7f165403aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1658006fd0 tx=0x7f1658006e40 comp rx=0 tx=0).stop 2024-03-19T05:54:40.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.538+0000 7f1674600700 1 -- 172.21.15.172:0/3190957102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166c106440 msgr2=0x7f166c19b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:40.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.538+0000 7f1674600700 1 --2- 172.21.15.172:0/3190957102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166c106440 0x7f166c19b5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1660005950 tx=0x7f1660009e60 comp rx=0 tx=0).stop 2024-03-19T05:54:40.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.538+0000 7f1674600700 1 -- 172.21.15.172:0/3190957102 shutdown_connections 2024-03-19T05:54:40.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.538+0000 7f1674600700 1 --2- 172.21.15.172:0/3190957102 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1654038580 0x7f165403aa30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:40.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.538+0000 7f1674600700 1 --2- 172.21.15.172:0/3190957102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f166c106440 0x7f166c19b5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:40.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.538+0000 7f1674600700 1 -- 172.21.15.172:0/3190957102 >> 172.21.15.172:0/3190957102 conn(0x7f166c0756e0 msgr2=0x7f166c0773a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:40.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.538+0000 7f1674600700 1 -- 172.21.15.172:0/3190957102 shutdown_connections 2024-03-19T05:54:40.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:40.538+0000 7f1674600700 1 -- 172.21.15.172:0/3190957102 wait complete. 2024-03-19T05:54:40.536 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:41.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:40 smithi072 ceph-mon[28706]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T05:54:41.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:40 smithi072 ceph-mon[28706]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T05:54:41.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:40 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/3190957102' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:42.266 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:42.267 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:42.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:41 smithi072 ceph-mon[28706]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-19T05:54:42.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:41 smithi072 ceph-mon[28706]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-03-19T05:54:42.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:41 smithi072 ceph-mon[28706]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T05:54:42.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:41 smithi072 ceph-mon[28706]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T05:54:42.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:42.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:42.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:42.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:42.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:42.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T05:54:42.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-03-19T05:54:42.331 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:54:43.288 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T05:54:43.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:42 smithi072 ceph-mon[28706]: Deploying daemon ceph-exporter.smithi172 on smithi172 2024-03-19T05:54:46.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:45 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.127+0000 7f05e8c00700 1 -- 172.21.15.172:0/1169458666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e410c450 msgr2=0x7f05e410c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.127+0000 7f05e8c00700 1 --2- 172.21.15.172:0/1169458666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e410c450 0x7f05e410c820 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009910 tx=0x7f05d4009c20 comp rx=0 tx=0).stop 2024-03-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.127+0000 7f05e8c00700 1 -- 172.21.15.172:0/1169458666 shutdown_connections 2024-03-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.127+0000 7f05e8c00700 1 --2- 172.21.15.172:0/1169458666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e410c450 0x7f05e410c820 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.127+0000 7f05e8c00700 1 -- 172.21.15.172:0/1169458666 >> 172.21.15.172:0/1169458666 conn(0x7f05e4075c40 msgr2=0x7f05e4078050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.127+0000 7f05e8c00700 1 -- 172.21.15.172:0/1169458666 shutdown_connections 2024-03-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.127+0000 7f05e8c00700 1 -- 172.21.15.172:0/1169458666 wait complete. 2024-03-19T05:54:46.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.128+0000 7f05e8c00700 1 Processor -- start 2024-03-19T05:54:46.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.129+0000 7f05e8c00700 1 -- start start 2024-03-19T05:54:46.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.129+0000 7f05e8c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e410c450 0x7f05e41a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.129+0000 7f05e8c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e41a1c50 con 0x7f05e410c450 2024-03-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.130+0000 7f05e1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e410c450 0x7f05e41a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.130+0000 7f05e1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e410c450 0x7f05e41a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:59060/0 (socket says 172.21.15.172:59060) 2024-03-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.130+0000 7f05e1e00700 1 -- 172.21.15.172:0/1300286544 learned_addr learned my addr 172.21.15.172:0/1300286544 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.130+0000 7f05e1e00700 1 -- 172.21.15.172:0/1300286544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d40095f0 con 0x7f05e410c450 2024-03-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.131+0000 7f05e1e00700 1 --2- 172.21.15.172:0/1300286544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e410c450 0x7f05e41a1710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f05d4005b40 tx=0x7f05d4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.131+0000 7f05daa00700 1 -- 172.21.15.172:0/1300286544 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05d401d070 con 0x7f05e410c450 2024-03-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.131+0000 7f05e8c00700 1 -- 172.21.15.172:0/1300286544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e41a1df0 con 0x7f05e410c450 2024-03-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.131+0000 7f05daa00700 1 -- 172.21.15.172:0/1300286544 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f05d40044d0 con 0x7f05e410c450 2024-03-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.131+0000 7f05daa00700 1 -- 172.21.15.172:0/1300286544 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05d4003930 con 0x7f05e410c450 2024-03-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.131+0000 7f05e8c00700 1 -- 172.21.15.172:0/1300286544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e41a21b0 con 0x7f05e410c450 2024-03-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.132+0000 7f05e8c00700 1 -- 172.21.15.172:0/1300286544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e4062380 con 0x7f05e410c450 2024-03-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.133+0000 7f05daa00700 1 -- 172.21.15.172:0/1300286544 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f05d400b960 con 0x7f05e410c450 2024-03-19T05:54:46.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.133+0000 7f05daa00700 1 --2- 172.21.15.172:0/1300286544 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f05c8038580 0x7f05c803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:46.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.133+0000 7f05daa00700 1 -- 172.21.15.172:0/1300286544 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f05d404c4b0 con 0x7f05e410c450 2024-03-19T05:54:46.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.134+0000 7f05dbe00700 1 --2- 172.21.15.172:0/1300286544 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f05c8038580 0x7f05c803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:46.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.135+0000 7f05dbe00700 1 --2- 172.21.15.172:0/1300286544 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f05c8038580 0x7f05c803aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f05cc006fd0 tx=0x7f05cc006e40 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.150+0000 7f05daa00700 1 -- 172.21.15.172:0/1300286544 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f05d402a540 con 0x7f05e410c450 2024-03-19T05:54:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.453+0000 7f05e8c00700 1 -- 172.21.15.172:0/1300286544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f05e419cca0 con 0x7f05e410c450 2024-03-19T05:54:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.454+0000 7f05daa00700 1 -- 172.21.15.172:0/1300286544 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f05d402a360 con 0x7f05e410c450 2024-03-19T05:54:46.449 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:46.449 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.457+0000 7f05e8c00700 1 -- 172.21.15.172:0/1300286544 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f05c8038580 msgr2=0x7f05c803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.457+0000 7f05e8c00700 1 --2- 172.21.15.172:0/1300286544 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f05c8038580 0x7f05c803aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f05cc006fd0 tx=0x7f05cc006e40 comp rx=0 tx=0).stop 2024-03-19T05:54:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.457+0000 7f05e8c00700 1 -- 172.21.15.172:0/1300286544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e410c450 msgr2=0x7f05e41a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.457+0000 7f05e8c00700 1 --2- 172.21.15.172:0/1300286544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e410c450 0x7f05e41a1710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f05d4005b40 tx=0x7f05d4004c80 comp rx=0 tx=0).stop 2024-03-19T05:54:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.457+0000 7f05e8c00700 1 -- 172.21.15.172:0/1300286544 shutdown_connections 2024-03-19T05:54:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.457+0000 7f05e8c00700 1 --2- 172.21.15.172:0/1300286544 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f05c8038580 0x7f05c803aa30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.457+0000 7f05e8c00700 1 --2- 172.21.15.172:0/1300286544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e410c450 0x7f05e41a1710 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.457+0000 7f05e8c00700 1 -- 172.21.15.172:0/1300286544 >> 172.21.15.172:0/1300286544 conn(0x7f05e4075c40 msgr2=0x7f05e40768a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.457+0000 7f05e8c00700 1 -- 172.21.15.172:0/1300286544 shutdown_connections 2024-03-19T05:54:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:46.457+0000 7f05e8c00700 1 -- 172.21.15.172:0/1300286544 wait complete. 2024-03-19T05:54:46.452 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:47.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:47.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:47.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:47.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:47.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T05:54:47.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-03-19T05:54:47.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:54:47.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:47 smithi072 ceph-mon[28706]: Deploying daemon crash.smithi172 on smithi172 2024-03-19T05:54:47.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:47 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/1300286544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:48.097 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:48.098 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:48.516 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T05:54:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.687+0000 7f7599200700 1 -- 172.21.15.172:0/1436068709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7594100090 msgr2=0x7f7594100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.687+0000 7f7599200700 1 --2- 172.21.15.172:0/1436068709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7594100090 0x7f7594100460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7584009910 tx=0x7f7584009c20 comp rx=0 tx=0).stop 2024-03-19T05:54:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.687+0000 7f7599200700 1 -- 172.21.15.172:0/1436068709 shutdown_connections 2024-03-19T05:54:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.687+0000 7f7599200700 1 --2- 172.21.15.172:0/1436068709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7594100090 0x7f7594100460 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.687+0000 7f7599200700 1 -- 172.21.15.172:0/1436068709 >> 172.21.15.172:0/1436068709 conn(0x7f75940fb970 msgr2=0x7f75940fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.687+0000 7f7599200700 1 -- 172.21.15.172:0/1436068709 shutdown_connections 2024-03-19T05:54:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.687+0000 7f7599200700 1 -- 172.21.15.172:0/1436068709 wait complete. 2024-03-19T05:54:50.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.689+0000 7f7599200700 1 Processor -- start 2024-03-19T05:54:50.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.689+0000 7f7599200700 1 -- start start 2024-03-19T05:54:50.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.689+0000 7f7599200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7594100090 0x7f7594197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:50.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.689+0000 7f7599200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7594197a60 con 0x7f7594100090 2024-03-19T05:54:50.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.690+0000 7f7591e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7594100090 0x7f7594197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:50.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.690+0000 7f7591e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7594100090 0x7f7594197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:46814/0 (socket says 172.21.15.172:46814) 2024-03-19T05:54:50.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.690+0000 7f7591e00700 1 -- 172.21.15.172:0/52653040 learned_addr learned my addr 172.21.15.172:0/52653040 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:54:50.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.691+0000 7f7591e00700 1 -- 172.21.15.172:0/52653040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75840095f0 con 0x7f7594100090 2024-03-19T05:54:50.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.691+0000 7f7591e00700 1 --2- 172.21.15.172:0/52653040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7594100090 0x7f7594197520 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7584005b40 tx=0x7f7584004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:50.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.691+0000 7f758aa00700 1 -- 172.21.15.172:0/52653040 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f758401d070 con 0x7f7594100090 2024-03-19T05:54:50.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.691+0000 7f758aa00700 1 -- 172.21.15.172:0/52653040 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f75840044d0 con 0x7f7594100090 2024-03-19T05:54:50.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.691+0000 7f758aa00700 1 -- 172.21.15.172:0/52653040 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7584003930 con 0x7f7594100090 2024-03-19T05:54:50.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.691+0000 7f7599200700 1 -- 172.21.15.172:0/52653040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7594197c60 con 0x7f7594100090 2024-03-19T05:54:50.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.692+0000 7f7599200700 1 -- 172.21.15.172:0/52653040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7594198020 con 0x7f7594100090 2024-03-19T05:54:50.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.693+0000 7f7599200700 1 -- 172.21.15.172:0/52653040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7594062380 con 0x7f7594100090 2024-03-19T05:54:50.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.694+0000 7f758aa00700 1 -- 172.21.15.172:0/52653040 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f758400b960 con 0x7f7594100090 2024-03-19T05:54:50.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.694+0000 7f758aa00700 1 --2- 172.21.15.172:0/52653040 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f75780385d0 0x7f757803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:50.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.694+0000 7f758aa00700 1 -- 172.21.15.172:0/52653040 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f758404c930 con 0x7f7594100090 2024-03-19T05:54:50.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.695+0000 7f7591400700 1 --2- 172.21.15.172:0/52653040 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f75780385d0 0x7f757803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:50.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.696+0000 7f7591400700 1 --2- 172.21.15.172:0/52653040 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f75780385d0 0x7f757803aa80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7580006fd0 tx=0x7f7580006e40 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:50.707+0000 7f758aa00700 1 -- 172.21.15.172:0/52653040 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f758402a950 con 0x7f7594100090 2024-03-19T05:54:51.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:51.012+0000 7f7599200700 1 -- 172.21.15.172:0/52653040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f759419bfa0 con 0x7f7594100090 2024-03-19T05:54:51.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:51.013+0000 7f758aa00700 1 -- 172.21.15.172:0/52653040 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f758402a360 con 0x7f7594100090 2024-03-19T05:54:51.007 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:51.007 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:51.016+0000 7f7599200700 1 -- 172.21.15.172:0/52653040 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f75780385d0 msgr2=0x7f757803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:51.016+0000 7f7599200700 1 --2- 172.21.15.172:0/52653040 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f75780385d0 0x7f757803aa80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7580006fd0 tx=0x7f7580006e40 comp rx=0 tx=0).stop 2024-03-19T05:54:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:51.016+0000 7f7599200700 1 -- 172.21.15.172:0/52653040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7594100090 msgr2=0x7f7594197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:51.016+0000 7f7599200700 1 --2- 172.21.15.172:0/52653040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7594100090 0x7f7594197520 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7584005b40 tx=0x7f7584004c80 comp rx=0 tx=0).stop 2024-03-19T05:54:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:51.016+0000 7f7599200700 1 -- 172.21.15.172:0/52653040 shutdown_connections 2024-03-19T05:54:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:51.016+0000 7f7599200700 1 --2- 172.21.15.172:0/52653040 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f75780385d0 0x7f757803aa80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:51.016+0000 7f7599200700 1 --2- 172.21.15.172:0/52653040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7594100090 0x7f7594197520 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:51.016+0000 7f7599200700 1 -- 172.21.15.172:0/52653040 >> 172.21.15.172:0/52653040 conn(0x7f75940fb970 msgr2=0x7f75941039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:51.016+0000 7f7599200700 1 -- 172.21.15.172:0/52653040 shutdown_connections 2024-03-19T05:54:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:51.016+0000 7f7599200700 1 -- 172.21.15.172:0/52653040 wait complete. 2024-03-19T05:54:51.011 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:51.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:51 smithi072 ceph-mon[28706]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:51.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:51 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:51.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:51 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:51.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:51 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:51.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:51 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:51.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:51 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:51.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:51 smithi072 ceph-mon[28706]: Deploying daemon node-exporter.smithi172 on smithi172 2024-03-19T05:54:51.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:51 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/52653040' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:52.693 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:52.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:53.063 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T05:54:53.991 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:53 smithi072 ceph-mon[28706]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:56.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:55 smithi072 ceph-mon[28706]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:56.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.672+0000 7fe786000700 1 -- 172.21.15.172:0/2754309387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7800730f0 msgr2=0x7fe7800734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:56.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.672+0000 7fe786000700 1 --2- 172.21.15.172:0/2754309387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7800730f0 0x7fe7800734c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe770009910 tx=0x7fe770009c20 comp rx=0 tx=0).stop 2024-03-19T05:54:56.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.672+0000 7fe786000700 1 -- 172.21.15.172:0/2754309387 shutdown_connections 2024-03-19T05:54:56.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.672+0000 7fe786000700 1 --2- 172.21.15.172:0/2754309387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7800730f0 0x7fe7800734c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:56.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.672+0000 7fe786000700 1 -- 172.21.15.172:0/2754309387 >> 172.21.15.172:0/2754309387 conn(0x7fe7800fb930 msgr2=0x7fe7800fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:56.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.672+0000 7fe786000700 1 -- 172.21.15.172:0/2754309387 shutdown_connections 2024-03-19T05:54:56.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.672+0000 7fe786000700 1 -- 172.21.15.172:0/2754309387 wait complete. 2024-03-19T05:54:56.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.673+0000 7fe786000700 1 Processor -- start 2024-03-19T05:54:56.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.674+0000 7fe786000700 1 -- start start 2024-03-19T05:54:56.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.674+0000 7fe786000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7801a19f0 0x7fe7801a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:56.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.674+0000 7fe786000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801a2300 con 0x7fe7801a19f0 2024-03-19T05:54:56.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.675+0000 7fe77f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7801a19f0 0x7fe7801a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:56.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.675+0000 7fe77f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7801a19f0 0x7fe7801a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:46822/0 (socket says 172.21.15.172:46822) 2024-03-19T05:54:56.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.675+0000 7fe77f400700 1 -- 172.21.15.172:0/548268745 learned_addr learned my addr 172.21.15.172:0/548268745 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:54:56.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.676+0000 7fe77f400700 1 -- 172.21.15.172:0/548268745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7700095f0 con 0x7fe7801a19f0 2024-03-19T05:54:56.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.676+0000 7fe77f400700 1 --2- 172.21.15.172:0/548268745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7801a19f0 0x7fe7801a1dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe770005950 tx=0x7fe770004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:56.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.677+0000 7fe77cc00700 1 -- 172.21.15.172:0/548268745 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe77001d070 con 0x7fe7801a19f0 2024-03-19T05:54:56.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.677+0000 7fe786000700 1 -- 172.21.15.172:0/548268745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7801a2500 con 0x7fe7801a19f0 2024-03-19T05:54:56.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.677+0000 7fe77cc00700 1 -- 172.21.15.172:0/548268745 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe77000be10 con 0x7fe7801a19f0 2024-03-19T05:54:56.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.677+0000 7fe77cc00700 1 -- 172.21.15.172:0/548268745 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe770022cc0 con 0x7fe7801a19f0 2024-03-19T05:54:56.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.677+0000 7fe786000700 1 -- 172.21.15.172:0/548268745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78019bc40 con 0x7fe7801a19f0 2024-03-19T05:54:56.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.678+0000 7fe786000700 1 -- 172.21.15.172:0/548268745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe780062380 con 0x7fe7801a19f0 2024-03-19T05:54:56.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.678+0000 7fe77cc00700 1 -- 172.21.15.172:0/548268745 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fe770022570 con 0x7fe7801a19f0 2024-03-19T05:54:56.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.679+0000 7fe77cc00700 1 --2- 172.21.15.172:0/548268745 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe7640385d0 0x7fe76403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:54:56.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.679+0000 7fe77cc00700 1 -- 172.21.15.172:0/548268745 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe77004cf10 con 0x7fe7801a19f0 2024-03-19T05:54:56.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.680+0000 7fe777e00700 1 --2- 172.21.15.172:0/548268745 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe7640385d0 0x7fe76403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:54:56.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.681+0000 7fe777e00700 1 --2- 172.21.15.172:0/548268745 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe7640385d0 0x7fe76403aa80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe768006fd0 tx=0x7fe768006e40 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:54:56.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:56.694+0000 7fe77cc00700 1 -- 172.21.15.172:0/548268745 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe770020370 con 0x7fe7801a19f0 2024-03-19T05:54:56.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:56 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:56.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:57.004+0000 7fe786000700 1 -- 172.21.15.172:0/548268745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe78019cf80 con 0x7fe7801a19f0 2024-03-19T05:54:56.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:57.007+0000 7fe77cc00700 1 -- 172.21.15.172:0/548268745 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fe770027030 con 0x7fe7801a19f0 2024-03-19T05:54:57.000 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:54:57.000 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:54:57.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:57.009+0000 7fe786000700 1 -- 172.21.15.172:0/548268745 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe7640385d0 msgr2=0x7fe76403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:57.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:57.009+0000 7fe786000700 1 --2- 172.21.15.172:0/548268745 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe7640385d0 0x7fe76403aa80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe768006fd0 tx=0x7fe768006e40 comp rx=0 tx=0).stop 2024-03-19T05:54:57.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:57.009+0000 7fe786000700 1 -- 172.21.15.172:0/548268745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7801a19f0 msgr2=0x7fe7801a1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:54:57.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:57.009+0000 7fe786000700 1 --2- 172.21.15.172:0/548268745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7801a19f0 0x7fe7801a1dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe770005950 tx=0x7fe770004c80 comp rx=0 tx=0).stop 2024-03-19T05:54:57.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:57.009+0000 7fe786000700 1 -- 172.21.15.172:0/548268745 shutdown_connections 2024-03-19T05:54:57.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:57.009+0000 7fe786000700 1 --2- 172.21.15.172:0/548268745 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe7640385d0 0x7fe76403aa80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:57.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:57.009+0000 7fe786000700 1 --2- 172.21.15.172:0/548268745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7801a19f0 0x7fe7801a1dc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:54:57.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:57.009+0000 7fe786000700 1 -- 172.21.15.172:0/548268745 >> 172.21.15.172:0/548268745 conn(0x7fe7800fb930 msgr2=0x7fe7800fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:54:57.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:57.009+0000 7fe786000700 1 -- 172.21.15.172:0/548268745 shutdown_connections 2024-03-19T05:54:57.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:54:57.009+0000 7fe786000700 1 -- 172.21.15.172:0/548268745 wait complete. 2024-03-19T05:54:57.004 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:54:58.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:57 smithi072 ceph-mon[28706]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:54:58.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:58.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:58.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:57 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/548268745' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:54:58.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:58.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:54:58.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.qkcahs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T05:54:58.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.qkcahs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-19T05:54:58.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T05:54:58.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:54:58.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:57 smithi072 ceph-mon[28706]: Deploying daemon mgr.smithi172.qkcahs on smithi172 2024-03-19T05:54:58.728 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:54:58.728 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:54:59.253 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T05:55:00.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:54:59 smithi072 ceph-mon[28706]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:01.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:00 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:55:01.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:00 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:01.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.365+0000 7fd535a00700 1 -- 172.21.15.172:0/3894554994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5301000b0 msgr2=0x7fd530100480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:55:01.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.365+0000 7fd535a00700 1 --2- 172.21.15.172:0/3894554994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5301000b0 0x7fd530100480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd52000b0a0 tx=0x7fd52000b3b0 comp rx=0 tx=0).stop 2024-03-19T05:55:01.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.366+0000 7fd535a00700 1 -- 172.21.15.172:0/3894554994 shutdown_connections 2024-03-19T05:55:01.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.366+0000 7fd535a00700 1 --2- 172.21.15.172:0/3894554994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5301000b0 0x7fd530100480 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:01.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.366+0000 7fd535a00700 1 -- 172.21.15.172:0/3894554994 >> 172.21.15.172:0/3894554994 conn(0x7fd5300fb970 msgr2=0x7fd5300fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:55:01.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.366+0000 7fd535a00700 1 -- 172.21.15.172:0/3894554994 shutdown_connections 2024-03-19T05:55:01.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.366+0000 7fd535a00700 1 -- 172.21.15.172:0/3894554994 wait complete. 2024-03-19T05:55:01.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.367+0000 7fd535a00700 1 Processor -- start 2024-03-19T05:55:01.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.368+0000 7fd535a00700 1 -- start start 2024-03-19T05:55:01.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.368+0000 7fd535a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5301000b0 0x7fd530073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:55:01.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.368+0000 7fd535a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd530074fd0 con 0x7fd5301000b0 2024-03-19T05:55:01.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.369+0000 7fd52ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5301000b0 0x7fd530073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:55:01.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.369+0000 7fd52ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5301000b0 0x7fd530073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.172:39248/0 (socket says 172.21.15.172:39248) 2024-03-19T05:55:01.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.369+0000 7fd52ea00700 1 -- 172.21.15.172:0/2087522312 learned_addr learned my addr 172.21.15.172:0/2087522312 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:55:01.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.370+0000 7fd52ea00700 1 -- 172.21.15.172:0/2087522312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd520009d00 con 0x7fd5301000b0 2024-03-19T05:55:01.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.370+0000 7fd52ea00700 1 --2- 172.21.15.172:0/2087522312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5301000b0 0x7fd530073050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd520009fd0 tx=0x7fd520003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:55:01.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.371+0000 7fd527e00700 1 -- 172.21.15.172:0/2087522312 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd52000e040 con 0x7fd5301000b0 2024-03-19T05:55:01.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.371+0000 7fd535a00700 1 -- 172.21.15.172:0/2087522312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd530073590 con 0x7fd5301000b0 2024-03-19T05:55:01.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.371+0000 7fd535a00700 1 -- 172.21.15.172:0/2087522312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd530073a10 con 0x7fd5301000b0 2024-03-19T05:55:01.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.371+0000 7fd527e00700 1 -- 172.21.15.172:0/2087522312 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd52000bdd0 con 0x7fd5301000b0 2024-03-19T05:55:01.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.371+0000 7fd527e00700 1 -- 172.21.15.172:0/2087522312 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd52001d9a0 con 0x7fd5301000b0 2024-03-19T05:55:01.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.372+0000 7fd535a00700 1 -- 172.21.15.172:0/2087522312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd530108330 con 0x7fd5301000b0 2024-03-19T05:55:01.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.373+0000 7fd527e00700 1 -- 172.21.15.172:0/2087522312 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fd520004250 con 0x7fd5301000b0 2024-03-19T05:55:01.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.373+0000 7fd527e00700 1 --2- 172.21.15.172:0/2087522312 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd514038620 0x7fd51403aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:55:01.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.373+0000 7fd527e00700 1 -- 172.21.15.172:0/2087522312 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd52004c480 con 0x7fd5301000b0 2024-03-19T05:55:01.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.374+0000 7fd526000700 1 --2- 172.21.15.172:0/2087522312 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd514038620 0x7fd51403aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:55:01.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.375+0000 7fd526000700 1 --2- 172.21.15.172:0/2087522312 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd514038620 0x7fd51403aad0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd518006fd0 tx=0x7fd518006e40 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:55:01.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.388+0000 7fd527e00700 1 -- 172.21.15.172:0/2087522312 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd520011570 con 0x7fd5301000b0 2024-03-19T05:55:01.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.716+0000 7fd535a00700 1 -- 172.21.15.172:0/2087522312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd530073d10 con 0x7fd5301000b0 2024-03-19T05:55:01.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.717+0000 7fd527e00700 1 -- 172.21.15.172:0/2087522312 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd52002b200 con 0x7fd5301000b0 2024-03-19T05:55:01.710 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:55:01.710 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:51:10.617972Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-19T05:55:01.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.720+0000 7fd535a00700 1 -- 172.21.15.172:0/2087522312 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd514038620 msgr2=0x7fd51403aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:55:01.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.720+0000 7fd535a00700 1 --2- 172.21.15.172:0/2087522312 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd514038620 0x7fd51403aad0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd518006fd0 tx=0x7fd518006e40 comp rx=0 tx=0).stop 2024-03-19T05:55:01.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.720+0000 7fd535a00700 1 -- 172.21.15.172:0/2087522312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5301000b0 msgr2=0x7fd530073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:55:01.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.720+0000 7fd535a00700 1 --2- 172.21.15.172:0/2087522312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5301000b0 0x7fd530073050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd520009fd0 tx=0x7fd520003ce0 comp rx=0 tx=0).stop 2024-03-19T05:55:01.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.720+0000 7fd535a00700 1 -- 172.21.15.172:0/2087522312 shutdown_connections 2024-03-19T05:55:01.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.720+0000 7fd535a00700 1 --2- 172.21.15.172:0/2087522312 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd514038620 0x7fd51403aad0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:01.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.720+0000 7fd535a00700 1 --2- 172.21.15.172:0/2087522312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5301000b0 0x7fd530073050 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:01.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.720+0000 7fd535a00700 1 -- 172.21.15.172:0/2087522312 >> 172.21.15.172:0/2087522312 conn(0x7fd5300fb970 msgr2=0x7fd530104290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:55:01.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.720+0000 7fd535a00700 1 -- 172.21.15.172:0/2087522312 shutdown_connections 2024-03-19T05:55:01.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:01.721+0000 7fd535a00700 1 -- 172.21.15.172:0/2087522312 wait complete. 2024-03-19T05:55:01.714 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-03-19T05:55:02.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:01 smithi072 ceph-mon[28706]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:02.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:01 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/2087522312' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:55:02.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:02.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:02.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:02.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:02.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T05:55:02.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:03.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:02 smithi072 ceph-mon[28706]: Deploying daemon mon.smithi172 on smithi172 2024-03-19T05:55:03.452 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-19T05:55:03.452 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mon dump -f json 2024-03-19T05:55:04.285 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:03 smithi072 ceph-mon[28706]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:04.942 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi172/config 2024-03-19T05:55:05.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:05 smithi172 systemd[1]: Starting Ceph mon.smithi172 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T05:55:06.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:05 smithi072 ceph-mon[28706]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:06.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:06.592 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:06 smithi172 podman[35668]: 2024-03-19 05:55:06.341837992 +0000 UTC m=+0.268037815 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007 2024-03-19T05:55:06.592 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:06 smithi172 podman[35668]: 2024-03-19 05:55:06.437269017 +0000 UTC m=+0.363468863 container create 31fba31e7d8a71b74bd306264d6456302e136d46e3ff01fdaedf614d3daebd12 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0) 2024-03-19T05:55:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:06 smithi172 podman[35668]: 2024-03-19 05:55:06.943585382 +0000 UTC m=+0.869785226 container init 31fba31e7d8a71b74bd306264d6456302e136d46e3ff01fdaedf614d3daebd12 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-19T05:55:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:06 smithi172 podman[35668]: 2024-03-19 05:55:06.952742963 +0000 UTC m=+0.878942786 container start 31fba31e7d8a71b74bd306264d6456302e136d46e3ff01fdaedf614d3daebd12 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.29.1) 2024-03-19T05:55:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:06 smithi172 ceph-mon[35716]: set uid:gid to 167:167 (ceph:ceph) 2024-03-19T05:55:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:06 smithi172 ceph-mon[35716]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-03-19T05:55:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:06 smithi172 ceph-mon[35716]: pidfile_write: ignore empty --pid-file 2024-03-19T05:55:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:06 smithi172 ceph-mon[35716]: load: jerasure load: lrc 2024-03-19T05:55:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: RocksDB version: 7.9.2 2024-03-19T05:55:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Git sha 0 2024-03-19T05:55:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Compile date 2023-08-03 19:21:13 2024-03-19T05:55:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: DB SUMMARY 2024-03-19T05:55:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: DB Session ID: FRLXTHQNOIIBHSJVJY6B 2024-03-19T05:55:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: CURRENT file: CURRENT 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: IDENTITY file: IDENTITY 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi172/store.db dir, Total Num: 0, files: 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi172/store.db: 000004.log size: 511 ; 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.error_if_exists: 0 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.create_if_missing: 0 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.paranoid_checks: 1 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.env: 0x561bf5691720 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.fs: PosixFileSystem 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.info_log: 0x561bf71272c0 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_file_opening_threads: 16 2024-03-19T05:55:07.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.statistics: (nil) 2024-03-19T05:55:07.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.use_fsync: 0 2024-03-19T05:55:07.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_log_file_size: 0 2024-03-19T05:55:07.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-19T05:55:07.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-19T05:55:07.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.keep_log_file_num: 1000 2024-03-19T05:55:07.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.recycle_log_file_num: 0 2024-03-19T05:55:07.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.allow_fallocate: 1 2024-03-19T05:55:07.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.allow_mmap_reads: 0 2024-03-19T05:55:07.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.allow_mmap_writes: 0 2024-03-19T05:55:07.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.use_direct_reads: 0 2024-03-19T05:55:07.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-19T05:55:07.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.create_missing_column_families: 0 2024-03-19T05:55:07.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.db_log_dir: 2024-03-19T05:55:07.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.wal_dir: 2024-03-19T05:55:07.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-19T05:55:07.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-19T05:55:07.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.advise_random_on_open: 1 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.db_write_buffer_size: 0 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.write_buffer_manager: 0x561bf63983c0 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.rate_limiter: (nil) 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.wal_recovery_mode: 2 2024-03-19T05:55:07.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.enable_thread_tracking: 0 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.enable_pipelined_write: 0 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.unordered_write: 0 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.row_cache: None 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.wal_filter: None 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.allow_ingest_behind: 0 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.two_write_queues: 0 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.manual_wal_flush: 0 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.wal_compression: 0 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.atomic_flush: 0 2024-03-19T05:55:07.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.log_readahead_size: 0 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.best_efforts_recovery: 0 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.allow_data_in_errors: 0 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.db_host_id: __hostname__ 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_background_jobs: 2 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_background_compactions: -1 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_subcompactions: 1 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-19T05:55:07.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_total_wal_size: 0 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_open_files: -1 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bytes_per_sync: 0 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_readahead_size: 0 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_background_flushes: -1 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Compression algorithms supported: 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-19T05:55:07.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: kZSTD supported: 0 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: kXpressCompression supported: 0 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: kLZ4HCCompression supported: 1 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: kZlibCompression supported: 1 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: kSnappyCompression supported: 1 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: kLZ4Compression supported: 1 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: kBZip2Compression supported: 0 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi172/store.db/MANIFEST-000005 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.merge_operator: 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_filter: None 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_filter_factory: None 2024-03-19T05:55:07.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.sst_partitioner_factory: None 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561bf71273c0) 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: cache_index_and_filter_blocks: 1 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: pin_top_level_index_and_filter: 1 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: index_type: 0 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: data_block_index_type: 0 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: index_shortening: 1 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: checksum: 4 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: no_block_cache: 0 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache: 0x561bf64391f0 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache_name: BinnedLRUCache 2024-03-19T05:55:07.216 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache_options: 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: capacity : 536870912 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: num_shard_bits : 4 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: strict_capacity_limit : 0 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: high_pri_pool_ratio: 0.000 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache_compressed: (nil) 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: persistent_cache: (nil) 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_size: 4096 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_size_deviation: 10 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_restart_interval: 16 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: index_block_restart_interval: 1 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: metadata_block_size: 4096 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: partition_filters: 0 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: use_delta_encoding: 1 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: filter_policy: bloomfilter 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: whole_key_filtering: 1 2024-03-19T05:55:07.217 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: verify_compression: 0 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: read_amp_bytes_per_bit: 0 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: format_version: 5 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: enable_index_compression: 1 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_align: 0 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: max_auto_readahead_size: 262144 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: prepopulate_block_cache: 0 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: initial_auto_readahead_size: 8192 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: num_file_reads_for_auto_readahead: 2 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.write_buffer_size: 33554432 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_write_buffer_number: 2 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compression: NoCompression 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bottommost_compression: Disabled 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.prefix_extractor: nullptr 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-19T05:55:07.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.num_levels: 7 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compression_opts.level: 32767 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compression_opts.strategy: 0 2024-03-19T05:55:07.219 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compression_opts.enabled: false 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.target_file_size_base: 67108864 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-19T05:55:07.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.arena_block_size: 1048576 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.disable_auto_compactions: 0 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-19T05:55:07.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.table_properties_collectors: 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.inplace_update_support: 0 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.bloom_locality: 0 2024-03-19T05:55:07.222 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.max_successive_merges: 0 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.paranoid_file_checks: 0 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.force_consistency_checks: 1 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.report_bg_io_stats: 0 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.ttl: 2592000 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.enable_blob_files: false 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.min_blob_size: 0 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.blob_file_size: 268435456 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-19T05:55:07.223 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.blob_file_starting_level: 0 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi172/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d530f8f5-d91e-4270-88af-4fad5af62a69 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710827707005120, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710827707006359, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1710827707, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d530f8f5-d91e-4270-88af-4fad5af62a69", "db_session_id": "FRLXTHQNOIIBHSJVJY6B", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710827707006761, "job": 1, "event": "recovery_finished"} 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi172/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561bf64d6000 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: DB pointer 0x561bf64c2000 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-19T05:55:07.224 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** DB Stats ** 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** Compaction Stats [default] ** 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-19T05:55:07.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** Compaction Stats [default] ** 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-19T05:55:07.226 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Block cache BinnedLRUCache@0x561bf64391f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172 does not exist in monmap, will attempt to join an existing cluster 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: using public_addr v2:172.21.15.172:0/0 -> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: starting mon.smithi172 rank -1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi172 fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(???) e0 preinit fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).mds e1 new map 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).mds e1 print_map 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: e1 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T05:55:07.227 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: legacy client fscid: -1 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: No filesystems configured 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14164 172.21.15.72:0/1004703113' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-19T05:55:07.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mgrmap e14: smithi072.jydpjk(active, since 91s) 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/2998681675' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Active manager daemon smithi072.jydpjk restarted 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Activating manager daemon smithi072.jydpjk 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: osdmap e5: 0 total, 0 up, 0 in 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mgrmap e15: smithi072.jydpjk(active, starting, since 0.00881115s) 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi072.jydpjk", "id": "smithi072.jydpjk"}]: dispatch 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Manager daemon smithi072.jydpjk is now available 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/1385385739' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:55:07.229 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/mirror_snapshot_schedule"}]: dispatch 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/trash_purge_schedule"}]: dispatch 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mgrmap e16: smithi072.jydpjk(active, since 1.00876s) 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: [19/Mar/2024:05:54:31] ENGINE Bus STARTING 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: [19/Mar/2024:05:54:31] ENGINE Serving on http://172.21.15.72:8765 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: [19/Mar/2024:05:54:31] ENGINE Serving on https://172.21.15.72:7150 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: [19/Mar/2024:05:54:31] ENGINE Bus STARTED 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mgrmap e17: smithi072.jydpjk(active, since 2s) 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.230 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/4279984456' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:55:07.231 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.231 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd/host:smithi072", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Updating smithi072:/etc/ceph/ceph.conf 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Updating smithi172:/etc/ceph/ceph.conf 2024-03-19T05:55:07.232 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T05:55:07.233 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T05:55:07.233 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/3190957102' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:55:07.233 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-19T05:55:07.233 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-03-19T05:55:07.233 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T05:55:07.233 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T05:55:07.233 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.233 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.233 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.233 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Deploying daemon ceph-exporter.smithi172 on smithi172 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Deploying daemon crash.smithi172 on smithi172 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/1300286544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:55:07.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Deploying daemon node-exporter.smithi172 on smithi172 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/52653040' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/548268745' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:55:07.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.qkcahs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.qkcahs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Deploying daemon mgr.smithi172.qkcahs on smithi172 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/2087522312' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: Deploying daemon mon.smithi172 on smithi172 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: mon.smithi172@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: expand_channel_meta expand map: {default=false} 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: expand_channel_meta from 'false' to 'false' 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: expand_channel_meta expanded map: {default=false} 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: expand_channel_meta expand map: {default=info} 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: expand_channel_meta from 'info' to 'info' 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: expand_channel_meta expanded map: {default=info} 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: expand_channel_meta expand map: {default=daemon} 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: expand_channel_meta from 'daemon' to 'daemon' 2024-03-19T05:55:07.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: expand_channel_meta expanded map: {default=daemon} 2024-03-19T05:55:07.238 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: expand_channel_meta expand map: {default=debug} 2024-03-19T05:55:07.238 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: expand_channel_meta from 'debug' to 'debug' 2024-03-19T05:55:07.238 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 ceph-mon[35716]: expand_channel_meta expanded map: {default=debug} 2024-03-19T05:55:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 bash[35668]: 31fba31e7d8a71b74bd306264d6456302e136d46e3ff01fdaedf614d3daebd12 2024-03-19T05:55:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:07 smithi172 systemd[1]: Started Ceph mon.smithi172 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T05:55:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T05:55:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: mon.smithi072 calling monitor election 2024-03-19T05:55:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:12.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: mon.smithi172 calling monitor election 2024-03-19T05:55:12.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/1299198693' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/crt"}]: dispatch 2024-03-19T05:55:12.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:12.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: mon.smithi072 is new leader, mons smithi072,smithi172 in quorum (ranks 0,1) 2024-03-19T05:55:12.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: monmap e2: 2 mons at {smithi072=[v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0],smithi172=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} 2024-03-19T05:55:12.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: fsmap 2024-03-19T05:55:12.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: osdmap e5: 0 total, 0 up, 0 in 2024-03-19T05:55:12.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: mgrmap e17: smithi072.jydpjk(active, since 41s) 2024-03-19T05:55:12.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: Standby manager daemon smithi172.qkcahs started 2024-03-19T05:55:12.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/1299198693' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T05:55:12.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: overall HEALTH_OK 2024-03-19T05:55:12.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/1299198693' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/key"}]: dispatch 2024-03-19T05:55:12.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/1299198693' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T05:55:12.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:12.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:12.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:12.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:12.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T05:55:12.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: mon.smithi072 calling monitor election 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: mon.smithi172 calling monitor election 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/1299198693' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/crt"}]: dispatch 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: mon.smithi072 is new leader, mons smithi072,smithi172 in quorum (ranks 0,1) 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: monmap e2: 2 mons at {smithi072=[v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0],smithi172=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: fsmap 2024-03-19T05:55:12.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: osdmap e5: 0 total, 0 up, 0 in 2024-03-19T05:55:12.581 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: mgrmap e17: smithi072.jydpjk(active, since 41s) 2024-03-19T05:55:12.581 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: Standby manager daemon smithi172.qkcahs started 2024-03-19T05:55:12.581 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/1299198693' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T05:55:12.581 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: overall HEALTH_OK 2024-03-19T05:55:12.581 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/1299198693' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/key"}]: dispatch 2024-03-19T05:55:12.581 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/1299198693' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T05:55:12.581 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:12.581 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:12.581 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:13.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.212+0000 7f8880200700 1 -- 172.21.15.172:0/1730493778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8860005c30 msgr2=0x7f88600080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:55:13.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.212+0000 7f8880200700 1 --2- 172.21.15.172:0/1730493778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8860005c30 0x7f88600080b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8878101400 tx=0x7f886c00ff20 comp rx=0 tx=0).stop 2024-03-19T05:55:13.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.212+0000 7f8880200700 1 -- 172.21.15.172:0/1730493778 shutdown_connections 2024-03-19T05:55:13.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.212+0000 7f8880200700 1 --2- 172.21.15.172:0/1730493778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8860005c30 0x7f88600080b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:13.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.212+0000 7f8880200700 1 -- 172.21.15.172:0/1730493778 >> 172.21.15.172:0/1730493778 conn(0x7f88780fba50 msgr2=0x7f88780fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:55:13.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.213+0000 7f8880200700 1 -- 172.21.15.172:0/1730493778 shutdown_connections 2024-03-19T05:55:13.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.213+0000 7f8880200700 1 -- 172.21.15.172:0/1730493778 wait complete. 2024-03-19T05:55:13.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.216+0000 7f8880200700 1 Processor -- start 2024-03-19T05:55:13.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.216+0000 7f8880200700 1 -- start start 2024-03-19T05:55:13.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.217+0000 7f8880200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8860005c30 0x7f8878195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:55:13.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.217+0000 7f8880200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8878195b40 0x7f8878199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:55:13.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.217+0000 7f8880200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8878196150 con 0x7f8860005c30 2024-03-19T05:55:13.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.217+0000 7f8880200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88781962c0 con 0x7f8878195b40 2024-03-19T05:55:13.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.217+0000 7f887d800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8860005c30 0x7f8878195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:55:13.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.217+0000 7f887ce00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8878195b40 0x7f8878199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:55:13.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.217+0000 7f887ce00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8878195b40 0x7f8878199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58344/0 (socket says 172.21.15.172:58344) 2024-03-19T05:55:13.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.217+0000 7f887ce00700 1 -- 172.21.15.172:0/2514659669 learned_addr learned my addr 172.21.15.172:0/2514659669 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:55:13.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.218+0000 7f887ce00700 1 -- 172.21.15.172:0/2514659669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8878195b40 msgr2=0x7f8878199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-03-19T05:55:13.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.218+0000 7f887ce00700 1 -- 172.21.15.172:0/2514659669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8878195b40 msgr2=0x7f8878199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-19T05:55:13.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.218+0000 7f887ce00700 1 --2- 172.21.15.172:0/2514659669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8878195b40 0x7f8878199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T05:55:13.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.218+0000 7f887ce00700 1 --2- 172.21.15.172:0/2514659669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8878195b40 0x7f8878199fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T05:55:13.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.218+0000 7f887d800700 1 -- 172.21.15.172:0/2514659669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8878195b40 msgr2=0x7f8878199fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-19T05:55:13.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.218+0000 7f887d800700 1 --2- 172.21.15.172:0/2514659669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8878195b40 0x7f8878199fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:13.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.218+0000 7f887d800700 1 -- 172.21.15.172:0/2514659669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c00f970 con 0x7f8860005c30 2024-03-19T05:55:13.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.218+0000 7f887d800700 1 --2- 172.21.15.172:0/2514659669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8860005c30 0x7f8878195600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f886c020000 tx=0x7f886c005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:55:13.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.219+0000 7f8876000700 1 -- 172.21.15.172:0/2514659669 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f886c021040 con 0x7f8860005c30 2024-03-19T05:55:13.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.219+0000 7f8880200700 1 -- 172.21.15.172:0/2514659669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887819a550 con 0x7f8860005c30 2024-03-19T05:55:13.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.219+0000 7f8876000700 1 -- 172.21.15.172:0/2514659669 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f886c012e50 con 0x7f8860005c30 2024-03-19T05:55:13.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.219+0000 7f8876000700 1 -- 172.21.15.172:0/2514659669 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f886c0142a0 con 0x7f8860005c30 2024-03-19T05:55:13.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.219+0000 7f8880200700 1 -- 172.21.15.172:0/2514659669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887819aaa0 con 0x7f8860005c30 2024-03-19T05:55:13.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.221+0000 7f8880200700 1 -- 172.21.15.172:0/2514659669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8878062380 con 0x7f8860005c30 2024-03-19T05:55:13.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.222+0000 7f8876000700 1 -- 172.21.15.172:0/2514659669 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f886c014510 con 0x7f8860005c30 2024-03-19T05:55:13.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.223+0000 7f8876000700 1 --2- 172.21.15.172:0/2514659669 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f885806c750 0x7f885806ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:55:13.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.223+0000 7f8876000700 1 -- 172.21.15.172:0/2514659669 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f886c08dea0 con 0x7f8860005c30 2024-03-19T05:55:13.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.224+0000 7f887ce00700 1 --2- 172.21.15.172:0/2514659669 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f885806c750 0x7f885806ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:55:13.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.225+0000 7f887ce00700 1 --2- 172.21.15.172:0/2514659669 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f885806c750 0x7f885806ec00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8864009180 tx=0x7f8864008040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:55:13.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.237+0000 7f8876000700 1 -- 172.21.15.172:0/2514659669 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f886c059640 con 0x7f8860005c30 2024-03-19T05:55:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:13 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:13 smithi172 ceph-mon[35716]: mgrmap e18: smithi072.jydpjk(active, since 41s), standbys: smithi172.qkcahs 2024-03-19T05:55:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:13 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi172.qkcahs", "id": "smithi172.qkcahs"}]: dispatch 2024-03-19T05:55:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:13 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:13 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:55:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:13 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:13.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.544+0000 7f8880200700 1 -- 172.21.15.172:0/2514659669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f887819ad80 con 0x7f8860005c30 2024-03-19T05:55:13.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.545+0000 7f8876000700 1 -- 172.21.15.172:0/2514659669 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7f886c05cc60 con 0x7f8860005c30 2024-03-19T05:55:13.538 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-19T05:55:13.538 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","modified":"2024-03-19T05:55:07.063387Z","created":"2024-03-19T05:51:10.617972Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi072","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi172","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-19T05:55:13.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.548+0000 7f8880200700 1 -- 172.21.15.172:0/2514659669 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f885806c750 msgr2=0x7f885806ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:55:13.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.548+0000 7f8880200700 1 --2- 172.21.15.172:0/2514659669 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f885806c750 0x7f885806ec00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8864009180 tx=0x7f8864008040 comp rx=0 tx=0).stop 2024-03-19T05:55:13.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.548+0000 7f8880200700 1 -- 172.21.15.172:0/2514659669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8860005c30 msgr2=0x7f8878195600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:55:13.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.548+0000 7f8880200700 1 --2- 172.21.15.172:0/2514659669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8860005c30 0x7f8878195600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f886c020000 tx=0x7f886c005cb0 comp rx=0 tx=0).stop 2024-03-19T05:55:13.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.548+0000 7f8880200700 1 -- 172.21.15.172:0/2514659669 shutdown_connections 2024-03-19T05:55:13.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.548+0000 7f8880200700 1 --2- 172.21.15.172:0/2514659669 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f885806c750 0x7f885806ec00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:13.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.548+0000 7f8880200700 1 --2- 172.21.15.172:0/2514659669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8860005c30 0x7f8878195600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:13.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.548+0000 7f8880200700 1 --2- 172.21.15.172:0/2514659669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8878195b40 0x7f8878199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:13.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.548+0000 7f8880200700 1 -- 172.21.15.172:0/2514659669 >> 172.21.15.172:0/2514659669 conn(0x7f88780fba50 msgr2=0x7f88780fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:55:13.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.549+0000 7f8880200700 1 -- 172.21.15.172:0/2514659669 shutdown_connections 2024-03-19T05:55:13.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:55:13.549+0000 7f8880200700 1 -- 172.21.15.172:0/2514659669 wait complete. 2024-03-19T05:55:13.542 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-03-19T05:55:13.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:13 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:13.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:13 smithi072 ceph-mon[28706]: mgrmap e18: smithi072.jydpjk(active, since 41s), standbys: smithi172.qkcahs 2024-03-19T05:55:13.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:13 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi172.qkcahs", "id": "smithi172.qkcahs"}]: dispatch 2024-03-19T05:55:13.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:13 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:13.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:13 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:55:13.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:13 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:55:14.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:14 smithi172 ceph-mon[35716]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:14.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:14 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/2514659669' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:55:14.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:14 smithi072 ceph-mon[28706]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:14.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:14 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/2514659669' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-19T05:55:14.718 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-19T05:55:14.719 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph config generate-minimal-conf 2024-03-19T05:55:15.117 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:55:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:16 smithi172 ceph-mon[35716]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:55:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:55:16.451 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:16 smithi072 ceph-mon[28706]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:16.451 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:55:16.451 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:16.451 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:16.451 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:16.451 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:16.451 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:55:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.269+0000 7f4c0b400700 1 -- 172.21.15.72:0/485900637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c04100090 msgr2=0x7f4c04100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:55:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.269+0000 7f4c0b400700 1 --2- 172.21.15.72:0/485900637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c04100090 0x7f4c04100460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800b0a0 tx=0x7f4bf800b3b0 comp rx=0 tx=0).stop 2024-03-19T05:55:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.270+0000 7f4c0b400700 1 -- 172.21.15.72:0/485900637 shutdown_connections 2024-03-19T05:55:17.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.270+0000 7f4c0b400700 1 --2- 172.21.15.72:0/485900637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c04100090 0x7f4c04100460 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.270+0000 7f4c0b400700 1 -- 172.21.15.72:0/485900637 >> 172.21.15.72:0/485900637 conn(0x7f4c040fb970 msgr2=0x7f4c040fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:55:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.270+0000 7f4c0b400700 1 -- 172.21.15.72:0/485900637 shutdown_connections 2024-03-19T05:55:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.270+0000 7f4c0b400700 1 -- 172.21.15.72:0/485900637 wait complete. 2024-03-19T05:55:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.271+0000 7f4c0b400700 1 Processor -- start 2024-03-19T05:55:17.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.271+0000 7f4c0b400700 1 -- start start 2024-03-19T05:55:17.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.271+0000 7f4c0b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c04100090 0x7f4c0419d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:55:17.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.271+0000 7f4c0b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c0419d960 0x7f4c04197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:55:17.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.272+0000 7f4c0b400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0419df70 con 0x7f4c04100090 2024-03-19T05:55:17.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.272+0000 7f4c0b400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c04197a40 con 0x7f4c0419d960 2024-03-19T05:55:17.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.272+0000 7f4c08a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c04100090 0x7f4c0419d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:55:17.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.272+0000 7f4c08a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c04100090 0x7f4c0419d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42398/0 (socket says 172.21.15.72:42398) 2024-03-19T05:55:17.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.272+0000 7f4c08a00700 1 -- 172.21.15.72:0/3381661803 learned_addr learned my addr 172.21.15.72:0/3381661803 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:55:17.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.272+0000 7f4c08a00700 1 -- 172.21.15.72:0/3381661803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c0419d960 msgr2=0x7f4c04197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:55:17.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.272+0000 7f4c08a00700 1 --2- 172.21.15.72:0/3381661803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c0419d960 0x7f4c04197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:17.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.272+0000 7f4c08a00700 1 -- 172.21.15.72:0/3381661803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8009d00 con 0x7f4c04100090 2024-03-19T05:55:17.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.273+0000 7f4c08a00700 1 --2- 172.21.15.72:0/3381661803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c04100090 0x7f4c0419d420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80062a0 tx=0x7f4bf8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:55:17.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.273+0000 7f4c01600700 1 -- 172.21.15.72:0/3381661803 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf800e040 con 0x7f4c04100090 2024-03-19T05:55:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.273+0000 7f4c01600700 1 -- 172.21.15.72:0/3381661803 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4bf800bdf0 con 0x7f4c04100090 2024-03-19T05:55:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.273+0000 7f4c0b400700 1 -- 172.21.15.72:0/3381661803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c04197cc0 con 0x7f4c04100090 2024-03-19T05:55:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.273+0000 7f4c01600700 1 -- 172.21.15.72:0/3381661803 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf801db60 con 0x7f4c04100090 2024-03-19T05:55:17.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.274+0000 7f4c0b400700 1 -- 172.21.15.72:0/3381661803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c04198180 con 0x7f4c04100090 2024-03-19T05:55:17.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.275+0000 7f4c0b400700 1 -- 172.21.15.72:0/3381661803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c04062380 con 0x7f4c04100090 2024-03-19T05:55:17.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.276+0000 7f4c01600700 1 -- 172.21.15.72:0/3381661803 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f4bf801dd50 con 0x7f4c04100090 2024-03-19T05:55:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.277+0000 7f4c01600700 1 --2- 172.21.15.72:0/3381661803 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f4bec06c760 0x7f4bec06ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:55:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.277+0000 7f4c01600700 1 -- 172.21.15.72:0/3381661803 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f4bf808c230 con 0x7f4c04100090 2024-03-19T05:55:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.277+0000 7f4c03e00700 1 --2- 172.21.15.72:0/3381661803 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f4bec06c760 0x7f4bec06ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:55:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.278+0000 7f4c03e00700 1 --2- 172.21.15.72:0/3381661803 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f4bec06c760 0x7f4bec06ec10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00098e0 tx=0x7f4bf0006dd0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:55:17.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.283+0000 7f4c01600700 1 -- 172.21.15.72:0/3381661803 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4bf805b500 con 0x7f4c04100090 2024-03-19T05:55:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.501+0000 7f4c0b400700 1 -- 172.21.15.72:0/3381661803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4c04198b80 con 0x7f4c04100090 2024-03-19T05:55:17.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:17 smithi072 ceph-mon[28706]: Updating smithi072:/etc/ceph/ceph.conf 2024-03-19T05:55:17.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:17 smithi072 ceph-mon[28706]: Updating smithi172:/etc/ceph/ceph.conf 2024-03-19T05:55:17.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:17 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:17.496 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:17 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:17.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.502+0000 7f4c01600700 1 -- 172.21.15.72:0/3381661803 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f4bf8017100 con 0x7f4c04100090 2024-03-19T05:55:17.497 INFO:teuthology.orchestra.run.smithi072.stdout:# minimal ceph.conf for 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:55:17.497 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2024-03-19T05:55:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T05:55:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: mon_host = [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-19T05:55:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.505+0000 7f4c0b400700 1 -- 172.21.15.72:0/3381661803 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f4bec06c760 msgr2=0x7f4bec06ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:55:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.505+0000 7f4c0b400700 1 --2- 172.21.15.72:0/3381661803 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f4bec06c760 0x7f4bec06ec10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00098e0 tx=0x7f4bf0006dd0 comp rx=0 tx=0).stop 2024-03-19T05:55:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.505+0000 7f4c0b400700 1 -- 172.21.15.72:0/3381661803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c04100090 msgr2=0x7f4c0419d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:55:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.505+0000 7f4c0b400700 1 --2- 172.21.15.72:0/3381661803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c04100090 0x7f4c0419d420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80062a0 tx=0x7f4bf8003ce0 comp rx=0 tx=0).stop 2024-03-19T05:55:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.505+0000 7f4c0b400700 1 -- 172.21.15.72:0/3381661803 shutdown_connections 2024-03-19T05:55:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.505+0000 7f4c0b400700 1 --2- 172.21.15.72:0/3381661803 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f4bec06c760 0x7f4bec06ec10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.505+0000 7f4c0b400700 1 --2- 172.21.15.72:0/3381661803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c04100090 0x7f4c0419d420 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.505+0000 7f4c0b400700 1 --2- 172.21.15.72:0/3381661803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c0419d960 0x7f4c04197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.505+0000 7f4c0b400700 1 -- 172.21.15.72:0/3381661803 >> 172.21.15.72:0/3381661803 conn(0x7f4c040fb970 msgr2=0x7f4c04102260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:55:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.506+0000 7f4c0b400700 1 -- 172.21.15.72:0/3381661803 shutdown_connections 2024-03-19T05:55:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:17.506+0000 7f4c0b400700 1 -- 172.21.15.72:0/3381661803 wait complete. 2024-03-19T05:55:17.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:17 smithi172 ceph-mon[35716]: Updating smithi072:/etc/ceph/ceph.conf 2024-03-19T05:55:17.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:17 smithi172 ceph-mon[35716]: Updating smithi172:/etc/ceph/ceph.conf 2024-03-19T05:55:17.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:17 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:17.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:17 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:18.227 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-19T05:55:18.227 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:55:18.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.conf 2024-03-19T05:55:18.298 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:55:18.298 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-19T05:55:18.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:18 smithi072 ceph-mon[28706]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T05:55:18.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:18 smithi072 ceph-mon[28706]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T05:55:18.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:18 smithi072 ceph-mon[28706]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:18.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:18 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:18.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:18 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:18.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:18 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:18.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:18 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3381661803' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:18.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:18 smithi072 ceph-mon[28706]: Reconfiguring mon.smithi072 (unknown last config time)... 2024-03-19T05:55:18.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:18 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T05:55:18.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:18 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-19T05:55:18.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:18 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:18.420 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:18 smithi072 ceph-mon[28706]: Reconfiguring daemon mon.smithi072 on smithi072 2024-03-19T05:55:18.421 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T05:55:18.422 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2024-03-19T05:55:18.509 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:18 smithi172 ceph-mon[35716]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T05:55:18.510 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:18 smithi172 ceph-mon[35716]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T05:55:18.510 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:18 smithi172 ceph-mon[35716]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:18.510 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:18 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:18.510 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:18 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:18.510 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:18 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:18.510 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:18 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3381661803' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:18.510 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:18 smithi172 ceph-mon[35716]: Reconfiguring mon.smithi072 (unknown last config time)... 2024-03-19T05:55:18.510 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:18 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T05:55:18.510 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:18 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-19T05:55:18.510 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:18 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:18.510 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:18 smithi172 ceph-mon[35716]: Reconfiguring daemon mon.smithi072 on smithi072 2024-03-19T05:55:18.522 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T05:55:18.522 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-19T05:55:18.658 INFO:tasks.cephadm:Deploying OSDs... 2024-03-19T05:55:18.659 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:55:18.659 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2024-03-19T05:55:18.708 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-19T05:55:18.708 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2024-03-19T05:55:18.786 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-19T05:55:18.786 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T05:55:18.786 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-19T05:55:18.786 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T05:55:18.786 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T05:55:18.786 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-03-19 05:54:19.926331422 +0000 2024-03-19T05:55:18.786 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-19 05:46:46.242421410 +0000 2024-03-19T05:55:18.786 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-19 05:46:46.242421410 +0000 2024-03-19T05:55:18.786 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-03-19 05:46:46.242421410 +0000 2024-03-19T05:55:18.787 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-19T05:55:18.901 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-03-19T05:55:18.902 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-03-19T05:55:18.902 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000322949 s, 1.6 MB/s 2024-03-19T05:55:18.905 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-19T05:55:18.955 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2024-03-19T05:55:19.001 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-19T05:55:19.001 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T05:55:19.001 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-03-19T05:55:19.001 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T05:55:19.001 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T05:55:19.001 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-03-19 05:54:19.927331401 +0000 2024-03-19T05:55:19.002 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-19 05:46:46.809409547 +0000 2024-03-19T05:55:19.002 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-19 05:46:46.809409547 +0000 2024-03-19T05:55:19.002 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-03-19 05:46:46.809409547 +0000 2024-03-19T05:55:19.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-19T05:55:19.126 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-03-19T05:55:19.127 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-03-19T05:55:19.127 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000357234 s, 1.4 MB/s 2024-03-19T05:55:19.131 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-19T05:55:19.183 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2024-03-19T05:55:19.229 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-19T05:55:19.230 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T05:55:19.230 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-03-19T05:55:19.230 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T05:55:19.230 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T05:55:19.230 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-03-19 05:54:19.928331380 +0000 2024-03-19T05:55:19.230 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-19 05:46:47.377397664 +0000 2024-03-19T05:55:19.231 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-19 05:46:47.377397664 +0000 2024-03-19T05:55:19.231 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-03-19 05:46:47.377397664 +0000 2024-03-19T05:55:19.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-19T05:55:19.351 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-03-19T05:55:19.351 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-03-19T05:55:19.351 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000331444 s, 1.5 MB/s 2024-03-19T05:55:19.357 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-19T05:55:19.415 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2024-03-19T05:55:19.465 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-19T05:55:19.465 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T05:55:19.466 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-19T05:55:19.466 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T05:55:19.466 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T05:55:19.466 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-03-19 05:54:19.929331359 +0000 2024-03-19T05:55:19.466 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-19 05:46:47.935385991 +0000 2024-03-19T05:55:19.466 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-19 05:46:47.935385991 +0000 2024-03-19T05:55:19.466 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-03-19 05:46:47.935385991 +0000 2024-03-19T05:55:19.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-19T05:55:19.566 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:19 smithi072 ceph-mon[28706]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-03-19T05:55:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-03-19T05:55:19.595 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000305814 s, 1.7 MB/s 2024-03-19T05:55:19.599 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-19T05:55:19.644 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T05:55:19.645 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-03-19T05:55:19.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:19 smithi172 ceph-mon[35716]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:19.697 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-19T05:55:19.698 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-03-19T05:55:19.793 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-19T05:55:19.794 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T05:55:19.794 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 632 Links: 1 2024-03-19T05:55:19.794 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T05:55:19.794 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T05:55:19.794 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-03-19 05:55:05.515301376 +0000 2024-03-19T05:55:19.794 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-19 05:46:32.709026390 +0000 2024-03-19T05:55:19.794 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-19 05:46:32.709026390 +0000 2024-03-19T05:55:19.794 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-03-19 05:46:32.709026390 +0000 2024-03-19T05:55:19.794 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-19T05:55:19.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-03-19T05:55:19.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-03-19T05:55:19.884 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000435037 s, 1.2 MB/s 2024-03-19T05:55:19.888 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-19T05:55:19.943 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-03-19T05:55:19.993 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-19T05:55:19.993 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T05:55:19.993 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-03-19T05:55:19.993 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T05:55:19.993 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T05:55:19.993 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-03-19 05:55:05.516301352 +0000 2024-03-19T05:55:19.993 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-19 05:46:33.288012609 +0000 2024-03-19T05:55:19.993 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-19 05:46:33.288012609 +0000 2024-03-19T05:55:19.993 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-03-19 05:46:33.288012609 +0000 2024-03-19T05:55:19.994 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-19T05:55:20.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-03-19T05:55:20.083 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-03-19T05:55:20.083 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000363488 s, 1.4 MB/s 2024-03-19T05:55:20.086 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-19T05:55:20.141 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-03-19T05:55:20.190 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-19T05:55:20.191 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T05:55:20.191 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-19T05:55:20.191 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T05:55:20.191 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T05:55:20.191 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-03-19 05:55:05.517301328 +0000 2024-03-19T05:55:20.191 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-19 05:46:33.844999351 +0000 2024-03-19T05:55:20.191 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-19 05:46:33.844999351 +0000 2024-03-19T05:55:20.191 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-03-19 05:46:33.844999351 +0000 2024-03-19T05:55:20.192 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-19T05:55:20.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-03-19T05:55:20.277 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-03-19T05:55:20.277 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000339799 s, 1.5 MB/s 2024-03-19T05:55:20.280 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-19T05:55:20.335 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-03-19T05:55:20.384 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-19T05:55:20.384 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T05:55:20.384 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-19T05:55:20.384 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T05:55:20.384 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T05:55:20.384 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-03-19 05:55:05.518301304 +0000 2024-03-19T05:55:20.384 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-19 05:46:34.420985641 +0000 2024-03-19T05:55:20.384 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-19 05:46:34.420985641 +0000 2024-03-19T05:55:20.384 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-03-19 05:46:34.420985641 +0000 2024-03-19T05:55:20.385 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-19T05:55:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-03-19T05:55:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-03-19T05:55:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000352349 s, 1.5 MB/s 2024-03-19T05:55:20.476 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-19T05:55:20.533 INFO:tasks.cephadm:Deploying osd.0 on smithi072 with /dev/vg_nvme/lv_4... 2024-03-19T05:55:20.534 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-19T05:55:21.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:20 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:21.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:20 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:21.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:20 smithi072 ceph-mon[28706]: Reconfiguring mgr.smithi072.jydpjk (unknown last config time)... 2024-03-19T05:55:21.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:20 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.jydpjk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T05:55:21.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:20 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T05:55:21.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:20 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:21.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:20 smithi072 ceph-mon[28706]: Reconfiguring daemon mgr.smithi072.jydpjk on smithi072 2024-03-19T05:55:21.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:20 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:21.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:20 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:21.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:20 smithi172 ceph-mon[35716]: Reconfiguring mgr.smithi072.jydpjk (unknown last config time)... 2024-03-19T05:55:21.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:20 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.jydpjk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T05:55:21.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:20 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T05:55:21.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:20 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:21.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:20 smithi172 ceph-mon[35716]: Reconfiguring daemon mgr.smithi072.jydpjk on smithi072 2024-03-19T05:55:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:55:22.071 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:21 smithi072 ceph-mon[28706]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:22.071 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:21 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:22.071 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:21 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:22.071 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:21 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T05:55:22.071 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:21 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:22.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:21 smithi172 ceph-mon[35716]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:22.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:21 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:22.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:21 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:22.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:21 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T05:55:22.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:21 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:23.189 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:22 smithi072 ceph-mon[28706]: Reconfiguring ceph-exporter.smithi072 (monmap changed)... 2024-03-19T05:55:23.189 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:22 smithi072 ceph-mon[28706]: Reconfiguring daemon ceph-exporter.smithi072 on smithi072 2024-03-19T05:55:23.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:22 smithi172 ceph-mon[35716]: Reconfiguring ceph-exporter.smithi072 (monmap changed)... 2024-03-19T05:55:23.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:22 smithi172 ceph-mon[35716]: Reconfiguring daemon ceph-exporter.smithi072 on smithi072 2024-03-19T05:55:24.254 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:23 smithi072 ceph-mon[28706]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:24.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:23 smithi172 ceph-mon[35716]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-19T05:55:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-19T05:55:25.329 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-03-19T05:55:25.330 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-03-19T05:55:25.330 INFO:teuthology.orchestra.run.smithi072.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0320705 s, 327 MB/s 2024-03-19T05:55:25.330 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-03-19T05:55:25.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:25 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:25.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:25 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:25.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:25 smithi172 ceph-mon[35716]: Reconfiguring crash.smithi072 (monmap changed)... 2024-03-19T05:55:25.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:25 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T05:55:25.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:25 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:25.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:25 smithi172 ceph-mon[35716]: Reconfiguring daemon crash.smithi072 on smithi072 2024-03-19T05:55:25.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:25 smithi172 ceph-mon[35716]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:25.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:25 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:25.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:25 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:25.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:25 smithi072 ceph-mon[28706]: Reconfiguring crash.smithi072 (monmap changed)... 2024-03-19T05:55:25.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:25 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T05:55:25.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:25 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:25.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:25 smithi072 ceph-mon[28706]: Reconfiguring daemon crash.smithi072 on smithi072 2024-03-19T05:55:25.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:25 smithi072 ceph-mon[28706]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:26.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi072:vg_nvme/lv_4 2024-03-19T05:55:27.122 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:55:28.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:28 smithi072 ceph-mon[28706]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:28.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:28 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:28.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:28 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:28.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:28 smithi072 ceph-mon[28706]: Reconfiguring alertmanager.smithi072 (dependencies changed)... 2024-03-19T05:55:28.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:28 smithi072 ceph-mon[28706]: Reconfiguring daemon alertmanager.smithi072 on smithi072 2024-03-19T05:55:28.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:28 smithi172 ceph-mon[35716]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:28.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:28 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:28.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:28 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:28.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:28 smithi172 ceph-mon[35716]: Reconfiguring alertmanager.smithi072 (dependencies changed)... 2024-03-19T05:55:28.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:28 smithi172 ceph-mon[35716]: Reconfiguring daemon alertmanager.smithi072 on smithi072 2024-03-19T05:55:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.663+0000 7f429d400700 1 -- 172.21.15.72:0/3185190774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4298106840 msgr2=0x7f4298106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:55:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.663+0000 7f429d400700 1 --2- 172.21.15.72:0/3185190774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4298106840 0x7f4298106c50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4288009910 tx=0x7f4288009c20 comp rx=0 tx=0).stop 2024-03-19T05:55:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.663+0000 7f429d400700 1 -- 172.21.15.72:0/3185190774 shutdown_connections 2024-03-19T05:55:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.663+0000 7f429d400700 1 --2- 172.21.15.72:0/3185190774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4298107a40 0x7f4298107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.663+0000 7f429d400700 1 --2- 172.21.15.72:0/3185190774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4298106840 0x7f4298106c50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.663+0000 7f429d400700 1 -- 172.21.15.72:0/3185190774 >> 172.21.15.72:0/3185190774 conn(0x7f4298075970 msgr2=0x7f4298077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:55:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.663+0000 7f429d400700 1 -- 172.21.15.72:0/3185190774 shutdown_connections 2024-03-19T05:55:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.663+0000 7f429d400700 1 -- 172.21.15.72:0/3185190774 wait complete. 2024-03-19T05:55:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.664+0000 7f429d400700 1 Processor -- start 2024-03-19T05:55:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.664+0000 7f429d400700 1 -- start start 2024-03-19T05:55:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.665+0000 7f429d400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4298106840 0x7f429819c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.665+0000 7f429d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4298107a40 0x7f429819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.665+0000 7f429d400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429819cc60 con 0x7f4298107a40 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.665+0000 7f429d400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429819cda0 con 0x7f4298106840 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.665+0000 7f428fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4298107a40 0x7f429819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.665+0000 7f428fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4298107a40 0x7f429819c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58642/0 (socket says 172.21.15.72:58642) 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.665+0000 7f428fe00700 1 -- 172.21.15.72:0/3080070142 learned_addr learned my addr 172.21.15.72:0/3080070142 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.665+0000 7f4296800700 1 --2- 172.21.15.72:0/3080070142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4298106840 0x7f429819c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.665+0000 7f428fe00700 1 -- 172.21.15.72:0/3080070142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4298106840 msgr2=0x7f429819c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.666+0000 7f428fe00700 1 --2- 172.21.15.72:0/3080070142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4298106840 0x7f429819c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.666+0000 7f428fe00700 1 -- 172.21.15.72:0/3080070142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880095f0 con 0x7f4298107a40 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.666+0000 7f428fe00700 1 --2- 172.21.15.72:0/3080070142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4298107a40 0x7f429819c640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f428000c8a0 tx=0x7f428000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.666+0000 7f428f400700 1 -- 172.21.15.72:0/3080070142 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f428000cea0 con 0x7f4298107a40 2024-03-19T05:55:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.666+0000 7f428f400700 1 -- 172.21.15.72:0/3080070142 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4280004830 con 0x7f4298107a40 2024-03-19T05:55:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.666+0000 7f429d400700 1 -- 172.21.15.72:0/3080070142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42981a1850 con 0x7f4298107a40 2024-03-19T05:55:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.666+0000 7f428f400700 1 -- 172.21.15.72:0/3080070142 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42800055b0 con 0x7f4298107a40 2024-03-19T05:55:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.666+0000 7f429d400700 1 -- 172.21.15.72:0/3080070142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42981a1da0 con 0x7f4298107a40 2024-03-19T05:55:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.667+0000 7f429d400700 1 -- 172.21.15.72:0/3080070142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429810f390 con 0x7f4298107a40 2024-03-19T05:55:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.668+0000 7f428f400700 1 -- 172.21.15.72:0/3080070142 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f4280007ad0 con 0x7f4298107a40 2024-03-19T05:55:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.669+0000 7f428f400700 1 --2- 172.21.15.72:0/3080070142 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f427c06c610 0x7f427c06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:55:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.669+0000 7f428f400700 1 -- 172.21.15.72:0/3080070142 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f428008a420 con 0x7f4298107a40 2024-03-19T05:55:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.669+0000 7f4296800700 1 --2- 172.21.15.72:0/3080070142 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f427c06c610 0x7f427c06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:55:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.670+0000 7f4296800700 1 --2- 172.21.15.72:0/3080070142 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f427c06c610 0x7f427c06eac0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4288006010 tx=0x7f428800b540 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:55:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.674+0000 7f428f400700 1 -- 172.21.15.72:0/3080070142 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f42800596f0 con 0x7f4298107a40 2024-03-19T05:55:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:55:29.899+0000 7f429d400700 1 -- 172.21.15.72:0/3080070142 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f429810c390 con 0x7f427c06c610 2024-03-19T05:55:30.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:30 smithi072 ceph-mon[28706]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:30.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-19T05:55:30.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-19T05:55:30.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:30.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:30 smithi172 ceph-mon[35716]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:30.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:30 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-19T05:55:30.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:30 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-19T05:55:30.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:30 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:31.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:31 smithi172 ceph-mon[35716]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:55:31.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:31 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:55:31.458 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:31 smithi072 ceph-mon[28706]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:55:31.458 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:55:32.363 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:32 smithi072 ceph-mon[28706]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:32.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:32 smithi172 ceph-mon[35716]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:34.286 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:34 smithi072 ceph-mon[28706]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:34.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:34 smithi172 ceph-mon[35716]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:36.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:36 smithi072 ceph-mon[28706]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:36.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:36 smithi172 ceph-mon[35716]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:37.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:37 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:37.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:37 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:37.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:37 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:37.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:37 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:38.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:38 smithi072 ceph-mon[28706]: Reconfiguring grafana.smithi072 (dependencies changed)... 2024-03-19T05:55:38.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:38 smithi072 ceph-mon[28706]: Reconfiguring daemon grafana.smithi072 on smithi072 2024-03-19T05:55:38.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:38 smithi072 ceph-mon[28706]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:38.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:38 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1686422951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "215fcddf-0352-4fb1-b006-edd278832a00"}]: dispatch 2024-03-19T05:55:38.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:38 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1686422951' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "215fcddf-0352-4fb1-b006-edd278832a00"}]': finished 2024-03-19T05:55:38.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:38 smithi072 ceph-mon[28706]: osdmap e6: 1 total, 0 up, 1 in 2024-03-19T05:55:38.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:38 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T05:55:38.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:38 smithi172 ceph-mon[35716]: Reconfiguring grafana.smithi072 (dependencies changed)... 2024-03-19T05:55:38.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:38 smithi172 ceph-mon[35716]: Reconfiguring daemon grafana.smithi072 on smithi072 2024-03-19T05:55:38.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:38 smithi172 ceph-mon[35716]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:38.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:38 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1686422951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "215fcddf-0352-4fb1-b006-edd278832a00"}]: dispatch 2024-03-19T05:55:38.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:38 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1686422951' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "215fcddf-0352-4fb1-b006-edd278832a00"}]': finished 2024-03-19T05:55:38.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:38 smithi172 ceph-mon[35716]: osdmap e6: 1 total, 0 up, 1 in 2024-03-19T05:55:38.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:38 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T05:55:39.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:39 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3027259809' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-19T05:55:39.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:39 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3027259809' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-19T05:55:40.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:40 smithi072 ceph-mon[28706]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:40.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:40 smithi172 ceph-mon[35716]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:42.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:41 smithi072 ceph-mon[28706]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:42.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:41 smithi172 ceph-mon[35716]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:44.286 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:43 smithi072 ceph-mon[28706]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:44.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:43 smithi172 ceph-mon[35716]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:46.061 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:45 smithi072 ceph-mon[28706]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:46.061 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:45 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:55:46.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:45 smithi172 ceph-mon[35716]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:46.221 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:45 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:55:48.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:47 smithi072 ceph-mon[28706]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:48.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:47 smithi172 ceph-mon[35716]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:50.274 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:49 smithi072 ceph-mon[28706]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:50.274 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:49 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:50.274 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:49 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:50.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:49 smithi172 ceph-mon[35716]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:50.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:49 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:50.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:49 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:51.238 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:50 smithi172 ceph-mon[35716]: Reconfiguring prometheus.smithi072 (dependencies changed)... 2024-03-19T05:55:51.238 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:50 smithi172 ceph-mon[35716]: Reconfiguring daemon prometheus.smithi072 on smithi072 2024-03-19T05:55:51.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:50 smithi072 ceph-mon[28706]: Reconfiguring prometheus.smithi072 (dependencies changed)... 2024-03-19T05:55:51.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:50 smithi072 ceph-mon[28706]: Reconfiguring daemon prometheus.smithi072 on smithi072 2024-03-19T05:55:52.278 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:51 smithi072 ceph-mon[28706]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:52.279 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:51 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-19T05:55:52.279 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:51 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:52.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:51 smithi172 ceph-mon[35716]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:52.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:51 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-19T05:55:52.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:51 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:53.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:53 smithi072 ceph-mon[28706]: Deploying daemon osd.0 on smithi072 2024-03-19T05:55:53.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:53 smithi172 ceph-mon[35716]: Deploying daemon osd.0 on smithi072 2024-03-19T05:55:54.285 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:54 smithi072 ceph-mon[28706]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:54.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:54 smithi172 ceph-mon[35716]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:56.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:56 smithi072 ceph-mon[28706]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:56.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:56 smithi172 ceph-mon[35716]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:58.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:58 smithi072 ceph-mon[28706]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:58.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:58 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:58.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:58 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:58.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:58 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T05:55:58.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:58 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:58.273 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:58 smithi172 ceph-mon[35716]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:55:58.273 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:58 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:58.273 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:58 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:55:58.274 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:58 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T05:55:58.274 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:58 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:55:59.320 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:59 smithi172 ceph-mon[35716]: Reconfiguring ceph-exporter.smithi172 (monmap changed)... 2024-03-19T05:55:59.320 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:55:59 smithi172 ceph-mon[35716]: Reconfiguring daemon ceph-exporter.smithi172 on smithi172 2024-03-19T05:55:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:59 smithi072 ceph-mon[28706]: Reconfiguring ceph-exporter.smithi172 (monmap changed)... 2024-03-19T05:55:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:55:59 smithi072 ceph-mon[28706]: Reconfiguring daemon ceph-exporter.smithi172 on smithi172 2024-03-19T05:56:00.291 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:00 smithi172 ceph-mon[35716]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:00.291 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:00 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:00.291 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:00 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:00.291 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:00 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T05:56:00.291 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:00 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:00.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:00 smithi072 ceph-mon[28706]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:00.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:00 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:00.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:00 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:00.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:00 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T05:56:00.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:00 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:01.140 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:01 smithi072 ceph-mon[28706]: Reconfiguring crash.smithi172 (monmap changed)... 2024-03-19T05:56:01.140 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:01 smithi072 ceph-mon[28706]: Reconfiguring daemon crash.smithi172 on smithi172 2024-03-19T05:56:01.140 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:56:01.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:01 smithi172 ceph-mon[35716]: Reconfiguring crash.smithi172 (monmap changed)... 2024-03-19T05:56:01.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:01 smithi172 ceph-mon[35716]: Reconfiguring daemon crash.smithi172 on smithi172 2024-03-19T05:56:01.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:56:02.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:02 smithi072 ceph-mon[28706]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:02.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:02.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:02.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.qkcahs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T05:56:02.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T05:56:02.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:02.356 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:02 smithi172 ceph-mon[35716]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:02.356 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:02.356 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:02.356 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.qkcahs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T05:56:02.356 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T05:56:02.356 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:03.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:03 smithi072 ceph-mon[28706]: Reconfiguring mgr.smithi172.qkcahs (monmap changed)... 2024-03-19T05:56:03.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:03 smithi072 ceph-mon[28706]: Reconfiguring daemon mgr.smithi172.qkcahs on smithi172 2024-03-19T05:56:03.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:03 smithi172 ceph-mon[35716]: Reconfiguring mgr.smithi172.qkcahs (monmap changed)... 2024-03-19T05:56:03.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:03 smithi172 ceph-mon[35716]: Reconfiguring daemon mgr.smithi172.qkcahs on smithi172 2024-03-19T05:56:04.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:04 smithi072 ceph-mon[28706]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:04.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:04.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:04.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T05:56:04.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-19T05:56:04.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:04.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:04 smithi172 ceph-mon[35716]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:04.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:04.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:04.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T05:56:04.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-19T05:56:04.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:05.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:05 smithi072 ceph-mon[28706]: Reconfiguring mon.smithi172 (monmap changed)... 2024-03-19T05:56:05.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:05 smithi072 ceph-mon[28706]: Reconfiguring daemon mon.smithi172 on smithi172 2024-03-19T05:56:05.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:05 smithi172 ceph-mon[35716]: Reconfiguring mon.smithi172 (monmap changed)... 2024-03-19T05:56:05.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:05 smithi172 ceph-mon[35716]: Reconfiguring daemon mon.smithi172 on smithi172 2024-03-19T05:56:06.124 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:06.125 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.125 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.125 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.125 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.125 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-19T05:56:06.125 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-03-19T05:56:06.125 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.125 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-19T05:56:06.125 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi072.front.sepia.ceph.com:3000"}]: dispatch 2024-03-19T05:56:06.125 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.125 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T05:56:06.126 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi072.front.sepia.ceph.com:9095"}]: dispatch 2024-03-19T05:56:06.126 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.126 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:56:06.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:06.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi072.front.sepia.ceph.com:3000"}]: dispatch 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi072.front.sepia.ceph.com:9095"}]: dispatch 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:06.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:56:07.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:07 smithi072 ceph-mon[28706]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-19T05:56:07.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:07 smithi072 ceph-mon[28706]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-03-19T05:56:07.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:07 smithi072 ceph-mon[28706]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-19T05:56:07.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:07 smithi072 ceph-mon[28706]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi072.front.sepia.ceph.com:3000"}]: dispatch 2024-03-19T05:56:07.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:07 smithi072 ceph-mon[28706]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T05:56:07.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:07 smithi072 ceph-mon[28706]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi072.front.sepia.ceph.com:9095"}]: dispatch 2024-03-19T05:56:07.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:07 smithi172 ceph-mon[35716]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-19T05:56:07.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:07 smithi172 ceph-mon[35716]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi072.front.sepia.ceph.com:9093"}]: dispatch 2024-03-19T05:56:07.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:07 smithi172 ceph-mon[35716]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-19T05:56:07.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:07 smithi172 ceph-mon[35716]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi072.front.sepia.ceph.com:3000"}]: dispatch 2024-03-19T05:56:07.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:07 smithi172 ceph-mon[35716]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T05:56:07.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:07 smithi172 ceph-mon[35716]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi072.front.sepia.ceph.com:9095"}]: dispatch 2024-03-19T05:56:08.164 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:08 smithi072 ceph-mon[28706]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:08.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:08 smithi172 ceph-mon[35716]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:09.573 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 0 on host 'smithi072' 2024-03-19T05:56:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:09.580+0000 7f428f400700 1 -- 172.21.15.72:0/3080070142 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f429810c390 con 0x7f427c06c610 2024-03-19T05:56:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:09.583+0000 7f429d400700 1 -- 172.21.15.72:0/3080070142 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f427c06c610 msgr2=0x7f427c06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:56:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:09.583+0000 7f429d400700 1 --2- 172.21.15.72:0/3080070142 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f427c06c610 0x7f427c06eac0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4288006010 tx=0x7f428800b540 comp rx=0 tx=0).stop 2024-03-19T05:56:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:09.583+0000 7f429d400700 1 -- 172.21.15.72:0/3080070142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4298107a40 msgr2=0x7f429819c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:56:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:09.583+0000 7f429d400700 1 --2- 172.21.15.72:0/3080070142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4298107a40 0x7f429819c640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f428000c8a0 tx=0x7f428000cc60 comp rx=0 tx=0).stop 2024-03-19T05:56:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:09.583+0000 7f429d400700 1 -- 172.21.15.72:0/3080070142 shutdown_connections 2024-03-19T05:56:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:09.583+0000 7f429d400700 1 --2- 172.21.15.72:0/3080070142 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f427c06c610 0x7f427c06eac0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:56:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:09.583+0000 7f429d400700 1 --2- 172.21.15.72:0/3080070142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4298106840 0x7f429819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:56:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:09.583+0000 7f429d400700 1 --2- 172.21.15.72:0/3080070142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4298107a40 0x7f429819c640 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:56:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:09.583+0000 7f429d400700 1 -- 172.21.15.72:0/3080070142 >> 172.21.15.72:0/3080070142 conn(0x7f4298075970 msgr2=0x7f429810ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:56:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:09.584+0000 7f429d400700 1 -- 172.21.15.72:0/3080070142 shutdown_connections 2024-03-19T05:56:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:09.584+0000 7f429d400700 1 -- 172.21.15.72:0/3080070142 wait complete. 2024-03-19T05:56:09.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:09 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:09.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:09 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:09.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:09 smithi072 ceph-mon[28706]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:09.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:09 smithi072 ceph-mon[28706]: from='osd.0 [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-19T05:56:09.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:09 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:09.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:09 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:09.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:09 smithi172 ceph-mon[35716]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:09.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:09 smithi172 ceph-mon[35716]: from='osd.0 [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-19T05:56:10.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:10 smithi072 ceph-mon[28706]: from='osd.0 [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-19T05:56:10.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:10 smithi072 ceph-mon[28706]: osdmap e7: 1 total, 0 up, 1 in 2024-03-19T05:56:10.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:10 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T05:56:10.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:10 smithi072 ceph-mon[28706]: from='osd.0 [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-19T05:56:10.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:10 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:10.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:10 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:10.887 DEBUG:teuthology.orchestra.run.smithi072:osd.0> sudo journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.0.service 2024-03-19T05:56:10.895 INFO:tasks.cephadm:Deploying osd.1 on smithi072 with /dev/vg_nvme/lv_3... 2024-03-19T05:56:10.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-19T05:56:10.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:10 smithi172 ceph-mon[35716]: from='osd.0 [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-19T05:56:10.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:10 smithi172 ceph-mon[35716]: osdmap e7: 1 total, 0 up, 1 in 2024-03-19T05:56:10.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:10 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T05:56:10.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:10 smithi172 ceph-mon[35716]: from='osd.0 [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-19T05:56:10.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:10 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:10.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:10 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:11.367 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:56:11.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:11 smithi172 ceph-mon[35716]: from='osd.0 [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-19T05:56:11.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:11 smithi172 ceph-mon[35716]: osdmap e8: 1 total, 0 up, 1 in 2024-03-19T05:56:11.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T05:56:11.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T05:56:11.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:11 smithi172 ceph-mon[35716]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:11.820 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:11 smithi072 ceph-mon[28706]: from='osd.0 [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-19T05:56:11.820 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:11 smithi072 ceph-mon[28706]: osdmap e8: 1 total, 0 up, 1 in 2024-03-19T05:56:11.820 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T05:56:11.821 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T05:56:11.821 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:11 smithi072 ceph-mon[28706]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-19T05:56:12.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:12 smithi072 ceph-mon[28706]: purged_snaps scrub starts 2024-03-19T05:56:12.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:12 smithi072 ceph-mon[28706]: purged_snaps scrub ok 2024-03-19T05:56:12.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:12 smithi072 ceph-mon[28706]: osd.0 [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724] boot 2024-03-19T05:56:12.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:12 smithi072 ceph-mon[28706]: osdmap e9: 1 total, 1 up, 1 in 2024-03-19T05:56:12.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T05:56:12.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:12 smithi172 ceph-mon[35716]: purged_snaps scrub starts 2024-03-19T05:56:12.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:12 smithi172 ceph-mon[35716]: purged_snaps scrub ok 2024-03-19T05:56:12.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:12 smithi172 ceph-mon[35716]: osd.0 [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724] boot 2024-03-19T05:56:12.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:12 smithi172 ceph-mon[35716]: osdmap e9: 1 total, 1 up, 1 in 2024-03-19T05:56:12.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T05:56:13.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:13 smithi072 ceph-mon[28706]: osdmap e10: 1 total, 1 up, 1 in 2024-03-19T05:56:13.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:13 smithi072 ceph-mon[28706]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:13.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:13 smithi172 ceph-mon[35716]: osdmap e10: 1 total, 1 up, 1 in 2024-03-19T05:56:13.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:13 smithi172 ceph-mon[35716]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-19T05:56:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-19T05:56:15.138 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-03-19T05:56:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-03-19T05:56:15.138 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0322237 s, 325 MB/s 2024-03-19T05:56:15.138 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-03-19T05:56:15.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:15 smithi172 ceph-mon[35716]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:15.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:15 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:56:16.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:15 smithi072 ceph-mon[28706]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:16.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:15 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:56:16.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi072:vg_nvme/lv_3 2024-03-19T05:56:17.060 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:56:17.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:17 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:17.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:17 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:17.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:17 smithi072 ceph-mon[28706]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:17.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:17 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:17.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:17 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:17.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:17 smithi172 ceph-mon[35716]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:19.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.443+0000 7f1e53c00700 1 -- 172.21.15.72:0/2635308556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e4c074d80 msgr2=0x7f1e4c0731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:56:19.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.443+0000 7f1e53c00700 1 --2- 172.21.15.72:0/2635308556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e4c074d80 0x7f1e4c0731e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009910 tx=0x7f1e40009c20 comp rx=0 tx=0).stop 2024-03-19T05:56:19.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.444+0000 7f1e53c00700 1 -- 172.21.15.72:0/2635308556 shutdown_connections 2024-03-19T05:56:19.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.444+0000 7f1e53c00700 1 --2- 172.21.15.72:0/2635308556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e4c0737b0 0x7f1e4c073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:56:19.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.444+0000 7f1e53c00700 1 --2- 172.21.15.72:0/2635308556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e4c074d80 0x7f1e4c0731e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.444+0000 7f1e53c00700 1 -- 172.21.15.72:0/2635308556 >> 172.21.15.72:0/2635308556 conn(0x7f1e4c0fb7f0 msgr2=0x7f1e4c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.444+0000 7f1e53c00700 1 -- 172.21.15.72:0/2635308556 shutdown_connections 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.444+0000 7f1e53c00700 1 -- 172.21.15.72:0/2635308556 wait complete. 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.445+0000 7f1e53c00700 1 Processor -- start 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.445+0000 7f1e53c00700 1 -- start start 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.445+0000 7f1e53c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e4c0737b0 0x7f1e4c19c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.445+0000 7f1e53c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e4c074d80 0x7f1e4c19c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.445+0000 7f1e53c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c19cbc0 con 0x7f1e4c0737b0 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.445+0000 7f1e53c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c19cd00 con 0x7f1e4c074d80 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.445+0000 7f1e51200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e4c0737b0 0x7f1e4c19c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.445+0000 7f1e51200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e4c0737b0 0x7f1e4c19c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55572/0 (socket says 172.21.15.72:55572) 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.445+0000 7f1e51200700 1 -- 172.21.15.72:0/13047758 learned_addr learned my addr 172.21.15.72:0/13047758 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:56:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.446+0000 7f1e4be00700 1 --2- 172.21.15.72:0/13047758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e4c074d80 0x7f1e4c19c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.446+0000 7f1e51200700 1 -- 172.21.15.72:0/13047758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e4c074d80 msgr2=0x7f1e4c19c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.446+0000 7f1e51200700 1 --2- 172.21.15.72:0/13047758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e4c074d80 0x7f1e4c19c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.446+0000 7f1e51200700 1 -- 172.21.15.72:0/13047758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400095f0 con 0x7f1e4c0737b0 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.446+0000 7f1e51200700 1 --2- 172.21.15.72:0/13047758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e4c0737b0 0x7f1e4c19c060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000b5c0 tx=0x7f1e4000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.446+0000 7f1e49600700 1 -- 172.21.15.72:0/13047758 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e4001d070 con 0x7f1e4c0737b0 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.446+0000 7f1e49600700 1 -- 172.21.15.72:0/13047758 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1e4000f460 con 0x7f1e4c0737b0 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.446+0000 7f1e49600700 1 -- 172.21.15.72:0/13047758 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e40021640 con 0x7f1e4c0737b0 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.446+0000 7f1e53c00700 1 -- 172.21.15.72:0/13047758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4c1a1750 con 0x7f1e4c0737b0 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.447+0000 7f1e53c00700 1 -- 172.21.15.72:0/13047758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c1a1c40 con 0x7f1e4c0737b0 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.448+0000 7f1e53c00700 1 -- 172.21.15.72:0/13047758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4c10f370 con 0x7f1e4c0737b0 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.448+0000 7f1e49600700 1 -- 172.21.15.72:0/13047758 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f1e4000f5d0 con 0x7f1e4c0737b0 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.449+0000 7f1e49600700 1 --2- 172.21.15.72:0/13047758 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1e3406c610 0x7f1e3406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:56:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.449+0000 7f1e49600700 1 -- 172.21.15.72:0/13047758 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f1e4008bd80 con 0x7f1e4c0737b0 2024-03-19T05:56:19.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.450+0000 7f1e4be00700 1 --2- 172.21.15.72:0/13047758 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1e3406c610 0x7f1e3406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:56:19.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.450+0000 7f1e4be00700 1 --2- 172.21.15.72:0/13047758 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1e3406c610 0x7f1e3406eac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1e38005950 tx=0x7f1e380058e0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:56:19.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.454+0000 7f1e49600700 1 -- 172.21.15.72:0/13047758 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1e4005ad50 con 0x7f1e4c0737b0 2024-03-19T05:56:19.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:19.678+0000 7f1e53c00700 1 -- 172.21.15.72:0/13047758 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e4c1032f0 con 0x7f1e3406c610 2024-03-19T05:56:19.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:19 smithi172 ceph-mon[35716]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:19.999 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:19 smithi072 ceph-mon[28706]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:20.817 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:20 smithi072 ceph-mon[28706]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:56:20.817 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:20 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-19T05:56:20.817 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:20 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-19T05:56:20.817 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:20 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:20.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:20 smithi172 ceph-mon[35716]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:56:20.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:20 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-19T05:56:20.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:20 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-19T05:56:20.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:20 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:22.255 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:21 smithi072 ceph-mon[28706]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:22.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:21 smithi172 ceph-mon[35716]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:24.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:23 smithi072 ceph-mon[28706]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:23 smithi072 ceph-mon[28706]: Detected new or changed devices on smithi072 2024-03-19T05:56:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:56:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:23 smithi072 ceph-mon[28706]: Adjusting osd_memory_target on smithi072 to 11842M 2024-03-19T05:56:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:56:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:24.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:56:24.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:23 smithi172 ceph-mon[35716]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:24.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:23 smithi172 ceph-mon[35716]: Detected new or changed devices on smithi072 2024-03-19T05:56:24.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:24.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:24.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:56:24.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:23 smithi172 ceph-mon[35716]: Adjusting osd_memory_target on smithi072 to 11842M 2024-03-19T05:56:24.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:24.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:24.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:56:24.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:24.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:56:24.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:24 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1890968241' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f52e39bf-bbfe-48c3-bf4f-70cae6b4e57c"}]: dispatch 2024-03-19T05:56:24.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:24 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1890968241' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f52e39bf-bbfe-48c3-bf4f-70cae6b4e57c"}]': finished 2024-03-19T05:56:24.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:24 smithi072 ceph-mon[28706]: osdmap e11: 2 total, 1 up, 2 in 2024-03-19T05:56:24.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:24 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T05:56:25.115 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:24 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1890968241' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f52e39bf-bbfe-48c3-bf4f-70cae6b4e57c"}]: dispatch 2024-03-19T05:56:25.115 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:24 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1890968241' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f52e39bf-bbfe-48c3-bf4f-70cae6b4e57c"}]': finished 2024-03-19T05:56:25.115 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:24 smithi172 ceph-mon[35716]: osdmap e11: 2 total, 1 up, 2 in 2024-03-19T05:56:25.115 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:24 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T05:56:25.893 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:25 smithi072 ceph-mon[28706]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:25.893 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:25 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1490038447' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-19T05:56:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:25 smithi172 ceph-mon[35716]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:26.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:25 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1490038447' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-19T05:56:27.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:26 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:27.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:26 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:27.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:26 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:27.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:26 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:28.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:28 smithi072 ceph-mon[28706]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:28.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:28 smithi172 ceph-mon[35716]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:30.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:30 smithi072 ceph-mon[28706]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:30.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:30.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:30.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:30.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:56:30.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:30.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:30 smithi172 ceph-mon[35716]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:30.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:30 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:30.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:30 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:30.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:30 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:30.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:30 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:56:30.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:30 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:31.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:56:31.368 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:31 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:56:32.295 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:32 smithi072 ceph-mon[28706]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:32.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:32 smithi172 ceph-mon[35716]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:34.286 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:34 smithi072 ceph-mon[28706]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:34.287 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:34 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-19T05:56:34.287 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:34 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:34.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:34 smithi172 ceph-mon[35716]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:34.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:34 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-19T05:56:34.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:34 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:35.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:35 smithi072 ceph-mon[28706]: Deploying daemon osd.1 on smithi072 2024-03-19T05:56:35.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:35 smithi172 ceph-mon[35716]: Deploying daemon osd.1 on smithi072 2024-03-19T05:56:36.304 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:36 smithi072 ceph-mon[28706]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:36.385 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:36 smithi172 ceph-mon[35716]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:38.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:38 smithi072 ceph-mon[28706]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:38.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:38 smithi172 ceph-mon[35716]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:40.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:40 smithi172 ceph-mon[35716]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:40.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:40 smithi072 ceph-mon[28706]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:42.380 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:42 smithi072 ceph-mon[28706]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:42.380 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:42 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:42.380 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:42 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:42.380 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:42 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:56:42.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:42 smithi172 ceph-mon[35716]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:42.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:42 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:42.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:42 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:42.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:42 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:56:44.365 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:44 smithi172 ceph-mon[35716]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:44.388 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:44 smithi072 ceph-mon[28706]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:46.131 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:45 smithi072 ceph-mon[28706]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:46.131 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:45 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:46.131 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:45 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:46.131 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:45 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:56:46.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:45 smithi172 ceph-mon[35716]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:46.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:45 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:46.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:45 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:46.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:45 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:56:46.975 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:46 smithi072 ceph-mon[28706]: from='osd.1 [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-19T05:56:47.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:46 smithi172 ceph-mon[35716]: from='osd.1 [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-19T05:56:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:47.178+0000 7f1e49600700 1 -- 172.21.15.72:0/13047758 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1e4c1032f0 con 0x7f1e3406c610 2024-03-19T05:56:47.171 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 1 on host 'smithi072' 2024-03-19T05:56:47.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:47.182+0000 7f1e53c00700 1 -- 172.21.15.72:0/13047758 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1e3406c610 msgr2=0x7f1e3406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:56:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:47.182+0000 7f1e53c00700 1 --2- 172.21.15.72:0/13047758 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1e3406c610 0x7f1e3406eac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1e38005950 tx=0x7f1e380058e0 comp rx=0 tx=0).stop 2024-03-19T05:56:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:47.182+0000 7f1e53c00700 1 -- 172.21.15.72:0/13047758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e4c0737b0 msgr2=0x7f1e4c19c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:56:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:47.182+0000 7f1e53c00700 1 --2- 172.21.15.72:0/13047758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e4c0737b0 0x7f1e4c19c060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000b5c0 tx=0x7f1e4000be20 comp rx=0 tx=0).stop 2024-03-19T05:56:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:47.182+0000 7f1e53c00700 1 -- 172.21.15.72:0/13047758 shutdown_connections 2024-03-19T05:56:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:47.182+0000 7f1e53c00700 1 --2- 172.21.15.72:0/13047758 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1e3406c610 0x7f1e3406eac0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:56:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:47.182+0000 7f1e53c00700 1 --2- 172.21.15.72:0/13047758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e4c0737b0 0x7f1e4c19c060 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:56:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:47.182+0000 7f1e53c00700 1 --2- 172.21.15.72:0/13047758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e4c074d80 0x7f1e4c19c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:56:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:47.182+0000 7f1e53c00700 1 -- 172.21.15.72:0/13047758 >> 172.21.15.72:0/13047758 conn(0x7f1e4c0fb7f0 msgr2=0x7f1e4c101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:56:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:47.182+0000 7f1e53c00700 1 -- 172.21.15.72:0/13047758 shutdown_connections 2024-03-19T05:56:47.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:47.183+0000 7f1e53c00700 1 -- 172.21.15.72:0/13047758 wait complete. 2024-03-19T05:56:48.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:47 smithi072 ceph-mon[28706]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:48.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:47 smithi072 ceph-mon[28706]: from='osd.1 [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-19T05:56:48.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:47 smithi072 ceph-mon[28706]: osdmap e12: 2 total, 1 up, 2 in 2024-03-19T05:56:48.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T05:56:48.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:47 smithi072 ceph-mon[28706]: from='osd.1 [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-19T05:56:48.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:48.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:48.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:47 smithi172 ceph-mon[35716]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:48.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:47 smithi172 ceph-mon[35716]: from='osd.1 [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-19T05:56:48.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:47 smithi172 ceph-mon[35716]: osdmap e12: 2 total, 1 up, 2 in 2024-03-19T05:56:48.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:47 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T05:56:48.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:47 smithi172 ceph-mon[35716]: from='osd.1 [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-19T05:56:48.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:47 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:48.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:47 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:48.467 DEBUG:teuthology.orchestra.run.smithi072:osd.1> sudo journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.1.service 2024-03-19T05:56:48.473 INFO:tasks.cephadm:Deploying osd.2 on smithi072 with /dev/vg_nvme/lv_2... 2024-03-19T05:56:48.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-19T05:56:49.105 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:48 smithi072 ceph-mon[28706]: from='osd.1 [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-19T05:56:49.105 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:48 smithi072 ceph-mon[28706]: osdmap e13: 2 total, 1 up, 2 in 2024-03-19T05:56:49.105 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:48 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T05:56:49.105 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:48 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T05:56:49.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:48 smithi172 ceph-mon[35716]: from='osd.1 [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-19T05:56:49.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:48 smithi172 ceph-mon[35716]: osdmap e13: 2 total, 1 up, 2 in 2024-03-19T05:56:49.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:48 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T05:56:49.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:48 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T05:56:49.378 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:56:50.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:49 smithi072 ceph-mon[28706]: purged_snaps scrub starts 2024-03-19T05:56:50.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:49 smithi072 ceph-mon[28706]: purged_snaps scrub ok 2024-03-19T05:56:50.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:49 smithi072 ceph-mon[28706]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:50.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:49 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T05:56:50.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:49 smithi072 ceph-mon[28706]: osd.1 [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949] boot 2024-03-19T05:56:50.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:49 smithi072 ceph-mon[28706]: osdmap e14: 2 total, 2 up, 2 in 2024-03-19T05:56:50.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:49 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T05:56:50.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:49 smithi172 ceph-mon[35716]: purged_snaps scrub starts 2024-03-19T05:56:50.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:49 smithi172 ceph-mon[35716]: purged_snaps scrub ok 2024-03-19T05:56:50.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:49 smithi172 ceph-mon[35716]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-19T05:56:50.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:49 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T05:56:50.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:49 smithi172 ceph-mon[35716]: osd.1 [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949] boot 2024-03-19T05:56:50.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:49 smithi172 ceph-mon[35716]: osdmap e14: 2 total, 2 up, 2 in 2024-03-19T05:56:50.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:49 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T05:56:51.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:50 smithi072 ceph-mon[28706]: osdmap e15: 2 total, 2 up, 2 in 2024-03-19T05:56:51.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:50 smithi172 ceph-mon[35716]: osdmap e15: 2 total, 2 up, 2 in 2024-03-19T05:56:52.250 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:51 smithi072 ceph-mon[28706]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:56:52.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:51 smithi172 ceph-mon[35716]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:56:52.473 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-19T05:56:52.473 INFO:teuthology.orchestra.run.smithi072.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-19T05:56:52.474 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 10+0 records in 2024-03-19T05:56:52.474 INFO:teuthology.orchestra.run.smithi072.stderr:10+0 records out 2024-03-19T05:56:52.474 INFO:teuthology.orchestra.run.smithi072.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0335619 s, 312 MB/s 2024-03-19T05:56:52.474 INFO:teuthology.orchestra.run.smithi072.stderr: stderr: 2024-03-19T05:56:52.474 INFO:teuthology.orchestra.run.smithi072.stderr:--> Zapping successful for: 2024-03-19T05:56:53.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi072:vg_nvme/lv_2 2024-03-19T05:56:54.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:54 smithi072 ceph-mon[28706]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:56:54.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:54 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:54.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:54 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:54.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:54 smithi172 ceph-mon[35716]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:56:54.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:54 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:54.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:54 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:54.621 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:56:56.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:56 smithi072 ceph-mon[28706]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:56:56.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:56 smithi172 ceph-mon[35716]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:56:58.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.029+0000 7f36b0e00700 1 -- 172.21.15.72:0/2096903028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac100cd0 msgr2=0x7f36ac1030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:56:58.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.029+0000 7f36b0e00700 1 --2- 172.21.15.72:0/2096903028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac100cd0 0x7f36ac1030b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f369c009910 tx=0x7f369c009c20 comp rx=0 tx=0).stop 2024-03-19T05:56:58.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.029+0000 7f36b0e00700 1 -- 172.21.15.72:0/2096903028 shutdown_connections 2024-03-19T05:56:58.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.029+0000 7f36b0e00700 1 --2- 172.21.15.72:0/2096903028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36ac1035f0 0x7f36ac1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:56:58.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.029+0000 7f36b0e00700 1 --2- 172.21.15.72:0/2096903028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac100cd0 0x7f36ac1030b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:56:58.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.029+0000 7f36b0e00700 1 -- 172.21.15.72:0/2096903028 >> 172.21.15.72:0/2096903028 conn(0x7f36ac0fa6d0 msgr2=0x7f36ac0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:56:58.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.029+0000 7f36b0e00700 1 -- 172.21.15.72:0/2096903028 shutdown_connections 2024-03-19T05:56:58.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.029+0000 7f36b0e00700 1 -- 172.21.15.72:0/2096903028 wait complete. 2024-03-19T05:56:58.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.030+0000 7f36b0e00700 1 Processor -- start 2024-03-19T05:56:58.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.030+0000 7f36b0e00700 1 -- start start 2024-03-19T05:56:58.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.031+0000 7f36b0e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36ac100cd0 0x7f36ac195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:56:58.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.031+0000 7f36b0e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac1035f0 0x7f36ac196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:56:58.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.031+0000 7f36b0e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac196650 con 0x7f36ac1035f0 2024-03-19T05:56:58.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.031+0000 7f36b0e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac196790 con 0x7f36ac100cd0 2024-03-19T05:56:58.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.031+0000 7f36a1400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac1035f0 0x7f36ac196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:56:58.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.031+0000 7f36a1400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac1035f0 0x7f36ac196030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59462/0 (socket says 172.21.15.72:59462) 2024-03-19T05:56:58.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.031+0000 7f36a1400700 1 -- 172.21.15.72:0/1657905134 learned_addr learned my addr 172.21.15.72:0/1657905134 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:56:58.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.031+0000 7f36a9e00700 1 --2- 172.21.15.72:0/1657905134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36ac100cd0 0x7f36ac195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:56:58.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.031+0000 7f36a1400700 1 -- 172.21.15.72:0/1657905134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36ac100cd0 msgr2=0x7f36ac195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:56:58.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.031+0000 7f36a1400700 1 --2- 172.21.15.72:0/1657905134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36ac100cd0 0x7f36ac195af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:56:58.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.031+0000 7f36a1400700 1 -- 172.21.15.72:0/1657905134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c0095f0 con 0x7f36ac1035f0 2024-03-19T05:56:58.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.032+0000 7f36a1400700 1 --2- 172.21.15.72:0/1657905134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac1035f0 0x7f36ac196030 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f369400b4b0 tx=0x7f369400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:56:58.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.032+0000 7f36a3400700 1 -- 172.21.15.72:0/1657905134 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3694011800 con 0x7f36ac1035f0 2024-03-19T05:56:58.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.032+0000 7f36a3400700 1 -- 172.21.15.72:0/1657905134 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3694011e10 con 0x7f36ac1035f0 2024-03-19T05:56:58.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.032+0000 7f36b0e00700 1 -- 172.21.15.72:0/1657905134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac19b240 con 0x7f36ac1035f0 2024-03-19T05:56:58.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.032+0000 7f36a3400700 1 -- 172.21.15.72:0/1657905134 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f369400f2e0 con 0x7f36ac1035f0 2024-03-19T05:56:58.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.032+0000 7f36b0e00700 1 -- 172.21.15.72:0/1657905134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac19b790 con 0x7f36ac1035f0 2024-03-19T05:56:58.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.033+0000 7f36b0e00700 1 -- 172.21.15.72:0/1657905134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac18fce0 con 0x7f36ac1035f0 2024-03-19T05:56:58.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.034+0000 7f36a3400700 1 -- 172.21.15.72:0/1657905134 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f3694011960 con 0x7f36ac1035f0 2024-03-19T05:56:58.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.035+0000 7f36a3400700 1 --2- 172.21.15.72:0/1657905134 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f369006c610 0x7f369006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:56:58.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.035+0000 7f36a3400700 1 -- 172.21.15.72:0/1657905134 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f369408a7a0 con 0x7f36ac1035f0 2024-03-19T05:56:58.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.035+0000 7f36a9e00700 1 --2- 172.21.15.72:0/1657905134 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f369006c610 0x7f369006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:56:58.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.036+0000 7f36a9e00700 1 --2- 172.21.15.72:0/1657905134 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f369006c610 0x7f369006eac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f369c006010 tx=0x7f369c00b540 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:56:58.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.040+0000 7f36a3400700 1 -- 172.21.15.72:0/1657905134 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f36940595e0 con 0x7f36ac1035f0 2024-03-19T05:56:58.141 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:58 smithi072 ceph-mon[28706]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:56:58.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:56:58.270+0000 7f36b0e00700 1 -- 172.21.15.72:0/1657905134 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f36ac061190 con 0x7f369006c610 2024-03-19T05:56:58.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:58 smithi172 ceph-mon[35716]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:56:59.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-19T05:56:59.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-19T05:56:59.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:59.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:59.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:59.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:56:59.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:56:59.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:59.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:59.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:56:59.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:59.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:56:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:56:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-19T05:56:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-19T05:56:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:56:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:56:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:56:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:56:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:56:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:56:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:57:00.302 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:00 smithi072 ceph-mon[28706]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:57:00.302 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:00 smithi072 ceph-mon[28706]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:00.302 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:00 smithi072 ceph-mon[28706]: Detected new or changed devices on smithi072 2024-03-19T05:57:00.302 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:00 smithi072 ceph-mon[28706]: Adjusting osd_memory_target on smithi072 to 5921M 2024-03-19T05:57:00.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:00 smithi172 ceph-mon[35716]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi072:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:57:00.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:00 smithi172 ceph-mon[35716]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:00.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:00 smithi172 ceph-mon[35716]: Detected new or changed devices on smithi072 2024-03-19T05:57:00.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:00 smithi172 ceph-mon[35716]: Adjusting osd_memory_target on smithi072 to 5921M 2024-03-19T05:57:01.195 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:57:01.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:57:02.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:02 smithi072 ceph-mon[28706]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:02.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:02.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:02.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:02 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2497858149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddcccb72-1a1e-4d0a-8d61-4fa48d91cba5"}]: dispatch 2024-03-19T05:57:02.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:02 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2497858149' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddcccb72-1a1e-4d0a-8d61-4fa48d91cba5"}]': finished 2024-03-19T05:57:02.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:02 smithi072 ceph-mon[28706]: osdmap e16: 3 total, 2 up, 3 in 2024-03-19T05:57:02.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T05:57:02.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:02 smithi172 ceph-mon[35716]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:02.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:02.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:02.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:02 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2497858149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddcccb72-1a1e-4d0a-8d61-4fa48d91cba5"}]: dispatch 2024-03-19T05:57:02.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:02 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2497858149' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddcccb72-1a1e-4d0a-8d61-4fa48d91cba5"}]': finished 2024-03-19T05:57:02.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:02 smithi172 ceph-mon[35716]: osdmap e16: 3 total, 2 up, 3 in 2024-03-19T05:57:02.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T05:57:03.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:03 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3506362558' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-19T05:57:03.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:03 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3506362558' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-19T05:57:04.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:04 smithi172 ceph-mon[35716]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:04.523 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:04 smithi072 ceph-mon[28706]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:06.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:06 smithi172 ceph-mon[35716]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:06.514 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:06 smithi072 ceph-mon[28706]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:07.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:07.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:07.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:57:07.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:57:07.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:07.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:07 smithi172 ceph-mon[35716]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:07.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:07 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:07.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:07 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:07.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:07 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:57:07.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:07 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:57:07.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:07 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:07.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:07 smithi072 ceph-mon[28706]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:09.778 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:09 smithi072 ceph-mon[28706]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:09.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:09 smithi172 ceph-mon[35716]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:12.269 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:12 smithi072 ceph-mon[28706]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:12.269 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-19T05:57:12.269 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:57:12.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:12 smithi172 ceph-mon[35716]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-19T05:57:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:57:13.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:13 smithi072 ceph-mon[28706]: Deploying daemon osd.2 on smithi072 2024-03-19T05:57:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:13 smithi172 ceph-mon[35716]: Deploying daemon osd.2 on smithi072 2024-03-19T05:57:14.231 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:14 smithi072 ceph-mon[28706]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:14.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:14 smithi172 ceph-mon[35716]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:16 smithi072 ceph-mon[28706]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:57:16.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:16 smithi172 ceph-mon[35716]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:16.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:57:18.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:18 smithi072 ceph-mon[28706]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:18.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:18 smithi172 ceph-mon[35716]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:20.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:20 smithi072 ceph-mon[28706]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:20.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:20 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:20.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:20 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:20.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:20 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:57:20.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:20 smithi172 ceph-mon[35716]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:20.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:20 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:20.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:20 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:20.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:20 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:57:22.291 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:22 smithi072 ceph-mon[28706]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:22.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:22 smithi172 ceph-mon[35716]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:24.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:24 smithi072 ceph-mon[28706]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:24.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:24 smithi072 ceph-mon[28706]: from='osd.2 [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-19T05:57:24.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:24 smithi172 ceph-mon[35716]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:24.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:24 smithi172 ceph-mon[35716]: from='osd.2 [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-19T05:57:25.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:25 smithi072 ceph-mon[28706]: from='osd.2 [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-19T05:57:25.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:25 smithi072 ceph-mon[28706]: osdmap e17: 3 total, 2 up, 3 in 2024-03-19T05:57:25.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:25 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T05:57:25.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:25 smithi072 ceph-mon[28706]: from='osd.2 [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-19T05:57:25.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:25 smithi072 ceph-mon[28706]: from='osd.2 [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-19T05:57:25.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:25 smithi072 ceph-mon[28706]: osdmap e18: 3 total, 2 up, 3 in 2024-03-19T05:57:25.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:25 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T05:57:25.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:25 smithi172 ceph-mon[35716]: from='osd.2 [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-19T05:57:25.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:25 smithi172 ceph-mon[35716]: osdmap e17: 3 total, 2 up, 3 in 2024-03-19T05:57:25.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:25 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T05:57:25.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:25 smithi172 ceph-mon[35716]: from='osd.2 [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-19T05:57:25.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:25 smithi172 ceph-mon[35716]: from='osd.2 [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]': finished 2024-03-19T05:57:25.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:25 smithi172 ceph-mon[35716]: osdmap e18: 3 total, 2 up, 3 in 2024-03-19T05:57:25.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:25 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T05:57:26.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:26 smithi072 ceph-mon[28706]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:26.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:26 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T05:57:26.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:26 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T05:57:26.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:26 smithi172 ceph-mon[35716]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:26.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:26 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T05:57:26.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:26 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T05:57:27.514 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:27 smithi072 ceph-mon[28706]: osd.2 [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661] boot 2024-03-19T05:57:27.514 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:27 smithi072 ceph-mon[28706]: osdmap e19: 3 total, 3 up, 3 in 2024-03-19T05:57:27.514 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:27 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T05:57:27.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:27 smithi172 ceph-mon[35716]: osd.2 [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661] boot 2024-03-19T05:57:27.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:27 smithi172 ceph-mon[35716]: osdmap e19: 3 total, 3 up, 3 in 2024-03-19T05:57:27.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:27 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T05:57:28.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:28 smithi072 ceph-mon[28706]: purged_snaps scrub starts 2024-03-19T05:57:28.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:28 smithi072 ceph-mon[28706]: purged_snaps scrub ok 2024-03-19T05:57:28.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:28 smithi072 ceph-mon[28706]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:28.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:28 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-19T05:57:28.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:28 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-19T05:57:28.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:28 smithi072 ceph-mon[28706]: osdmap e20: 3 total, 3 up, 3 in 2024-03-19T05:57:28.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:28 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-19T05:57:28.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:28 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-19T05:57:28.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:28 smithi172 ceph-mon[35716]: purged_snaps scrub starts 2024-03-19T05:57:28.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:28 smithi172 ceph-mon[35716]: purged_snaps scrub ok 2024-03-19T05:57:28.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:28 smithi172 ceph-mon[35716]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-19T05:57:28.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:28 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-19T05:57:28.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:28 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-19T05:57:28.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:28 smithi172 ceph-mon[35716]: osdmap e20: 3 total, 3 up, 3 in 2024-03-19T05:57:28.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:28 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-19T05:57:28.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:28 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-19T05:57:28.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:57:28.720+0000 7f36a3400700 1 -- 172.21.15.72:0/1657905134 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f36ac061190 con 0x7f369006c610 2024-03-19T05:57:28.714 INFO:teuthology.orchestra.run.smithi072.stdout:Created osd(s) 2 on host 'smithi072' 2024-03-19T05:57:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:57:28.722+0000 7f36b0e00700 1 -- 172.21.15.72:0/1657905134 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f369006c610 msgr2=0x7f369006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:57:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:57:28.722+0000 7f36b0e00700 1 --2- 172.21.15.72:0/1657905134 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f369006c610 0x7f369006eac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f369c006010 tx=0x7f369c00b540 comp rx=0 tx=0).stop 2024-03-19T05:57:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:57:28.722+0000 7f36b0e00700 1 -- 172.21.15.72:0/1657905134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac1035f0 msgr2=0x7f36ac196030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:57:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:57:28.722+0000 7f36b0e00700 1 --2- 172.21.15.72:0/1657905134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac1035f0 0x7f36ac196030 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f369400b4b0 tx=0x7f369400b870 comp rx=0 tx=0).stop 2024-03-19T05:57:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:57:28.723+0000 7f36b0e00700 1 -- 172.21.15.72:0/1657905134 shutdown_connections 2024-03-19T05:57:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:57:28.723+0000 7f36b0e00700 1 --2- 172.21.15.72:0/1657905134 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f369006c610 0x7f369006eac0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:57:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:57:28.723+0000 7f36b0e00700 1 --2- 172.21.15.72:0/1657905134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36ac100cd0 0x7f36ac195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:57:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:57:28.723+0000 7f36b0e00700 1 --2- 172.21.15.72:0/1657905134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac1035f0 0x7f36ac196030 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:57:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:57:28.723+0000 7f36b0e00700 1 -- 172.21.15.72:0/1657905134 >> 172.21.15.72:0/1657905134 conn(0x7f36ac0fa6d0 msgr2=0x7f36ac0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:57:28.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:57:28.723+0000 7f36b0e00700 1 -- 172.21.15.72:0/1657905134 shutdown_connections 2024-03-19T05:57:28.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:57:28.723+0000 7f36b0e00700 1 -- 172.21.15.72:0/1657905134 wait complete. 2024-03-19T05:57:29.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:29 smithi072 ceph-mon[28706]: osdmap e21: 3 total, 3 up, 3 in 2024-03-19T05:57:29.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:29 smithi072 ceph-mon[28706]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:29.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:29 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:29.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:29 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:29.328 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 05:57:29 smithi072 sudo[56016]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-19T05:57:29.328 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 05:57:29 smithi072 sudo[56016]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-19T05:57:29.329 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 05:57:29 smithi072 sudo[56016]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-19T05:57:29.329 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 05:57:29 smithi072 sudo[56016]: pam_unix(sudo:session): session closed for user root 2024-03-19T05:57:29.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:29 smithi172 ceph-mon[35716]: osdmap e21: 3 total, 3 up, 3 in 2024-03-19T05:57:29.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:29 smithi172 ceph-mon[35716]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:29.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:29 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:29.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:29 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:29.828 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 05:57:29 smithi072 sudo[56047]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-19T05:57:29.828 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 05:57:29 smithi072 sudo[56047]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-19T05:57:29.828 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 05:57:29 smithi072 sudo[56047]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-19T05:57:29.828 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 05:57:29 smithi072 sudo[56047]: pam_unix(sudo:session): session closed for user root 2024-03-19T05:57:30.371 DEBUG:teuthology.orchestra.run.smithi072:osd.2> sudo journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.2.service 2024-03-19T05:57:30.377 INFO:tasks.cephadm:Deploying osd.3 on smithi172 with /dev/vg_nvme/lv_4... 2024-03-19T05:57:30.377 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-19T05:57:30.443 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:30 smithi072 ceph-mon[28706]: mgrmap e19: smithi072.jydpjk(active, since 2m), standbys: smithi172.qkcahs 2024-03-19T05:57:30.443 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:30 smithi072 ceph-mon[28706]: osdmap e22: 3 total, 3 up, 3 in 2024-03-19T05:57:30.443 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:30.443 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 05:57:30 smithi072 sudo[56096]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-19T05:57:30.443 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 05:57:30 smithi072 sudo[56096]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-19T05:57:30.443 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 05:57:30 smithi072 sudo[56096]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-19T05:57:30.443 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 05:57:30 smithi072 sudo[56096]: pam_unix(sudo:session): session closed for user root 2024-03-19T05:57:30.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:30 smithi172 ceph-mon[35716]: mgrmap e19: smithi072.jydpjk(active, since 2m), standbys: smithi172.qkcahs 2024-03-19T05:57:30.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:30 smithi172 ceph-mon[35716]: osdmap e22: 3 total, 3 up, 3 in 2024-03-19T05:57:30.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:30 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:30.770 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi172/config 2024-03-19T05:57:31.078 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 05:57:30 smithi072 sudo[56135]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-19T05:57:31.078 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 05:57:30 smithi072 sudo[56135]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-19T05:57:31.078 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 05:57:30 smithi072 sudo[56135]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-19T05:57:31.078 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 05:57:30 smithi072 sudo[56135]: pam_unix(sudo:session): session closed for user root 2024-03-19T05:57:31.575 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:31 smithi172 ceph-mon[35716]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:31.575 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:31 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:57:31.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:31 smithi072 ceph-mon[28706]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:31.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:57:31.578 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 05:57:31 smithi072 sudo[56171]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-19T05:57:31.578 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 05:57:31 smithi072 sudo[56171]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-19T05:57:31.578 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 05:57:31 smithi072 sudo[56171]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-19T05:57:31.578 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 05:57:31 smithi072 sudo[56171]: pam_unix(sudo:session): session closed for user root 2024-03-19T05:57:32.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 05:57:31 smithi072 sudo[56231]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-19T05:57:32.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 05:57:31 smithi072 sudo[56231]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-19T05:57:32.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 05:57:31 smithi072 sudo[56231]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-19T05:57:32.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 05:57:31 smithi072 sudo[56231]: pam_unix(sudo:session): session closed for user root 2024-03-19T05:57:32.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:32 smithi072 sudo[56288]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-19T05:57:32.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:32 smithi072 sudo[56288]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-19T05:57:32.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:32 smithi072 sudo[56288]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-19T05:57:32.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:32 smithi072 sudo[56288]: pam_unix(sudo:session): session closed for user root 2024-03-19T05:57:33.222 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-19T05:57:33.223 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-19T05:57:33.223 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-03-19T05:57:33.223 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-03-19T05:57:33.223 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0343305 s, 305 MB/s 2024-03-19T05:57:33.223 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-03-19T05:57:33.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:33 smithi072 sudo[56291]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-19T05:57:33.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:33 smithi072 sudo[56291]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-19T05:57:33.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:33 smithi072 sudo[56291]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-19T05:57:33.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:33 smithi072 sudo[56291]: pam_unix(sudo:session): session closed for user root 2024-03-19T05:57:33.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:33 smithi172 sudo[39180]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-19T05:57:33.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:33 smithi172 sudo[39180]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-19T05:57:33.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:33 smithi172 sudo[39180]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-19T05:57:33.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:33 smithi172 sudo[39180]: pam_unix(sudo:session): session closed for user root 2024-03-19T05:57:33.984 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2024-03-19T05:57:34.363 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi172/config 2024-03-19T05:57:34.516 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:34 smithi172 sudo[39216]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-19T05:57:34.516 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:34 smithi172 sudo[39216]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-19T05:57:34.516 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:34 smithi172 sudo[39216]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-19T05:57:34.516 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:34 smithi172 sudo[39216]: pam_unix(sudo:session): session closed for user root 2024-03-19T05:57:34.516 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:34 smithi172 ceph-mon[35716]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-19T05:57:34.516 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:34 smithi172 ceph-mon[35716]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-19T05:57:34.516 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:34 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T05:57:34.516 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:34 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:57:34.516 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:34 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:34.517 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:34 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T05:57:34.517 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:34 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:57:34.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:34 smithi072 ceph-mon[28706]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-19T05:57:34.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:34 smithi072 ceph-mon[28706]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-19T05:57:34.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:34 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T05:57:34.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:34 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:57:34.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:34 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:34.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:34 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T05:57:34.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:34 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T05:57:35.548 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:35 smithi172 ceph-mon[35716]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:35.548 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:35 smithi172 ceph-mon[35716]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-19T05:57:35.548 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:35 smithi172 ceph-mon[35716]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-19T05:57:35.548 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:35 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:35.548 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:35 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:35.548 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:35 smithi172 ceph-mon[35716]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:35.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:35 smithi072 ceph-mon[28706]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:35.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:35 smithi072 ceph-mon[28706]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-19T05:57:35.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:35 smithi072 ceph-mon[28706]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-19T05:57:35.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:35 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:35.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:35 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:35.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:35 smithi072 ceph-mon[28706]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.448+0000 7f17bc800700 1 -- 172.21.15.172:0/300294533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b40737b0 msgr2=0x7f17b4073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:57:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.448+0000 7f17bc800700 1 --2- 172.21.15.172:0/300294533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b40737b0 0x7f17b4073c20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009910 tx=0x7f17a4009c20 comp rx=0 tx=0).stop 2024-03-19T05:57:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.448+0000 7f17bc800700 1 -- 172.21.15.172:0/300294533 shutdown_connections 2024-03-19T05:57:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.448+0000 7f17bc800700 1 --2- 172.21.15.172:0/300294533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b40737b0 0x7f17b4073c20 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:57:36.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.448+0000 7f17bc800700 1 --2- 172.21.15.172:0/300294533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b4074d80 0x7f17b40731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:57:36.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.448+0000 7f17bc800700 1 -- 172.21.15.172:0/300294533 >> 172.21.15.172:0/300294533 conn(0x7f17b40fb7f0 msgr2=0x7f17b40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:57:36.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.448+0000 7f17bc800700 1 -- 172.21.15.172:0/300294533 shutdown_connections 2024-03-19T05:57:36.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.448+0000 7f17bc800700 1 -- 172.21.15.172:0/300294533 wait complete. 2024-03-19T05:57:36.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.449+0000 7f17bc800700 1 Processor -- start 2024-03-19T05:57:36.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.449+0000 7f17bc800700 1 -- start start 2024-03-19T05:57:36.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.450+0000 7f17bc800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b40737b0 0x7f17b419c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:57:36.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.450+0000 7f17bc800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b4074d80 0x7f17b419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:57:36.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.450+0000 7f17bc800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b419cbd0 con 0x7f17b4074d80 2024-03-19T05:57:36.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.450+0000 7f17bc800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b419cd10 con 0x7f17b40737b0 2024-03-19T05:57:36.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.450+0000 7f17b9e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b40737b0 0x7f17b419c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:57:36.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.450+0000 7f17b9e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b40737b0 0x7f17b419c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36880/0 (socket says 172.21.15.172:36880) 2024-03-19T05:57:36.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.450+0000 7f17b9e00700 1 -- 172.21.15.172:0/3399134682 learned_addr learned my addr 172.21.15.172:0/3399134682 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:57:36.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.450+0000 7f17b9400700 1 --2- 172.21.15.172:0/3399134682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b4074d80 0x7f17b419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:57:36.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.450+0000 7f17b9e00700 1 -- 172.21.15.172:0/3399134682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b4074d80 msgr2=0x7f17b419c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:57:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.450+0000 7f17b9e00700 1 --2- 172.21.15.172:0/3399134682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b4074d80 0x7f17b419c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:57:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.450+0000 7f17b9e00700 1 -- 172.21.15.172:0/3399134682 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a40095f0 con 0x7f17b40737b0 2024-03-19T05:57:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.451+0000 7f17b9e00700 1 --2- 172.21.15.172:0/3399134682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b40737b0 0x7f17b419c070 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f17a800e920 tx=0x7f17a800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:57:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.451+0000 7f17aea00700 1 -- 172.21.15.172:0/3399134682 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a8009790 con 0x7f17b40737b0 2024-03-19T05:57:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.451+0000 7f17aea00700 1 -- 172.21.15.172:0/3399134682 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17a800cba0 con 0x7f17b40737b0 2024-03-19T05:57:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.451+0000 7f17aea00700 1 -- 172.21.15.172:0/3399134682 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a8018630 con 0x7f17b40737b0 2024-03-19T05:57:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.451+0000 7f17bc800700 1 -- 172.21.15.172:0/3399134682 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b41a17c0 con 0x7f17b40737b0 2024-03-19T05:57:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.451+0000 7f17bc800700 1 -- 172.21.15.172:0/3399134682 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b41a1d10 con 0x7f17b40737b0 2024-03-19T05:57:36.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.452+0000 7f17bc800700 1 -- 172.21.15.172:0/3399134682 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b410f380 con 0x7f17b40737b0 2024-03-19T05:57:36.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.453+0000 7f17aea00700 1 -- 172.21.15.172:0/3399134682 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f17a800cd10 con 0x7f17b40737b0 2024-03-19T05:57:36.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.454+0000 7f17aea00700 1 --2- 172.21.15.172:0/3399134682 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f179c06c680 0x7f179c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:57:36.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.454+0000 7f17aea00700 1 -- 172.21.15.172:0/3399134682 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3232+0+0 (secure 0 0 0) 0x7f17a8014070 con 0x7f17b40737b0 2024-03-19T05:57:36.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.455+0000 7f17b9400700 1 --2- 172.21.15.172:0/3399134682 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f179c06c680 0x7f179c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:57:36.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.456+0000 7f17b9400700 1 --2- 172.21.15.172:0/3399134682 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f179c06c680 0x7f179c06eb30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f17a40059d0 tx=0x7f17a4005940 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:57:36.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.460+0000 7f17aea00700 1 -- 172.21.15.172:0/3399134682 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f17a8051720 con 0x7f17b40737b0 2024-03-19T05:57:36.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:57:36.682+0000 7f17bc800700 1 -- 172.21.15.172:0/3399134682 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f17b41031e0 con 0x7f179c06c680 2024-03-19T05:57:37.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:37 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-19T05:57:37.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:37 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-19T05:57:37.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:37 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:57:37.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:37 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-19T05:57:37.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:37 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-19T05:57:37.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:37 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:57:38.231 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:38 smithi072 ceph-mon[28706]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-19T05:57:38.231 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:38 smithi072 ceph-mon[28706]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:57:38.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:38 smithi172 ceph-mon[35716]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-03-19T05:57:38.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:38 smithi172 ceph-mon[35716]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:57:40.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:40 smithi072 ceph-mon[28706]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-19T05:57:40.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:40 smithi172 ceph-mon[35716]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-03-19T05:57:41.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: Detected new or changed devices on smithi072 2024-03-19T05:57:41.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:41.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/3064048935' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27291f1a-1705-4da7-a15a-4ddc099c08ee"}]: dispatch 2024-03-19T05:57:41.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:41.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27291f1a-1705-4da7-a15a-4ddc099c08ee"}]: dispatch 2024-03-19T05:57:41.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:57:41.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27291f1a-1705-4da7-a15a-4ddc099c08ee"}]': finished 2024-03-19T05:57:41.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: osdmap e23: 4 total, 3 up, 4 in 2024-03-19T05:57:41.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:57:41.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T05:57:41.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:57:41.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: Adjusting osd_memory_target on smithi072 to 3947M 2024-03-19T05:57:41.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:41.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:57:41.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:57:41.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:41.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:57:41.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:41 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/1560203906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-19T05:57:41.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: Detected new or changed devices on smithi072 2024-03-19T05:57:41.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/3064048935' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27291f1a-1705-4da7-a15a-4ddc099c08ee"}]: dispatch 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27291f1a-1705-4da7-a15a-4ddc099c08ee"}]: dispatch 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27291f1a-1705-4da7-a15a-4ddc099c08ee"}]': finished 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: osdmap e23: 4 total, 3 up, 4 in 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: Adjusting osd_memory_target on smithi072 to 3947M 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:57:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:41.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:57:41.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:41 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/1560203906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-19T05:57:42.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:42 smithi072 ceph-mon[28706]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-19T05:57:42.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:42 smithi172 ceph-mon[35716]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-19T05:57:44.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:44 smithi172 ceph-mon[35716]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-19T05:57:44.557 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:44 smithi072 ceph-mon[28706]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-19T05:57:46.280 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:46 smithi172 ceph-mon[35716]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-19T05:57:46.281 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:46 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:57:46.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:46 smithi072 ceph-mon[28706]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-03-19T05:57:46.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:46 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:57:47.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:47 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:47.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:47 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:47.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:47 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:57:47.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:47 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:57:47.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:47 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:47.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:47 smithi172 ceph-mon[35716]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:47.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:47.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:47.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:57:47.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:57:47.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:47 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:47.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:47 smithi072 ceph-mon[28706]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:49.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:49 smithi172 ceph-mon[35716]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:49.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:49 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-19T05:57:49.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:49 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:57:49.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:49 smithi172 ceph-mon[35716]: Deploying daemon osd.3 on smithi172 2024-03-19T05:57:50.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:49 smithi072 ceph-mon[28706]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:50.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:49 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-19T05:57:50.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:49 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:57:50.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:49 smithi072 ceph-mon[28706]: Deploying daemon osd.3 on smithi172 2024-03-19T05:57:52.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:52 smithi172 ceph-mon[35716]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:52.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:52 smithi072 ceph-mon[28706]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:54.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:54 smithi172 ceph-mon[35716]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:54.285 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:54 smithi072 ceph-mon[28706]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:56.311 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:56 smithi172 ceph-mon[35716]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:56.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:56 smithi072 ceph-mon[28706]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:57.740 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:57 smithi172 ceph-mon[35716]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:57.740 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:57 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:57.740 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:57 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:57.740 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:57 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:57:58.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:57 smithi072 ceph-mon[28706]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:57:58.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:58.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:57:58.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:57:59.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:57:59 smithi172 ceph-mon[35716]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:58:00.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:57:59 smithi072 ceph-mon[28706]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:58:00.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:00 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:58:00.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:00 smithi172 ceph-mon[35716]: from='osd.3 [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-19T05:58:00.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:00 smithi172 ceph-mon[35716]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-19T05:58:01.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:00 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:58:01.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:00 smithi072 ceph-mon[28706]: from='osd.3 [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-19T05:58:01.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:00 smithi072 ceph-mon[28706]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-19T05:58:01.232 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 3 on host 'smithi172' 2024-03-19T05:58:01.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:01.238+0000 7f17aea00700 1 -- 172.21.15.172:0/3399134682 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f17b41031e0 con 0x7f179c06c680 2024-03-19T05:58:01.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:01.242+0000 7f17bc800700 1 -- 172.21.15.172:0/3399134682 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f179c06c680 msgr2=0x7f179c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:58:01.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:01.242+0000 7f17bc800700 1 --2- 172.21.15.172:0/3399134682 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f179c06c680 0x7f179c06eb30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f17a40059d0 tx=0x7f17a4005940 comp rx=0 tx=0).stop 2024-03-19T05:58:01.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:01.242+0000 7f17bc800700 1 -- 172.21.15.172:0/3399134682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b40737b0 msgr2=0x7f17b419c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:58:01.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:01.242+0000 7f17bc800700 1 --2- 172.21.15.172:0/3399134682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b40737b0 0x7f17b419c070 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f17a800e920 tx=0x7f17a800ece0 comp rx=0 tx=0).stop 2024-03-19T05:58:01.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:01.242+0000 7f17bc800700 1 -- 172.21.15.172:0/3399134682 shutdown_connections 2024-03-19T05:58:01.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:01.242+0000 7f17bc800700 1 --2- 172.21.15.172:0/3399134682 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f179c06c680 0x7f179c06eb30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:58:01.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:01.242+0000 7f17bc800700 1 --2- 172.21.15.172:0/3399134682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b40737b0 0x7f17b419c070 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:58:01.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:01.242+0000 7f17bc800700 1 --2- 172.21.15.172:0/3399134682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b4074d80 0x7f17b419c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:58:01.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:01.242+0000 7f17bc800700 1 -- 172.21.15.172:0/3399134682 >> 172.21.15.172:0/3399134682 conn(0x7f17b40fb7f0 msgr2=0x7f17b4101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:58:01.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:01.242+0000 7f17bc800700 1 -- 172.21.15.172:0/3399134682 shutdown_connections 2024-03-19T05:58:01.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:01.242+0000 7f17bc800700 1 -- 172.21.15.172:0/3399134682 wait complete. 2024-03-19T05:58:01.992 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:58:01.992 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-19T05:58:01.992 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: osdmap e24: 4 total, 3 up, 4 in 2024-03-19T05:58:01.992 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T05:58:01.992 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: from='osd.3 [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T05:58:01.992 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T05:58:01.993 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:01.993 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:01.993 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:01.993 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:58:01.993 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:01.993 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:58:01.993 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:01.993 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:02.048 DEBUG:teuthology.orchestra.run.smithi172:osd.3> sudo journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.3.service 2024-03-19T05:58:02.053 INFO:tasks.cephadm:Deploying osd.4 on smithi172 with /dev/vg_nvme/lv_3... 2024-03-19T05:58:02.053 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-19T05:58:02.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:58:02.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-19T05:58:02.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: osdmap e24: 4 total, 3 up, 4 in 2024-03-19T05:58:02.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T05:58:02.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: from='osd.3 [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T05:58:02.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T05:58:02.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:02.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:02.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:02.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:58:02.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:02.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:58:02.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:02.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:02.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:02 smithi172 ceph-mon[35716]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-19T05:58:02.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:02 smithi172 ceph-mon[35716]: osdmap e25: 4 total, 3 up, 4 in 2024-03-19T05:58:02.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T05:58:02.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T05:58:03.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:02 smithi072 ceph-mon[28706]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-19T05:58:03.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:02 smithi072 ceph-mon[28706]: osdmap e25: 4 total, 3 up, 4 in 2024-03-19T05:58:03.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T05:58:03.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T05:58:03.345 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi172/config 2024-03-19T05:58:03.950 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:03 smithi172 ceph-mon[35716]: purged_snaps scrub starts 2024-03-19T05:58:03.950 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:03 smithi172 ceph-mon[35716]: purged_snaps scrub ok 2024-03-19T05:58:03.950 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:03 smithi172 ceph-mon[35716]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:58:03.950 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:03 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T05:58:03.950 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:03 smithi172 ceph-mon[35716]: osd.3 [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040] boot 2024-03-19T05:58:03.950 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:03 smithi172 ceph-mon[35716]: osdmap e26: 4 total, 4 up, 4 in 2024-03-19T05:58:03.950 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:03 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T05:58:03.968 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:03 smithi072 ceph-mon[28706]: purged_snaps scrub starts 2024-03-19T05:58:03.969 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:03 smithi072 ceph-mon[28706]: purged_snaps scrub ok 2024-03-19T05:58:03.969 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:03 smithi072 ceph-mon[28706]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-03-19T05:58:03.969 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:03 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T05:58:03.969 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:03 smithi072 ceph-mon[28706]: osd.3 [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040] boot 2024-03-19T05:58:03.969 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:03 smithi072 ceph-mon[28706]: osdmap e26: 4 total, 4 up, 4 in 2024-03-19T05:58:03.969 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:03 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T05:58:05.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:04 smithi072 ceph-mon[28706]: osdmap e27: 4 total, 4 up, 4 in 2024-03-19T05:58:05.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:04 smithi172 ceph-mon[35716]: osdmap e27: 4 total, 4 up, 4 in 2024-03-19T05:58:05.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:05 smithi172 ceph-mon[35716]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:05.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:05 smithi172 ceph-mon[35716]: osdmap e28: 4 total, 4 up, 4 in 2024-03-19T05:58:06.077 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:05 smithi072 ceph-mon[28706]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:06.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:05 smithi072 ceph-mon[28706]: osdmap e28: 4 total, 4 up, 4 in 2024-03-19T05:58:07.022 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:06 smithi172 ceph-mon[35716]: osdmap e29: 4 total, 4 up, 4 in 2024-03-19T05:58:07.022 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:06 smithi172 ceph-mon[35716]: Detected new or changed devices on smithi172 2024-03-19T05:58:07.022 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:07.022 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:07.022 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:58:07.022 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:06 smithi172 ceph-mon[35716]: Adjusting osd_memory_target on smithi172 to 14915M 2024-03-19T05:58:07.022 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:07.022 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:07.022 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:58:07.023 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:07.023 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-19T05:58:07.023 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-19T05:58:07.023 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-03-19T05:58:07.023 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-03-19T05:58:07.023 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0483044 s, 217 MB/s 2024-03-19T05:58:07.023 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-03-19T05:58:07.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:06 smithi072 ceph-mon[28706]: osdmap e29: 4 total, 4 up, 4 in 2024-03-19T05:58:07.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:06 smithi072 ceph-mon[28706]: Detected new or changed devices on smithi172 2024-03-19T05:58:07.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:07.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:07.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:58:07.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:06 smithi072 ceph-mon[28706]: Adjusting osd_memory_target on smithi172 to 14915M 2024-03-19T05:58:07.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:07.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:07.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:58:07.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:07.798 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2024-03-19T05:58:08.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:07 smithi072 ceph-mon[28706]: pgmap v125: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-19T05:58:08.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:07 smithi072 ceph-mon[28706]: osdmap e30: 4 total, 4 up, 4 in 2024-03-19T05:58:08.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:07 smithi172 ceph-mon[35716]: pgmap v125: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-19T05:58:08.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:07 smithi172 ceph-mon[35716]: osdmap e30: 4 total, 4 up, 4 in 2024-03-19T05:58:08.198 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi172/config 2024-03-19T05:58:09.970 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:09 smithi172 ceph-mon[35716]: pgmap v127: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-03-19T05:58:10.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:09 smithi072 ceph-mon[28706]: pgmap v127: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-03-19T05:58:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.146+0000 7f7bb2c00700 1 -- 172.21.15.172:0/4129587304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bac107a40 msgr2=0x7f7bac107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:58:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.146+0000 7f7bb2c00700 1 --2- 172.21.15.172:0/4129587304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bac107a40 0x7f7bac107e90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009910 tx=0x7f7b94009c20 comp rx=0 tx=0).stop 2024-03-19T05:58:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.146+0000 7f7bb2c00700 1 -- 172.21.15.172:0/4129587304 shutdown_connections 2024-03-19T05:58:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.146+0000 7f7bb2c00700 1 --2- 172.21.15.172:0/4129587304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bac107a40 0x7f7bac107e90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:58:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.146+0000 7f7bb2c00700 1 --2- 172.21.15.172:0/4129587304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac106840 0x7f7bac106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:58:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.146+0000 7f7bb2c00700 1 -- 172.21.15.172:0/4129587304 >> 172.21.15.172:0/4129587304 conn(0x7f7bac075970 msgr2=0x7f7bac077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:58:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.146+0000 7f7bb2c00700 1 -- 172.21.15.172:0/4129587304 shutdown_connections 2024-03-19T05:58:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.146+0000 7f7bb2c00700 1 -- 172.21.15.172:0/4129587304 wait complete. 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.147+0000 7f7bb2c00700 1 Processor -- start 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.147+0000 7f7bb2c00700 1 -- start start 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.148+0000 7f7bb2c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bac106840 0x7f7bac19c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.148+0000 7f7bb2c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac107a40 0x7f7bac19c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.148+0000 7f7bb2c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac19cc10 con 0x7f7bac107a40 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.148+0000 7f7bb2c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac19cd50 con 0x7f7bac106840 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.148+0000 7f7babe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bac106840 0x7f7bac19c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.148+0000 7f7babe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bac106840 0x7f7bac19c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58318/0 (socket says 172.21.15.172:58318) 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.148+0000 7f7babe00700 1 -- 172.21.15.172:0/1316277054 learned_addr learned my addr 172.21.15.172:0/1316277054 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.148+0000 7f7bab400700 1 --2- 172.21.15.172:0/1316277054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac107a40 0x7f7bac19c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.148+0000 7f7babe00700 1 -- 172.21.15.172:0/1316277054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac107a40 msgr2=0x7f7bac19c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.148+0000 7f7babe00700 1 --2- 172.21.15.172:0/1316277054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac107a40 0x7f7bac19c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:58:10.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.148+0000 7f7babe00700 1 -- 172.21.15.172:0/1316277054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940095f0 con 0x7f7bac106840 2024-03-19T05:58:10.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.149+0000 7f7babe00700 1 --2- 172.21.15.172:0/1316277054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bac106840 0x7f7bac19c0b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00c8f0 tx=0x7f7b9c00ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:58:10.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.149+0000 7f7ba8c00700 1 -- 172.21.15.172:0/1316277054 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b9c007a70 con 0x7f7bac106840 2024-03-19T05:58:10.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.149+0000 7f7ba8c00700 1 -- 172.21.15.172:0/1316277054 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7b9c007bd0 con 0x7f7bac106840 2024-03-19T05:58:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.149+0000 7f7bb2c00700 1 -- 172.21.15.172:0/1316277054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac1a1800 con 0x7f7bac106840 2024-03-19T05:58:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.149+0000 7f7ba8c00700 1 -- 172.21.15.172:0/1316277054 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b9c018630 con 0x7f7bac106840 2024-03-19T05:58:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.149+0000 7f7bb2c00700 1 -- 172.21.15.172:0/1316277054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac1a1d50 con 0x7f7bac106840 2024-03-19T05:58:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.150+0000 7f7bb2c00700 1 -- 172.21.15.172:0/1316277054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bac10f390 con 0x7f7bac106840 2024-03-19T05:58:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.152+0000 7f7ba8c00700 1 -- 172.21.15.172:0/1316277054 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7b9c00f450 con 0x7f7bac106840 2024-03-19T05:58:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.153+0000 7f7ba8c00700 1 --2- 172.21.15.172:0/1316277054 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7b9006c680 0x7f7b9006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:58:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.153+0000 7f7ba8c00700 1 -- 172.21.15.172:0/1316277054 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f7b9c08b1c0 con 0x7f7bac106840 2024-03-19T05:58:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.153+0000 7f7bab400700 1 --2- 172.21.15.172:0/1316277054 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7b9006c680 0x7f7b9006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:58:10.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.154+0000 7f7bab400700 1 --2- 172.21.15.172:0/1316277054 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7b9006c680 0x7f7b9006eb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b94006010 tx=0x7f7b9400b540 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:58:10.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.158+0000 7f7ba8c00700 1 -- 172.21.15.172:0/1316277054 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7b9c059a60 con 0x7f7bac106840 2024-03-19T05:58:10.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:10.380+0000 7f7bb2c00700 1 -- 172.21.15.172:0/1316277054 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bac10c390 con 0x7f7b9006c680 2024-03-19T05:58:11.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:10 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-19T05:58:11.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:10 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-19T05:58:11.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:10 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:11.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:10 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-19T05:58:11.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:10 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-19T05:58:11.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:10 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:12.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:12 smithi072 ceph-mon[28706]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:58:12.331 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:12 smithi072 ceph-mon[28706]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-19T05:58:12.360 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:12 smithi172 ceph-mon[35716]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:58:12.361 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:12 smithi172 ceph-mon[35716]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-19T05:58:14.285 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:14 smithi072 ceph-mon[28706]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-03-19T05:58:14.285 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:14 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/3543892413' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88b90845-3e0a-4e4d-80e9-7a70e25dbfac"}]: dispatch 2024-03-19T05:58:14.285 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:14 smithi072 ceph-mon[28706]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88b90845-3e0a-4e4d-80e9-7a70e25dbfac"}]: dispatch 2024-03-19T05:58:14.285 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:14 smithi072 ceph-mon[28706]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88b90845-3e0a-4e4d-80e9-7a70e25dbfac"}]': finished 2024-03-19T05:58:14.285 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:14 smithi072 ceph-mon[28706]: osdmap e31: 5 total, 4 up, 5 in 2024-03-19T05:58:14.286 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:14 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T05:58:14.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:14 smithi172 ceph-mon[35716]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-03-19T05:58:14.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:14 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/3543892413' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88b90845-3e0a-4e4d-80e9-7a70e25dbfac"}]: dispatch 2024-03-19T05:58:14.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:14 smithi172 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "88b90845-3e0a-4e4d-80e9-7a70e25dbfac"}]: dispatch 2024-03-19T05:58:14.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:14 smithi172 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "88b90845-3e0a-4e4d-80e9-7a70e25dbfac"}]': finished 2024-03-19T05:58:14.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:14 smithi172 ceph-mon[35716]: osdmap e31: 5 total, 4 up, 5 in 2024-03-19T05:58:14.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:14 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T05:58:15.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:15 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/2496726907' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-19T05:58:15.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:15 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/2496726907' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-19T05:58:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:16 smithi172 ceph-mon[35716]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:58:16.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:16 smithi072 ceph-mon[28706]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:16.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:58:18.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:18 smithi172 ceph-mon[35716]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:18.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:18 smithi072 ceph-mon[28706]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:20.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:20 smithi172 ceph-mon[35716]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:20.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:20 smithi072 ceph-mon[28706]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:22.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:22 smithi172 ceph-mon[35716]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:22.380 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:22 smithi072 ceph-mon[28706]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:23.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-19T05:58:23.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:23.408 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-19T05:58:23.408 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:24.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:24 smithi172 ceph-mon[35716]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:24.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:24 smithi172 ceph-mon[35716]: Deploying daemon osd.4 on smithi172 2024-03-19T05:58:24.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:24 smithi072 ceph-mon[28706]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:24.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:24 smithi072 ceph-mon[28706]: Deploying daemon osd.4 on smithi172 2024-03-19T05:58:26.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:26 smithi172 ceph-mon[35716]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:26.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:26 smithi072 ceph-mon[28706]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:28.175 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:28 smithi172 ceph-mon[35716]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:28.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:28 smithi072 ceph-mon[28706]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:30.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:30 smithi172 ceph-mon[35716]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:30.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:30 smithi072 ceph-mon[28706]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:31.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:31 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:31.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:31 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:31.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:31 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:58:31.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:31 smithi172 ceph-mon[35716]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:31.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:31 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:58:31.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:31.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:31.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:58:31.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:31 smithi072 ceph-mon[28706]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:31.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:58:33.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:33 smithi172 ceph-mon[35716]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:34.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:33 smithi072 ceph-mon[28706]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:34.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:34 smithi172 ceph-mon[35716]: from='osd.4 [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-19T05:58:34.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:34 smithi172 ceph-mon[35716]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-19T05:58:35.077 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:34 smithi072 ceph-mon[28706]: from='osd.4 [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-19T05:58:35.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:34 smithi072 ceph-mon[28706]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-19T05:58:35.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:35.384+0000 7f7ba8c00700 1 -- 172.21.15.172:0/1316277054 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7bac10c390 con 0x7f7b9006c680 2024-03-19T05:58:35.378 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 4 on host 'smithi172' 2024-03-19T05:58:35.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:35.388+0000 7f7bb2c00700 1 -- 172.21.15.172:0/1316277054 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7b9006c680 msgr2=0x7f7b9006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:58:35.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:35.388+0000 7f7bb2c00700 1 --2- 172.21.15.172:0/1316277054 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7b9006c680 0x7f7b9006eb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b94006010 tx=0x7f7b9400b540 comp rx=0 tx=0).stop 2024-03-19T05:58:35.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:35.388+0000 7f7bb2c00700 1 -- 172.21.15.172:0/1316277054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bac106840 msgr2=0x7f7bac19c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:58:35.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:35.388+0000 7f7bb2c00700 1 --2- 172.21.15.172:0/1316277054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bac106840 0x7f7bac19c0b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00c8f0 tx=0x7f7b9c00ccb0 comp rx=0 tx=0).stop 2024-03-19T05:58:35.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:35.388+0000 7f7bb2c00700 1 -- 172.21.15.172:0/1316277054 shutdown_connections 2024-03-19T05:58:35.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:35.388+0000 7f7bb2c00700 1 --2- 172.21.15.172:0/1316277054 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7b9006c680 0x7f7b9006eb30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:58:35.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:35.388+0000 7f7bb2c00700 1 --2- 172.21.15.172:0/1316277054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bac106840 0x7f7bac19c0b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:58:35.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:35.388+0000 7f7bb2c00700 1 --2- 172.21.15.172:0/1316277054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac107a40 0x7f7bac19c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:58:35.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:35.388+0000 7f7bb2c00700 1 -- 172.21.15.172:0/1316277054 >> 172.21.15.172:0/1316277054 conn(0x7f7bac075970 msgr2=0x7f7bac10ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:58:35.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:35.388+0000 7f7bb2c00700 1 -- 172.21.15.172:0/1316277054 shutdown_connections 2024-03-19T05:58:35.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:35.389+0000 7f7bb2c00700 1 -- 172.21.15.172:0/1316277054 wait complete. 2024-03-19T05:58:36.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:35 smithi072 ceph-mon[28706]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:36.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:35 smithi072 ceph-mon[28706]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-19T05:58:36.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:35 smithi072 ceph-mon[28706]: osdmap e32: 5 total, 4 up, 5 in 2024-03-19T05:58:36.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:35 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T05:58:36.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:35 smithi072 ceph-mon[28706]: from='osd.4 [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T05:58:36.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:35 smithi072 ceph-mon[28706]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T05:58:36.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:35 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:36.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:35 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:36.117 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:35 smithi172 ceph-mon[35716]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:36.118 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:35 smithi172 ceph-mon[35716]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-19T05:58:36.118 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:35 smithi172 ceph-mon[35716]: osdmap e32: 5 total, 4 up, 5 in 2024-03-19T05:58:36.118 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:35 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T05:58:36.118 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:35 smithi172 ceph-mon[35716]: from='osd.4 [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T05:58:36.118 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:35 smithi172 ceph-mon[35716]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T05:58:36.118 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:35 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:36.118 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:35 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:36.161 DEBUG:teuthology.orchestra.run.smithi172:osd.4> sudo journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.4.service 2024-03-19T05:58:36.166 INFO:tasks.cephadm:Deploying osd.5 on smithi172 with /dev/vg_nvme/lv_2... 2024-03-19T05:58:36.166 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-19T05:58:36.574 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi172/config 2024-03-19T05:58:37.015 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:36 smithi172 ceph-mon[35716]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-19T05:58:37.015 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:36 smithi172 ceph-mon[35716]: osdmap e33: 5 total, 4 up, 5 in 2024-03-19T05:58:37.015 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:36 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T05:58:37.015 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:36 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T05:58:37.015 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:36 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:37.015 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:36 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:37.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:36 smithi072 ceph-mon[28706]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-19T05:58:37.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:36 smithi072 ceph-mon[28706]: osdmap e33: 5 total, 4 up, 5 in 2024-03-19T05:58:37.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:36 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T05:58:37.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:36 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T05:58:37.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:36 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:37.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:36 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:37.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:37 smithi172 ceph-mon[35716]: purged_snaps scrub starts 2024-03-19T05:58:37.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:37 smithi172 ceph-mon[35716]: purged_snaps scrub ok 2024-03-19T05:58:37.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:37 smithi172 ceph-mon[35716]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:37.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:37 smithi172 ceph-mon[35716]: osd.4 [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887] boot 2024-03-19T05:58:37.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:37 smithi172 ceph-mon[35716]: osdmap e34: 5 total, 5 up, 5 in 2024-03-19T05:58:37.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:37 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T05:58:38.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:37 smithi072 ceph-mon[28706]: purged_snaps scrub starts 2024-03-19T05:58:38.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:37 smithi072 ceph-mon[28706]: purged_snaps scrub ok 2024-03-19T05:58:38.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:37 smithi072 ceph-mon[28706]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-03-19T05:58:38.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:37 smithi072 ceph-mon[28706]: osd.4 [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887] boot 2024-03-19T05:58:38.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:37 smithi072 ceph-mon[28706]: osdmap e34: 5 total, 5 up, 5 in 2024-03-19T05:58:38.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:37 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T05:58:39.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:39 smithi072 ceph-mon[28706]: osdmap e35: 5 total, 5 up, 5 in 2024-03-19T05:58:39.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:39 smithi072 ceph-mon[28706]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:39.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:39 smithi172 ceph-mon[35716]: osdmap e35: 5 total, 5 up, 5 in 2024-03-19T05:58:39.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:39 smithi172 ceph-mon[35716]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:39.847 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-19T05:58:39.847 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-19T05:58:39.847 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-03-19T05:58:39.847 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-03-19T05:58:39.848 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0321833 s, 326 MB/s 2024-03-19T05:58:39.848 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-03-19T05:58:40.671 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2024-03-19T05:58:41.232 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi172/config 2024-03-19T05:58:42.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:42 smithi072 ceph-mon[28706]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:42.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:42 smithi172 ceph-mon[35716]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:43.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.981+0000 7f0e20600700 1 -- 172.21.15.172:0/1141059343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e18103600 msgr2=0x7f0e181059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:58:43.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.981+0000 7f0e20600700 1 --2- 172.21.15.172:0/1141059343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e18103600 0x7f0e181059e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009910 tx=0x7f0e04009c20 comp rx=0 tx=0).stop 2024-03-19T05:58:43.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.981+0000 7f0e20600700 1 -- 172.21.15.172:0/1141059343 shutdown_connections 2024-03-19T05:58:43.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.981+0000 7f0e20600700 1 --2- 172.21.15.172:0/1141059343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e18103600 0x7f0e181059e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:58:43.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.981+0000 7f0e20600700 1 --2- 172.21.15.172:0/1141059343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18100ce0 0x7f0e181030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:58:43.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.981+0000 7f0e20600700 1 -- 172.21.15.172:0/1141059343 >> 172.21.15.172:0/1141059343 conn(0x7f0e180fa700 msgr2=0x7f0e180fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:58:43.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.981+0000 7f0e20600700 1 -- 172.21.15.172:0/1141059343 shutdown_connections 2024-03-19T05:58:43.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.981+0000 7f0e20600700 1 -- 172.21.15.172:0/1141059343 wait complete. 2024-03-19T05:58:43.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.983+0000 7f0e20600700 1 Processor -- start 2024-03-19T05:58:43.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.983+0000 7f0e20600700 1 -- start start 2024-03-19T05:58:43.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.983+0000 7f0e20600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18100ce0 0x7f0e18100640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:58:43.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.983+0000 7f0e20600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e18103600 0x7f0e180fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:58:43.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.983+0000 7f0e20600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180ff1d0 con 0x7f0e18100ce0 2024-03-19T05:58:43.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.983+0000 7f0e20600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180ff310 con 0x7f0e18103600 2024-03-19T05:58:43.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.983+0000 7f0e1d200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e18103600 0x7f0e180fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:58:43.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.984+0000 7f0e1d200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e18103600 0x7f0e180fec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58502/0 (socket says 172.21.15.172:58502) 2024-03-19T05:58:43.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.984+0000 7f0e1d200700 1 -- 172.21.15.172:0/2099242587 learned_addr learned my addr 172.21.15.172:0/2099242587 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:58:43.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.984+0000 7f0e1dc00700 1 --2- 172.21.15.172:0/2099242587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18100ce0 0x7f0e18100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:58:43.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.984+0000 7f0e1d200700 1 -- 172.21.15.172:0/2099242587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18100ce0 msgr2=0x7f0e18100640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:58:43.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.984+0000 7f0e1d200700 1 --2- 172.21.15.172:0/2099242587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18100ce0 0x7f0e18100640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:58:43.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.984+0000 7f0e1d200700 1 -- 172.21.15.172:0/2099242587 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e040095f0 con 0x7f0e18103600 2024-03-19T05:58:43.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.984+0000 7f0e1d200700 1 --2- 172.21.15.172:0/2099242587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e18103600 0x7f0e180fec90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0e04005b40 tx=0x7f0e0400be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:58:43.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.985+0000 7f0e16000700 1 -- 172.21.15.172:0/2099242587 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e0401d070 con 0x7f0e18103600 2024-03-19T05:58:43.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.985+0000 7f0e20600700 1 -- 172.21.15.172:0/2099242587 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e180ff590 con 0x7f0e18103600 2024-03-19T05:58:43.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.985+0000 7f0e16000700 1 -- 172.21.15.172:0/2099242587 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0e0400f460 con 0x7f0e18103600 2024-03-19T05:58:43.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.985+0000 7f0e16000700 1 -- 172.21.15.172:0/2099242587 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e04021640 con 0x7f0e18103600 2024-03-19T05:58:43.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.985+0000 7f0e20600700 1 -- 172.21.15.172:0/2099242587 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e180ffa80 con 0x7f0e18103600 2024-03-19T05:58:43.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.986+0000 7f0e20600700 1 -- 172.21.15.172:0/2099242587 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1818fc70 con 0x7f0e18103600 2024-03-19T05:58:43.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.987+0000 7f0e16000700 1 -- 172.21.15.172:0/2099242587 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0e0400fa90 con 0x7f0e18103600 2024-03-19T05:58:43.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.988+0000 7f0e16000700 1 --2- 172.21.15.172:0/2099242587 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f0e0006c680 0x7f0e0006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:58:43.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.988+0000 7f0e16000700 1 -- 172.21.15.172:0/2099242587 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f0e0408c740 con 0x7f0e18103600 2024-03-19T05:58:43.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.988+0000 7f0e1dc00700 1 --2- 172.21.15.172:0/2099242587 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f0e0006c680 0x7f0e0006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:58:43.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.989+0000 7f0e1dc00700 1 --2- 172.21.15.172:0/2099242587 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f0e0006c680 0x7f0e0006eb30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009d10 tx=0x7f0e0c009040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:58:43.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:43.993+0000 7f0e16000700 1 -- 172.21.15.172:0/2099242587 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0e0405ad00 con 0x7f0e18103600 2024-03-19T05:58:44.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:43 smithi172 ceph-mon[35716]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:44.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:43 smithi172 ceph-mon[35716]: Detected new or changed devices on smithi172 2024-03-19T05:58:44.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:43 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:44.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:43 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:44.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:43 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:58:44.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:43 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:58:44.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:43 smithi172 ceph-mon[35716]: Adjusting osd_memory_target on smithi172 to 7457M 2024-03-19T05:58:44.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:43 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:44.157 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:43 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:44.157 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:43 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:58:44.157 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:43 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:44.157 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:43 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:58:44.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:58:44.215+0000 7f0e20600700 1 -- 172.21.15.172:0/2099242587 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e18061190 con 0x7f0e0006c680 2024-03-19T05:58:44.287 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:43 smithi072 ceph-mon[28706]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:44.287 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:43 smithi072 ceph-mon[28706]: Detected new or changed devices on smithi172 2024-03-19T05:58:44.287 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:43 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:44.287 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:43 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:44.288 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:43 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:58:44.288 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:43 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:58:44.288 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:43 smithi072 ceph-mon[28706]: Adjusting osd_memory_target on smithi172 to 7457M 2024-03-19T05:58:44.288 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:43 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:44.288 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:43 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:44.288 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:43 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:58:44.288 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:43 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:44.288 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:43 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:58:45.244 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:44 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-19T05:58:45.244 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:44 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-19T05:58:45.244 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:44 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:45.245 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:44 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:45.245 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:44 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:58:45.245 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:44 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:45.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:44 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-19T05:58:45.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:44 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-19T05:58:45.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:44 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:45.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:44 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:45.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:44 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:58:45.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:44 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:58:46.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:45 smithi072 ceph-mon[28706]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:58:46.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:45 smithi072 ceph-mon[28706]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:46.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:45 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:58:46.352 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:45 smithi172 ceph-mon[35716]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T05:58:46.352 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:45 smithi172 ceph-mon[35716]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:46.352 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:45 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:58:48.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:48 smithi072 ceph-mon[28706]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:48.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:48 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/3823333433' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6095500f-8c30-475a-8f69-ab85226b2d68"}]: dispatch 2024-03-19T05:58:48.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:48 smithi072 ceph-mon[28706]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6095500f-8c30-475a-8f69-ab85226b2d68"}]: dispatch 2024-03-19T05:58:48.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:48 smithi072 ceph-mon[28706]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6095500f-8c30-475a-8f69-ab85226b2d68"}]': finished 2024-03-19T05:58:48.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:48 smithi072 ceph-mon[28706]: osdmap e36: 6 total, 5 up, 6 in 2024-03-19T05:58:48.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:48 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T05:58:48.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:48 smithi172 ceph-mon[35716]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:48.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:48 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/3823333433' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6095500f-8c30-475a-8f69-ab85226b2d68"}]: dispatch 2024-03-19T05:58:48.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:48 smithi172 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6095500f-8c30-475a-8f69-ab85226b2d68"}]: dispatch 2024-03-19T05:58:48.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:48 smithi172 ceph-mon[35716]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6095500f-8c30-475a-8f69-ab85226b2d68"}]': finished 2024-03-19T05:58:48.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:48 smithi172 ceph-mon[35716]: osdmap e36: 6 total, 5 up, 6 in 2024-03-19T05:58:48.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:48 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T05:58:49.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:49 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/2670475837' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-19T05:58:49.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:49 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/2670475837' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-19T05:58:50.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:50 smithi172 ceph-mon[35716]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:50.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:50 smithi072 ceph-mon[28706]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:52.381 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:52 smithi072 ceph-mon[28706]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:52.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:52 smithi172 ceph-mon[35716]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:54.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:54 smithi172 ceph-mon[35716]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:54.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:54 smithi072 ceph-mon[28706]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:56.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:56 smithi172 ceph-mon[35716]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:56.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:56 smithi072 ceph-mon[28706]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:58.385 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:58 smithi172 ceph-mon[35716]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:58.386 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:58 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-19T05:58:58.386 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:58 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:58.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:58 smithi072 ceph-mon[28706]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:58:58.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:58 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-19T05:58:58.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:58 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:58:59.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:58:59 smithi072 ceph-mon[28706]: Deploying daemon osd.5 on smithi172 2024-03-19T05:58:59.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:58:59 smithi172 ceph-mon[35716]: Deploying daemon osd.5 on smithi172 2024-03-19T05:59:00.317 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:00 smithi172 ceph-mon[35716]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:00.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:00 smithi072 ceph-mon[28706]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:01.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:59:01.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:59:02.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:02 smithi172 ceph-mon[35716]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:02.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:02 smithi072 ceph-mon[28706]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:04.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:04 smithi172 ceph-mon[35716]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:04.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:04 smithi072 ceph-mon[28706]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:06.457 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:06 smithi172 ceph-mon[35716]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:06.457 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:06.457 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:06.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:59:06.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:06 smithi072 ceph-mon[28706]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:06.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:06.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:06.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:59:08.369 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:08 smithi172 ceph-mon[35716]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:08.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:08 smithi072 ceph-mon[28706]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:09.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:09 smithi172 ceph-mon[35716]: from='osd.5 [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-19T05:59:09.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:09 smithi172 ceph-mon[35716]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-19T05:59:09.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:09 smithi072 ceph-mon[28706]: from='osd.5 [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-19T05:59:09.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:09 smithi072 ceph-mon[28706]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-19T05:59:10.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:10.039+0000 7f0e16000700 1 -- 172.21.15.172:0/2099242587 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0e18061190 con 0x7f0e0006c680 2024-03-19T05:59:10.033 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 5 on host 'smithi172' 2024-03-19T05:59:10.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:10.043+0000 7f0e20600700 1 -- 172.21.15.172:0/2099242587 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f0e0006c680 msgr2=0x7f0e0006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:10.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:10.043+0000 7f0e20600700 1 --2- 172.21.15.172:0/2099242587 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f0e0006c680 0x7f0e0006eb30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009d10 tx=0x7f0e0c009040 comp rx=0 tx=0).stop 2024-03-19T05:59:10.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:10.043+0000 7f0e20600700 1 -- 172.21.15.172:0/2099242587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e18103600 msgr2=0x7f0e180fec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:10.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:10.043+0000 7f0e20600700 1 --2- 172.21.15.172:0/2099242587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e18103600 0x7f0e180fec90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0e04005b40 tx=0x7f0e0400be20 comp rx=0 tx=0).stop 2024-03-19T05:59:10.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:10.043+0000 7f0e20600700 1 -- 172.21.15.172:0/2099242587 shutdown_connections 2024-03-19T05:59:10.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:10.043+0000 7f0e20600700 1 --2- 172.21.15.172:0/2099242587 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f0e0006c680 0x7f0e0006eb30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:10.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:10.043+0000 7f0e20600700 1 --2- 172.21.15.172:0/2099242587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e18100ce0 0x7f0e18100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:10.043+0000 7f0e20600700 1 --2- 172.21.15.172:0/2099242587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e18103600 0x7f0e180fec90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:10.043+0000 7f0e20600700 1 -- 172.21.15.172:0/2099242587 >> 172.21.15.172:0/2099242587 conn(0x7f0e180fa700 msgr2=0x7f0e180fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:10.043+0000 7f0e20600700 1 -- 172.21.15.172:0/2099242587 shutdown_connections 2024-03-19T05:59:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:10.043+0000 7f0e20600700 1 -- 172.21.15.172:0/2099242587 wait complete. 2024-03-19T05:59:10.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:10 smithi072 ceph-mon[28706]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:10.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:10 smithi072 ceph-mon[28706]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-19T05:59:10.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:10 smithi072 ceph-mon[28706]: osdmap e37: 6 total, 5 up, 6 in 2024-03-19T05:59:10.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:10 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T05:59:10.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:10 smithi072 ceph-mon[28706]: from='osd.5 [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T05:59:10.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:10 smithi072 ceph-mon[28706]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T05:59:10.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:10 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:10.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:10 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:10.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:10 smithi172 ceph-mon[35716]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:10.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:10 smithi172 ceph-mon[35716]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-19T05:59:10.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:10 smithi172 ceph-mon[35716]: osdmap e37: 6 total, 5 up, 6 in 2024-03-19T05:59:10.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:10 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T05:59:10.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:10 smithi172 ceph-mon[35716]: from='osd.5 [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T05:59:10.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:10 smithi172 ceph-mon[35716]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T05:59:10.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:10 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:10.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:10 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:10.778 DEBUG:teuthology.orchestra.run.smithi172:osd.5> sudo journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.5.service 2024-03-19T05:59:10.783 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-03-19T05:59:10.783 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph osd stat -f json 2024-03-19T05:59:11.185 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:11.527 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:11 smithi072 ceph-mon[28706]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-19T05:59:11.527 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:11 smithi072 ceph-mon[28706]: osdmap e38: 6 total, 5 up, 6 in 2024-03-19T05:59:11.527 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T05:59:11.527 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T05:59:11.528 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:11 smithi072 ceph-mon[28706]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:11.528 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:11.528 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:11.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:11 smithi172 ceph-mon[35716]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-03-19T05:59:11.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:11 smithi172 ceph-mon[35716]: osdmap e38: 6 total, 5 up, 6 in 2024-03-19T05:59:11.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T05:59:11.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T05:59:11.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:11 smithi172 ceph-mon[35716]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-03-19T05:59:11.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:11.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:12.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:12 smithi172 ceph-mon[35716]: purged_snaps scrub starts 2024-03-19T05:59:12.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:12 smithi172 ceph-mon[35716]: purged_snaps scrub ok 2024-03-19T05:59:12.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:12 smithi172 ceph-mon[35716]: osd.5 [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762] boot 2024-03-19T05:59:12.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:12 smithi172 ceph-mon[35716]: osdmap e39: 6 total, 6 up, 6 in 2024-03-19T05:59:12.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T05:59:12.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:12 smithi072 ceph-mon[28706]: purged_snaps scrub starts 2024-03-19T05:59:12.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:12 smithi072 ceph-mon[28706]: purged_snaps scrub ok 2024-03-19T05:59:12.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:12 smithi072 ceph-mon[28706]: osd.5 [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762] boot 2024-03-19T05:59:12.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:12 smithi072 ceph-mon[28706]: osdmap e39: 6 total, 6 up, 6 in 2024-03-19T05:59:12.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T05:59:13.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.421+0000 7fefd2200700 1 -- 172.21.15.72:0/2295365012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefcc102430 msgr2=0x7fefcc102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:13.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.421+0000 7fefd2200700 1 --2- 172.21.15.72:0/2295365012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefcc102430 0x7fefcc102840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009910 tx=0x7fefbc009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:13.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.421+0000 7fefd2200700 1 -- 172.21.15.72:0/2295365012 shutdown_connections 2024-03-19T05:59:13.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.421+0000 7fefd2200700 1 --2- 172.21.15.72:0/2295365012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefcc1036d0 0x7fefcc103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:13.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.421+0000 7fefd2200700 1 --2- 172.21.15.72:0/2295365012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefcc102430 0x7fefcc102840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:13.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.421+0000 7fefd2200700 1 -- 172.21.15.72:0/2295365012 >> 172.21.15.72:0/2295365012 conn(0x7fefcc0fda80 msgr2=0x7fefcc0ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:13.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.421+0000 7fefd2200700 1 -- 172.21.15.72:0/2295365012 shutdown_connections 2024-03-19T05:59:13.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.421+0000 7fefd2200700 1 -- 172.21.15.72:0/2295365012 wait complete. 2024-03-19T05:59:13.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:13 smithi072 ceph-mon[28706]: osdmap e40: 6 total, 6 up, 6 in 2024-03-19T05:59:13.415 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:13 smithi072 ceph-mon[28706]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.422+0000 7fefd2200700 1 Processor -- start 2024-03-19T05:59:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.423+0000 7fefd2200700 1 -- start start 2024-03-19T05:59:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.423+0000 7fefd2200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefcc102430 0x7fefcc197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.423+0000 7fefd2200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefcc1036d0 0x7fefcc198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.423+0000 7fefd2200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc198890 con 0x7fefcc1036d0 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.423+0000 7fefd2200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc1989d0 con 0x7fefcc102430 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.423+0000 7fefcaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefcc1036d0 0x7fefcc198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.423+0000 7fefcaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefcc1036d0 0x7fefcc198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40568/0 (socket says 172.21.15.72:40568) 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.423+0000 7fefcaa00700 1 -- 172.21.15.72:0/339794312 learned_addr learned my addr 172.21.15.72:0/339794312 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.423+0000 7fefcb400700 1 --2- 172.21.15.72:0/339794312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefcc102430 0x7fefcc197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.424+0000 7fefcaa00700 1 -- 172.21.15.72:0/339794312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefcc102430 msgr2=0x7fefcc197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.424+0000 7fefcaa00700 1 --2- 172.21.15.72:0/339794312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefcc102430 0x7fefcc197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.424+0000 7fefcaa00700 1 -- 172.21.15.72:0/339794312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc0095f0 con 0x7fefcc1036d0 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.424+0000 7fefcaa00700 1 --2- 172.21.15.72:0/339794312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefcc1036d0 0x7fefcc198270 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fefb800b4b0 tx=0x7fefb800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.424+0000 7fefc3e00700 1 -- 172.21.15.72:0/339794312 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefb8011800 con 0x7fefcc1036d0 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.424+0000 7fefc3e00700 1 -- 172.21.15.72:0/339794312 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fefb8011e10 con 0x7fefcc1036d0 2024-03-19T05:59:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.424+0000 7fefd2200700 1 -- 172.21.15.72:0/339794312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefcc19d480 con 0x7fefcc1036d0 2024-03-19T05:59:13.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.424+0000 7fefc3e00700 1 -- 172.21.15.72:0/339794312 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefb800f2e0 con 0x7fefcc1036d0 2024-03-19T05:59:13.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.424+0000 7fefd2200700 1 -- 172.21.15.72:0/339794312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefcc19d9d0 con 0x7fefcc1036d0 2024-03-19T05:59:13.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.425+0000 7fefd2200700 1 -- 172.21.15.72:0/339794312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefcc10af90 con 0x7fefcc1036d0 2024-03-19T05:59:13.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.426+0000 7fefc3e00700 1 -- 172.21.15.72:0/339794312 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fefb8010380 con 0x7fefcc1036d0 2024-03-19T05:59:13.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.427+0000 7fefc3e00700 1 --2- 172.21.15.72:0/339794312 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fefb006c680 0x7fefb006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:13.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.427+0000 7fefc3e00700 1 -- 172.21.15.72:0/339794312 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fefb808b130 con 0x7fefcc1036d0 2024-03-19T05:59:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.428+0000 7fefcb400700 1 --2- 172.21.15.72:0/339794312 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fefb006c680 0x7fefb006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.428+0000 7fefcb400700 1 --2- 172.21.15.72:0/339794312 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fefb006c680 0x7fefb006eb30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fefbc006010 tx=0x7fefbc00b580 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.432+0000 7fefc3e00700 1 -- 172.21.15.72:0/339794312 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fefb8059670 con 0x7fefcc1036d0 2024-03-19T05:59:13.519 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:13 smithi172 ceph-mon[35716]: osdmap e40: 6 total, 6 up, 6 in 2024-03-19T05:59:13.519 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:13 smithi172 ceph-mon[35716]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:13.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.646+0000 7fefd2200700 1 -- 172.21.15.72:0/339794312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fefcc10b180 con 0x7fefcc1036d0 2024-03-19T05:59:13.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.647+0000 7fefc3e00700 1 -- 172.21.15.72:0/339794312 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7fefb8059200 con 0x7fefcc1036d0 2024-03-19T05:59:13.639 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:59:13.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.649+0000 7fefd2200700 1 -- 172.21.15.72:0/339794312 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fefb006c680 msgr2=0x7fefb006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.649+0000 7fefd2200700 1 --2- 172.21.15.72:0/339794312 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fefb006c680 0x7fefb006eb30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fefbc006010 tx=0x7fefbc00b580 comp rx=0 tx=0).stop 2024-03-19T05:59:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.649+0000 7fefd2200700 1 -- 172.21.15.72:0/339794312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefcc1036d0 msgr2=0x7fefcc198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.649+0000 7fefd2200700 1 --2- 172.21.15.72:0/339794312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefcc1036d0 0x7fefcc198270 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fefb800b4b0 tx=0x7fefb800b870 comp rx=0 tx=0).stop 2024-03-19T05:59:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.649+0000 7fefd2200700 1 -- 172.21.15.72:0/339794312 shutdown_connections 2024-03-19T05:59:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.649+0000 7fefd2200700 1 --2- 172.21.15.72:0/339794312 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fefb006c680 0x7fefb006eb30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.649+0000 7fefd2200700 1 --2- 172.21.15.72:0/339794312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefcc102430 0x7fefcc197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.649+0000 7fefd2200700 1 --2- 172.21.15.72:0/339794312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefcc1036d0 0x7fefcc198270 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:13.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.649+0000 7fefd2200700 1 -- 172.21.15.72:0/339794312 >> 172.21.15.72:0/339794312 conn(0x7fefcc0fda80 msgr2=0x7fefcc106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:13.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.650+0000 7fefd2200700 1 -- 172.21.15.72:0/339794312 shutdown_connections 2024-03-19T05:59:13.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:13.650+0000 7fefd2200700 1 -- 172.21.15.72:0/339794312 wait complete. 2024-03-19T05:59:14.530 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:14 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/339794312' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-19T05:59:14.573 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1710827951,"num_in_osds":6,"osd_in_since":1710827927,"num_remapped_pgs":0} 2024-03-19T05:59:14.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph osd dump --format=json 2024-03-19T05:59:14.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:14 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/339794312' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-19T05:59:14.980 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:15.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:15 smithi072 ceph-mon[28706]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:15.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:15 smithi172 ceph-mon[35716]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:16.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: Detected new or changed devices on smithi172 2024-03-19T05:59:16.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:16.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:16.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:59:16.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:59:16.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:59:16.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: Adjusting osd_memory_target on smithi172 to 4971M 2024-03-19T05:59:16.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:16.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:59:16.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:59:16.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:16.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:59:16.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:59:16.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:59:16.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:59:16.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:16.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: Detected new or changed devices on smithi172 2024-03-19T05:59:16.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:16.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:16.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:59:16.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:59:16.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-19T05:59:16.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: Adjusting osd_memory_target on smithi172 to 4971M 2024-03-19T05:59:16.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:16.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:59:16.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:59:16.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:16.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:59:16.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T05:59:16.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T05:59:16.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T05:59:16.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T05:59:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.556+0000 7f8e53e00700 1 -- 172.21.15.72:0/1185379320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c102470 msgr2=0x7f8e4c1028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.556+0000 7f8e53e00700 1 --2- 172.21.15.72:0/1185379320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c102470 0x7f8e4c1028e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009910 tx=0x7f8e38009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.556+0000 7f8e53e00700 1 -- 172.21.15.72:0/1185379320 shutdown_connections 2024-03-19T05:59:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.556+0000 7f8e53e00700 1 --2- 172.21.15.72:0/1185379320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c102470 0x7f8e4c1028e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.556+0000 7f8e53e00700 1 --2- 172.21.15.72:0/1185379320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e4c108470 0x7f8e4c108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.556+0000 7f8e53e00700 1 -- 172.21.15.72:0/1185379320 >> 172.21.15.72:0/1185379320 conn(0x7f8e4c0fdf90 msgr2=0x7f8e4c1003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.556+0000 7f8e53e00700 1 -- 172.21.15.72:0/1185379320 shutdown_connections 2024-03-19T05:59:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.557+0000 7f8e53e00700 1 -- 172.21.15.72:0/1185379320 wait complete. 2024-03-19T05:59:17.550 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:17 smithi072 ceph-mon[28706]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:17.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.558+0000 7f8e53e00700 1 Processor -- start 2024-03-19T05:59:17.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.558+0000 7f8e53e00700 1 -- start start 2024-03-19T05:59:17.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.558+0000 7f8e53e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e4c102470 0x7f8e4c1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:17.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.559+0000 7f8e53e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c108470 0x7f8e4c198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:17.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.559+0000 7f8e53e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c198e10 con 0x7f8e4c108470 2024-03-19T05:59:17.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.559+0000 7f8e53e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c19cba0 con 0x7f8e4c102470 2024-03-19T05:59:17.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.559+0000 7f8e50a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c108470 0x7f8e4c198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:17.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.559+0000 7f8e50a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c108470 0x7f8e4c198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35528/0 (socket says 172.21.15.72:35528) 2024-03-19T05:59:17.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.559+0000 7f8e50a00700 1 -- 172.21.15.72:0/3747602559 learned_addr learned my addr 172.21.15.72:0/3747602559 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:17.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.559+0000 7f8e51400700 1 --2- 172.21.15.72:0/3747602559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e4c102470 0x7f8e4c1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:17.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.559+0000 7f8e50a00700 1 -- 172.21.15.72:0/3747602559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e4c102470 msgr2=0x7f8e4c1981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:17.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.559+0000 7f8e50a00700 1 --2- 172.21.15.72:0/3747602559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e4c102470 0x7f8e4c1981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:17.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.559+0000 7f8e50a00700 1 -- 172.21.15.72:0/3747602559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380095f0 con 0x7f8e4c108470 2024-03-19T05:59:17.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.560+0000 7f8e50a00700 1 --2- 172.21.15.72:0/3747602559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c108470 0x7f8e4c198730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8e38006010 tx=0x7f8e3800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:17.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.560+0000 7f8e4a000700 1 -- 172.21.15.72:0/3747602559 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e3801d070 con 0x7f8e4c108470 2024-03-19T05:59:17.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.560+0000 7f8e4a000700 1 -- 172.21.15.72:0/3747602559 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e38004f50 con 0x7f8e4c108470 2024-03-19T05:59:17.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.560+0000 7f8e4a000700 1 -- 172.21.15.72:0/3747602559 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e38021640 con 0x7f8e4c108470 2024-03-19T05:59:17.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.560+0000 7f8e53e00700 1 -- 172.21.15.72:0/3747602559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c19ce20 con 0x7f8e4c108470 2024-03-19T05:59:17.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.560+0000 7f8e53e00700 1 -- 172.21.15.72:0/3747602559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c19d310 con 0x7f8e4c108470 2024-03-19T05:59:17.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.561+0000 7f8e53e00700 1 -- 172.21.15.72:0/3747602559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c10a970 con 0x7f8e4c108470 2024-03-19T05:59:17.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.562+0000 7f8e4a000700 1 -- 172.21.15.72:0/3747602559 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f8e3800f460 con 0x7f8e4c108470 2024-03-19T05:59:17.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.563+0000 7f8e4a000700 1 --2- 172.21.15.72:0/3747602559 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8e3406c680 0x7f8e3406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:17.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.563+0000 7f8e4a000700 1 -- 172.21.15.72:0/3747602559 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f8e3808c6a0 con 0x7f8e4c108470 2024-03-19T05:59:17.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.563+0000 7f8e51400700 1 --2- 172.21.15.72:0/3747602559 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8e3406c680 0x7f8e3406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:17.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.564+0000 7f8e51400700 1 --2- 172.21.15.72:0/3747602559 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8e3406c680 0x7f8e3406eb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e40005950 tx=0x7f8e400058e0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:17.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.568+0000 7f8e4a000700 1 -- 172.21.15.72:0/3747602559 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8e38057140 con 0x7f8e4c108470 2024-03-19T05:59:17.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:17 smithi172 ceph-mon[35716]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:17.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.784+0000 7f8e53e00700 1 -- 172.21.15.72:0/3747602559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e4c10a350 con 0x7f8e4c108470 2024-03-19T05:59:17.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.786+0000 7f8e4a000700 1 -- 172.21.15.72:0/3747602559 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11351 (secure 0 0 0) 0x7f8e3800fe60 con 0x7f8e4c108470 2024-03-19T05:59:17.782 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:59:17.782 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","created":"2024-03-19T05:51:14.734187+0000","modified":"2024-03-19T05:59:12.230173+0000","last_up_change":"2024-03-19T05:59:11.221924+0000","last_in_change":"2024-03-19T05:58:47.988240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T05:57:27.222850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"215fcddf-0352-4fb1-b006-edd278832a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6803","nonce":2999939724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6805","nonce":2999939724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6809","nonce":2999939724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6807","nonce":2999939724}]},"public_addr":"172.21.15.72:6803/2999939724","cluster_addr":"172.21.15.72:6805/2999939724","heartbeat_back_addr":"172.21.15.72:6809/2999939724","heartbeat_front_addr":"172.21.15.72:6807/2999939724","state":["exists","up"]},{"osd":1,"uuid":"f52e39bf-bbfe-48c3-bf4f-70cae6b4e57c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6811","nonce":1791583949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6813","nonce":1791583949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6817","nonce":1791583949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6815","nonce":1791583949}]},"public_addr":"172.21.15.72:6811/1791583949","cluster_addr":"172.21.15.72:6813/1791583949","heartbeat_back_addr":"172.21.15.72:6817/1791583949","heartbeat_front_addr":"172.21.15.72:6815/1791583949","state":["exists","up"]},{"osd":2,"uuid":"ddcccb72-1a1e-4d0a-8d61-4fa48d91cba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6819","nonce":3669016661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6821","nonce":3669016661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6825","nonce":3669016661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6823","nonce":3669016661}]},"public_addr":"172.21.15.72:6819/3669016661","cluster_addr":"172.21.15.72:6821/3669016661","heartbeat_back_addr":"172.21.15.72:6825/3669016661","heartbeat_front_addr":"172.21.15.72:6823/3669016661","state":["exists","up"]},{"osd":3,"uuid":"27291f1a-1705-4da7-a15a-4ddc099c08ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6801","nonce":1596269040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6803","nonce":1596269040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6807","nonce":1596269040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6805","nonce":1596269040}]},"public_addr":"172.21.15.172:6801/1596269040","cluster_addr":"172.21.15.172:6803/1596269040","heartbeat_back_addr":"172.21.15.172:6807/1596269040","heartbeat_front_addr":"172.21.15.172:6805/1596269040","state":["exists","up"]},{"osd":4,"uuid":"88b90845-3e0a-4e4d-80e9-7a70e25dbfac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6809","nonce":3130039887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6811","nonce":3130039887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6815","nonce":3130039887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6813","nonce":3130039887}]},"public_addr":"172.21.15.172:6809/3130039887","cluster_addr":"172.21.15.172:6811/3130039887","heartbeat_back_addr":"172.21.15.172:6815/3130039887","heartbeat_front_addr":"172.21.15.172:6813/3130039887","state":["exists","up"]},{"osd":5,"uuid":"6095500f-8c30-475a-8f69-ab85226b2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6817","nonce":4144227762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6819","nonce":4144227762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6823","nonce":4144227762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6821","nonce":4144227762}]},"public_addr":"172.21.15.172:6817/4144227762","cluster_addr":"172.21.15.172:6819/4144227762","heartbeat_back_addr":"172.21.15.172:6823/4144227762","heartbeat_front_addr":"172.21.15.172:6821/4144227762","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:10.113377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:46.911606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:57:24.691482+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:01.632867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:35.570288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:59:10.181140+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/2582270882":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6800/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/1450624542":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/1827861673":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/3229768069":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6800/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/3141025630":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6801/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/2295310555":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6801/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6801/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/1631679569":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6800/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/1795725640":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/3627388017":"2024-03-20T05:52:08.433691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T05:59:17.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.789+0000 7f8e53e00700 1 -- 172.21.15.72:0/3747602559 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8e3406c680 msgr2=0x7f8e3406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:17.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.789+0000 7f8e53e00700 1 --2- 172.21.15.72:0/3747602559 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8e3406c680 0x7f8e3406eb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e40005950 tx=0x7f8e400058e0 comp rx=0 tx=0).stop 2024-03-19T05:59:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.789+0000 7f8e53e00700 1 -- 172.21.15.72:0/3747602559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c108470 msgr2=0x7f8e4c198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.789+0000 7f8e53e00700 1 --2- 172.21.15.72:0/3747602559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c108470 0x7f8e4c198730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8e38006010 tx=0x7f8e3800be20 comp rx=0 tx=0).stop 2024-03-19T05:59:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.789+0000 7f8e53e00700 1 -- 172.21.15.72:0/3747602559 shutdown_connections 2024-03-19T05:59:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.789+0000 7f8e53e00700 1 --2- 172.21.15.72:0/3747602559 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8e3406c680 0x7f8e3406eb30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.789+0000 7f8e53e00700 1 --2- 172.21.15.72:0/3747602559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e4c102470 0x7f8e4c1981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.789+0000 7f8e53e00700 1 --2- 172.21.15.72:0/3747602559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c108470 0x7f8e4c198730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.789+0000 7f8e53e00700 1 -- 172.21.15.72:0/3747602559 >> 172.21.15.72:0/3747602559 conn(0x7f8e4c0fdf90 msgr2=0x7f8e4c0ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.790+0000 7f8e53e00700 1 -- 172.21.15.72:0/3747602559 shutdown_connections 2024-03-19T05:59:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:17.790+0000 7f8e53e00700 1 -- 172.21.15.72:0/3747602559 wait complete. 2024-03-19T05:59:18.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:18 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3747602559' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T05:59:18.748 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T05:57:27.222850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T05:59:18.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-19T05:59:18.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:18 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3747602559' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T05:59:19.147 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:19.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:19 smithi072 ceph-mon[28706]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:19.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:19 smithi172 ceph-mon[35716]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:21.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.151+0000 7f037cc00700 1 -- 172.21.15.72:0/3488408361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0378102470 msgr2=0x7f03781028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:21.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.151+0000 7f037cc00700 1 --2- 172.21.15.72:0/3488408361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0378102470 0x7f03781028e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0364009910 tx=0x7f0364009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:21.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.151+0000 7f037cc00700 1 -- 172.21.15.72:0/3488408361 shutdown_connections 2024-03-19T05:59:21.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.151+0000 7f037cc00700 1 --2- 172.21.15.72:0/3488408361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0378102470 0x7f03781028e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:21.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.151+0000 7f037cc00700 1 --2- 172.21.15.72:0/3488408361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0378108470 0x7f0378108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.151+0000 7f037cc00700 1 -- 172.21.15.72:0/3488408361 >> 172.21.15.72:0/3488408361 conn(0x7f03780fdf90 msgr2=0x7f03781003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.151+0000 7f037cc00700 1 -- 172.21.15.72:0/3488408361 shutdown_connections 2024-03-19T05:59:21.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.151+0000 7f037cc00700 1 -- 172.21.15.72:0/3488408361 wait complete. 2024-03-19T05:59:21.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.152+0000 7f037cc00700 1 Processor -- start 2024-03-19T05:59:21.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.152+0000 7f037cc00700 1 -- start start 2024-03-19T05:59:21.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.153+0000 7f037cc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0378102470 0x7f03781981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:21.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.153+0000 7f037cc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0378108470 0x7f0378198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.153+0000 7f037cc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0378198e10 con 0x7f0378102470 2024-03-19T05:59:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.153+0000 7f037cc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037819cba0 con 0x7f0378108470 2024-03-19T05:59:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.153+0000 7f0375e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0378102470 0x7f03781981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.153+0000 7f0375e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0378102470 0x7f03781981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35536/0 (socket says 172.21.15.72:35536) 2024-03-19T05:59:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.153+0000 7f0375e00700 1 -- 172.21.15.72:0/996377770 learned_addr learned my addr 172.21.15.72:0/996377770 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:21.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.153+0000 7f0375400700 1 --2- 172.21.15.72:0/996377770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0378108470 0x7f0378198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:21.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.154+0000 7f0375e00700 1 -- 172.21.15.72:0/996377770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0378108470 msgr2=0x7f0378198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:21.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.154+0000 7f0375e00700 1 --2- 172.21.15.72:0/996377770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0378108470 0x7f0378198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:21.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.154+0000 7f0375e00700 1 -- 172.21.15.72:0/996377770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03640095f0 con 0x7f0378102470 2024-03-19T05:59:21.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.154+0000 7f0375e00700 1 --2- 172.21.15.72:0/996377770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0378102470 0x7f03781981f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f036800c8a0 tx=0x7f036800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:21.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.154+0000 7f036ea00700 1 -- 172.21.15.72:0/996377770 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036800cea0 con 0x7f0378102470 2024-03-19T05:59:21.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.154+0000 7f037cc00700 1 -- 172.21.15.72:0/996377770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037819ce80 con 0x7f0378102470 2024-03-19T05:59:21.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.154+0000 7f036ea00700 1 -- 172.21.15.72:0/996377770 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0368004830 con 0x7f0378102470 2024-03-19T05:59:21.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.154+0000 7f036ea00700 1 -- 172.21.15.72:0/996377770 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03680055b0 con 0x7f0378102470 2024-03-19T05:59:21.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.155+0000 7f037cc00700 1 -- 172.21.15.72:0/996377770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037819d3d0 con 0x7f0378102470 2024-03-19T05:59:21.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.156+0000 7f037cc00700 1 -- 172.21.15.72:0/996377770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037810a970 con 0x7f0378102470 2024-03-19T05:59:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.157+0000 7f036ea00700 1 -- 172.21.15.72:0/996377770 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0368007ad0 con 0x7f0378102470 2024-03-19T05:59:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.157+0000 7f036ea00700 1 --2- 172.21.15.72:0/996377770 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f035c06c680 0x7f035c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.158+0000 7f036ea00700 1 -- 172.21.15.72:0/996377770 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f036808b1f0 con 0x7f0378102470 2024-03-19T05:59:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.158+0000 7f0375400700 1 --2- 172.21.15.72:0/996377770 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f035c06c680 0x7f035c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:21.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.158+0000 7f0375400700 1 --2- 172.21.15.72:0/996377770 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f035c06c680 0x7f035c06eb30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0378199810 tx=0x7f036401a040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:21.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.163+0000 7f036ea00700 1 -- 172.21.15.72:0/996377770 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0368055c90 con 0x7f0378102470 2024-03-19T05:59:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.377+0000 7f037cc00700 1 -- 172.21.15.72:0/996377770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0378199620 con 0x7f0378102470 2024-03-19T05:59:21.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.378+0000 7f036ea00700 1 -- 172.21.15.72:0/996377770 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03680592b0 con 0x7f0378102470 2024-03-19T05:59:21.371 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-19T05:59:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.381+0000 7f037cc00700 1 -- 172.21.15.72:0/996377770 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f035c06c680 msgr2=0x7f035c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.381+0000 7f037cc00700 1 --2- 172.21.15.72:0/996377770 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f035c06c680 0x7f035c06eb30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0378199810 tx=0x7f036401a040 comp rx=0 tx=0).stop 2024-03-19T05:59:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.381+0000 7f037cc00700 1 -- 172.21.15.72:0/996377770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0378102470 msgr2=0x7f03781981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.381+0000 7f037cc00700 1 --2- 172.21.15.72:0/996377770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0378102470 0x7f03781981f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f036800c8a0 tx=0x7f036800cc60 comp rx=0 tx=0).stop 2024-03-19T05:59:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.381+0000 7f037cc00700 1 -- 172.21.15.72:0/996377770 shutdown_connections 2024-03-19T05:59:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.381+0000 7f037cc00700 1 --2- 172.21.15.72:0/996377770 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f035c06c680 0x7f035c06eb30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.381+0000 7f037cc00700 1 --2- 172.21.15.72:0/996377770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0378102470 0x7f03781981f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.382+0000 7f037cc00700 1 --2- 172.21.15.72:0/996377770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0378108470 0x7f0378198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.382+0000 7f037cc00700 1 -- 172.21.15.72:0/996377770 >> 172.21.15.72:0/996377770 conn(0x7f03780fdf90 msgr2=0x7f03780ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.382+0000 7f037cc00700 1 -- 172.21.15.72:0/996377770 shutdown_connections 2024-03-19T05:59:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:21.382+0000 7f037cc00700 1 -- 172.21.15.72:0/996377770 wait complete. 2024-03-19T05:59:22.165 INFO:tasks.cephadm:Setting up client nodes... 2024-03-19T05:59:22.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-19T05:59:22.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:22 smithi072 ceph-mon[28706]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:22.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:22 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/996377770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-19T05:59:22.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:22 smithi172 ceph-mon[35716]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:22.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:22 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/996377770' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-19T05:59:22.590 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:24.249 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:24 smithi072 ceph-mon[28706]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:24.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:24 smithi172 ceph-mon[35716]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.781+0000 7fa40e400700 1 -- 172.21.15.72:0/4191486748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa408100240 msgr2=0x7fa408100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.781+0000 7fa40e400700 1 --2- 172.21.15.72:0/4191486748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa408100240 0x7fa408100650 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009910 tx=0x7fa3f8009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.781+0000 7fa40e400700 1 -- 172.21.15.72:0/4191486748 shutdown_connections 2024-03-19T05:59:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.781+0000 7fa40e400700 1 --2- 172.21.15.72:0/4191486748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa408101440 0x7fa408101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.781+0000 7fa40e400700 1 --2- 172.21.15.72:0/4191486748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa408100240 0x7fa408100650 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.781+0000 7fa40e400700 1 -- 172.21.15.72:0/4191486748 >> 172.21.15.72:0/4191486748 conn(0x7fa4080fb7f0 msgr2=0x7fa4080fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.782+0000 7fa40e400700 1 -- 172.21.15.72:0/4191486748 shutdown_connections 2024-03-19T05:59:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.782+0000 7fa40e400700 1 -- 172.21.15.72:0/4191486748 wait complete. 2024-03-19T05:59:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.783+0000 7fa40e400700 1 Processor -- start 2024-03-19T05:59:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.784+0000 7fa40e400700 1 -- start start 2024-03-19T05:59:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.784+0000 7fa40e400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa408100240 0x7fa408074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.784+0000 7fa40e400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa408101440 0x7fa408073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.784+0000 7fa40e400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa408073680 con 0x7fa408101440 2024-03-19T05:59:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.784+0000 7fa40e400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4080737c0 con 0x7fa408100240 2024-03-19T05:59:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.784+0000 7fa406a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa408101440 0x7fa408073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.784+0000 7fa406a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa408101440 0x7fa408073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54168/0 (socket says 172.21.15.72:54168) 2024-03-19T05:59:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.784+0000 7fa406a00700 1 -- 172.21.15.72:0/1452409245 learned_addr learned my addr 172.21.15.72:0/1452409245 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.785+0000 7fa407400700 1 --2- 172.21.15.72:0/1452409245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa408100240 0x7fa408074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.785+0000 7fa406a00700 1 -- 172.21.15.72:0/1452409245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa408100240 msgr2=0x7fa408074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.785+0000 7fa406a00700 1 --2- 172.21.15.72:0/1452409245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa408100240 0x7fa408074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:24.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.785+0000 7fa406a00700 1 -- 172.21.15.72:0/1452409245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80095f0 con 0x7fa408101440 2024-03-19T05:59:24.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.785+0000 7fa406a00700 1 --2- 172.21.15.72:0/1452409245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa408101440 0x7fa408073140 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400d8d0 tx=0x7fa3f400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:24.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.785+0000 7fa3ffe00700 1 -- 172.21.15.72:0/1452409245 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3f4009940 con 0x7fa408101440 2024-03-19T05:59:24.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.785+0000 7fa3ffe00700 1 -- 172.21.15.72:0/1452409245 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa3f4010460 con 0x7fa408101440 2024-03-19T05:59:24.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.785+0000 7fa40e400700 1 -- 172.21.15.72:0/1452409245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa408073aa0 con 0x7fa408101440 2024-03-19T05:59:24.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.785+0000 7fa3ffe00700 1 -- 172.21.15.72:0/1452409245 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3f400f5f0 con 0x7fa408101440 2024-03-19T05:59:24.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.786+0000 7fa40e400700 1 -- 172.21.15.72:0/1452409245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40819db30 con 0x7fa408101440 2024-03-19T05:59:24.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.787+0000 7fa40e400700 1 -- 172.21.15.72:0/1452409245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa408108d90 con 0x7fa408101440 2024-03-19T05:59:24.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.788+0000 7fa3ffe00700 1 -- 172.21.15.72:0/1452409245 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa3f40105d0 con 0x7fa408101440 2024-03-19T05:59:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.789+0000 7fa3ffe00700 1 --2- 172.21.15.72:0/1452409245 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa3ec06c680 0x7fa3ec06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.789+0000 7fa3ffe00700 1 -- 172.21.15.72:0/1452409245 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa3f408b5e0 con 0x7fa408101440 2024-03-19T05:59:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.789+0000 7fa407400700 1 --2- 172.21.15.72:0/1452409245 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa3ec06c680 0x7fa3ec06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.790+0000 7fa407400700 1 --2- 172.21.15.72:0/1452409245 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa3ec06c680 0x7fa3ec06eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8006010 tx=0x7fa3f800b540 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:24.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:24.793+0000 7fa3ffe00700 1 -- 172.21.15.72:0/1452409245 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa3f40599f0 con 0x7fa408101440 2024-03-19T05:59:25.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.090+0000 7fa40e400700 1 -- 172.21.15.72:0/1452409245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fa408108f50 con 0x7fa408101440 2024-03-19T05:59:25.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.098+0000 7fa3ffe00700 1 -- 172.21.15.72:0/1452409245 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fa3f4059580 con 0x7fa408101440 2024-03-19T05:59:25.092 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2024-03-19T05:59:25.092 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQC9Kfllv8aHBRAAvFuDP+fvbljEY4hXi+4CfA== 2024-03-19T05:59:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.101+0000 7fa40e400700 1 -- 172.21.15.72:0/1452409245 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa3ec06c680 msgr2=0x7fa3ec06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.101+0000 7fa40e400700 1 --2- 172.21.15.72:0/1452409245 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa3ec06c680 0x7fa3ec06eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8006010 tx=0x7fa3f800b540 comp rx=0 tx=0).stop 2024-03-19T05:59:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.101+0000 7fa40e400700 1 -- 172.21.15.72:0/1452409245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa408101440 msgr2=0x7fa408073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.101+0000 7fa40e400700 1 --2- 172.21.15.72:0/1452409245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa408101440 0x7fa408073140 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400d8d0 tx=0x7fa3f400dc90 comp rx=0 tx=0).stop 2024-03-19T05:59:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.101+0000 7fa40e400700 1 -- 172.21.15.72:0/1452409245 shutdown_connections 2024-03-19T05:59:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.101+0000 7fa40e400700 1 --2- 172.21.15.72:0/1452409245 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa3ec06c680 0x7fa3ec06eb30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.101+0000 7fa40e400700 1 --2- 172.21.15.72:0/1452409245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa408100240 0x7fa408074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.101+0000 7fa40e400700 1 --2- 172.21.15.72:0/1452409245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa408101440 0x7fa408073140 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.101+0000 7fa40e400700 1 -- 172.21.15.72:0/1452409245 >> 172.21.15.72:0/1452409245 conn(0x7fa4080fb7f0 msgr2=0x7fa408104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.101+0000 7fa40e400700 1 -- 172.21.15.72:0/1452409245 shutdown_connections 2024-03-19T05:59:25.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:25.101+0000 7fa40e400700 1 -- 172.21.15.72:0/1452409245 wait complete. 2024-03-19T05:59:25.911 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T05:59:25.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-19T05:59:25.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-19T05:59:26.066 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-19T05:59:26.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:26 smithi072 ceph-mon[28706]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:26.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:26 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1452409245' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-19T05:59:26.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:26 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1452409245' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-19T05:59:26.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:26 smithi172 ceph-mon[35716]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:26.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:26 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1452409245' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-19T05:59:26.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:26 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1452409245' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-19T05:59:26.483 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi172/config 2024-03-19T05:59:28.256 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:28 smithi172 ceph-mon[35716]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:28.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:28 smithi072 ceph-mon[28706]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:28.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.771+0000 7f2477000700 1 -- 172.21.15.172:0/3912562390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470107870 msgr2=0x7f2470107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:28.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.771+0000 7f2477000700 1 --2- 172.21.15.172:0/3912562390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470107870 0x7f2470107cc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f245c009910 tx=0x7f245c009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:28.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.771+0000 7f2477000700 1 -- 172.21.15.172:0/3912562390 shutdown_connections 2024-03-19T05:59:28.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.771+0000 7f2477000700 1 --2- 172.21.15.172:0/3912562390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470107870 0x7f2470107cc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:28.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.771+0000 7f2477000700 1 --2- 172.21.15.172:0/3912562390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2470106670 0x7f2470106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:28.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.771+0000 7f2477000700 1 -- 172.21.15.172:0/3912562390 >> 172.21.15.172:0/3912562390 conn(0x7f2470075740 msgr2=0x7f2470077bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:28.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.771+0000 7f2477000700 1 -- 172.21.15.172:0/3912562390 shutdown_connections 2024-03-19T05:59:28.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.771+0000 7f2477000700 1 -- 172.21.15.172:0/3912562390 wait complete. 2024-03-19T05:59:28.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.772+0000 7f2477000700 1 Processor -- start 2024-03-19T05:59:28.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.772+0000 7f2477000700 1 -- start start 2024-03-19T05:59:28.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.773+0000 7f2477000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470106670 0x7f247019be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:28.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.773+0000 7f2477000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2470107870 0x7f247019c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:28.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.773+0000 7f2477000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247019c9f0 con 0x7f2470107870 2024-03-19T05:59:28.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.773+0000 7f2477000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247019cb30 con 0x7f2470106670 2024-03-19T05:59:28.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.773+0000 7f2475c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470106670 0x7f247019be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:28.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.773+0000 7f2475c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470106670 0x7f247019be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60476/0 (socket says 172.21.15.172:60476) 2024-03-19T05:59:28.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.773+0000 7f2475c00700 1 -- 172.21.15.172:0/4230627446 learned_addr learned my addr 172.21.15.172:0/4230627446 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-03-19T05:59:28.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.773+0000 7f2475200700 1 --2- 172.21.15.172:0/4230627446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2470107870 0x7f247019c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:28.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.773+0000 7f2475c00700 1 -- 172.21.15.172:0/4230627446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2470107870 msgr2=0x7f247019c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:28.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.773+0000 7f2475c00700 1 --2- 172.21.15.172:0/4230627446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2470107870 0x7f247019c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:28.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.773+0000 7f2475c00700 1 -- 172.21.15.172:0/4230627446 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0095f0 con 0x7f2470106670 2024-03-19T05:59:28.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.773+0000 7f2475200700 1 --2- 172.21.15.172:0/4230627446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2470107870 0x7f247019c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T05:59:28.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.774+0000 7f2475c00700 1 --2- 172.21.15.172:0/4230627446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470106670 0x7f247019be90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2464007e90 tx=0x7f246400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:28.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.774+0000 7f246e000700 1 -- 172.21.15.172:0/4230627446 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2464017070 con 0x7f2470106670 2024-03-19T05:59:28.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.774+0000 7f246e000700 1 -- 172.21.15.172:0/4230627446 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f246400f040 con 0x7f2470106670 2024-03-19T05:59:28.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.774+0000 7f2477000700 1 -- 172.21.15.172:0/4230627446 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24701a15e0 con 0x7f2470106670 2024-03-19T05:59:28.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.774+0000 7f246e000700 1 -- 172.21.15.172:0/4230627446 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2464004880 con 0x7f2470106670 2024-03-19T05:59:28.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.774+0000 7f2477000700 1 -- 172.21.15.172:0/4230627446 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24701a1b30 con 0x7f2470106670 2024-03-19T05:59:28.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.775+0000 7f2477000700 1 -- 172.21.15.172:0/4230627446 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247010f1c0 con 0x7f2470106670 2024-03-19T05:59:28.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.776+0000 7f246e000700 1 -- 172.21.15.172:0/4230627446 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f24640040b0 con 0x7f2470106670 2024-03-19T05:59:28.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.777+0000 7f246e000700 1 --2- 172.21.15.172:0/4230627446 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f245806c680 0x7f245806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:28.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.777+0000 7f246e000700 1 -- 172.21.15.172:0/4230627446 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f246408ae90 con 0x7f2470106670 2024-03-19T05:59:28.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.778+0000 7f2475200700 1 --2- 172.21.15.172:0/4230627446 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f245806c680 0x7f245806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:28.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.779+0000 7f2475200700 1 --2- 172.21.15.172:0/4230627446 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f245806c680 0x7f245806eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f245c006010 tx=0x7f245c00b540 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:28.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:28.782+0000 7f246e000700 1 -- 172.21.15.172:0/4230627446 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f24640593c0 con 0x7f2470106670 2024-03-19T05:59:29.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.076+0000 7f2477000700 1 -- 172.21.15.172:0/4230627446 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f247010f3b0 con 0x7f2470106670 2024-03-19T05:59:29.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.093+0000 7f246e000700 1 -- 172.21.15.172:0/4230627446 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) v1 ==== 170+0+59 (secure 0 0 0) 0x7f2464058f50 con 0x7f2470106670 2024-03-19T05:59:29.087 INFO:teuthology.orchestra.run.smithi172.stdout:[client.1] 2024-03-19T05:59:29.087 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDBKfllzv8mBRAA0e9u7rRcF/XdGRrxcM+pzA== 2024-03-19T05:59:29.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.096+0000 7f2477000700 1 -- 172.21.15.172:0/4230627446 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f245806c680 msgr2=0x7f245806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:29.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.096+0000 7f2477000700 1 --2- 172.21.15.172:0/4230627446 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f245806c680 0x7f245806eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f245c006010 tx=0x7f245c00b540 comp rx=0 tx=0).stop 2024-03-19T05:59:29.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.096+0000 7f2477000700 1 -- 172.21.15.172:0/4230627446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470106670 msgr2=0x7f247019be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:29.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.096+0000 7f2477000700 1 --2- 172.21.15.172:0/4230627446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470106670 0x7f247019be90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2464007e90 tx=0x7f246400d3b0 comp rx=0 tx=0).stop 2024-03-19T05:59:29.090 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.096+0000 7f2477000700 1 -- 172.21.15.172:0/4230627446 shutdown_connections 2024-03-19T05:59:29.090 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.096+0000 7f2477000700 1 --2- 172.21.15.172:0/4230627446 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f245806c680 0x7f245806eb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:29.090 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.096+0000 7f2477000700 1 --2- 172.21.15.172:0/4230627446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470106670 0x7f247019be90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:29.090 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.096+0000 7f2477000700 1 --2- 172.21.15.172:0/4230627446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2470107870 0x7f247019c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:29.090 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.096+0000 7f2477000700 1 -- 172.21.15.172:0/4230627446 >> 172.21.15.172:0/4230627446 conn(0x7f2470075740 msgr2=0x7f247010aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:29.090 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.096+0000 7f2477000700 1 -- 172.21.15.172:0/4230627446 shutdown_connections 2024-03-19T05:59:29.090 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T05:59:29.097+0000 7f2477000700 1 -- 172.21.15.172:0/4230627446 wait complete. 2024-03-19T05:59:29.977 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T05:59:29.977 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-03-19T05:59:29.977 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-19T05:59:30.129 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-19T05:59:30.129 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-19T05:59:30.130 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph mgr dump --format=json 2024-03-19T05:59:30.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:30 smithi072 ceph-mon[28706]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:30.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:30 smithi072 ceph-mon[28706]: from='client.? 172.21.15.172:0/4230627446' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-19T05:59:30.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:30 smithi072 ceph-mon[28706]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-19T05:59:30.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:30 smithi072 ceph-mon[28706]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-19T05:59:30.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:30 smithi172 ceph-mon[35716]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:30.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:30 smithi172 ceph-mon[35716]: from='client.? 172.21.15.172:0/4230627446' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-19T05:59:30.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:30 smithi172 ceph-mon[35716]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-19T05:59:30.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:30 smithi172 ceph-mon[35716]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-19T05:59:30.556 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:31.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:59:31.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:31 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:59:32.215 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:32 smithi072 ceph-mon[28706]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:32.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:32 smithi172 ceph-mon[35716]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:32.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.716+0000 7fd31e400700 1 -- 172.21.15.72:0/1411147698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd318101d30 msgr2=0x7fd31810a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:32.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.716+0000 7fd31e400700 1 --2- 172.21.15.72:0/1411147698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd318101d30 0x7fd31810a230 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd300009910 tx=0x7fd300009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:32.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.716+0000 7fd31e400700 1 -- 172.21.15.72:0/1411147698 shutdown_connections 2024-03-19T05:59:32.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.716+0000 7fd31e400700 1 --2- 172.21.15.72:0/1411147698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd318101d30 0x7fd31810a230 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:32.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.716+0000 7fd31e400700 1 --2- 172.21.15.72:0/1411147698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd318101420 0x7fd3181017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:32.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.716+0000 7fd31e400700 1 -- 172.21.15.72:0/1411147698 >> 172.21.15.72:0/1411147698 conn(0x7fd3180fac80 msgr2=0x7fd3180fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:32.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.716+0000 7fd31e400700 1 -- 172.21.15.72:0/1411147698 shutdown_connections 2024-03-19T05:59:32.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.717+0000 7fd31e400700 1 -- 172.21.15.72:0/1411147698 wait complete. 2024-03-19T05:59:32.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.718+0000 7fd31e400700 1 Processor -- start 2024-03-19T05:59:32.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.718+0000 7fd31e400700 1 -- start start 2024-03-19T05:59:32.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.718+0000 7fd31e400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd318101420 0x7fd318198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:32.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.718+0000 7fd31e400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd318101d30 0x7fd3181985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:32.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.718+0000 7fd31e400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd318198c80 con 0x7fd318101d30 2024-03-19T05:59:32.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.718+0000 7fd31e400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31819ca10 con 0x7fd318101420 2024-03-19T05:59:32.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.719+0000 7fd30fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd318101d30 0x7fd3181985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:32.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.719+0000 7fd30fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd318101d30 0x7fd3181985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54192/0 (socket says 172.21.15.72:54192) 2024-03-19T05:59:32.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.719+0000 7fd30fe00700 1 -- 172.21.15.72:0/1600419662 learned_addr learned my addr 172.21.15.72:0/1600419662 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:32.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.719+0000 7fd317400700 1 --2- 172.21.15.72:0/1600419662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd318101420 0x7fd318198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:32.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.719+0000 7fd30fe00700 1 -- 172.21.15.72:0/1600419662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd318101420 msgr2=0x7fd318198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:32.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.719+0000 7fd30fe00700 1 --2- 172.21.15.72:0/1600419662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd318101420 0x7fd318198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:32.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.719+0000 7fd30fe00700 1 -- 172.21.15.72:0/1600419662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3000095f0 con 0x7fd318101d30 2024-03-19T05:59:32.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.720+0000 7fd30fe00700 1 --2- 172.21.15.72:0/1600419662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd318101d30 0x7fd3181985a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd300006010 tx=0x7fd30000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:32.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.720+0000 7fd314c00700 1 -- 172.21.15.72:0/1600419662 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd30001d070 con 0x7fd318101d30 2024-03-19T05:59:32.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.720+0000 7fd314c00700 1 -- 172.21.15.72:0/1600419662 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd30000f460 con 0x7fd318101d30 2024-03-19T05:59:32.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.720+0000 7fd314c00700 1 -- 172.21.15.72:0/1600419662 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd300021640 con 0x7fd318101d30 2024-03-19T05:59:32.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.720+0000 7fd31e400700 1 -- 172.21.15.72:0/1600419662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31819cc90 con 0x7fd318101d30 2024-03-19T05:59:32.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.720+0000 7fd31e400700 1 -- 172.21.15.72:0/1600419662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31819d180 con 0x7fd318101d30 2024-03-19T05:59:32.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.721+0000 7fd31e400700 1 -- 172.21.15.72:0/1600419662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd318106900 con 0x7fd318101d30 2024-03-19T05:59:32.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.722+0000 7fd314c00700 1 -- 172.21.15.72:0/1600419662 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd30000faf0 con 0x7fd318101d30 2024-03-19T05:59:32.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.723+0000 7fd314c00700 1 --2- 172.21.15.72:0/1600419662 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd2fc06c680 0x7fd2fc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:32.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.723+0000 7fd314c00700 1 -- 172.21.15.72:0/1600419662 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd30008c7e0 con 0x7fd318101d30 2024-03-19T05:59:32.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.723+0000 7fd317400700 1 --2- 172.21.15.72:0/1600419662 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd2fc06c680 0x7fd2fc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:32.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.724+0000 7fd317400700 1 --2- 172.21.15.72:0/1600419662 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd2fc06c680 0x7fd2fc06eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd308005fd0 tx=0x7fd30800a560 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:32.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:32.729+0000 7fd314c00700 1 -- 172.21.15.72:0/1600419662 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd3000571e0 con 0x7fd318101d30 2024-03-19T05:59:32.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.000+0000 7fd31e400700 1 -- 172.21.15.72:0/1600419662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd31804f2a0 con 0x7fd318101d30 2024-03-19T05:59:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.009+0000 7fd314c00700 1 -- 172.21.15.72:0/1600419662 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172855 (secure 0 0 0) 0x7fd30005a800 con 0x7fd318101d30 2024-03-19T05:59:33.003 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:59:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.014+0000 7fd31e400700 1 -- 172.21.15.72:0/1600419662 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd2fc06c680 msgr2=0x7fd2fc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.014+0000 7fd31e400700 1 --2- 172.21.15.72:0/1600419662 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd2fc06c680 0x7fd2fc06eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd308005fd0 tx=0x7fd30800a560 comp rx=0 tx=0).stop 2024-03-19T05:59:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.014+0000 7fd31e400700 1 -- 172.21.15.72:0/1600419662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd318101d30 msgr2=0x7fd3181985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.014+0000 7fd31e400700 1 --2- 172.21.15.72:0/1600419662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd318101d30 0x7fd3181985a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd300006010 tx=0x7fd30000be20 comp rx=0 tx=0).stop 2024-03-19T05:59:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.014+0000 7fd31e400700 1 -- 172.21.15.72:0/1600419662 shutdown_connections 2024-03-19T05:59:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.014+0000 7fd31e400700 1 --2- 172.21.15.72:0/1600419662 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd2fc06c680 0x7fd2fc06eb30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.014+0000 7fd31e400700 1 --2- 172.21.15.72:0/1600419662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd318101420 0x7fd318198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.014+0000 7fd31e400700 1 --2- 172.21.15.72:0/1600419662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd318101d30 0x7fd3181985a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.014+0000 7fd31e400700 1 -- 172.21.15.72:0/1600419662 >> 172.21.15.72:0/1600419662 conn(0x7fd3180fac80 msgr2=0x7fd3180fc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.014+0000 7fd31e400700 1 -- 172.21.15.72:0/1600419662 shutdown_connections 2024-03-19T05:59:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:33.014+0000 7fd31e400700 1 -- 172.21.15.72:0/1600419662 wait complete. 2024-03-19T05:59:33.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:33 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1600419662' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-19T05:59:33.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:33 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1600419662' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-19T05:59:33.735 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"active_gid":14219,"active_name":"smithi072.jydpjk","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1154232723},{"type":"v1","addr":"172.21.15.72:6801","nonce":1154232723}]},"active_addr":"172.21.15.72:6801/1154232723","active_change":"2024-03-19T05:54:30.519670+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14244,"name":"smithi172.qkcahs","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.72:8443/","prometheus":"http://172.21.15.72:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":4199454850}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3793616122}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1944964087}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3195993518}]}]} 2024-03-19T05:59:33.742 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-19T05:59:33.742 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-19T05:59:33.742 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph osd dump --format=json 2024-03-19T05:59:34.150 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:34.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:34 smithi172 ceph-mon[35716]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:34.459 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:34 smithi072 ceph-mon[28706]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:36.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.306+0000 7f8cb1000700 1 -- 172.21.15.72:0/2028031375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cac108470 msgr2=0x7f8cac108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:36.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.306+0000 7f8cb1000700 1 --2- 172.21.15.72:0/2028031375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cac108470 0x7f8cac108840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009910 tx=0x7f8c9c009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:36.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.306+0000 7f8cb1000700 1 -- 172.21.15.72:0/2028031375 shutdown_connections 2024-03-19T05:59:36.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.306+0000 7f8cb1000700 1 --2- 172.21.15.72:0/2028031375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cac102470 0x7f8cac1028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:36.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.306+0000 7f8cb1000700 1 --2- 172.21.15.72:0/2028031375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cac108470 0x7f8cac108840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:36.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.306+0000 7f8cb1000700 1 -- 172.21.15.72:0/2028031375 >> 172.21.15.72:0/2028031375 conn(0x7f8cac0fdf90 msgr2=0x7f8cac1003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:36.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.306+0000 7f8cb1000700 1 -- 172.21.15.72:0/2028031375 shutdown_connections 2024-03-19T05:59:36.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.307+0000 7f8cb1000700 1 -- 172.21.15.72:0/2028031375 wait complete. 2024-03-19T05:59:36.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.308+0000 7f8cb1000700 1 Processor -- start 2024-03-19T05:59:36.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.308+0000 7f8cb1000700 1 -- start start 2024-03-19T05:59:36.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.308+0000 7f8cb1000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cac102470 0x7f8cac1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:36.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.308+0000 7f8cb1000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cac108470 0x7f8cac198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:36.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.309+0000 7f8cb1000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac198e10 con 0x7f8cac102470 2024-03-19T05:59:36.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.309+0000 7f8cb1000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac19cba0 con 0x7f8cac108470 2024-03-19T05:59:36.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.309+0000 7f8ca9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cac102470 0x7f8cac1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:36.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.309+0000 7f8ca9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cac102470 0x7f8cac1981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42350/0 (socket says 172.21.15.72:42350) 2024-03-19T05:59:36.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.309+0000 7f8ca9e00700 1 -- 172.21.15.72:0/465687661 learned_addr learned my addr 172.21.15.72:0/465687661 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.309+0000 7f8ca3e00700 1 --2- 172.21.15.72:0/465687661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cac108470 0x7f8cac198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.309+0000 7f8ca9e00700 1 -- 172.21.15.72:0/465687661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cac108470 msgr2=0x7f8cac198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.309+0000 7f8ca9e00700 1 --2- 172.21.15.72:0/465687661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cac108470 0x7f8cac198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.309+0000 7f8ca9e00700 1 -- 172.21.15.72:0/465687661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c0095f0 con 0x7f8cac102470 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.310+0000 7f8ca9e00700 1 --2- 172.21.15.72:0/465687661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cac102470 0x7f8cac1981f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00fa00 tx=0x7f8c9c00fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.310+0000 7f8ca2a00700 1 -- 172.21.15.72:0/465687661 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c9c01d070 con 0x7f8cac102470 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.310+0000 7f8cb1000700 1 -- 172.21.15.72:0/465687661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac19ce20 con 0x7f8cac102470 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.310+0000 7f8ca2a00700 1 -- 172.21.15.72:0/465687661 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c9c005640 con 0x7f8cac102470 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.310+0000 7f8ca2a00700 1 -- 172.21.15.72:0/465687661 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c9c0226a0 con 0x7f8cac102470 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.310+0000 7f8cb1000700 1 -- 172.21.15.72:0/465687661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac19d310 con 0x7f8cac102470 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.311+0000 7f8cb1000700 1 -- 172.21.15.72:0/465687661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac10a9e0 con 0x7f8cac102470 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.312+0000 7f8ca2a00700 1 -- 172.21.15.72:0/465687661 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f8c9c003680 con 0x7f8cac102470 2024-03-19T05:59:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.313+0000 7f8ca2a00700 1 --2- 172.21.15.72:0/465687661 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8c8c06c680 0x7f8c8c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:36.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.313+0000 7f8ca2a00700 1 -- 172.21.15.72:0/465687661 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f8c9c08ca70 con 0x7f8cac102470 2024-03-19T05:59:36.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.313+0000 7f8ca3e00700 1 --2- 172.21.15.72:0/465687661 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8c8c06c680 0x7f8c8c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:36.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.314+0000 7f8ca3e00700 1 --2- 172.21.15.72:0/465687661 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8c8c06c680 0x7f8c8c06eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8cac199810 tx=0x7f8c94009260 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:36.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.318+0000 7f8ca2a00700 1 -- 172.21.15.72:0/465687661 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8c9c057490 con 0x7f8cac102470 2024-03-19T05:59:36.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:36 smithi172 ceph-mon[35716]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.532+0000 7f8cb1000700 1 -- 172.21.15.72:0/465687661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cac04f2a0 con 0x7f8cac102470 2024-03-19T05:59:36.526 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:36 smithi072 ceph-mon[28706]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.534+0000 7f8ca2a00700 1 -- 172.21.15.72:0/465687661 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11351 (secure 0 0 0) 0x7f8c9c05aab0 con 0x7f8cac102470 2024-03-19T05:59:36.527 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:59:36.527 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","created":"2024-03-19T05:51:14.734187+0000","modified":"2024-03-19T05:59:12.230173+0000","last_up_change":"2024-03-19T05:59:11.221924+0000","last_in_change":"2024-03-19T05:58:47.988240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T05:57:27.222850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"215fcddf-0352-4fb1-b006-edd278832a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6803","nonce":2999939724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6805","nonce":2999939724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6809","nonce":2999939724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6807","nonce":2999939724}]},"public_addr":"172.21.15.72:6803/2999939724","cluster_addr":"172.21.15.72:6805/2999939724","heartbeat_back_addr":"172.21.15.72:6809/2999939724","heartbeat_front_addr":"172.21.15.72:6807/2999939724","state":["exists","up"]},{"osd":1,"uuid":"f52e39bf-bbfe-48c3-bf4f-70cae6b4e57c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6811","nonce":1791583949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6813","nonce":1791583949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6817","nonce":1791583949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6815","nonce":1791583949}]},"public_addr":"172.21.15.72:6811/1791583949","cluster_addr":"172.21.15.72:6813/1791583949","heartbeat_back_addr":"172.21.15.72:6817/1791583949","heartbeat_front_addr":"172.21.15.72:6815/1791583949","state":["exists","up"]},{"osd":2,"uuid":"ddcccb72-1a1e-4d0a-8d61-4fa48d91cba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6819","nonce":3669016661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6821","nonce":3669016661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6825","nonce":3669016661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6823","nonce":3669016661}]},"public_addr":"172.21.15.72:6819/3669016661","cluster_addr":"172.21.15.72:6821/3669016661","heartbeat_back_addr":"172.21.15.72:6825/3669016661","heartbeat_front_addr":"172.21.15.72:6823/3669016661","state":["exists","up"]},{"osd":3,"uuid":"27291f1a-1705-4da7-a15a-4ddc099c08ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6801","nonce":1596269040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6803","nonce":1596269040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6807","nonce":1596269040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6805","nonce":1596269040}]},"public_addr":"172.21.15.172:6801/1596269040","cluster_addr":"172.21.15.172:6803/1596269040","heartbeat_back_addr":"172.21.15.172:6807/1596269040","heartbeat_front_addr":"172.21.15.172:6805/1596269040","state":["exists","up"]},{"osd":4,"uuid":"88b90845-3e0a-4e4d-80e9-7a70e25dbfac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6809","nonce":3130039887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6811","nonce":3130039887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6815","nonce":3130039887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6813","nonce":3130039887}]},"public_addr":"172.21.15.172:6809/3130039887","cluster_addr":"172.21.15.172:6811/3130039887","heartbeat_back_addr":"172.21.15.172:6815/3130039887","heartbeat_front_addr":"172.21.15.172:6813/3130039887","state":["exists","up"]},{"osd":5,"uuid":"6095500f-8c30-475a-8f69-ab85226b2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6817","nonce":4144227762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6819","nonce":4144227762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6823","nonce":4144227762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6821","nonce":4144227762}]},"public_addr":"172.21.15.172:6817/4144227762","cluster_addr":"172.21.15.172:6819/4144227762","heartbeat_back_addr":"172.21.15.172:6823/4144227762","heartbeat_front_addr":"172.21.15.172:6821/4144227762","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:10.113377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:46.911606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:57:24.691482+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:01.632867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:35.570288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:59:10.181140+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/2582270882":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6800/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/1450624542":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/1827861673":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/3229768069":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6800/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/3141025630":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6801/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/2295310555":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6801/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6801/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/1631679569":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6800/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/1795725640":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/3627388017":"2024-03-20T05:52:08.433691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T05:59:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.537+0000 7f8cb1000700 1 -- 172.21.15.72:0/465687661 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8c8c06c680 msgr2=0x7f8c8c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.537+0000 7f8cb1000700 1 --2- 172.21.15.72:0/465687661 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8c8c06c680 0x7f8c8c06eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8cac199810 tx=0x7f8c94009260 comp rx=0 tx=0).stop 2024-03-19T05:59:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.537+0000 7f8cb1000700 1 -- 172.21.15.72:0/465687661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cac102470 msgr2=0x7f8cac1981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.537+0000 7f8cb1000700 1 --2- 172.21.15.72:0/465687661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cac102470 0x7f8cac1981f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00fa00 tx=0x7f8c9c00fae0 comp rx=0 tx=0).stop 2024-03-19T05:59:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.537+0000 7f8cb1000700 1 -- 172.21.15.72:0/465687661 shutdown_connections 2024-03-19T05:59:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.537+0000 7f8cb1000700 1 --2- 172.21.15.72:0/465687661 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8c8c06c680 0x7f8c8c06eb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.537+0000 7f8cb1000700 1 --2- 172.21.15.72:0/465687661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cac102470 0x7f8cac1981f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.537+0000 7f8cb1000700 1 --2- 172.21.15.72:0/465687661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cac108470 0x7f8cac198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.537+0000 7f8cb1000700 1 -- 172.21.15.72:0/465687661 >> 172.21.15.72:0/465687661 conn(0x7f8cac0fdf90 msgr2=0x7f8cac1002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.537+0000 7f8cb1000700 1 -- 172.21.15.72:0/465687661 shutdown_connections 2024-03-19T05:59:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:36.537+0000 7f8cb1000700 1 -- 172.21.15.72:0/465687661 wait complete. 2024-03-19T05:59:37.319 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:37 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/465687661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T05:59:37.379 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-19T05:59:37.380 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph osd dump --format=json 2024-03-19T05:59:37.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:37 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/465687661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T05:59:37.782 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:38.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:38 smithi172 ceph-mon[35716]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:38.188 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:38 smithi072 ceph-mon[28706]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:39.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.000+0000 7f99e2e00700 1 -- 172.21.15.72:0/4054014614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99dc101420 msgr2=0x7f99dc1017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.000+0000 7f99e2e00700 1 --2- 172.21.15.72:0/4054014614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99dc101420 0x7f99dc1017f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00b0a0 tx=0x7f99cc00b3b0 comp rx=0 tx=0).stop 2024-03-19T05:59:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.001+0000 7f99e2e00700 1 -- 172.21.15.72:0/4054014614 shutdown_connections 2024-03-19T05:59:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.001+0000 7f99e2e00700 1 --2- 172.21.15.72:0/4054014614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc101d30 0x7f99dc10a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.001+0000 7f99e2e00700 1 --2- 172.21.15.72:0/4054014614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99dc101420 0x7f99dc1017f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.001+0000 7f99e2e00700 1 -- 172.21.15.72:0/4054014614 >> 172.21.15.72:0/4054014614 conn(0x7f99dc0fac80 msgr2=0x7f99dc0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:39.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.001+0000 7f99e2e00700 1 -- 172.21.15.72:0/4054014614 shutdown_connections 2024-03-19T05:59:39.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.001+0000 7f99e2e00700 1 -- 172.21.15.72:0/4054014614 wait complete. 2024-03-19T05:59:39.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.002+0000 7f99e2e00700 1 Processor -- start 2024-03-19T05:59:40.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.002+0000 7f99e2e00700 1 -- start start 2024-03-19T05:59:40.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.003+0000 7f99e2e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc101420 0x7f99dc1980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:40.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.003+0000 7f99e2e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99dc101d30 0x7f99dc198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:40.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.003+0000 7f99e2e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc198cf0 con 0x7f99dc101d30 2024-03-19T05:59:40.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.003+0000 7f99e2e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc19ca80 con 0x7f99dc101420 2024-03-19T05:59:40.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.003+0000 7f99d3400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99dc101d30 0x7f99dc198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:40.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.003+0000 7f99d3400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99dc101d30 0x7f99dc198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42374/0 (socket says 172.21.15.72:42374) 2024-03-19T05:59:40.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.003+0000 7f99d3400700 1 -- 172.21.15.72:0/1229266836 learned_addr learned my addr 172.21.15.72:0/1229266836 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:40.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.003+0000 7f99dbe00700 1 --2- 172.21.15.72:0/1229266836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc101420 0x7f99dc1980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:40.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.004+0000 7f99d3400700 1 -- 172.21.15.72:0/1229266836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc101420 msgr2=0x7f99dc1980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:40.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.004+0000 7f99d3400700 1 --2- 172.21.15.72:0/1229266836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc101420 0x7f99dc1980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:40.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.004+0000 7f99d3400700 1 -- 172.21.15.72:0/1229266836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc009d00 con 0x7f99dc101d30 2024-03-19T05:59:40.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.004+0000 7f99dbe00700 1 --2- 172.21.15.72:0/1229266836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc101420 0x7f99dc1980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T05:59:40.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.004+0000 7f99d3400700 1 --2- 172.21.15.72:0/1229266836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99dc101d30 0x7f99dc198610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f99c400c8a0 tx=0x7f99c400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:40.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.004+0000 7f99d9600700 1 -- 172.21.15.72:0/1229266836 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c400cea0 con 0x7f99dc101d30 2024-03-19T05:59:40.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.004+0000 7f99d9600700 1 -- 172.21.15.72:0/1229266836 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f99c4004830 con 0x7f99dc101d30 2024-03-19T05:59:40.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.004+0000 7f99e2e00700 1 -- 172.21.15.72:0/1229266836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99dc19cd60 con 0x7f99dc101d30 2024-03-19T05:59:40.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.004+0000 7f99d9600700 1 -- 172.21.15.72:0/1229266836 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c40055b0 con 0x7f99dc101d30 2024-03-19T05:59:40.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.004+0000 7f99e2e00700 1 -- 172.21.15.72:0/1229266836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc19d2b0 con 0x7f99dc101d30 2024-03-19T05:59:40.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.005+0000 7f99e2e00700 1 -- 172.21.15.72:0/1229266836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99dc109d60 con 0x7f99dc101d30 2024-03-19T05:59:40.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.006+0000 7f99d9600700 1 -- 172.21.15.72:0/1229266836 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f99c4007ad0 con 0x7f99dc101d30 2024-03-19T05:59:40.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.007+0000 7f99d9600700 1 --2- 172.21.15.72:0/1229266836 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f99c006c680 0x7f99c006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:40.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.007+0000 7f99d9600700 1 -- 172.21.15.72:0/1229266836 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f99c408b290 con 0x7f99dc101d30 2024-03-19T05:59:40.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.008+0000 7f99dbe00700 1 --2- 172.21.15.72:0/1229266836 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f99c006c680 0x7f99c006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:40.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.008+0000 7f99dbe00700 1 --2- 172.21.15.72:0/1229266836 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f99c006c680 0x7f99c006eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0062a0 tx=0x7f99cc006210 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:40.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.012+0000 7f99d9600700 1 -- 172.21.15.72:0/1229266836 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f99c4055c90 con 0x7f99dc101d30 2024-03-19T05:59:40.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.229+0000 7f99e2e00700 1 -- 172.21.15.72:0/1229266836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99dc04f2a0 con 0x7f99dc101d30 2024-03-19T05:59:40.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.231+0000 7f99d9600700 1 -- 172.21.15.72:0/1229266836 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11351 (secure 0 0 0) 0x7f99c40592b0 con 0x7f99dc101d30 2024-03-19T05:59:40.224 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T05:59:40.225 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","created":"2024-03-19T05:51:14.734187+0000","modified":"2024-03-19T05:59:12.230173+0000","last_up_change":"2024-03-19T05:59:11.221924+0000","last_in_change":"2024-03-19T05:58:47.988240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T05:57:27.222850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"215fcddf-0352-4fb1-b006-edd278832a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6803","nonce":2999939724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6805","nonce":2999939724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6809","nonce":2999939724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6807","nonce":2999939724}]},"public_addr":"172.21.15.72:6803/2999939724","cluster_addr":"172.21.15.72:6805/2999939724","heartbeat_back_addr":"172.21.15.72:6809/2999939724","heartbeat_front_addr":"172.21.15.72:6807/2999939724","state":["exists","up"]},{"osd":1,"uuid":"f52e39bf-bbfe-48c3-bf4f-70cae6b4e57c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6811","nonce":1791583949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6813","nonce":1791583949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6817","nonce":1791583949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6815","nonce":1791583949}]},"public_addr":"172.21.15.72:6811/1791583949","cluster_addr":"172.21.15.72:6813/1791583949","heartbeat_back_addr":"172.21.15.72:6817/1791583949","heartbeat_front_addr":"172.21.15.72:6815/1791583949","state":["exists","up"]},{"osd":2,"uuid":"ddcccb72-1a1e-4d0a-8d61-4fa48d91cba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6819","nonce":3669016661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6821","nonce":3669016661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6825","nonce":3669016661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6823","nonce":3669016661}]},"public_addr":"172.21.15.72:6819/3669016661","cluster_addr":"172.21.15.72:6821/3669016661","heartbeat_back_addr":"172.21.15.72:6825/3669016661","heartbeat_front_addr":"172.21.15.72:6823/3669016661","state":["exists","up"]},{"osd":3,"uuid":"27291f1a-1705-4da7-a15a-4ddc099c08ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6801","nonce":1596269040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6803","nonce":1596269040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6807","nonce":1596269040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6805","nonce":1596269040}]},"public_addr":"172.21.15.172:6801/1596269040","cluster_addr":"172.21.15.172:6803/1596269040","heartbeat_back_addr":"172.21.15.172:6807/1596269040","heartbeat_front_addr":"172.21.15.172:6805/1596269040","state":["exists","up"]},{"osd":4,"uuid":"88b90845-3e0a-4e4d-80e9-7a70e25dbfac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6809","nonce":3130039887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6811","nonce":3130039887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6815","nonce":3130039887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6813","nonce":3130039887}]},"public_addr":"172.21.15.172:6809/3130039887","cluster_addr":"172.21.15.172:6811/3130039887","heartbeat_back_addr":"172.21.15.172:6815/3130039887","heartbeat_front_addr":"172.21.15.172:6813/3130039887","state":["exists","up"]},{"osd":5,"uuid":"6095500f-8c30-475a-8f69-ab85226b2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6817","nonce":4144227762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6819","nonce":4144227762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6823","nonce":4144227762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6821","nonce":4144227762}]},"public_addr":"172.21.15.172:6817/4144227762","cluster_addr":"172.21.15.172:6819/4144227762","heartbeat_back_addr":"172.21.15.172:6823/4144227762","heartbeat_front_addr":"172.21.15.172:6821/4144227762","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:10.113377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:46.911606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:57:24.691482+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:01.632867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:35.570288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:59:10.181140+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/2582270882":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6800/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/1450624542":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/1827861673":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/3229768069":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6800/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/3141025630":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6801/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/2295310555":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6801/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6801/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/1631679569":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6800/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/1795725640":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/3627388017":"2024-03-20T05:52:08.433691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T05:59:40.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.233+0000 7f99e2e00700 1 -- 172.21.15.72:0/1229266836 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f99c006c680 msgr2=0x7f99c006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:40.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.233+0000 7f99e2e00700 1 --2- 172.21.15.72:0/1229266836 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f99c006c680 0x7f99c006eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0062a0 tx=0x7f99cc006210 comp rx=0 tx=0).stop 2024-03-19T05:59:40.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.234+0000 7f99e2e00700 1 -- 172.21.15.72:0/1229266836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99dc101d30 msgr2=0x7f99dc198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:40.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.234+0000 7f99e2e00700 1 --2- 172.21.15.72:0/1229266836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99dc101d30 0x7f99dc198610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f99c400c8a0 tx=0x7f99c400cc60 comp rx=0 tx=0).stop 2024-03-19T05:59:40.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.234+0000 7f99e2e00700 1 -- 172.21.15.72:0/1229266836 shutdown_connections 2024-03-19T05:59:40.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.234+0000 7f99e2e00700 1 --2- 172.21.15.72:0/1229266836 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f99c006c680 0x7f99c006eb30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:40.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.234+0000 7f99e2e00700 1 --2- 172.21.15.72:0/1229266836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99dc101420 0x7f99dc1980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:40.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.234+0000 7f99e2e00700 1 --2- 172.21.15.72:0/1229266836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99dc101d30 0x7f99dc198610 secure :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f99c400c8a0 tx=0x7f99c400cc60 comp rx=0 tx=0).stop 2024-03-19T05:59:40.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.234+0000 7f99e2e00700 1 -- 172.21.15.72:0/1229266836 >> 172.21.15.72:0/1229266836 conn(0x7f99dc0fac80 msgr2=0x7f99dc0ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:40.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.234+0000 7f99e2e00700 1 -- 172.21.15.72:0/1229266836 shutdown_connections 2024-03-19T05:59:40.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:40.234+0000 7f99e2e00700 1 -- 172.21.15.72:0/1229266836 wait complete. 2024-03-19T05:59:40.244 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:40 smithi072 ceph-mon[28706]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:40.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:40 smithi172 ceph-mon[35716]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:41.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-19T05:59:41.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-19T05:59:41.041 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-19T05:59:41.041 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-19T05:59:41.041 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-19T05:59:41.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-19T05:59:41.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:41 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1229266836' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T05:59:41.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:41 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1229266836' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T05:59:41.562 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:41.563 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:41.585 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:41.648 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:41.650 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:41.657 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:42.260 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:42 smithi072 ceph-mon[28706]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:42.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:42 smithi172 ceph-mon[35716]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:44.375 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:44 smithi072 ceph-mon[28706]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:44.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:44 smithi172 ceph-mon[35716]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:46.257 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:46 smithi072 ceph-mon[28706]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:46.257 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:46 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:59:46.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:46 smithi172 ceph-mon[35716]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:46.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:46 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T05:59:48.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.140+0000 7f98b5800700 1 -- 172.21.15.72:0/2947098397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b0106b80 msgr2=0x7f98b0106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:48.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.140+0000 7f98b5800700 1 --2- 172.21.15.72:0/2947098397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b0106b80 0x7f98b0106ff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f989c009910 tx=0x7f989c009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:48.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.140+0000 7f98b5800700 1 -- 172.21.15.72:0/2947098397 shutdown_connections 2024-03-19T05:59:48.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.140+0000 7f98b5800700 1 --2- 172.21.15.72:0/2947098397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b0106b80 0x7f98b0106ff0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:48.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.140+0000 7f98b5800700 1 --2- 172.21.15.72:0/2947098397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98b010c8f0 0x7f98b010ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:48.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.140+0000 7f98b5800700 1 -- 172.21.15.72:0/2947098397 >> 172.21.15.72:0/2947098397 conn(0x7f98b0076060 msgr2=0x7f98b0078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:48.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.140+0000 7f98b5800700 1 -- 172.21.15.72:0/2947098397 shutdown_connections 2024-03-19T05:59:48.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.140+0000 7f98b5800700 1 -- 172.21.15.72:0/2947098397 wait complete. 2024-03-19T05:59:48.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.141+0000 7f98b5800700 1 Processor -- start 2024-03-19T05:59:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.141+0000 7f98b5800700 1 -- start start 2024-03-19T05:59:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.141+0000 7f98b5800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b0106b80 0x7f98b019c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.141+0000 7f98b5800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98b010c8f0 0x7f98b019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.141+0000 7f98b5800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b019d060 con 0x7f98b0106b80 2024-03-19T05:59:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.141+0000 7f98b5800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b01a0df0 con 0x7f98b010c8f0 2024-03-19T05:59:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.142+0000 7f98aea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b0106b80 0x7f98b019c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.142+0000 7f98aea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b0106b80 0x7f98b019c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49674/0 (socket says 172.21.15.72:49674) 2024-03-19T05:59:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.142+0000 7f98aea00700 1 -- 172.21.15.72:0/536007031 learned_addr learned my addr 172.21.15.72:0/536007031 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.142+0000 7f98ae000700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98b010c8f0 0x7f98b019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.142+0000 7f98aea00700 1 -- 172.21.15.72:0/536007031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98b010c8f0 msgr2=0x7f98b019c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.142+0000 7f98aea00700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98b010c8f0 0x7f98b019c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.142+0000 7f98aea00700 1 -- 172.21.15.72:0/536007031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c0095f0 con 0x7f98b0106b80 2024-03-19T05:59:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.142+0000 7f98ae000700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98b010c8f0 0x7f98b019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T05:59:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.142+0000 7f98aea00700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b0106b80 0x7f98b019c440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f98a000c8a0 tx=0x7f98a000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.143+0000 7f98a7400700 1 -- 172.21.15.72:0/536007031 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a000cea0 con 0x7f98b0106b80 2024-03-19T05:59:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.143+0000 7f98a7400700 1 -- 172.21.15.72:0/536007031 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f98a0004830 con 0x7f98b0106b80 2024-03-19T05:59:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.143+0000 7f98a7400700 1 -- 172.21.15.72:0/536007031 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a00055b0 con 0x7f98b0106b80 2024-03-19T05:59:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.143+0000 7f98b5800700 1 -- 172.21.15.72:0/536007031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b01a10d0 con 0x7f98b0106b80 2024-03-19T05:59:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.143+0000 7f98b5800700 1 -- 172.21.15.72:0/536007031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b01a15d0 con 0x7f98b0106b80 2024-03-19T05:59:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.144+0000 7f98b5800700 1 -- 172.21.15.72:0/536007031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98b0113c30 con 0x7f98b0106b80 2024-03-19T05:59:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.145+0000 7f98a7400700 1 -- 172.21.15.72:0/536007031 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f98a0007ad0 con 0x7f98b0106b80 2024-03-19T05:59:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.146+0000 7f98a7400700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f989406c680 0x7f989406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.146+0000 7f98a7400700 1 -- 172.21.15.72:0/536007031 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f98a008b340 con 0x7f98b0106b80 2024-03-19T05:59:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.146+0000 7f98ae000700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f989406c680 0x7f989406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.146+0000 7f98a7400700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949] conn(0x7f9894072350 0x7f9894074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.146+0000 7f98a7400700 1 -- 172.21.15.72:0/536007031 --> [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9894074e10 con 0x7f9894072350 2024-03-19T05:59:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.146+0000 7f98a7400700 1 -- 172.21.15.72:0/536007031 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98a008d970 con 0x7f98b0106b80 2024-03-19T05:59:48.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.146+0000 7f98af400700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949] conn(0x7f9894072350 0x7f9894074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:48.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.147+0000 7f98ae000700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f989406c680 0x7f989406eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f989c006010 tx=0x7f989c00b540 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:48.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.147+0000 7f98af400700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949] conn(0x7f9894072350 0x7f9894074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:48.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.148+0000 7f98a7400700 1 -- 172.21.15.72:0/536007031 <== osd.1 v2:172.21.15.72:6810/1791583949 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9894074e10 con 0x7f9894072350 2024-03-19T05:59:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.166+0000 7f98b5800700 1 -- 172.21.15.72:0/536007031 --> [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98b004f2a0 con 0x7f9894072350 2024-03-19T05:59:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.167+0000 7f98a7400700 1 -- 172.21.15.72:0/536007031 <== osd.1 v2:172.21.15.72:6810/1791583949 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f98b004f2a0 con 0x7f9894072350 2024-03-19T05:59:48.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.167+0000 7f98b5800700 1 -- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949] conn(0x7f9894072350 msgr2=0x7f9894074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.167+0000 7f98b5800700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949] conn(0x7f9894072350 0x7f9894074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.167+0000 7f98b5800700 1 -- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f989406c680 msgr2=0x7f989406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.167+0000 7f98b5800700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f989406c680 0x7f989406eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f989c006010 tx=0x7f989c00b540 comp rx=0 tx=0).stop 2024-03-19T05:59:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.167+0000 7f98b5800700 1 -- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b0106b80 msgr2=0x7f98b019c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.167+0000 7f98b5800700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b0106b80 0x7f98b019c440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f98a000c8a0 tx=0x7f98a000cc60 comp rx=0 tx=0).stop 2024-03-19T05:59:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.168+0000 7f98b5800700 1 -- 172.21.15.72:0/536007031 shutdown_connections 2024-03-19T05:59:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.168+0000 7f98b5800700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:6810/1791583949,v1:172.21.15.72:6811/1791583949] conn(0x7f9894072350 0x7f9894074760 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.168+0000 7f98b5800700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f989406c680 0x7f989406eb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.168+0000 7f98b5800700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b0106b80 0x7f98b019c440 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.168+0000 7f98b5800700 1 --2- 172.21.15.72:0/536007031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98b010c8f0 0x7f98b019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.168+0000 7f98b5800700 1 -- 172.21.15.72:0/536007031 >> 172.21.15.72:0/536007031 conn(0x7f98b0076060 msgr2=0x7f98b0077ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.168+0000 7f98b5800700 1 -- 172.21.15.72:0/536007031 shutdown_connections 2024-03-19T05:59:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:48.168+0000 7f98b5800700 1 -- 172.21.15.72:0/536007031 wait complete. 2024-03-19T05:59:48.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:48 smithi072 ceph-mon[28706]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:48.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:48 smithi172 ceph-mon[35716]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:49.413 INFO:teuthology.orchestra.run.smithi072.stdout:60129542182 2024-03-19T05:59:49.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-19T05:59:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.196+0000 7f43d4400700 1 -- 172.21.15.72:0/1823402115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43cc102470 msgr2=0x7f43cc1028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.196+0000 7f43d4400700 1 --2- 172.21.15.72:0/1823402115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43cc102470 0x7f43cc1028e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009910 tx=0x7f43b8009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.196+0000 7f43d4400700 1 -- 172.21.15.72:0/1823402115 shutdown_connections 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.196+0000 7f43d4400700 1 --2- 172.21.15.72:0/1823402115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43cc102470 0x7f43cc1028e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.196+0000 7f43d4400700 1 --2- 172.21.15.72:0/1823402115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43cc108470 0x7f43cc108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.196+0000 7f43d4400700 1 -- 172.21.15.72:0/1823402115 >> 172.21.15.72:0/1823402115 conn(0x7f43cc0fdf90 msgr2=0x7f43cc1003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.196+0000 7f43d4400700 1 -- 172.21.15.72:0/1823402115 shutdown_connections 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.196+0000 7f43d4400700 1 -- 172.21.15.72:0/1823402115 wait complete. 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.197+0000 7f43d4400700 1 Processor -- start 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.197+0000 7f43d4400700 1 -- start start 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.198+0000 7f43d4400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43cc102470 0x7f43cc1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.198+0000 7f43d4400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43cc108470 0x7f43cc198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.198+0000 7f43d4400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc198d80 con 0x7f43cc108470 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.198+0000 7f43d4400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc198ec0 con 0x7f43cc102470 2024-03-19T05:59:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.198+0000 7f43d1000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43cc108470 0x7f43cc198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.198+0000 7f43d1000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43cc108470 0x7f43cc198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49692/0 (socket says 172.21.15.72:49692) 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.198+0000 7f43d1000700 1 -- 172.21.15.72:0/658080847 learned_addr learned my addr 172.21.15.72:0/658080847 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.198+0000 7f43d1a00700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43cc102470 0x7f43cc1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.199+0000 7f43d1000700 1 -- 172.21.15.72:0/658080847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43cc102470 msgr2=0x7f43cc1981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.199+0000 7f43d1000700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43cc102470 0x7f43cc1981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.199+0000 7f43d1000700 1 -- 172.21.15.72:0/658080847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b80095f0 con 0x7f43cc108470 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.199+0000 7f43d1a00700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43cc102470 0x7f43cc1981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.199+0000 7f43d1000700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43cc108470 0x7f43cc198730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f43b8006010 tx=0x7f43b800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.199+0000 7f43ca000700 1 -- 172.21.15.72:0/658080847 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b801d070 con 0x7f43cc108470 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.199+0000 7f43ca000700 1 -- 172.21.15.72:0/658080847 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f43b800f460 con 0x7f43cc108470 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.199+0000 7f43ca000700 1 -- 172.21.15.72:0/658080847 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b8021640 con 0x7f43cc108470 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.199+0000 7f43d4400700 1 -- 172.21.15.72:0/658080847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc19ccb0 con 0x7f43cc108470 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.199+0000 7f43d4400700 1 -- 172.21.15.72:0/658080847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc19d1a0 con 0x7f43cc108470 2024-03-19T05:59:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.200+0000 7f43d4400700 1 -- 172.21.15.72:0/658080847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f43cc10f860 con 0x7f43cc108470 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.202+0000 7f43ca000700 1 -- 172.21.15.72:0/658080847 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f43b800faf0 con 0x7f43cc108470 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.202+0000 7f43ca000700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f43b406c680 0x7f43b406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.202+0000 7f43ca000700 1 -- 172.21.15.72:0/658080847 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f43b808c950 con 0x7f43cc108470 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.203+0000 7f43ca000700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887] conn(0x7f43b4072350 0x7f43b4074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.203+0000 7f43d1a00700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f43b406c680 0x7f43b406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.203+0000 7f43ca000700 1 -- 172.21.15.72:0/658080847 --> [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43b4074e10 con 0x7f43b4072350 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.203+0000 7f43ca000700 1 -- 172.21.15.72:0/658080847 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43b80912a0 con 0x7f43cc108470 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.203+0000 7f43d1a00700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f43b406c680 0x7f43b406eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005fd0 tx=0x7f43c0005e20 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.203+0000 7f43d2400700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887] conn(0x7f43b4072350 0x7f43b4074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.204+0000 7f43d2400700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887] conn(0x7f43b4072350 0x7f43b4074760 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.207+0000 7f43ca000700 1 -- 172.21.15.72:0/658080847 <== osd.4 v2:172.21.15.172:6808/3130039887 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f43b4074e10 con 0x7f43b4072350 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.224+0000 7f43d4400700 1 -- 172.21.15.72:0/658080847 --> [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f43cc04f2a0 con 0x7f43b4072350 2024-03-19T05:59:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43ca000700 1 -- 172.21.15.72:0/658080847 <== osd.4 v2:172.21.15.172:6808/3130039887 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f43cc04f2a0 con 0x7f43b4072350 2024-03-19T05:59:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43d4400700 1 -- 172.21.15.72:0/658080847 >> [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887] conn(0x7f43b4072350 msgr2=0x7f43b4074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43d4400700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887] conn(0x7f43b4072350 0x7f43b4074760 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43d4400700 1 -- 172.21.15.72:0/658080847 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f43b406c680 msgr2=0x7f43b406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43d4400700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f43b406c680 0x7f43b406eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005fd0 tx=0x7f43c0005e20 comp rx=0 tx=0).stop 2024-03-19T05:59:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43d4400700 1 -- 172.21.15.72:0/658080847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43cc108470 msgr2=0x7f43cc198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43d4400700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43cc108470 0x7f43cc198730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f43b8006010 tx=0x7f43b800be20 comp rx=0 tx=0).stop 2024-03-19T05:59:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43d4400700 1 -- 172.21.15.72:0/658080847 shutdown_connections 2024-03-19T05:59:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43d4400700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.172:6808/3130039887,v1:172.21.15.172:6809/3130039887] conn(0x7f43b4072350 0x7f43b4074760 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43d4400700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f43b406c680 0x7f43b406eb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43d4400700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43cc102470 0x7f43cc1981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43d4400700 1 --2- 172.21.15.72:0/658080847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43cc108470 0x7f43cc198730 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.225+0000 7f43d4400700 1 -- 172.21.15.72:0/658080847 >> 172.21.15.72:0/658080847 conn(0x7f43cc0fdf90 msgr2=0x7f43cc0ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:49.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.226+0000 7f43d4400700 1 -- 172.21.15.72:0/658080847 shutdown_connections 2024-03-19T05:59:49.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:49.226+0000 7f43d4400700 1 -- 172.21.15.72:0/658080847 wait complete. 2024-03-19T05:59:49.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.164+0000 7f1847200700 1 -- 172.21.15.72:0/1799472611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1848101250 msgr2=0x7f1848101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:49.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.164+0000 7f1847200700 1 --2- 172.21.15.72:0/1799472611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1848101250 0x7f1848101620 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1838009910 tx=0x7f1838009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:49.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.164+0000 7f1847200700 1 -- 172.21.15.72:0/1799472611 shutdown_connections 2024-03-19T05:59:49.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.164+0000 7f1847200700 1 --2- 172.21.15.72:0/1799472611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1848101bf0 0x7f1848106040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.164+0000 7f1847200700 1 --2- 172.21.15.72:0/1799472611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1848101250 0x7f1848101620 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.164+0000 7f1847200700 1 -- 172.21.15.72:0/1799472611 >> 172.21.15.72:0/1799472611 conn(0x7f18480faad0 msgr2=0x7f18480fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:49.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.164+0000 7f1847200700 1 -- 172.21.15.72:0/1799472611 shutdown_connections 2024-03-19T05:59:49.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.164+0000 7f1847200700 1 -- 172.21.15.72:0/1799472611 wait complete. 2024-03-19T05:59:49.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.165+0000 7f1847200700 1 Processor -- start 2024-03-19T05:59:49.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.165+0000 7f1847200700 1 -- start start 2024-03-19T05:59:49.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.166+0000 7f1847200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1848101250 0x7f1848195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:49.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.166+0000 7f1847200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1848101bf0 0x7f18481963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:49.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.166+0000 7f1847200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1848196a80 con 0x7f1848101bf0 2024-03-19T05:59:49.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.166+0000 7f1847200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184819a810 con 0x7f1848101250 2024-03-19T05:59:49.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.166+0000 7f1845400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1848101bf0 0x7f18481963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:49.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.166+0000 7f1845400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1848101bf0 0x7f18481963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49656/0 (socket says 172.21.15.72:49656) 2024-03-19T05:59:49.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.166+0000 7f1845400700 1 -- 172.21.15.72:0/1560265935 learned_addr learned my addr 172.21.15.72:0/1560265935 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:49.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.166+0000 7f1845e00700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1848101250 0x7f1848195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:49.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.167+0000 7f1845400700 1 -- 172.21.15.72:0/1560265935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1848101250 msgr2=0x7f1848195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:49.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.167+0000 7f1845400700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1848101250 0x7f1848195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.167+0000 7f1845400700 1 -- 172.21.15.72:0/1560265935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380095f0 con 0x7f1848101bf0 2024-03-19T05:59:49.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.167+0000 7f1845400700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1848101bf0 0x7f18481963a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f183400b480 tx=0x7f183400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.167+0000 7f183ea00700 1 -- 172.21.15.72:0/1560265935 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18340118c0 con 0x7f1848101bf0 2024-03-19T05:59:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.167+0000 7f183ea00700 1 -- 172.21.15.72:0/1560265935 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1834010380 con 0x7f1848101bf0 2024-03-19T05:59:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.167+0000 7f1847200700 1 -- 172.21.15.72:0/1560265935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184819aaf0 con 0x7f1848101bf0 2024-03-19T05:59:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.167+0000 7f183ea00700 1 -- 172.21.15.72:0/1560265935 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f183400f4f0 con 0x7f1848101bf0 2024-03-19T05:59:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.167+0000 7f1847200700 1 -- 172.21.15.72:0/1560265935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184819b040 con 0x7f1848101bf0 2024-03-19T05:59:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.168+0000 7f1847200700 1 -- 172.21.15.72:0/1560265935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f184810d620 con 0x7f1848101bf0 2024-03-19T05:59:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.169+0000 7f183ea00700 1 -- 172.21.15.72:0/1560265935 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f18340104f0 con 0x7f1848101bf0 2024-03-19T05:59:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.170+0000 7f183ea00700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f182c06c680 0x7f182c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.170+0000 7f183ea00700 1 -- 172.21.15.72:0/1560265935 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f183408b220 con 0x7f1848101bf0 2024-03-19T05:59:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.170+0000 7f1845e00700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f182c06c680 0x7f182c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.170+0000 7f183ea00700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661] conn(0x7f182c072350 0x7f182c074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.170+0000 7f183ea00700 1 -- 172.21.15.72:0/1560265935 --> [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f182c074e10 con 0x7f182c072350 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.170+0000 7f183ea00700 1 -- 172.21.15.72:0/1560265935 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f183408d850 con 0x7f1848101bf0 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.170+0000 7f1846800700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661] conn(0x7f182c072350 0x7f182c074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.171+0000 7f1845e00700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f182c06c680 0x7f182c06eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1838000c00 tx=0x7f1838005fd0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.171+0000 7f1846800700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661] conn(0x7f182c072350 0x7f182c074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.172+0000 7f183ea00700 1 -- 172.21.15.72:0/1560265935 <== osd.2 v2:172.21.15.72:6818/3669016661 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f182c074e10 con 0x7f182c072350 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.188+0000 7f1847200700 1 -- 172.21.15.72:0/1560265935 --> [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1848062380 con 0x7f182c072350 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.189+0000 7f183ea00700 1 -- 172.21.15.72:0/1560265935 <== osd.2 v2:172.21.15.72:6818/3669016661 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1848062380 con 0x7f182c072350 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.189+0000 7f1847200700 1 -- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661] conn(0x7f182c072350 msgr2=0x7f182c074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.189+0000 7f1847200700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661] conn(0x7f182c072350 0x7f182c074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.189+0000 7f1847200700 1 -- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f182c06c680 msgr2=0x7f182c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.189+0000 7f1847200700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f182c06c680 0x7f182c06eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1838000c00 tx=0x7f1838005fd0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.189+0000 7f1847200700 1 -- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1848101bf0 msgr2=0x7f18481963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:49.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.189+0000 7f1847200700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1848101bf0 0x7f18481963a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f183400b480 tx=0x7f183400b840 comp rx=0 tx=0).stop 2024-03-19T05:59:49.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.190+0000 7f1847200700 1 -- 172.21.15.72:0/1560265935 shutdown_connections 2024-03-19T05:59:49.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.190+0000 7f1847200700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:6818/3669016661,v1:172.21.15.72:6819/3669016661] conn(0x7f182c072350 0x7f182c074760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.190+0000 7f1847200700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f182c06c680 0x7f182c06eb30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.190+0000 7f1847200700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1848101250 0x7f1848195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.190+0000 7f1847200700 1 --2- 172.21.15.72:0/1560265935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1848101bf0 0x7f18481963a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:49.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.190+0000 7f1847200700 1 -- 172.21.15.72:0/1560265935 >> 172.21.15.72:0/1560265935 conn(0x7f18480faad0 msgr2=0x7f18481098c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:49.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.190+0000 7f1847200700 1 -- 172.21.15.72:0/1560265935 shutdown_connections 2024-03-19T05:59:49.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:47.190+0000 7f1847200700 1 -- 172.21.15.72:0/1560265935 wait complete. 2024-03-19T05:59:50.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:50 smithi072 ceph-mon[28706]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:50.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:50 smithi172 ceph-mon[35716]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:51.034 INFO:teuthology.orchestra.run.smithi072.stdout:146028888080 2024-03-19T05:59:51.034 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-19T05:59:51.464 INFO:teuthology.orchestra.run.smithi072.stdout:81604378655 2024-03-19T05:59:51.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-19T05:59:52.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:52 smithi072 ceph-mon[28706]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:52.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:52 smithi172 ceph-mon[35716]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:53.472 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:53.472 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.497+0000 7fd819400700 1 -- 172.21.15.72:0/115817365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd814101d30 msgr2=0x7fd81410a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.497+0000 7fd819400700 1 --2- 172.21.15.72:0/115817365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd814101d30 0x7fd81410a230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd800009910 tx=0x7fd800009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.497+0000 7fd819400700 1 -- 172.21.15.72:0/115817365 shutdown_connections 2024-03-19T05:59:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.497+0000 7fd819400700 1 --2- 172.21.15.72:0/115817365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd814101d30 0x7fd81410a230 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.497+0000 7fd819400700 1 --2- 172.21.15.72:0/115817365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd814101420 0x7fd8141017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.497+0000 7fd819400700 1 -- 172.21.15.72:0/115817365 >> 172.21.15.72:0/115817365 conn(0x7fd8140fac80 msgr2=0x7fd8140fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.497+0000 7fd819400700 1 -- 172.21.15.72:0/115817365 shutdown_connections 2024-03-19T05:59:53.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.497+0000 7fd819400700 1 -- 172.21.15.72:0/115817365 wait complete. 2024-03-19T05:59:53.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.499+0000 7fd819400700 1 Processor -- start 2024-03-19T05:59:53.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.499+0000 7fd819400700 1 -- start start 2024-03-19T05:59:53.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.499+0000 7fd819400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd814101420 0x7fd814198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:53.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.499+0000 7fd819400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd814101d30 0x7fd814198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:53.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.499+0000 7fd819400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd814198d20 con 0x7fd814101d30 2024-03-19T05:59:53.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.499+0000 7fd819400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81419cab0 con 0x7fd814101420 2024-03-19T05:59:53.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.500+0000 7fd811e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd814101d30 0x7fd814198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:53.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.500+0000 7fd811e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd814101d30 0x7fd814198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49714/0 (socket says 172.21.15.72:49714) 2024-03-19T05:59:53.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.500+0000 7fd811e00700 1 -- 172.21.15.72:0/1280237119 learned_addr learned my addr 172.21.15.72:0/1280237119 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:53.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.500+0000 7fd812800700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd814101420 0x7fd814198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.500+0000 7fd811e00700 1 -- 172.21.15.72:0/1280237119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd814101420 msgr2=0x7fd814198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.500+0000 7fd811e00700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd814101420 0x7fd814198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.500+0000 7fd811e00700 1 -- 172.21.15.72:0/1280237119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8000095f0 con 0x7fd814101d30 2024-03-19T05:59:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.500+0000 7fd812800700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd814101420 0x7fd814198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T05:59:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.501+0000 7fd811e00700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd814101d30 0x7fd814198640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd80000b5c0 tx=0x7fd80000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.501+0000 7fd80b400700 1 -- 172.21.15.72:0/1280237119 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd80001d070 con 0x7fd814101d30 2024-03-19T05:59:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.501+0000 7fd80b400700 1 -- 172.21.15.72:0/1280237119 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd800022470 con 0x7fd814101d30 2024-03-19T05:59:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.501+0000 7fd819400700 1 -- 172.21.15.72:0/1280237119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81419cd30 con 0x7fd814101d30 2024-03-19T05:59:53.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.501+0000 7fd80b400700 1 -- 172.21.15.72:0/1280237119 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd80000f670 con 0x7fd814101d30 2024-03-19T05:59:53.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.501+0000 7fd819400700 1 -- 172.21.15.72:0/1280237119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81419d220 con 0x7fd814101d30 2024-03-19T05:59:53.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.503+0000 7fd819400700 1 -- 172.21.15.72:0/1280237119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd81410d6b0 con 0x7fd814101d30 2024-03-19T05:59:53.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.504+0000 7fd80b400700 1 -- 172.21.15.72:0/1280237119 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd800004c30 con 0x7fd814101d30 2024-03-19T05:59:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.505+0000 7fd80b400700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd7f806c6d0 0x7fd7f806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.505+0000 7fd80b400700 1 -- 172.21.15.72:0/1280237119 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd80008cb90 con 0x7fd814101d30 2024-03-19T05:59:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.505+0000 7fd80b400700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762] conn(0x7fd7f80723a0 0x7fd7f80747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.505+0000 7fd80b400700 1 -- 172.21.15.72:0/1280237119 --> [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7f8074e60 con 0x7fd7f80723a0 2024-03-19T05:59:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.505+0000 7fd80b400700 1 -- 172.21.15.72:0/1280237119 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8000912a0 con 0x7fd814101d30 2024-03-19T05:59:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.506+0000 7fd812800700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd7f806c6d0 0x7fd7f806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.506+0000 7fd813200700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762] conn(0x7fd7f80723a0 0x7fd7f80747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.506+0000 7fd812800700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd7f806c6d0 0x7fd7f806eb80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd804007900 tx=0x7fd804008040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.507+0000 7fd813200700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762] conn(0x7fd7f80723a0 0x7fd7f80747b0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.509+0000 7fd80b400700 1 -- 172.21.15.72:0/1280237119 <== osd.5 v2:172.21.15.172:6816/4144227762 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd7f8074e60 con 0x7fd7f80723a0 2024-03-19T05:59:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.534+0000 7fd819400700 1 -- 172.21.15.72:0/1280237119 --> [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd81404f2a0 con 0x7fd7f80723a0 2024-03-19T05:59:53.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.535+0000 7fd80b400700 1 -- 172.21.15.72:0/1280237119 <== osd.5 v2:172.21.15.172:6816/4144227762 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd81404f2a0 con 0x7fd7f80723a0 2024-03-19T05:59:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.535+0000 7fd819400700 1 -- 172.21.15.72:0/1280237119 >> [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762] conn(0x7fd7f80723a0 msgr2=0x7fd7f80747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.535+0000 7fd819400700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762] conn(0x7fd7f80723a0 0x7fd7f80747b0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.535+0000 7fd819400700 1 -- 172.21.15.72:0/1280237119 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd7f806c6d0 msgr2=0x7fd7f806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.535+0000 7fd819400700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd7f806c6d0 0x7fd7f806eb80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd804007900 tx=0x7fd804008040 comp rx=0 tx=0).stop 2024-03-19T05:59:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.535+0000 7fd819400700 1 -- 172.21.15.72:0/1280237119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd814101d30 msgr2=0x7fd814198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.535+0000 7fd819400700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd814101d30 0x7fd814198640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd80000b5c0 tx=0x7fd80000be00 comp rx=0 tx=0).stop 2024-03-19T05:59:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.536+0000 7fd819400700 1 -- 172.21.15.72:0/1280237119 shutdown_connections 2024-03-19T05:59:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.536+0000 7fd819400700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.172:6816/4144227762,v1:172.21.15.172:6817/4144227762] conn(0x7fd7f80723a0 0x7fd7f80747b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.536+0000 7fd819400700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd7f806c6d0 0x7fd7f806eb80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.536+0000 7fd819400700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd814101420 0x7fd814198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.536+0000 7fd819400700 1 --2- 172.21.15.72:0/1280237119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd814101d30 0x7fd814198640 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.536+0000 7fd819400700 1 -- 172.21.15.72:0/1280237119 >> 172.21.15.72:0/1280237119 conn(0x7fd8140fac80 msgr2=0x7fd8140ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.536+0000 7fd819400700 1 -- 172.21.15.72:0/1280237119 shutdown_connections 2024-03-19T05:59:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:53.536+0000 7fd819400700 1 -- 172.21.15.72:0/1280237119 wait complete. 2024-03-19T05:59:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.133+0000 7fda43e00700 1 -- 172.21.15.72:0/2782507328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda44102e60 msgr2=0x7fda44106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.133+0000 7fda43e00700 1 --2- 172.21.15.72:0/2782507328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda44102e60 0x7fda44106e30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009910 tx=0x7fda2c009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.133+0000 7fda43e00700 1 -- 172.21.15.72:0/2782507328 shutdown_connections 2024-03-19T05:59:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.133+0000 7fda43e00700 1 --2- 172.21.15.72:0/2782507328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda44102e60 0x7fda44106e30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.133+0000 7fda43e00700 1 --2- 172.21.15.72:0/2782507328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda441024c0 0x7fda44102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.133+0000 7fda43e00700 1 -- 172.21.15.72:0/2782507328 >> 172.21.15.72:0/2782507328 conn(0x7fda440fdd20 msgr2=0x7fda44100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.133+0000 7fda43e00700 1 -- 172.21.15.72:0/2782507328 shutdown_connections 2024-03-19T05:59:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.133+0000 7fda43e00700 1 -- 172.21.15.72:0/2782507328 wait complete. 2024-03-19T05:59:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.135+0000 7fda43e00700 1 Processor -- start 2024-03-19T05:59:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.135+0000 7fda43e00700 1 -- start start 2024-03-19T05:59:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.136+0000 7fda43e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda441024c0 0x7fda44197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.136+0000 7fda43e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda44102e60 0x7fda44198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.136+0000 7fda43e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda441989e0 con 0x7fda44102e60 2024-03-19T05:59:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.136+0000 7fda43e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44198b20 con 0x7fda441024c0 2024-03-19T05:59:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.136+0000 7fda3be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda44102e60 0x7fda44198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.136+0000 7fda3be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda44102e60 0x7fda44198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45928/0 (socket says 172.21.15.72:45928) 2024-03-19T05:59:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.136+0000 7fda3be00700 1 -- 172.21.15.72:0/3328275540 learned_addr learned my addr 172.21.15.72:0/3328275540 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.136+0000 7fda42a00700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda441024c0 0x7fda44197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.137+0000 7fda3be00700 1 -- 172.21.15.72:0/3328275540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda441024c0 msgr2=0x7fda44197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.137+0000 7fda3be00700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda441024c0 0x7fda44197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.137+0000 7fda3be00700 1 -- 172.21.15.72:0/3328275540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c0095f0 con 0x7fda44102e60 2024-03-19T05:59:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.137+0000 7fda3be00700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda44102e60 0x7fda44198390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0092e0 tx=0x7fda2c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.137+0000 7fda3b400700 1 -- 172.21.15.72:0/3328275540 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2c01d070 con 0x7fda44102e60 2024-03-19T05:59:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.137+0000 7fda43e00700 1 -- 172.21.15.72:0/3328275540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4419c910 con 0x7fda44102e60 2024-03-19T05:59:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.137+0000 7fda3b400700 1 -- 172.21.15.72:0/3328275540 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda2c022470 con 0x7fda44102e60 2024-03-19T05:59:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.137+0000 7fda3b400700 1 -- 172.21.15.72:0/3328275540 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2c00f690 con 0x7fda44102e60 2024-03-19T05:59:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.138+0000 7fda43e00700 1 -- 172.21.15.72:0/3328275540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4419ce00 con 0x7fda44102e60 2024-03-19T05:59:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.139+0000 7fda43e00700 1 -- 172.21.15.72:0/3328275540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda4410f6b0 con 0x7fda44102e60 2024-03-19T05:59:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.140+0000 7fda3b400700 1 -- 172.21.15.72:0/3328275540 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fda2c0225e0 con 0x7fda44102e60 2024-03-19T05:59:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.141+0000 7fda3b400700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fda2806c680 0x7fda2806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.141+0000 7fda3b400700 1 -- 172.21.15.72:0/3328275540 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fda2c08c9b0 con 0x7fda44102e60 2024-03-19T05:59:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.141+0000 7fda42a00700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fda2806c680 0x7fda2806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.141+0000 7fda3b400700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040] conn(0x7fda28072350 0x7fda28074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.141+0000 7fda3b400700 1 -- 172.21.15.72:0/3328275540 --> [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda28074e10 con 0x7fda28072350 2024-03-19T05:59:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.141+0000 7fda3b400700 1 -- 172.21.15.72:0/3328275540 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda2c0912a0 con 0x7fda44102e60 2024-03-19T05:59:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.142+0000 7fda43400700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040] conn(0x7fda28072350 0x7fda28074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.142+0000 7fda42a00700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fda2806c680 0x7fda2806eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fda34005ea0 tx=0x7fda34005e30 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.143+0000 7fda43400700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040] conn(0x7fda28072350 0x7fda28074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:54.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.147+0000 7fda3b400700 1 -- 172.21.15.72:0/3328275540 <== osd.3 v2:172.21.15.172:6800/1596269040 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fda28074e10 con 0x7fda28072350 2024-03-19T05:59:54.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.166+0000 7fda43e00700 1 -- 172.21.15.72:0/3328275540 --> [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda44062380 con 0x7fda28072350 2024-03-19T05:59:54.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda3b400700 1 -- 172.21.15.72:0/3328275540 <== osd.3 v2:172.21.15.172:6800/1596269040 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fda44062380 con 0x7fda28072350 2024-03-19T05:59:54.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda43e00700 1 -- 172.21.15.72:0/3328275540 >> [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040] conn(0x7fda28072350 msgr2=0x7fda28074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda43e00700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040] conn(0x7fda28072350 0x7fda28074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda43e00700 1 -- 172.21.15.72:0/3328275540 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fda2806c680 msgr2=0x7fda2806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda43e00700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fda2806c680 0x7fda2806eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fda34005ea0 tx=0x7fda34005e30 comp rx=0 tx=0).stop 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda43e00700 1 -- 172.21.15.72:0/3328275540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda44102e60 msgr2=0x7fda44198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda43e00700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda44102e60 0x7fda44198390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0092e0 tx=0x7fda2c00be20 comp rx=0 tx=0).stop 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda43e00700 1 -- 172.21.15.72:0/3328275540 shutdown_connections 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda43e00700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.172:6800/1596269040,v1:172.21.15.172:6801/1596269040] conn(0x7fda28072350 0x7fda28074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda43e00700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fda2806c680 0x7fda2806eb30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda43e00700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda441024c0 0x7fda44197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda43e00700 1 --2- 172.21.15.72:0/3328275540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda44102e60 0x7fda44198390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.167+0000 7fda43e00700 1 -- 172.21.15.72:0/3328275540 >> 172.21.15.72:0/3328275540 conn(0x7fda440fdd20 msgr2=0x7fda441000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.168+0000 7fda43e00700 1 -- 172.21.15.72:0/3328275540 shutdown_connections 2024-03-19T05:59:54.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:54.168+0000 7fda43e00700 1 -- 172.21.15.72:0/3328275540 wait complete. 2024-03-19T05:59:54.265 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:54 smithi072 ceph-mon[28706]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:54.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:54 smithi172 ceph-mon[35716]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:55.679 INFO:teuthology.orchestra.run.smithi072.stdout:167503724554 2024-03-19T05:59:55.680 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-19T05:59:56.452 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:56 smithi072 ceph-mon[28706]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:56.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:56 smithi172 ceph-mon[35716]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:57.420 INFO:teuthology.orchestra.run.smithi072.stdout:111669149722 2024-03-19T05:59:57.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-19T05:59:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.081+0000 7f2998e00700 1 -- 172.21.15.72:0/1601580037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2994107de0 msgr2=0x7f29941081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.081+0000 7f2998e00700 1 --2- 172.21.15.72:0/1601580037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2994107de0 0x7f29941081b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f297c009940 tx=0x7f297c009c50 comp rx=0 tx=0).stop 2024-03-19T05:59:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.081+0000 7f2998e00700 1 -- 172.21.15.72:0/1601580037 shutdown_connections 2024-03-19T05:59:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.081+0000 7f2998e00700 1 --2- 172.21.15.72:0/1601580037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2994108780 0x7f2994110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.081+0000 7f2998e00700 1 --2- 172.21.15.72:0/1601580037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2994107de0 0x7f29941081b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.081+0000 7f2998e00700 1 -- 172.21.15.72:0/1601580037 >> 172.21.15.72:0/1601580037 conn(0x7f299406ca90 msgr2=0x7f299406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.081+0000 7f2998e00700 1 -- 172.21.15.72:0/1601580037 shutdown_connections 2024-03-19T05:59:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.082+0000 7f2998e00700 1 -- 172.21.15.72:0/1601580037 wait complete. 2024-03-19T05:59:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.083+0000 7f2998e00700 1 Processor -- start 2024-03-19T05:59:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.083+0000 7f2998e00700 1 -- start start 2024-03-19T05:59:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.083+0000 7f2998e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2994107de0 0x7f29941a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.083+0000 7f2998e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2994108780 0x7f299419c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.083+0000 7f2998e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299419c840 con 0x7f2994107de0 2024-03-19T05:59:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.083+0000 7f2998e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299419c9b0 con 0x7f2994108780 2024-03-19T05:59:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.084+0000 7f2991e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2994107de0 0x7f29941a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.084+0000 7f2991e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2994107de0 0x7f29941a1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45948/0 (socket says 172.21.15.72:45948) 2024-03-19T05:59:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.084+0000 7f2991e00700 1 -- 172.21.15.72:0/740637708 learned_addr learned my addr 172.21.15.72:0/740637708 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:58.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.084+0000 7f2989400700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2994108780 0x7f299419c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:58.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.085+0000 7f2991e00700 1 -- 172.21.15.72:0/740637708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2994108780 msgr2=0x7f299419c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:58.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.085+0000 7f2991e00700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2994108780 0x7f299419c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:58.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.085+0000 7f2991e00700 1 -- 172.21.15.72:0/740637708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c0095f0 con 0x7f2994107de0 2024-03-19T05:59:58.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.085+0000 7f2989400700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2994108780 0x7f299419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T05:59:58.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.086+0000 7f2991e00700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2994107de0 0x7f29941a1270 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f297c009910 tx=0x7f297c005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:58.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.087+0000 7f298b400700 1 -- 172.21.15.72:0/740637708 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297c01d070 con 0x7f2994107de0 2024-03-19T05:59:58.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.087+0000 7f298b400700 1 -- 172.21.15.72:0/740637708 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f297c0048c0 con 0x7f2994107de0 2024-03-19T05:59:58.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.087+0000 7f298b400700 1 -- 172.21.15.72:0/740637708 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297c003ca0 con 0x7f2994107de0 2024-03-19T05:59:58.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.087+0000 7f2998e00700 1 -- 172.21.15.72:0/740637708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299419cc90 con 0x7f2994107de0 2024-03-19T05:59:58.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.087+0000 7f2998e00700 1 -- 172.21.15.72:0/740637708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29941b7910 con 0x7f2994107de0 2024-03-19T05:59:58.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.088+0000 7f2998e00700 1 -- 172.21.15.72:0/740637708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2994113c80 con 0x7f2994107de0 2024-03-19T05:59:58.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.090+0000 7f298b400700 1 -- 172.21.15.72:0/740637708 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f297c0041f0 con 0x7f2994107de0 2024-03-19T05:59:58.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.091+0000 7f298b400700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f297806c690 0x7f297806eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:58.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.092+0000 7f298b400700 1 -- 172.21.15.72:0/740637708 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f297c08cfe0 con 0x7f2994107de0 2024-03-19T05:59:58.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.092+0000 7f298b400700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724] conn(0x7f2978072360 0x7f2978074770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:58.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.092+0000 7f298b400700 1 -- 172.21.15.72:0/740637708 --> [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2978074e20 con 0x7f2978072360 2024-03-19T05:59:58.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.092+0000 7f2989400700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f297806c690 0x7f297806eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:58.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.092+0000 7f298b400700 1 -- 172.21.15.72:0/740637708 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f297c08d410 con 0x7f2994107de0 2024-03-19T05:59:58.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.093+0000 7f2989400700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f297806c690 0x7f297806eb40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f299419da60 tx=0x7f2984008040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:58.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.093+0000 7f2992800700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724] conn(0x7f2978072360 0x7f2978074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:58.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.094+0000 7f2992800700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724] conn(0x7f2978072360 0x7f2978074770 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:58.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.095+0000 7f298b400700 1 -- 172.21.15.72:0/740637708 <== osd.0 v2:172.21.15.72:6802/2999939724 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2978074e20 con 0x7f2978072360 2024-03-19T05:59:58.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.113+0000 7f2998e00700 1 -- 172.21.15.72:0/740637708 --> [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f299404f2a0 con 0x7f2978072360 2024-03-19T05:59:58.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.113+0000 7f298b400700 1 -- 172.21.15.72:0/740637708 <== osd.0 v2:172.21.15.72:6802/2999939724 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f299404f2a0 con 0x7f2978072360 2024-03-19T05:59:58.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.114+0000 7f2998e00700 1 -- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724] conn(0x7f2978072360 msgr2=0x7f2978074770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:58.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.114+0000 7f2998e00700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724] conn(0x7f2978072360 0x7f2978074770 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:58.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.114+0000 7f2998e00700 1 -- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f297806c690 msgr2=0x7f297806eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:58.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.114+0000 7f2998e00700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f297806c690 0x7f297806eb40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f299419da60 tx=0x7f2984008040 comp rx=0 tx=0).stop 2024-03-19T05:59:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.114+0000 7f2998e00700 1 -- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2994107de0 msgr2=0x7f29941a1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.114+0000 7f2998e00700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2994107de0 0x7f29941a1270 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f297c009910 tx=0x7f297c005ee0 comp rx=0 tx=0).stop 2024-03-19T05:59:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.114+0000 7f2998e00700 1 -- 172.21.15.72:0/740637708 shutdown_connections 2024-03-19T05:59:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.114+0000 7f2998e00700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:6802/2999939724,v1:172.21.15.72:6803/2999939724] conn(0x7f2978072360 0x7f2978074770 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.114+0000 7f2998e00700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f297806c690 0x7f297806eb40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.114+0000 7f2998e00700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2994107de0 0x7f29941a1270 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.114+0000 7f2998e00700 1 --2- 172.21.15.72:0/740637708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2994108780 0x7f299419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.114+0000 7f2998e00700 1 -- 172.21.15.72:0/740637708 >> 172.21.15.72:0/740637708 conn(0x7f299406ca90 msgr2=0x7f299410b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.115+0000 7f2998e00700 1 -- 172.21.15.72:0/740637708 shutdown_connections 2024-03-19T05:59:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:58.115+0000 7f2998e00700 1 -- 172.21.15.72:0/740637708 wait complete. 2024-03-19T05:59:58.299 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 05:59:58 smithi072 ceph-mon[28706]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:58.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 05:59:58 smithi172 ceph-mon[35716]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T05:59:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.213+0000 7f0081a00700 1 -- 172.21.15.72:0/3787886812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007c106b80 msgr2=0x7f007c106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.213+0000 7f0081a00700 1 --2- 172.21.15.72:0/3787886812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007c106b80 0x7f007c106ff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0068009910 tx=0x7f0068009c20 comp rx=0 tx=0).stop 2024-03-19T05:59:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.213+0000 7f0081a00700 1 -- 172.21.15.72:0/3787886812 shutdown_connections 2024-03-19T05:59:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.213+0000 7f0081a00700 1 --2- 172.21.15.72:0/3787886812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007c106b80 0x7f007c106ff0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.213+0000 7f0081a00700 1 --2- 172.21.15.72:0/3787886812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f007c10c8f0 0x7f007c10ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.213+0000 7f0081a00700 1 -- 172.21.15.72:0/3787886812 >> 172.21.15.72:0/3787886812 conn(0x7f007c076060 msgr2=0x7f007c078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.213+0000 7f0081a00700 1 -- 172.21.15.72:0/3787886812 shutdown_connections 2024-03-19T05:59:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.214+0000 7f0081a00700 1 -- 172.21.15.72:0/3787886812 wait complete. 2024-03-19T05:59:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.215+0000 7f0081a00700 1 Processor -- start 2024-03-19T05:59:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.215+0000 7f0081a00700 1 -- start start 2024-03-19T05:59:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.215+0000 7f0081a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007c106b80 0x7f007c19c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.215+0000 7f0081a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f007c10c8f0 0x7f007c19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.215+0000 7f0081a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c19d060 con 0x7f007c106b80 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.215+0000 7f0081a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c1a0df0 con 0x7f007c10c8f0 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.216+0000 7f007aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007c106b80 0x7f007c19c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.216+0000 7f007aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007c106b80 0x7f007c19c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45960/0 (socket says 172.21.15.72:45960) 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.216+0000 7f007aa00700 1 -- 172.21.15.72:0/1568393216 learned_addr learned my addr 172.21.15.72:0/1568393216 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.216+0000 7f007a000700 1 --2- 172.21.15.72:0/1568393216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f007c10c8f0 0x7f007c19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.216+0000 7f007aa00700 1 -- 172.21.15.72:0/1568393216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f007c10c8f0 msgr2=0x7f007c19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.216+0000 7f007aa00700 1 --2- 172.21.15.72:0/1568393216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f007c10c8f0 0x7f007c19c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.216+0000 7f007aa00700 1 -- 172.21.15.72:0/1568393216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00680095f0 con 0x7f007c106b80 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.216+0000 7f007aa00700 1 --2- 172.21.15.72:0/1568393216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007c106b80 0x7f007c19c440 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f006c00c8a0 tx=0x7f006c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.217+0000 7f0073400700 1 -- 172.21.15.72:0/1568393216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006c00cea0 con 0x7f007c106b80 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.217+0000 7f0073400700 1 -- 172.21.15.72:0/1568393216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f006c004830 con 0x7f007c106b80 2024-03-19T05:59:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.217+0000 7f0081a00700 1 -- 172.21.15.72:0/1568393216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c1a10d0 con 0x7f007c106b80 2024-03-19T05:59:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.217+0000 7f0073400700 1 -- 172.21.15.72:0/1568393216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006c0055b0 con 0x7f007c106b80 2024-03-19T05:59:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.217+0000 7f0081a00700 1 -- 172.21.15.72:0/1568393216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c1a1620 con 0x7f007c106b80 2024-03-19T05:59:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.218+0000 7f0081a00700 1 -- 172.21.15.72:0/1568393216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c10ecc0 con 0x7f007c106b80 2024-03-19T05:59:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.219+0000 7f0073400700 1 -- 172.21.15.72:0/1568393216 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f006c007ad0 con 0x7f007c106b80 2024-03-19T05:59:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.220+0000 7f0073400700 1 --2- 172.21.15.72:0/1568393216 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f006006c680 0x7f006006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T05:59:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.220+0000 7f0073400700 1 -- 172.21.15.72:0/1568393216 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f006c08b290 con 0x7f007c106b80 2024-03-19T05:59:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.220+0000 7f007a000700 1 --2- 172.21.15.72:0/1568393216 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f006006c680 0x7f006006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T05:59:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.221+0000 7f007a000700 1 --2- 172.21.15.72:0/1568393216 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f006006c680 0x7f006006eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f006800b5c0 tx=0x7f0068005960 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T05:59:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.224+0000 7f0073400700 1 -- 172.21.15.72:0/1568393216 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f006c055c90 con 0x7f007c106b80 2024-03-19T05:59:59.397 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:59.413 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:59.438 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T05:59:59.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.455+0000 7f0081a00700 1 -- 172.21.15.72:0/1568393216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f007c04f2a0 con 0x7f007c106b80 2024-03-19T05:59:59.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.457+0000 7f0073400700 1 -- 172.21.15.72:0/1568393216 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f007c04f2a0 con 0x7f007c106b80 2024-03-19T05:59:59.449 INFO:teuthology.orchestra.run.smithi072.stdout:146028888082 2024-03-19T05:59:59.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.460+0000 7f0081a00700 1 -- 172.21.15.72:0/1568393216 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f006006c680 msgr2=0x7f006006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:59.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.460+0000 7f0081a00700 1 --2- 172.21.15.72:0/1568393216 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f006006c680 0x7f006006eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f006800b5c0 tx=0x7f0068005960 comp rx=0 tx=0).stop 2024-03-19T05:59:59.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.461+0000 7f0081a00700 1 -- 172.21.15.72:0/1568393216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007c106b80 msgr2=0x7f007c19c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T05:59:59.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.461+0000 7f0081a00700 1 --2- 172.21.15.72:0/1568393216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007c106b80 0x7f007c19c440 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f006c00c8a0 tx=0x7f006c00cc60 comp rx=0 tx=0).stop 2024-03-19T05:59:59.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.461+0000 7f0081a00700 1 -- 172.21.15.72:0/1568393216 shutdown_connections 2024-03-19T05:59:59.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.461+0000 7f0081a00700 1 --2- 172.21.15.72:0/1568393216 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f006006c680 0x7f006006eb30 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f006800b5c0 tx=0x7f0068005960 comp rx=0 tx=0).stop 2024-03-19T05:59:59.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.461+0000 7f0081a00700 1 --2- 172.21.15.72:0/1568393216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f007c106b80 0x7f007c19c440 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f006c00c8a0 tx=0x7f006c00cc60 comp rx=0 tx=0).stop 2024-03-19T05:59:59.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.461+0000 7f0081a00700 1 --2- 172.21.15.72:0/1568393216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f007c10c8f0 0x7f007c19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T05:59:59.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.461+0000 7f0081a00700 1 -- 172.21.15.72:0/1568393216 >> 172.21.15.72:0/1568393216 conn(0x7f007c076060 msgr2=0x7f007c077ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T05:59:59.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.462+0000 7f0081a00700 1 -- 172.21.15.72:0/1568393216 shutdown_connections 2024-03-19T05:59:59.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T05:59:59.462+0000 7f0081a00700 1 -- 172.21.15.72:0/1568393216 wait complete. 2024-03-19T06:00:00.441 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:00 smithi072 ceph-mon[28706]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:00.441 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:00 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1568393216' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-19T06:00:00.441 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:00 smithi072 ceph-mon[28706]: overall HEALTH_OK 2024-03-19T06:00:00.460 INFO:teuthology.orchestra.run.smithi072.stdout:38654705713 2024-03-19T06:00:00.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-19T06:00:00.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:00 smithi172 ceph-mon[35716]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:00.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:00 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1568393216' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-19T06:00:00.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:00 smithi172 ceph-mon[35716]: overall HEALTH_OK 2024-03-19T06:00:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.099+0000 7f4815000700 1 -- 172.21.15.72:0/3638678282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4810106120 msgr2=0x7f48101064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.099+0000 7f4815000700 1 --2- 172.21.15.72:0/3638678282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4810106120 0x7f48101064f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4800009910 tx=0x7f4800009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.099+0000 7f4815000700 1 -- 172.21.15.72:0/3638678282 shutdown_connections 2024-03-19T06:00:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.099+0000 7f4815000700 1 --2- 172.21.15.72:0/3638678282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4810068540 0x7f48100689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.099+0000 7f4815000700 1 --2- 172.21.15.72:0/3638678282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4810106120 0x7f48101064f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.099+0000 7f4815000700 1 -- 172.21.15.72:0/3638678282 >> 172.21.15.72:0/3638678282 conn(0x7f4810074fa0 msgr2=0x7f48100753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.099+0000 7f4815000700 1 -- 172.21.15.72:0/3638678282 shutdown_connections 2024-03-19T06:00:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.099+0000 7f4815000700 1 -- 172.21.15.72:0/3638678282 wait complete. 2024-03-19T06:00:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.100+0000 7f4815000700 1 Processor -- start 2024-03-19T06:00:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.100+0000 7f4815000700 1 -- start start 2024-03-19T06:00:01.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.101+0000 7f4815000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4810068540 0x7f4810197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:01.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.101+0000 7f4815000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4810106120 0x7f48101982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:01.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.101+0000 7f4815000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48101989a0 con 0x7f4810068540 2024-03-19T06:00:01.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.101+0000 7f4815000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481019c730 con 0x7f4810106120 2024-03-19T06:00:01.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.101+0000 7f480f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4810068540 0x7f4810197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:01.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.101+0000 7f480f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4810068540 0x7f4810197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45970/0 (socket says 172.21.15.72:45970) 2024-03-19T06:00:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.101+0000 7f480f400700 1 -- 172.21.15.72:0/2889316235 learned_addr learned my addr 172.21.15.72:0/2889316235 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.101+0000 7f480ea00700 1 --2- 172.21.15.72:0/2889316235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4810106120 0x7f48101982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.102+0000 7f480f400700 1 -- 172.21.15.72:0/2889316235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4810106120 msgr2=0x7f48101982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.102+0000 7f480f400700 1 --2- 172.21.15.72:0/2889316235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4810106120 0x7f48101982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.102+0000 7f480f400700 1 -- 172.21.15.72:0/2889316235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48000095f0 con 0x7f4810068540 2024-03-19T06:00:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.102+0000 7f480ea00700 1 --2- 172.21.15.72:0/2889316235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4810106120 0x7f48101982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:00:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.102+0000 7f480f400700 1 --2- 172.21.15.72:0/2889316235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4810068540 0x7f4810197d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f480000b5c0 tx=0x7f480000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.102+0000 7f4807e00700 1 -- 172.21.15.72:0/2889316235 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f480001d070 con 0x7f4810068540 2024-03-19T06:00:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.102+0000 7f4807e00700 1 -- 172.21.15.72:0/2889316235 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4800022470 con 0x7f4810068540 2024-03-19T06:00:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.102+0000 7f4815000700 1 -- 172.21.15.72:0/2889316235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481019c9b0 con 0x7f4810068540 2024-03-19T06:00:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.102+0000 7f4807e00700 1 -- 172.21.15.72:0/2889316235 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f480000f670 con 0x7f4810068540 2024-03-19T06:00:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.102+0000 7f4815000700 1 -- 172.21.15.72:0/2889316235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481019cea0 con 0x7f4810068540 2024-03-19T06:00:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.104+0000 7f4815000700 1 -- 172.21.15.72:0/2889316235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4810062380 con 0x7f4810068540 2024-03-19T06:00:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.105+0000 7f4807e00700 1 -- 172.21.15.72:0/2889316235 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4800004c30 con 0x7f4810068540 2024-03-19T06:00:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.105+0000 7f4807e00700 1 --2- 172.21.15.72:0/2889316235 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f47f406c680 0x7f47f406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.106+0000 7f4807e00700 1 -- 172.21.15.72:0/2889316235 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f480008cbf0 con 0x7f4810068540 2024-03-19T06:00:01.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.106+0000 7f480ea00700 1 --2- 172.21.15.72:0/2889316235 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f47f406c680 0x7f47f406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:01.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.106+0000 7f480ea00700 1 --2- 172.21.15.72:0/2889316235 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f47f406c680 0x7f47f406eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f47fc005fd0 tx=0x7f47fc005dc0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:01.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.112+0000 7f4807e00700 1 -- 172.21.15.72:0/2889316235 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f48000576c0 con 0x7f4810068540 2024-03-19T06:00:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.331+0000 7f4815000700 1 -- 172.21.15.72:0/2889316235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f48101990e0 con 0x7f4810068540 2024-03-19T06:00:01.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:00:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.332+0000 7f4807e00700 1 -- 172.21.15.72:0/2889316235 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f480005ace0 con 0x7f4810068540 2024-03-19T06:00:01.324 INFO:teuthology.orchestra.run.smithi072.stdout:60129542185 2024-03-19T06:00:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.334+0000 7f4815000700 1 -- 172.21.15.72:0/2889316235 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f47f406c680 msgr2=0x7f47f406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.334+0000 7f4815000700 1 --2- 172.21.15.72:0/2889316235 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f47f406c680 0x7f47f406eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f47fc005fd0 tx=0x7f47fc005dc0 comp rx=0 tx=0).stop 2024-03-19T06:00:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.334+0000 7f4815000700 1 -- 172.21.15.72:0/2889316235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4810068540 msgr2=0x7f4810197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.334+0000 7f4815000700 1 --2- 172.21.15.72:0/2889316235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4810068540 0x7f4810197d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f480000b5c0 tx=0x7f480000be00 comp rx=0 tx=0).stop 2024-03-19T06:00:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.335+0000 7f4815000700 1 -- 172.21.15.72:0/2889316235 shutdown_connections 2024-03-19T06:00:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.335+0000 7f4815000700 1 --2- 172.21.15.72:0/2889316235 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f47f406c680 0x7f47f406eb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.335+0000 7f4815000700 1 --2- 172.21.15.72:0/2889316235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4810068540 0x7f4810197d80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.335+0000 7f4815000700 1 --2- 172.21.15.72:0/2889316235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4810106120 0x7f48101982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:01.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.335+0000 7f4815000700 1 -- 172.21.15.72:0/2889316235 >> 172.21.15.72:0/2889316235 conn(0x7f4810074fa0 msgr2=0x7f48100fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:01.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.335+0000 7f4815000700 1 -- 172.21.15.72:0/2889316235 shutdown_connections 2024-03-19T06:00:01.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:01.335+0000 7f4815000700 1 -- 172.21.15.72:0/2889316235 wait complete. 2024-03-19T06:00:01.543 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888080 got 146028888082 for osd.4 2024-03-19T06:00:01.544 DEBUG:teuthology.parallel:result is None 2024-03-19T06:00:01.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:00:02.484 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:02 smithi072 ceph-mon[28706]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:02.484 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:02 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2889316235' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-19T06:00:02.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:02 smithi172 ceph-mon[35716]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:02.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:02 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2889316235' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-19T06:00:03.935 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542182 got 60129542185 for osd.1 2024-03-19T06:00:03.935 DEBUG:teuthology.parallel:result is None 2024-03-19T06:00:04.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:04 smithi072 ceph-mon[28706]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:04.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:04 smithi172 ceph-mon[35716]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:05.817 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:00:06.398 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:06 smithi072 ceph-mon[28706]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:06.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:06 smithi172 ceph-mon[35716]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:06.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.680+0000 7fabdca00700 1 -- 172.21.15.72:0/1577815314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabd8100c30 msgr2=0x7fabd8104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:06.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.680+0000 7fabdca00700 1 --2- 172.21.15.72:0/1577815314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabd8100c30 0x7fabd8104c00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009910 tx=0x7fabc0009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:06.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.680+0000 7fabdca00700 1 -- 172.21.15.72:0/1577815314 shutdown_connections 2024-03-19T06:00:06.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.680+0000 7fabdca00700 1 --2- 172.21.15.72:0/1577815314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabd8100c30 0x7fabd8104c00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:06.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.680+0000 7fabdca00700 1 --2- 172.21.15.72:0/1577815314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabd8100290 0x7fabd8100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:06.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.680+0000 7fabdca00700 1 -- 172.21.15.72:0/1577815314 >> 172.21.15.72:0/1577815314 conn(0x7fabd80fbb10 msgr2=0x7fabd80fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:06.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.680+0000 7fabdca00700 1 -- 172.21.15.72:0/1577815314 shutdown_connections 2024-03-19T06:00:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.680+0000 7fabdca00700 1 -- 172.21.15.72:0/1577815314 wait complete. 2024-03-19T06:00:06.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.681+0000 7fabdca00700 1 Processor -- start 2024-03-19T06:00:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.681+0000 7fabdca00700 1 -- start start 2024-03-19T06:00:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.682+0000 7fabdca00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabd8100290 0x7fabd8197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.682+0000 7fabdca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabd8100c30 0x7fabd81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.682+0000 7fabdca00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8198ac0 con 0x7fabd8100c30 2024-03-19T06:00:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.682+0000 7fabdca00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd819c850 con 0x7fabd8100290 2024-03-19T06:00:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.682+0000 7fabcde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabd8100c30 0x7fabd81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.682+0000 7fabcde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabd8100c30 0x7fabd81983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56938/0 (socket says 172.21.15.72:56938) 2024-03-19T06:00:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.682+0000 7fabcde00700 1 -- 172.21.15.72:0/2454948119 learned_addr learned my addr 172.21.15.72:0/2454948119 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.682+0000 7fabd6800700 1 --2- 172.21.15.72:0/2454948119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabd8100290 0x7fabd8197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.683+0000 7fabcde00700 1 -- 172.21.15.72:0/2454948119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabd8100290 msgr2=0x7fabd8197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.683+0000 7fabcde00700 1 --2- 172.21.15.72:0/2454948119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabd8100290 0x7fabd8197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.683+0000 7fabcde00700 1 -- 172.21.15.72:0/2454948119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc00095f0 con 0x7fabd8100c30 2024-03-19T06:00:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.683+0000 7fabcde00700 1 --2- 172.21.15.72:0/2454948119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabd8100c30 0x7fabd81983e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fabc0005f50 tx=0x7fabc000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.683+0000 7fabcfe00700 1 -- 172.21.15.72:0/2454948119 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabc001d070 con 0x7fabd8100c30 2024-03-19T06:00:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.683+0000 7fabcfe00700 1 -- 172.21.15.72:0/2454948119 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fabc000f460 con 0x7fabd8100c30 2024-03-19T06:00:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.683+0000 7fabdca00700 1 -- 172.21.15.72:0/2454948119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd819cad0 con 0x7fabd8100c30 2024-03-19T06:00:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.683+0000 7fabcfe00700 1 -- 172.21.15.72:0/2454948119 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabc0004fd0 con 0x7fabd8100c30 2024-03-19T06:00:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.683+0000 7fabdca00700 1 -- 172.21.15.72:0/2454948119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd819cfc0 con 0x7fabd8100c30 2024-03-19T06:00:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.685+0000 7fabdca00700 1 -- 172.21.15.72:0/2454948119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd8104380 con 0x7fabd8100c30 2024-03-19T06:00:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.685+0000 7fabcfe00700 1 -- 172.21.15.72:0/2454948119 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fabc000f5d0 con 0x7fabd8100c30 2024-03-19T06:00:06.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.686+0000 7fabcfe00700 1 --2- 172.21.15.72:0/2454948119 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fabbc06c680 0x7fabbc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:06.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.686+0000 7fabcfe00700 1 -- 172.21.15.72:0/2454948119 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fabc008c970 con 0x7fabd8100c30 2024-03-19T06:00:06.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.686+0000 7fabd6800700 1 --2- 172.21.15.72:0/2454948119 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fabbc06c680 0x7fabbc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:06.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.687+0000 7fabd6800700 1 --2- 172.21.15.72:0/2454948119 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fabbc06c680 0x7fabbc06eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fabc80060b0 tx=0x7fabc8007b80 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:06.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.691+0000 7fabcfe00700 1 -- 172.21.15.72:0/2454948119 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fabc00572f0 con 0x7fabd8100c30 2024-03-19T06:00:06.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.867+0000 7f368e600700 1 -- 172.21.15.72:0/1414729757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3688100e80 msgr2=0x7f3688104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:06.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.867+0000 7f368e600700 1 --2- 172.21.15.72:0/1414729757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3688100e80 0x7f3688104e50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3674009910 tx=0x7f3674009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:06.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.867+0000 7f368e600700 1 -- 172.21.15.72:0/1414729757 shutdown_connections 2024-03-19T06:00:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.867+0000 7f368e600700 1 --2- 172.21.15.72:0/1414729757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3688100e80 0x7f3688104e50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.867+0000 7f368e600700 1 --2- 172.21.15.72:0/1414729757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36881004e0 0x7f36881008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.867+0000 7f368e600700 1 -- 172.21.15.72:0/1414729757 >> 172.21.15.72:0/1414729757 conn(0x7f36880fbda0 msgr2=0x7f36880fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.867+0000 7f368e600700 1 -- 172.21.15.72:0/1414729757 shutdown_connections 2024-03-19T06:00:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.868+0000 7f368e600700 1 -- 172.21.15.72:0/1414729757 wait complete. 2024-03-19T06:00:06.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.869+0000 7f368e600700 1 Processor -- start 2024-03-19T06:00:06.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.869+0000 7f368e600700 1 -- start start 2024-03-19T06:00:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.869+0000 7f368e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36881004e0 0x7f3688198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.869+0000 7f368e600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3688100e80 0x7f3688198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.869+0000 7f368e600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3688198d30 con 0x7f36881004e0 2024-03-19T06:00:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.869+0000 7f368e600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368819cac0 con 0x7f3688100e80 2024-03-19T06:00:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.870+0000 7f3687400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36881004e0 0x7f3688198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.870+0000 7f3687400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36881004e0 0x7f3688198110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56958/0 (socket says 172.21.15.72:56958) 2024-03-19T06:00:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.870+0000 7f3687400700 1 -- 172.21.15.72:0/2416082424 learned_addr learned my addr 172.21.15.72:0/2416082424 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.870+0000 7f3686a00700 1 --2- 172.21.15.72:0/2416082424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3688100e80 0x7f3688198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.870+0000 7f3687400700 1 -- 172.21.15.72:0/2416082424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3688100e80 msgr2=0x7f3688198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.870+0000 7f3687400700 1 --2- 172.21.15.72:0/2416082424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3688100e80 0x7f3688198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.870+0000 7f3687400700 1 -- 172.21.15.72:0/2416082424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36740095f0 con 0x7f36881004e0 2024-03-19T06:00:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.871+0000 7f3687400700 1 --2- 172.21.15.72:0/2416082424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36881004e0 0x7f3688198110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f367800d8d0 tx=0x7f367800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.871+0000 7f367fe00700 1 -- 172.21.15.72:0/2416082424 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36780098a0 con 0x7f36881004e0 2024-03-19T06:00:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.871+0000 7f367fe00700 1 -- 172.21.15.72:0/2416082424 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3678010460 con 0x7f36881004e0 2024-03-19T06:00:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.871+0000 7f368e600700 1 -- 172.21.15.72:0/2416082424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368819cda0 con 0x7f36881004e0 2024-03-19T06:00:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.871+0000 7f367fe00700 1 -- 172.21.15.72:0/2416082424 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f367800f5f0 con 0x7f36881004e0 2024-03-19T06:00:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.871+0000 7f368e600700 1 -- 172.21.15.72:0/2416082424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368819d2f0 con 0x7f36881004e0 2024-03-19T06:00:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.873+0000 7f368e600700 1 -- 172.21.15.72:0/2416082424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36881045d0 con 0x7f36881004e0 2024-03-19T06:00:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.875+0000 7f367fe00700 1 -- 172.21.15.72:0/2416082424 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3678009a00 con 0x7f36881004e0 2024-03-19T06:00:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.876+0000 7f367fe00700 1 --2- 172.21.15.72:0/2416082424 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f366c06c680 0x7f366c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.877+0000 7f367fe00700 1 -- 172.21.15.72:0/2416082424 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f367808b400 con 0x7f36881004e0 2024-03-19T06:00:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.877+0000 7f3686a00700 1 --2- 172.21.15.72:0/2416082424 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f366c06c680 0x7f366c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.878+0000 7f3686a00700 1 --2- 172.21.15.72:0/2416082424 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f366c06c680 0x7f366c06eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3688199730 tx=0x7f367401a040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:06.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.880+0000 7f367fe00700 1 -- 172.21.15.72:0/2416082424 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3678055f30 con 0x7f36881004e0 2024-03-19T06:00:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.916+0000 7fabdca00700 1 -- 172.21.15.72:0/2454948119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fabd802cc30 con 0x7fabd8100c30 2024-03-19T06:00:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.916+0000 7fabcfe00700 1 -- 172.21.15.72:0/2454948119 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabc0026090 con 0x7fabd8100c30 2024-03-19T06:00:06.909 INFO:teuthology.orchestra.run.smithi072.stdout:167503724556 2024-03-19T06:00:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.919+0000 7fabdca00700 1 -- 172.21.15.72:0/2454948119 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fabbc06c680 msgr2=0x7fabbc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.919+0000 7fabdca00700 1 --2- 172.21.15.72:0/2454948119 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fabbc06c680 0x7fabbc06eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fabc80060b0 tx=0x7fabc8007b80 comp rx=0 tx=0).stop 2024-03-19T06:00:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.919+0000 7fabdca00700 1 -- 172.21.15.72:0/2454948119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabd8100c30 msgr2=0x7fabd81983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.919+0000 7fabdca00700 1 --2- 172.21.15.72:0/2454948119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabd8100c30 0x7fabd81983e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fabc0005f50 tx=0x7fabc000be20 comp rx=0 tx=0).stop 2024-03-19T06:00:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.919+0000 7fabdca00700 1 -- 172.21.15.72:0/2454948119 shutdown_connections 2024-03-19T06:00:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.919+0000 7fabdca00700 1 --2- 172.21.15.72:0/2454948119 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fabbc06c680 0x7fabbc06eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.919+0000 7fabdca00700 1 --2- 172.21.15.72:0/2454948119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabd8100290 0x7fabd8197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.919+0000 7fabdca00700 1 --2- 172.21.15.72:0/2454948119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabd8100c30 0x7fabd81983e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.919+0000 7fabdca00700 1 -- 172.21.15.72:0/2454948119 >> 172.21.15.72:0/2454948119 conn(0x7fabd80fbb10 msgr2=0x7fabd80fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.919+0000 7fabdca00700 1 -- 172.21.15.72:0/2454948119 shutdown_connections 2024-03-19T06:00:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:06.920+0000 7fabdca00700 1 -- 172.21.15.72:0/2454948119 wait complete. 2024-03-19T06:00:07.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.103+0000 7f368e600700 1 -- 172.21.15.72:0/2416082424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f368804f2a0 con 0x7f36881004e0 2024-03-19T06:00:07.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.103+0000 7f367fe00700 1 -- 172.21.15.72:0/2416082424 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3678059550 con 0x7f36881004e0 2024-03-19T06:00:07.096 INFO:teuthology.orchestra.run.smithi072.stdout:81604378658 2024-03-19T06:00:07.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.106+0000 7f368e600700 1 -- 172.21.15.72:0/2416082424 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f366c06c680 msgr2=0x7f366c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:07.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.106+0000 7f368e600700 1 --2- 172.21.15.72:0/2416082424 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f366c06c680 0x7f366c06eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3688199730 tx=0x7f367401a040 comp rx=0 tx=0).stop 2024-03-19T06:00:07.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.106+0000 7f368e600700 1 -- 172.21.15.72:0/2416082424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36881004e0 msgr2=0x7f3688198110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:07.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.106+0000 7f368e600700 1 --2- 172.21.15.72:0/2416082424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36881004e0 0x7f3688198110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f367800d8d0 tx=0x7f367800dbe0 comp rx=0 tx=0).stop 2024-03-19T06:00:07.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.106+0000 7f368e600700 1 -- 172.21.15.72:0/2416082424 shutdown_connections 2024-03-19T06:00:07.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.106+0000 7f368e600700 1 --2- 172.21.15.72:0/2416082424 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f366c06c680 0x7f366c06eb30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:07.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.106+0000 7f368e600700 1 --2- 172.21.15.72:0/2416082424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36881004e0 0x7f3688198110 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:07.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.106+0000 7f368e600700 1 --2- 172.21.15.72:0/2416082424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3688100e80 0x7f3688198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:07.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.106+0000 7f368e600700 1 -- 172.21.15.72:0/2416082424 >> 172.21.15.72:0/2416082424 conn(0x7f36880fbda0 msgr2=0x7f36880fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:07.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.107+0000 7f368e600700 1 -- 172.21.15.72:0/2416082424 shutdown_connections 2024-03-19T06:00:07.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:07.107+0000 7f368e600700 1 -- 172.21.15.72:0/2416082424 wait complete. 2024-03-19T06:00:07.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:07 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2454948119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-19T06:00:07.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:07 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2416082424' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-19T06:00:07.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:07 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2454948119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-19T06:00:07.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:07 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2416082424' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-19T06:00:07.946 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724554 got 167503724556 for osd.5 2024-03-19T06:00:07.946 DEBUG:teuthology.parallel:result is None 2024-03-19T06:00:08.465 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:08 smithi072 ceph-mon[28706]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:08.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:08 smithi172 ceph-mon[35716]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:09.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.479+0000 7f1ee3800700 1 -- 172.21.15.72:0/3138165453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1edc0ff8c0 msgr2=0x7f1edc10c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:09.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.479+0000 7f1ee3800700 1 --2- 172.21.15.72:0/3138165453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1edc0ff8c0 0x7f1edc10c620 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009910 tx=0x7f1ec8009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:09.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.479+0000 7f1ee3800700 1 -- 172.21.15.72:0/3138165453 shutdown_connections 2024-03-19T06:00:09.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.479+0000 7f1ee3800700 1 --2- 172.21.15.72:0/3138165453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1edc0ff8c0 0x7f1edc10c620 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:09.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.479+0000 7f1ee3800700 1 --2- 172.21.15.72:0/3138165453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1edc0fefb0 0x7f1edc0ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:09.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.479+0000 7f1ee3800700 1 -- 172.21.15.72:0/3138165453 >> 172.21.15.72:0/3138165453 conn(0x7f1edc0fac60 msgr2=0x7f1edc0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:09.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.479+0000 7f1ee3800700 1 -- 172.21.15.72:0/3138165453 shutdown_connections 2024-03-19T06:00:09.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.479+0000 7f1ee3800700 1 -- 172.21.15.72:0/3138165453 wait complete. 2024-03-19T06:00:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.480+0000 7f1ee3800700 1 Processor -- start 2024-03-19T06:00:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.481+0000 7f1ee3800700 1 -- start start 2024-03-19T06:00:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.481+0000 7f1ee3800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1edc0fefb0 0x7f1edc198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.481+0000 7f1ee3800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1edc0ff8c0 0x7f1edc198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.481+0000 7f1ee3800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc198c60 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.481+0000 7f1ee3800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc19c9f0 con 0x7f1edc0fefb0 2024-03-19T06:00:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.481+0000 7f1edbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1edc0ff8c0 0x7f1edc198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.482+0000 7f1edbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1edc0ff8c0 0x7f1edc198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56976/0 (socket says 172.21.15.72:56976) 2024-03-19T06:00:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.482+0000 7f1edbe00700 1 -- 172.21.15.72:0/4184525304 learned_addr learned my addr 172.21.15.72:0/4184525304 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.482+0000 7f1ee0e00700 1 --2- 172.21.15.72:0/4184525304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1edc0fefb0 0x7f1edc198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.482+0000 7f1edbe00700 1 -- 172.21.15.72:0/4184525304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1edc0fefb0 msgr2=0x7f1edc198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.482+0000 7f1edbe00700 1 --2- 172.21.15.72:0/4184525304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1edc0fefb0 0x7f1edc198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.482+0000 7f1edbe00700 1 -- 172.21.15.72:0/4184525304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec80095f0 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.482+0000 7f1ee0e00700 1 --2- 172.21.15.72:0/4184525304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1edc0fefb0 0x7f1edc198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:00:09.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.483+0000 7f1edbe00700 1 --2- 172.21.15.72:0/4184525304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1edc0ff8c0 0x7f1edc198580 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8006010 tx=0x7f1ec800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:09.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.483+0000 7f1ed9600700 1 -- 172.21.15.72:0/4184525304 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ec801d070 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.483+0000 7f1ed9600700 1 -- 172.21.15.72:0/4184525304 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1ec800f460 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.483+0000 7f1ee3800700 1 -- 172.21.15.72:0/4184525304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1edc19cc70 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.484+0000 7f1ed9600700 1 -- 172.21.15.72:0/4184525304 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ec8021640 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.484+0000 7f1ee3800700 1 -- 172.21.15.72:0/4184525304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1edc19d1c0 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.485+0000 7f1ee3800700 1 -- 172.21.15.72:0/4184525304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc109d90 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.486+0000 7f1ed9600700 1 -- 172.21.15.72:0/4184525304 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f1ec800fab0 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.487+0000 7f1ed9600700 1 --2- 172.21.15.72:0/4184525304 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1ec406c680 0x7f1ec406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.487+0000 7f1ed9600700 1 -- 172.21.15.72:0/4184525304 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f1ec808c830 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.488+0000 7f1ee0e00700 1 --2- 172.21.15.72:0/4184525304 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1ec406c680 0x7f1ec406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:09.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.488+0000 7f1ee0e00700 1 --2- 172.21.15.72:0/4184525304 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1ec406c680 0x7f1ec406eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0005fd0 tx=0x7f1ed0005dc0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:09.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.492+0000 7f1ed9600700 1 -- 172.21.15.72:0/4184525304 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1ec8057230 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.486 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:09 smithi072 ceph-mon[28706]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:09.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:09 smithi172 ceph-mon[35716]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:09.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.709+0000 7f1ee3800700 1 -- 172.21.15.72:0/4184525304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1edc04f2a0 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.710+0000 7f1ed9600700 1 -- 172.21.15.72:0/4184525304 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ec805a850 con 0x7f1edc0ff8c0 2024-03-19T06:00:09.703 INFO:teuthology.orchestra.run.smithi072.stdout:111669149724 2024-03-19T06:00:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.713+0000 7f1ee3800700 1 -- 172.21.15.72:0/4184525304 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1ec406c680 msgr2=0x7f1ec406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.713+0000 7f1ee3800700 1 --2- 172.21.15.72:0/4184525304 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1ec406c680 0x7f1ec406eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0005fd0 tx=0x7f1ed0005dc0 comp rx=0 tx=0).stop 2024-03-19T06:00:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.713+0000 7f1ee3800700 1 -- 172.21.15.72:0/4184525304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1edc0ff8c0 msgr2=0x7f1edc198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.713+0000 7f1ee3800700 1 --2- 172.21.15.72:0/4184525304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1edc0ff8c0 0x7f1edc198580 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8006010 tx=0x7f1ec800be20 comp rx=0 tx=0).stop 2024-03-19T06:00:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.713+0000 7f1ee3800700 1 -- 172.21.15.72:0/4184525304 shutdown_connections 2024-03-19T06:00:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.713+0000 7f1ee3800700 1 --2- 172.21.15.72:0/4184525304 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1ec406c680 0x7f1ec406eb30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.713+0000 7f1ee3800700 1 --2- 172.21.15.72:0/4184525304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1edc0fefb0 0x7f1edc198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.713+0000 7f1ee3800700 1 --2- 172.21.15.72:0/4184525304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1edc0ff8c0 0x7f1edc198580 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.713+0000 7f1ee3800700 1 -- 172.21.15.72:0/4184525304 >> 172.21.15.72:0/4184525304 conn(0x7f1edc0fac60 msgr2=0x7f1edc0fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.713+0000 7f1ee3800700 1 -- 172.21.15.72:0/4184525304 shutdown_connections 2024-03-19T06:00:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:09.713+0000 7f1ee3800700 1 -- 172.21.15.72:0/4184525304 wait complete. 2024-03-19T06:00:10.142 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378655 got 81604378658 for osd.2 2024-03-19T06:00:10.142 DEBUG:teuthology.parallel:result is None 2024-03-19T06:00:10.511 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:10 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/4184525304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-19T06:00:10.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:10 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/4184525304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-19T06:00:10.933 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149722 got 111669149724 for osd.3 2024-03-19T06:00:10.933 DEBUG:teuthology.parallel:result is None 2024-03-19T06:00:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.531+0000 7f3860c00700 1 -- 172.21.15.72:0/1349515412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385c1004e0 msgr2=0x7f385c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.531+0000 7f3860c00700 1 --2- 172.21.15.72:0/1349515412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385c1004e0 0x7f385c1008b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f384c00b0a0 tx=0x7f384c00b3b0 comp rx=0 tx=0).stop 2024-03-19T06:00:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.531+0000 7f3860c00700 1 -- 172.21.15.72:0/1349515412 shutdown_connections 2024-03-19T06:00:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.531+0000 7f3860c00700 1 --2- 172.21.15.72:0/1349515412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f385c100e80 0x7f385c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.531+0000 7f3860c00700 1 --2- 172.21.15.72:0/1349515412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385c1004e0 0x7f385c1008b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.531+0000 7f3860c00700 1 -- 172.21.15.72:0/1349515412 >> 172.21.15.72:0/1349515412 conn(0x7f385c0fbda0 msgr2=0x7f385c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.531+0000 7f3860c00700 1 -- 172.21.15.72:0/1349515412 shutdown_connections 2024-03-19T06:00:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.531+0000 7f3860c00700 1 -- 172.21.15.72:0/1349515412 wait complete. 2024-03-19T06:00:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.532+0000 7f3860c00700 1 Processor -- start 2024-03-19T06:00:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.532+0000 7f3860c00700 1 -- start start 2024-03-19T06:00:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.532+0000 7f3860c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385c1004e0 0x7f385c198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.532+0000 7f3860c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f385c100e80 0x7f385c198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.533+0000 7f3860c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c198d40 con 0x7f385c1004e0 2024-03-19T06:00:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.533+0000 7f3860c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c19cad0 con 0x7f385c100e80 2024-03-19T06:00:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.533+0000 7f3859e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385c1004e0 0x7f385c198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.533+0000 7f3859e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385c1004e0 0x7f385c198120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56990/0 (socket says 172.21.15.72:56990) 2024-03-19T06:00:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.533+0000 7f3859e00700 1 -- 172.21.15.72:0/2438188063 learned_addr learned my addr 172.21.15.72:0/2438188063 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.533+0000 7f384be00700 1 --2- 172.21.15.72:0/2438188063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f385c100e80 0x7f385c198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.533+0000 7f3859e00700 1 -- 172.21.15.72:0/2438188063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f385c100e80 msgr2=0x7f385c198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.533+0000 7f3859e00700 1 --2- 172.21.15.72:0/2438188063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f385c100e80 0x7f385c198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.533+0000 7f3859e00700 1 -- 172.21.15.72:0/2438188063 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009d00 con 0x7f385c1004e0 2024-03-19T06:00:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.533+0000 7f3859e00700 1 --2- 172.21.15.72:0/2438188063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385c1004e0 0x7f385c198120 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f384c00b070 tx=0x7f384c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.534+0000 7f3853400700 1 -- 172.21.15.72:0/2438188063 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f384c00e040 con 0x7f385c1004e0 2024-03-19T06:00:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.534+0000 7f3853400700 1 -- 172.21.15.72:0/2438188063 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f384c0044f0 con 0x7f385c1004e0 2024-03-19T06:00:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.534+0000 7f3860c00700 1 -- 172.21.15.72:0/2438188063 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385c19cd50 con 0x7f385c1004e0 2024-03-19T06:00:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.534+0000 7f3853400700 1 -- 172.21.15.72:0/2438188063 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f384c01d9a0 con 0x7f385c1004e0 2024-03-19T06:00:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.534+0000 7f3860c00700 1 -- 172.21.15.72:0/2438188063 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385c19d240 con 0x7f385c1004e0 2024-03-19T06:00:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.535+0000 7f3860c00700 1 -- 172.21.15.72:0/2438188063 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385c1045d0 con 0x7f385c1004e0 2024-03-19T06:00:11.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.536+0000 7f3853400700 1 -- 172.21.15.72:0/2438188063 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f384c004660 con 0x7f385c1004e0 2024-03-19T06:00:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.537+0000 7f3853400700 1 --2- 172.21.15.72:0/2438188063 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f383c06c680 0x7f383c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.537+0000 7f3853400700 1 -- 172.21.15.72:0/2438188063 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f384c08d0d0 con 0x7f385c1004e0 2024-03-19T06:00:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.537+0000 7f384be00700 1 --2- 172.21.15.72:0/2438188063 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f383c06c680 0x7f383c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.538+0000 7f384be00700 1 --2- 172.21.15.72:0/2438188063 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f383c06c680 0x7f383c06eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f385c199740 tx=0x7f3844005cf0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:11.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.542+0000 7f3853400700 1 -- 172.21.15.72:0/2438188063 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f384c057a50 con 0x7f385c1004e0 2024-03-19T06:00:11.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.758+0000 7f3860c00700 1 -- 172.21.15.72:0/2438188063 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f385c04f2a0 con 0x7f385c1004e0 2024-03-19T06:00:11.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.759+0000 7f3853400700 1 -- 172.21.15.72:0/2438188063 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f384c05b070 con 0x7f385c1004e0 2024-03-19T06:00:11.753 INFO:teuthology.orchestra.run.smithi072.stdout:38654705715 2024-03-19T06:00:11.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.763+0000 7f3860c00700 1 -- 172.21.15.72:0/2438188063 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f383c06c680 msgr2=0x7f383c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.763+0000 7f3860c00700 1 --2- 172.21.15.72:0/2438188063 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f383c06c680 0x7f383c06eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f385c199740 tx=0x7f3844005cf0 comp rx=0 tx=0).stop 2024-03-19T06:00:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.763+0000 7f3860c00700 1 -- 172.21.15.72:0/2438188063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385c1004e0 msgr2=0x7f385c198120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:11.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.763+0000 7f3860c00700 1 --2- 172.21.15.72:0/2438188063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385c1004e0 0x7f385c198120 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f384c00b070 tx=0x7f384c00cdb0 comp rx=0 tx=0).stop 2024-03-19T06:00:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.763+0000 7f3860c00700 1 -- 172.21.15.72:0/2438188063 shutdown_connections 2024-03-19T06:00:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.763+0000 7f3860c00700 1 --2- 172.21.15.72:0/2438188063 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f383c06c680 0x7f383c06eb30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.763+0000 7f3860c00700 1 --2- 172.21.15.72:0/2438188063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385c1004e0 0x7f385c198120 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.763+0000 7f3860c00700 1 --2- 172.21.15.72:0/2438188063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f385c100e80 0x7f385c198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.763+0000 7f3860c00700 1 -- 172.21.15.72:0/2438188063 >> 172.21.15.72:0/2438188063 conn(0x7f385c0fbda0 msgr2=0x7f385c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.763+0000 7f3860c00700 1 -- 172.21.15.72:0/2438188063 shutdown_connections 2024-03-19T06:00:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:11.763+0000 7f3860c00700 1 -- 172.21.15.72:0/2438188063 wait complete. 2024-03-19T06:00:12.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:12 smithi072 ceph-mon[28706]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:12.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:12 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2438188063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-19T06:00:12.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:12 smithi172 ceph-mon[35716]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:12.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:12 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2438188063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-19T06:00:12.559 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705713 got 38654705715 for osd.0 2024-03-19T06:00:12.559 DEBUG:teuthology.parallel:result is None 2024-03-19T06:00:12.560 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-19T06:00:12.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph pg dump --format=json 2024-03-19T06:00:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:00:14.285 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:14 smithi072 ceph-mon[28706]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:14.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:14 smithi172 ceph-mon[35716]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:15.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.110+0000 7fe766200700 1 -- 172.21.15.72:0/1041672295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe76010c8f0 msgr2=0x7fe76010ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:15.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.110+0000 7fe766200700 1 --2- 172.21.15.72:0/1041672295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe76010c8f0 0x7fe76010ccc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe750009910 tx=0x7fe750009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:15.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.110+0000 7fe766200700 1 -- 172.21.15.72:0/1041672295 shutdown_connections 2024-03-19T06:00:15.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.110+0000 7fe766200700 1 --2- 172.21.15.72:0/1041672295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe760106b80 0x7fe760106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:15.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.110+0000 7fe766200700 1 --2- 172.21.15.72:0/1041672295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe76010c8f0 0x7fe76010ccc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:15.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.110+0000 7fe766200700 1 -- 172.21.15.72:0/1041672295 >> 172.21.15.72:0/1041672295 conn(0x7fe760076060 msgr2=0x7fe760078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:15.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.110+0000 7fe766200700 1 -- 172.21.15.72:0/1041672295 shutdown_connections 2024-03-19T06:00:15.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.110+0000 7fe766200700 1 -- 172.21.15.72:0/1041672295 wait complete. 2024-03-19T06:00:15.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.111+0000 7fe766200700 1 Processor -- start 2024-03-19T06:00:15.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.111+0000 7fe766200700 1 -- start start 2024-03-19T06:00:15.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.112+0000 7fe766200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe760106b80 0x7fe76019c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:15.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.112+0000 7fe766200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe76010c8f0 0x7fe76019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:15.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.112+0000 7fe766200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76019d120 con 0x7fe76010c8f0 2024-03-19T06:00:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.112+0000 7fe766200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7601a0eb0 con 0x7fe760106b80 2024-03-19T06:00:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.112+0000 7fe75ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe76010c8f0 0x7fe76019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.112+0000 7fe75ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe76010c8f0 0x7fe76019ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52660/0 (socket says 172.21.15.72:52660) 2024-03-19T06:00:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.112+0000 7fe75ea00700 1 -- 172.21.15.72:0/1184300228 learned_addr learned my addr 172.21.15.72:0/1184300228 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.112+0000 7fe75f400700 1 --2- 172.21.15.72:0/1184300228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe760106b80 0x7fe76019c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.112+0000 7fe75ea00700 1 -- 172.21.15.72:0/1184300228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe760106b80 msgr2=0x7fe76019c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.112+0000 7fe75ea00700 1 --2- 172.21.15.72:0/1184300228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe760106b80 0x7fe76019c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.112+0000 7fe75ea00700 1 -- 172.21.15.72:0/1184300228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7500095f0 con 0x7fe76010c8f0 2024-03-19T06:00:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.113+0000 7fe75ea00700 1 --2- 172.21.15.72:0/1184300228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe76010c8f0 0x7fe76019ca40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00d8d0 tx=0x7fe74c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.113+0000 7fe757e00700 1 -- 172.21.15.72:0/1184300228 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe74c009940 con 0x7fe76010c8f0 2024-03-19T06:00:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.113+0000 7fe757e00700 1 -- 172.21.15.72:0/1184300228 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe74c010460 con 0x7fe76010c8f0 2024-03-19T06:00:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.113+0000 7fe766200700 1 -- 172.21.15.72:0/1184300228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7601a1190 con 0x7fe76010c8f0 2024-03-19T06:00:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.113+0000 7fe757e00700 1 -- 172.21.15.72:0/1184300228 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe74c00f5f0 con 0x7fe76010c8f0 2024-03-19T06:00:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.113+0000 7fe766200700 1 -- 172.21.15.72:0/1184300228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7601a16e0 con 0x7fe76010c8f0 2024-03-19T06:00:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.114+0000 7fe766200700 1 -- 172.21.15.72:0/1184300228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe760109b20 con 0x7fe76010c8f0 2024-03-19T06:00:15.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.115+0000 7fe757e00700 1 -- 172.21.15.72:0/1184300228 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe74c0105d0 con 0x7fe76010c8f0 2024-03-19T06:00:15.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.117+0000 7fe757e00700 1 --2- 172.21.15.72:0/1184300228 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe74406c680 0x7fe74406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:15.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.117+0000 7fe757e00700 1 -- 172.21.15.72:0/1184300228 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe74c08b510 con 0x7fe76010c8f0 2024-03-19T06:00:15.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.117+0000 7fe75f400700 1 --2- 172.21.15.72:0/1184300228 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe74406c680 0x7fe74406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:15.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.117+0000 7fe75f400700 1 --2- 172.21.15.72:0/1184300228 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe74406c680 0x7fe74406eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe75000b5c0 tx=0x7fe7500058e0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:15.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.121+0000 7fe757e00700 1 -- 172.21.15.72:0/1184300228 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe74c055f10 con 0x7fe76010c8f0 2024-03-19T06:00:15.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.330+0000 7fe766200700 1 -- 172.21.15.72:0/1184300228 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7601a19c0 con 0x7fe74406c680 2024-03-19T06:00:15.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.334+0000 7fe757e00700 1 -- 172.21.15.72:0/1184300228 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27588 (secure 0 0 0) 0x7fe7601a19c0 con 0x7fe74406c680 2024-03-19T06:00:15.328 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.337+0000 7fe766200700 1 -- 172.21.15.72:0/1184300228 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe74406c680 msgr2=0x7fe74406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.337+0000 7fe766200700 1 --2- 172.21.15.72:0/1184300228 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe74406c680 0x7fe74406eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe75000b5c0 tx=0x7fe7500058e0 comp rx=0 tx=0).stop 2024-03-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.337+0000 7fe766200700 1 -- 172.21.15.72:0/1184300228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe76010c8f0 msgr2=0x7fe76019ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.337+0000 7fe766200700 1 --2- 172.21.15.72:0/1184300228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe76010c8f0 0x7fe76019ca40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00d8d0 tx=0x7fe74c00dc90 comp rx=0 tx=0).stop 2024-03-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.337+0000 7fe766200700 1 -- 172.21.15.72:0/1184300228 shutdown_connections 2024-03-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.337+0000 7fe766200700 1 --2- 172.21.15.72:0/1184300228 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe74406c680 0x7fe74406eb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.337+0000 7fe766200700 1 --2- 172.21.15.72:0/1184300228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe760106b80 0x7fe76019c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.337+0000 7fe766200700 1 --2- 172.21.15.72:0/1184300228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe76010c8f0 0x7fe76019ca40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.337+0000 7fe766200700 1 -- 172.21.15.72:0/1184300228 >> 172.21.15.72:0/1184300228 conn(0x7fe760076060 msgr2=0x7fe760077aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.338+0000 7fe766200700 1 -- 172.21.15.72:0/1184300228 shutdown_connections 2024-03-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:15.338+0000 7fe766200700 1 -- 172.21.15.72:0/1184300228 wait complete. 2024-03-19T06:00:15.332 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-19T06:00:16.237 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-03-19T06:00:14.617032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003403"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-19T05:59:11.227373+0000","last_change":"2024-03-19T05:58:36.681063+0000","last_active":"2024-03-19T05:59:11.227373+0000","last_peered":"2024-03-19T05:59:11.227373+0000","last_clean":"2024-03-19T05:59:11.227373+0000","last_became_active":"2024-03-19T05:58:36.680608+0000","last_became_peered":"2024-03-19T05:58:36.680608+0000","last_unstale":"2024-03-19T05:59:11.227373+0000","last_undegraded":"2024-03-19T05:59:11.227373+0000","last_fullsized":"2024-03-19T05:59:11.227373+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T05:57:27.222989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T05:57:27.222989+0000","last_clean_scrub_stamp":"2024-03-19T05:57:27.222989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:50:52.767669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888085,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 19 05:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.83299999999999996}]},{"osd":1,"last update":"Tue Mar 19 05:59:38 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.268}]},{"osd":2,"last update":"Tue Mar 19 05:59:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.359},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.099}]},{"osd":3,"last update":"Tue Mar 19 05:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":1.115}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149726,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 19 06:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.94999999999999996,"15min":0.94599999999999995},"min":{"1min":0.58499999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.877},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.95499999999999996,"15min":0.95099999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.304,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.181}]},{"osd":1,"last update":"Tue Mar 19 06:00:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.995,"15min":0.98899999999999999},"min":{"1min":0.69899999999999995,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1,"5min":0.97499999999999998,"15min":0.97099999999999997},"min":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.95499999999999996}]},{"osd":2,"last update":"Tue Mar 19 06:00:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.456,"5min":1.49,"15min":1.49},"last":1.292},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.175,"15min":1.175},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.1379999999999999}]},{"osd":4,"last update":"Tue Mar 19 05:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.466}]},{"osd":5,"last update":"Tue Mar 19 06:00:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.363},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.79300000000000004}]}]},{"osd":2,"up_from":19,"seq":81604378660,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 19 05:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.66900000000000004,"5min":0.316,"15min":0.316},"max":{"1min":0.98499999999999999,"5min":1.145,"15min":1.145},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.84399999999999997,"15min":0.83799999999999997},"min":{"1min":0.67200000000000004,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.046,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.1080000000000001}]},{"osd":1,"last update":"Tue Mar 19 05:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.877,"15min":0.871},"min":{"1min":0.64600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.173,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.96199999999999997,"15min":0.95199999999999996},"min":{"1min":0.67000000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1899999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.85499999999999998}]},{"osd":3,"last update":"Tue Mar 19 06:00:03 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.081,"15min":1.087},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.292,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.109,"5min":1.097,"15min":1.095},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.4390000000000001,"5min":1.601,"15min":1.601},"last":1.25}]},{"osd":4,"last update":"Tue Mar 19 05:59:36 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.383}]},{"osd":5,"last update":"Tue Mar 19 06:00:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.343}]}]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 19 05:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.69899999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.76400000000000001,"15min":0.72599999999999998},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.77400000000000002}]},{"osd":2,"last update":"Tue Mar 19 05:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.85099999999999998,"15min":0.83399999999999996},"min":{"1min":0.54300000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.89300000000000002,"15min":0.88300000000000001},"min":{"1min":0.61499999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.133,"5min":1.179,"15min":1.179},"last":0.83399999999999996}]},{"osd":3,"last update":"Tue Mar 19 06:00:07 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0700000000000001,"15min":1.0680000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.246},{"interface":"front","average":{"1min":1.103,"5min":1.046,"15min":1.036},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.149}]},{"osd":4,"last update":"Tue Mar 19 05:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.282},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 19 05:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.84999999999999998,"15min":0.84799999999999998},"min":{"1min":0.55900000000000005,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.3660000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.80600000000000005,"15min":0.76400000000000001},"min":{"1min":0.52700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.95199999999999996}]},{"osd":2,"last update":"Tue Mar 19 05:59:31 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.84599999999999997,"15min":0.83399999999999996},"min":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.48},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.90500000000000003,"15min":0.89200000000000002},"min":{"1min":0.51900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.21}]},{"osd":3,"last update":"Tue Mar 19 05:59:06 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.05},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.397}]},{"osd":4,"last update":"Tue Mar 19 05:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:00:16.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph pg dump --format=json 2024-03-19T06:00:16.307 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:16 smithi072 ceph-mon[28706]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:16.307 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:00:16.307 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:00:16.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:16 smithi172 ceph-mon[35716]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:16.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:00:16.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:00:16.626 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:00:17.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:17 smithi072 ceph-mon[28706]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-19T06:00:17.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:17 smithi172 ceph-mon[35716]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-19T06:00:18.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:18 smithi072 ceph-mon[28706]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:18.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:18 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:00:18.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:18 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:00:18.306 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:18 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:18.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:18 smithi172 ceph-mon[35716]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:18.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:18 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:00:18.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:18 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:00:18.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:18 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.162+0000 7f779be00700 1 -- 172.21.15.72:0/296122059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779c101b20 msgr2=0x7f779c10a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:19.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.162+0000 7f779be00700 1 --2- 172.21.15.72:0/296122059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779c101b20 0x7f779c10a020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7784009910 tx=0x7f7784009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:19.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.162+0000 7f779be00700 1 -- 172.21.15.72:0/296122059 shutdown_connections 2024-03-19T06:00:19.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.162+0000 7f779be00700 1 --2- 172.21.15.72:0/296122059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779c101b20 0x7f779c10a020 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:19.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.162+0000 7f779be00700 1 --2- 172.21.15.72:0/296122059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f779c101210 0x7f779c1015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:19.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.162+0000 7f779be00700 1 -- 172.21.15.72:0/296122059 >> 172.21.15.72:0/296122059 conn(0x7f779c0faa30 msgr2=0x7f779c0fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:19.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.162+0000 7f779be00700 1 -- 172.21.15.72:0/296122059 shutdown_connections 2024-03-19T06:00:19.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.162+0000 7f779be00700 1 -- 172.21.15.72:0/296122059 wait complete. 2024-03-19T06:00:19.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.163+0000 7f779be00700 1 Processor -- start 2024-03-19T06:00:19.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.163+0000 7f779be00700 1 -- start start 2024-03-19T06:00:19.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.164+0000 7f779be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f779c101210 0x7f779c0fee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:19.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.164+0000 7f779be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779c101b20 0x7f779c0ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.164+0000 7f779be00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0ff8f0 con 0x7f779c101b20 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.164+0000 7f779be00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0ffa30 con 0x7f779c101210 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.164+0000 7f7793e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779c101b20 0x7f779c0ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.164+0000 7f7793e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779c101b20 0x7f779c0ff3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52684/0 (socket says 172.21.15.72:52684) 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.164+0000 7f7793e00700 1 -- 172.21.15.72:0/3976048919 learned_addr learned my addr 172.21.15.72:0/3976048919 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.164+0000 7f779aa00700 1 --2- 172.21.15.72:0/3976048919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f779c101210 0x7f779c0fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.164+0000 7f7793e00700 1 -- 172.21.15.72:0/3976048919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f779c101210 msgr2=0x7f779c0fee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.164+0000 7f7793e00700 1 --2- 172.21.15.72:0/3976048919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f779c101210 0x7f779c0fee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.164+0000 7f7793e00700 1 -- 172.21.15.72:0/3976048919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77840095f0 con 0x7f779c101b20 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.164+0000 7f779aa00700 1 --2- 172.21.15.72:0/3976048919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f779c101210 0x7f779c0fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.165+0000 7f7793e00700 1 --2- 172.21.15.72:0/3976048919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779c101b20 0x7f779c0ff3b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7784006010 tx=0x7f778400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.165+0000 7f7793400700 1 -- 172.21.15.72:0/3976048919 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f778401d070 con 0x7f779c101b20 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.165+0000 7f7793400700 1 -- 172.21.15.72:0/3976048919 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f778400f460 con 0x7f779c101b20 2024-03-19T06:00:19.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.165+0000 7f779be00700 1 -- 172.21.15.72:0/3976048919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c0ffcb0 con 0x7f779c101b20 2024-03-19T06:00:19.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.165+0000 7f7793400700 1 -- 172.21.15.72:0/3976048919 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7784017630 con 0x7f779c101b20 2024-03-19T06:00:19.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.165+0000 7f779be00700 1 -- 172.21.15.72:0/3976048919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c1a20d0 con 0x7f779c101b20 2024-03-19T06:00:19.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.166+0000 7f779be00700 1 -- 172.21.15.72:0/3976048919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c107690 con 0x7f779c101b20 2024-03-19T06:00:19.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.167+0000 7f7793400700 1 -- 172.21.15.72:0/3976048919 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f778400f5d0 con 0x7f779c101b20 2024-03-19T06:00:19.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.168+0000 7f7793400700 1 --2- 172.21.15.72:0/3976048919 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f778006c680 0x7f778006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:19.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.168+0000 7f7793400700 1 -- 172.21.15.72:0/3976048919 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f778408ca60 con 0x7f779c101b20 2024-03-19T06:00:19.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.168+0000 7f779aa00700 1 --2- 172.21.15.72:0/3976048919 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f778006c680 0x7f778006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:19.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.169+0000 7f779aa00700 1 --2- 172.21.15.72:0/3976048919 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f778006c680 0x7f778006eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f778c005fd0 tx=0x7f778c005dc0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:19.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.173+0000 7f7793400700 1 -- 172.21.15.72:0/3976048919 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7784057500 con 0x7f779c101b20 2024-03-19T06:00:19.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.386+0000 7f779be00700 1 -- 172.21.15.72:0/3976048919 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f779c02cca0 con 0x7f778006c680 2024-03-19T06:00:19.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.389+0000 7f7793400700 1 -- 172.21.15.72:0/3976048919 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30613 (secure 0 0 0) 0x7f779c02cca0 con 0x7f778006c680 2024-03-19T06:00:19.383 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:00:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.392+0000 7f779be00700 1 -- 172.21.15.72:0/3976048919 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f778006c680 msgr2=0x7f778006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.392+0000 7f779be00700 1 --2- 172.21.15.72:0/3976048919 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f778006c680 0x7f778006eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f778c005fd0 tx=0x7f778c005dc0 comp rx=0 tx=0).stop 2024-03-19T06:00:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.392+0000 7f779be00700 1 -- 172.21.15.72:0/3976048919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779c101b20 msgr2=0x7f779c0ff3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.392+0000 7f779be00700 1 --2- 172.21.15.72:0/3976048919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779c101b20 0x7f779c0ff3b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7784006010 tx=0x7f778400be20 comp rx=0 tx=0).stop 2024-03-19T06:00:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.393+0000 7f779be00700 1 -- 172.21.15.72:0/3976048919 shutdown_connections 2024-03-19T06:00:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.393+0000 7f779be00700 1 --2- 172.21.15.72:0/3976048919 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f778006c680 0x7f778006eb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.393+0000 7f779be00700 1 --2- 172.21.15.72:0/3976048919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f779c101210 0x7f779c0fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.393+0000 7f779be00700 1 --2- 172.21.15.72:0/3976048919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f779c101b20 0x7f779c0ff3b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.393+0000 7f779be00700 1 -- 172.21.15.72:0/3976048919 >> 172.21.15.72:0/3976048919 conn(0x7f779c0faa30 msgr2=0x7f779c1047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.393+0000 7f779be00700 1 -- 172.21.15.72:0/3976048919 shutdown_connections 2024-03-19T06:00:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:19.393+0000 7f779be00700 1 -- 172.21.15.72:0/3976048919 wait complete. 2024-03-19T06:00:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-19T06:00:20.302 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-03-19T06:00:18.617947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003166"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-19T05:59:11.227373+0000","last_change":"2024-03-19T05:58:36.681063+0000","last_active":"2024-03-19T05:59:11.227373+0000","last_peered":"2024-03-19T05:59:11.227373+0000","last_clean":"2024-03-19T05:59:11.227373+0000","last_became_active":"2024-03-19T05:58:36.680608+0000","last_became_peered":"2024-03-19T05:58:36.680608+0000","last_unstale":"2024-03-19T05:59:11.227373+0000","last_undegraded":"2024-03-19T05:59:11.227373+0000","last_fullsized":"2024-03-19T05:59:11.227373+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T05:57:27.222989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T05:57:27.222989+0000","last_clean_scrub_stamp":"2024-03-19T05:57:27.222989+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:50:52.767669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 19 06:00:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.093}]},{"osd":1,"last update":"Tue Mar 19 06:00:12 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Tue Mar 19 06:00:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.4889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.276}]},{"osd":3,"last update":"Tue Mar 19 06:00:12 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.3420000000000001}]},{"osd":4,"last update":"Tue Mar 19 06:00:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.6749999999999998,"5min":2.6749999999999998,"15min":2.6749999999999998},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.2230000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 19 05:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.92900000000000005}]},{"osd":1,"last update":"Tue Mar 19 05:59:38 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.2010000000000001}]},{"osd":2,"last update":"Tue Mar 19 05:59:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.2749999999999999}]},{"osd":3,"last update":"Tue Mar 19 05:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.135},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.83199999999999996}]},{"osd":5,"last update":"Tue Mar 19 06:00:13 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":1.232},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.024}]}]},{"osd":3,"up_from":26,"seq":111669149726,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 19 06:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.94999999999999996,"15min":0.94599999999999995},"min":{"1min":0.58499999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.877},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.95499999999999996,"15min":0.95099999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.304,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.181}]},{"osd":1,"last update":"Tue Mar 19 06:00:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.995,"15min":0.98899999999999999},"min":{"1min":0.69899999999999995,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1,"5min":0.97499999999999998,"15min":0.97099999999999997},"min":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.95499999999999996}]},{"osd":2,"last update":"Tue Mar 19 06:00:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0589999999999999,"15min":1.0569999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.456,"5min":1.49,"15min":1.49},"last":1.292},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.175,"15min":1.175},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.1379999999999999}]},{"osd":4,"last update":"Tue Mar 19 05:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.466}]},{"osd":5,"last update":"Tue Mar 19 06:00:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.363},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.79300000000000004}]}]},{"osd":2,"up_from":19,"seq":81604378661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 19 05:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.66900000000000004,"5min":0.316,"15min":0.316},"max":{"1min":0.98499999999999999,"5min":1.145,"15min":1.145},"last":1.337},{"interface":"front","average":{"1min":0.879,"5min":0.84399999999999997,"15min":0.83799999999999997},"min":{"1min":0.67200000000000004,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.046,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.69399999999999995}]},{"osd":1,"last update":"Tue Mar 19 05:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.877,"15min":0.871},"min":{"1min":0.64600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.173,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.667},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.96199999999999997,"15min":0.95199999999999996},"min":{"1min":0.67000000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1899999999999999,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.1399999999999999}]},{"osd":3,"last update":"Tue Mar 19 06:00:03 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.081,"15min":1.087},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.292,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.109,"5min":1.097,"15min":1.095},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.4390000000000001,"5min":1.601,"15min":1.601},"last":1.9950000000000001}]},{"osd":4,"last update":"Tue Mar 19 05:59:36 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.891},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.2549999999999999}]},{"osd":5,"last update":"Tue Mar 19 06:00:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.486},{"interface":"front","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":2.0430000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 19 05:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.69899999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.76400000000000001,"15min":0.72599999999999998},"min":{"1min":0.44500000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.57399999999999995}]},{"osd":2,"last update":"Tue Mar 19 05:59:29 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.85099999999999998,"15min":0.83399999999999996},"min":{"1min":0.54300000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.89300000000000002,"15min":0.88300000000000001},"min":{"1min":0.61499999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.133,"5min":1.179,"15min":1.179},"last":0.625}]},{"osd":3,"last update":"Tue Mar 19 06:00:07 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0700000000000001,"15min":1.0680000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.103,"5min":1.046,"15min":1.036},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.0680000000000001}]},{"osd":4,"last update":"Tue Mar 19 05:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.0549999999999999}]},{"osd":5,"last update":"Tue Mar 19 06:00:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.92300000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 19 05:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.84999999999999998,"15min":0.84799999999999998},"min":{"1min":0.55900000000000005,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.3660000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.80600000000000005,"15min":0.76400000000000001},"min":{"1min":0.52700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.82899999999999996}]},{"osd":2,"last update":"Tue Mar 19 05:59:31 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.84599999999999997,"15min":0.83399999999999996},"min":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.90500000000000003,"15min":0.89200000000000002},"min":{"1min":0.51900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.169}]},{"osd":3,"last update":"Tue Mar 19 06:00:11 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.0820000000000001,"15min":1.073},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.302},{"interface":"front","average":{"1min":1.278,"5min":1.139,"15min":1.1160000000000001},"min":{"1min":0.83899999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.7080000000000002,"5min":2.7080000000000002,"15min":2.7080000000000002},"last":1.2609999999999999}]},{"osd":4,"last update":"Tue Mar 19 05:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.226}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:00:20.303 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-19T06:00:20.303 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-19T06:00:20.303 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-19T06:00:20.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph health --format=json 2024-03-19T06:00:20.389 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:20 smithi072 ceph-mon[28706]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:20.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:20 smithi172 ceph-mon[35716]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:20.712 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:00:21.229 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:21 smithi072 ceph-mon[28706]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-19T06:00:21.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:21 smithi172 ceph-mon[35716]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-19T06:00:22.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:22 smithi172 ceph-mon[35716]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:22.490 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:22 smithi072 ceph-mon[28706]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:23.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.087+0000 7fb48e200700 1 -- 172.21.15.72:0/2805312336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb488102470 msgr2=0x7fb4881028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:23.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.087+0000 7fb48e200700 1 --2- 172.21.15.72:0/2805312336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb488102470 0x7fb4881028e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb470009910 tx=0x7fb470009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:23.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.087+0000 7fb48e200700 1 -- 172.21.15.72:0/2805312336 shutdown_connections 2024-03-19T06:00:23.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.087+0000 7fb48e200700 1 --2- 172.21.15.72:0/2805312336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb488102470 0x7fb4881028e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:23.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.087+0000 7fb48e200700 1 --2- 172.21.15.72:0/2805312336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb488108470 0x7fb488108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:23.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.087+0000 7fb48e200700 1 -- 172.21.15.72:0/2805312336 >> 172.21.15.72:0/2805312336 conn(0x7fb4880fdf90 msgr2=0x7fb4881003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:23.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.088+0000 7fb48e200700 1 -- 172.21.15.72:0/2805312336 shutdown_connections 2024-03-19T06:00:23.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.088+0000 7fb48e200700 1 -- 172.21.15.72:0/2805312336 wait complete. 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.089+0000 7fb48e200700 1 Processor -- start 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.089+0000 7fb48e200700 1 -- start start 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.089+0000 7fb48e200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb488102470 0x7fb4881981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.089+0000 7fb48e200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb488108470 0x7fb488198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.089+0000 7fb48e200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb488198e10 con 0x7fb488108470 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.089+0000 7fb48e200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48819cba0 con 0x7fb488102470 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.089+0000 7fb47fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb488108470 0x7fb488198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.090+0000 7fb47fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb488108470 0x7fb488198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52702/0 (socket says 172.21.15.72:52702) 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.090+0000 7fb47fe00700 1 -- 172.21.15.72:0/1981068272 learned_addr learned my addr 172.21.15.72:0/1981068272 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.090+0000 7fb487400700 1 --2- 172.21.15.72:0/1981068272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb488102470 0x7fb4881981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.090+0000 7fb47fe00700 1 -- 172.21.15.72:0/1981068272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb488102470 msgr2=0x7fb4881981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.090+0000 7fb47fe00700 1 --2- 172.21.15.72:0/1981068272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb488102470 0x7fb4881981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.090+0000 7fb47fe00700 1 -- 172.21.15.72:0/1981068272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4700095f0 con 0x7fb488108470 2024-03-19T06:00:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.090+0000 7fb47fe00700 1 --2- 172.21.15.72:0/1981068272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb488108470 0x7fb488198730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb47000b5c0 tx=0x7fb47000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.091+0000 7fb484c00700 1 -- 172.21.15.72:0/1981068272 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb47001d070 con 0x7fb488108470 2024-03-19T06:00:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.091+0000 7fb484c00700 1 -- 172.21.15.72:0/1981068272 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb470022470 con 0x7fb488108470 2024-03-19T06:00:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.091+0000 7fb48e200700 1 -- 172.21.15.72:0/1981068272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48819ce20 con 0x7fb488108470 2024-03-19T06:00:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.091+0000 7fb484c00700 1 -- 172.21.15.72:0/1981068272 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb47000f670 con 0x7fb488108470 2024-03-19T06:00:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.091+0000 7fb48e200700 1 -- 172.21.15.72:0/1981068272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48819d310 con 0x7fb488108470 2024-03-19T06:00:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.092+0000 7fb48e200700 1 -- 172.21.15.72:0/1981068272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48810a970 con 0x7fb488108470 2024-03-19T06:00:23.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.093+0000 7fb484c00700 1 -- 172.21.15.72:0/1981068272 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb470004c30 con 0x7fb488108470 2024-03-19T06:00:23.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.094+0000 7fb484c00700 1 --2- 172.21.15.72:0/1981068272 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb46c06c680 0x7fb46c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:23.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.094+0000 7fb484c00700 1 -- 172.21.15.72:0/1981068272 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb47008cc10 con 0x7fb488108470 2024-03-19T06:00:23.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.094+0000 7fb487400700 1 --2- 172.21.15.72:0/1981068272 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb46c06c680 0x7fb46c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:23.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.095+0000 7fb487400700 1 --2- 172.21.15.72:0/1981068272 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb46c06c680 0x7fb46c06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb478005950 tx=0x7fb478005cf0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:23.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.099+0000 7fb484c00700 1 -- 172.21.15.72:0/1981068272 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb470057640 con 0x7fb488108470 2024-03-19T06:00:23.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.361+0000 7fb48e200700 1 -- 172.21.15.72:0/1981068272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb48804f2a0 con 0x7fb488108470 2024-03-19T06:00:23.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.362+0000 7fb484c00700 1 -- 172.21.15.72:0/1981068272 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb47005ac60 con 0x7fb488108470 2024-03-19T06:00:23.355 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:00:23.355 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-19T06:00:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.364+0000 7fb48e200700 1 -- 172.21.15.72:0/1981068272 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb46c06c680 msgr2=0x7fb46c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.364+0000 7fb48e200700 1 --2- 172.21.15.72:0/1981068272 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb46c06c680 0x7fb46c06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb478005950 tx=0x7fb478005cf0 comp rx=0 tx=0).stop 2024-03-19T06:00:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.364+0000 7fb48e200700 1 -- 172.21.15.72:0/1981068272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb488108470 msgr2=0x7fb488198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.364+0000 7fb48e200700 1 --2- 172.21.15.72:0/1981068272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb488108470 0x7fb488198730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb47000b5c0 tx=0x7fb47000be00 comp rx=0 tx=0).stop 2024-03-19T06:00:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.365+0000 7fb48e200700 1 -- 172.21.15.72:0/1981068272 shutdown_connections 2024-03-19T06:00:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.365+0000 7fb48e200700 1 --2- 172.21.15.72:0/1981068272 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb46c06c680 0x7fb46c06eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.365+0000 7fb48e200700 1 --2- 172.21.15.72:0/1981068272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb488102470 0x7fb4881981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.365+0000 7fb48e200700 1 --2- 172.21.15.72:0/1981068272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb488108470 0x7fb488198730 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.365+0000 7fb48e200700 1 -- 172.21.15.72:0/1981068272 >> 172.21.15.72:0/1981068272 conn(0x7fb4880fdf90 msgr2=0x7fb4880ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.365+0000 7fb48e200700 1 -- 172.21.15.72:0/1981068272 shutdown_connections 2024-03-19T06:00:23.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:23.365+0000 7fb48e200700 1 -- 172.21.15.72:0/1981068272 wait complete. 2024-03-19T06:00:24.305 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-19T06:00:24.305 INFO:tasks.cephadm:Setup complete, yielding 2024-03-19T06:00:24.306 INFO:teuthology.run_tasks:Running task print... 2024-03-19T06:00:24.315 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-03-19T06:00:24.315 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-19T06:00:24.324 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T06:00:24.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-03-19T06:00:24.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:24 smithi172 ceph-mon[35716]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:24.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:24 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1981068272' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-19T06:00:24.411 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:24 smithi072 ceph-mon[28706]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:24.411 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:24 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1981068272' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-19T06:00:24.733 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:00:26.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:26 smithi072 ceph-mon[28706]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:26.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:26 smithi172 ceph-mon[35716]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:26.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.867+0000 7fc740c00700 1 -- 172.21.15.72:0/2931759887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73c107870 msgr2=0x7fc73c107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:26.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.867+0000 7fc740c00700 1 --2- 172.21.15.72:0/2931759887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73c107870 0x7fc73c107cc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc724009910 tx=0x7fc724009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:26.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.867+0000 7fc740c00700 1 -- 172.21.15.72:0/2931759887 shutdown_connections 2024-03-19T06:00:26.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.867+0000 7fc740c00700 1 --2- 172.21.15.72:0/2931759887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73c107870 0x7fc73c107cc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:26.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.867+0000 7fc740c00700 1 --2- 172.21.15.72:0/2931759887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc73c106670 0x7fc73c106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:26.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.867+0000 7fc740c00700 1 -- 172.21.15.72:0/2931759887 >> 172.21.15.72:0/2931759887 conn(0x7fc73c075740 msgr2=0x7fc73c077bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:26.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.867+0000 7fc740c00700 1 -- 172.21.15.72:0/2931759887 shutdown_connections 2024-03-19T06:00:26.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.867+0000 7fc740c00700 1 -- 172.21.15.72:0/2931759887 wait complete. 2024-03-19T06:00:26.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.869+0000 7fc740c00700 1 Processor -- start 2024-03-19T06:00:26.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.869+0000 7fc740c00700 1 -- start start 2024-03-19T06:00:26.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.869+0000 7fc740c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73c106670 0x7fc73c19be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:26.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.869+0000 7fc740c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc73c107870 0x7fc73c19c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:26.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.869+0000 7fc740c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c19c9d0 con 0x7fc73c106670 2024-03-19T06:00:26.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.869+0000 7fc740c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c19cb10 con 0x7fc73c107870 2024-03-19T06:00:26.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.869+0000 7fc73b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73c106670 0x7fc73c19be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:26.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.869+0000 7fc73b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73c106670 0x7fc73c19be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57346/0 (socket says 172.21.15.72:57346) 2024-03-19T06:00:26.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.869+0000 7fc73b400700 1 -- 172.21.15.72:0/1510648796 learned_addr learned my addr 172.21.15.72:0/1510648796 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:26.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.870+0000 7fc733e00700 1 --2- 172.21.15.72:0/1510648796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc73c107870 0x7fc73c19c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:26.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.870+0000 7fc73b400700 1 -- 172.21.15.72:0/1510648796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc73c107870 msgr2=0x7fc73c19c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:26.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.870+0000 7fc73b400700 1 --2- 172.21.15.72:0/1510648796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc73c107870 0x7fc73c19c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:26.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.870+0000 7fc73b400700 1 -- 172.21.15.72:0/1510648796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7240095f0 con 0x7fc73c106670 2024-03-19T06:00:26.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.870+0000 7fc73b400700 1 --2- 172.21.15.72:0/1510648796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73c106670 0x7fc73c19be70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00d900 tx=0x7fc72c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:26.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.870+0000 7fc738c00700 1 -- 172.21.15.72:0/1510648796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc72c0041f0 con 0x7fc73c106670 2024-03-19T06:00:26.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.871+0000 7fc738c00700 1 -- 172.21.15.72:0/1510648796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc72c004350 con 0x7fc73c106670 2024-03-19T06:00:26.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.871+0000 7fc740c00700 1 -- 172.21.15.72:0/1510648796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73c1a15c0 con 0x7fc73c106670 2024-03-19T06:00:26.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.871+0000 7fc738c00700 1 -- 172.21.15.72:0/1510648796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc72c003d40 con 0x7fc73c106670 2024-03-19T06:00:26.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.871+0000 7fc740c00700 1 -- 172.21.15.72:0/1510648796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73c1a1b10 con 0x7fc73c106670 2024-03-19T06:00:26.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.872+0000 7fc740c00700 1 -- 172.21.15.72:0/1510648796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73c10f1c0 con 0x7fc73c106670 2024-03-19T06:00:26.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.873+0000 7fc738c00700 1 -- 172.21.15.72:0/1510648796 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc72c009730 con 0x7fc73c106670 2024-03-19T06:00:26.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.874+0000 7fc738c00700 1 --2- 172.21.15.72:0/1510648796 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc72006c680 0x7fc72006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:26.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.874+0000 7fc738c00700 1 -- 172.21.15.72:0/1510648796 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc72c08b740 con 0x7fc73c106670 2024-03-19T06:00:26.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.874+0000 7fc733e00700 1 --2- 172.21.15.72:0/1510648796 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc72006c680 0x7fc72006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:26.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.875+0000 7fc733e00700 1 --2- 172.21.15.72:0/1510648796 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc72006c680 0x7fc72006eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc724000c00 tx=0x7fc724005fb0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:26.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:26.879+0000 7fc738c00700 1 -- 172.21.15.72:0/1510648796 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc72c059b50 con 0x7fc73c106670 2024-03-19T06:00:27.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.090+0000 7fc740c00700 1 -- 172.21.15.72:0/1510648796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fc73c10f380 con 0x7fc73c106670 2024-03-19T06:00:27.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.101+0000 7fc738c00700 1 -- 172.21.15.72:0/1510648796 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fc72c0596e0 con 0x7fc73c106670 2024-03-19T06:00:27.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.104+0000 7fc740c00700 1 -- 172.21.15.72:0/1510648796 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc72006c680 msgr2=0x7fc72006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.104+0000 7fc740c00700 1 --2- 172.21.15.72:0/1510648796 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc72006c680 0x7fc72006eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc724000c00 tx=0x7fc724005fb0 comp rx=0 tx=0).stop 2024-03-19T06:00:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.104+0000 7fc740c00700 1 -- 172.21.15.72:0/1510648796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73c106670 msgr2=0x7fc73c19be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.104+0000 7fc740c00700 1 --2- 172.21.15.72:0/1510648796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73c106670 0x7fc73c19be70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00d900 tx=0x7fc72c00dcc0 comp rx=0 tx=0).stop 2024-03-19T06:00:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.104+0000 7fc740c00700 1 -- 172.21.15.72:0/1510648796 shutdown_connections 2024-03-19T06:00:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.104+0000 7fc740c00700 1 --2- 172.21.15.72:0/1510648796 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc72006c680 0x7fc72006eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.104+0000 7fc740c00700 1 --2- 172.21.15.72:0/1510648796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73c106670 0x7fc73c19be70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.104+0000 7fc740c00700 1 --2- 172.21.15.72:0/1510648796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc73c107870 0x7fc73c19c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.104+0000 7fc740c00700 1 -- 172.21.15.72:0/1510648796 >> 172.21.15.72:0/1510648796 conn(0x7fc73c075740 msgr2=0x7fc73c10aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.105+0000 7fc740c00700 1 -- 172.21.15.72:0/1510648796 shutdown_connections 2024-03-19T06:00:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:27.105+0000 7fc740c00700 1 -- 172.21.15.72:0/1510648796 wait complete. 2024-03-19T06:00:27.970 INFO:teuthology.run_tasks:Running task print... 2024-03-19T06:00:27.985 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-03-19T06:00:27.985 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-19T06:00:27.994 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T06:00:27.994 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph orch status' 2024-03-19T06:00:28.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:28 smithi072 ceph-mon[28706]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:28.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:28 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1510648796' entity='client.admin' 2024-03-19T06:00:28.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:28 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:00:28.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:28 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:00:28.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:28 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:00:28.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:28 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:28.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:28 smithi172 ceph-mon[35716]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:28.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:28 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1510648796' entity='client.admin' 2024-03-19T06:00:28.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:28 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:00:28.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:28 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:00:28.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:28 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:00:28.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:28 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:28.411 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:00:30.175 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:30 smithi072 ceph-mon[28706]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:30.410 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:30 smithi172 ceph-mon[35716]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:30.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.764+0000 7fa257400700 1 -- 172.21.15.72:0/419043462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa250106840 msgr2=0x7fa250106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.764+0000 7fa257400700 1 --2- 172.21.15.72:0/419043462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa250106840 0x7fa250106c50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa244009910 tx=0x7fa244009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.764+0000 7fa257400700 1 -- 172.21.15.72:0/419043462 shutdown_connections 2024-03-19T06:00:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.764+0000 7fa257400700 1 --2- 172.21.15.72:0/419043462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa250107a40 0x7fa250107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.764+0000 7fa257400700 1 --2- 172.21.15.72:0/419043462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa250106840 0x7fa250106c50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.764+0000 7fa257400700 1 -- 172.21.15.72:0/419043462 >> 172.21.15.72:0/419043462 conn(0x7fa250075970 msgr2=0x7fa250077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.764+0000 7fa257400700 1 -- 172.21.15.72:0/419043462 shutdown_connections 2024-03-19T06:00:30.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.764+0000 7fa257400700 1 -- 172.21.15.72:0/419043462 wait complete. 2024-03-19T06:00:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.765+0000 7fa257400700 1 Processor -- start 2024-03-19T06:00:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.765+0000 7fa257400700 1 -- start start 2024-03-19T06:00:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.766+0000 7fa257400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa250106840 0x7fa25019c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.766+0000 7fa257400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa250107a40 0x7fa25019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.766+0000 7fa257400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25019cc60 con 0x7fa250106840 2024-03-19T06:00:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.766+0000 7fa257400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25019cda0 con 0x7fa250107a40 2024-03-19T06:00:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.766+0000 7fa254a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa250106840 0x7fa25019c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.766+0000 7fa254a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa250106840 0x7fa25019c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57356/0 (socket says 172.21.15.72:57356) 2024-03-19T06:00:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.766+0000 7fa254a00700 1 -- 172.21.15.72:0/2878069514 learned_addr learned my addr 172.21.15.72:0/2878069514 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.766+0000 7fa24fe00700 1 --2- 172.21.15.72:0/2878069514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa250107a40 0x7fa25019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.766+0000 7fa254a00700 1 -- 172.21.15.72:0/2878069514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa250107a40 msgr2=0x7fa25019c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.766+0000 7fa254a00700 1 --2- 172.21.15.72:0/2878069514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa250107a40 0x7fa25019c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.766+0000 7fa254a00700 1 -- 172.21.15.72:0/2878069514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2440095f0 con 0x7fa250106840 2024-03-19T06:00:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.767+0000 7fa254a00700 1 --2- 172.21.15.72:0/2878069514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa250106840 0x7fa25019c100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa24400bda0 tx=0x7fa24400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.767+0000 7fa24d600700 1 -- 172.21.15.72:0/2878069514 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa24401d070 con 0x7fa250106840 2024-03-19T06:00:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.767+0000 7fa24d600700 1 -- 172.21.15.72:0/2878069514 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa24400f460 con 0x7fa250106840 2024-03-19T06:00:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.767+0000 7fa24d600700 1 -- 172.21.15.72:0/2878069514 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa244021620 con 0x7fa250106840 2024-03-19T06:00:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.767+0000 7fa257400700 1 -- 172.21.15.72:0/2878069514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2501a17f0 con 0x7fa250106840 2024-03-19T06:00:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.767+0000 7fa257400700 1 -- 172.21.15.72:0/2878069514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2501a1ce0 con 0x7fa250106840 2024-03-19T06:00:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.768+0000 7fa257400700 1 -- 172.21.15.72:0/2878069514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25010f390 con 0x7fa250106840 2024-03-19T06:00:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.769+0000 7fa24d600700 1 -- 172.21.15.72:0/2878069514 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa24400f5d0 con 0x7fa250106840 2024-03-19T06:00:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.770+0000 7fa24d600700 1 --2- 172.21.15.72:0/2878069514 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa23806c680 0x7fa23806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.770+0000 7fa24d600700 1 -- 172.21.15.72:0/2878069514 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa24408c8b0 con 0x7fa250106840 2024-03-19T06:00:30.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.770+0000 7fa24fe00700 1 --2- 172.21.15.72:0/2878069514 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa23806c680 0x7fa23806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:30.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.771+0000 7fa24fe00700 1 --2- 172.21.15.72:0/2878069514 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa23806c680 0x7fa23806eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa23c005950 tx=0x7fa23c0058e0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:30.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:30.775+0000 7fa24d600700 1 -- 172.21.15.72:0/2878069514 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa24405acc0 con 0x7fa250106840 2024-03-19T06:00:31.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.006+0000 7fa257400700 1 -- 172.21.15.72:0/2878069514 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2501a2370 con 0x7fa23806c680 2024-03-19T06:00:31.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.008+0000 7fa24d600700 1 -- 172.21.15.72:0/2878069514 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa2501a2370 con 0x7fa23806c680 2024-03-19T06:00:31.001 INFO:teuthology.orchestra.run.smithi072.stdout:Backend: cephadm 2024-03-19T06:00:31.001 INFO:teuthology.orchestra.run.smithi072.stdout:Available: Yes 2024-03-19T06:00:31.001 INFO:teuthology.orchestra.run.smithi072.stdout:Paused: No 2024-03-19T06:00:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.010+0000 7fa257400700 1 -- 172.21.15.72:0/2878069514 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa23806c680 msgr2=0x7fa23806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.010+0000 7fa257400700 1 --2- 172.21.15.72:0/2878069514 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa23806c680 0x7fa23806eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa23c005950 tx=0x7fa23c0058e0 comp rx=0 tx=0).stop 2024-03-19T06:00:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.010+0000 7fa257400700 1 -- 172.21.15.72:0/2878069514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa250106840 msgr2=0x7fa25019c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.010+0000 7fa257400700 1 --2- 172.21.15.72:0/2878069514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa250106840 0x7fa25019c100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa24400bda0 tx=0x7fa24400be80 comp rx=0 tx=0).stop 2024-03-19T06:00:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.011+0000 7fa257400700 1 -- 172.21.15.72:0/2878069514 shutdown_connections 2024-03-19T06:00:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.011+0000 7fa257400700 1 --2- 172.21.15.72:0/2878069514 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa23806c680 0x7fa23806eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.011+0000 7fa257400700 1 --2- 172.21.15.72:0/2878069514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa250106840 0x7fa25019c100 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:31.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.011+0000 7fa257400700 1 --2- 172.21.15.72:0/2878069514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa250107a40 0x7fa25019c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:31.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.011+0000 7fa257400700 1 -- 172.21.15.72:0/2878069514 >> 172.21.15.72:0/2878069514 conn(0x7fa250075970 msgr2=0x7fa25010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:31.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.011+0000 7fa257400700 1 -- 172.21.15.72:0/2878069514 shutdown_connections 2024-03-19T06:00:31.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:31.011+0000 7fa257400700 1 -- 172.21.15.72:0/2878069514 wait complete. 2024-03-19T06:00:31.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:00:31.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:31 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:00:31.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-19T06:00:32.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:32 smithi072 ceph-mon[28706]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:32.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:32 smithi072 ceph-mon[28706]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:00:32.404 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:00:32.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:32 smithi172 ceph-mon[35716]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:32.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:32 smithi172 ceph-mon[35716]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:00:34.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:34 smithi172 ceph-mon[35716]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:34.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:34 smithi072 ceph-mon[28706]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:34.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.686+0000 7f9ad7400700 1 -- 172.21.15.72:0/1025931484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad0102430 msgr2=0x7f9ad0102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:34.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.686+0000 7f9ad7400700 1 --2- 172.21.15.72:0/1025931484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad0102430 0x7f9ad0102840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009910 tx=0x7f9ac4009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:34.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.686+0000 7f9ad7400700 1 -- 172.21.15.72:0/1025931484 shutdown_connections 2024-03-19T06:00:34.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.686+0000 7f9ad7400700 1 --2- 172.21.15.72:0/1025931484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad01036d0 0x7f9ad0103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:34.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.686+0000 7f9ad7400700 1 --2- 172.21.15.72:0/1025931484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad0102430 0x7f9ad0102840 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:34.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.686+0000 7f9ad7400700 1 -- 172.21.15.72:0/1025931484 >> 172.21.15.72:0/1025931484 conn(0x7f9ad00fda80 msgr2=0x7f9ad00ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:34.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.686+0000 7f9ad7400700 1 -- 172.21.15.72:0/1025931484 shutdown_connections 2024-03-19T06:00:34.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.686+0000 7f9ad7400700 1 -- 172.21.15.72:0/1025931484 wait complete. 2024-03-19T06:00:34.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.687+0000 7f9ad7400700 1 Processor -- start 2024-03-19T06:00:34.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.687+0000 7f9ad7400700 1 -- start start 2024-03-19T06:00:34.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.687+0000 7f9ad7400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad0102430 0x7f9ad0197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:34.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.687+0000 7f9ad7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad01036d0 0x7f9ad0198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:34.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.687+0000 7f9ad7400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad0198890 con 0x7f9ad01036d0 2024-03-19T06:00:34.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.687+0000 7f9ad7400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad01989d0 con 0x7f9ad0102430 2024-03-19T06:00:34.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.688+0000 7f9acfe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad01036d0 0x7f9ad0198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:34.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.688+0000 7f9acfe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad01036d0 0x7f9ad0198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60452/0 (socket says 172.21.15.72:60452) 2024-03-19T06:00:34.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.688+0000 7f9acfe00700 1 -- 172.21.15.72:0/3784388573 learned_addr learned my addr 172.21.15.72:0/3784388573 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:34.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.688+0000 7f9ad4a00700 1 --2- 172.21.15.72:0/3784388573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad0102430 0x7f9ad0197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:34.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.688+0000 7f9acfe00700 1 -- 172.21.15.72:0/3784388573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad0102430 msgr2=0x7f9ad0197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:34.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.688+0000 7f9acfe00700 1 --2- 172.21.15.72:0/3784388573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad0102430 0x7f9ad0197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:34.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.688+0000 7f9acfe00700 1 -- 172.21.15.72:0/3784388573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40095f0 con 0x7f9ad01036d0 2024-03-19T06:00:34.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.688+0000 7f9acfe00700 1 --2- 172.21.15.72:0/3784388573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad01036d0 0x7f9ad0198270 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000b4b0 tx=0x7f9ac000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.689+0000 7f9acd600700 1 -- 172.21.15.72:0/3784388573 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ac0011800 con 0x7f9ad01036d0 2024-03-19T06:00:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.689+0000 7f9acd600700 1 -- 172.21.15.72:0/3784388573 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9ac0011e10 con 0x7f9ad01036d0 2024-03-19T06:00:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.689+0000 7f9ad7400700 1 -- 172.21.15.72:0/3784388573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad019d480 con 0x7f9ad01036d0 2024-03-19T06:00:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.689+0000 7f9acd600700 1 -- 172.21.15.72:0/3784388573 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ac000f2e0 con 0x7f9ad01036d0 2024-03-19T06:00:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.689+0000 7f9ad7400700 1 -- 172.21.15.72:0/3784388573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad019d9d0 con 0x7f9ad01036d0 2024-03-19T06:00:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.690+0000 7f9ad7400700 1 -- 172.21.15.72:0/3784388573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad010af90 con 0x7f9ad01036d0 2024-03-19T06:00:34.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.691+0000 7f9acd600700 1 -- 172.21.15.72:0/3784388573 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9ac0010380 con 0x7f9ad01036d0 2024-03-19T06:00:34.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.692+0000 7f9acd600700 1 --2- 172.21.15.72:0/3784388573 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ab806c680 0x7f9ab806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:34.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.692+0000 7f9acd600700 1 -- 172.21.15.72:0/3784388573 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9ac008b130 con 0x7f9ad01036d0 2024-03-19T06:00:34.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.692+0000 7f9ad4a00700 1 --2- 172.21.15.72:0/3784388573 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ab806c680 0x7f9ab806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:34.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.693+0000 7f9ad4a00700 1 --2- 172.21.15.72:0/3784388573 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ab806c680 0x7f9ab806eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006010 tx=0x7f9ac400b540 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:34.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.697+0000 7f9acd600700 1 -- 172.21.15.72:0/3784388573 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9ac0059670 con 0x7f9ad01036d0 2024-03-19T06:00:34.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.920+0000 7f9ad7400700 1 -- 172.21.15.72:0/3784388573 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ad0108020 con 0x7f9ab806c680 2024-03-19T06:00:34.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.931+0000 7f9acd600700 1 -- 172.21.15.72:0/3784388573 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2820 (secure 0 0 0) 0x7f9ad0108020 con 0x7f9ab806c680 2024-03-19T06:00:34.924 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (4m) 2m ago 6m 14.4M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (7m) 2m ago 7m 7105k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (5m) 83s ago 5m 6941k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (7m) 2m ago 7m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (5m) 83s ago 5m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (4m) 2m ago 6m 74.5M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:9283,8765,8443 running (8m) 2m ago 8m 480M - 18.2.0 dc2bc1663786 af0e8bfc899d 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (5m) 83s ago 5m 436M - 18.2.0 dc2bc1663786 16f76f54583f 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (9m) 2m ago 9m 44.1M 2048M 18.2.0 dc2bc1663786 77289e9e2b33 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (5m) 83s ago 5m 33.2M 2048M 18.2.0 dc2bc1663786 31fba31e7d8a 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (7m) 2m ago 7m 7310k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (5m) 83s ago 5m 7889k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:00:34.925 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (4m) 2m ago 4m 39.9M 3947M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:00:34.926 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (3m) 2m ago 3m 39.7M 3947M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:00:34.926 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (3m) 2m ago 3m 39.4M 3947M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:00:34.926 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (2m) 83s ago 2m 40.4M 4971M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:00:34.926 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (2m) 83s ago 2m 38.2M 4971M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:00:34.926 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (90s) 83s ago 89s 11.0M 4971M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:00:34.926 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (4m) 2m ago 6m 40.7M - 2.43.0 a07b618ecd1d ea7a91af5b4a 2024-03-19T06:00:34.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.934+0000 7f9ad7400700 1 -- 172.21.15.72:0/3784388573 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ab806c680 msgr2=0x7f9ab806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:34.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.934+0000 7f9ad7400700 1 --2- 172.21.15.72:0/3784388573 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ab806c680 0x7f9ab806eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006010 tx=0x7f9ac400b540 comp rx=0 tx=0).stop 2024-03-19T06:00:34.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.934+0000 7f9ad7400700 1 -- 172.21.15.72:0/3784388573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad01036d0 msgr2=0x7f9ad0198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:34.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.934+0000 7f9ad7400700 1 --2- 172.21.15.72:0/3784388573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad01036d0 0x7f9ad0198270 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000b4b0 tx=0x7f9ac000b870 comp rx=0 tx=0).stop 2024-03-19T06:00:34.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.934+0000 7f9ad7400700 1 -- 172.21.15.72:0/3784388573 shutdown_connections 2024-03-19T06:00:34.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.934+0000 7f9ad7400700 1 --2- 172.21.15.72:0/3784388573 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ab806c680 0x7f9ab806eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:34.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.934+0000 7f9ad7400700 1 --2- 172.21.15.72:0/3784388573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad0102430 0x7f9ad0197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:34.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.934+0000 7f9ad7400700 1 --2- 172.21.15.72:0/3784388573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ad01036d0 0x7f9ad0198270 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:34.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.934+0000 7f9ad7400700 1 -- 172.21.15.72:0/3784388573 >> 172.21.15.72:0/3784388573 conn(0x7f9ad00fda80 msgr2=0x7f9ad0106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:34.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.934+0000 7f9ad7400700 1 -- 172.21.15.72:0/3784388573 shutdown_connections 2024-03-19T06:00:34.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:34.934+0000 7f9ad7400700 1 -- 172.21.15.72:0/3784388573 wait complete. 2024-03-19T06:00:35.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph orch ls' 2024-03-19T06:00:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:00:36.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:36 smithi172 ceph-mon[35716]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:36.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:36 smithi172 ceph-mon[35716]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:00:36.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:36 smithi072 ceph-mon[28706]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:36.493 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:36 smithi072 ceph-mon[28706]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:00:38.198 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:38 smithi072 ceph-mon[28706]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:38.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.371+0000 7f8c7de00700 1 -- 172.21.15.72:0/2117307193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c781012c0 msgr2=0x7f8c78101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:38.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.371+0000 7f8c7de00700 1 --2- 172.21.15.72:0/2117307193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c781012c0 0x7f8c78101730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009910 tx=0x7f8c64009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:38.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.371+0000 7f8c7de00700 1 -- 172.21.15.72:0/2117307193 shutdown_connections 2024-03-19T06:00:38.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.371+0000 7f8c7de00700 1 --2- 172.21.15.72:0/2117307193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c781012c0 0x7f8c78101730 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:38.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.371+0000 7f8c7de00700 1 --2- 172.21.15.72:0/2117307193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c78100020 0x7f8c78100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:38.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.371+0000 7f8c7de00700 1 -- 172.21.15.72:0/2117307193 >> 172.21.15.72:0/2117307193 conn(0x7f8c780fb650 msgr2=0x7f8c780fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:38.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.371+0000 7f8c7de00700 1 -- 172.21.15.72:0/2117307193 shutdown_connections 2024-03-19T06:00:38.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.371+0000 7f8c7de00700 1 -- 172.21.15.72:0/2117307193 wait complete. 2024-03-19T06:00:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.372+0000 7f8c7de00700 1 Processor -- start 2024-03-19T06:00:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.372+0000 7f8c7de00700 1 -- start start 2024-03-19T06:00:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.373+0000 7f8c7de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c78100020 0x7f8c78197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.373+0000 7f8c7de00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c781012c0 0x7f8c78197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.373+0000 7f8c7de00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78198560 con 0x7f8c78100020 2024-03-19T06:00:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.373+0000 7f8c7de00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c781986a0 con 0x7f8c781012c0 2024-03-19T06:00:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.373+0000 7f8c7ca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c78100020 0x7f8c78197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.373+0000 7f8c7ca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c78100020 0x7f8c78197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60478/0 (socket says 172.21.15.72:60478) 2024-03-19T06:00:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.373+0000 7f8c7ca00700 1 -- 172.21.15.72:0/2658915329 learned_addr learned my addr 172.21.15.72:0/2658915329 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:38.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.373+0000 7f8c77e00700 1 --2- 172.21.15.72:0/2658915329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c781012c0 0x7f8c78197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.374+0000 7f8c7ca00700 1 -- 172.21.15.72:0/2658915329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c781012c0 msgr2=0x7f8c78197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.374+0000 7f8c7ca00700 1 --2- 172.21.15.72:0/2658915329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c781012c0 0x7f8c78197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.374+0000 7f8c7ca00700 1 -- 172.21.15.72:0/2658915329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c640095f0 con 0x7f8c78100020 2024-03-19T06:00:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.374+0000 7f8c7ca00700 1 --2- 172.21.15.72:0/2658915329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c78100020 0x7f8c78197a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00c8a0 tx=0x7f8c6c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.374+0000 7f8c75600700 1 -- 172.21.15.72:0/2658915329 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c6c00cea0 con 0x7f8c78100020 2024-03-19T06:00:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.374+0000 7f8c75600700 1 -- 172.21.15.72:0/2658915329 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c6c004830 con 0x7f8c78100020 2024-03-19T06:00:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.374+0000 7f8c7de00700 1 -- 172.21.15.72:0/2658915329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7819d150 con 0x7f8c78100020 2024-03-19T06:00:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.374+0000 7f8c75600700 1 -- 172.21.15.72:0/2658915329 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c6c0055b0 con 0x7f8c78100020 2024-03-19T06:00:38.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.374+0000 7f8c7de00700 1 -- 172.21.15.72:0/2658915329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7819d6a0 con 0x7f8c78100020 2024-03-19T06:00:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.375+0000 7f8c7de00700 1 -- 172.21.15.72:0/2658915329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c78108b00 con 0x7f8c78100020 2024-03-19T06:00:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.376+0000 7f8c75600700 1 -- 172.21.15.72:0/2658915329 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f8c6c007ad0 con 0x7f8c78100020 2024-03-19T06:00:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.377+0000 7f8c75600700 1 --2- 172.21.15.72:0/2658915329 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8c6006c680 0x7f8c6006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.377+0000 7f8c75600700 1 -- 172.21.15.72:0/2658915329 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f8c6c08b2a0 con 0x7f8c78100020 2024-03-19T06:00:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.377+0000 7f8c77e00700 1 --2- 172.21.15.72:0/2658915329 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8c6006c680 0x7f8c6006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:38.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.378+0000 7f8c77e00700 1 --2- 172.21.15.72:0/2658915329 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8c6006c680 0x7f8c6006eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c64006010 tx=0x7f8c6400b540 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:38.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.382+0000 7f8c75600700 1 -- 172.21.15.72:0/2658915329 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8c6c059750 con 0x7f8c78100020 2024-03-19T06:00:38.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:38 smithi172 ceph-mon[35716]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:38.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.604+0000 7f8c7de00700 1 -- 172.21.15.72:0/2658915329 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c78074470 con 0x7f8c6006c680 2024-03-19T06:00:38.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.616+0000 7f8c75600700 1 -- 172.21.15.72:0/2658915329 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7f8c78074470 con 0x7f8c6006c680 2024-03-19T06:00:38.609 INFO:teuthology.orchestra.run.smithi072.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-19T06:00:38.609 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager ?:9093,9094 1/1 2m ago 8m count:1 2024-03-19T06:00:38.610 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter 2/2 2m ago 8m * 2024-03-19T06:00:38.610 INFO:teuthology.orchestra.run.smithi072.stdout:crash 2/2 2m ago 8m * 2024-03-19T06:00:38.610 INFO:teuthology.orchestra.run.smithi072.stdout:grafana ?:3000 1/1 2m ago 8m count:1 2024-03-19T06:00:38.610 INFO:teuthology.orchestra.run.smithi072.stdout:mgr 2/2 2m ago 8m count:2 2024-03-19T06:00:38.610 INFO:teuthology.orchestra.run.smithi072.stdout:mon 2/2 2m ago 7m smithi072:172.21.15.72=smithi072;smithi172:172.21.15.172=smithi172;count:2 2024-03-19T06:00:38.610 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter ?:9100 2/2 2m ago 8m * 2024-03-19T06:00:38.610 INFO:teuthology.orchestra.run.smithi072.stdout:osd 6 2m ago - 2024-03-19T06:00:38.610 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus ?:9095 1/1 2m ago 8m count:1 2024-03-19T06:00:38.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.619+0000 7f8c7de00700 1 -- 172.21.15.72:0/2658915329 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8c6006c680 msgr2=0x7f8c6006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:38.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.619+0000 7f8c7de00700 1 --2- 172.21.15.72:0/2658915329 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8c6006c680 0x7f8c6006eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c64006010 tx=0x7f8c6400b540 comp rx=0 tx=0).stop 2024-03-19T06:00:38.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.620+0000 7f8c7de00700 1 -- 172.21.15.72:0/2658915329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c78100020 msgr2=0x7f8c78197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:38.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.620+0000 7f8c7de00700 1 --2- 172.21.15.72:0/2658915329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c78100020 0x7f8c78197a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00c8a0 tx=0x7f8c6c00cc60 comp rx=0 tx=0).stop 2024-03-19T06:00:38.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.620+0000 7f8c7de00700 1 -- 172.21.15.72:0/2658915329 shutdown_connections 2024-03-19T06:00:38.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.620+0000 7f8c7de00700 1 --2- 172.21.15.72:0/2658915329 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8c6006c680 0x7f8c6006eb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:38.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.620+0000 7f8c7de00700 1 --2- 172.21.15.72:0/2658915329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c78100020 0x7f8c78197a00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.620+0000 7f8c7de00700 1 --2- 172.21.15.72:0/2658915329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c781012c0 0x7f8c78197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.620+0000 7f8c7de00700 1 -- 172.21.15.72:0/2658915329 >> 172.21.15.72:0/2658915329 conn(0x7f8c780fb650 msgr2=0x7f8c780fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.620+0000 7f8c7de00700 1 -- 172.21.15.72:0/2658915329 shutdown_connections 2024-03-19T06:00:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:38.620+0000 7f8c7de00700 1 -- 172.21.15.72:0/2658915329 wait complete. 2024-03-19T06:00:39.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-19T06:00:39.801 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:00:40.304 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:40 smithi072 ceph-mon[28706]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:00:40.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:40 smithi072 ceph-mon[28706]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:40.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:40 smithi172 ceph-mon[35716]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:00:40.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:40 smithi172 ceph-mon[35716]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:42.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.071+0000 7f5b7c800700 1 -- 172.21.15.72:0/3653043347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b741036a0 msgr2=0x7f5b74105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:42.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.071+0000 7f5b7c800700 1 --2- 172.21.15.72:0/3653043347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b741036a0 0x7f5b74105a80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009910 tx=0x7f5b64009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.071+0000 7f5b7c800700 1 -- 172.21.15.72:0/3653043347 shutdown_connections 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.071+0000 7f5b7c800700 1 --2- 172.21.15.72:0/3653043347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b741036a0 0x7f5b74105a80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.071+0000 7f5b7c800700 1 --2- 172.21.15.72:0/3653043347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b74100d80 0x7f5b74103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.071+0000 7f5b7c800700 1 -- 172.21.15.72:0/3653043347 >> 172.21.15.72:0/3653043347 conn(0x7f5b740fa7a0 msgr2=0x7f5b740fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.071+0000 7f5b7c800700 1 -- 172.21.15.72:0/3653043347 shutdown_connections 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.071+0000 7f5b7c800700 1 -- 172.21.15.72:0/3653043347 wait complete. 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.072+0000 7f5b7c800700 1 Processor -- start 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.072+0000 7f5b7c800700 1 -- start start 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.072+0000 7f5b7c800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b74100d80 0x7f5b741006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.073+0000 7f5b7c800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b741036a0 0x7f5b740fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.073+0000 7f5b7c800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b740ff270 con 0x7f5b74100d80 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.073+0000 7f5b7c800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b740ff3b0 con 0x7f5b741036a0 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.073+0000 7f5b79e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b74100d80 0x7f5b741006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.073+0000 7f5b79e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b74100d80 0x7f5b741006e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60492/0 (socket says 172.21.15.72:60492) 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.073+0000 7f5b79e00700 1 -- 172.21.15.72:0/3535411662 learned_addr learned my addr 172.21.15.72:0/3535411662 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.073+0000 7f5b79e00700 1 -- 172.21.15.72:0/3535411662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b741036a0 msgr2=0x7f5b740fed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.073+0000 7f5b79400700 1 --2- 172.21.15.72:0/3535411662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b741036a0 0x7f5b740fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.073+0000 7f5b79e00700 1 --2- 172.21.15.72:0/3535411662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b741036a0 0x7f5b740fed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.073+0000 7f5b79e00700 1 -- 172.21.15.72:0/3535411662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b640095f0 con 0x7f5b74100d80 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.073+0000 7f5b79e00700 1 --2- 172.21.15.72:0/3535411662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b74100d80 0x7f5b741006e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c8f0 tx=0x7f5b6800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.074+0000 7f5b6ea00700 1 -- 172.21.15.72:0/3535411662 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b68007a50 con 0x7f5b74100d80 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.074+0000 7f5b6ea00700 1 -- 172.21.15.72:0/3535411662 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b68007bb0 con 0x7f5b74100d80 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.074+0000 7f5b7c800700 1 -- 172.21.15.72:0/3535411662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b740ff690 con 0x7f5b74100d80 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.074+0000 7f5b6ea00700 1 -- 172.21.15.72:0/3535411662 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b68018630 con 0x7f5b74100d80 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.074+0000 7f5b7c800700 1 -- 172.21.15.72:0/3535411662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7419de20 con 0x7f5b74100d80 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.075+0000 7f5b7c800700 1 -- 172.21.15.72:0/3535411662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7418fc00 con 0x7f5b74100d80 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.076+0000 7f5b6ea00700 1 -- 172.21.15.72:0/3535411662 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5b68007d20 con 0x7f5b74100d80 2024-03-19T06:00:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.077+0000 7f5b6ea00700 1 --2- 172.21.15.72:0/3535411662 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f5b5c06c680 0x7f5b5c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:42.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.077+0000 7f5b6ea00700 1 -- 172.21.15.72:0/3535411662 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5b6808b550 con 0x7f5b74100d80 2024-03-19T06:00:42.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.077+0000 7f5b79400700 1 --2- 172.21.15.72:0/3535411662 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f5b5c06c680 0x7f5b5c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:42.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.078+0000 7f5b79400700 1 --2- 172.21.15.72:0/3535411662 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f5b5c06c680 0x7f5b5c06eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400b5c0 tx=0x7f5b64005960 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:42.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.082+0000 7f5b6ea00700 1 -- 172.21.15.72:0/3535411662 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5b680599e0 con 0x7f5b74100d80 2024-03-19T06:00:42.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.304+0000 7f5b7c800700 1 -- 172.21.15.72:0/3535411662 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b74061190 con 0x7f5b5c06c680 2024-03-19T06:00:42.298 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:42 smithi072 ceph-mon[28706]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:42.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.306+0000 7f5b6ea00700 1 -- 172.21.15.72:0/3535411662 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f5b74061190 con 0x7f5b5c06c680 2024-03-19T06:00:42.299 INFO:teuthology.orchestra.run.smithi072.stdout:HOST ADDR LABELS STATUS 2024-03-19T06:00:42.299 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072 172.21.15.72 2024-03-19T06:00:42.299 INFO:teuthology.orchestra.run.smithi072.stdout:smithi172 172.21.15.172 2024-03-19T06:00:42.300 INFO:teuthology.orchestra.run.smithi072.stdout:2 hosts in cluster 2024-03-19T06:00:42.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.309+0000 7f5b7c800700 1 -- 172.21.15.72:0/3535411662 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f5b5c06c680 msgr2=0x7f5b5c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:42.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.309+0000 7f5b7c800700 1 --2- 172.21.15.72:0/3535411662 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f5b5c06c680 0x7f5b5c06eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400b5c0 tx=0x7f5b64005960 comp rx=0 tx=0).stop 2024-03-19T06:00:42.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.309+0000 7f5b7c800700 1 -- 172.21.15.72:0/3535411662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b74100d80 msgr2=0x7f5b741006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:42.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.309+0000 7f5b7c800700 1 --2- 172.21.15.72:0/3535411662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b74100d80 0x7f5b741006e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c8f0 tx=0x7f5b6800ccb0 comp rx=0 tx=0).stop 2024-03-19T06:00:42.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.309+0000 7f5b7c800700 1 -- 172.21.15.72:0/3535411662 shutdown_connections 2024-03-19T06:00:42.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.309+0000 7f5b7c800700 1 --2- 172.21.15.72:0/3535411662 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f5b5c06c680 0x7f5b5c06eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:42.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.309+0000 7f5b7c800700 1 --2- 172.21.15.72:0/3535411662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b74100d80 0x7f5b741006e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:42.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.309+0000 7f5b7c800700 1 --2- 172.21.15.72:0/3535411662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b741036a0 0x7f5b740fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:42.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.309+0000 7f5b7c800700 1 -- 172.21.15.72:0/3535411662 >> 172.21.15.72:0/3535411662 conn(0x7f5b740fa7a0 msgr2=0x7f5b740fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:42.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.309+0000 7f5b7c800700 1 -- 172.21.15.72:0/3535411662 shutdown_connections 2024-03-19T06:00:42.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:42.309+0000 7f5b7c800700 1 -- 172.21.15.72:0/3535411662 wait complete. 2024-03-19T06:00:42.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:42 smithi172 ceph-mon[35716]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:43.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-19T06:00:43.678 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:00:44.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:44 smithi172 ceph-mon[35716]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:00:44.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:44 smithi172 ceph-mon[35716]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:44.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:44 smithi072 ceph-mon[28706]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:00:44.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:44 smithi072 ceph-mon[28706]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:45.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.973+0000 7f30c4c00700 1 -- 172.21.15.72:0/3702226097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c0106840 msgr2=0x7f30c0106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:45.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.973+0000 7f30c4c00700 1 --2- 172.21.15.72:0/3702226097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c0106840 0x7f30c0106c50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009910 tx=0x7f30b0009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:45.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.973+0000 7f30c4c00700 1 -- 172.21.15.72:0/3702226097 shutdown_connections 2024-03-19T06:00:45.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.973+0000 7f30c4c00700 1 --2- 172.21.15.72:0/3702226097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30c0107a40 0x7f30c0107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:45.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.973+0000 7f30c4c00700 1 --2- 172.21.15.72:0/3702226097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c0106840 0x7f30c0106c50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:45.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.973+0000 7f30c4c00700 1 -- 172.21.15.72:0/3702226097 >> 172.21.15.72:0/3702226097 conn(0x7f30c0075970 msgr2=0x7f30c0077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:45.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.973+0000 7f30c4c00700 1 -- 172.21.15.72:0/3702226097 shutdown_connections 2024-03-19T06:00:45.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.973+0000 7f30c4c00700 1 -- 172.21.15.72:0/3702226097 wait complete. 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.974+0000 7f30c4c00700 1 Processor -- start 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.975+0000 7f30c4c00700 1 -- start start 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.975+0000 7f30c4c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c0106840 0x7f30c019c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.975+0000 7f30c4c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30c0107a40 0x7f30c019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.975+0000 7f30c4c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c019cd10 con 0x7f30c0106840 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.975+0000 7f30c4c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c019ce50 con 0x7f30c0107a40 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.975+0000 7f30bde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c0106840 0x7f30c019c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.975+0000 7f30bde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c0106840 0x7f30c019c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53676/0 (socket says 172.21.15.72:53676) 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.975+0000 7f30bde00700 1 -- 172.21.15.72:0/2757521112 learned_addr learned my addr 172.21.15.72:0/2757521112 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.976+0000 7f30bde00700 1 -- 172.21.15.72:0/2757521112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30c0107a40 msgr2=0x7f30c019c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.976+0000 7f30b7e00700 1 --2- 172.21.15.72:0/2757521112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30c0107a40 0x7f30c019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.976+0000 7f30bde00700 1 --2- 172.21.15.72:0/2757521112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30c0107a40 0x7f30c019c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.976+0000 7f30bde00700 1 -- 172.21.15.72:0/2757521112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b00095f0 con 0x7f30c0106840 2024-03-19T06:00:45.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.976+0000 7f30bde00700 1 --2- 172.21.15.72:0/2757521112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c0106840 0x7f30c019c1b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f30b000bd70 tx=0x7f30b000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:45.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.976+0000 7f30b6a00700 1 -- 172.21.15.72:0/2757521112 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30b001d070 con 0x7f30c0106840 2024-03-19T06:00:45.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.976+0000 7f30b6a00700 1 -- 172.21.15.72:0/2757521112 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f30b000f460 con 0x7f30c0106840 2024-03-19T06:00:45.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.976+0000 7f30c4c00700 1 -- 172.21.15.72:0/2757521112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c01a18a0 con 0x7f30c0106840 2024-03-19T06:00:45.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.976+0000 7f30b6a00700 1 -- 172.21.15.72:0/2757521112 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30b0021640 con 0x7f30c0106840 2024-03-19T06:00:45.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.976+0000 7f30c4c00700 1 -- 172.21.15.72:0/2757521112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c01a1d90 con 0x7f30c0106840 2024-03-19T06:00:45.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.978+0000 7f30c4c00700 1 -- 172.21.15.72:0/2757521112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c010f410 con 0x7f30c0106840 2024-03-19T06:00:45.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.979+0000 7f30b6a00700 1 -- 172.21.15.72:0/2757521112 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f30b000fab0 con 0x7f30c0106840 2024-03-19T06:00:45.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.980+0000 7f30b6a00700 1 --2- 172.21.15.72:0/2757521112 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f30a406c680 0x7f30a406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:45.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.980+0000 7f30b6a00700 1 -- 172.21.15.72:0/2757521112 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f30b008c980 con 0x7f30c0106840 2024-03-19T06:00:45.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.980+0000 7f30b7e00700 1 --2- 172.21.15.72:0/2757521112 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f30a406c680 0x7f30a406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:45.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.981+0000 7f30b7e00700 1 --2- 172.21.15.72:0/2757521112 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f30a406c680 0x7f30a406eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f30a8006fd0 tx=0x7f30a8008040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:45.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:45.985+0000 7f30b6a00700 1 -- 172.21.15.72:0/2757521112 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f30b005ae30 con 0x7f30c0106840 2024-03-19T06:00:46.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.212+0000 7f30c4c00700 1 -- 172.21.15.72:0/2757521112 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f30c010c390 con 0x7f30a406c680 2024-03-19T06:00:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.215+0000 7f30b6a00700 1 -- 172.21.15.72:0/2757521112 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f30c010c390 con 0x7f30a406c680 2024-03-19T06:00:46.208 INFO:teuthology.orchestra.run.smithi072.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-19T06:00:46.208 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400V7400BGN 372G No 3m ago LVM detected, locked 2024-03-19T06:00:46.208 INFO:teuthology.orchestra.run.smithi072.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 90s ago LVM detected, locked 2024-03-19T06:00:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.218+0000 7f30c4c00700 1 -- 172.21.15.72:0/2757521112 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f30a406c680 msgr2=0x7f30a406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.218+0000 7f30c4c00700 1 --2- 172.21.15.72:0/2757521112 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f30a406c680 0x7f30a406eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f30a8006fd0 tx=0x7f30a8008040 comp rx=0 tx=0).stop 2024-03-19T06:00:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.218+0000 7f30c4c00700 1 -- 172.21.15.72:0/2757521112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c0106840 msgr2=0x7f30c019c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.218+0000 7f30c4c00700 1 --2- 172.21.15.72:0/2757521112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c0106840 0x7f30c019c1b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f30b000bd70 tx=0x7f30b000be50 comp rx=0 tx=0).stop 2024-03-19T06:00:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.218+0000 7f30c4c00700 1 -- 172.21.15.72:0/2757521112 shutdown_connections 2024-03-19T06:00:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.218+0000 7f30c4c00700 1 --2- 172.21.15.72:0/2757521112 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f30a406c680 0x7f30a406eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.218+0000 7f30c4c00700 1 --2- 172.21.15.72:0/2757521112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c0106840 0x7f30c019c1b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.218+0000 7f30c4c00700 1 --2- 172.21.15.72:0/2757521112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30c0107a40 0x7f30c019c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.218+0000 7f30c4c00700 1 -- 172.21.15.72:0/2757521112 >> 172.21.15.72:0/2757521112 conn(0x7f30c0075970 msgr2=0x7f30c010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.218+0000 7f30c4c00700 1 -- 172.21.15.72:0/2757521112 shutdown_connections 2024-03-19T06:00:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:46.218+0000 7f30c4c00700 1 -- 172.21.15.72:0/2757521112 wait complete. 2024-03-19T06:00:46.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:46 smithi172 ceph-mon[35716]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:46.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:46 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:00:46.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:46 smithi072 ceph-mon[28706]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:46.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:46 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:00:47.129 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-19T06:00:47.139 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T06:00:47.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-03-19T06:00:47.220 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:47 smithi072 ceph-mon[28706]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:00:47.545 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:00:47.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:47 smithi172 ceph-mon[35716]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:00:48.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:48 smithi072 ceph-mon[28706]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:48.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:48 smithi172 ceph-mon[35716]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.986+0000 7f283c200700 1 -- 172.21.15.72:0/1879481272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28340ff420 msgr2=0x7f28340ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:49.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.986+0000 7f283c200700 1 --2- 172.21.15.72:0/1879481272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28340ff420 0x7f28340ff890 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2820009910 tx=0x7f2820009c20 comp rx=0 tx=0).stop 2024-03-19T06:00:49.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.986+0000 7f283c200700 1 -- 172.21.15.72:0/1879481272 shutdown_connections 2024-03-19T06:00:49.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.986+0000 7f283c200700 1 --2- 172.21.15.72:0/1879481272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28340ff420 0x7f28340ff890 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:49.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.986+0000 7f283c200700 1 --2- 172.21.15.72:0/1879481272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28340fead0 0x7f28340feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:49.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.986+0000 7f283c200700 1 -- 172.21.15.72:0/1879481272 >> 172.21.15.72:0/1879481272 conn(0x7f28340fa700 msgr2=0x7f28340fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:49.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.986+0000 7f283c200700 1 -- 172.21.15.72:0/1879481272 shutdown_connections 2024-03-19T06:00:49.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.986+0000 7f283c200700 1 -- 172.21.15.72:0/1879481272 wait complete. 2024-03-19T06:00:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.987+0000 7f283c200700 1 Processor -- start 2024-03-19T06:00:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.987+0000 7f283c200700 1 -- start start 2024-03-19T06:00:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.987+0000 7f283c200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28340fead0 0x7f2834197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.988+0000 7f283c200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28340ff420 0x7f2834198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.988+0000 7f283c200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2834198870 con 0x7f28340ff420 2024-03-19T06:00:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.988+0000 7f283c200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283419d280 con 0x7f28340fead0 2024-03-19T06:00:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.988+0000 7f2838e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28340ff420 0x7f2834198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.988+0000 7f2838e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28340ff420 0x7f2834198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53700/0 (socket says 172.21.15.72:53700) 2024-03-19T06:00:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.988+0000 7f2838e00700 1 -- 172.21.15.72:0/3701569085 learned_addr learned my addr 172.21.15.72:0/3701569085 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.988+0000 7f2839800700 1 --2- 172.21.15.72:0/3701569085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28340fead0 0x7f2834197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.988+0000 7f2838e00700 1 -- 172.21.15.72:0/3701569085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28340fead0 msgr2=0x7f2834197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.988+0000 7f2838e00700 1 --2- 172.21.15.72:0/3701569085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28340fead0 0x7f2834197d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.988+0000 7f2838e00700 1 -- 172.21.15.72:0/3701569085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28200095f0 con 0x7f28340ff420 2024-03-19T06:00:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.989+0000 7f2838e00700 1 --2- 172.21.15.72:0/3701569085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28340ff420 0x7f2834198250 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2820006010 tx=0x7f282000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.989+0000 7f2832000700 1 -- 172.21.15.72:0/3701569085 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f282001d070 con 0x7f28340ff420 2024-03-19T06:00:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.989+0000 7f2832000700 1 -- 172.21.15.72:0/3701569085 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f282000f460 con 0x7f28340ff420 2024-03-19T06:00:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.989+0000 7f283c200700 1 -- 172.21.15.72:0/3701569085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283419d420 con 0x7f28340ff420 2024-03-19T06:00:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.989+0000 7f2832000700 1 -- 172.21.15.72:0/3701569085 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2820021640 con 0x7f28340ff420 2024-03-19T06:00:49.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.989+0000 7f283c200700 1 -- 172.21.15.72:0/3701569085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283419d8e0 con 0x7f28340ff420 2024-03-19T06:00:49.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.990+0000 7f283c200700 1 -- 172.21.15.72:0/3701569085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283410b000 con 0x7f28340ff420 2024-03-19T06:00:49.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.991+0000 7f2832000700 1 -- 172.21.15.72:0/3701569085 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f282000fab0 con 0x7f28340ff420 2024-03-19T06:00:49.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.992+0000 7f2832000700 1 --2- 172.21.15.72:0/3701569085 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f281c06c680 0x7f281c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:49.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.992+0000 7f2832000700 1 -- 172.21.15.72:0/3701569085 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f282008ca30 con 0x7f28340ff420 2024-03-19T06:00:49.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.992+0000 7f2839800700 1 --2- 172.21.15.72:0/3701569085 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f281c06c680 0x7f281c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:49.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.993+0000 7f2839800700 1 --2- 172.21.15.72:0/3701569085 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f281c06c680 0x7f281c06eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2828006fd0 tx=0x7f2828008040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:49.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:49.997+0000 7f2832000700 1 -- 172.21.15.72:0/3701569085 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f28200573b0 con 0x7f28340ff420 2024-03-19T06:00:50.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:50.244+0000 7f283c200700 1 -- 172.21.15.72:0/3701569085 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2834108820 con 0x7f281c06c680 2024-03-19T06:00:50.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:50 smithi072 ceph-mon[28706]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:50.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:50 smithi172 ceph-mon[35716]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:51.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:51 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-03-19T06:00:51.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:51 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-03-19T06:00:52.200 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:52 smithi072 ceph-mon[28706]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:00:52.200 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:52 smithi072 ceph-mon[28706]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:52.200 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:52 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-03-19T06:00:52.200 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:52 smithi072 ceph-mon[28706]: osdmap e41: 6 total, 6 up, 6 in 2024-03-19T06:00:52.200 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:52 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-03-19T06:00:52.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:52.249+0000 7f2832000700 1 -- 172.21.15.72:0/3701569085 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2834108820 con 0x7f281c06c680 2024-03-19T06:00:52.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:52.253+0000 7f283c200700 1 -- 172.21.15.72:0/3701569085 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f281c06c680 msgr2=0x7f281c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:52.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:52.253+0000 7f283c200700 1 --2- 172.21.15.72:0/3701569085 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f281c06c680 0x7f281c06eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2828006fd0 tx=0x7f2828008040 comp rx=0 tx=0).stop 2024-03-19T06:00:52.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:52.253+0000 7f283c200700 1 -- 172.21.15.72:0/3701569085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28340ff420 msgr2=0x7f2834198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:52.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:52.253+0000 7f283c200700 1 --2- 172.21.15.72:0/3701569085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28340ff420 0x7f2834198250 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2820006010 tx=0x7f282000be20 comp rx=0 tx=0).stop 2024-03-19T06:00:52.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:52.253+0000 7f283c200700 1 -- 172.21.15.72:0/3701569085 shutdown_connections 2024-03-19T06:00:52.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:52.253+0000 7f283c200700 1 --2- 172.21.15.72:0/3701569085 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f281c06c680 0x7f281c06eb30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:52.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:52.253+0000 7f283c200700 1 --2- 172.21.15.72:0/3701569085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28340fead0 0x7f2834197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:52.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:52.253+0000 7f283c200700 1 --2- 172.21.15.72:0/3701569085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28340ff420 0x7f2834198250 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:52.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:52.253+0000 7f283c200700 1 -- 172.21.15.72:0/3701569085 >> 172.21.15.72:0/3701569085 conn(0x7f28340fa700 msgr2=0x7f2834107100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:52.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:52.253+0000 7f283c200700 1 -- 172.21.15.72:0/3701569085 shutdown_connections 2024-03-19T06:00:52.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:52.253+0000 7f283c200700 1 -- 172.21.15.72:0/3701569085 wait complete. 2024-03-19T06:00:52.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:52 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072[28701]: 2024-03-19T06:00:52.215+0000 7f8352400700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:00:52.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:52 smithi172 ceph-mon[35716]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:00:52.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:52 smithi172 ceph-mon[35716]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:52.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:52 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-03-19T06:00:52.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:52 smithi172 ceph-mon[35716]: osdmap e41: 6 total, 6 up, 6 in 2024-03-19T06:00:52.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:52 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-03-19T06:00:53.184 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-19T06:00:53.468 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-03-19T06:00:53.468 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: osdmap e42: 6 total, 6 up, 6 in 2024-03-19T06:00:53.468 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-03-19T06:00:53.468 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:00:53.468 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-19T06:00:53.468 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: osdmap e43: 6 total, 6 up, 6 in 2024-03-19T06:00:53.468 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-03-19T06:00:53.469 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: fsmap cephfs:0 2024-03-19T06:00:53.469 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:53.469 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:00:53.469 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:00:53.469 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:00:53.469 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:53.469 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.jhxzfi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:00:53.469 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.jhxzfi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-19T06:00:53.469 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:00:53.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-03-19T06:00:53.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: osdmap e42: 6 total, 6 up, 6 in 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: osdmap e43: 6 total, 6 up, 6 in 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: fsmap cephfs:0 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.jhxzfi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.jhxzfi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-19T06:00:53.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:00:54.287 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:54 smithi072 ceph-mon[28706]: Saving service mds.cephfs spec with placement count:4 2024-03-19T06:00:54.288 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:54 smithi072 ceph-mon[28706]: Deploying daemon mds.cephfs.smithi072.jhxzfi on smithi072 2024-03-19T06:00:54.288 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:54 smithi072 ceph-mon[28706]: pgmap v222: 65 pgs: 3 creating+activating, 13 creating+peering, 7 active+clean, 42 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:54.288 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:54 smithi072 ceph-mon[28706]: osdmap e44: 6 total, 6 up, 6 in 2024-03-19T06:00:54.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:54 smithi172 ceph-mon[35716]: Saving service mds.cephfs spec with placement count:4 2024-03-19T06:00:54.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:54 smithi172 ceph-mon[35716]: Deploying daemon mds.cephfs.smithi072.jhxzfi on smithi072 2024-03-19T06:00:54.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:54 smithi172 ceph-mon[35716]: pgmap v222: 65 pgs: 3 creating+activating, 13 creating+peering, 7 active+clean, 42 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:54.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:54 smithi172 ceph-mon[35716]: osdmap e44: 6 total, 6 up, 6 in 2024-03-19T06:00:55.072 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:00:55.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:55 smithi072 ceph-mon[28706]: osdmap e45: 6 total, 6 up, 6 in 2024-03-19T06:00:55.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:55 smithi072 ceph-mon[28706]: pgmap v225: 65 pgs: 4 creating+activating, 13 creating+peering, 21 active+clean, 27 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:55.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:55 smithi172 ceph-mon[35716]: osdmap e45: 6 total, 6 up, 6 in 2024-03-19T06:00:55.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:55 smithi172 ceph-mon[35716]: pgmap v225: 65 pgs: 4 creating+activating, 13 creating+peering, 21 active+clean, 27 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:57.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.650+0000 7ffb62e00700 1 -- 172.21.15.72:0/755993738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c075fb0 msgr2=0x7ffb5c0769b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:57.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.650+0000 7ffb62e00700 1 --2- 172.21.15.72:0/755993738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c075fb0 0x7ffb5c0769b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400b0a0 tx=0x7ffb4400b3b0 comp rx=0 tx=0).stop 2024-03-19T06:00:57.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.650+0000 7ffb62e00700 1 -- 172.21.15.72:0/755993738 shutdown_connections 2024-03-19T06:00:57.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.650+0000 7ffb62e00700 1 --2- 172.21.15.72:0/755993738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c075fb0 0x7ffb5c0769b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:57.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.650+0000 7ffb62e00700 1 --2- 172.21.15.72:0/755993738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c075660 0x7ffb5c075a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:57.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.650+0000 7ffb62e00700 1 -- 172.21.15.72:0/755993738 >> 172.21.15.72:0/755993738 conn(0x7ffb5c0fda80 msgr2=0x7ffb5c0ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:57.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.650+0000 7ffb62e00700 1 -- 172.21.15.72:0/755993738 shutdown_connections 2024-03-19T06:00:57.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.650+0000 7ffb62e00700 1 -- 172.21.15.72:0/755993738 wait complete. 2024-03-19T06:00:57.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.651+0000 7ffb62e00700 1 Processor -- start 2024-03-19T06:00:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.652+0000 7ffb62e00700 1 -- start start 2024-03-19T06:00:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.652+0000 7ffb62e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c075660 0x7ffb5c19c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.652+0000 7ffb62e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c075fb0 0x7ffb5c19c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.652+0000 7ffb62e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c19cbb0 con 0x7ffb5c075660 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.652+0000 7ffb62e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c19ccf0 con 0x7ffb5c075fb0 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.652+0000 7ffb5be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c075660 0x7ffb5c19c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.652+0000 7ffb5be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c075660 0x7ffb5c19c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55500/0 (socket says 172.21.15.72:55500) 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.652+0000 7ffb5be00700 1 -- 172.21.15.72:0/3532262069 learned_addr learned my addr 172.21.15.72:0/3532262069 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.653+0000 7ffb53400700 1 --2- 172.21.15.72:0/3532262069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c075fb0 0x7ffb5c19c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.653+0000 7ffb5be00700 1 -- 172.21.15.72:0/3532262069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c075fb0 msgr2=0x7ffb5c19c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.653+0000 7ffb5be00700 1 --2- 172.21.15.72:0/3532262069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c075fb0 0x7ffb5c19c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.653+0000 7ffb5be00700 1 -- 172.21.15.72:0/3532262069 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44009d00 con 0x7ffb5c075660 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.653+0000 7ffb53400700 1 --2- 172.21.15.72:0/3532262069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c075fb0 0x7ffb5c19c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.653+0000 7ffb5be00700 1 --2- 172.21.15.72:0/3532262069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c075660 0x7ffb5c19c0e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00c910 tx=0x7ffb4c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.653+0000 7ffb59600700 1 -- 172.21.15.72:0/3532262069 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb4c0041f0 con 0x7ffb5c075660 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.653+0000 7ffb59600700 1 -- 172.21.15.72:0/3532262069 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb4c007db0 con 0x7ffb5c075660 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.653+0000 7ffb62e00700 1 -- 172.21.15.72:0/3532262069 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5c1a17b0 con 0x7ffb5c075660 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.653+0000 7ffb59600700 1 -- 172.21.15.72:0/3532262069 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb4c003d60 con 0x7ffb5c075660 2024-03-19T06:00:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.654+0000 7ffb62e00700 1 -- 172.21.15.72:0/3532262069 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c1a1cd0 con 0x7ffb5c075660 2024-03-19T06:00:57.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.655+0000 7ffb62e00700 1 -- 172.21.15.72:0/3532262069 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c10f2e0 con 0x7ffb5c075660 2024-03-19T06:00:57.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.656+0000 7ffb59600700 1 -- 172.21.15.72:0/3532262069 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ffb4c007900 con 0x7ffb5c075660 2024-03-19T06:00:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.656+0000 7ffb59600700 1 --2- 172.21.15.72:0/3532262069 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ffb4006c680 0x7ffb4006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:00:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.657+0000 7ffb59600700 1 -- 172.21.15.72:0/3532262069 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ffb4c08b5b0 con 0x7ffb5c075660 2024-03-19T06:00:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.657+0000 7ffb53400700 1 --2- 172.21.15.72:0/3532262069 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ffb4006c680 0x7ffb4006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:00:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.657+0000 7ffb53400700 1 --2- 172.21.15.72:0/3532262069 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ffb4006c680 0x7ffb4006eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009480 tx=0x7ffb44000f40 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:00:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.663+0000 7ffb59600700 1 -- 172.21.15.72:0/3532262069 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffb4c059720 con 0x7ffb5c075660 2024-03-19T06:00:57.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.930+0000 7ffb62e00700 1 -- 172.21.15.72:0/3532262069 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb5c1a2370 con 0x7ffb5c075660 2024-03-19T06:00:57.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.931+0000 7ffb59600700 1 -- 172.21.15.72:0/3532262069 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7ffb4c0592b0 con 0x7ffb5c075660 2024-03-19T06:00:57.924 INFO:teuthology.orchestra.run.smithi072.stdout:e2 2024-03-19T06:00:57.925 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:00:57.925 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:00:57.925 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:00:57.925 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:00:57.925 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:00:57.925 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:00:57.925 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 2 2024-03-19T06:00:57.925 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:00:57.925 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:00:57.925 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:00:52.215310+0000 2024-03-19T06:00:57.925 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:00:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:00:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:00:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:00:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:00:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:00:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:00:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:00:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:00:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-03-19T06:00:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:in 2024-03-19T06:00:57.926 INFO:teuthology.orchestra.run.smithi072.stdout:up {} 2024-03-19T06:00:57.927 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:00:57.927 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:00:57.927 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:00:57.927 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:00:57.927 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:00:57.927 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data disabled 2024-03-19T06:00:57.927 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:00:57.927 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:00:57.927 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 0 2024-03-19T06:00:57.927 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:00:57.927 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:00:57.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.934+0000 7ffb62e00700 1 -- 172.21.15.72:0/3532262069 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ffb4006c680 msgr2=0x7ffb4006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:57.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.934+0000 7ffb62e00700 1 --2- 172.21.15.72:0/3532262069 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ffb4006c680 0x7ffb4006eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009480 tx=0x7ffb44000f40 comp rx=0 tx=0).stop 2024-03-19T06:00:57.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.934+0000 7ffb62e00700 1 -- 172.21.15.72:0/3532262069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c075660 msgr2=0x7ffb5c19c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:00:57.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.934+0000 7ffb62e00700 1 --2- 172.21.15.72:0/3532262069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c075660 0x7ffb5c19c0e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00c910 tx=0x7ffb4c00ccd0 comp rx=0 tx=0).stop 2024-03-19T06:00:57.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.934+0000 7ffb62e00700 1 -- 172.21.15.72:0/3532262069 shutdown_connections 2024-03-19T06:00:57.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.934+0000 7ffb62e00700 1 --2- 172.21.15.72:0/3532262069 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ffb4006c680 0x7ffb4006eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:57.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.934+0000 7ffb62e00700 1 --2- 172.21.15.72:0/3532262069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c075660 0x7ffb5c19c0e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:57.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.934+0000 7ffb62e00700 1 --2- 172.21.15.72:0/3532262069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c075fb0 0x7ffb5c19c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:00:57.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.934+0000 7ffb62e00700 1 -- 172.21.15.72:0/3532262069 >> 172.21.15.72:0/3532262069 conn(0x7ffb5c0fda80 msgr2=0x7ffb5c10c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:00:57.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.934+0000 7ffb62e00700 1 -- 172.21.15.72:0/3532262069 shutdown_connections 2024-03-19T06:00:57.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:00:57.934+0000 7ffb62e00700 1 -- 172.21.15.72:0/3532262069 wait complete. 2024-03-19T06:00:57.929 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 2 2024-03-19T06:00:58.250 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:58 smithi072 ceph-mon[28706]: pgmap v226: 65 pgs: 4 creating+activating, 8 creating+peering, 46 active+clean, 7 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:58.250 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:58 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3532262069' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:00:58.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:58 smithi172 ceph-mon[35716]: pgmap v226: 65 pgs: 4 creating+activating, 8 creating+peering, 46 active+clean, 7 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:00:58.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:58 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3532262069' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:00:59.037 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-19T06:00:59.048 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T06:00:59.048 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: mds.? [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] up:boot 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: daemon mds.cephfs.smithi072.jhxzfi assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: Cluster is now healthy 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: fsmap cephfs:0 1 up:standby 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:creating} 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: daemon mds.cephfs.smithi072.jhxzfi is now active in filesystem cephfs as rank 0 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:59.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.xlokxp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:00:59.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.xlokxp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-19T06:00:59.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:00:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:00:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: mds.? [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] up:boot 2024-03-19T06:00:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: daemon mds.cephfs.smithi072.jhxzfi assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-03-19T06:00:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-19T06:00:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-19T06:00:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: Cluster is now healthy 2024-03-19T06:00:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: fsmap cephfs:0 1 up:standby 2024-03-19T06:00:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:00:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:creating} 2024-03-19T06:00:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: daemon mds.cephfs.smithi072.jhxzfi is now active in filesystem cephfs as rank 0 2024-03-19T06:00:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:59.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:00:59.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.xlokxp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:00:59.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.xlokxp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-19T06:00:59.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:00:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:00:59.458 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:01:00.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:00 smithi072 ceph-mon[28706]: Deploying daemon mds.cephfs.smithi172.xlokxp on smithi172 2024-03-19T06:01:00.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:00 smithi072 ceph-mon[28706]: pgmap v227: 65 pgs: 1 creating+activating, 64 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:00.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:00 smithi072 ceph-mon[28706]: mds.? [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] up:active 2024-03-19T06:01:00.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:00 smithi072 ceph-mon[28706]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:active} 2024-03-19T06:01:00.361 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:00 smithi172 ceph-mon[35716]: Deploying daemon mds.cephfs.smithi172.xlokxp on smithi172 2024-03-19T06:01:00.362 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:00 smithi172 ceph-mon[35716]: pgmap v227: 65 pgs: 1 creating+activating, 64 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:00.362 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:00 smithi172 ceph-mon[35716]: mds.? [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] up:active 2024-03-19T06:01:00.362 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:00 smithi172 ceph-mon[35716]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:active} 2024-03-19T06:01:01.238 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:01:01.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:01:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.736+0000 7fce8f000700 1 -- 172.21.15.72:0/837517621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce88074d20 msgr2=0x7fce88073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.736+0000 7fce8f000700 1 --2- 172.21.15.72:0/837517621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce88074d20 0x7fce88073180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fce78009910 tx=0x7fce78009c20 comp rx=0 tx=0).stop 2024-03-19T06:01:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.736+0000 7fce8f000700 1 -- 172.21.15.72:0/837517621 shutdown_connections 2024-03-19T06:01:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.736+0000 7fce8f000700 1 --2- 172.21.15.72:0/837517621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce88073750 0x7fce88073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.736+0000 7fce8f000700 1 --2- 172.21.15.72:0/837517621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce88074d20 0x7fce88073180 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.736+0000 7fce8f000700 1 -- 172.21.15.72:0/837517621 >> 172.21.15.72:0/837517621 conn(0x7fce880fb6e0 msgr2=0x7fce880fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.736+0000 7fce8f000700 1 -- 172.21.15.72:0/837517621 shutdown_connections 2024-03-19T06:01:01.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.736+0000 7fce8f000700 1 -- 172.21.15.72:0/837517621 wait complete. 2024-03-19T06:01:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.737+0000 7fce8f000700 1 Processor -- start 2024-03-19T06:01:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.738+0000 7fce8f000700 1 -- start start 2024-03-19T06:01:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.738+0000 7fce8f000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce88073750 0x7fce88197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.738+0000 7fce8f000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce88074d20 0x7fce88198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.738+0000 7fce8f000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce88198720 con 0x7fce88074d20 2024-03-19T06:01:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.738+0000 7fce8f000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce88198860 con 0x7fce88073750 2024-03-19T06:01:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.738+0000 7fce7f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce88074d20 0x7fce88198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.738+0000 7fce7f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce88074d20 0x7fce88198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55560/0 (socket says 172.21.15.72:55560) 2024-03-19T06:01:01.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.738+0000 7fce7f400700 1 -- 172.21.15.72:0/2847758296 learned_addr learned my addr 172.21.15.72:0/2847758296 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:01.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.739+0000 7fce87e00700 1 --2- 172.21.15.72:0/2847758296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce88073750 0x7fce88197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:01.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.739+0000 7fce7f400700 1 -- 172.21.15.72:0/2847758296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce88073750 msgr2=0x7fce88197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:01.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.739+0000 7fce7f400700 1 --2- 172.21.15.72:0/2847758296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce88073750 0x7fce88197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:01.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.739+0000 7fce7f400700 1 -- 172.21.15.72:0/2847758296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce780095f0 con 0x7fce88074d20 2024-03-19T06:01:01.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.739+0000 7fce7f400700 1 --2- 172.21.15.72:0/2847758296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce88074d20 0x7fce88198100 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fce7000b4b0 tx=0x7fce7000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:01.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.739+0000 7fce85600700 1 -- 172.21.15.72:0/2847758296 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce70011800 con 0x7fce88074d20 2024-03-19T06:01:01.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.739+0000 7fce85600700 1 -- 172.21.15.72:0/2847758296 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fce70011e10 con 0x7fce88074d20 2024-03-19T06:01:01.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.739+0000 7fce85600700 1 -- 172.21.15.72:0/2847758296 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce7000f2e0 con 0x7fce88074d20 2024-03-19T06:01:01.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.739+0000 7fce8f000700 1 -- 172.21.15.72:0/2847758296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8819d310 con 0x7fce88074d20 2024-03-19T06:01:01.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.740+0000 7fce8f000700 1 -- 172.21.15.72:0/2847758296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8819d8e0 con 0x7fce88074d20 2024-03-19T06:01:01.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.741+0000 7fce8f000700 1 -- 172.21.15.72:0/2847758296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8810af10 con 0x7fce88074d20 2024-03-19T06:01:01.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.742+0000 7fce85600700 1 -- 172.21.15.72:0/2847758296 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fce70010380 con 0x7fce88074d20 2024-03-19T06:01:01.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.743+0000 7fce85600700 1 --2- 172.21.15.72:0/2847758296 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fce6c06c680 0x7fce6c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:01.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.743+0000 7fce85600700 1 -- 172.21.15.72:0/2847758296 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fce7008b590 con 0x7fce88074d20 2024-03-19T06:01:01.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.743+0000 7fce87e00700 1 --2- 172.21.15.72:0/2847758296 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fce6c06c680 0x7fce6c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:01.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.744+0000 7fce87e00700 1 --2- 172.21.15.72:0/2847758296 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fce6c06c680 0x7fce6c06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fce78006010 tx=0x7fce7800b580 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:01.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:01.747+0000 7fce85600700 1 -- 172.21.15.72:0/2847758296 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fce70059660 con 0x7fce88074d20 2024-03-19T06:01:02.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.014+0000 7fce8f000700 1 -- 172.21.15.72:0/2847758296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fce8819e320 con 0x7fce88074d20 2024-03-19T06:01:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.141+0000 7fce85600700 1 -- 172.21.15.72:0/2847758296 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fce700591f0 con 0x7fce88074d20 2024-03-19T06:01:02.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.145+0000 7fce8f000700 1 -- 172.21.15.72:0/2847758296 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fce6c06c680 msgr2=0x7fce6c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:02.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.145+0000 7fce8f000700 1 --2- 172.21.15.72:0/2847758296 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fce6c06c680 0x7fce6c06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fce78006010 tx=0x7fce7800b580 comp rx=0 tx=0).stop 2024-03-19T06:01:02.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.145+0000 7fce8f000700 1 -- 172.21.15.72:0/2847758296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce88074d20 msgr2=0x7fce88198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:02.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.145+0000 7fce8f000700 1 --2- 172.21.15.72:0/2847758296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce88074d20 0x7fce88198100 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fce7000b4b0 tx=0x7fce7000b870 comp rx=0 tx=0).stop 2024-03-19T06:01:02.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.146+0000 7fce8f000700 1 -- 172.21.15.72:0/2847758296 shutdown_connections 2024-03-19T06:01:02.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.146+0000 7fce8f000700 1 --2- 172.21.15.72:0/2847758296 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fce6c06c680 0x7fce6c06eb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:02.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.146+0000 7fce8f000700 1 --2- 172.21.15.72:0/2847758296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce88073750 0x7fce88197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:02.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.146+0000 7fce8f000700 1 --2- 172.21.15.72:0/2847758296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce88074d20 0x7fce88198100 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:02.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.146+0000 7fce8f000700 1 -- 172.21.15.72:0/2847758296 >> 172.21.15.72:0/2847758296 conn(0x7fce880fb6e0 msgr2=0x7fce88105f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:02.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.146+0000 7fce8f000700 1 -- 172.21.15.72:0/2847758296 shutdown_connections 2024-03-19T06:01:02.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:02.146+0000 7fce8f000700 1 -- 172.21.15.72:0/2847758296 wait complete. 2024-03-19T06:01:02.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:02 smithi172 ceph-mon[35716]: pgmap v228: 65 pgs: 65 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 639 B/s wr, 2 op/s 2024-03-19T06:01:02.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:02 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2847758296' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-03-19T06:01:02.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:02 smithi072 ceph-mon[28706]: pgmap v228: 65 pgs: 65 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 639 B/s wr, 2 op/s 2024-03-19T06:01:02.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:02 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2847758296' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-03-19T06:01:02.972 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-19T06:01:02.983 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T06:01:02.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-03-19T06:01:03.297 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-19T06:01:03.297 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: mds.? [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] up:boot 2024-03-19T06:01:03.297 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2847758296' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-03-19T06:01:03.297 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: daemon mds.cephfs.smithi172.xlokxp assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-19T06:01:03.297 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-03-19T06:01:03.297 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-19T06:01:03.297 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:active} 1 up:standby 2024-03-19T06:01:03.297 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:01:03.297 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:creating} 2024-03-19T06:01:03.297 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:03.298 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: daemon mds.cephfs.smithi172.xlokxp is now active in filesystem cephfs as rank 1 2024-03-19T06:01:03.298 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:03.298 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:03.298 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.dvdjwb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:01:03.298 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.dvdjwb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-19T06:01:03.298 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:01:03.298 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:03 smithi072 ceph-mon[28706]: Deploying daemon mds.cephfs.smithi072.dvdjwb on smithi072 2024-03-19T06:01:03.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-19T06:01:03.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: mds.? [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] up:boot 2024-03-19T06:01:03.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2847758296' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-03-19T06:01:03.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: daemon mds.cephfs.smithi172.xlokxp assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-19T06:01:03.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-03-19T06:01:03.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-19T06:01:03.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:active} 1 up:standby 2024-03-19T06:01:03.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:01:03.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:creating} 2024-03-19T06:01:03.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:03.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: daemon mds.cephfs.smithi172.xlokxp is now active in filesystem cephfs as rank 1 2024-03-19T06:01:03.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:03.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:03.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.dvdjwb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:01:03.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.dvdjwb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-19T06:01:03.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:01:03.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:03 smithi172 ceph-mon[35716]: Deploying daemon mds.cephfs.smithi072.dvdjwb on smithi072 2024-03-19T06:01:04.524 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:04 smithi072 ceph-mon[28706]: pgmap v229: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-03-19T06:01:04.524 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:04 smithi072 ceph-mon[28706]: mds.? [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] up:active 2024-03-19T06:01:04.524 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:04 smithi072 ceph-mon[28706]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2024-03-19T06:01:04.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:04 smithi172 ceph-mon[35716]: pgmap v229: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-03-19T06:01:04.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:04 smithi172 ceph-mon[35716]: mds.? [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] up:active 2024-03-19T06:01:04.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:04 smithi172 ceph-mon[35716]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2024-03-19T06:01:04.663 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:01:06.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:06 smithi072 ceph-mon[28706]: pgmap v230: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 6 op/s 2024-03-19T06:01:06.431 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:06 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:06.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:06 smithi172 ceph-mon[35716]: pgmap v230: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 6 op/s 2024-03-19T06:01:06.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:06 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:07.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:07 smithi072 ceph-mon[28706]: pgmap v231: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 6 op/s 2024-03-19T06:01:07.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:07 smithi072 ceph-mon[28706]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-03-19T06:01:07.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:07 smithi072 ceph-mon[28706]: Cluster is now healthy 2024-03-19T06:01:07.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:07 smithi072 ceph-mon[28706]: mds.? [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] up:boot 2024-03-19T06:01:07.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:07 smithi072 ceph-mon[28706]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 1 up:standby 2024-03-19T06:01:07.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:07 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:01:07.329 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:07 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:07.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:07 smithi172 ceph-mon[35716]: pgmap v231: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 6 op/s 2024-03-19T06:01:07.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:07 smithi172 ceph-mon[35716]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-03-19T06:01:07.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:07 smithi172 ceph-mon[35716]: Cluster is now healthy 2024-03-19T06:01:07.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:07 smithi172 ceph-mon[35716]: mds.? [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] up:boot 2024-03-19T06:01:07.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:07 smithi172 ceph-mon[35716]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 1 up:standby 2024-03-19T06:01:07.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:01:07.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:07 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.403+0000 7f6d86a00700 1 -- 172.21.15.72:0/246853247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d80076950 msgr2=0x7f6d80076dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.403+0000 7f6d86a00700 1 --2- 172.21.15.72:0/246853247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d80076950 0x7f6d80076dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c009910 tx=0x7f6d6c009c20 comp rx=0 tx=0).stop 2024-03-19T06:01:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.404+0000 7f6d86a00700 1 -- 172.21.15.72:0/246853247 shutdown_connections 2024-03-19T06:01:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.404+0000 7f6d86a00700 1 --2- 172.21.15.72:0/246853247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d80076950 0x7f6d80076dc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.404+0000 7f6d86a00700 1 --2- 172.21.15.72:0/246853247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d80075700 0x7f6d80075b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.404+0000 7f6d86a00700 1 -- 172.21.15.72:0/246853247 >> 172.21.15.72:0/246853247 conn(0x7f6d800fd9f0 msgr2=0x7f6d800ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.404+0000 7f6d86a00700 1 -- 172.21.15.72:0/246853247 shutdown_connections 2024-03-19T06:01:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.404+0000 7f6d86a00700 1 -- 172.21.15.72:0/246853247 wait complete. 2024-03-19T06:01:07.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.405+0000 7f6d86a00700 1 Processor -- start 2024-03-19T06:01:07.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.405+0000 7f6d86a00700 1 -- start start 2024-03-19T06:01:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.405+0000 7f6d86a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d80075700 0x7f6d8019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.405+0000 7f6d86a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d80076950 0x7f6d8019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.405+0000 7f6d86a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8019cbd0 con 0x7f6d80075700 2024-03-19T06:01:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.405+0000 7f6d86a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8019cd10 con 0x7f6d80076950 2024-03-19T06:01:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.405+0000 7f6d7fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d80075700 0x7f6d8019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.405+0000 7f6d7fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d80075700 0x7f6d8019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50082/0 (socket says 172.21.15.72:50082) 2024-03-19T06:01:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.405+0000 7f6d7fe00700 1 -- 172.21.15.72:0/3031078538 learned_addr learned my addr 172.21.15.72:0/3031078538 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.406+0000 7f6d7f400700 1 --2- 172.21.15.72:0/3031078538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d80076950 0x7f6d8019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.406+0000 7f6d7fe00700 1 -- 172.21.15.72:0/3031078538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d80076950 msgr2=0x7f6d8019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.406+0000 7f6d7fe00700 1 --2- 172.21.15.72:0/3031078538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d80076950 0x7f6d8019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:07.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.406+0000 7f6d7fe00700 1 -- 172.21.15.72:0/3031078538 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c0095f0 con 0x7f6d80075700 2024-03-19T06:01:07.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.406+0000 7f6d7fe00700 1 --2- 172.21.15.72:0/3031078538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d80075700 0x7f6d8019c070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000e920 tx=0x7f6d7000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:07.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.406+0000 7f6d7cc00700 1 -- 172.21.15.72:0/3031078538 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d70009790 con 0x7f6d80075700 2024-03-19T06:01:07.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.406+0000 7f6d7cc00700 1 -- 172.21.15.72:0/3031078538 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d7000cba0 con 0x7f6d80075700 2024-03-19T06:01:07.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.406+0000 7f6d86a00700 1 -- 172.21.15.72:0/3031078538 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d801a17c0 con 0x7f6d80075700 2024-03-19T06:01:07.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.407+0000 7f6d7cc00700 1 -- 172.21.15.72:0/3031078538 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d70018630 con 0x7f6d80075700 2024-03-19T06:01:07.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.407+0000 7f6d86a00700 1 -- 172.21.15.72:0/3031078538 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d801a1d10 con 0x7f6d80075700 2024-03-19T06:01:07.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.408+0000 7f6d86a00700 1 -- 172.21.15.72:0/3031078538 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8010f390 con 0x7f6d80075700 2024-03-19T06:01:07.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.410+0000 7f6d7cc00700 1 -- 172.21.15.72:0/3031078538 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6d7000cd10 con 0x7f6d80075700 2024-03-19T06:01:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.411+0000 7f6d7cc00700 1 --2- 172.21.15.72:0/3031078538 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6d6406c680 0x7f6d6406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.411+0000 7f6d7cc00700 1 -- 172.21.15.72:0/3031078538 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f6d70014070 con 0x7f6d80075700 2024-03-19T06:01:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.411+0000 7f6d7f400700 1 --2- 172.21.15.72:0/3031078538 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6d6406c680 0x7f6d6406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:07.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.412+0000 7f6d7f400700 1 --2- 172.21.15.72:0/3031078538 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6d6406c680 0x7f6d6406eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0059d0 tx=0x7f6d6c005940 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:07.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.415+0000 7f6d7cc00700 1 -- 172.21.15.72:0/3031078538 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6d7005a0f0 con 0x7f6d80075700 2024-03-19T06:01:07.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:07.677+0000 7f6d86a00700 1 -- 172.21.15.72:0/3031078538 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6d8010f580 con 0x7f6d80075700 2024-03-19T06:01:08.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:08.310+0000 7f6d7cc00700 1 -- 172.21.15.72:0/3031078538 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6d70059f10 con 0x7f6d80075700 2024-03-19T06:01:08.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:08.314+0000 7f6d86a00700 1 -- 172.21.15.72:0/3031078538 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6d6406c680 msgr2=0x7f6d6406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:08.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:08.314+0000 7f6d86a00700 1 --2- 172.21.15.72:0/3031078538 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6d6406c680 0x7f6d6406eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0059d0 tx=0x7f6d6c005940 comp rx=0 tx=0).stop 2024-03-19T06:01:08.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:08.314+0000 7f6d86a00700 1 -- 172.21.15.72:0/3031078538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d80075700 msgr2=0x7f6d8019c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:08.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:08.314+0000 7f6d86a00700 1 --2- 172.21.15.72:0/3031078538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d80075700 0x7f6d8019c070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000e920 tx=0x7f6d7000ece0 comp rx=0 tx=0).stop 2024-03-19T06:01:08.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:08.314+0000 7f6d86a00700 1 -- 172.21.15.72:0/3031078538 shutdown_connections 2024-03-19T06:01:08.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:08.314+0000 7f6d86a00700 1 --2- 172.21.15.72:0/3031078538 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6d6406c680 0x7f6d6406eb30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:08.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:08.314+0000 7f6d86a00700 1 --2- 172.21.15.72:0/3031078538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d80075700 0x7f6d8019c070 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:08.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:08.314+0000 7f6d86a00700 1 --2- 172.21.15.72:0/3031078538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d80076950 0x7f6d8019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:08.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:08.314+0000 7f6d86a00700 1 -- 172.21.15.72:0/3031078538 >> 172.21.15.72:0/3031078538 conn(0x7f6d800fd9f0 msgr2=0x7f6d8010c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:08.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:08.315+0000 7f6d86a00700 1 -- 172.21.15.72:0/3031078538 shutdown_connections 2024-03-19T06:01:08.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:08.315+0000 7f6d86a00700 1 -- 172.21.15.72:0/3031078538 wait complete. 2024-03-19T06:01:08.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:08 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:08.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:08 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:08.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:08 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.nparnw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:01:08.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:08 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.nparnw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-19T06:01:08.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:08 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:01:08.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:08 smithi172 ceph-mon[35716]: Deploying daemon mds.cephfs.smithi172.nparnw on smithi172 2024-03-19T06:01:08.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:08 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3031078538' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-19T06:01:08.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:08 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:08.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:08 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:08.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:08 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.nparnw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:01:08.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:08 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.nparnw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-19T06:01:08.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:08 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:01:08.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:08 smithi072 ceph-mon[28706]: Deploying daemon mds.cephfs.smithi172.nparnw on smithi172 2024-03-19T06:01:08.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:08 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3031078538' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-19T06:01:09.221 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-19T06:01:09.230 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T06:01:09.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-03-19T06:01:09.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:09 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3031078538' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-03-19T06:01:09.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:09 smithi072 ceph-mon[28706]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 1 up:standby 2024-03-19T06:01:09.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:09 smithi072 ceph-mon[28706]: pgmap v232: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 6 op/s 2024-03-19T06:01:09.648 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:01:09.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:09 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3031078538' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-03-19T06:01:09.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:09 smithi172 ceph-mon[35716]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 1 up:standby 2024-03-19T06:01:09.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:09 smithi172 ceph-mon[35716]: pgmap v232: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 6 op/s 2024-03-19T06:01:11.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.896+0000 7f22f6c00700 1 -- 172.21.15.72:0/1099102675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22f0073730 msgr2=0x7f22f0073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:11.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.896+0000 7f22f6c00700 1 --2- 172.21.15.72:0/1099102675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22f0073730 0x7f22f0073ba0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009910 tx=0x7f22dc009c20 comp rx=0 tx=0).stop 2024-03-19T06:01:11.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.897+0000 7f22f6c00700 1 -- 172.21.15.72:0/1099102675 shutdown_connections 2024-03-19T06:01:11.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.897+0000 7f22f6c00700 1 --2- 172.21.15.72:0/1099102675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22f0073730 0x7f22f0073ba0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:11.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.897+0000 7f22f6c00700 1 --2- 172.21.15.72:0/1099102675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0074d00 0x7f22f0073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:11.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.897+0000 7f22f6c00700 1 -- 172.21.15.72:0/1099102675 >> 172.21.15.72:0/1099102675 conn(0x7f22f00fb7f0 msgr2=0x7f22f00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:11.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.897+0000 7f22f6c00700 1 -- 172.21.15.72:0/1099102675 shutdown_connections 2024-03-19T06:01:11.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.897+0000 7f22f6c00700 1 -- 172.21.15.72:0/1099102675 wait complete. 2024-03-19T06:01:11.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.898+0000 7f22f6c00700 1 Processor -- start 2024-03-19T06:01:11.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.898+0000 7f22f6c00700 1 -- start start 2024-03-19T06:01:11.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.898+0000 7f22f6c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22f0073730 0x7f22f0197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:11.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.898+0000 7f22f6c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0074d00 0x7f22f01981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:11.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.898+0000 7f22f6c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f01987b0 con 0x7f22f0073730 2024-03-19T06:01:11.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.898+0000 7f22f6c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f0198920 con 0x7f22f0074d00 2024-03-19T06:01:11.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.899+0000 7f22efe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22f0073730 0x7f22f0197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:11.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.899+0000 7f22ef400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0074d00 0x7f22f01981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:11.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.899+0000 7f22ef400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0074d00 0x7f22f01981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:35714/0 (socket says 172.21.15.72:35714) 2024-03-19T06:01:11.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.899+0000 7f22efe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22f0073730 0x7f22f0197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50102/0 (socket says 172.21.15.72:50102) 2024-03-19T06:01:11.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.899+0000 7f22ef400700 1 -- 172.21.15.72:0/2390562850 learned_addr learned my addr 172.21.15.72:0/2390562850 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:11.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.900+0000 7f22ef400700 1 -- 172.21.15.72:0/2390562850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22f0073730 msgr2=0x7f22f0197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:11.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.900+0000 7f22ef400700 1 --2- 172.21.15.72:0/2390562850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22f0073730 0x7f22f0197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:11.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.900+0000 7f22ef400700 1 -- 172.21.15.72:0/2390562850 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0095f0 con 0x7f22f0074d00 2024-03-19T06:01:11.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.900+0000 7f22efe00700 1 --2- 172.21.15.72:0/2390562850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22f0073730 0x7f22f0197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:01:11.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.900+0000 7f22ef400700 1 --2- 172.21.15.72:0/2390562850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0074d00 0x7f22f01981b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0092e0 tx=0x7f22dc00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:11.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.900+0000 7f22ecc00700 1 -- 172.21.15.72:0/2390562850 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22dc01d070 con 0x7f22f0074d00 2024-03-19T06:01:11.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.900+0000 7f22ecc00700 1 -- 172.21.15.72:0/2390562850 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f22dc005dc0 con 0x7f22f0074d00 2024-03-19T06:01:11.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.900+0000 7f22ecc00700 1 -- 172.21.15.72:0/2390562850 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22dc017630 con 0x7f22f0074d00 2024-03-19T06:01:11.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.900+0000 7f22f6c00700 1 -- 172.21.15.72:0/2390562850 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f019d350 con 0x7f22f0074d00 2024-03-19T06:01:11.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.901+0000 7f22f6c00700 1 -- 172.21.15.72:0/2390562850 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f019d840 con 0x7f22f0074d00 2024-03-19T06:01:11.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.902+0000 7f22f6c00700 1 -- 172.21.15.72:0/2390562850 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f010af70 con 0x7f22f0074d00 2024-03-19T06:01:11.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.903+0000 7f22ecc00700 1 -- 172.21.15.72:0/2390562850 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f22dc00faf0 con 0x7f22f0074d00 2024-03-19T06:01:11.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.904+0000 7f22ecc00700 1 --2- 172.21.15.72:0/2390562850 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f22d406c680 0x7f22d406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:11.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.904+0000 7f22ecc00700 1 -- 172.21.15.72:0/2390562850 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f22dc08cc90 con 0x7f22f0074d00 2024-03-19T06:01:11.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.904+0000 7f22efe00700 1 --2- 172.21.15.72:0/2390562850 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f22d406c680 0x7f22d406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:11.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.905+0000 7f22efe00700 1 --2- 172.21.15.72:0/2390562850 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f22d406c680 0x7f22d406eb30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22f0198b50 tx=0x7f22e0009260 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:11.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:11.909+0000 7f22ecc00700 1 -- 172.21.15.72:0/2390562850 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f22dc057350 con 0x7f22f0074d00 2024-03-19T06:01:12.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:12.190+0000 7f22f6c00700 1 -- 172.21.15.72:0/2390562850 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f22f010b160 con 0x7f22f0074d00 2024-03-19T06:01:12.230 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:11 smithi072 ceph-mon[28706]: pgmap v233: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 7 op/s 2024-03-19T06:01:12.230 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:12.230 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:12.231 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:12.231 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:12.231 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:12.231 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:01:12.231 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:11 smithi072 ceph-mon[28706]: mds.? [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] up:boot 2024-03-19T06:01:12.231 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:11 smithi072 ceph-mon[28706]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:01:12.231 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:11 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.nparnw"}]: dispatch 2024-03-19T06:01:12.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:11 smithi172 ceph-mon[35716]: pgmap v233: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 7 op/s 2024-03-19T06:01:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:01:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:11 smithi172 ceph-mon[35716]: mds.? [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] up:boot 2024-03-19T06:01:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:11 smithi172 ceph-mon[35716]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:01:12.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:11 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.nparnw"}]: dispatch 2024-03-19T06:01:12.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:13.003+0000 7f22ecc00700 1 -- 172.21.15.72:0/2390562850 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v12) v1 ==== 168+0+0 (secure 0 0 0) 0x7f22dc05a970 con 0x7f22f0074d00 2024-03-19T06:01:12.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:13.006+0000 7f22f6c00700 1 -- 172.21.15.72:0/2390562850 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f22d406c680 msgr2=0x7f22d406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:12.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:13.006+0000 7f22f6c00700 1 --2- 172.21.15.72:0/2390562850 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f22d406c680 0x7f22d406eb30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22f0198b50 tx=0x7f22e0009260 comp rx=0 tx=0).stop 2024-03-19T06:01:12.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:13.006+0000 7f22f6c00700 1 -- 172.21.15.72:0/2390562850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0074d00 msgr2=0x7f22f01981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:12.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:13.006+0000 7f22f6c00700 1 --2- 172.21.15.72:0/2390562850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0074d00 0x7f22f01981b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0092e0 tx=0x7f22dc00f690 comp rx=0 tx=0).stop 2024-03-19T06:01:12.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:13.006+0000 7f22f6c00700 1 -- 172.21.15.72:0/2390562850 shutdown_connections 2024-03-19T06:01:13.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:13.006+0000 7f22f6c00700 1 --2- 172.21.15.72:0/2390562850 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f22d406c680 0x7f22d406eb30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:13.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:13.006+0000 7f22f6c00700 1 --2- 172.21.15.72:0/2390562850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22f0073730 0x7f22f0197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:13.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:13.006+0000 7f22f6c00700 1 --2- 172.21.15.72:0/2390562850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0074d00 0x7f22f01981b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:13.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:13.006+0000 7f22f6c00700 1 -- 172.21.15.72:0/2390562850 >> 172.21.15.72:0/2390562850 conn(0x7f22f00fb7f0 msgr2=0x7f22f01060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:13.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:13.007+0000 7f22f6c00700 1 -- 172.21.15.72:0/2390562850 shutdown_connections 2024-03-19T06:01:13.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:13.007+0000 7f22f6c00700 1 -- 172.21.15.72:0/2390562850 wait complete. 2024-03-19T06:01:13.000 INFO:teuthology.orchestra.run.smithi072.stderr:inline data enabled 2024-03-19T06:01:13.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:12 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2390562850' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-19T06:01:13.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:12 smithi072 ceph-mon[28706]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-19T06:01:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:12 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2390562850' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-19T06:01:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:12 smithi172 ceph-mon[35716]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-19T06:01:13.971 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-19T06:01:13.980 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T06:01:13.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-19T06:01:14.286 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:13 smithi072 ceph-mon[28706]: pgmap v234: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-03-19T06:01:14.286 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:13 smithi072 ceph-mon[28706]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-03-19T06:01:14.287 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:13 smithi072 ceph-mon[28706]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-03-19T06:01:14.287 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:13 smithi072 ceph-mon[28706]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:01:14.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:13 smithi172 ceph-mon[35716]: pgmap v234: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-03-19T06:01:14.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:13 smithi172 ceph-mon[35716]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-03-19T06:01:14.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:13 smithi172 ceph-mon[35716]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-03-19T06:01:14.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:13 smithi172 ceph-mon[35716]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:01:15.075 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:01:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:15 smithi072 ceph-mon[28706]: pgmap v235: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 3 op/s 2024-03-19T06:01:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:15 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:15 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:15 smithi072 ceph-mon[28706]: mds.? [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] up:active 2024-03-19T06:01:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:15 smithi072 ceph-mon[28706]: mds.? [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] up:active 2024-03-19T06:01:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:15 smithi072 ceph-mon[28706]: mds.? [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] up:standby 2024-03-19T06:01:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:15 smithi072 ceph-mon[28706]: mds.? [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] up:standby 2024-03-19T06:01:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:15 smithi072 ceph-mon[28706]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:01:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:15 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:15 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:01:16.214 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:15 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:16.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:15 smithi172 ceph-mon[35716]: pgmap v235: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 3 op/s 2024-03-19T06:01:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:15 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:15 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:15 smithi172 ceph-mon[35716]: mds.? [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] up:active 2024-03-19T06:01:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:15 smithi172 ceph-mon[35716]: mds.? [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] up:active 2024-03-19T06:01:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:15 smithi172 ceph-mon[35716]: mds.? [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] up:standby 2024-03-19T06:01:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:15 smithi172 ceph-mon[35716]: mds.? [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] up:standby 2024-03-19T06:01:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:15 smithi172 ceph-mon[35716]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:01:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:15 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:15 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:01:16.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:15 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:17.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.974+0000 7f7d30600700 1 -- 172.21.15.72:0/2418214611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d280feac0 msgr2=0x7f7d28100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:17.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.974+0000 7f7d30600700 1 --2- 172.21.15.72:0/2418214611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d280feac0 0x7f7d28100ee0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009910 tx=0x7f7d1c009c20 comp rx=0 tx=0).stop 2024-03-19T06:01:17.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.974+0000 7f7d30600700 1 -- 172.21.15.72:0/2418214611 shutdown_connections 2024-03-19T06:01:17.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.974+0000 7f7d30600700 1 --2- 172.21.15.72:0/2418214611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d28101420 0x7f7d281038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:17.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.974+0000 7f7d30600700 1 --2- 172.21.15.72:0/2418214611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d280feac0 0x7f7d28100ee0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:17.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.974+0000 7f7d30600700 1 -- 172.21.15.72:0/2418214611 >> 172.21.15.72:0/2418214611 conn(0x7f7d280fa6d0 msgr2=0x7f7d280fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:17.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.974+0000 7f7d30600700 1 -- 172.21.15.72:0/2418214611 shutdown_connections 2024-03-19T06:01:17.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.975+0000 7f7d30600700 1 -- 172.21.15.72:0/2418214611 wait complete. 2024-03-19T06:01:17.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.976+0000 7f7d30600700 1 Processor -- start 2024-03-19T06:01:17.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.976+0000 7f7d30600700 1 -- start start 2024-03-19T06:01:17.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.977+0000 7f7d30600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d280feac0 0x7f7d2819c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:17.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.977+0000 7f7d30600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d28101420 0x7f7d2819c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:17.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.977+0000 7f7d30600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2819cb30 con 0x7f7d28101420 2024-03-19T06:01:17.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.977+0000 7f7d30600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2819cc70 con 0x7f7d280feac0 2024-03-19T06:01:17.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.977+0000 7f7d2d200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d28101420 0x7f7d2819c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:17.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.977+0000 7f7d2d200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d28101420 0x7f7d2819c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50220/0 (socket says 172.21.15.72:50220) 2024-03-19T06:01:17.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.977+0000 7f7d2d200700 1 -- 172.21.15.72:0/1509503693 learned_addr learned my addr 172.21.15.72:0/1509503693 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:17.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.977+0000 7f7d2dc00700 1 --2- 172.21.15.72:0/1509503693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d280feac0 0x7f7d2819c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:17.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.978+0000 7f7d2d200700 1 -- 172.21.15.72:0/1509503693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d280feac0 msgr2=0x7f7d2819c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:17.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.978+0000 7f7d2d200700 1 --2- 172.21.15.72:0/1509503693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d280feac0 0x7f7d2819c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:17.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.978+0000 7f7d2d200700 1 -- 172.21.15.72:0/1509503693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c0095f0 con 0x7f7d28101420 2024-03-19T06:01:17.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.978+0000 7f7d2d200700 1 --2- 172.21.15.72:0/1509503693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d28101420 0x7f7d2819c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c930 tx=0x7f7d1400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:17.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.978+0000 7f7d26000700 1 -- 172.21.15.72:0/1509503693 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d14007ad0 con 0x7f7d28101420 2024-03-19T06:01:17.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.978+0000 7f7d26000700 1 -- 172.21.15.72:0/1509503693 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7d14007c30 con 0x7f7d28101420 2024-03-19T06:01:17.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.978+0000 7f7d30600700 1 -- 172.21.15.72:0/1509503693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d281a1730 con 0x7f7d28101420 2024-03-19T06:01:17.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.978+0000 7f7d26000700 1 -- 172.21.15.72:0/1509503693 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d14018630 con 0x7f7d28101420 2024-03-19T06:01:17.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.979+0000 7f7d30600700 1 -- 172.21.15.72:0/1509503693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d281a1c50 con 0x7f7d28101420 2024-03-19T06:01:17.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.980+0000 7f7d30600700 1 -- 172.21.15.72:0/1509503693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d28196260 con 0x7f7d28101420 2024-03-19T06:01:17.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.981+0000 7f7d26000700 1 -- 172.21.15.72:0/1509503693 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7d1400f450 con 0x7f7d28101420 2024-03-19T06:01:17.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.982+0000 7f7d26000700 1 --2- 172.21.15.72:0/1509503693 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7d1006c680 0x7f7d1006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:17.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.982+0000 7f7d26000700 1 -- 172.21.15.72:0/1509503693 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f7d1408bcd0 con 0x7f7d28101420 2024-03-19T06:01:17.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.982+0000 7f7d2dc00700 1 --2- 172.21.15.72:0/1509503693 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7d1006c680 0x7f7d1006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:17.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.983+0000 7f7d2dc00700 1 --2- 172.21.15.72:0/1509503693 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7d1006c680 0x7f7d1006eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c006010 tx=0x7f7d1c00b540 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:17.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:17.990+0000 7f7d26000700 1 -- 172.21.15.72:0/1509503693 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7d14059ea0 con 0x7f7d28101420 2024-03-19T06:01:18.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.255+0000 7f7d30600700 1 -- 172.21.15.72:0/1509503693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7d2802cc30 con 0x7f7d28101420 2024-03-19T06:01:18.249 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:18 smithi072 ceph-mon[28706]: pgmap v236: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 1 op/s 2024-03-19T06:01:18.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.256+0000 7f7d26000700 1 -- 172.21.15.72:0/1509503693 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1831 (secure 0 0 0) 0x7f7d14059a30 con 0x7f7d28101420 2024-03-19T06:01:18.249 INFO:teuthology.orchestra.run.smithi072.stdout:e13 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 13 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:01:14.992147+0000 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:01:18.250 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:01:18.251 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:01:18.252 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:01:18.252 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:01:18.252 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:01:18.252 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:01:18.252 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:01:18.252 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:01:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:01:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:01:18.252 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:01:18.252 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:01:18.252 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:01:18.252 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:01:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.259+0000 7f7d30600700 1 -- 172.21.15.72:0/1509503693 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7d1006c680 msgr2=0x7f7d1006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.259+0000 7f7d30600700 1 --2- 172.21.15.72:0/1509503693 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7d1006c680 0x7f7d1006eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c006010 tx=0x7f7d1c00b540 comp rx=0 tx=0).stop 2024-03-19T06:01:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.259+0000 7f7d30600700 1 -- 172.21.15.72:0/1509503693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d28101420 msgr2=0x7f7d2819c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.259+0000 7f7d30600700 1 --2- 172.21.15.72:0/1509503693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d28101420 0x7f7d2819c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c930 tx=0x7f7d1400ccf0 comp rx=0 tx=0).stop 2024-03-19T06:01:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.260+0000 7f7d30600700 1 -- 172.21.15.72:0/1509503693 shutdown_connections 2024-03-19T06:01:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.260+0000 7f7d30600700 1 --2- 172.21.15.72:0/1509503693 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7d1006c680 0x7f7d1006eb30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.260+0000 7f7d30600700 1 --2- 172.21.15.72:0/1509503693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d280feac0 0x7f7d2819c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:18.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.260+0000 7f7d30600700 1 --2- 172.21.15.72:0/1509503693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d28101420 0x7f7d2819c5a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:18.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.260+0000 7f7d30600700 1 -- 172.21.15.72:0/1509503693 >> 172.21.15.72:0/1509503693 conn(0x7f7d280fa6d0 msgr2=0x7f7d280fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:18.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.261+0000 7f7d30600700 1 -- 172.21.15.72:0/1509503693 shutdown_connections 2024-03-19T06:01:18.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:18.261+0000 7f7d30600700 1 -- 172.21.15.72:0/1509503693 wait complete. 2024-03-19T06:01:18.255 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 13 2024-03-19T06:01:18.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:18 smithi172 ceph-mon[35716]: pgmap v236: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 1 op/s 2024-03-19T06:01:19.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:19 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1509503693' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:01:19.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:19 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1509503693' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:01:19.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-03-19T06:01:20.297 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:20 smithi072 ceph-mon[28706]: pgmap v237: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-03-19T06:01:20.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:20 smithi172 ceph-mon[35716]: pgmap v237: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-03-19T06:01:20.635 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:01:22.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:22 smithi172 ceph-mon[35716]: pgmap v238: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-03-19T06:01:22.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:22 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:22.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:22 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:22.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:22 smithi072 ceph-mon[28706]: pgmap v238: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-03-19T06:01:22.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:22 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:22.421 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:22 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:23.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.030+0000 7f579fe00700 1 -- 172.21.15.72:0/1591192469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5798100240 msgr2=0x7f5798100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:23.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.030+0000 7f579fe00700 1 --2- 172.21.15.72:0/1591192469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5798100240 0x7f5798100650 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f578c009910 tx=0x7f578c009c20 comp rx=0 tx=0).stop 2024-03-19T06:01:23.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.030+0000 7f579fe00700 1 -- 172.21.15.72:0/1591192469 shutdown_connections 2024-03-19T06:01:23.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.030+0000 7f579fe00700 1 --2- 172.21.15.72:0/1591192469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5798101440 0x7f5798101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:23.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.030+0000 7f579fe00700 1 --2- 172.21.15.72:0/1591192469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5798100240 0x7f5798100650 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:23.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.030+0000 7f579fe00700 1 -- 172.21.15.72:0/1591192469 >> 172.21.15.72:0/1591192469 conn(0x7f57980fb7f0 msgr2=0x7f57980fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:23.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.030+0000 7f579fe00700 1 -- 172.21.15.72:0/1591192469 shutdown_connections 2024-03-19T06:01:23.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.030+0000 7f579fe00700 1 -- 172.21.15.72:0/1591192469 wait complete. 2024-03-19T06:01:23.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.031+0000 7f579fe00700 1 Processor -- start 2024-03-19T06:01:23.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.032+0000 7f579fe00700 1 -- start start 2024-03-19T06:01:23.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.032+0000 7f579fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5798100240 0x7f5798195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.032+0000 7f579fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5798101440 0x7f5798196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.032+0000 7f579fe00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5798196630 con 0x7f5798101440 2024-03-19T06:01:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.032+0000 7f579fe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5798196770 con 0x7f5798100240 2024-03-19T06:01:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.032+0000 7f579ca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5798101440 0x7f5798196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.032+0000 7f579ca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5798101440 0x7f5798196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50240/0 (socket says 172.21.15.72:50240) 2024-03-19T06:01:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.032+0000 7f579ca00700 1 -- 172.21.15.72:0/1362752137 learned_addr learned my addr 172.21.15.72:0/1362752137 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.032+0000 7f579d400700 1 --2- 172.21.15.72:0/1362752137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5798100240 0x7f5798195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.033+0000 7f579ca00700 1 -- 172.21.15.72:0/1362752137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5798100240 msgr2=0x7f5798195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.033+0000 7f579ca00700 1 --2- 172.21.15.72:0/1362752137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5798100240 0x7f5798195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.033+0000 7f579ca00700 1 -- 172.21.15.72:0/1362752137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0095f0 con 0x7f5798101440 2024-03-19T06:01:23.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.033+0000 7f579ca00700 1 --2- 172.21.15.72:0/1362752137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5798101440 0x7f5798196010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f578400e920 tx=0x7f578400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:23.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.033+0000 7f5796000700 1 -- 172.21.15.72:0/1362752137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f578400c9d0 con 0x7f5798101440 2024-03-19T06:01:23.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.033+0000 7f5796000700 1 -- 172.21.15.72:0/1362752137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5784010430 con 0x7f5798101440 2024-03-19T06:01:23.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.034+0000 7f5796000700 1 -- 172.21.15.72:0/1362752137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5784018650 con 0x7f5798101440 2024-03-19T06:01:23.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.034+0000 7f579fe00700 1 -- 172.21.15.72:0/1362752137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579819b220 con 0x7f5798101440 2024-03-19T06:01:23.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.034+0000 7f579fe00700 1 -- 172.21.15.72:0/1362752137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579819b770 con 0x7f5798101440 2024-03-19T06:01:23.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.035+0000 7f579fe00700 1 -- 172.21.15.72:0/1362752137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5798108d90 con 0x7f5798101440 2024-03-19T06:01:23.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.036+0000 7f5796000700 1 -- 172.21.15.72:0/1362752137 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f57840105a0 con 0x7f5798101440 2024-03-19T06:01:23.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.037+0000 7f5796000700 1 --2- 172.21.15.72:0/1362752137 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f578006c680 0x7f578006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:23.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.037+0000 7f5796000700 1 -- 172.21.15.72:0/1362752137 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f5784014070 con 0x7f5798101440 2024-03-19T06:01:23.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.037+0000 7f579d400700 1 --2- 172.21.15.72:0/1362752137 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f578006c680 0x7f578006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:23.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.037+0000 7f579d400700 1 --2- 172.21.15.72:0/1362752137 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f578006c680 0x7f578006eb30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f578c009fd0 tx=0x7f578c005fd0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:23.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.041+0000 7f5796000700 1 -- 172.21.15.72:0/1362752137 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5784051720 con 0x7f5798101440 2024-03-19T06:01:23.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.329+0000 7f579fe00700 1 -- 172.21.15.72:0/1362752137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f579819be00 con 0x7f5798101440 2024-03-19T06:01:23.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:01:23.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:01:23.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:23.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:23 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:01:23.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.330+0000 7f5796000700 1 -- 172.21.15.72:0/1362752137 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4752 (secure 0 0 0) 0x7f5784059dc0 con 0x7f5798101440 2024-03-19T06:01:23.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.333+0000 7f579fe00700 1 -- 172.21.15.72:0/1362752137 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f578006c680 msgr2=0x7f578006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:23.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.333+0000 7f579fe00700 1 --2- 172.21.15.72:0/1362752137 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f578006c680 0x7f578006eb30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f578c009fd0 tx=0x7f578c005fd0 comp rx=0 tx=0).stop 2024-03-19T06:01:23.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.333+0000 7f579fe00700 1 -- 172.21.15.72:0/1362752137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5798101440 msgr2=0x7f5798196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:23.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.333+0000 7f579fe00700 1 --2- 172.21.15.72:0/1362752137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5798101440 0x7f5798196010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f578400e920 tx=0x7f578400ec30 comp rx=0 tx=0).stop 2024-03-19T06:01:23.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.333+0000 7f579fe00700 1 -- 172.21.15.72:0/1362752137 shutdown_connections 2024-03-19T06:01:23.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.333+0000 7f579fe00700 1 --2- 172.21.15.72:0/1362752137 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f578006c680 0x7f578006eb30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:23.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.333+0000 7f579fe00700 1 --2- 172.21.15.72:0/1362752137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5798100240 0x7f5798195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:23.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.333+0000 7f579fe00700 1 --2- 172.21.15.72:0/1362752137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5798101440 0x7f5798196010 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:23.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.333+0000 7f579fe00700 1 -- 172.21.15.72:0/1362752137 >> 172.21.15.72:0/1362752137 conn(0x7f57980fb7f0 msgr2=0x7f5798104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:23.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.333+0000 7f579fe00700 1 -- 172.21.15.72:0/1362752137 shutdown_connections 2024-03-19T06:01:23.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:23.333+0000 7f579fe00700 1 -- 172.21.15.72:0/1362752137 wait complete. 2024-03-19T06:01:23.329 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 13 2024-03-19T06:01:23.345 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:01:23.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:01:23.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:01:23.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:23.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:23 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:01:24.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-03-19T06:01:24.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:24 smithi172 ceph-mon[35716]: pgmap v239: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:24.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:24 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1362752137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-19T06:01:24.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:24 smithi072 ceph-mon[28706]: pgmap v239: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:24.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:24 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1362752137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-19T06:01:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:01:26.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:26 smithi172 ceph-mon[35716]: pgmap v240: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:26.464 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:26 smithi072 ceph-mon[28706]: pgmap v240: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:27.803 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:27 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:27.803 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:27 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:27.803 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:27 smithi072 ceph-mon[28706]: pgmap v241: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:27.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:27 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:27.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:27 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:27.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:27 smithi172 ceph-mon[35716]: pgmap v241: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:28.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.271+0000 7f8bc5600700 1 -- 172.21.15.72:0/3274202186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc0103680 msgr2=0x7f8bc0105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:28.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.271+0000 7f8bc5600700 1 --2- 172.21.15.72:0/3274202186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc0103680 0x7f8bc0105a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009910 tx=0x7f8bac009c20 comp rx=0 tx=0).stop 2024-03-19T06:01:28.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.271+0000 7f8bc5600700 1 -- 172.21.15.72:0/3274202186 shutdown_connections 2024-03-19T06:01:28.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.271+0000 7f8bc5600700 1 --2- 172.21.15.72:0/3274202186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc0103680 0x7f8bc0105a60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.271+0000 7f8bc5600700 1 --2- 172.21.15.72:0/3274202186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0100d60 0x7f8bc0103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.271+0000 7f8bc5600700 1 -- 172.21.15.72:0/3274202186 >> 172.21.15.72:0/3274202186 conn(0x7f8bc00fa780 msgr2=0x7f8bc00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.271+0000 7f8bc5600700 1 -- 172.21.15.72:0/3274202186 shutdown_connections 2024-03-19T06:01:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.271+0000 7f8bc5600700 1 -- 172.21.15.72:0/3274202186 wait complete. 2024-03-19T06:01:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.272+0000 7f8bc5600700 1 Processor -- start 2024-03-19T06:01:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.272+0000 7f8bc5600700 1 -- start start 2024-03-19T06:01:28.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.272+0000 7f8bc5600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0100d60 0x7f8bc0195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.272+0000 7f8bc5600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc0103680 0x7f8bc0196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.272+0000 7f8bc5600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc01966a0 con 0x7f8bc0103680 2024-03-19T06:01:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.272+0000 7f8bc5600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc01967e0 con 0x7f8bc0100d60 2024-03-19T06:01:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.273+0000 7f8bbe000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc0103680 0x7f8bc0196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.273+0000 7f8bbe000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc0103680 0x7f8bc0196080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37738/0 (socket says 172.21.15.72:37738) 2024-03-19T06:01:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.273+0000 7f8bbe000700 1 -- 172.21.15.72:0/848202046 learned_addr learned my addr 172.21.15.72:0/848202046 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.273+0000 7f8bbea00700 1 --2- 172.21.15.72:0/848202046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0100d60 0x7f8bc0195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.273+0000 7f8bbe000700 1 -- 172.21.15.72:0/848202046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0100d60 msgr2=0x7f8bc0195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.273+0000 7f8bbe000700 1 --2- 172.21.15.72:0/848202046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0100d60 0x7f8bc0195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.273+0000 7f8bbe000700 1 -- 172.21.15.72:0/848202046 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac0095f0 con 0x7f8bc0103680 2024-03-19T06:01:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.273+0000 7f8bbe000700 1 --2- 172.21.15.72:0/848202046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc0103680 0x7f8bc0196080 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8bac005b40 tx=0x7f8bac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.274+0000 7f8bb7400700 1 -- 172.21.15.72:0/848202046 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bac01d070 con 0x7f8bc0103680 2024-03-19T06:01:28.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.274+0000 7f8bb7400700 1 -- 172.21.15.72:0/848202046 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8bac022470 con 0x7f8bc0103680 2024-03-19T06:01:28.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.274+0000 7f8bc5600700 1 -- 172.21.15.72:0/848202046 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc019b230 con 0x7f8bc0103680 2024-03-19T06:01:28.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.274+0000 7f8bb7400700 1 -- 172.21.15.72:0/848202046 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bac00f690 con 0x7f8bc0103680 2024-03-19T06:01:28.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.274+0000 7f8bc5600700 1 -- 172.21.15.72:0/848202046 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc019b720 con 0x7f8bc0103680 2024-03-19T06:01:28.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.276+0000 7f8bb7400700 1 -- 172.21.15.72:0/848202046 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f8bac0225e0 con 0x7f8bc0103680 2024-03-19T06:01:28.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.276+0000 7f8bc5600700 1 -- 172.21.15.72:0/848202046 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc018fc60 con 0x7f8bc0103680 2024-03-19T06:01:28.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.277+0000 7f8bb7400700 1 --2- 172.21.15.72:0/848202046 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8ba406c680 0x7f8ba406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:28.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.277+0000 7f8bb7400700 1 -- 172.21.15.72:0/848202046 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f8bac08d090 con 0x7f8bc0103680 2024-03-19T06:01:28.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.277+0000 7f8bbea00700 1 --2- 172.21.15.72:0/848202046 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8ba406c680 0x7f8ba406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.278+0000 7f8bbea00700 1 --2- 172.21.15.72:0/848202046 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8ba406c680 0x7f8ba406eb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0006fd0 tx=0x7f8bb0008040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.284+0000 7f8bb7400700 1 -- 172.21.15.72:0/848202046 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8bac05b260 con 0x7f8bc0103680 2024-03-19T06:01:28.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.606+0000 7f8bc5600700 1 -- 172.21.15.72:0/848202046 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f8bc002cc30 con 0x7f8bc0103680 2024-03-19T06:01:28.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.607+0000 7f8bb7400700 1 -- 172.21.15.72:0/848202046 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v13) v1 ==== 78+0+83 (secure 0 0 0) 0x7f8bac05adf0 con 0x7f8bc0103680 2024-03-19T06:01:28.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.610+0000 7f8bc5600700 1 -- 172.21.15.72:0/848202046 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8ba406c680 msgr2=0x7f8ba406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.610+0000 7f8bc5600700 1 --2- 172.21.15.72:0/848202046 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8ba406c680 0x7f8ba406eb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0006fd0 tx=0x7f8bb0008040 comp rx=0 tx=0).stop 2024-03-19T06:01:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.610+0000 7f8bc5600700 1 -- 172.21.15.72:0/848202046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc0103680 msgr2=0x7f8bc0196080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.610+0000 7f8bc5600700 1 --2- 172.21.15.72:0/848202046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc0103680 0x7f8bc0196080 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8bac005b40 tx=0x7f8bac00be20 comp rx=0 tx=0).stop 2024-03-19T06:01:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.610+0000 7f8bc5600700 1 -- 172.21.15.72:0/848202046 shutdown_connections 2024-03-19T06:01:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.610+0000 7f8bc5600700 1 --2- 172.21.15.72:0/848202046 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f8ba406c680 0x7f8ba406eb30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.610+0000 7f8bc5600700 1 --2- 172.21.15.72:0/848202046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bc0100d60 0x7f8bc0195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.610+0000 7f8bc5600700 1 --2- 172.21.15.72:0/848202046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bc0103680 0x7f8bc0196080 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.610+0000 7f8bc5600700 1 -- 172.21.15.72:0/848202046 >> 172.21.15.72:0/848202046 conn(0x7f8bc00fa780 msgr2=0x7f8bc00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.610+0000 7f8bc5600700 1 -- 172.21.15.72:0/848202046 shutdown_connections 2024-03-19T06:01:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:28.610+0000 7f8bc5600700 1 -- 172.21.15.72:0/848202046 wait complete. 2024-03-19T06:01:28.618 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:01:28.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:28 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/848202046' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-03-19T06:01:28.969 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:28 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/848202046' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-03-19T06:01:29.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:29 smithi072 ceph-mon[28706]: pgmap v242: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:29.985 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-03-19T06:01:30.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:01:30.177 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:29 smithi172 ceph-mon[35716]: pgmap v242: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:30.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.416+0000 7fb8e7400640 1 -- 172.21.15.72:0/749455807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0102a60 msgr2=0x7fb8e0102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:30.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.416+0000 7fb8e7400640 1 --2- 172.21.15.72:0/749455807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0102a60 0x7fb8e0102ed0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009880 tx=0x7fb8cc02bce0 comp rx=0 tx=0).stop 2024-03-19T06:01:30.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.416+0000 7fb8e7400640 1 -- 172.21.15.72:0/749455807 shutdown_connections 2024-03-19T06:01:30.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.416+0000 7fb8e7400640 1 --2- 172.21.15.72:0/749455807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0102a60 0x7fb8e0102ed0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.416+0000 7fb8e7400640 1 --2- 172.21.15.72:0/749455807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e0101870 0x7fb8e0101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.416+0000 7fb8e7400640 1 -- 172.21.15.72:0/749455807 >> 172.21.15.72:0/749455807 conn(0x7fb8e00fce10 msgr2=0x7fb8e00ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.416+0000 7fb8e7400640 1 -- 172.21.15.72:0/749455807 shutdown_connections 2024-03-19T06:01:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.416+0000 7fb8e7400640 1 -- 172.21.15.72:0/749455807 wait complete. 2024-03-19T06:01:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.417+0000 7fb8e7400640 1 Processor -- start 2024-03-19T06:01:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.417+0000 7fb8e7400640 1 -- start start 2024-03-19T06:01:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.418+0000 7fb8e7400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e0101870 0x7fb8e01970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.418+0000 7fb8e7400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0102a60 0x7fb8e01975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.418+0000 7fb8e7400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e0197bb0 con 0x7fb8e0102a60 2024-03-19T06:01:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.418+0000 7fb8e7400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e0197d20 con 0x7fb8e0101870 2024-03-19T06:01:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.418+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0102a60 0x7fb8e01975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.418+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0102a60 0x7fb8e01975e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37760/0 (socket says 172.21.15.72:37760) 2024-03-19T06:01:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.418+0000 7fb8dfe00640 1 -- 172.21.15.72:0/3642786083 learned_addr learned my addr 172.21.15.72:0/3642786083 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.418+0000 7fb8e4a00640 1 --2- 172.21.15.72:0/3642786083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e0101870 0x7fb8e01970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.418+0000 7fb8dfe00640 1 -- 172.21.15.72:0/3642786083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e0101870 msgr2=0x7fb8e01970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.418+0000 7fb8dfe00640 1 --2- 172.21.15.72:0/3642786083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e0101870 0x7fb8e01970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.418+0000 7fb8dfe00640 1 -- 172.21.15.72:0/3642786083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc009560 con 0x7fb8e0102a60 2024-03-19T06:01:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.418+0000 7fb8e4a00640 1 --2- 172.21.15.72:0/3642786083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e0101870 0x7fb8e01970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:01:30.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.419+0000 7fb8dfe00640 1 --2- 172.21.15.72:0/3642786083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0102a60 0x7fb8e01975e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009230 tx=0x7fb8cc004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:30.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.419+0000 7fb8dd600640 1 -- 172.21.15.72:0/3642786083 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8cc004520 con 0x7fb8e0102a60 2024-03-19T06:01:30.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.419+0000 7fb8e7400640 1 -- 172.21.15.72:0/3642786083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e019c750 con 0x7fb8e0102a60 2024-03-19T06:01:30.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.419+0000 7fb8dd600640 1 -- 172.21.15.72:0/3642786083 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8cc0054b0 con 0x7fb8e0102a60 2024-03-19T06:01:30.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.419+0000 7fb8dd600640 1 -- 172.21.15.72:0/3642786083 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8cc034670 con 0x7fb8e0102a60 2024-03-19T06:01:30.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.419+0000 7fb8e7400640 1 -- 172.21.15.72:0/3642786083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e019cc50 con 0x7fb8e0102a60 2024-03-19T06:01:30.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.420+0000 7fb8e7400640 1 -- 172.21.15.72:0/3642786083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e010a5b0 con 0x7fb8e0102a60 2024-03-19T06:01:30.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.421+0000 7fb8dd600640 1 -- 172.21.15.72:0/3642786083 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb8cc0038b0 con 0x7fb8e0102a60 2024-03-19T06:01:30.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.422+0000 7fb8dd600640 1 --2- 172.21.15.72:0/3642786083 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb8c806c6b0 0x7fb8c806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:30.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.422+0000 7fb8dd600640 1 -- 172.21.15.72:0/3642786083 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fb8cc0ade20 con 0x7fb8e0102a60 2024-03-19T06:01:30.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.423+0000 7fb8e4a00640 1 --2- 172.21.15.72:0/3642786083 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb8c806c6b0 0x7fb8c806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:30.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.423+0000 7fb8e4a00640 1 --2- 172.21.15.72:0/3642786083 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb8c806c6b0 0x7fb8c806eb60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb8e01028c0 tx=0x7fb8d4005e70 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:30.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.427+0000 7fb8dd600640 1 -- 172.21.15.72:0/3642786083 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb8cc078500 con 0x7fb8e0102a60 2024-03-19T06:01:30.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.622+0000 7fb8e7400640 1 -- 172.21.15.72:0/3642786083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8e019ce70 con 0x7fb8e0102a60 2024-03-19T06:01:30.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.625+0000 7fb8dd600640 1 -- 172.21.15.72:0/3642786083 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+15014 (secure 0 0 0) 0x7fb8cc07bb20 con 0x7fb8e0102a60 2024-03-19T06:01:30.622 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:01:30.622 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":45,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","created":"2024-03-19T05:51:14.734187+0000","modified":"2024-03-19T06:00:54.231357+0000","last_up_change":"2024-03-19T05:59:11.221924+0000","last_in_change":"2024-03-19T05:58:47.988240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T05:57:27.222850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-03-19T06:00:50.787240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-03-19T06:00:51.727393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"215fcddf-0352-4fb1-b006-edd278832a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6803","nonce":2999939724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6805","nonce":2999939724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6809","nonce":2999939724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2999939724},{"type":"v1","addr":"172.21.15.72:6807","nonce":2999939724}]},"public_addr":"172.21.15.72:6803/2999939724","cluster_addr":"172.21.15.72:6805/2999939724","heartbeat_back_addr":"172.21.15.72:6809/2999939724","heartbeat_front_addr":"172.21.15.72:6807/2999939724","state":["exists","up"]},{"osd":1,"uuid":"f52e39bf-bbfe-48c3-bf4f-70cae6b4e57c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6811","nonce":1791583949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6813","nonce":1791583949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6817","nonce":1791583949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1791583949},{"type":"v1","addr":"172.21.15.72:6815","nonce":1791583949}]},"public_addr":"172.21.15.72:6811/1791583949","cluster_addr":"172.21.15.72:6813/1791583949","heartbeat_back_addr":"172.21.15.72:6817/1791583949","heartbeat_front_addr":"172.21.15.72:6815/1791583949","state":["exists","up"]},{"osd":2,"uuid":"ddcccb72-1a1e-4d0a-8d61-4fa48d91cba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6819","nonce":3669016661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6821","nonce":3669016661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6825","nonce":3669016661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":3669016661},{"type":"v1","addr":"172.21.15.72:6823","nonce":3669016661}]},"public_addr":"172.21.15.72:6819/3669016661","cluster_addr":"172.21.15.72:6821/3669016661","heartbeat_back_addr":"172.21.15.72:6825/3669016661","heartbeat_front_addr":"172.21.15.72:6823/3669016661","state":["exists","up"]},{"osd":3,"uuid":"27291f1a-1705-4da7-a15a-4ddc099c08ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6801","nonce":1596269040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6803","nonce":1596269040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6807","nonce":1596269040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1596269040},{"type":"v1","addr":"172.21.15.172:6805","nonce":1596269040}]},"public_addr":"172.21.15.172:6801/1596269040","cluster_addr":"172.21.15.172:6803/1596269040","heartbeat_back_addr":"172.21.15.172:6807/1596269040","heartbeat_front_addr":"172.21.15.172:6805/1596269040","state":["exists","up"]},{"osd":4,"uuid":"88b90845-3e0a-4e4d-80e9-7a70e25dbfac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6809","nonce":3130039887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6811","nonce":3130039887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6815","nonce":3130039887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3130039887},{"type":"v1","addr":"172.21.15.172:6813","nonce":3130039887}]},"public_addr":"172.21.15.172:6809/3130039887","cluster_addr":"172.21.15.172:6811/3130039887","heartbeat_back_addr":"172.21.15.172:6815/3130039887","heartbeat_front_addr":"172.21.15.172:6813/3130039887","state":["exists","up"]},{"osd":5,"uuid":"6095500f-8c30-475a-8f69-ab85226b2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6817","nonce":4144227762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6819","nonce":4144227762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6823","nonce":4144227762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4144227762},{"type":"v1","addr":"172.21.15.172:6821","nonce":4144227762}]},"public_addr":"172.21.15.172:6817/4144227762","cluster_addr":"172.21.15.172:6819/4144227762","heartbeat_back_addr":"172.21.15.172:6823/4144227762","heartbeat_front_addr":"172.21.15.172:6821/4144227762","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:10.113377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:46.911606+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:57:24.691482+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:01.632867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:35.570288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:59:10.181140+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/2582270882":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6800/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/1450624542":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/1827861673":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/3229768069":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6800/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/3141025630":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6801/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/2295310555":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6801/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6801/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/1631679569":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6800/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/1795725640":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/3627388017":"2024-03-20T05:52:08.433691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:01:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.628+0000 7fb8e7400640 1 -- 172.21.15.72:0/3642786083 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb8c806c6b0 msgr2=0x7fb8c806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.628+0000 7fb8e7400640 1 --2- 172.21.15.72:0/3642786083 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb8c806c6b0 0x7fb8c806eb60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb8e01028c0 tx=0x7fb8d4005e70 comp rx=0 tx=0).stop 2024-03-19T06:01:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.628+0000 7fb8e7400640 1 -- 172.21.15.72:0/3642786083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0102a60 msgr2=0x7fb8e01975e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.628+0000 7fb8e7400640 1 --2- 172.21.15.72:0/3642786083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0102a60 0x7fb8e01975e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009230 tx=0x7fb8cc004e30 comp rx=0 tx=0).stop 2024-03-19T06:01:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.628+0000 7fb8e7400640 1 -- 172.21.15.72:0/3642786083 shutdown_connections 2024-03-19T06:01:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.628+0000 7fb8e7400640 1 --2- 172.21.15.72:0/3642786083 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb8c806c6b0 0x7fb8c806eb60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.628+0000 7fb8e7400640 1 --2- 172.21.15.72:0/3642786083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0102a60 0x7fb8e01975e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.628+0000 7fb8e7400640 1 --2- 172.21.15.72:0/3642786083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e0101870 0x7fb8e01970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.628+0000 7fb8e7400640 1 -- 172.21.15.72:0/3642786083 >> 172.21.15.72:0/3642786083 conn(0x7fb8e00fce10 msgr2=0x7fb8e0105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.628+0000 7fb8e7400640 1 -- 172.21.15.72:0/3642786083 shutdown_connections 2024-03-19T06:01:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.628+0000 7fb8e7400640 1 -- 172.21.15.72:0/3642786083 wait complete. 2024-03-19T06:01:30.641 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T05:57:27.222850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-03-19T06:00:50.787240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-03-19T06:00:51.727393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:01:30.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:01:30.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.852+0000 7fa0a9600640 1 -- 172.21.15.72:0/3142562391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0a4100840 msgr2=0x7fa0a4100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:30.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.852+0000 7fa0a9600640 1 --2- 172.21.15.72:0/3142562391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0a4100840 0x7fa0a4100cb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa090009880 tx=0x7fa09002bce0 comp rx=0 tx=0).stop 2024-03-19T06:01:30.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.852+0000 7fa0a9600640 1 -- 172.21.15.72:0/3142562391 shutdown_connections 2024-03-19T06:01:30.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.852+0000 7fa0a9600640 1 --2- 172.21.15.72:0/3142562391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0a4100840 0x7fa0a4100cb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:30.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.852+0000 7fa0a9600640 1 --2- 172.21.15.72:0/3142562391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a40ff650 0x7fa0a40ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:30.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.853+0000 7fa0a9600640 1 -- 172.21.15.72:0/3142562391 >> 172.21.15.72:0/3142562391 conn(0x7fa0a40fabd0 msgr2=0x7fa0a40fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:30.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.853+0000 7fa0a9600640 1 -- 172.21.15.72:0/3142562391 shutdown_connections 2024-03-19T06:01:30.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.853+0000 7fa0a9600640 1 -- 172.21.15.72:0/3142562391 wait complete. 2024-03-19T06:01:30.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.854+0000 7fa0a9600640 1 Processor -- start 2024-03-19T06:01:30.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.854+0000 7fa0a9600640 1 -- start start 2024-03-19T06:01:30.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.854+0000 7fa0a9600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0a40ff650 0x7fa0a4197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:30.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.854+0000 7fa0a9600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4100840 0x7fa0a41976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:30.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.854+0000 7fa0a9600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4197c80 con 0x7fa0a40ff650 2024-03-19T06:01:30.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.854+0000 7fa0a9600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4197df0 con 0x7fa0a4100840 2024-03-19T06:01:30.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.854+0000 7fa0a2a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0a40ff650 0x7fa0a4197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:30.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.854+0000 7fa0a2a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0a40ff650 0x7fa0a4197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37782/0 (socket says 172.21.15.72:37782) 2024-03-19T06:01:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.854+0000 7fa0a2a00640 1 -- 172.21.15.72:0/1460958328 learned_addr learned my addr 172.21.15.72:0/1460958328 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.855+0000 7fa0a2000640 1 --2- 172.21.15.72:0/1460958328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4100840 0x7fa0a41976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.855+0000 7fa0a2a00640 1 -- 172.21.15.72:0/1460958328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4100840 msgr2=0x7fa0a41976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.855+0000 7fa0a2a00640 1 --2- 172.21.15.72:0/1460958328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4100840 0x7fa0a41976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.855+0000 7fa0a2a00640 1 -- 172.21.15.72:0/1460958328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa090009560 con 0x7fa0a40ff650 2024-03-19T06:01:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.855+0000 7fa0a2a00640 1 --2- 172.21.15.72:0/1460958328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0a40ff650 0x7fa0a4197170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c8f0 tx=0x7fa09400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.855+0000 7fa09b400640 1 -- 172.21.15.72:0/1460958328 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa094007b80 con 0x7fa0a40ff650 2024-03-19T06:01:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.855+0000 7fa0a9600640 1 -- 172.21.15.72:0/1460958328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a419c880 con 0x7fa0a40ff650 2024-03-19T06:01:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.855+0000 7fa09b400640 1 -- 172.21.15.72:0/1460958328 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa094007ce0 con 0x7fa0a40ff650 2024-03-19T06:01:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.855+0000 7fa09b400640 1 -- 172.21.15.72:0/1460958328 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0940187d0 con 0x7fa0a40ff650 2024-03-19T06:01:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.856+0000 7fa0a9600640 1 -- 172.21.15.72:0/1460958328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a419cde0 con 0x7fa0a40ff650 2024-03-19T06:01:30.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.857+0000 7fa0a9600640 1 -- 172.21.15.72:0/1460958328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a4104890 con 0x7fa0a40ff650 2024-03-19T06:01:30.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.858+0000 7fa09b400640 1 -- 172.21.15.72:0/1460958328 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa094018a40 con 0x7fa0a40ff650 2024-03-19T06:01:30.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.858+0000 7fa09b400640 1 --2- 172.21.15.72:0/1460958328 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa08806c5f0 0x7fa08806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:30.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.859+0000 7fa09b400640 1 -- 172.21.15.72:0/1460958328 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fa09408ba30 con 0x7fa0a40ff650 2024-03-19T06:01:30.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.859+0000 7fa0a2000640 1 --2- 172.21.15.72:0/1460958328 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa08806c5f0 0x7fa08806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:30.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.860+0000 7fa0a2000640 1 --2- 172.21.15.72:0/1460958328 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa08806c5f0 0x7fa08806eaa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4198680 tx=0x7fa090000bc0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:30.864+0000 7fa09b400640 1 -- 172.21.15.72:0/1460958328 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa0940560b0 con 0x7fa0a40ff650 2024-03-19T06:01:30.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:30 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:01:30.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:30 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3642786083' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T06:01:31.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.057+0000 7fa0a9600640 1 -- 172.21.15.72:0/1460958328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0a402c4a0 con 0x7fa0a40ff650 2024-03-19T06:01:31.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.058+0000 7fa09b400640 1 -- 172.21.15.72:0/1460958328 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0940596d0 con 0x7fa0a40ff650 2024-03-19T06:01:31.051 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-19T06:01:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.061+0000 7fa0a9600640 1 -- 172.21.15.72:0/1460958328 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa08806c5f0 msgr2=0x7fa08806eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.061+0000 7fa0a9600640 1 --2- 172.21.15.72:0/1460958328 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa08806c5f0 0x7fa08806eaa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4198680 tx=0x7fa090000bc0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.061+0000 7fa0a9600640 1 -- 172.21.15.72:0/1460958328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0a40ff650 msgr2=0x7fa0a4197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.061+0000 7fa0a9600640 1 --2- 172.21.15.72:0/1460958328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0a40ff650 0x7fa0a4197170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c8f0 tx=0x7fa09400cdb0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.061+0000 7fa0a9600640 1 -- 172.21.15.72:0/1460958328 shutdown_connections 2024-03-19T06:01:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.061+0000 7fa0a9600640 1 --2- 172.21.15.72:0/1460958328 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa08806c5f0 0x7fa08806eaa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.061+0000 7fa0a9600640 1 --2- 172.21.15.72:0/1460958328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0a4100840 0x7fa0a41976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.061+0000 7fa0a9600640 1 --2- 172.21.15.72:0/1460958328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0a40ff650 0x7fa0a4197170 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.061+0000 7fa0a9600640 1 -- 172.21.15.72:0/1460958328 >> 172.21.15.72:0/1460958328 conn(0x7fa0a40fabd0 msgr2=0x7fa0a4101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:31.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.061+0000 7fa0a9600640 1 -- 172.21.15.72:0/1460958328 shutdown_connections 2024-03-19T06:01:31.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.061+0000 7fa0a9600640 1 -- 172.21.15.72:0/1460958328 wait complete. 2024-03-19T06:01:31.070 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:30 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:01:31.070 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:30 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3642786083' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T06:01:31.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-03-19T06:01:31.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.293+0000 7f7419800640 1 -- 172.21.15.72:0/1539089923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74140ff640 msgr2=0x7f74140ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:31.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.293+0000 7f7419800640 1 --2- 172.21.15.72:0/1539089923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74140ff640 0x7f74140ffa50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7404009880 tx=0x7f740402bce0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.293+0000 7f7419800640 1 -- 172.21.15.72:0/1539089923 shutdown_connections 2024-03-19T06:01:31.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.293+0000 7f7419800640 1 --2- 172.21.15.72:0/1539089923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7414100830 0x7f7414100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.293+0000 7f7419800640 1 --2- 172.21.15.72:0/1539089923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74140ff640 0x7f74140ffa50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.293+0000 7f7419800640 1 -- 172.21.15.72:0/1539089923 >> 172.21.15.72:0/1539089923 conn(0x7f74140fab80 msgr2=0x7f74140fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:31.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.293+0000 7f7419800640 1 -- 172.21.15.72:0/1539089923 shutdown_connections 2024-03-19T06:01:31.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.293+0000 7f7419800640 1 -- 172.21.15.72:0/1539089923 wait complete. 2024-03-19T06:01:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.294+0000 7f7419800640 1 Processor -- start 2024-03-19T06:01:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.294+0000 7f7419800640 1 -- start start 2024-03-19T06:01:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.294+0000 7f7419800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74140ff640 0x7f74141971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.294+0000 7f7419800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7414100830 0x7f7414197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.294+0000 7f7419800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7414197cd0 con 0x7f74140ff640 2024-03-19T06:01:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.294+0000 7f7419800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7414197e40 con 0x7f7414100830 2024-03-19T06:01:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.295+0000 7f7412a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74140ff640 0x7f74141971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.295+0000 7f7412a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74140ff640 0x7f74141971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37788/0 (socket says 172.21.15.72:37788) 2024-03-19T06:01:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.295+0000 7f7412a00640 1 -- 172.21.15.72:0/3483029391 learned_addr learned my addr 172.21.15.72:0/3483029391 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.295+0000 7f7412000640 1 --2- 172.21.15.72:0/3483029391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7414100830 0x7f7414197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:31.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.295+0000 7f7412a00640 1 -- 172.21.15.72:0/3483029391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7414100830 msgr2=0x7f7414197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:31.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.295+0000 7f7412a00640 1 --2- 172.21.15.72:0/3483029391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7414100830 0x7f7414197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.295+0000 7f7412a00640 1 -- 172.21.15.72:0/3483029391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404009560 con 0x7f74140ff640 2024-03-19T06:01:31.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.295+0000 7f7412000640 1 --2- 172.21.15.72:0/3483029391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7414100830 0x7f7414197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:01:31.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.295+0000 7f7412a00640 1 --2- 172.21.15.72:0/3483029391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74140ff640 0x7f74141971c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7404009230 tx=0x7f7404004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:31.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.296+0000 7f740b400640 1 -- 172.21.15.72:0/3483029391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7404005000 con 0x7f74140ff640 2024-03-19T06:01:31.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.296+0000 7f740b400640 1 -- 172.21.15.72:0/3483029391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7404005610 con 0x7f74140ff640 2024-03-19T06:01:31.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.296+0000 7f740b400640 1 -- 172.21.15.72:0/3483029391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7404034440 con 0x7f74140ff640 2024-03-19T06:01:31.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.296+0000 7f7419800640 1 -- 172.21.15.72:0/3483029391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741419c870 con 0x7f74140ff640 2024-03-19T06:01:31.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.296+0000 7f7419800640 1 -- 172.21.15.72:0/3483029391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741419cd70 con 0x7f74140ff640 2024-03-19T06:01:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.297+0000 7f7419800640 1 -- 172.21.15.72:0/3483029391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7414104880 con 0x7f74140ff640 2024-03-19T06:01:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.299+0000 7f740b400640 1 -- 172.21.15.72:0/3483029391 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7404003880 con 0x7f74140ff640 2024-03-19T06:01:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.300+0000 7f740b400640 1 --2- 172.21.15.72:0/3483029391 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f73f806c5f0 0x7f73f806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.300+0000 7f740b400640 1 -- 172.21.15.72:0/3483029391 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f74040add00 con 0x7f74140ff640 2024-03-19T06:01:31.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.300+0000 7f7412000640 1 --2- 172.21.15.72:0/3483029391 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f73f806c5f0 0x7f73f806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:31.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.301+0000 7f7412000640 1 --2- 172.21.15.72:0/3483029391 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f73f806c5f0 0x7f73f806eaa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f74141986d0 tx=0x7f7400005e50 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.305+0000 7f740b400640 1 -- 172.21.15.72:0/3483029391 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f74040b1030 con 0x7f74140ff640 2024-03-19T06:01:31.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.496+0000 7f7419800640 1 -- 172.21.15.72:0/3483029391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f741402c4a0 con 0x7f74140ff640 2024-03-19T06:01:31.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.497+0000 7f740b400640 1 -- 172.21.15.72:0/3483029391 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v45) v1 ==== 107+0+11 (secure 0 0 0) 0x7f74040410b0 con 0x7f74140ff640 2024-03-19T06:01:31.490 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-19T06:01:31.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.500+0000 7f7419800640 1 -- 172.21.15.72:0/3483029391 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f73f806c5f0 msgr2=0x7f73f806eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:31.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.500+0000 7f7419800640 1 --2- 172.21.15.72:0/3483029391 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f73f806c5f0 0x7f73f806eaa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f74141986d0 tx=0x7f7400005e50 comp rx=0 tx=0).stop 2024-03-19T06:01:31.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.500+0000 7f7419800640 1 -- 172.21.15.72:0/3483029391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74140ff640 msgr2=0x7f74141971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:31.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.500+0000 7f7419800640 1 --2- 172.21.15.72:0/3483029391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74140ff640 0x7f74141971c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7404009230 tx=0x7f7404004e30 comp rx=0 tx=0).stop 2024-03-19T06:01:31.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.500+0000 7f7419800640 1 -- 172.21.15.72:0/3483029391 shutdown_connections 2024-03-19T06:01:31.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.500+0000 7f7419800640 1 --2- 172.21.15.72:0/3483029391 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f73f806c5f0 0x7f73f806eaa0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.500+0000 7f7419800640 1 --2- 172.21.15.72:0/3483029391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7414100830 0x7f7414197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.500+0000 7f7419800640 1 --2- 172.21.15.72:0/3483029391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74140ff640 0x7f74141971c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.500+0000 7f7419800640 1 -- 172.21.15.72:0/3483029391 >> 172.21.15.72:0/3483029391 conn(0x7f74140fab80 msgr2=0x7f7414101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:31.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.500+0000 7f7419800640 1 -- 172.21.15.72:0/3483029391 shutdown_connections 2024-03-19T06:01:31.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.500+0000 7f7419800640 1 -- 172.21.15.72:0/3483029391 wait complete. 2024-03-19T06:01:31.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-03-19T06:01:31.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.735+0000 7f3602c00640 1 -- 172.21.15.72:0/3868272177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35fc0ff630 msgr2=0x7f35fc0ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:31.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.735+0000 7f3602c00640 1 --2- 172.21.15.72:0/3868272177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35fc0ff630 0x7f35fc0ffa40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009880 tx=0x7f35ec02bce0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.735+0000 7f3602c00640 1 -- 172.21.15.72:0/3868272177 shutdown_connections 2024-03-19T06:01:31.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.735+0000 7f3602c00640 1 --2- 172.21.15.72:0/3868272177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35fc1008c0 0x7f35fc100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.735+0000 7f3602c00640 1 --2- 172.21.15.72:0/3868272177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35fc0ff630 0x7f35fc0ffa40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.735+0000 7f3602c00640 1 -- 172.21.15.72:0/3868272177 >> 172.21.15.72:0/3868272177 conn(0x7f35fc0fac50 msgr2=0x7f35fc0fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:31.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.735+0000 7f3602c00640 1 -- 172.21.15.72:0/3868272177 shutdown_connections 2024-03-19T06:01:31.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.735+0000 7f3602c00640 1 -- 172.21.15.72:0/3868272177 wait complete. 2024-03-19T06:01:31.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.737+0000 7f3602c00640 1 Processor -- start 2024-03-19T06:01:31.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.737+0000 7f3602c00640 1 -- start start 2024-03-19T06:01:31.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.737+0000 7f3602c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35fc0ff630 0x7f35fc194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.737+0000 7f3602c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35fc1008c0 0x7f35fc1954a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.737+0000 7f3602c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc1959e0 con 0x7f35fc1008c0 2024-03-19T06:01:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.737+0000 7f3602c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc195b50 con 0x7f35fc0ff630 2024-03-19T06:01:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.737+0000 7f35fb400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35fc1008c0 0x7f35fc1954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.737+0000 7f35fb400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35fc1008c0 0x7f35fc1954a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37806/0 (socket says 172.21.15.72:37806) 2024-03-19T06:01:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.737+0000 7f35fb400640 1 -- 172.21.15.72:0/1503981521 learned_addr learned my addr 172.21.15.72:0/1503981521 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.738+0000 7f35fbe00640 1 --2- 172.21.15.72:0/1503981521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35fc0ff630 0x7f35fc194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.738+0000 7f35fb400640 1 -- 172.21.15.72:0/1503981521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35fc0ff630 msgr2=0x7f35fc194f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.738+0000 7f35fb400640 1 --2- 172.21.15.72:0/1503981521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35fc0ff630 0x7f35fc194f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.738+0000 7f35fb400640 1 -- 172.21.15.72:0/1503981521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec009560 con 0x7f35fc1008c0 2024-03-19T06:01:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.738+0000 7f35fb400640 1 --2- 172.21.15.72:0/1503981521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35fc1008c0 0x7f35fc1954a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f35e800c8f0 tx=0x7f35e800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:31.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.738+0000 7f35f8c00640 1 -- 172.21.15.72:0/1503981521 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35e80041f0 con 0x7f35fc1008c0 2024-03-19T06:01:31.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.738+0000 7f35f8c00640 1 -- 172.21.15.72:0/1503981521 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35e8007e00 con 0x7f35fc1008c0 2024-03-19T06:01:31.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.738+0000 7f35f8c00640 1 -- 172.21.15.72:0/1503981521 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35e800f450 con 0x7f35fc1008c0 2024-03-19T06:01:31.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.738+0000 7f3602c00640 1 -- 172.21.15.72:0/1503981521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc19a620 con 0x7f35fc1008c0 2024-03-19T06:01:31.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.739+0000 7f3602c00640 1 -- 172.21.15.72:0/1503981521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc19ab50 con 0x7f35fc1008c0 2024-03-19T06:01:31.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.740+0000 7f3602c00640 1 -- 172.21.15.72:0/1503981521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc108170 con 0x7f35fc1008c0 2024-03-19T06:01:31.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.741+0000 7f35f8c00640 1 -- 172.21.15.72:0/1503981521 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f35e8004350 con 0x7f35fc1008c0 2024-03-19T06:01:31.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.742+0000 7f35f8c00640 1 --2- 172.21.15.72:0/1503981521 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f35e006c5f0 0x7f35e006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:31.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.742+0000 7f35f8c00640 1 -- 172.21.15.72:0/1503981521 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f35e8013070 con 0x7f35fc1008c0 2024-03-19T06:01:31.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.742+0000 7f35fbe00640 1 --2- 172.21.15.72:0/1503981521 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f35e006c5f0 0x7f35e006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:31.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.743+0000 7f35fbe00640 1 --2- 172.21.15.72:0/1503981521 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f35e006c5f0 0x7f35e006eaa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f35ec02c7c0 tx=0x7f35ec02cf90 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:31.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.746+0000 7f35f8c00640 1 -- 172.21.15.72:0/1503981521 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f35e8056050 con 0x7f35fc1008c0 2024-03-19T06:01:31.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.945+0000 7f3602c00640 1 -- 172.21.15.72:0/1503981521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f35fc19ae20 con 0x7f35fc1008c0 2024-03-19T06:01:31.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.946+0000 7f35f8c00640 1 -- 172.21.15.72:0/1503981521 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v45) v1 ==== 107+0+11 (secure 0 0 0) 0x7f35e8059670 con 0x7f35fc1008c0 2024-03-19T06:01:31.939 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-19T06:01:31.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.949+0000 7f3602c00640 1 -- 172.21.15.72:0/1503981521 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f35e006c5f0 msgr2=0x7f35e006eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.949+0000 7f3602c00640 1 --2- 172.21.15.72:0/1503981521 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f35e006c5f0 0x7f35e006eaa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f35ec02c7c0 tx=0x7f35ec02cf90 comp rx=0 tx=0).stop 2024-03-19T06:01:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.949+0000 7f3602c00640 1 -- 172.21.15.72:0/1503981521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35fc1008c0 msgr2=0x7f35fc1954a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.949+0000 7f3602c00640 1 --2- 172.21.15.72:0/1503981521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35fc1008c0 0x7f35fc1954a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f35e800c8f0 tx=0x7f35e800cdb0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.949+0000 7f3602c00640 1 -- 172.21.15.72:0/1503981521 shutdown_connections 2024-03-19T06:01:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.949+0000 7f3602c00640 1 --2- 172.21.15.72:0/1503981521 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f35e006c5f0 0x7f35e006eaa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.949+0000 7f3602c00640 1 --2- 172.21.15.72:0/1503981521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35fc1008c0 0x7f35fc1954a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.949+0000 7f3602c00640 1 --2- 172.21.15.72:0/1503981521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35fc0ff630 0x7f35fc194f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.949+0000 7f3602c00640 1 -- 172.21.15.72:0/1503981521 >> 172.21.15.72:0/1503981521 conn(0x7f35fc0fac50 msgr2=0x7f35fc103af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.949+0000 7f3602c00640 1 -- 172.21.15.72:0/1503981521 shutdown_connections 2024-03-19T06:01:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:31.949+0000 7f3602c00640 1 -- 172.21.15.72:0/1503981521 wait complete. 2024-03-19T06:01:31.958 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:31 smithi072 ceph-mon[28706]: pgmap v243: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:31.958 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:31 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1460958328' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-19T06:01:31.958 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:31 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3483029391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-19T06:01:31.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:01:32.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.157+0000 7fcfa3c00640 1 -- 172.21.15.72:0/1450284591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf9c0ff640 msgr2=0x7fcf9c0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.157+0000 7fcfa3c00640 1 --2- 172.21.15.72:0/1450284591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf9c0ff640 0x7fcf9c0ffa50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009880 tx=0x7fcf9002bce0 comp rx=0 tx=0).stop 2024-03-19T06:01:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.157+0000 7fcfa3c00640 1 -- 172.21.15.72:0/1450284591 shutdown_connections 2024-03-19T06:01:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.157+0000 7fcfa3c00640 1 --2- 172.21.15.72:0/1450284591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf9c100830 0x7fcf9c100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.157+0000 7fcfa3c00640 1 --2- 172.21.15.72:0/1450284591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf9c0ff640 0x7fcf9c0ffa50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.157+0000 7fcfa3c00640 1 -- 172.21.15.72:0/1450284591 >> 172.21.15.72:0/1450284591 conn(0x7fcf9c0fabc0 msgr2=0x7fcf9c0fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.157+0000 7fcfa3c00640 1 -- 172.21.15.72:0/1450284591 shutdown_connections 2024-03-19T06:01:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.157+0000 7fcfa3c00640 1 -- 172.21.15.72:0/1450284591 wait complete. 2024-03-19T06:01:32.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.158+0000 7fcfa3c00640 1 Processor -- start 2024-03-19T06:01:32.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.159+0000 7fcfa3c00640 1 -- start start 2024-03-19T06:01:32.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.159+0000 7fcfa3c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf9c0ff640 0x7fcf9c074010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.159+0000 7fcfa3c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf9c100830 0x7fcf9c072650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.159+0000 7fcfa3c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c072b90 con 0x7fcf9c100830 2024-03-19T06:01:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.159+0000 7fcfa3c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c072d00 con 0x7fcf9c0ff640 2024-03-19T06:01:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.159+0000 7fcf9be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf9c100830 0x7fcf9c072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.159+0000 7fcf9be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf9c100830 0x7fcf9c072650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37822/0 (socket says 172.21.15.72:37822) 2024-03-19T06:01:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.159+0000 7fcf9be00640 1 -- 172.21.15.72:0/313181172 learned_addr learned my addr 172.21.15.72:0/313181172 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.159+0000 7fcfa1200640 1 --2- 172.21.15.72:0/313181172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf9c0ff640 0x7fcf9c074010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.161+0000 7fcf9be00640 1 -- 172.21.15.72:0/313181172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf9c0ff640 msgr2=0x7fcf9c074010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.161+0000 7fcf9be00640 1 --2- 172.21.15.72:0/313181172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf9c0ff640 0x7fcf9c074010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.161+0000 7fcf9be00640 1 -- 172.21.15.72:0/313181172 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf90009560 con 0x7fcf9c100830 2024-03-19T06:01:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.161+0000 7fcf9be00640 1 --2- 172.21.15.72:0/313181172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf9c100830 0x7fcf9c072650 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800d6f0 tx=0x7fcf8800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.161+0000 7fcf99600640 1 -- 172.21.15.72:0/313181172 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf88009a30 con 0x7fcf9c100830 2024-03-19T06:01:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.161+0000 7fcf99600640 1 -- 172.21.15.72:0/313181172 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcf880054d0 con 0x7fcf9c100830 2024-03-19T06:01:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.161+0000 7fcf99600640 1 -- 172.21.15.72:0/313181172 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf88010460 con 0x7fcf9c100830 2024-03-19T06:01:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.161+0000 7fcfa3c00640 1 -- 172.21.15.72:0/313181172 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9c072fe0 con 0x7fcf9c100830 2024-03-19T06:01:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.161+0000 7fcfa3c00640 1 -- 172.21.15.72:0/313181172 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c19cf20 con 0x7fcf9c100830 2024-03-19T06:01:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.162+0000 7fcfa3c00640 1 -- 172.21.15.72:0/313181172 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9c108220 con 0x7fcf9c100830 2024-03-19T06:01:32.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:31 smithi172 ceph-mon[35716]: pgmap v243: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:32.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:31 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1460958328' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-19T06:01:32.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:31 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3483029391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-19T06:01:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.163+0000 7fcf99600640 1 -- 172.21.15.72:0/313181172 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcf88009b90 con 0x7fcf9c100830 2024-03-19T06:01:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.164+0000 7fcf99600640 1 --2- 172.21.15.72:0/313181172 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fcf8406c700 0x7fcf8406ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.164+0000 7fcf99600640 1 -- 172.21.15.72:0/313181172 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fcf8808b4c0 con 0x7fcf9c100830 2024-03-19T06:01:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.164+0000 7fcfa1200640 1 --2- 172.21.15.72:0/313181172 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fcf8406c700 0x7fcf8406ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.165+0000 7fcfa1200640 1 --2- 172.21.15.72:0/313181172 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fcf8406c700 0x7fcf8406ebb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcf90006010 tx=0x7fcf9002cf90 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.169+0000 7fcf99600640 1 -- 172.21.15.72:0/313181172 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcf88055b00 con 0x7fcf9c100830 2024-03-19T06:01:32.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.410+0000 7fcfa3c00640 1 -- 172.21.15.72:0/313181172 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf9c108490 con 0x7fcf9c100830 2024-03-19T06:01:32.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.410+0000 7fcf99600640 1 -- 172.21.15.72:0/313181172 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4752 (secure 0 0 0) 0x7fcf88059120 con 0x7fcf9c100830 2024-03-19T06:01:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:01:32.404 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:01:14.992147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.72:6827/772635337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":772635337},{"type":"v1","addr":"172.21.15.72:6827","nonce":772635337}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24227":{"gid":24227,"name":"cephfs.smithi172.xlokxp","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.172:6825/2806079216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2806079216},{"type":"v1","addr":"172.21.15.172:6825","nonce":2806079216}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:01:32.404 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 13 2024-03-19T06:01:32.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.413+0000 7fcfa3c00640 1 -- 172.21.15.72:0/313181172 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fcf8406c700 msgr2=0x7fcf8406ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:32.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.413+0000 7fcfa3c00640 1 --2- 172.21.15.72:0/313181172 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fcf8406c700 0x7fcf8406ebb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcf90006010 tx=0x7fcf9002cf90 comp rx=0 tx=0).stop 2024-03-19T06:01:32.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.413+0000 7fcfa3c00640 1 -- 172.21.15.72:0/313181172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf9c100830 msgr2=0x7fcf9c072650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:32.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.413+0000 7fcfa3c00640 1 --2- 172.21.15.72:0/313181172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf9c100830 0x7fcf9c072650 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800d6f0 tx=0x7fcf8800dbb0 comp rx=0 tx=0).stop 2024-03-19T06:01:32.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.413+0000 7fcfa3c00640 1 -- 172.21.15.72:0/313181172 shutdown_connections 2024-03-19T06:01:32.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.413+0000 7fcfa3c00640 1 --2- 172.21.15.72:0/313181172 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fcf8406c700 0x7fcf8406ebb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:32.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.413+0000 7fcfa3c00640 1 --2- 172.21.15.72:0/313181172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf9c100830 0x7fcf9c072650 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:32.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.413+0000 7fcfa3c00640 1 --2- 172.21.15.72:0/313181172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf9c0ff640 0x7fcf9c074010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:32.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.413+0000 7fcfa3c00640 1 -- 172.21.15.72:0/313181172 >> 172.21.15.72:0/313181172 conn(0x7fcf9c0fabc0 msgr2=0x7fcf9c103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:32.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.413+0000 7fcfa3c00640 1 -- 172.21.15.72:0/313181172 shutdown_connections 2024-03-19T06:01:32.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:32.413+0000 7fcfa3c00640 1 -- 172.21.15.72:0/313181172 wait complete. 2024-03-19T06:01:32.424 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 2, 'flags': 18} 2024-03-19T06:01:32.424 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-19T06:01:32.461 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-19T06:01:32.462 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-03-19T06:01:32.462 INFO:tasks.ceph_fuse:client.0 config is {} 2024-03-19T06:01:32.462 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-19T06:01:32.462 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-19T06:01:32.462 INFO:tasks.ceph_fuse:client.1 config is {} 2024-03-19T06:01:32.462 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-19T06:01:32.462 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-19T06:01:32.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:32.463 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-03-19T06:01:32.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:32.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2024-03-19T06:01:32.610 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2024-03-19T06:01:32.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:01:32.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:32.614 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-03-19T06:01:32.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:32.671 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2024-03-19T06:01:32.771 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2024-03-19T06:01:32.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:01:32.775 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-19T06:01:32.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph fs ls 2024-03-19T06:01:33.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:32 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1503981521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-19T06:01:33.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:32 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:33.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:32 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:33.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:32 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:01:33.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:32 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:01:33.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:32 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:33.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:32 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/313181172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-19T06:01:33.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:32 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1503981521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-19T06:01:33.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:32 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:33.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:32 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:33.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:32 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:01:33.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:32 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:01:33.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:32 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:33.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:32 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/313181172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-19T06:01:33.193 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:01:34.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:34 smithi072 ceph-mon[28706]: pgmap v244: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:34.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:34 smithi172 ceph-mon[35716]: pgmap v244: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:35.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.684+0000 7f8407000700 1 -- 172.21.15.72:0/273850640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8400102470 msgr2=0x7f84001028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:35.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.684+0000 7f8407000700 1 --2- 172.21.15.72:0/273850640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8400102470 0x7f84001028e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009910 tx=0x7f83ec009c20 comp rx=0 tx=0).stop 2024-03-19T06:01:35.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.684+0000 7f8407000700 1 -- 172.21.15.72:0/273850640 shutdown_connections 2024-03-19T06:01:35.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.684+0000 7f8407000700 1 --2- 172.21.15.72:0/273850640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8400102470 0x7f84001028e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:35.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.684+0000 7f8407000700 1 --2- 172.21.15.72:0/273850640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8400108470 0x7f8400108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:35.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.684+0000 7f8407000700 1 -- 172.21.15.72:0/273850640 >> 172.21.15.72:0/273850640 conn(0x7f84000fdf90 msgr2=0x7f84001003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:35.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.684+0000 7f8407000700 1 -- 172.21.15.72:0/273850640 shutdown_connections 2024-03-19T06:01:35.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.684+0000 7f8407000700 1 -- 172.21.15.72:0/273850640 wait complete. 2024-03-19T06:01:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.686+0000 7f8407000700 1 Processor -- start 2024-03-19T06:01:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.686+0000 7f8407000700 1 -- start start 2024-03-19T06:01:35.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.687+0000 7f8407000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8400102470 0x7f84001981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:35.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.687+0000 7f8407000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8400108470 0x7f8400198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:35.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.687+0000 7f8407000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8400198e10 con 0x7f8400102470 2024-03-19T06:01:35.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.687+0000 7f8407000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840019cba0 con 0x7f8400108470 2024-03-19T06:01:35.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.687+0000 7f83ffe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8400102470 0x7f84001981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:35.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.687+0000 7f83ffe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8400102470 0x7f84001981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45554/0 (socket says 172.21.15.72:45554) 2024-03-19T06:01:35.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.687+0000 7f83ffe00700 1 -- 172.21.15.72:0/579966959 learned_addr learned my addr 172.21.15.72:0/579966959 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:35.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.687+0000 7f83ffe00700 1 -- 172.21.15.72:0/579966959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8400108470 msgr2=0x7f8400198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:35.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.687+0000 7f83ffe00700 1 --2- 172.21.15.72:0/579966959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8400108470 0x7f8400198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:35.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.687+0000 7f83ffe00700 1 -- 172.21.15.72:0/579966959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec0095f0 con 0x7f8400102470 2024-03-19T06:01:35.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.688+0000 7f83ffe00700 1 --2- 172.21.15.72:0/579966959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8400102470 0x7f84001981f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f83f000d8d0 tx=0x7f83f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:35.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.688+0000 7f83fcc00700 1 -- 172.21.15.72:0/579966959 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83f0009940 con 0x7f8400102470 2024-03-19T06:01:35.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.688+0000 7f83fcc00700 1 -- 172.21.15.72:0/579966959 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f83f0010460 con 0x7f8400102470 2024-03-19T06:01:35.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.688+0000 7f83fcc00700 1 -- 172.21.15.72:0/579966959 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83f000f5f0 con 0x7f8400102470 2024-03-19T06:01:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.688+0000 7f8407000700 1 -- 172.21.15.72:0/579966959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840019ce80 con 0x7f8400102470 2024-03-19T06:01:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.688+0000 7f8407000700 1 -- 172.21.15.72:0/579966959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840019d3d0 con 0x7f8400102470 2024-03-19T06:01:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.689+0000 7f8407000700 1 -- 172.21.15.72:0/579966959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840010a970 con 0x7f8400102470 2024-03-19T06:01:35.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.690+0000 7f83fcc00700 1 -- 172.21.15.72:0/579966959 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f83f00105d0 con 0x7f8400102470 2024-03-19T06:01:35.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.691+0000 7f83fcc00700 1 --2- 172.21.15.72:0/579966959 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f83e406c680 0x7f83e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:35.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.691+0000 7f83fcc00700 1 -- 172.21.15.72:0/579966959 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f83f008b7b0 con 0x7f8400102470 2024-03-19T06:01:35.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.691+0000 7f83ff400700 1 --2- 172.21.15.72:0/579966959 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f83e406c680 0x7f83e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:35.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.692+0000 7f83ff400700 1 --2- 172.21.15.72:0/579966959 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f83e406c680 0x7f83e406eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00b5c0 tx=0x7f83ec005fd0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:35.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.695+0000 7f83fcc00700 1 -- 172.21.15.72:0/579966959 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f83f0055f10 con 0x7f8400102470 2024-03-19T06:01:35.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.957+0000 7f8407000700 1 -- 172.21.15.72:0/579966959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8400199620 con 0x7f8400102470 2024-03-19T06:01:35.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.958+0000 7f83fcc00700 1 -- 172.21.15.72:0/579966959 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7f83f005de60 con 0x7f8400102470 2024-03-19T06:01:35.950 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-03-19T06:01:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.961+0000 7f8407000700 1 -- 172.21.15.72:0/579966959 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f83e406c680 msgr2=0x7f83e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.961+0000 7f8407000700 1 --2- 172.21.15.72:0/579966959 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f83e406c680 0x7f83e406eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00b5c0 tx=0x7f83ec005fd0 comp rx=0 tx=0).stop 2024-03-19T06:01:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.961+0000 7f8407000700 1 -- 172.21.15.72:0/579966959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8400102470 msgr2=0x7f84001981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.961+0000 7f8407000700 1 --2- 172.21.15.72:0/579966959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8400102470 0x7f84001981f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f83f000d8d0 tx=0x7f83f000dc90 comp rx=0 tx=0).stop 2024-03-19T06:01:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.961+0000 7f8407000700 1 -- 172.21.15.72:0/579966959 shutdown_connections 2024-03-19T06:01:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.961+0000 7f8407000700 1 --2- 172.21.15.72:0/579966959 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f83e406c680 0x7f83e406eb30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.961+0000 7f8407000700 1 --2- 172.21.15.72:0/579966959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8400102470 0x7f84001981f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.961+0000 7f8407000700 1 --2- 172.21.15.72:0/579966959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8400108470 0x7f8400198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.961+0000 7f8407000700 1 -- 172.21.15.72:0/579966959 >> 172.21.15.72:0/579966959 conn(0x7f84000fdf90 msgr2=0x7f84000ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.962+0000 7f8407000700 1 -- 172.21.15.72:0/579966959 shutdown_connections 2024-03-19T06:01:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:35.962+0000 7f8407000700 1 -- 172.21.15.72:0/579966959 wait complete. 2024-03-19T06:01:36.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:36 smithi072 ceph-mon[28706]: pgmap v245: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:36 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/579966959' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-19T06:01:36.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:36 smithi172 ceph-mon[35716]: pgmap v245: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:36.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:36 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/579966959' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-19T06:01:36.951 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:01:36.951 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:01:36.951 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-03-19T06:01:36.951 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-19T06:01:36.951 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-19T06:01:36.951 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:01:36.951 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:01:36.951 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:01:36.951 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:01:36.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:36.952 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-03-19T06:01:37.002 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:01:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:01:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:01:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:01:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-03-19T06:01:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:01:37.002 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-19T06:01:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:01:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-03-19T06:01:37.002 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-19T06:01:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:01:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-03-19T06:01:37.003 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-19T06:01:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:01:37.003 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:01:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:01:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-19T06:01:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 41937sec preferred_lft 41937sec 2024-03-19T06:01:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-03-19T06:01:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:01:37.003 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-19T06:01:37.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:37.004 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2024-03-19T06:01:37.004 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-19T06:01:37.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2024-03-19T06:01:37.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2024-03-19T06:01:37.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2024-03-19T06:01:37.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-19T06:01:37.004 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-19T06:01:37.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:37.551 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:01:37.631 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-03-19T06:01:37.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:37.634 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-03-19T06:01:37.724 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-03-19T06:01:37.725 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:01:37.725 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-19T06:01:37.725 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-19T06:01:37.725 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:01:37.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:37.726 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2024-03-19T06:01:37.726 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-19T06:01:37.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-19T06:01:37.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-19T06:01:37.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-19T06:01:37.727 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-19T06:01:38.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:38 smithi072 ceph-mon[28706]: pgmap v246: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:38.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:38 smithi172 ceph-mon[35716]: pgmap v246: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:38.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:38.666 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-03-19T06:01:38.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:38.720 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2024-03-19T06:01:38.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:38.770 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2024-03-19T06:01:38.770 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-19T06:01:38.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:01:38.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-19T06:01:38.771 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-19T06:01:38.913 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-19T06:01:38.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:38.913 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2024-03-19T06:01:38.913 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-19T06:01:38.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-19T06:01:38.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-19T06:01:38.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-19T06:01:38.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-19T06:01:38.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-19T06:01:38.914 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-19T06:01:39.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:39.186 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2024-03-19T06:01:39.186 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-19T06:01:39.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2024-03-19T06:01:39.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2024-03-19T06:01:39.186 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-19T06:01:39.349 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-19T06:01:39.349 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:01:39.350 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-19T06:01:39.394 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:01:39.394 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:01:39.394 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:01:39.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-03-19T06:01:39.579 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:01:39.631 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-03-19T06:01:39.631 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-03-19T06:01:39.631 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-03-19T06:01:39.631 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-03-19T06:01:39.631 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-03-19T06:01:39.631 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-03-19T06:01:39.631 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-03-19T06:01:39.631 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-03-19T06:01:39.631 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-03-19T06:01:39.631 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:01:39.632 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:01:39.633 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-03-19T06:01:39.633 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-03-19T06:01:39.633 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay 2024-03-19T06:01:39.633 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/2382e46878e05384b7da43402388834fa3912bf480e6b6d1d3ace3ce22354495/merged 2024-03-19T06:01:39.633 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/91b680b26f9ba9a5509555b90661a01faa28371c8b9f080b440f5b56bcbe48ae/merged 2024-03-19T06:01:39.633 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/0 2024-03-19T06:01:39.633 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:01:39.633 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/3eb80975cb94850ac4ba04d88fe5c45db443e2528d87f08d6200ed8e23b0cbb6/merged 2024-03-19T06:01:39.633 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/89da2e245fb8e1b7d5b6dd6f6d45e877230acf4cba0c1926644ca195bdc5dc18/merged 2024-03-19T06:01:39.633 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/68f41ddf487725b5a2f7a76ecccdc84f67867733748e13438201d663baa9fe04/merged 2024-03-19T06:01:39.634 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/01b17ff1854628dccdedc923d177f776c8cf770aaf6d6f1ad0c9cc35257e0f52/merged 2024-03-19T06:01:39.634 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/b3e474d85225af793c0ec638af624b3e5923cafdd319dd039dd34b41a0ba3547/merged 2024-03-19T06:01:39.634 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/2b1455d81bd185f97a94e8b617b92c4778cf9a19a2b25ae17f31d9e5b50f58a7/merged 2024-03-19T06:01:39.634 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/d588d4b6c11b01fef8cc6483785ce6e9f6d30b4210b753de39e906ab65ecb85f/merged 2024-03-19T06:01:39.634 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/afde38fd9773e0792e0dd5a44deb6e563101bdd1a36e55d94487a4fb9d2bb394/merged 2024-03-19T06:01:39.634 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/4b3fa5e2c1589dda98f4b3f1200e48ad31013888ccd531ef2f9d05a6ef6d8dd0/merged 2024-03-19T06:01:39.634 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/ce36ea8363ceb2ae0b5d562334c127f6cdd65a6e4ff5a44e2d182b4cd7e6e056/merged 2024-03-19T06:01:39.634 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/b98b49bbbaee671d7b98625ab5b945be460b5511f558a02329e97ced048d8746/merged 2024-03-19T06:01:39.634 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-03-19T06:01:39.634 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:01:39.634 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:01:39.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:39.635 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-03-19T06:01:39.684 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-19T06:01:39.684 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-19T06:01:39.731 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-03-19T06:01:39.808 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:01:39.850 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-03-19T06:01:39.850 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-03-19T06:01:39.850 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-03-19T06:01:39.850 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-03-19T06:01:39.850 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-03-19T06:01:39.850 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-03-19T06:01:39.851 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/2382e46878e05384b7da43402388834fa3912bf480e6b6d1d3ace3ce22354495/merged 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/91b680b26f9ba9a5509555b90661a01faa28371c8b9f080b440f5b56bcbe48ae/merged 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/0 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/3eb80975cb94850ac4ba04d88fe5c45db443e2528d87f08d6200ed8e23b0cbb6/merged 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/89da2e245fb8e1b7d5b6dd6f6d45e877230acf4cba0c1926644ca195bdc5dc18/merged 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/68f41ddf487725b5a2f7a76ecccdc84f67867733748e13438201d663baa9fe04/merged 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/01b17ff1854628dccdedc923d177f776c8cf770aaf6d6f1ad0c9cc35257e0f52/merged 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/b3e474d85225af793c0ec638af624b3e5923cafdd319dd039dd34b41a0ba3547/merged 2024-03-19T06:01:39.852 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/2b1455d81bd185f97a94e8b617b92c4778cf9a19a2b25ae17f31d9e5b50f58a7/merged 2024-03-19T06:01:39.853 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/d588d4b6c11b01fef8cc6483785ce6e9f6d30b4210b753de39e906ab65ecb85f/merged 2024-03-19T06:01:39.853 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/afde38fd9773e0792e0dd5a44deb6e563101bdd1a36e55d94487a4fb9d2bb394/merged 2024-03-19T06:01:39.853 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/4b3fa5e2c1589dda98f4b3f1200e48ad31013888ccd531ef2f9d05a6ef6d8dd0/merged 2024-03-19T06:01:39.853 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/ce36ea8363ceb2ae0b5d562334c127f6cdd65a6e4ff5a44e2d182b4cd7e6e056/merged 2024-03-19T06:01:39.853 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/b98b49bbbaee671d7b98625ab5b945be460b5511f558a02329e97ced048d8746/merged 2024-03-19T06:01:39.853 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-03-19T06:01:39.853 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:01:39.853 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:01:39.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:39.854 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-03-19T06:01:39.944 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:2024-03-19T06:01:39.952+0000 7f0549238480 -1 init, newargv = 0x565433c168a0 newargc=15 2024-03-19T06:01:39.944 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[66577]: starting ceph client 2024-03-19T06:01:39.964 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[66577]: starting fuse 2024-03-19T06:01:40.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:40 smithi072 ceph-mon[28706]: pgmap v247: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:40.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:40 smithi172 ceph-mon[35716]: pgmap v247: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:41.046 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-03-19T06:01:41.141 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:01:41.192 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-03-19T06:01:41.192 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-03-19T06:01:41.192 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-03-19T06:01:41.192 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-03-19T06:01:41.192 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-03-19T06:01:41.192 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-03-19T06:01:41.192 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-03-19T06:01:41.192 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-03-19T06:01:41.192 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-03-19T06:01:41.192 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-03-19T06:01:41.193 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-03-19T06:01:41.193 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-03-19T06:01:41.193 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:01:41.193 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-03-19T06:01:41.193 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-03-19T06:01:41.193 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-03-19T06:01:41.193 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-03-19T06:01:41.193 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:01:41.193 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-03-19T06:01:41.193 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-03-19T06:01:41.193 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:01:41.193 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/2382e46878e05384b7da43402388834fa3912bf480e6b6d1d3ace3ce22354495/merged 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/91b680b26f9ba9a5509555b90661a01faa28371c8b9f080b440f5b56bcbe48ae/merged 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/0 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/3eb80975cb94850ac4ba04d88fe5c45db443e2528d87f08d6200ed8e23b0cbb6/merged 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/89da2e245fb8e1b7d5b6dd6f6d45e877230acf4cba0c1926644ca195bdc5dc18/merged 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/68f41ddf487725b5a2f7a76ecccdc84f67867733748e13438201d663baa9fe04/merged 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/01b17ff1854628dccdedc923d177f776c8cf770aaf6d6f1ad0c9cc35257e0f52/merged 2024-03-19T06:01:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/b3e474d85225af793c0ec638af624b3e5923cafdd319dd039dd34b41a0ba3547/merged 2024-03-19T06:01:41.195 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/2b1455d81bd185f97a94e8b617b92c4778cf9a19a2b25ae17f31d9e5b50f58a7/merged 2024-03-19T06:01:41.195 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/d588d4b6c11b01fef8cc6483785ce6e9f6d30b4210b753de39e906ab65ecb85f/merged 2024-03-19T06:01:41.195 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/afde38fd9773e0792e0dd5a44deb6e563101bdd1a36e55d94487a4fb9d2bb394/merged 2024-03-19T06:01:41.195 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/4b3fa5e2c1589dda98f4b3f1200e48ad31013888ccd531ef2f9d05a6ef6d8dd0/merged 2024-03-19T06:01:41.195 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/ce36ea8363ceb2ae0b5d562334c127f6cdd65a6e4ff5a44e2d182b4cd7e6e056/merged 2024-03-19T06:01:41.195 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/containers/storage/overlay/b98b49bbbaee671d7b98625ab5b945be460b5511f558a02329e97ced048d8746/merged 2024-03-19T06:01:41.195 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-03-19T06:01:41.195 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:01:41.195 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:01:41.195 INFO:teuthology.orchestra.run.smithi072.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-19T06:01:41.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:41.196 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-03-19T06:01:41.251 INFO:teuthology.orchestra.run.smithi072.stdout:158 2024-03-19T06:01:41.251 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [158] 2024-03-19T06:01:41.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:01:41.252 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2024-03-19T06:01:41.252 DEBUG:teuthology.orchestra.run.smithi072:> import re 2024-03-19T06:01:41.252 DEBUG:teuthology.orchestra.run.smithi072:> import os 2024-03-19T06:01:41.252 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2024-03-19T06:01:41.252 DEBUG:teuthology.orchestra.run.smithi072:> 2024-03-19T06:01:41.252 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2024-03-19T06:01:41.253 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-19T06:01:41.253 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2024-03-19T06:01:41.253 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-19T06:01:41.253 DEBUG:teuthology.orchestra.run.smithi072:> 2024-03-19T06:01:41.253 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2024-03-19T06:01:41.253 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2024-03-19T06:01:41.253 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2024-03-19T06:01:41.253 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2024-03-19T06:01:41.253 DEBUG:teuthology.orchestra.run.smithi072:> 2024-03-19T06:01:41.254 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2024-03-19T06:01:41.254 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:01:41.254 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:01:41.254 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:01:41.254 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2024-03-19T06:01:41.254 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2024-03-19T06:01:41.254 DEBUG:teuthology.orchestra.run.smithi072:> return f 2024-03-19T06:01:41.254 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:01:41.254 DEBUG:teuthology.orchestra.run.smithi072:> 2024-03-19T06:01:41.254 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.0")) 2024-03-19T06:01:41.255 DEBUG:teuthology.orchestra.run.smithi072:> ' 2024-03-19T06:01:41.422 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.0.66577.asok 2024-03-19T06:01:41.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:01:41.439 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.66577.asok 2024-03-19T06:01:41.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:41.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.66577.asok status 2024-03-19T06:01:41.676 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:01:41.676 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2024-03-19T06:01:41.676 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-03-19T06:01:41.676 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-03-19T06:01:41.676 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "0", 2024-03-19T06:01:41.676 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "66577", 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 14520, 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 14520 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-03-19T06:01:41.677 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 3828438056 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 3828438056 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.14520 192.168.0.1:0/3828438056", 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/3828438056", 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 13, 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 45, 2024-03-19T06:01:41.678 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:01:41.679 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2024-03-19T06:01:41.679 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2024-03-19T06:01:41.679 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:01:41.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- ceph fs ls 2024-03-19T06:01:42.094 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:01:42.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:42 smithi172 ceph-mon[35716]: pgmap v248: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:42.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:42 smithi072 ceph-mon[28706]: pgmap v248: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:01:44.217 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:44 smithi072 ceph-mon[28706]: pgmap v249: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-19T06:01:44.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.387+0000 7ff1bba00700 1 -- 172.21.15.72:0/2192542388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1b4075b90 msgr2=0x7ff1b4110bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:44.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.387+0000 7ff1bba00700 1 --2- 172.21.15.72:0/2192542388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1b4075b90 0x7ff1b4110bd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009910 tx=0x7ff1a0009c20 comp rx=0 tx=0).stop 2024-03-19T06:01:44.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.387+0000 7ff1bba00700 1 -- 172.21.15.72:0/2192542388 shutdown_connections 2024-03-19T06:01:44.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.387+0000 7ff1bba00700 1 --2- 172.21.15.72:0/2192542388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1b4075b90 0x7ff1b4110bd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:44.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.387+0000 7ff1bba00700 1 --2- 172.21.15.72:0/2192542388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b4075280 0x7ff1b4075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:44.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.387+0000 7ff1bba00700 1 -- 172.21.15.72:0/2192542388 >> 172.21.15.72:0/2192542388 conn(0x7ff1b40fdf90 msgr2=0x7ff1b41003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:44.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.387+0000 7ff1bba00700 1 -- 172.21.15.72:0/2192542388 shutdown_connections 2024-03-19T06:01:44.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.388+0000 7ff1bba00700 1 -- 172.21.15.72:0/2192542388 wait complete. 2024-03-19T06:01:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.389+0000 7ff1bba00700 1 Processor -- start 2024-03-19T06:01:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.389+0000 7ff1bba00700 1 -- start start 2024-03-19T06:01:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.389+0000 7ff1bba00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1b4075280 0x7ff1b419c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.389+0000 7ff1bba00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b4075b90 0x7ff1b419ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.389+0000 7ff1bba00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b419d100 con 0x7ff1b4075280 2024-03-19T06:01:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.389+0000 7ff1bba00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b41a0e90 con 0x7ff1b4075b90 2024-03-19T06:01:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.389+0000 7ff1b9000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1b4075280 0x7ff1b419c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.390+0000 7ff1b9000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1b4075280 0x7ff1b419c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38236/0 (socket says 172.21.15.72:38236) 2024-03-19T06:01:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.390+0000 7ff1b9000700 1 -- 172.21.15.72:0/2098898168 learned_addr learned my addr 172.21.15.72:0/2098898168 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.390+0000 7ff1b9000700 1 -- 172.21.15.72:0/2098898168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b4075b90 msgr2=0x7ff1b419ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.390+0000 7ff1b9000700 1 --2- 172.21.15.72:0/2098898168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b4075b90 0x7ff1b419ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.390+0000 7ff1b9000700 1 -- 172.21.15.72:0/2098898168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00095f0 con 0x7ff1b4075280 2024-03-19T06:01:44.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.390+0000 7ff1b9000700 1 --2- 172.21.15.72:0/2098898168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1b4075280 0x7ff1b419c4e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800d8d0 tx=0x7ff1a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:44.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.390+0000 7ff1b1600700 1 -- 172.21.15.72:0/2098898168 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a8009940 con 0x7ff1b4075280 2024-03-19T06:01:44.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.391+0000 7ff1b1600700 1 -- 172.21.15.72:0/2098898168 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff1a8010460 con 0x7ff1b4075280 2024-03-19T06:01:44.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.391+0000 7ff1bba00700 1 -- 172.21.15.72:0/2098898168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b41a1170 con 0x7ff1b4075280 2024-03-19T06:01:44.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.391+0000 7ff1b1600700 1 -- 172.21.15.72:0/2098898168 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a800f5f0 con 0x7ff1b4075280 2024-03-19T06:01:44.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.391+0000 7ff1bba00700 1 -- 172.21.15.72:0/2098898168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b41a16c0 con 0x7ff1b4075280 2024-03-19T06:01:44.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.392+0000 7ff1bba00700 1 -- 172.21.15.72:0/2098898168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b410e340 con 0x7ff1b4075280 2024-03-19T06:01:44.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.393+0000 7ff1b1600700 1 -- 172.21.15.72:0/2098898168 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff1a80105d0 con 0x7ff1b4075280 2024-03-19T06:01:44.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.394+0000 7ff1b1600700 1 --2- 172.21.15.72:0/2098898168 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ff19c06c680 0x7ff19c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:44.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.394+0000 7ff1b1600700 1 -- 172.21.15.72:0/2098898168 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff1a808b200 con 0x7ff1b4075280 2024-03-19T06:01:44.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.394+0000 7ff1b3e00700 1 --2- 172.21.15.72:0/2098898168 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ff19c06c680 0x7ff19c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:44.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.395+0000 7ff1b3e00700 1 --2- 172.21.15.72:0/2098898168 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ff19c06c680 0x7ff19c06eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000b5c0 tx=0x7ff1a000b770 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:44.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.398+0000 7ff1b1600700 1 -- 172.21.15.72:0/2098898168 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff1a8055960 con 0x7ff1b4075280 2024-03-19T06:01:44.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:44 smithi172 ceph-mon[35716]: pgmap v249: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-19T06:01:44.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.657+0000 7ff1bba00700 1 -- 172.21.15.72:0/2098898168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff1b419d910 con 0x7ff1b4075280 2024-03-19T06:01:44.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.658+0000 7ff1b1600700 1 -- 172.21.15.72:0/2098898168 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7ff1a8058f80 con 0x7ff1b4075280 2024-03-19T06:01:44.651 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-03-19T06:01:44.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.661+0000 7ff1bba00700 1 -- 172.21.15.72:0/2098898168 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ff19c06c680 msgr2=0x7ff19c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:44.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.661+0000 7ff1bba00700 1 --2- 172.21.15.72:0/2098898168 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ff19c06c680 0x7ff19c06eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000b5c0 tx=0x7ff1a000b770 comp rx=0 tx=0).stop 2024-03-19T06:01:44.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.661+0000 7ff1bba00700 1 -- 172.21.15.72:0/2098898168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1b4075280 msgr2=0x7ff1b419c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:44.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.661+0000 7ff1bba00700 1 --2- 172.21.15.72:0/2098898168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1b4075280 0x7ff1b419c4e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800d8d0 tx=0x7ff1a800dc90 comp rx=0 tx=0).stop 2024-03-19T06:01:44.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.661+0000 7ff1bba00700 1 -- 172.21.15.72:0/2098898168 shutdown_connections 2024-03-19T06:01:44.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.661+0000 7ff1bba00700 1 --2- 172.21.15.72:0/2098898168 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ff19c06c680 0x7ff19c06eb30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:44.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.661+0000 7ff1bba00700 1 --2- 172.21.15.72:0/2098898168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1b4075280 0x7ff1b419c4e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:44.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.661+0000 7ff1bba00700 1 --2- 172.21.15.72:0/2098898168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b4075b90 0x7ff1b419ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:44.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.661+0000 7ff1bba00700 1 -- 172.21.15.72:0/2098898168 >> 172.21.15.72:0/2098898168 conn(0x7ff1b40fdf90 msgr2=0x7ff1b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:44.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.661+0000 7ff1bba00700 1 -- 172.21.15.72:0/2098898168 shutdown_connections 2024-03-19T06:01:44.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:44.662+0000 7ff1bba00700 1 -- 172.21.15.72:0/2098898168 wait complete. 2024-03-19T06:01:45.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:45 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2098898168' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-19T06:01:45.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:45 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2098898168' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-19T06:01:45.495 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:01:45.495 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:01:45.495 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-03-19T06:01:45.495 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-19T06:01:45.495 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-19T06:01:45.495 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:01:45.495 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:01:45.496 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:01:45.496 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-19T06:01:45.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:45.496 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-03-19T06:01:45.554 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:01:45.554 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:01:45.554 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:01:45.554 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:01:45.554 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-03-19T06:01:45.554 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:01:45.554 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 41942sec preferred_lft 41942sec 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2024-03-19T06:01:45.555 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:01:45.556 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-19T06:01:45.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:45.557 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-03-19T06:01:45.557 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-03-19T06:01:45.557 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add name ceph-brx type bridge 2024-03-19T06:01:45.557 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr flush dev ceph-brx 2024-03-19T06:01:45.557 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set ceph-brx up 2024-03-19T06:01:45.557 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-19T06:01:45.557 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-03-19T06:01:45.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:45.995 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:01:46.075 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-03-19T06:01:46.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:46.079 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-03-19T06:01:46.133 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-03-19T06:01:46.133 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:01:46.133 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-19T06:01:46.133 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-19T06:01:46.133 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:01:46.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:46.134 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-03-19T06:01:46.134 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-03-19T06:01:46.134 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-19T06:01:46.134 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-19T06:01:46.134 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-19T06:01:46.134 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-03-19T06:01:46.205 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:46 smithi172 ceph-mon[35716]: pgmap v250: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-03-19T06:01:46.205 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:46 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:01:46.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:46 smithi072 ceph-mon[28706]: pgmap v250: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-03-19T06:01:46.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:46 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:01:46.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:46.852 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-03-19T06:01:46.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:46.907 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2024-03-19T06:01:46.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:46.960 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-03-19T06:01:46.960 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-03-19T06:01:46.960 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:01:46.960 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-19T06:01:46.960 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-03-19T06:01:47.104 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-19T06:01:47.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:47.104 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-03-19T06:01:47.104 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-03-19T06:01:47.105 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-19T06:01:47.105 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-19T06:01:47.105 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-19T06:01:47.105 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-19T06:01:47.105 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-19T06:01:47.105 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-03-19T06:01:47.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:47.388 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-03-19T06:01:47.388 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-03-19T06:01:47.388 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-03-19T06:01:47.388 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.0 master ceph-brx 2024-03-19T06:01:47.388 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-03-19T06:01:47.549 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-19T06:01:47.550 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:01:47.550 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-19T06:01:47.601 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-19T06:01:47.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:01:47.601 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-19T06:01:47.651 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2024-03-19T06:01:47.746 DEBUG:teuthology.orchestra.run.smithi172:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:01:47.801 INFO:teuthology.orchestra.run.smithi172.stdout:/proc 2024-03-19T06:01:47.801 INFO:teuthology.orchestra.run.smithi172.stdout:/sys 2024-03-19T06:01:47.801 INFO:teuthology.orchestra.run.smithi172.stdout:/dev 2024-03-19T06:01:47.801 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/security 2024-03-19T06:01:47.801 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/shm 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/pts 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/run 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/cgroup 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/pstore 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/bpf 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/ 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/selinux 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/mqueue 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/hugepages 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/debug 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/tracing 2024-03-19T06:01:47.802 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/fuse/connections 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/config 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/run/user/1000 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/run/user/0 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/96b87a8c24a4d9a6c27de2ae209adc9ebe6449e23ba687fa030f81aca354eb69/merged 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/2baae50985d4dbd6fd21c10658e115c57acdf619c71d5868ba2b4369873f5792/merged 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/18a3f54c8b37bc477cca3af0f95804c8e313ea7822fbf4ee6d5a044189eb027b/merged 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/c075f5bd7f80abb84750fc8d2ac1bd09661d87996a8e9737d51234f387f0bd75/merged 2024-03-19T06:01:47.803 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/20479e924b68f27a324a22662114614ccbfdee90f22ee9828de9dc305749ce48/merged 2024-03-19T06:01:47.804 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/f21955f5a76423ffbe121faac047ce8415a18bdcf971ed71af33e6af61d3dd25/merged 2024-03-19T06:01:47.804 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/d25295fd1c4df1989723e77ed1c81363949b0f49a22b7b251e89679b3e729bcf/merged 2024-03-19T06:01:47.804 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/a44a6eef557564c024cd8c15e4974d819e2eb065a02efb23bbb572bc7b0bfeae/merged 2024-03-19T06:01:47.804 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/b7332b7d576f88af3a01136ca5038f5e844917b3da66b6c0d199e5ac458faacd/merged 2024-03-19T06:01:47.804 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/c6d2c23db6f3ad10594e9f7c0275e2570a39368434e491796546da59f1d469e1/merged 2024-03-19T06:01:47.804 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns 2024-03-19T06:01:47.804 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:01:47.804 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:01:47.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:47.805 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2024-03-19T06:01:47.857 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-19T06:01:47.857 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-19T06:01:47.862 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2024-03-19T06:01:47.934 DEBUG:teuthology.orchestra.run.smithi172:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:01:47.974 INFO:teuthology.orchestra.run.smithi172.stdout:/proc 2024-03-19T06:01:47.974 INFO:teuthology.orchestra.run.smithi172.stdout:/sys 2024-03-19T06:01:47.974 INFO:teuthology.orchestra.run.smithi172.stdout:/dev 2024-03-19T06:01:47.974 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/security 2024-03-19T06:01:47.974 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/shm 2024-03-19T06:01:47.974 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/pts 2024-03-19T06:01:47.974 INFO:teuthology.orchestra.run.smithi172.stdout:/run 2024-03-19T06:01:47.974 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/cgroup 2024-03-19T06:01:47.974 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/pstore 2024-03-19T06:01:47.974 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/bpf 2024-03-19T06:01:47.974 INFO:teuthology.orchestra.run.smithi172.stdout:/ 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/selinux 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/mqueue 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/hugepages 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/debug 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/tracing 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/fuse/connections 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/config 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/run/user/1000 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/run/user/0 2024-03-19T06:01:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/96b87a8c24a4d9a6c27de2ae209adc9ebe6449e23ba687fa030f81aca354eb69/merged 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/2baae50985d4dbd6fd21c10658e115c57acdf619c71d5868ba2b4369873f5792/merged 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/18a3f54c8b37bc477cca3af0f95804c8e313ea7822fbf4ee6d5a044189eb027b/merged 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/c075f5bd7f80abb84750fc8d2ac1bd09661d87996a8e9737d51234f387f0bd75/merged 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/20479e924b68f27a324a22662114614ccbfdee90f22ee9828de9dc305749ce48/merged 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/f21955f5a76423ffbe121faac047ce8415a18bdcf971ed71af33e6af61d3dd25/merged 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/d25295fd1c4df1989723e77ed1c81363949b0f49a22b7b251e89679b3e729bcf/merged 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/a44a6eef557564c024cd8c15e4974d819e2eb065a02efb23bbb572bc7b0bfeae/merged 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/b7332b7d576f88af3a01136ca5038f5e844917b3da66b6c0d199e5ac458faacd/merged 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/c6d2c23db6f3ad10594e9f7c0275e2570a39368434e491796546da59f1d469e1/merged 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:01:47.976 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:01:47.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:47.977 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2024-03-19T06:01:48.075 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:2024-03-19T06:01:48.082+0000 7fb020838480 -1 init, newargv = 0x5643ac9ef450 newargc=15 2024-03-19T06:01:48.075 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[55565]: starting ceph client 2024-03-19T06:01:48.092 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[55565]: starting fuse 2024-03-19T06:01:48.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:48 smithi072 ceph-mon[28706]: pgmap v251: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-03-19T06:01:48.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:48 smithi172 ceph-mon[35716]: pgmap v251: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-03-19T06:01:49.164 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2024-03-19T06:01:49.264 DEBUG:teuthology.orchestra.run.smithi172:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:01:49.318 INFO:teuthology.orchestra.run.smithi172.stdout:/proc 2024-03-19T06:01:49.318 INFO:teuthology.orchestra.run.smithi172.stdout:/sys 2024-03-19T06:01:49.318 INFO:teuthology.orchestra.run.smithi172.stdout:/dev 2024-03-19T06:01:49.318 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/security 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/shm 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/pts 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/run 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/cgroup 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/pstore 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/bpf 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/ 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/selinux 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/mqueue 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/hugepages 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/debug 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/tracing 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/fuse/connections 2024-03-19T06:01:49.319 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/config 2024-03-19T06:01:49.320 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:01:49.320 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:01:49.320 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:01:49.320 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:01:49.320 INFO:teuthology.orchestra.run.smithi172.stdout:/run/user/1000 2024-03-19T06:01:49.320 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph 2024-03-19T06:01:49.320 INFO:teuthology.orchestra.run.smithi172.stdout:/run/user/0 2024-03-19T06:01:49.320 INFO:teuthology.orchestra.run.smithi172.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/96b87a8c24a4d9a6c27de2ae209adc9ebe6449e23ba687fa030f81aca354eb69/merged 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/2baae50985d4dbd6fd21c10658e115c57acdf619c71d5868ba2b4369873f5792/merged 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/18a3f54c8b37bc477cca3af0f95804c8e313ea7822fbf4ee6d5a044189eb027b/merged 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/c075f5bd7f80abb84750fc8d2ac1bd09661d87996a8e9737d51234f387f0bd75/merged 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/20479e924b68f27a324a22662114614ccbfdee90f22ee9828de9dc305749ce48/merged 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/f21955f5a76423ffbe121faac047ce8415a18bdcf971ed71af33e6af61d3dd25/merged 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/d25295fd1c4df1989723e77ed1c81363949b0f49a22b7b251e89679b3e729bcf/merged 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/a44a6eef557564c024cd8c15e4974d819e2eb065a02efb23bbb572bc7b0bfeae/merged 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/b7332b7d576f88af3a01136ca5038f5e844917b3da66b6c0d199e5ac458faacd/merged 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/c6d2c23db6f3ad10594e9f7c0275e2570a39368434e491796546da59f1d469e1/merged 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:01:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-19T06:01:49.322 INFO:teuthology.orchestra.run.smithi172.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-19T06:01:49.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:49.323 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2024-03-19T06:01:49.373 INFO:teuthology.orchestra.run.smithi172.stdout:125 2024-03-19T06:01:49.373 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [125] 2024-03-19T06:01:49.373 DEBUG:teuthology.orchestra.run.smithi172:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:01:49.373 DEBUG:teuthology.orchestra.run.smithi172:> import glob 2024-03-19T06:01:49.373 DEBUG:teuthology.orchestra.run.smithi172:> import re 2024-03-19T06:01:49.373 DEBUG:teuthology.orchestra.run.smithi172:> import os 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> import subprocess 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> def _find_admin_socket(client_name): 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> files = glob.glob(asok_path) 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> # Given a non-glob path, it better be there 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> if "*" not in asok_path: 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> assert(len(files) == 1) 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> return files[0] 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> for f in files: 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:01:49.374 DEBUG:teuthology.orchestra.run.smithi172:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:01:49.375 DEBUG:teuthology.orchestra.run.smithi172:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:01:49.375 DEBUG:teuthology.orchestra.run.smithi172:> contents = proc_f.read() 2024-03-19T06:01:49.375 DEBUG:teuthology.orchestra.run.smithi172:> if mountpoint in contents: 2024-03-19T06:01:49.375 DEBUG:teuthology.orchestra.run.smithi172:> return f 2024-03-19T06:01:49.375 DEBUG:teuthology.orchestra.run.smithi172:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:01:49.375 DEBUG:teuthology.orchestra.run.smithi172:> 2024-03-19T06:01:49.375 DEBUG:teuthology.orchestra.run.smithi172:> print(_find_admin_socket("client.1")) 2024-03-19T06:01:49.375 DEBUG:teuthology.orchestra.run.smithi172:> ' 2024-03-19T06:01:49.555 INFO:teuthology.orchestra.run.smithi172.stdout:/var/run/ceph/ceph-client.1.55565.asok 2024-03-19T06:01:49.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-19T06:01:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:01:49.573 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.55565.asok 2024-03-19T06:01:49.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:49.574 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.55565.asok status 2024-03-19T06:01:49.810 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-03-19T06:01:49.810 INFO:teuthology.orchestra.run.smithi172.stdout: "metadata": { 2024-03-19T06:01:49.810 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_sha1": "5dd24139a1eada541a3bc16b6941c5dde975e26d", 2024-03-19T06:01:49.810 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-03-19T06:01:49.810 INFO:teuthology.orchestra.run.smithi172.stdout: "entity_id": "1", 2024-03-19T06:01:49.810 INFO:teuthology.orchestra.run.smithi172.stdout: "hostname": "smithi172", 2024-03-19T06:01:49.810 INFO:teuthology.orchestra.run.smithi172.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "pid": "55565", 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "root": "/" 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_count": 0, 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_pinned_count": 0, 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 24271, 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "inst": { 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "name": { 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "client", 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "num": 24271 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:01:49.811 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 1243789683 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 1243789683 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: "inst_str": "client.24271 192.168.0.1:0/1243789683", 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: "addr_str": "192.168.0.1:0/1243789683", 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: "inode_count": 1, 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_epoch": 13, 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch": 45, 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: "blocklisted": false, 2024-03-19T06:01:49.812 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs" 2024-03-19T06:01:49.813 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-03-19T06:01:49.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:49.824 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2024-03-19T06:01:49.824 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-19T06:01:49.885 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2024-03-19T06:01:49.885 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-19T06:01:49.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:49.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:01:49.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:49.990 DEBUG:teuthology.orchestra.run.smithi172:> stat --file-system '--printf=%T 2024-03-19T06:01:49.990 DEBUG:teuthology.orchestra.run.smithi172:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-19T06:01:50.049 INFO:teuthology.orchestra.run.smithi172.stdout:fuseblk 2024-03-19T06:01:50.049 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-19T06:01:50.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:01:50.049 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-19T06:01:50.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:50 smithi072 ceph-mon[28706]: pgmap v252: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-03-19T06:01:50.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:50 smithi172 ceph-mon[35716]: pgmap v252: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-03-19T06:01:52.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:52 smithi172 ceph-mon[35716]: pgmap v253: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:01:52.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:52 smithi072 ceph-mon[28706]: pgmap v253: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:01:53.049 INFO:teuthology.run_tasks:Running task print... 2024-03-19T06:01:53.064 INFO:teuthology.task.print:**** done client 2024-03-19T06:01:53.064 INFO:teuthology.run_tasks:Running task parallel... 2024-03-19T06:01:53.089 INFO:teuthology.task.parallel:starting parallel... 2024-03-19T06:01:53.089 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-03-19T06:01:53.090 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-03-19T06:01:53.091 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T06:01:53.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-03-19T06:01:53.091 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-03-19T06:01:53.091 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-03-19T06:01:53.095 INFO:tasks.workunit:Pulling workunits from ref b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:01:53.095 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-19T06:01:53.096 INFO:tasks.workunit:timeout=3h 2024-03-19T06:01:53.096 INFO:tasks.workunit:cleanup=True 2024-03-19T06:01:53.096 DEBUG:teuthology.orchestra.run.smithi072:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-19T06:01:53.151 INFO:teuthology.orchestra.run.smithi072.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-19T06:01:53.151 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-19T06:01:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 9eh/158d Inode: 1 Links: 2 2024-03-19T06:01:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:01:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:fusefs_t:s0 2024-03-19T06:01:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-19T06:01:53.151 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-19 06:00:58.121994415 +0000 2024-03-19T06:01:53.152 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-19 06:01:49.990108752 +0000 2024-03-19T06:01:53.152 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-03-19T06:01:53.152 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-19T06:01:53.152 DEBUG:teuthology.orchestra.run.smithi072:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-19T06:01:53.278 DEBUG:teuthology.orchestra.run.smithi172:> stat -- /home/ubuntu/cephtest/mnt.1 2024-03-19T06:01:53.338 INFO:teuthology.orchestra.run.smithi172.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-03-19T06:01:53.339 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-19T06:01:53.339 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 7dh/125d Inode: 1 Links: 3 2024-03-19T06:01:53.339 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:01:53.339 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:fusefs_t:s0 2024-03-19T06:01:53.339 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-19T06:01:53.339 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-19 06:01:53.271045236 +0000 2024-03-19T06:01:53.339 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-19 06:01:53.271045236 +0000 2024-03-19T06:01:53.339 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-03-19T06:01:53.339 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-03-19T06:01:53.340 DEBUG:teuthology.orchestra.run.smithi172:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-03-19T06:01:53.456 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:01:53.456 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:01:53.504 INFO:tasks.workunit.client.0.smithi072.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-19T06:01:53.514 INFO:tasks.workunit.client.1.smithi172.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-03-19T06:01:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:01:54.285 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:54 smithi072 ceph-mon[28706]: pgmap v254: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:01:54.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:54 smithi172 ceph-mon[35716]: pgmap v254: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:01:56.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.016+0000 7f4750e00700 1 -- 172.21.15.72:0/1773741712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f474c103640 msgr2=0x7f474c103a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:56.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.016+0000 7f4750e00700 1 --2- 172.21.15.72:0/1773741712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f474c103640 0x7f474c103a90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4738009910 tx=0x7f4738009c20 comp rx=0 tx=0).stop 2024-03-19T06:01:56.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.016+0000 7f4750e00700 1 -- 172.21.15.72:0/1773741712 shutdown_connections 2024-03-19T06:01:56.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.016+0000 7f4750e00700 1 --2- 172.21.15.72:0/1773741712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f474c103640 0x7f474c103a90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:56.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.016+0000 7f4750e00700 1 --2- 172.21.15.72:0/1773741712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f474c102440 0x7f474c102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:56.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.016+0000 7f4750e00700 1 -- 172.21.15.72:0/1773741712 >> 172.21.15.72:0/1773741712 conn(0x7f474c0fd9f0 msgr2=0x7f474c0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:56.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.016+0000 7f4750e00700 1 -- 172.21.15.72:0/1773741712 shutdown_connections 2024-03-19T06:01:56.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.016+0000 7f4750e00700 1 -- 172.21.15.72:0/1773741712 wait complete. 2024-03-19T06:01:56.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.017+0000 7f4750e00700 1 Processor -- start 2024-03-19T06:01:56.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.017+0000 7f4750e00700 1 -- start start 2024-03-19T06:01:56.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.018+0000 7f4750e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f474c102440 0x7f474c197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:56.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.018+0000 7f4750e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f474c103640 0x7f474c1981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:56.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.018+0000 7f4750e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c1987d0 con 0x7f474c103640 2024-03-19T06:01:56.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.018+0000 7f4750e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c198940 con 0x7f474c102440 2024-03-19T06:01:56.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.018+0000 7f4749400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f474c103640 0x7f474c1981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:56.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.018+0000 7f4749400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f474c103640 0x7f474c1981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34424/0 (socket says 172.21.15.72:34424) 2024-03-19T06:01:56.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.018+0000 7f4749400700 1 -- 172.21.15.72:0/3263560687 learned_addr learned my addr 172.21.15.72:0/3263560687 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:56.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.018+0000 7f4749400700 1 -- 172.21.15.72:0/3263560687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f474c102440 msgr2=0x7f474c197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:56.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.018+0000 7f4749400700 1 --2- 172.21.15.72:0/3263560687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f474c102440 0x7f474c197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:56.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.018+0000 7f4749400700 1 -- 172.21.15.72:0/3263560687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47380095f0 con 0x7f474c103640 2024-03-19T06:01:56.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.019+0000 7f4749400700 1 --2- 172.21.15.72:0/3263560687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f474c103640 0x7f474c1981d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f473800b5c0 tx=0x7f473800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:56.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.019+0000 7f4742a00700 1 -- 172.21.15.72:0/3263560687 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f473801d070 con 0x7f474c103640 2024-03-19T06:01:56.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.019+0000 7f4742a00700 1 -- 172.21.15.72:0/3263560687 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4738022470 con 0x7f474c103640 2024-03-19T06:01:56.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.019+0000 7f4750e00700 1 -- 172.21.15.72:0/3263560687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474c19d370 con 0x7f474c103640 2024-03-19T06:01:56.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.019+0000 7f4742a00700 1 -- 172.21.15.72:0/3263560687 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f473800f690 con 0x7f474c103640 2024-03-19T06:01:56.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.019+0000 7f4750e00700 1 -- 172.21.15.72:0/3263560687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474c19d860 con 0x7f474c103640 2024-03-19T06:01:56.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.020+0000 7f4750e00700 1 -- 172.21.15.72:0/3263560687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474c10af90 con 0x7f474c103640 2024-03-19T06:01:56.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.021+0000 7f4742a00700 1 -- 172.21.15.72:0/3263560687 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4738004b70 con 0x7f474c103640 2024-03-19T06:01:56.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.022+0000 7f4742a00700 1 --2- 172.21.15.72:0/3263560687 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f473006c680 0x7f473006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:56.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.023+0000 7f4742a00700 1 -- 172.21.15.72:0/3263560687 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f473808cf00 con 0x7f474c103640 2024-03-19T06:01:56.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.023+0000 7f4749e00700 1 --2- 172.21.15.72:0/3263560687 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f473006c680 0x7f473006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:56.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.023+0000 7f4749e00700 1 --2- 172.21.15.72:0/3263560687 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f473006c680 0x7f473006eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f474c198b70 tx=0x7f473c005ca0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:56.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.028+0000 7f4742a00700 1 -- 172.21.15.72:0/3263560687 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4738057670 con 0x7f474c103640 2024-03-19T06:01:56.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.256+0000 7f4750e00700 1 -- 172.21.15.72:0/3263560687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f474c10b180 con 0x7f474c103640 2024-03-19T06:01:56.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.266+0000 7f4742a00700 1 -- 172.21.15.72:0/3263560687 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v22)=0 v22) v1 ==== 126+0+0 (secure 0 0 0) 0x7f474c10b180 con 0x7f474c103640 2024-03-19T06:01:56.260 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:56 smithi072 ceph-mon[28706]: pgmap v255: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s wr, 0 op/s 2024-03-19T06:01:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.270+0000 7f4750e00700 1 -- 172.21.15.72:0/3263560687 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f473006c680 msgr2=0x7f473006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.270+0000 7f4750e00700 1 --2- 172.21.15.72:0/3263560687 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f473006c680 0x7f473006eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f474c198b70 tx=0x7f473c005ca0 comp rx=0 tx=0).stop 2024-03-19T06:01:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.270+0000 7f4750e00700 1 -- 172.21.15.72:0/3263560687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f474c103640 msgr2=0x7f474c1981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.270+0000 7f4750e00700 1 --2- 172.21.15.72:0/3263560687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f474c103640 0x7f474c1981d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f473800b5c0 tx=0x7f473800be20 comp rx=0 tx=0).stop 2024-03-19T06:01:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.270+0000 7f4750e00700 1 -- 172.21.15.72:0/3263560687 shutdown_connections 2024-03-19T06:01:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.270+0000 7f4750e00700 1 --2- 172.21.15.72:0/3263560687 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f473006c680 0x7f473006eb30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.270+0000 7f4750e00700 1 --2- 172.21.15.72:0/3263560687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f474c102440 0x7f474c197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.270+0000 7f4750e00700 1 --2- 172.21.15.72:0/3263560687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f474c103640 0x7f474c1981d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.270+0000 7f4750e00700 1 -- 172.21.15.72:0/3263560687 >> 172.21.15.72:0/3263560687 conn(0x7f474c0fd9f0 msgr2=0x7f474c106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.270+0000 7f4750e00700 1 -- 172.21.15.72:0/3263560687 shutdown_connections 2024-03-19T06:01:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:56.270+0000 7f4750e00700 1 -- 172.21.15.72:0/3263560687 wait complete. 2024-03-19T06:01:56.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:56 smithi172 ceph-mon[35716]: pgmap v255: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s wr, 0 op/s 2024-03-19T06:01:57.233 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-03-19T06:01:57.233 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T06:01:57.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-03-19T06:01:57.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:57 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3263560687' entity='client.admin' 2024-03-19T06:01:57.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:01:57.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:01:57.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:01:57.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:57 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:57.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:57 smithi072 ceph-mon[28706]: pgmap v256: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-03-19T06:01:57.641 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:01:57.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:57 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3263560687' entity='client.admin' 2024-03-19T06:01:57.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:57 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:01:57.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:57 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:01:57.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:57 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:01:57.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:57 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:01:57.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:57 smithi172 ceph-mon[35716]: pgmap v256: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-03-19T06:01:59.904 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:01:59 smithi072 ceph-mon[28706]: pgmap v257: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-03-19T06:01:59.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.954+0000 7ff1eda00700 1 -- 172.21.15.72:0/4253010165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1e8069b00 msgr2=0x7ff1e8102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:59.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.954+0000 7ff1eda00700 1 --2- 172.21.15.72:0/4253010165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1e8069b00 0x7ff1e8102df0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009910 tx=0x7ff1d8009c20 comp rx=0 tx=0).stop 2024-03-19T06:01:59.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.954+0000 7ff1eda00700 1 -- 172.21.15.72:0/4253010165 shutdown_connections 2024-03-19T06:01:59.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.954+0000 7ff1eda00700 1 --2- 172.21.15.72:0/4253010165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1e8103330 0x7ff1e81057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:59.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.954+0000 7ff1eda00700 1 --2- 172.21.15.72:0/4253010165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1e8069b00 0x7ff1e8102df0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:59.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.954+0000 7ff1eda00700 1 -- 172.21.15.72:0/4253010165 >> 172.21.15.72:0/4253010165 conn(0x7ff1e80fa7a0 msgr2=0x7ff1e80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:01:59.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.954+0000 7ff1eda00700 1 -- 172.21.15.72:0/4253010165 shutdown_connections 2024-03-19T06:01:59.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.954+0000 7ff1eda00700 1 -- 172.21.15.72:0/4253010165 wait complete. 2024-03-19T06:01:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.955+0000 7ff1eda00700 1 Processor -- start 2024-03-19T06:01:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.955+0000 7ff1eda00700 1 -- start start 2024-03-19T06:01:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.956+0000 7ff1eda00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1e8103330 0x7ff1e8100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.956+0000 7ff1eda00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1e80fed90 0x7ff1e80ff200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.956+0000 7ff1eda00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e80ff740 con 0x7ff1e8103330 2024-03-19T06:01:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.956+0000 7ff1eda00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e80ff8b0 con 0x7ff1e80fed90 2024-03-19T06:01:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.956+0000 7ff1e6a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1e8103330 0x7ff1e8100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.956+0000 7ff1e6a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1e8103330 0x7ff1e8100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34434/0 (socket says 172.21.15.72:34434) 2024-03-19T06:01:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.956+0000 7ff1e6a00700 1 -- 172.21.15.72:0/1576981375 learned_addr learned my addr 172.21.15.72:0/1576981375 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:01:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.957+0000 7ff1e6000700 1 --2- 172.21.15.72:0/1576981375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1e80fed90 0x7ff1e80ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.957+0000 7ff1e6a00700 1 -- 172.21.15.72:0/1576981375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1e80fed90 msgr2=0x7ff1e80ff200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:01:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.957+0000 7ff1e6a00700 1 --2- 172.21.15.72:0/1576981375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1e80fed90 0x7ff1e80ff200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:01:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.957+0000 7ff1e6a00700 1 -- 172.21.15.72:0/1576981375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d80095f0 con 0x7ff1e8103330 2024-03-19T06:01:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.957+0000 7ff1e6000700 1 --2- 172.21.15.72:0/1576981375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1e80fed90 0x7ff1e80ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:01:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.957+0000 7ff1e6a00700 1 --2- 172.21.15.72:0/1576981375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1e8103330 0x7ff1e8100740 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800bda0 tx=0x7ff1d800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.957+0000 7ff1df400700 1 -- 172.21.15.72:0/1576981375 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1d801d070 con 0x7ff1e8103330 2024-03-19T06:01:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.957+0000 7ff1df400700 1 -- 172.21.15.72:0/1576981375 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff1d8004c50 con 0x7ff1e8103330 2024-03-19T06:01:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.957+0000 7ff1eda00700 1 -- 172.21.15.72:0/1576981375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e80ffb30 con 0x7ff1e8103330 2024-03-19T06:01:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.957+0000 7ff1df400700 1 -- 172.21.15.72:0/1576981375 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1d800f690 con 0x7ff1e8103330 2024-03-19T06:01:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.958+0000 7ff1eda00700 1 -- 172.21.15.72:0/1576981375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e819e0f0 con 0x7ff1e8103330 2024-03-19T06:01:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.959+0000 7ff1eda00700 1 -- 172.21.15.72:0/1576981375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e818fc70 con 0x7ff1e8103330 2024-03-19T06:01:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.960+0000 7ff1df400700 1 -- 172.21.15.72:0/1576981375 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff1d8022a20 con 0x7ff1e8103330 2024-03-19T06:01:59.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.961+0000 7ff1df400700 1 --2- 172.21.15.72:0/1576981375 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ff1cc06c680 0x7ff1cc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:01:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.961+0000 7ff1df400700 1 -- 172.21.15.72:0/1576981375 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff1d808d100 con 0x7ff1e8103330 2024-03-19T06:01:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.961+0000 7ff1e6000700 1 --2- 172.21.15.72:0/1576981375 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ff1cc06c680 0x7ff1cc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:01:59.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.962+0000 7ff1e6000700 1 --2- 172.21.15.72:0/1576981375 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ff1cc06c680 0x7ff1cc06eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4007900 tx=0x7ff1d4008040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:01:59.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:01:59.967+0000 7ff1df400700 1 -- 172.21.15.72:0/1576981375 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff1d805b1d0 con 0x7ff1e8103330 2024-03-19T06:02:00.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:01:59 smithi172 ceph-mon[35716]: pgmap v257: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-03-19T06:02:00.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.180+0000 7ff1eda00700 1 -- 172.21.15.72:0/1576981375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7ff1e802cc30 con 0x7ff1e8103330 2024-03-19T06:02:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.181+0000 7ff1df400700 1 -- 172.21.15.72:0/1576981375 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v22)=0 v22) v1 ==== 155+0+0 (secure 0 0 0) 0x7ff1d805ad60 con 0x7ff1e8103330 2024-03-19T06:02:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.184+0000 7ff1eda00700 1 -- 172.21.15.72:0/1576981375 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ff1cc06c680 msgr2=0x7ff1cc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.184+0000 7ff1eda00700 1 --2- 172.21.15.72:0/1576981375 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ff1cc06c680 0x7ff1cc06eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4007900 tx=0x7ff1d4008040 comp rx=0 tx=0).stop 2024-03-19T06:02:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.184+0000 7ff1eda00700 1 -- 172.21.15.72:0/1576981375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1e8103330 msgr2=0x7ff1e8100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.184+0000 7ff1eda00700 1 --2- 172.21.15.72:0/1576981375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1e8103330 0x7ff1e8100740 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800bda0 tx=0x7ff1d800be80 comp rx=0 tx=0).stop 2024-03-19T06:02:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.184+0000 7ff1eda00700 1 -- 172.21.15.72:0/1576981375 shutdown_connections 2024-03-19T06:02:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.184+0000 7ff1eda00700 1 --2- 172.21.15.72:0/1576981375 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7ff1cc06c680 0x7ff1cc06eb30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.184+0000 7ff1eda00700 1 --2- 172.21.15.72:0/1576981375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1e8103330 0x7ff1e8100740 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.184+0000 7ff1eda00700 1 --2- 172.21.15.72:0/1576981375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1e80fed90 0x7ff1e80ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.184+0000 7ff1eda00700 1 -- 172.21.15.72:0/1576981375 >> 172.21.15.72:0/1576981375 conn(0x7ff1e80fa7a0 msgr2=0x7ff1e80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.185+0000 7ff1eda00700 1 -- 172.21.15.72:0/1576981375 shutdown_connections 2024-03-19T06:02:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:00.185+0000 7ff1eda00700 1 -- 172.21.15.72:0/1576981375 wait complete. 2024-03-19T06:02:00.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:00 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:02:01.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-03-19T06:02:01.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:00 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:02:01.525 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:02:02.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:02 smithi072 ceph-mon[28706]: pgmap v258: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s wr, 1 op/s 2024-03-19T06:02:02.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:02 smithi172 ceph-mon[35716]: pgmap v258: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s wr, 1 op/s 2024-03-19T06:02:03.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.793+0000 7f9ec6000700 1 -- 172.21.15.72:0/1117849851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ec0103680 msgr2=0x7f9ec0105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:03.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.793+0000 7f9ec6000700 1 --2- 172.21.15.72:0/1117849851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ec0103680 0x7f9ec0105a60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009910 tx=0x7f9ea8009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:03.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.793+0000 7f9ec6000700 1 -- 172.21.15.72:0/1117849851 shutdown_connections 2024-03-19T06:02:03.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.793+0000 7f9ec6000700 1 --2- 172.21.15.72:0/1117849851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ec0103680 0x7f9ec0105a60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:03.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.793+0000 7f9ec6000700 1 --2- 172.21.15.72:0/1117849851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec0100d60 0x7f9ec0103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:03.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.793+0000 7f9ec6000700 1 -- 172.21.15.72:0/1117849851 >> 172.21.15.72:0/1117849851 conn(0x7f9ec00fa780 msgr2=0x7f9ec00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:03.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.793+0000 7f9ec6000700 1 -- 172.21.15.72:0/1117849851 shutdown_connections 2024-03-19T06:02:03.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.793+0000 7f9ec6000700 1 -- 172.21.15.72:0/1117849851 wait complete. 2024-03-19T06:02:03.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.795+0000 7f9ec6000700 1 Processor -- start 2024-03-19T06:02:03.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.795+0000 7f9ec6000700 1 -- start start 2024-03-19T06:02:03.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.795+0000 7f9ec6000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec0100d60 0x7f9ec0197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:03.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.795+0000 7f9ec6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ec0103680 0x7f9ec0198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:03.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.795+0000 7f9ec6000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0198850 con 0x7f9ec0103680 2024-03-19T06:02:03.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.795+0000 7f9ec6000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec019d260 con 0x7f9ec0100d60 2024-03-19T06:02:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.796+0000 7f9eb7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ec0103680 0x7f9ec0198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.796+0000 7f9eb7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ec0103680 0x7f9ec0198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34464/0 (socket says 172.21.15.72:34464) 2024-03-19T06:02:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.796+0000 7f9eb7e00700 1 -- 172.21.15.72:0/2163924142 learned_addr learned my addr 172.21.15.72:0/2163924142 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.796+0000 7f9ebf400700 1 --2- 172.21.15.72:0/2163924142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec0100d60 0x7f9ec0197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.796+0000 7f9eb7e00700 1 -- 172.21.15.72:0/2163924142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec0100d60 msgr2=0x7f9ec0197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.796+0000 7f9eb7e00700 1 --2- 172.21.15.72:0/2163924142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec0100d60 0x7f9ec0197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.796+0000 7f9eb7e00700 1 -- 172.21.15.72:0/2163924142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80095f0 con 0x7f9ec0103680 2024-03-19T06:02:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.796+0000 7f9eb7e00700 1 --2- 172.21.15.72:0/2163924142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ec0103680 0x7f9ec0198230 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8005b40 tx=0x7f9ea800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.797+0000 7f9ebcc00700 1 -- 172.21.15.72:0/2163924142 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ea801d070 con 0x7f9ec0103680 2024-03-19T06:02:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.797+0000 7f9ebcc00700 1 -- 172.21.15.72:0/2163924142 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9ea8022470 con 0x7f9ec0103680 2024-03-19T06:02:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.797+0000 7f9ec6000700 1 -- 172.21.15.72:0/2163924142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec019d400 con 0x7f9ec0103680 2024-03-19T06:02:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.797+0000 7f9ebcc00700 1 -- 172.21.15.72:0/2163924142 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ea800f690 con 0x7f9ec0103680 2024-03-19T06:02:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.797+0000 7f9ec6000700 1 -- 172.21.15.72:0/2163924142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec019d8c0 con 0x7f9ec0103680 2024-03-19T06:02:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.798+0000 7f9ec6000700 1 -- 172.21.15.72:0/2163924142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec00fc340 con 0x7f9ec0103680 2024-03-19T06:02:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.799+0000 7f9ebcc00700 1 -- 172.21.15.72:0/2163924142 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9ea80225e0 con 0x7f9ec0103680 2024-03-19T06:02:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.800+0000 7f9ebcc00700 1 --2- 172.21.15.72:0/2163924142 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ea406c680 0x7f9ea406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.800+0000 7f9ebcc00700 1 -- 172.21.15.72:0/2163924142 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f9ea808d110 con 0x7f9ec0103680 2024-03-19T06:02:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.800+0000 7f9ebf400700 1 --2- 172.21.15.72:0/2163924142 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ea406c680 0x7f9ea406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.801+0000 7f9ebf400700 1 --2- 172.21.15.72:0/2163924142 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ea406c680 0x7f9ea406eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0005950 tx=0x7f9eb0005d10 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:03.805+0000 7f9ebcc00700 1 -- 172.21.15.72:0/2163924142 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9ea80577d0 con 0x7f9ec0103680 2024-03-19T06:02:04.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.017+0000 7f9ec6000700 1 -- 172.21.15.72:0/2163924142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f9ec002cc30 con 0x7f9ec0103680 2024-03-19T06:02:04.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.018+0000 7f9ebcc00700 1 -- 172.21.15.72:0/2163924142 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v22)=0 v22) v1 ==== 163+0+0 (secure 0 0 0) 0x7f9ea805adf0 con 0x7f9ec0103680 2024-03-19T06:02:04.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.021+0000 7f9ec6000700 1 -- 172.21.15.72:0/2163924142 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ea406c680 msgr2=0x7f9ea406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:04.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.021+0000 7f9ec6000700 1 --2- 172.21.15.72:0/2163924142 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ea406c680 0x7f9ea406eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0005950 tx=0x7f9eb0005d10 comp rx=0 tx=0).stop 2024-03-19T06:02:04.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.021+0000 7f9ec6000700 1 -- 172.21.15.72:0/2163924142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ec0103680 msgr2=0x7f9ec0198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:04.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.021+0000 7f9ec6000700 1 --2- 172.21.15.72:0/2163924142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ec0103680 0x7f9ec0198230 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8005b40 tx=0x7f9ea800be20 comp rx=0 tx=0).stop 2024-03-19T06:02:04.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.021+0000 7f9ec6000700 1 -- 172.21.15.72:0/2163924142 shutdown_connections 2024-03-19T06:02:04.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.021+0000 7f9ec6000700 1 --2- 172.21.15.72:0/2163924142 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ea406c680 0x7f9ea406eb30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:04.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.021+0000 7f9ec6000700 1 --2- 172.21.15.72:0/2163924142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec0100d60 0x7f9ec0197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:04.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.021+0000 7f9ec6000700 1 --2- 172.21.15.72:0/2163924142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ec0103680 0x7f9ec0198230 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:04.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.021+0000 7f9ec6000700 1 -- 172.21.15.72:0/2163924142 >> 172.21.15.72:0/2163924142 conn(0x7f9ec00fa780 msgr2=0x7f9ec00ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:04.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.022+0000 7f9ec6000700 1 -- 172.21.15.72:0/2163924142 shutdown_connections 2024-03-19T06:02:04.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:04.022+0000 7f9ec6000700 1 -- 172.21.15.72:0/2163924142 wait complete. 2024-03-19T06:02:04.286 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:04 smithi072 ceph-mon[28706]: pgmap v259: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-03-19T06:02:04.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:04 smithi172 ceph-mon[35716]: pgmap v259: 65 pgs: 65 active+clean; 587 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-03-19T06:02:04.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph config set global log_to_journald false --force' 2024-03-19T06:02:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:02:06.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:06 smithi172 ceph-mon[35716]: pgmap v260: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-03-19T06:02:06.432 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:06 smithi072 ceph-mon[28706]: pgmap v260: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-03-19T06:02:07.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.709+0000 7f3a78200700 1 -- 172.21.15.72:0/1476322398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a70100240 msgr2=0x7f3a70100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:07.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.709+0000 7f3a78200700 1 --2- 172.21.15.72:0/1476322398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a70100240 0x7f3a70100650 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009910 tx=0x7f3a64009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:07.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.709+0000 7f3a78200700 1 -- 172.21.15.72:0/1476322398 shutdown_connections 2024-03-19T06:02:07.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.709+0000 7f3a78200700 1 --2- 172.21.15.72:0/1476322398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a70101440 0x7f3a70101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:07.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.709+0000 7f3a78200700 1 --2- 172.21.15.72:0/1476322398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a70100240 0x7f3a70100650 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:07.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.709+0000 7f3a78200700 1 -- 172.21.15.72:0/1476322398 >> 172.21.15.72:0/1476322398 conn(0x7f3a700fb7f0 msgr2=0x7f3a700fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:07.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.709+0000 7f3a78200700 1 -- 172.21.15.72:0/1476322398 shutdown_connections 2024-03-19T06:02:07.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.709+0000 7f3a78200700 1 -- 172.21.15.72:0/1476322398 wait complete. 2024-03-19T06:02:07.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.710+0000 7f3a78200700 1 Processor -- start 2024-03-19T06:02:07.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.710+0000 7f3a78200700 1 -- start start 2024-03-19T06:02:07.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.710+0000 7f3a78200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a70100240 0x7f3a70197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:07.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.710+0000 7f3a78200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a70101440 0x7f3a70198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:07.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.710+0000 7f3a78200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70198850 con 0x7f3a70100240 2024-03-19T06:02:07.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.710+0000 7f3a78200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7019d260 con 0x7f3a70101440 2024-03-19T06:02:07.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.711+0000 7f3a75800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a70100240 0x7f3a70197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:07.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.711+0000 7f3a75800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a70100240 0x7f3a70197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50720/0 (socket says 172.21.15.72:50720) 2024-03-19T06:02:07.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.711+0000 7f3a75800700 1 -- 172.21.15.72:0/2543687089 learned_addr learned my addr 172.21.15.72:0/2543687089 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:07.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.711+0000 7f3a75800700 1 -- 172.21.15.72:0/2543687089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a70101440 msgr2=0x7f3a70198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:07.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.711+0000 7f3a75800700 1 --2- 172.21.15.72:0/2543687089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a70101440 0x7f3a70198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:07.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.711+0000 7f3a75800700 1 -- 172.21.15.72:0/2543687089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a640095f0 con 0x7f3a70100240 2024-03-19T06:02:07.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.711+0000 7f3a75800700 1 --2- 172.21.15.72:0/2543687089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a70100240 0x7f3a70197cf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400bd70 tx=0x7f3a6400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:07.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.712+0000 7f3a6e000700 1 -- 172.21.15.72:0/2543687089 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a6401d070 con 0x7f3a70100240 2024-03-19T06:02:07.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.712+0000 7f3a6e000700 1 -- 172.21.15.72:0/2543687089 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3a6400f460 con 0x7f3a70100240 2024-03-19T06:02:07.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.712+0000 7f3a6e000700 1 -- 172.21.15.72:0/2543687089 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a64021640 con 0x7f3a70100240 2024-03-19T06:02:07.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.712+0000 7f3a78200700 1 -- 172.21.15.72:0/2543687089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7019d400 con 0x7f3a70100240 2024-03-19T06:02:07.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.712+0000 7f3a78200700 1 -- 172.21.15.72:0/2543687089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7019d870 con 0x7f3a70100240 2024-03-19T06:02:07.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.713+0000 7f3a78200700 1 -- 172.21.15.72:0/2543687089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a70105520 con 0x7f3a70100240 2024-03-19T06:02:07.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.714+0000 7f3a6e000700 1 -- 172.21.15.72:0/2543687089 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3a6400fab0 con 0x7f3a70100240 2024-03-19T06:02:07.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.715+0000 7f3a6e000700 1 --2- 172.21.15.72:0/2543687089 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f3a5806c680 0x7f3a5806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:07.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.715+0000 7f3a6e000700 1 -- 172.21.15.72:0/2543687089 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f3a6408cc10 con 0x7f3a70100240 2024-03-19T06:02:07.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.715+0000 7f3a74e00700 1 --2- 172.21.15.72:0/2543687089 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f3a5806c680 0x7f3a5806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:07.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.716+0000 7f3a74e00700 1 --2- 172.21.15.72:0/2543687089 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f3a5806c680 0x7f3a5806eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00a990 tx=0x7f3a5c005c80 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:07.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.720+0000 7f3a6e000700 1 -- 172.21.15.72:0/2543687089 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3a64057370 con 0x7f3a70100240 2024-03-19T06:02:07.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.935+0000 7f3a78200700 1 -- 172.21.15.72:0/2543687089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f3a7002cc30 con 0x7f3a70100240 2024-03-19T06:02:07.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.935+0000 7f3a6e000700 1 -- 172.21.15.72:0/2543687089 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v22)=0 v22) v1 ==== 135+0+0 (secure 0 0 0) 0x7f3a640260c0 con 0x7f3a70100240 2024-03-19T06:02:07.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.938+0000 7f3a78200700 1 -- 172.21.15.72:0/2543687089 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f3a5806c680 msgr2=0x7f3a5806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:07.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.938+0000 7f3a78200700 1 --2- 172.21.15.72:0/2543687089 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f3a5806c680 0x7f3a5806eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00a990 tx=0x7f3a5c005c80 comp rx=0 tx=0).stop 2024-03-19T06:02:07.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.938+0000 7f3a78200700 1 -- 172.21.15.72:0/2543687089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a70100240 msgr2=0x7f3a70197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:07.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.938+0000 7f3a78200700 1 --2- 172.21.15.72:0/2543687089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a70100240 0x7f3a70197cf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400bd70 tx=0x7f3a6400be50 comp rx=0 tx=0).stop 2024-03-19T06:02:07.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.938+0000 7f3a78200700 1 -- 172.21.15.72:0/2543687089 shutdown_connections 2024-03-19T06:02:07.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.938+0000 7f3a78200700 1 --2- 172.21.15.72:0/2543687089 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f3a5806c680 0x7f3a5806eb30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:07.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.938+0000 7f3a78200700 1 --2- 172.21.15.72:0/2543687089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a70100240 0x7f3a70197cf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:07.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.938+0000 7f3a78200700 1 --2- 172.21.15.72:0/2543687089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a70101440 0x7f3a70198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:07.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.938+0000 7f3a78200700 1 -- 172.21.15.72:0/2543687089 >> 172.21.15.72:0/2543687089 conn(0x7f3a700fb7f0 msgr2=0x7f3a70102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:07.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.938+0000 7f3a78200700 1 -- 172.21.15.72:0/2543687089 shutdown_connections 2024-03-19T06:02:07.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:07.938+0000 7f3a78200700 1 -- 172.21.15.72:0/2543687089 wait complete. 2024-03-19T06:02:08.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:08 smithi072 ceph-mon[28706]: pgmap v261: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-03-19T06:02:08.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:08 smithi172 ceph-mon[35716]: pgmap v261: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-03-19T06:02:08.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-03-19T06:02:09.280 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:02:10.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:10 smithi172 ceph-mon[35716]: pgmap v262: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-19T06:02:10.453 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:10 smithi072 ceph-mon[28706]: pgmap v262: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-19T06:02:11.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.526+0000 7fc7ddc00700 1 -- 172.21.15.72:0/2709044713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d8101440 msgr2=0x7fc7d8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.526+0000 7fc7ddc00700 1 --2- 172.21.15.72:0/2709044713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d8101440 0x7fc7d8101890 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009910 tx=0x7fc7c4009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.526+0000 7fc7ddc00700 1 -- 172.21.15.72:0/2709044713 shutdown_connections 2024-03-19T06:02:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.526+0000 7fc7ddc00700 1 --2- 172.21.15.72:0/2709044713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d8101440 0x7fc7d8101890 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.526+0000 7fc7ddc00700 1 --2- 172.21.15.72:0/2709044713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7d8100240 0x7fc7d8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.526+0000 7fc7ddc00700 1 -- 172.21.15.72:0/2709044713 >> 172.21.15.72:0/2709044713 conn(0x7fc7d80fb7f0 msgr2=0x7fc7d80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.526+0000 7fc7ddc00700 1 -- 172.21.15.72:0/2709044713 shutdown_connections 2024-03-19T06:02:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.526+0000 7fc7ddc00700 1 -- 172.21.15.72:0/2709044713 wait complete. 2024-03-19T06:02:11.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.527+0000 7fc7ddc00700 1 Processor -- start 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.528+0000 7fc7ddc00700 1 -- start start 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.528+0000 7fc7ddc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7d8100240 0x7fc7d8195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.528+0000 7fc7ddc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d8101440 0x7fc7d8196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.528+0000 7fc7ddc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d81966b0 con 0x7fc7d8101440 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.528+0000 7fc7ddc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d81967f0 con 0x7fc7d8100240 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.528+0000 7fc7d6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d8101440 0x7fc7d8196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.528+0000 7fc7d6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d8101440 0x7fc7d8196090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50736/0 (socket says 172.21.15.72:50736) 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.528+0000 7fc7d6000700 1 -- 172.21.15.72:0/3641929718 learned_addr learned my addr 172.21.15.72:0/3641929718 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.529+0000 7fc7d6a00700 1 --2- 172.21.15.72:0/3641929718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7d8100240 0x7fc7d8195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.529+0000 7fc7d6000700 1 -- 172.21.15.72:0/3641929718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7d8100240 msgr2=0x7fc7d8195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.529+0000 7fc7d6000700 1 --2- 172.21.15.72:0/3641929718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7d8100240 0x7fc7d8195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.529+0000 7fc7d6000700 1 -- 172.21.15.72:0/3641929718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40095f0 con 0x7fc7d8101440 2024-03-19T06:02:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.529+0000 7fc7d6000700 1 --2- 172.21.15.72:0/3641929718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d8101440 0x7fc7d8196090 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400bd70 tx=0x7fc7c400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:11.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.529+0000 7fc7cf400700 1 -- 172.21.15.72:0/3641929718 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7c401d070 con 0x7fc7d8101440 2024-03-19T06:02:11.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.529+0000 7fc7cf400700 1 -- 172.21.15.72:0/3641929718 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc7c4022470 con 0x7fc7d8101440 2024-03-19T06:02:11.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.529+0000 7fc7cf400700 1 -- 172.21.15.72:0/3641929718 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7c400f670 con 0x7fc7d8101440 2024-03-19T06:02:11.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.529+0000 7fc7ddc00700 1 -- 172.21.15.72:0/3641929718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d819b240 con 0x7fc7d8101440 2024-03-19T06:02:11.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.529+0000 7fc7ddc00700 1 -- 172.21.15.72:0/3641929718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d819b730 con 0x7fc7d8101440 2024-03-19T06:02:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.530+0000 7fc7ddc00700 1 -- 172.21.15.72:0/3641929718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d8108e30 con 0x7fc7d8101440 2024-03-19T06:02:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.532+0000 7fc7cf400700 1 -- 172.21.15.72:0/3641929718 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc7c4022a50 con 0x7fc7d8101440 2024-03-19T06:02:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.532+0000 7fc7cf400700 1 --2- 172.21.15.72:0/3641929718 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc7bc06c680 0x7fc7bc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.533+0000 7fc7cf400700 1 -- 172.21.15.72:0/3641929718 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc7c408cfc0 con 0x7fc7d8101440 2024-03-19T06:02:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.533+0000 7fc7d6a00700 1 --2- 172.21.15.72:0/3641929718 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc7bc06c680 0x7fc7bc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.534+0000 7fc7d6a00700 1 --2- 172.21.15.72:0/3641929718 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc7bc06c680 0x7fc7bc06eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8006fd0 tx=0x7fc7c8008040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.537+0000 7fc7cf400700 1 -- 172.21.15.72:0/3641929718 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc7c40bf720 con 0x7fc7d8101440 2024-03-19T06:02:11.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.769+0000 7fc7ddc00700 1 -- 172.21.15.72:0/3641929718 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7d8105d90 con 0x7fc7bc06c680 2024-03-19T06:02:11.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.782+0000 7fc7cf400700 1 -- 172.21.15.72:0/3641929718 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fc7d8105d90 con 0x7fc7bc06c680 2024-03-19T06:02:11.775 INFO:teuthology.orchestra.run.smithi072.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:02:11.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.785+0000 7fc7ddc00700 1 -- 172.21.15.72:0/3641929718 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc7bc06c680 msgr2=0x7fc7bc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:11.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.785+0000 7fc7ddc00700 1 --2- 172.21.15.72:0/3641929718 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc7bc06c680 0x7fc7bc06eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8006fd0 tx=0x7fc7c8008040 comp rx=0 tx=0).stop 2024-03-19T06:02:11.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.785+0000 7fc7ddc00700 1 -- 172.21.15.72:0/3641929718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d8101440 msgr2=0x7fc7d8196090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:11.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.785+0000 7fc7ddc00700 1 --2- 172.21.15.72:0/3641929718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d8101440 0x7fc7d8196090 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400bd70 tx=0x7fc7c400be50 comp rx=0 tx=0).stop 2024-03-19T06:02:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.785+0000 7fc7ddc00700 1 -- 172.21.15.72:0/3641929718 shutdown_connections 2024-03-19T06:02:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.785+0000 7fc7ddc00700 1 --2- 172.21.15.72:0/3641929718 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc7bc06c680 0x7fc7bc06eb30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.785+0000 7fc7ddc00700 1 --2- 172.21.15.72:0/3641929718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7d8100240 0x7fc7d8195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.785+0000 7fc7ddc00700 1 --2- 172.21.15.72:0/3641929718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7d8101440 0x7fc7d8196090 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.785+0000 7fc7ddc00700 1 -- 172.21.15.72:0/3641929718 >> 172.21.15.72:0/3641929718 conn(0x7fc7d80fb7f0 msgr2=0x7fc7d8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.785+0000 7fc7ddc00700 1 -- 172.21.15.72:0/3641929718 shutdown_connections 2024-03-19T06:02:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:11.785+0000 7fc7ddc00700 1 -- 172.21.15.72:0/3641929718 wait complete. 2024-03-19T06:02:12.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:12 smithi072 ceph-mon[28706]: pgmap v263: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-19T06:02:12.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:02:12.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:02:12.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:02:12.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:02:12.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:12 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:02:12.623 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-03-19T06:02:12.624 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T06:02:12.624 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-03-19T06:02:12.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:12 smithi172 ceph-mon[35716]: pgmap v263: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-19T06:02:12.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:02:12.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:02:12.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:02:12.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:02:12.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:12 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:02:13.017 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:02:13.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:13 smithi072 ceph-mon[28706]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:13.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:13 smithi072 ceph-mon[28706]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:02:13.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:13 smithi072 ceph-mon[28706]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:02:13.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:13 smithi172 ceph-mon[35716]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:13.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:13 smithi172 ceph-mon[35716]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:02:13.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:13 smithi172 ceph-mon[35716]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:02:14.286 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:14 smithi072 ceph-mon[28706]: pgmap v264: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:02:14.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:14 smithi172 ceph-mon[35716]: pgmap v264: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:02:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.464+0000 7fd436200700 1 -- 172.21.15.72:0/2987466388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd430103680 msgr2=0x7fd430105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.464+0000 7fd436200700 1 --2- 172.21.15.72:0/2987466388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd430103680 0x7fd430105a60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009910 tx=0x7fd41c009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.465+0000 7fd436200700 1 -- 172.21.15.72:0/2987466388 shutdown_connections 2024-03-19T06:02:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.465+0000 7fd436200700 1 --2- 172.21.15.72:0/2987466388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd430103680 0x7fd430105a60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.465+0000 7fd436200700 1 --2- 172.21.15.72:0/2987466388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd430100d60 0x7fd430103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.465+0000 7fd436200700 1 -- 172.21.15.72:0/2987466388 >> 172.21.15.72:0/2987466388 conn(0x7fd4300fa780 msgr2=0x7fd4300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.465+0000 7fd436200700 1 -- 172.21.15.72:0/2987466388 shutdown_connections 2024-03-19T06:02:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.465+0000 7fd436200700 1 -- 172.21.15.72:0/2987466388 wait complete. 2024-03-19T06:02:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.466+0000 7fd436200700 1 Processor -- start 2024-03-19T06:02:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.466+0000 7fd436200700 1 -- start start 2024-03-19T06:02:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.466+0000 7fd436200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd430100d60 0x7fd4301006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.466+0000 7fd436200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd430103680 0x7fd4300fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.466+0000 7fd436200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd430199790 con 0x7fd430103680 2024-03-19T06:02:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.466+0000 7fd436200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301998d0 con 0x7fd430100d60 2024-03-19T06:02:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.467+0000 7fd42ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd430103680 0x7fd4300fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.467+0000 7fd42ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd430103680 0x7fd4300fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50872/0 (socket says 172.21.15.72:50872) 2024-03-19T06:02:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.467+0000 7fd42ea00700 1 -- 172.21.15.72:0/3450425477 learned_addr learned my addr 172.21.15.72:0/3450425477 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.467+0000 7fd42f400700 1 --2- 172.21.15.72:0/3450425477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd430100d60 0x7fd4301006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.468+0000 7fd42ea00700 1 -- 172.21.15.72:0/3450425477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd430100d60 msgr2=0x7fd4301006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.468+0000 7fd42ea00700 1 --2- 172.21.15.72:0/3450425477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd430100d60 0x7fd4301006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.468+0000 7fd42ea00700 1 -- 172.21.15.72:0/3450425477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c0095f0 con 0x7fd430103680 2024-03-19T06:02:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.468+0000 7fd42ea00700 1 --2- 172.21.15.72:0/3450425477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd430103680 0x7fd4300fed10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00bd70 tx=0x7fd41c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:15.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.468+0000 7fd427e00700 1 -- 172.21.15.72:0/3450425477 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd41c01d070 con 0x7fd430103680 2024-03-19T06:02:15.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.468+0000 7fd436200700 1 -- 172.21.15.72:0/3450425477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4300ff250 con 0x7fd430103680 2024-03-19T06:02:15.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.468+0000 7fd427e00700 1 -- 172.21.15.72:0/3450425477 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd41c005940 con 0x7fd430103680 2024-03-19T06:02:15.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.468+0000 7fd427e00700 1 -- 172.21.15.72:0/3450425477 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd41c021430 con 0x7fd430103680 2024-03-19T06:02:15.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.469+0000 7fd436200700 1 -- 172.21.15.72:0/3450425477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4300ff710 con 0x7fd430103680 2024-03-19T06:02:15.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.470+0000 7fd436200700 1 -- 172.21.15.72:0/3450425477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43018fc60 con 0x7fd430103680 2024-03-19T06:02:15.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.471+0000 7fd427e00700 1 -- 172.21.15.72:0/3450425477 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd41c00f860 con 0x7fd430103680 2024-03-19T06:02:15.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.472+0000 7fd427e00700 1 --2- 172.21.15.72:0/3450425477 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd41406c680 0x7fd41406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:15.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.472+0000 7fd427e00700 1 -- 172.21.15.72:0/3450425477 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd41c08cc90 con 0x7fd430103680 2024-03-19T06:02:15.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.472+0000 7fd42f400700 1 --2- 172.21.15.72:0/3450425477 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd41406c680 0x7fd41406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:15.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.473+0000 7fd42f400700 1 --2- 172.21.15.72:0/3450425477 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd41406c680 0x7fd41406eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd430069000 tx=0x7fd420009190 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.477+0000 7fd427e00700 1 -- 172.21.15.72:0/3450425477 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd41c05ae00 con 0x7fd430103680 2024-03-19T06:02:15.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.780+0000 7fd436200700 1 -- 172.21.15.72:0/3450425477 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd43002cdb0 con 0x7fd41406c680 2024-03-19T06:02:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.782+0000 7fd427e00700 1 -- 172.21.15.72:0/3450425477 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fd43002cdb0 con 0x7fd41406c680 2024-03-19T06:02:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.785+0000 7fd436200700 1 -- 172.21.15.72:0/3450425477 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd41406c680 msgr2=0x7fd41406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.785+0000 7fd436200700 1 --2- 172.21.15.72:0/3450425477 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd41406c680 0x7fd41406eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd430069000 tx=0x7fd420009190 comp rx=0 tx=0).stop 2024-03-19T06:02:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.785+0000 7fd436200700 1 -- 172.21.15.72:0/3450425477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd430103680 msgr2=0x7fd4300fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.785+0000 7fd436200700 1 --2- 172.21.15.72:0/3450425477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd430103680 0x7fd4300fed10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00bd70 tx=0x7fd41c00bda0 comp rx=0 tx=0).stop 2024-03-19T06:02:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.785+0000 7fd436200700 1 -- 172.21.15.72:0/3450425477 shutdown_connections 2024-03-19T06:02:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.785+0000 7fd436200700 1 --2- 172.21.15.72:0/3450425477 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd41406c680 0x7fd41406eb30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.785+0000 7fd436200700 1 --2- 172.21.15.72:0/3450425477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd430100d60 0x7fd4301006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.785+0000 7fd436200700 1 --2- 172.21.15.72:0/3450425477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd430103680 0x7fd4300fed10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.785+0000 7fd436200700 1 -- 172.21.15.72:0/3450425477 >> 172.21.15.72:0/3450425477 conn(0x7fd4300fa780 msgr2=0x7fd4300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.785+0000 7fd436200700 1 -- 172.21.15.72:0/3450425477 shutdown_connections 2024-03-19T06:02:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.785+0000 7fd436200700 1 -- 172.21.15.72:0/3450425477 wait complete. 2024-03-19T06:02:15.796 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:02:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.956+0000 7fc459a00700 1 -- 172.21.15.72:0/3614247958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc454101490 msgr2=0x7fc4541018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.956+0000 7fc459a00700 1 --2- 172.21.15.72:0/3614247958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc454101490 0x7fc4541018e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc440009910 tx=0x7fc440009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.956+0000 7fc459a00700 1 -- 172.21.15.72:0/3614247958 shutdown_connections 2024-03-19T06:02:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.956+0000 7fc459a00700 1 --2- 172.21.15.72:0/3614247958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc454101490 0x7fc4541018e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.956+0000 7fc459a00700 1 --2- 172.21.15.72:0/3614247958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc454100290 0x7fc4541006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.956+0000 7fc459a00700 1 -- 172.21.15.72:0/3614247958 >> 172.21.15.72:0/3614247958 conn(0x7fc4540fb860 msgr2=0x7fc4540fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.957+0000 7fc459a00700 1 -- 172.21.15.72:0/3614247958 shutdown_connections 2024-03-19T06:02:15.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.957+0000 7fc459a00700 1 -- 172.21.15.72:0/3614247958 wait complete. 2024-03-19T06:02:15.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.958+0000 7fc459a00700 1 Processor -- start 2024-03-19T06:02:15.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.958+0000 7fc459a00700 1 -- start start 2024-03-19T06:02:15.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.959+0000 7fc459a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc454100290 0x7fc454197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:15.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.959+0000 7fc459a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc454101490 0x7fc4541981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:15.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.959+0000 7fc459a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541987d0 con 0x7fc454101490 2024-03-19T06:02:15.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.959+0000 7fc459a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45419d1e0 con 0x7fc454100290 2024-03-19T06:02:15.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.959+0000 7fc453400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc454101490 0x7fc4541981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:15.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.959+0000 7fc453400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc454101490 0x7fc4541981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50886/0 (socket says 172.21.15.72:50886) 2024-03-19T06:02:15.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.959+0000 7fc453400700 1 -- 172.21.15.72:0/1664105772 learned_addr learned my addr 172.21.15.72:0/1664105772 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:15.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.959+0000 7fc453e00700 1 --2- 172.21.15.72:0/1664105772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc454100290 0x7fc454197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.959+0000 7fc453400700 1 -- 172.21.15.72:0/1664105772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc454100290 msgr2=0x7fc454197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.959+0000 7fc453400700 1 --2- 172.21.15.72:0/1664105772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc454100290 0x7fc454197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.959+0000 7fc453400700 1 -- 172.21.15.72:0/1664105772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4400095f0 con 0x7fc454101490 2024-03-19T06:02:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.960+0000 7fc453e00700 1 --2- 172.21.15.72:0/1664105772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc454100290 0x7fc454197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:02:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.960+0000 7fc453400700 1 --2- 172.21.15.72:0/1664105772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc454101490 0x7fc4541981b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc440005b40 tx=0x7fc44000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.960+0000 7fc450c00700 1 -- 172.21.15.72:0/1664105772 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc44001d070 con 0x7fc454101490 2024-03-19T06:02:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.960+0000 7fc450c00700 1 -- 172.21.15.72:0/1664105772 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc440022470 con 0x7fc454101490 2024-03-19T06:02:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.960+0000 7fc450c00700 1 -- 172.21.15.72:0/1664105772 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc44000f690 con 0x7fc454101490 2024-03-19T06:02:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.960+0000 7fc459a00700 1 -- 172.21.15.72:0/1664105772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45419d380 con 0x7fc454101490 2024-03-19T06:02:15.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.960+0000 7fc459a00700 1 -- 172.21.15.72:0/1664105772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45419d840 con 0x7fc454101490 2024-03-19T06:02:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.962+0000 7fc459a00700 1 -- 172.21.15.72:0/1664105772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45406a550 con 0x7fc454101490 2024-03-19T06:02:15.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.963+0000 7fc450c00700 1 -- 172.21.15.72:0/1664105772 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc4400225e0 con 0x7fc454101490 2024-03-19T06:02:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.964+0000 7fc450c00700 1 --2- 172.21.15.72:0/1664105772 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc43806c680 0x7fc43806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.964+0000 7fc450c00700 1 -- 172.21.15.72:0/1664105772 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc44008d090 con 0x7fc454101490 2024-03-19T06:02:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.964+0000 7fc453e00700 1 --2- 172.21.15.72:0/1664105772 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc43806c680 0x7fc43806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.965+0000 7fc453e00700 1 --2- 172.21.15.72:0/1664105772 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc43806c680 0x7fc43806eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc444005fd0 tx=0x7fc444005de0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:15.970+0000 7fc450c00700 1 -- 172.21.15.72:0/1664105772 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc4400577d0 con 0x7fc454101490 2024-03-19T06:02:16.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.249+0000 7fc459a00700 1 -- 172.21.15.72:0/1664105772 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4541056d0 con 0x7fc43806c680 2024-03-19T06:02:16.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.251+0000 7fc450c00700 1 -- 172.21.15.72:0/1664105772 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fc4541056d0 con 0x7fc43806c680 2024-03-19T06:02:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.254+0000 7fc459a00700 1 -- 172.21.15.72:0/1664105772 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc43806c680 msgr2=0x7fc43806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.254+0000 7fc459a00700 1 --2- 172.21.15.72:0/1664105772 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc43806c680 0x7fc43806eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc444005fd0 tx=0x7fc444005de0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.254+0000 7fc459a00700 1 -- 172.21.15.72:0/1664105772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc454101490 msgr2=0x7fc4541981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:16.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.254+0000 7fc459a00700 1 --2- 172.21.15.72:0/1664105772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc454101490 0x7fc4541981b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc440005b40 tx=0x7fc44000be20 comp rx=0 tx=0).stop 2024-03-19T06:02:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.254+0000 7fc459a00700 1 -- 172.21.15.72:0/1664105772 shutdown_connections 2024-03-19T06:02:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.254+0000 7fc459a00700 1 --2- 172.21.15.72:0/1664105772 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc43806c680 0x7fc43806eb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.254+0000 7fc459a00700 1 --2- 172.21.15.72:0/1664105772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc454100290 0x7fc454197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.254+0000 7fc459a00700 1 --2- 172.21.15.72:0/1664105772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc454101490 0x7fc4541981b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.254+0000 7fc459a00700 1 -- 172.21.15.72:0/1664105772 >> 172.21.15.72:0/1664105772 conn(0x7fc4540fb860 msgr2=0x7fc4540fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.254+0000 7fc459a00700 1 -- 172.21.15.72:0/1664105772 shutdown_connections 2024-03-19T06:02:16.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.255+0000 7fc459a00700 1 -- 172.21.15.72:0/1664105772 wait complete. 2024-03-19T06:02:16.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.429+0000 7faf14600700 1 -- 172.21.15.72:0/2840315701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf0c073750 msgr2=0x7faf0c073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:16.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.429+0000 7faf14600700 1 --2- 172.21.15.72:0/2840315701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf0c073750 0x7faf0c073bc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faef8009910 tx=0x7faef8009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:16.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.429+0000 7faf14600700 1 -- 172.21.15.72:0/2840315701 shutdown_connections 2024-03-19T06:02:16.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.429+0000 7faf14600700 1 --2- 172.21.15.72:0/2840315701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf0c073750 0x7faf0c073bc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.429+0000 7faf14600700 1 --2- 172.21.15.72:0/2840315701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c074d20 0x7faf0c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.429+0000 7faf14600700 1 -- 172.21.15.72:0/2840315701 >> 172.21.15.72:0/2840315701 conn(0x7faf0c0fb7f0 msgr2=0x7faf0c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:16.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.430+0000 7faf14600700 1 -- 172.21.15.72:0/2840315701 shutdown_connections 2024-03-19T06:02:16.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.430+0000 7faf14600700 1 -- 172.21.15.72:0/2840315701 wait complete. 2024-03-19T06:02:16.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.431+0000 7faf14600700 1 Processor -- start 2024-03-19T06:02:16.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.431+0000 7faf14600700 1 -- start start 2024-03-19T06:02:16.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.431+0000 7faf14600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c073750 0x7faf0c197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:16.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.431+0000 7faf14600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf0c074d20 0x7faf0c1981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:16.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.431+0000 7faf14600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c1987b0 con 0x7faf0c074d20 2024-03-19T06:02:16.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.431+0000 7faf14600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c198920 con 0x7faf0c073750 2024-03-19T06:02:16.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.432+0000 7faf11200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf0c074d20 0x7faf0c1981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:16.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.432+0000 7faf11200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf0c074d20 0x7faf0c1981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50898/0 (socket says 172.21.15.72:50898) 2024-03-19T06:02:16.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.432+0000 7faf11200700 1 -- 172.21.15.72:0/1838427964 learned_addr learned my addr 172.21.15.72:0/1838427964 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:16.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.432+0000 7faf11c00700 1 --2- 172.21.15.72:0/1838427964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c073750 0x7faf0c197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:16.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.432+0000 7faf11200700 1 -- 172.21.15.72:0/1838427964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c073750 msgr2=0x7faf0c197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:16.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.432+0000 7faf11200700 1 --2- 172.21.15.72:0/1838427964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c073750 0x7faf0c197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.432+0000 7faf11200700 1 -- 172.21.15.72:0/1838427964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef80095f0 con 0x7faf0c074d20 2024-03-19T06:02:16.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.433+0000 7faf11200700 1 --2- 172.21.15.72:0/1838427964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf0c074d20 0x7faf0c1981b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faef8005b40 tx=0x7faef800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:16.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.433+0000 7faf0a000700 1 -- 172.21.15.72:0/1838427964 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faef801d070 con 0x7faf0c074d20 2024-03-19T06:02:16.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.433+0000 7faf0a000700 1 -- 172.21.15.72:0/1838427964 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faef800f460 con 0x7faf0c074d20 2024-03-19T06:02:16.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.433+0000 7faf14600700 1 -- 172.21.15.72:0/1838427964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c19d350 con 0x7faf0c074d20 2024-03-19T06:02:16.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.433+0000 7faf0a000700 1 -- 172.21.15.72:0/1838427964 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faef8021640 con 0x7faf0c074d20 2024-03-19T06:02:16.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.433+0000 7faf14600700 1 -- 172.21.15.72:0/1838427964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c19d840 con 0x7faf0c074d20 2024-03-19T06:02:16.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.435+0000 7faeff400700 1 -- 172.21.15.72:0/1838427964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee80052f0 con 0x7faf0c074d20 2024-03-19T06:02:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:16 smithi072 ceph-mon[28706]: pgmap v265: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:02:16.428 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:02:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.437+0000 7faf0a000700 1 -- 172.21.15.72:0/1838427964 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7faef800fa90 con 0x7faf0c074d20 2024-03-19T06:02:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.438+0000 7faf0a000700 1 --2- 172.21.15.72:0/1838427964 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7faef406c680 0x7faef406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.438+0000 7faf0a000700 1 -- 172.21.15.72:0/1838427964 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7faef808cbf0 con 0x7faf0c074d20 2024-03-19T06:02:16.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.439+0000 7faf11c00700 1 --2- 172.21.15.72:0/1838427964 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7faef406c680 0x7faef406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:16.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.440+0000 7faf11c00700 1 --2- 172.21.15.72:0/1838427964 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7faef406c680 0x7faef406eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faf00005950 tx=0x7faf000058e0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:16.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.447+0000 7faf0a000700 1 -- 172.21.15.72:0/1838427964 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7faef8057270 con 0x7faf0c074d20 2024-03-19T06:02:16.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:16 smithi172 ceph-mon[35716]: pgmap v265: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:02:16.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:02:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.716+0000 7faeff400700 1 -- 172.21.15.72:0/1838427964 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faee8000bc0 con 0x7faef406c680 2024-03-19T06:02:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.746+0000 7faf0a000700 1 -- 172.21.15.72:0/1838427964 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7faee8000bc0 con 0x7faef406c680 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (6m) 44s ago 8m 13.7M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (9m) 44s ago 9m 7545k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (7m) 50s ago 7m 7402k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (9m) 44s ago 9m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (7m) 50s ago 7m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (6m) 44s ago 8m 72.8M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (70s) 44s ago 69s 11.7M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (79s) 44s ago 78s 14.9M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (66s) 50s ago 65s 11.5M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (75s) 50s ago 74s 14.2M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:9283,8765,8443 running (10m) 44s ago 10m 488M - 18.2.0 dc2bc1663786 af0e8bfc899d 2024-03-19T06:02:16.740 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (7m) 50s ago 7m 437M - 18.2.0 dc2bc1663786 16f76f54583f 2024-03-19T06:02:16.741 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (10m) 44s ago 11m 44.9M 2048M 18.2.0 dc2bc1663786 77289e9e2b33 2024-03-19T06:02:16.741 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (7m) 50s ago 7m 33.7M 2048M 18.2.0 dc2bc1663786 31fba31e7d8a 2024-03-19T06:02:16.741 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (8m) 44s ago 8m 7810k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:02:16.741 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (7m) 50s ago 7m 8006k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:02:16.741 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (6m) 44s ago 6m 47.1M 3947M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:02:16.741 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (5m) 44s ago 5m 47.5M 3947M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:02:16.741 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (4m) 44s ago 4m 46.5M 3947M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:02:16.741 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (4m) 50s ago 4m 45.1M 4971M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:02:16.741 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (3m) 50s ago 3m 42.8M 4971M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:02:16.741 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (3m) 50s ago 3m 42.5M 4971M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:02:16.741 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (6m) 44s ago 7m 53.1M - 2.43.0 a07b618ecd1d ea7a91af5b4a 2024-03-19T06:02:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.749+0000 7faeff400700 1 -- 172.21.15.72:0/1838427964 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7faef406c680 msgr2=0x7faef406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.749+0000 7faeff400700 1 --2- 172.21.15.72:0/1838427964 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7faef406c680 0x7faef406eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faf00005950 tx=0x7faf000058e0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.749+0000 7faeff400700 1 -- 172.21.15.72:0/1838427964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf0c074d20 msgr2=0x7faf0c1981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.749+0000 7faeff400700 1 --2- 172.21.15.72:0/1838427964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf0c074d20 0x7faf0c1981b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faef8005b40 tx=0x7faef800be20 comp rx=0 tx=0).stop 2024-03-19T06:02:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.750+0000 7faeff400700 1 -- 172.21.15.72:0/1838427964 shutdown_connections 2024-03-19T06:02:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.750+0000 7faeff400700 1 --2- 172.21.15.72:0/1838427964 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7faef406c680 0x7faef406eb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.750+0000 7faeff400700 1 --2- 172.21.15.72:0/1838427964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c073750 0x7faf0c197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.750+0000 7faeff400700 1 --2- 172.21.15.72:0/1838427964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf0c074d20 0x7faf0c1981b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.750+0000 7faeff400700 1 -- 172.21.15.72:0/1838427964 >> 172.21.15.72:0/1838427964 conn(0x7faf0c0fb7f0 msgr2=0x7faf0c106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.750+0000 7faeff400700 1 -- 172.21.15.72:0/1838427964 shutdown_connections 2024-03-19T06:02:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.750+0000 7faeff400700 1 -- 172.21.15.72:0/1838427964 wait complete. 2024-03-19T06:02:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.919+0000 7f262a000700 1 -- 172.21.15.72:0/119617838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2624100240 msgr2=0x7f2624100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.919+0000 7f262a000700 1 --2- 172.21.15.72:0/119617838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2624100240 0x7f2624100650 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2614009910 tx=0x7f2614009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.919+0000 7f262a000700 1 -- 172.21.15.72:0/119617838 shutdown_connections 2024-03-19T06:02:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.919+0000 7f262a000700 1 --2- 172.21.15.72:0/119617838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624101440 0x7f2624101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.919+0000 7f262a000700 1 --2- 172.21.15.72:0/119617838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2624100240 0x7f2624100650 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.919+0000 7f262a000700 1 -- 172.21.15.72:0/119617838 >> 172.21.15.72:0/119617838 conn(0x7f26240fb7f0 msgr2=0x7f26240fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.919+0000 7f262a000700 1 -- 172.21.15.72:0/119617838 shutdown_connections 2024-03-19T06:02:16.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.919+0000 7f262a000700 1 -- 172.21.15.72:0/119617838 wait complete. 2024-03-19T06:02:16.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.920+0000 7f262a000700 1 Processor -- start 2024-03-19T06:02:16.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.921+0000 7f262a000700 1 -- start start 2024-03-19T06:02:16.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.921+0000 7f262a000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624100240 0x7f2624197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.921+0000 7f262a000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2624101440 0x7f26241981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.921+0000 7f262a000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26241987f0 con 0x7f2624101440 2024-03-19T06:02:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.921+0000 7f262a000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2624198960 con 0x7f2624100240 2024-03-19T06:02:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.922+0000 7f2623400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624100240 0x7f2624197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.922+0000 7f2623400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624100240 0x7f2624197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:33236/0 (socket says 172.21.15.72:33236) 2024-03-19T06:02:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.922+0000 7f2623400700 1 -- 172.21.15.72:0/3517009302 learned_addr learned my addr 172.21.15.72:0/3517009302 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.922+0000 7f2622a00700 1 --2- 172.21.15.72:0/3517009302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2624101440 0x7f26241981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.923+0000 7f2623400700 1 -- 172.21.15.72:0/3517009302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2624101440 msgr2=0x7f26241981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.923+0000 7f2623400700 1 --2- 172.21.15.72:0/3517009302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2624101440 0x7f26241981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.923+0000 7f2623400700 1 -- 172.21.15.72:0/3517009302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26140095f0 con 0x7f2624100240 2024-03-19T06:02:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.923+0000 7f2623400700 1 --2- 172.21.15.72:0/3517009302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624100240 0x7f2624197cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f261400bda0 tx=0x7f261400be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.924+0000 7f261be00700 1 -- 172.21.15.72:0/3517009302 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f261401d070 con 0x7f2624100240 2024-03-19T06:02:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.924+0000 7f262a000700 1 -- 172.21.15.72:0/3517009302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262419d390 con 0x7f2624100240 2024-03-19T06:02:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.924+0000 7f262a000700 1 -- 172.21.15.72:0/3517009302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262419d880 con 0x7f2624100240 2024-03-19T06:02:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.924+0000 7f261be00700 1 -- 172.21.15.72:0/3517009302 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2614004c50 con 0x7f2624100240 2024-03-19T06:02:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.924+0000 7f261be00700 1 -- 172.21.15.72:0/3517009302 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f261400f690 con 0x7f2624100240 2024-03-19T06:02:16.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.925+0000 7f262a000700 1 -- 172.21.15.72:0/3517009302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2604005320 con 0x7f2624100240 2024-03-19T06:02:16.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.928+0000 7f261be00700 1 -- 172.21.15.72:0/3517009302 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f261400f7f0 con 0x7f2624100240 2024-03-19T06:02:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.928+0000 7f261be00700 1 --2- 172.21.15.72:0/3517009302 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f260806c680 0x7f260806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:16.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.929+0000 7f261be00700 1 -- 172.21.15.72:0/3517009302 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f261408d0b0 con 0x7f2624100240 2024-03-19T06:02:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.929+0000 7f2622a00700 1 --2- 172.21.15.72:0/3517009302 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f260806c680 0x7f260806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:16.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.929+0000 7f2622a00700 1 --2- 172.21.15.72:0/3517009302 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f260806c680 0x7f260806eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2610005fd0 tx=0x7f261000a560 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:16.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:16.944+0000 7f261be00700 1 -- 172.21.15.72:0/3517009302 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f26140578c0 con 0x7f2624100240 2024-03-19T06:02:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.285+0000 7f262a000700 1 -- 172.21.15.72:0/3517009302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2604005cc0 con 0x7f2624100240 2024-03-19T06:02:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.286+0000 7f261be00700 1 -- 172.21.15.72:0/3517009302 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f261405aee0 con 0x7f2624100240 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:02:17.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:02:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:02:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-03-19T06:02:17.281 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:02:17.281 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:02:17.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.289+0000 7f262a000700 1 -- 172.21.15.72:0/3517009302 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f260806c680 msgr2=0x7f260806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:17.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.289+0000 7f262a000700 1 --2- 172.21.15.72:0/3517009302 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f260806c680 0x7f260806eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2610005fd0 tx=0x7f261000a560 comp rx=0 tx=0).stop 2024-03-19T06:02:17.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.289+0000 7f262a000700 1 -- 172.21.15.72:0/3517009302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624100240 msgr2=0x7f2624197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:17.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.289+0000 7f262a000700 1 --2- 172.21.15.72:0/3517009302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624100240 0x7f2624197cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f261400bda0 tx=0x7f261400be80 comp rx=0 tx=0).stop 2024-03-19T06:02:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.290+0000 7f262a000700 1 -- 172.21.15.72:0/3517009302 shutdown_connections 2024-03-19T06:02:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.290+0000 7f262a000700 1 --2- 172.21.15.72:0/3517009302 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f260806c680 0x7f260806eb30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.290+0000 7f262a000700 1 --2- 172.21.15.72:0/3517009302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2624100240 0x7f2624197cb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.290+0000 7f262a000700 1 --2- 172.21.15.72:0/3517009302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2624101440 0x7f26241981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.290+0000 7f262a000700 1 -- 172.21.15.72:0/3517009302 >> 172.21.15.72:0/3517009302 conn(0x7f26240fb7f0 msgr2=0x7f2624102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.290+0000 7f262a000700 1 -- 172.21.15.72:0/3517009302 shutdown_connections 2024-03-19T06:02:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.290+0000 7f262a000700 1 -- 172.21.15.72:0/3517009302 wait complete. 2024-03-19T06:02:17.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.469+0000 7f89e2a00700 1 -- 172.21.15.72:0/990407643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89dc0fe500 msgr2=0x7f89dc0fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:17.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.469+0000 7f89e2a00700 1 --2- 172.21.15.72:0/990407643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89dc0fe500 0x7f89dc0fe910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009910 tx=0x7f89cc009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:17.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.469+0000 7f89e2a00700 1 -- 172.21.15.72:0/990407643 shutdown_connections 2024-03-19T06:02:17.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.469+0000 7f89e2a00700 1 --2- 172.21.15.72:0/990407643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89dc0fee50 0x7f89dc0ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.469+0000 7f89e2a00700 1 --2- 172.21.15.72:0/990407643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89dc0fe500 0x7f89dc0fe910 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.469+0000 7f89e2a00700 1 -- 172.21.15.72:0/990407643 >> 172.21.15.72:0/990407643 conn(0x7f89dc0f9f10 msgr2=0x7f89dc0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:17.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.469+0000 7f89e2a00700 1 -- 172.21.15.72:0/990407643 shutdown_connections 2024-03-19T06:02:17.463 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:17 smithi072 ceph-mon[28706]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:17.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.469+0000 7f89e2a00700 1 -- 172.21.15.72:0/990407643 wait complete. 2024-03-19T06:02:17.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.471+0000 7f89e2a00700 1 Processor -- start 2024-03-19T06:02:17.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.471+0000 7f89e2a00700 1 -- start start 2024-03-19T06:02:17.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.471+0000 7f89e2a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89dc0fe500 0x7f89dc193910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:17.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.471+0000 7f89e2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89dc0fee50 0x7f89dc193e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:17.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.472+0000 7f89e2a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc1943e0 con 0x7f89dc0fee50 2024-03-19T06:02:17.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.472+0000 7f89e2a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc194520 con 0x7f89dc0fe500 2024-03-19T06:02:17.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.472+0000 7f89db400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89dc0fee50 0x7f89dc193e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:17.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.472+0000 7f89db400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89dc0fee50 0x7f89dc193e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50930/0 (socket says 172.21.15.72:50930) 2024-03-19T06:02:17.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.472+0000 7f89db400700 1 -- 172.21.15.72:0/892090129 learned_addr learned my addr 172.21.15.72:0/892090129 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:17.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.472+0000 7f89dbe00700 1 --2- 172.21.15.72:0/892090129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89dc0fe500 0x7f89dc193910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:17.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.472+0000 7f89db400700 1 -- 172.21.15.72:0/892090129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89dc0fe500 msgr2=0x7f89dc193910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:17.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.472+0000 7f89db400700 1 --2- 172.21.15.72:0/892090129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89dc0fe500 0x7f89dc193910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.472+0000 7f89db400700 1 -- 172.21.15.72:0/892090129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc0095f0 con 0x7f89dc0fee50 2024-03-19T06:02:17.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.473+0000 7f89db400700 1 --2- 172.21.15.72:0/892090129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89dc0fee50 0x7f89dc193e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c930 tx=0x7f89c800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:17.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.473+0000 7f89d8c00700 1 -- 172.21.15.72:0/892090129 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89c8007a70 con 0x7f89dc0fee50 2024-03-19T06:02:17.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.473+0000 7f89d8c00700 1 -- 172.21.15.72:0/892090129 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f89c8007bd0 con 0x7f89dc0fee50 2024-03-19T06:02:17.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.474+0000 7f89d8c00700 1 -- 172.21.15.72:0/892090129 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89c8018630 con 0x7f89dc0fee50 2024-03-19T06:02:17.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.476+0000 7f89e2a00700 1 -- 172.21.15.72:0/892090129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc196fd0 con 0x7f89dc0fee50 2024-03-19T06:02:17.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.476+0000 7f89e2a00700 1 -- 172.21.15.72:0/892090129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc1974a0 con 0x7f89dc0fee50 2024-03-19T06:02:17.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.477+0000 7f89e2a00700 1 -- 172.21.15.72:0/892090129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc10af40 con 0x7f89dc0fee50 2024-03-19T06:02:17.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.478+0000 7f89d8c00700 1 -- 172.21.15.72:0/892090129 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f89c8007d40 con 0x7f89dc0fee50 2024-03-19T06:02:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.479+0000 7f89d8c00700 1 --2- 172.21.15.72:0/892090129 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f89c006c680 0x7f89c006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.479+0000 7f89d8c00700 1 -- 172.21.15.72:0/892090129 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f89c808bdc0 con 0x7f89dc0fee50 2024-03-19T06:02:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.479+0000 7f89dbe00700 1 --2- 172.21.15.72:0/892090129 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f89c006c680 0x7f89c006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:17.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.480+0000 7f89dbe00700 1 --2- 172.21.15.72:0/892090129 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f89c006c680 0x7f89c006eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f89cc000c00 tx=0x7f89cc005fb0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:17.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.484+0000 7f89d8c00700 1 -- 172.21.15.72:0/892090129 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f89c8059fb0 con 0x7f89dc0fee50 2024-03-19T06:02:17.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:17 smithi172 ceph-mon[35716]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:17.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.804+0000 7f89e2a00700 1 -- 172.21.15.72:0/892090129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f89dc106050 con 0x7f89dc0fee50 2024-03-19T06:02:17.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.805+0000 7f89d8c00700 1 -- 172.21.15.72:0/892090129 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1831 (secure 0 0 0) 0x7f89c8059b40 con 0x7f89dc0fee50 2024-03-19T06:02:17.798 INFO:teuthology.orchestra.run.smithi072.stdout:e13 2024-03-19T06:02:17.798 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:02:17.798 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:02:17.798 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:02:17.798 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:02:17.798 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 13 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:01:14.992147+0000 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:02:17.799 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:02:17.800 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:02:17.801 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:02:17.801 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:02:17.801 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:02:17.801 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:02:17.801 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:02:17.801 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:02:17.801 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:02:17.801 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:02:17.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.807+0000 7f89e2a00700 1 -- 172.21.15.72:0/892090129 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f89c006c680 msgr2=0x7f89c006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:17.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.807+0000 7f89e2a00700 1 --2- 172.21.15.72:0/892090129 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f89c006c680 0x7f89c006eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f89cc000c00 tx=0x7f89cc005fb0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.808+0000 7f89e2a00700 1 -- 172.21.15.72:0/892090129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89dc0fee50 msgr2=0x7f89dc193e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:17.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.808+0000 7f89e2a00700 1 --2- 172.21.15.72:0/892090129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89dc0fee50 0x7f89dc193e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c930 tx=0x7f89c800ccf0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.808+0000 7f89e2a00700 1 -- 172.21.15.72:0/892090129 shutdown_connections 2024-03-19T06:02:17.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.808+0000 7f89e2a00700 1 --2- 172.21.15.72:0/892090129 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f89c006c680 0x7f89c006eb30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.808+0000 7f89e2a00700 1 --2- 172.21.15.72:0/892090129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89dc0fe500 0x7f89dc193910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.808+0000 7f89e2a00700 1 --2- 172.21.15.72:0/892090129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89dc0fee50 0x7f89dc193e50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.808+0000 7f89e2a00700 1 -- 172.21.15.72:0/892090129 >> 172.21.15.72:0/892090129 conn(0x7f89dc0f9f10 msgr2=0x7f89dc103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:17.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.808+0000 7f89e2a00700 1 -- 172.21.15.72:0/892090129 shutdown_connections 2024-03-19T06:02:17.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.808+0000 7f89e2a00700 1 -- 172.21.15.72:0/892090129 wait complete. 2024-03-19T06:02:17.803 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 13 2024-03-19T06:02:17.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.962+0000 7fcdb2e00700 1 -- 172.21.15.72:0/4227065317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac106670 msgr2=0x7fcdac106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:17.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.962+0000 7fcdb2e00700 1 --2- 172.21.15.72:0/4227065317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac106670 0x7fcdac106a80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009910 tx=0x7fcda0009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:17.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.962+0000 7fcdb2e00700 1 -- 172.21.15.72:0/4227065317 shutdown_connections 2024-03-19T06:02:17.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.962+0000 7fcdb2e00700 1 --2- 172.21.15.72:0/4227065317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac107870 0x7fcdac107cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.962+0000 7fcdb2e00700 1 --2- 172.21.15.72:0/4227065317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac106670 0x7fcdac106a80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.962+0000 7fcdb2e00700 1 -- 172.21.15.72:0/4227065317 >> 172.21.15.72:0/4227065317 conn(0x7fcdac075740 msgr2=0x7fcdac077bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.962+0000 7fcdb2e00700 1 -- 172.21.15.72:0/4227065317 shutdown_connections 2024-03-19T06:02:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.962+0000 7fcdb2e00700 1 -- 172.21.15.72:0/4227065317 wait complete. 2024-03-19T06:02:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.963+0000 7fcdb2e00700 1 Processor -- start 2024-03-19T06:02:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.963+0000 7fcdb2e00700 1 -- start start 2024-03-19T06:02:17.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.964+0000 7fcdb2e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac106670 0x7fcdac19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:17.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.964+0000 7fcdb2e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac107870 0x7fcdac19c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:17.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.964+0000 7fcdb2e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac19c960 con 0x7fcdac107870 2024-03-19T06:02:17.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.964+0000 7fcdb2e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac19caa0 con 0x7fcdac106670 2024-03-19T06:02:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.964+0000 7fcdb1000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac107870 0x7fcdac19c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.964+0000 7fcdb1000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac107870 0x7fcdac19c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50954/0 (socket says 172.21.15.72:50954) 2024-03-19T06:02:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.964+0000 7fcdb1000700 1 -- 172.21.15.72:0/3129217475 learned_addr learned my addr 172.21.15.72:0/3129217475 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.964+0000 7fcdb1a00700 1 --2- 172.21.15.72:0/3129217475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac106670 0x7fcdac19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.965+0000 7fcdb1000700 1 -- 172.21.15.72:0/3129217475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac106670 msgr2=0x7fcdac19be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.965+0000 7fcdb1000700 1 --2- 172.21.15.72:0/3129217475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac106670 0x7fcdac19be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.965+0000 7fcdb1000700 1 -- 172.21.15.72:0/3129217475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00095f0 con 0x7fcdac107870 2024-03-19T06:02:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.965+0000 7fcdb1000700 1 --2- 172.21.15.72:0/3129217475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac107870 0x7fcdac19c3d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00c930 tx=0x7fcd9c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.966+0000 7fcdaa000700 1 -- 172.21.15.72:0/3129217475 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd9c007ad0 con 0x7fcdac107870 2024-03-19T06:02:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.966+0000 7fcdaa000700 1 -- 172.21.15.72:0/3129217475 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcd9c00ce80 con 0x7fcdac107870 2024-03-19T06:02:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.966+0000 7fcdb2e00700 1 -- 172.21.15.72:0/3129217475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac1a1560 con 0x7fcdac107870 2024-03-19T06:02:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.966+0000 7fcdaa000700 1 -- 172.21.15.72:0/3129217475 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd9c018630 con 0x7fcdac107870 2024-03-19T06:02:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.966+0000 7fcdb2e00700 1 -- 172.21.15.72:0/3129217475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac1a1a80 con 0x7fcdac107870 2024-03-19T06:02:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.967+0000 7fcdb2e00700 1 -- 172.21.15.72:0/3129217475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac10f1c0 con 0x7fcdac107870 2024-03-19T06:02:17.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.968+0000 7fcdaa000700 1 -- 172.21.15.72:0/3129217475 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcd9c007c30 con 0x7fcdac107870 2024-03-19T06:02:17.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.969+0000 7fcdaa000700 1 --2- 172.21.15.72:0/3129217475 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fcd9406c680 0x7fcd9406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:17.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.969+0000 7fcdaa000700 1 -- 172.21.15.72:0/3129217475 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fcd9c08b7a0 con 0x7fcdac107870 2024-03-19T06:02:17.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.969+0000 7fcdb1a00700 1 --2- 172.21.15.72:0/3129217475 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fcd9406c680 0x7fcd9406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.970+0000 7fcdb1a00700 1 --2- 172.21.15.72:0/3129217475 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fcd9406c680 0x7fcd9406eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcda0006010 tx=0x7fcda000b560 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:17.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:17.974+0000 7fcdaa000700 1 -- 172.21.15.72:0/3129217475 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcd9c059990 con 0x7fcdac107870 2024-03-19T06:02:18.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.209+0000 7fcdb2e00700 1 -- 172.21.15.72:0/3129217475 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdac10c1c0 con 0x7fcd9406c680 2024-03-19T06:02:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.210+0000 7fcdaa000700 1 -- 172.21.15.72:0/3129217475 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fcdac10c1c0 con 0x7fcd9406c680 2024-03-19T06:02:18.203 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:02:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:02:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:02:18.203 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:02:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-03-19T06:02:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "", 2024-03-19T06:02:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f image", 2024-03-19T06:02:18.204 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:02:18.204 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:02:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.213+0000 7fcdb2e00700 1 -- 172.21.15.72:0/3129217475 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fcd9406c680 msgr2=0x7fcd9406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.213+0000 7fcdb2e00700 1 --2- 172.21.15.72:0/3129217475 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fcd9406c680 0x7fcd9406eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcda0006010 tx=0x7fcda000b560 comp rx=0 tx=0).stop 2024-03-19T06:02:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.213+0000 7fcdb2e00700 1 -- 172.21.15.72:0/3129217475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac107870 msgr2=0x7fcdac19c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.213+0000 7fcdb2e00700 1 --2- 172.21.15.72:0/3129217475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac107870 0x7fcdac19c3d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00c930 tx=0x7fcd9c00cc40 comp rx=0 tx=0).stop 2024-03-19T06:02:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.213+0000 7fcdb2e00700 1 -- 172.21.15.72:0/3129217475 shutdown_connections 2024-03-19T06:02:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.213+0000 7fcdb2e00700 1 --2- 172.21.15.72:0/3129217475 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fcd9406c680 0x7fcd9406eb30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.213+0000 7fcdb2e00700 1 --2- 172.21.15.72:0/3129217475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac106670 0x7fcdac19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.213+0000 7fcdb2e00700 1 --2- 172.21.15.72:0/3129217475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac107870 0x7fcdac19c3d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.213+0000 7fcdb2e00700 1 -- 172.21.15.72:0/3129217475 >> 172.21.15.72:0/3129217475 conn(0x7fcdac075740 msgr2=0x7fcdac10aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.213+0000 7fcdb2e00700 1 -- 172.21.15.72:0/3129217475 shutdown_connections 2024-03-19T06:02:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.213+0000 7fcdb2e00700 1 -- 172.21.15.72:0/3129217475 wait complete. 2024-03-19T06:02:18.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.365+0000 7f9f0b000700 1 -- 172.21.15.72:0/2108388688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074d20 msgr2=0x7f9f04073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:18.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.365+0000 7f9f0b000700 1 --2- 172.21.15.72:0/2108388688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074d20 0x7f9f04073180 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009910 tx=0x7f9ef4009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:18.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.365+0000 7f9f0b000700 1 -- 172.21.15.72:0/2108388688 shutdown_connections 2024-03-19T06:02:18.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.365+0000 7f9f0b000700 1 --2- 172.21.15.72:0/2108388688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f04073750 0x7f9f04073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:18.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.365+0000 7f9f0b000700 1 --2- 172.21.15.72:0/2108388688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074d20 0x7f9f04073180 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:18.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.365+0000 7f9f0b000700 1 -- 172.21.15.72:0/2108388688 >> 172.21.15.72:0/2108388688 conn(0x7f9f040fb7f0 msgr2=0x7f9f040fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.365+0000 7f9f0b000700 1 -- 172.21.15.72:0/2108388688 shutdown_connections 2024-03-19T06:02:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.366+0000 7f9f0b000700 1 -- 172.21.15.72:0/2108388688 wait complete. 2024-03-19T06:02:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.366+0000 7f9f0b000700 1 Processor -- start 2024-03-19T06:02:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.367+0000 7f9f0b000700 1 -- start start 2024-03-19T06:02:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.367+0000 7f9f0b000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04073750 0x7f9f04197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.367+0000 7f9f0b000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f04074d20 0x7f9f04198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.367+0000 7f9f0b000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f041988b0 con 0x7f9f04073750 2024-03-19T06:02:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.367+0000 7f9f0b000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f041989f0 con 0x7f9f04074d20 2024-03-19T06:02:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.367+0000 7f9f03e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04073750 0x7f9f04197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.367+0000 7f9f03e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04073750 0x7f9f04197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50974/0 (socket says 172.21.15.72:50974) 2024-03-19T06:02:18.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.367+0000 7f9f03e00700 1 -- 172.21.15.72:0/805245069 learned_addr learned my addr 172.21.15.72:0/805245069 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:18.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.368+0000 7f9f03e00700 1 -- 172.21.15.72:0/805245069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f04074d20 msgr2=0x7f9f04198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:18.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.368+0000 7f9f03e00700 1 --2- 172.21.15.72:0/805245069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f04074d20 0x7f9f04198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:18.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.368+0000 7f9f03e00700 1 -- 172.21.15.72:0/805245069 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef40095f0 con 0x7f9f04073750 2024-03-19T06:02:18.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.368+0000 7f9f03e00700 1 --2- 172.21.15.72:0/805245069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04073750 0x7f9f04197d50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400b5c0 tx=0x7f9ef400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:18.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.368+0000 7f9f00c00700 1 -- 172.21.15.72:0/805245069 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef401d070 con 0x7f9f04073750 2024-03-19T06:02:18.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.368+0000 7f9f00c00700 1 -- 172.21.15.72:0/805245069 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9ef4022470 con 0x7f9f04073750 2024-03-19T06:02:18.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.368+0000 7f9f00c00700 1 -- 172.21.15.72:0/805245069 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef400f690 con 0x7f9f04073750 2024-03-19T06:02:18.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.369+0000 7f9f0b000700 1 -- 172.21.15.72:0/805245069 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0419d440 con 0x7f9f04073750 2024-03-19T06:02:18.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.369+0000 7f9f0b000700 1 -- 172.21.15.72:0/805245069 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0419d930 con 0x7f9f04073750 2024-03-19T06:02:18.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.370+0000 7f9f0b000700 1 -- 172.21.15.72:0/805245069 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0410b000 con 0x7f9f04073750 2024-03-19T06:02:18.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.371+0000 7f9f00c00700 1 -- 172.21.15.72:0/805245069 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9ef4004b70 con 0x7f9f04073750 2024-03-19T06:02:18.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.372+0000 7f9f00c00700 1 --2- 172.21.15.72:0/805245069 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ee806c680 0x7f9ee806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:18.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.372+0000 7f9f00c00700 1 -- 172.21.15.72:0/805245069 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f9ef408ceb0 con 0x7f9f04073750 2024-03-19T06:02:18.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.372+0000 7f9f03400700 1 --2- 172.21.15.72:0/805245069 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ee806c680 0x7f9ee806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:18.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.373+0000 7f9f03400700 1 --2- 172.21.15.72:0/805245069 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ee806c680 0x7f9ee806eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00097b0 tx=0x7f9ef0006d20 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:18.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.376+0000 7f9f00c00700 1 -- 172.21.15.72:0/805245069 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9ef405b150 con 0x7f9f04073750 2024-03-19T06:02:18.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:18 smithi072 ceph-mon[28706]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:18.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:18 smithi072 ceph-mon[28706]: pgmap v266: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-19T06:02:18.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:18 smithi072 ceph-mon[28706]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:18.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:18 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3517009302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:02:18.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:18 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/892090129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:02:18.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:18 smithi172 ceph-mon[35716]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:18.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:18 smithi172 ceph-mon[35716]: pgmap v266: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-19T06:02:18.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:18 smithi172 ceph-mon[35716]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:18.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:18 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3517009302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:02:18.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:18 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/892090129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:02:18.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.688+0000 7f9f0b000700 1 -- 172.21.15.72:0/805245069 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9f0419e370 con 0x7f9f04073750 2024-03-19T06:02:18.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.689+0000 7f9f00c00700 1 -- 172.21.15.72:0/805245069 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f9ef405ace0 con 0x7f9f04073750 2024-03-19T06:02:18.682 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:02:18.682 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:02:18.682 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:02:18.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.692+0000 7f9f0b000700 1 -- 172.21.15.72:0/805245069 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ee806c680 msgr2=0x7f9ee806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:18.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.692+0000 7f9f0b000700 1 --2- 172.21.15.72:0/805245069 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ee806c680 0x7f9ee806eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00097b0 tx=0x7f9ef0006d20 comp rx=0 tx=0).stop 2024-03-19T06:02:18.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.692+0000 7f9f0b000700 1 -- 172.21.15.72:0/805245069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04073750 msgr2=0x7f9f04197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:18.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.692+0000 7f9f0b000700 1 --2- 172.21.15.72:0/805245069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04073750 0x7f9f04197d50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400b5c0 tx=0x7f9ef400be20 comp rx=0 tx=0).stop 2024-03-19T06:02:18.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.692+0000 7f9f0b000700 1 -- 172.21.15.72:0/805245069 shutdown_connections 2024-03-19T06:02:18.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.692+0000 7f9f0b000700 1 --2- 172.21.15.72:0/805245069 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f9ee806c680 0x7f9ee806eb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:18.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.692+0000 7f9f0b000700 1 --2- 172.21.15.72:0/805245069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04073750 0x7f9f04197d50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:18.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.692+0000 7f9f0b000700 1 --2- 172.21.15.72:0/805245069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f04074d20 0x7f9f04198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:18.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.692+0000 7f9f0b000700 1 -- 172.21.15.72:0/805245069 >> 172.21.15.72:0/805245069 conn(0x7f9f040fb7f0 msgr2=0x7f9f04106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:18.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.692+0000 7f9f0b000700 1 -- 172.21.15.72:0/805245069 shutdown_connections 2024-03-19T06:02:18.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:18.692+0000 7f9f0b000700 1 -- 172.21.15.72:0/805245069 wait complete. 2024-03-19T06:02:19.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:19 smithi072 ceph-mon[28706]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:19.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:19 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/805245069' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:02:19.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:19 smithi172 ceph-mon[35716]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:19.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:19 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/805245069' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:02:20.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:20 smithi072 ceph-mon[28706]: pgmap v267: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:20.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:20 smithi172 ceph-mon[35716]: pgmap v267: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:22.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:22 smithi072 ceph-mon[28706]: pgmap v268: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:22.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:22 smithi172 ceph-mon[35716]: pgmap v268: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:24.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:24 smithi072 ceph-mon[28706]: pgmap v269: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:24.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:24 smithi172 ceph-mon[35716]: pgmap v269: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:26.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:26 smithi072 ceph-mon[28706]: pgmap v270: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:26.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:26 smithi172 ceph-mon[35716]: pgmap v270: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:28.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:28 smithi072 ceph-mon[28706]: pgmap v271: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:28.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:28 smithi172 ceph-mon[35716]: pgmap v271: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:30.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:30 smithi072 ceph-mon[28706]: pgmap v272: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:30.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:30 smithi172 ceph-mon[35716]: pgmap v272: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:31.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:02:31.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:31 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:02:32.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:32 smithi072 ceph-mon[28706]: pgmap v273: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:32.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:32 smithi172 ceph-mon[35716]: pgmap v273: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:33.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:33 smithi072 ceph-mon[28706]: pgmap v274: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:33.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:33 smithi172 ceph-mon[35716]: pgmap v274: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:36.077 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:35 smithi072 ceph-mon[28706]: pgmap v275: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:36.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:35 smithi172 ceph-mon[35716]: pgmap v275: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:38.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:38 smithi172 ceph-mon[35716]: pgmap v276: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:38.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:38 smithi072 ceph-mon[28706]: pgmap v276: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:40.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:40 smithi172 ceph-mon[35716]: pgmap v277: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:40.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:40 smithi072 ceph-mon[28706]: pgmap v277: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:42.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:42 smithi172 ceph-mon[35716]: pgmap v278: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:42.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:42 smithi072 ceph-mon[28706]: pgmap v278: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:44.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:44 smithi072 ceph-mon[28706]: pgmap v279: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:44.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:44 smithi172 ceph-mon[35716]: pgmap v279: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:46.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:46 smithi072 ceph-mon[28706]: pgmap v280: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:46.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:46 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:02:46.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:46 smithi172 ceph-mon[35716]: pgmap v280: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:46.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:46 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:02:48.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:48 smithi072 ceph-mon[28706]: pgmap v281: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:48.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:48 smithi172 ceph-mon[35716]: pgmap v281: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:48.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.897+0000 7f6dbba00700 1 -- 172.21.15.72:0/979434846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db4069270 msgr2=0x7f6db41051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:48.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.897+0000 7f6dbba00700 1 --2- 172.21.15.72:0/979434846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db4069270 0x7f6db41051d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009910 tx=0x7f6da4009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:48.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.897+0000 7f6dbba00700 1 -- 172.21.15.72:0/979434846 shutdown_connections 2024-03-19T06:02:48.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.897+0000 7f6dbba00700 1 --2- 172.21.15.72:0/979434846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4105710 0x7f6db4107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:48.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.897+0000 7f6dbba00700 1 --2- 172.21.15.72:0/979434846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db4069270 0x7f6db41051d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:48.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.897+0000 7f6dbba00700 1 -- 172.21.15.72:0/979434846 >> 172.21.15.72:0/979434846 conn(0x7f6db40fa780 msgr2=0x7f6db40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:48.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.898+0000 7f6dbba00700 1 -- 172.21.15.72:0/979434846 shutdown_connections 2024-03-19T06:02:48.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.899+0000 7f6dbba00700 1 -- 172.21.15.72:0/979434846 wait complete. 2024-03-19T06:02:48.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.900+0000 7f6dbba00700 1 Processor -- start 2024-03-19T06:02:48.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.901+0000 7f6dbba00700 1 -- start start 2024-03-19T06:02:48.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.901+0000 7f6dbba00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4105710 0x7f6db4072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:48.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.902+0000 7f6dbba00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db40725c0 0x7f6db41a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:48.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.902+0000 7f6dbba00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4072af0 con 0x7f6db40725c0 2024-03-19T06:02:48.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.902+0000 7f6db9000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4105710 0x7f6db4072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:48.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.902+0000 7f6dbba00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4072c60 con 0x7f6db4105710 2024-03-19T06:02:48.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.902+0000 7f6db9000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4105710 0x7f6db4072080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:40576/0 (socket says 172.21.15.72:40576) 2024-03-19T06:02:48.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.902+0000 7f6db9000700 1 -- 172.21.15.72:0/1819435803 learned_addr learned my addr 172.21.15.72:0/1819435803 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:48.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.903+0000 7f6db3e00700 1 --2- 172.21.15.72:0/1819435803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db40725c0 0x7f6db41a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:48.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.903+0000 7f6db9000700 1 -- 172.21.15.72:0/1819435803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db40725c0 msgr2=0x7f6db41a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:48.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.903+0000 7f6db9000700 1 --2- 172.21.15.72:0/1819435803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db40725c0 0x7f6db41a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:48.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.903+0000 7f6db9000700 1 -- 172.21.15.72:0/1819435803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da40095f0 con 0x7f6db4105710 2024-03-19T06:02:48.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.903+0000 7f6db3e00700 1 --2- 172.21.15.72:0/1819435803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db40725c0 0x7f6db41a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:02:48.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.904+0000 7f6db9000700 1 --2- 172.21.15.72:0/1819435803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4105710 0x7f6db4072080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6da4000c00 tx=0x7f6da400be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:48.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.904+0000 7f6db1600700 1 -- 172.21.15.72:0/1819435803 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6da401d070 con 0x7f6db4105710 2024-03-19T06:02:48.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.904+0000 7f6dbba00700 1 -- 172.21.15.72:0/1819435803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db41a6290 con 0x7f6db4105710 2024-03-19T06:02:48.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.905+0000 7f6db1600700 1 -- 172.21.15.72:0/1819435803 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6da4022470 con 0x7f6db4105710 2024-03-19T06:02:48.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.905+0000 7f6db1600700 1 -- 172.21.15.72:0/1819435803 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6da400f690 con 0x7f6db4105710 2024-03-19T06:02:48.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.905+0000 7f6dbba00700 1 -- 172.21.15.72:0/1819435803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db41a6750 con 0x7f6db4105710 2024-03-19T06:02:48.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.906+0000 7f6dbba00700 1 -- 172.21.15.72:0/1819435803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d98005320 con 0x7f6db4105710 2024-03-19T06:02:48.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.908+0000 7f6db1600700 1 -- 172.21.15.72:0/1819435803 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6da4004af0 con 0x7f6db4105710 2024-03-19T06:02:48.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.909+0000 7f6db1600700 1 --2- 172.21.15.72:0/1819435803 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6d9c06c680 0x7f6d9c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:48.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.910+0000 7f6db1600700 1 -- 172.21.15.72:0/1819435803 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f6da408d0a0 con 0x7f6db4105710 2024-03-19T06:02:48.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.910+0000 7f6db3e00700 1 --2- 172.21.15.72:0/1819435803 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6d9c06c680 0x7f6d9c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:48.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.911+0000 7f6db3e00700 1 --2- 172.21.15.72:0/1819435803 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6d9c06c680 0x7f6d9c06eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6da80099d0 tx=0x7f6da8008040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:48.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:48.919+0000 7f6db1600700 1 -- 172.21.15.72:0/1819435803 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6da4057800 con 0x7f6db4105710 2024-03-19T06:02:49.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.324+0000 7f6dbba00700 1 -- 172.21.15.72:0/1819435803 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d98000bf0 con 0x7f6d9c06c680 2024-03-19T06:02:49.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.326+0000 7f6db1600700 1 -- 172.21.15.72:0/1819435803 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f6d98000bf0 con 0x7f6d9c06c680 2024-03-19T06:02:49.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.329+0000 7f6dbba00700 1 -- 172.21.15.72:0/1819435803 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6d9c06c680 msgr2=0x7f6d9c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.329+0000 7f6dbba00700 1 --2- 172.21.15.72:0/1819435803 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6d9c06c680 0x7f6d9c06eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6da80099d0 tx=0x7f6da8008040 comp rx=0 tx=0).stop 2024-03-19T06:02:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.329+0000 7f6dbba00700 1 -- 172.21.15.72:0/1819435803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4105710 msgr2=0x7f6db4072080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.329+0000 7f6dbba00700 1 --2- 172.21.15.72:0/1819435803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4105710 0x7f6db4072080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6da4000c00 tx=0x7f6da400be20 comp rx=0 tx=0).stop 2024-03-19T06:02:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.329+0000 7f6dbba00700 1 -- 172.21.15.72:0/1819435803 shutdown_connections 2024-03-19T06:02:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.329+0000 7f6dbba00700 1 --2- 172.21.15.72:0/1819435803 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6d9c06c680 0x7f6d9c06eb30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.329+0000 7f6dbba00700 1 --2- 172.21.15.72:0/1819435803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4105710 0x7f6db4072080 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.329+0000 7f6dbba00700 1 --2- 172.21.15.72:0/1819435803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db40725c0 0x7f6db41a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.329+0000 7f6dbba00700 1 -- 172.21.15.72:0/1819435803 >> 172.21.15.72:0/1819435803 conn(0x7f6db40fa780 msgr2=0x7f6db40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.330+0000 7f6dbba00700 1 -- 172.21.15.72:0/1819435803 shutdown_connections 2024-03-19T06:02:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.330+0000 7f6dbba00700 1 -- 172.21.15.72:0/1819435803 wait complete. 2024-03-19T06:02:49.343 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:02:49.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.554+0000 7f82c8200700 1 -- 172.21.15.72:0/673210147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c00feb50 msgr2=0x7f82c0100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.554+0000 7f82c8200700 1 --2- 172.21.15.72:0/673210147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c00feb50 0x7f82c0100f70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009910 tx=0x7f82b4009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.554+0000 7f82c8200700 1 -- 172.21.15.72:0/673210147 shutdown_connections 2024-03-19T06:02:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.554+0000 7f82c8200700 1 --2- 172.21.15.72:0/673210147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c01014b0 0x7f82c0103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.554+0000 7f82c8200700 1 --2- 172.21.15.72:0/673210147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c00feb50 0x7f82c0100f70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.554+0000 7f82c8200700 1 -- 172.21.15.72:0/673210147 >> 172.21.15.72:0/673210147 conn(0x7f82c00fa780 msgr2=0x7f82c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.555+0000 7f82c8200700 1 -- 172.21.15.72:0/673210147 shutdown_connections 2024-03-19T06:02:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.555+0000 7f82c8200700 1 -- 172.21.15.72:0/673210147 wait complete. 2024-03-19T06:02:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.556+0000 7f82c8200700 1 Processor -- start 2024-03-19T06:02:49.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.556+0000 7f82c8200700 1 -- start start 2024-03-19T06:02:49.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.557+0000 7f82c8200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c00feb50 0x7f82c019c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.557+0000 7f82c8200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c01014b0 0x7f82c019c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.557+0000 7f82c8200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c019cc10 con 0x7f82c00feb50 2024-03-19T06:02:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.557+0000 7f82c8200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c019cd50 con 0x7f82c01014b0 2024-03-19T06:02:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.557+0000 7f82c5800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c00feb50 0x7f82c019c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.557+0000 7f82c4e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c01014b0 0x7f82c019c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.557+0000 7f82c4e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c01014b0 0x7f82c019c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:40604/0 (socket says 172.21.15.72:40604) 2024-03-19T06:02:49.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.557+0000 7f82c4e00700 1 -- 172.21.15.72:0/3162915840 learned_addr learned my addr 172.21.15.72:0/3162915840 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:49.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.558+0000 7f82c4e00700 1 -- 172.21.15.72:0/3162915840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c00feb50 msgr2=0x7f82c019c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:49.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.558+0000 7f82c4e00700 1 --2- 172.21.15.72:0/3162915840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c00feb50 0x7f82c019c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:49.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.558+0000 7f82c4e00700 1 -- 172.21.15.72:0/3162915840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40095f0 con 0x7f82c01014b0 2024-03-19T06:02:49.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.558+0000 7f82c5800700 1 --2- 172.21.15.72:0/3162915840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c00feb50 0x7f82c019c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:02:49.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.559+0000 7f82c4e00700 1 --2- 172.21.15.72:0/3162915840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c01014b0 0x7f82c019c5f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82b000e920 tx=0x7f82b000ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:49.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.559+0000 7f82be000700 1 -- 172.21.15.72:0/3162915840 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82b000c9d0 con 0x7f82c01014b0 2024-03-19T06:02:49.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.559+0000 7f82be000700 1 -- 172.21.15.72:0/3162915840 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f82b0010430 con 0x7f82c01014b0 2024-03-19T06:02:49.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.559+0000 7f82be000700 1 -- 172.21.15.72:0/3162915840 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82b0018650 con 0x7f82c01014b0 2024-03-19T06:02:49.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.559+0000 7f82c8200700 1 -- 172.21.15.72:0/3162915840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c01a1800 con 0x7f82c01014b0 2024-03-19T06:02:49.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.559+0000 7f82c8200700 1 -- 172.21.15.72:0/3162915840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c01a1d50 con 0x7f82c01014b0 2024-03-19T06:02:49.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.561+0000 7f82c8200700 1 -- 172.21.15.72:0/3162915840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c01961c0 con 0x7f82c01014b0 2024-03-19T06:02:49.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.562+0000 7f82be000700 1 -- 172.21.15.72:0/3162915840 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f82b00105a0 con 0x7f82c01014b0 2024-03-19T06:02:49.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.563+0000 7f82be000700 1 --2- 172.21.15.72:0/3162915840 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f82a806c6d0 0x7f82a806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:49.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.563+0000 7f82be000700 1 -- 172.21.15.72:0/3162915840 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f82b0014070 con 0x7f82c01014b0 2024-03-19T06:02:49.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.564+0000 7f82c5800700 1 --2- 172.21.15.72:0/3162915840 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f82a806c6d0 0x7f82a806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:49.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.565+0000 7f82c5800700 1 --2- 172.21.15.72:0/3162915840 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f82a806c6d0 0x7f82a806eb80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009fd0 tx=0x7f82b4005fd0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:49.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.571+0000 7f82be000700 1 -- 172.21.15.72:0/3162915840 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f82b0051720 con 0x7f82c01014b0 2024-03-19T06:02:49.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.906+0000 7f82c8200700 1 -- 172.21.15.72:0/3162915840 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82c0061190 con 0x7f82a806c6d0 2024-03-19T06:02:49.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.907+0000 7f82be000700 1 -- 172.21.15.72:0/3162915840 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f82c0061190 con 0x7f82a806c6d0 2024-03-19T06:02:49.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.911+0000 7f82c8200700 1 -- 172.21.15.72:0/3162915840 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f82a806c6d0 msgr2=0x7f82a806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:49.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.911+0000 7f82c8200700 1 --2- 172.21.15.72:0/3162915840 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f82a806c6d0 0x7f82a806eb80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009fd0 tx=0x7f82b4005fd0 comp rx=0 tx=0).stop 2024-03-19T06:02:49.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.911+0000 7f82c8200700 1 -- 172.21.15.72:0/3162915840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c01014b0 msgr2=0x7f82c019c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:49.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.911+0000 7f82c8200700 1 --2- 172.21.15.72:0/3162915840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c01014b0 0x7f82c019c5f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82b000e920 tx=0x7f82b000ec30 comp rx=0 tx=0).stop 2024-03-19T06:02:49.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.911+0000 7f82c8200700 1 -- 172.21.15.72:0/3162915840 shutdown_connections 2024-03-19T06:02:49.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.911+0000 7f82c8200700 1 --2- 172.21.15.72:0/3162915840 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f82a806c6d0 0x7f82a806eb80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:49.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.911+0000 7f82c8200700 1 --2- 172.21.15.72:0/3162915840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c00feb50 0x7f82c019c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:49.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.911+0000 7f82c8200700 1 --2- 172.21.15.72:0/3162915840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c01014b0 0x7f82c019c5f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:49.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.911+0000 7f82c8200700 1 -- 172.21.15.72:0/3162915840 >> 172.21.15.72:0/3162915840 conn(0x7f82c00fa780 msgr2=0x7f82c00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:49.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.912+0000 7f82c8200700 1 -- 172.21.15.72:0/3162915840 shutdown_connections 2024-03-19T06:02:49.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:49.912+0000 7f82c8200700 1 -- 172.21.15.72:0/3162915840 wait complete. 2024-03-19T06:02:50.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.123+0000 7f6fb8200700 1 -- 172.21.15.72:0/2976079084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fb00737b0 msgr2=0x7f6fb0073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:50.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.123+0000 7f6fb8200700 1 --2- 172.21.15.72:0/2976079084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fb00737b0 0x7f6fb0073c20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009910 tx=0x7f6f9c009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:50.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.124+0000 7f6fb8200700 1 -- 172.21.15.72:0/2976079084 shutdown_connections 2024-03-19T06:02:50.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.124+0000 7f6fb8200700 1 --2- 172.21.15.72:0/2976079084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fb00737b0 0x7f6fb0073c20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:50.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.124+0000 7f6fb8200700 1 --2- 172.21.15.72:0/2976079084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fb0074d80 0x7f6fb00731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:50.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.124+0000 7f6fb8200700 1 -- 172.21.15.72:0/2976079084 >> 172.21.15.72:0/2976079084 conn(0x7f6fb00fb7f0 msgr2=0x7f6fb00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:50.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.124+0000 7f6fb8200700 1 -- 172.21.15.72:0/2976079084 shutdown_connections 2024-03-19T06:02:50.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.124+0000 7f6fb8200700 1 -- 172.21.15.72:0/2976079084 wait complete. 2024-03-19T06:02:50.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.126+0000 7f6fb8200700 1 Processor -- start 2024-03-19T06:02:50.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.126+0000 7f6fb8200700 1 -- start start 2024-03-19T06:02:50.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.126+0000 7f6fb8200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fb00737b0 0x7f6fb019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:50.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.127+0000 7f6fb8200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fb0074d80 0x7f6fb019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:50.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.127+0000 7f6fb8200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb019cbd0 con 0x7f6fb00737b0 2024-03-19T06:02:50.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.127+0000 7f6fb8200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb019cd10 con 0x7f6fb0074d80 2024-03-19T06:02:50.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.127+0000 7f6fb5800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fb00737b0 0x7f6fb019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:50.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.127+0000 7f6fb5800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fb00737b0 0x7f6fb019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58828/0 (socket says 172.21.15.72:58828) 2024-03-19T06:02:50.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.127+0000 7f6fb5800700 1 -- 172.21.15.72:0/91009282 learned_addr learned my addr 172.21.15.72:0/91009282 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:50.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.127+0000 7f6fb4e00700 1 --2- 172.21.15.72:0/91009282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fb0074d80 0x7f6fb019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:50.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.128+0000 7f6fb5800700 1 -- 172.21.15.72:0/91009282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fb0074d80 msgr2=0x7f6fb019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:50.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.128+0000 7f6fb5800700 1 --2- 172.21.15.72:0/91009282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fb0074d80 0x7f6fb019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:50.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.128+0000 7f6fb5800700 1 -- 172.21.15.72:0/91009282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c0095f0 con 0x7f6fb00737b0 2024-03-19T06:02:50.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.128+0000 7f6fb5800700 1 --2- 172.21.15.72:0/91009282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fb00737b0 0x7f6fb019c070 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400d900 tx=0x7f6fa400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:50.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.129+0000 7f6fae000700 1 -- 172.21.15.72:0/91009282 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fa40041f0 con 0x7f6fb00737b0 2024-03-19T06:02:50.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.129+0000 7f6fae000700 1 -- 172.21.15.72:0/91009282 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6fa4004ce0 con 0x7f6fb00737b0 2024-03-19T06:02:50.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.129+0000 7f6fae000700 1 -- 172.21.15.72:0/91009282 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fa400b750 con 0x7f6fb00737b0 2024-03-19T06:02:50.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.129+0000 7f6fb8200700 1 -- 172.21.15.72:0/91009282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb01a17c0 con 0x7f6fb00737b0 2024-03-19T06:02:50.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.129+0000 7f6fb8200700 1 -- 172.21.15.72:0/91009282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb01a1d10 con 0x7f6fb00737b0 2024-03-19T06:02:50.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.131+0000 7f6fb8200700 1 -- 172.21.15.72:0/91009282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb010f380 con 0x7f6fb00737b0 2024-03-19T06:02:50.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.133+0000 7f6fae000700 1 -- 172.21.15.72:0/91009282 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6fa4004e50 con 0x7f6fb00737b0 2024-03-19T06:02:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.134+0000 7f6fae000700 1 --2- 172.21.15.72:0/91009282 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6f9806c680 0x7f6f9806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.134+0000 7f6fae000700 1 -- 172.21.15.72:0/91009282 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f6fa408b740 con 0x7f6fb00737b0 2024-03-19T06:02:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.137+0000 7f6fb4e00700 1 --2- 172.21.15.72:0/91009282 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6f9806c680 0x7f6f9806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.137+0000 7f6fb4e00700 1 --2- 172.21.15.72:0/91009282 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6f9806c680 0x7f6f9806eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c006010 tx=0x7f6f9c00b560 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:50.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.143+0000 7f6fae000700 1 -- 172.21.15.72:0/91009282 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6fa4059890 con 0x7f6fb00737b0 2024-03-19T06:02:50.485 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:50 smithi072 ceph-mon[28706]: pgmap v282: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:50.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.489+0000 7f6fb8200700 1 -- 172.21.15.72:0/91009282 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fb01a2410 con 0x7f6f9806c680 2024-03-19T06:02:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.506+0000 7f6fae000700 1 -- 172.21.15.72:0/91009282 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7f6fb01a2410 con 0x7f6f9806c680 2024-03-19T06:02:50.499 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:02:50.499 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (7m) 78s ago 9m 13.7M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:02:50.499 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (9m) 78s ago 9m 7545k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:02:50.499 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (8m) 84s ago 8m 7402k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:02:50.499 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (9m) 78s ago 9m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:02:50.499 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (8m) 84s ago 7m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:02:50.499 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (7m) 78s ago 8m 72.8M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:02:50.499 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (104s) 78s ago 103s 11.7M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (113s) 78s ago 112s 14.9M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (100s) 84s ago 99s 11.5M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (108s) 84s ago 108s 14.2M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:9283,8765,8443 running (11m) 78s ago 11m 488M - 18.2.0 dc2bc1663786 af0e8bfc899d 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (7m) 84s ago 7m 437M - 18.2.0 dc2bc1663786 16f76f54583f 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (11m) 78s ago 11m 44.9M 2048M 18.2.0 dc2bc1663786 77289e9e2b33 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (7m) 84s ago 7m 33.7M 2048M 18.2.0 dc2bc1663786 31fba31e7d8a 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (9m) 78s ago 9m 7810k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (7m) 84s ago 7m 8006k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (6m) 78s ago 6m 47.1M 3947M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (6m) 78s ago 6m 47.5M 3947M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (5m) 78s ago 5m 46.5M 3947M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (4m) 84s ago 4m 45.1M 4971M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (4m) 84s ago 4m 42.8M 4971M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (3m) 84s ago 3m 42.5M 4971M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:02:50.500 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (6m) 78s ago 8m 53.1M - 2.43.0 a07b618ecd1d ea7a91af5b4a 2024-03-19T06:02:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.509+0000 7f6fb8200700 1 -- 172.21.15.72:0/91009282 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6f9806c680 msgr2=0x7f6f9806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.509+0000 7f6fb8200700 1 --2- 172.21.15.72:0/91009282 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6f9806c680 0x7f6f9806eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c006010 tx=0x7f6f9c00b560 comp rx=0 tx=0).stop 2024-03-19T06:02:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.509+0000 7f6fb8200700 1 -- 172.21.15.72:0/91009282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fb00737b0 msgr2=0x7f6fb019c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.509+0000 7f6fb8200700 1 --2- 172.21.15.72:0/91009282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fb00737b0 0x7f6fb019c070 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400d900 tx=0x7f6fa400dc10 comp rx=0 tx=0).stop 2024-03-19T06:02:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.510+0000 7f6fb8200700 1 -- 172.21.15.72:0/91009282 shutdown_connections 2024-03-19T06:02:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.510+0000 7f6fb8200700 1 --2- 172.21.15.72:0/91009282 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f6f9806c680 0x7f6f9806eb30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.510+0000 7f6fb8200700 1 --2- 172.21.15.72:0/91009282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fb00737b0 0x7f6fb019c070 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.510+0000 7f6fb8200700 1 --2- 172.21.15.72:0/91009282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fb0074d80 0x7f6fb019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.510+0000 7f6fb8200700 1 -- 172.21.15.72:0/91009282 >> 172.21.15.72:0/91009282 conn(0x7f6fb00fb7f0 msgr2=0x7f6fb0101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.510+0000 7f6fb8200700 1 -- 172.21.15.72:0/91009282 shutdown_connections 2024-03-19T06:02:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.510+0000 7f6fb8200700 1 -- 172.21.15.72:0/91009282 wait complete. 2024-03-19T06:02:50.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:50 smithi172 ceph-mon[35716]: pgmap v282: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:50.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.708+0000 7f84b3200700 1 -- 172.21.15.72:0/2431807728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ac0fef20 msgr2=0x7f84ac0ff330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:50.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.708+0000 7f84b3200700 1 --2- 172.21.15.72:0/2431807728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ac0fef20 0x7f84ac0ff330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009910 tx=0x7f84a0009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.709+0000 7f84b3200700 1 -- 172.21.15.72:0/2431807728 shutdown_connections 2024-03-19T06:02:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.709+0000 7f84b3200700 1 --2- 172.21.15.72:0/2431807728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac100080 0x7f84ac1004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.709+0000 7f84b3200700 1 --2- 172.21.15.72:0/2431807728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ac0fef20 0x7f84ac0ff330 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.709+0000 7f84b3200700 1 -- 172.21.15.72:0/2431807728 >> 172.21.15.72:0/2431807728 conn(0x7f84ac0fa4d0 msgr2=0x7f84ac0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.709+0000 7f84b3200700 1 -- 172.21.15.72:0/2431807728 shutdown_connections 2024-03-19T06:02:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.709+0000 7f84b3200700 1 -- 172.21.15.72:0/2431807728 wait complete. 2024-03-19T06:02:50.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.710+0000 7f84b3200700 1 Processor -- start 2024-03-19T06:02:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.711+0000 7f84b3200700 1 -- start start 2024-03-19T06:02:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.711+0000 7f84b3200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ac0fef20 0x7f84ac102ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.711+0000 7f84b3200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac100080 0x7f84ac1014f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.711+0000 7f84b3200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac101a30 con 0x7f84ac0fef20 2024-03-19T06:02:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.711+0000 7f84b3200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac101b70 con 0x7f84ac100080 2024-03-19T06:02:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.712+0000 7f84b1400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac100080 0x7f84ac1014f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.712+0000 7f84b1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ac0fef20 0x7f84ac102ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.712+0000 7f84b1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ac0fef20 0x7f84ac102ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58834/0 (socket says 172.21.15.72:58834) 2024-03-19T06:02:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.712+0000 7f84b1e00700 1 -- 172.21.15.72:0/3837487029 learned_addr learned my addr 172.21.15.72:0/3837487029 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.712+0000 7f84b1e00700 1 -- 172.21.15.72:0/3837487029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac100080 msgr2=0x7f84ac1014f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.713+0000 7f84b1e00700 1 --2- 172.21.15.72:0/3837487029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac100080 0x7f84ac1014f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.713+0000 7f84b1e00700 1 -- 172.21.15.72:0/3837487029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a00095f0 con 0x7f84ac0fef20 2024-03-19T06:02:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.713+0000 7f84b1400700 1 --2- 172.21.15.72:0/3837487029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac100080 0x7f84ac1014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:02:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.713+0000 7f84b1e00700 1 --2- 172.21.15.72:0/3837487029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ac0fef20 0x7f84ac102ea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f84a00092e0 tx=0x7f84a000fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.713+0000 7f84a6a00700 1 -- 172.21.15.72:0/3837487029 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84a001d070 con 0x7f84ac0fef20 2024-03-19T06:02:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.713+0000 7f84b3200700 1 -- 172.21.15.72:0/3837487029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac101df0 con 0x7f84ac0fef20 2024-03-19T06:02:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.714+0000 7f84a6a00700 1 -- 172.21.15.72:0/3837487029 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f84a000fe70 con 0x7f84ac0fef20 2024-03-19T06:02:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.714+0000 7f84a6a00700 1 -- 172.21.15.72:0/3837487029 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84a0017630 con 0x7f84ac0fef20 2024-03-19T06:02:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.714+0000 7f84b3200700 1 -- 172.21.15.72:0/3837487029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ac1022e0 con 0x7f84ac0fef20 2024-03-19T06:02:50.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.715+0000 7f84b3200700 1 -- 172.21.15.72:0/3837487029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ac1079f0 con 0x7f84ac0fef20 2024-03-19T06:02:50.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.717+0000 7f84a6a00700 1 -- 172.21.15.72:0/3837487029 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f84a0003680 con 0x7f84ac0fef20 2024-03-19T06:02:50.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.719+0000 7f84a6a00700 1 --2- 172.21.15.72:0/3837487029 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f849406c680 0x7f849406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:50.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.719+0000 7f84a6a00700 1 -- 172.21.15.72:0/3837487029 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f84a008ccf0 con 0x7f84ac0fef20 2024-03-19T06:02:50.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.720+0000 7f84b1400700 1 --2- 172.21.15.72:0/3837487029 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f849406c680 0x7f849406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:50.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.721+0000 7f84b1400700 1 --2- 172.21.15.72:0/3837487029 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f849406c680 0x7f849406eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f849c011490 tx=0x7f849c009260 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:50.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:50.726+0000 7f84a6a00700 1 -- 172.21.15.72:0/3837487029 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f84a005ae60 con 0x7f84ac0fef20 2024-03-19T06:02:51.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.208+0000 7f84b3200700 1 -- 172.21.15.72:0/3837487029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f84ac107be0 con 0x7f84ac0fef20 2024-03-19T06:02:51.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.210+0000 7f84a6a00700 1 -- 172.21.15.72:0/3837487029 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f84a0003e60 con 0x7f84ac0fef20 2024-03-19T06:02:51.203 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:02:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:02:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:02:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:02:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:02:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:02:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:02:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:02:51.203 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:02:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:02:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:02:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:02:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:02:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:02:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-03-19T06:02:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:02:51.204 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:02:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.213+0000 7f84b3200700 1 -- 172.21.15.72:0/3837487029 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f849406c680 msgr2=0x7f849406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.213+0000 7f84b3200700 1 --2- 172.21.15.72:0/3837487029 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f849406c680 0x7f849406eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f849c011490 tx=0x7f849c009260 comp rx=0 tx=0).stop 2024-03-19T06:02:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.213+0000 7f84b3200700 1 -- 172.21.15.72:0/3837487029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ac0fef20 msgr2=0x7f84ac102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:51.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.213+0000 7f84b3200700 1 --2- 172.21.15.72:0/3837487029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ac0fef20 0x7f84ac102ea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f84a00092e0 tx=0x7f84a000fa50 comp rx=0 tx=0).stop 2024-03-19T06:02:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.214+0000 7f84b3200700 1 -- 172.21.15.72:0/3837487029 shutdown_connections 2024-03-19T06:02:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.214+0000 7f84b3200700 1 --2- 172.21.15.72:0/3837487029 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f849406c680 0x7f849406eb30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.214+0000 7f84b3200700 1 --2- 172.21.15.72:0/3837487029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84ac0fef20 0x7f84ac102ea0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.214+0000 7f84b3200700 1 --2- 172.21.15.72:0/3837487029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac100080 0x7f84ac1014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.214+0000 7f84b3200700 1 -- 172.21.15.72:0/3837487029 >> 172.21.15.72:0/3837487029 conn(0x7f84ac0fa4d0 msgr2=0x7f84ac068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.214+0000 7f84b3200700 1 -- 172.21.15.72:0/3837487029 shutdown_connections 2024-03-19T06:02:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.214+0000 7f84b3200700 1 -- 172.21.15.72:0/3837487029 wait complete. 2024-03-19T06:02:51.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.432+0000 7fc58c200700 1 -- 172.21.15.72:0/809501364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5840737b0 msgr2=0x7fc584073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:51.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.432+0000 7fc58c200700 1 --2- 172.21.15.72:0/809501364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5840737b0 0x7fc584073c20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc570009940 tx=0x7fc570009c50 comp rx=0 tx=0).stop 2024-03-19T06:02:51.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.433+0000 7fc58c200700 1 -- 172.21.15.72:0/809501364 shutdown_connections 2024-03-19T06:02:51.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.433+0000 7fc58c200700 1 --2- 172.21.15.72:0/809501364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5840737b0 0x7fc584073c20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:51.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.433+0000 7fc58c200700 1 --2- 172.21.15.72:0/809501364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc584074d80 0x7fc5840731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:51.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.433+0000 7fc58c200700 1 -- 172.21.15.72:0/809501364 >> 172.21.15.72:0/809501364 conn(0x7fc5840fb7f0 msgr2=0x7fc5840fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:51.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.433+0000 7fc58c200700 1 -- 172.21.15.72:0/809501364 shutdown_connections 2024-03-19T06:02:51.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.433+0000 7fc58c200700 1 -- 172.21.15.72:0/809501364 wait complete. 2024-03-19T06:02:51.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.435+0000 7fc58c200700 1 Processor -- start 2024-03-19T06:02:51.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.435+0000 7fc58c200700 1 -- start start 2024-03-19T06:02:51.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.435+0000 7fc58c200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5840737b0 0x7fc584197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:51.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.435+0000 7fc58c200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc584074d80 0x7fc5841981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:51.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.435+0000 7fc58c200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5841987b0 con 0x7fc5840737b0 2024-03-19T06:02:51.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.435+0000 7fc58c200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc584198920 con 0x7fc584074d80 2024-03-19T06:02:51.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.436+0000 7fc589800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5840737b0 0x7fc584197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:51.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.436+0000 7fc588e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc584074d80 0x7fc5841981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:51.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.436+0000 7fc588e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc584074d80 0x7fc5841981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:40666/0 (socket says 172.21.15.72:40666) 2024-03-19T06:02:51.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.436+0000 7fc588e00700 1 -- 172.21.15.72:0/2972255591 learned_addr learned my addr 172.21.15.72:0/2972255591 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:51.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.436+0000 7fc589800700 1 -- 172.21.15.72:0/2972255591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc584074d80 msgr2=0x7fc5841981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:51.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.436+0000 7fc589800700 1 --2- 172.21.15.72:0/2972255591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc584074d80 0x7fc5841981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:51.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.436+0000 7fc589800700 1 -- 172.21.15.72:0/2972255591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700095f0 con 0x7fc5840737b0 2024-03-19T06:02:51.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.437+0000 7fc589800700 1 --2- 172.21.15.72:0/2972255591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5840737b0 0x7fc584197c70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc57800e970 tx=0x7fc57800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:51.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.437+0000 7fc582000700 1 -- 172.21.15.72:0/2972255591 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc57800c950 con 0x7fc5840737b0 2024-03-19T06:02:51.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.437+0000 7fc58c200700 1 -- 172.21.15.72:0/2972255591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58419d3b0 con 0x7fc5840737b0 2024-03-19T06:02:51.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.437+0000 7fc582000700 1 -- 172.21.15.72:0/2972255591 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc578010430 con 0x7fc5840737b0 2024-03-19T06:02:51.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.437+0000 7fc582000700 1 -- 172.21.15.72:0/2972255591 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc578018630 con 0x7fc5840737b0 2024-03-19T06:02:51.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.437+0000 7fc58c200700 1 -- 172.21.15.72:0/2972255591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58419d900 con 0x7fc5840737b0 2024-03-19T06:02:51.432 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:51 smithi072 ceph-mon[28706]: from='client.24285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:51.432 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:51 smithi072 ceph-mon[28706]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:51.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.439+0000 7fc58c200700 1 -- 172.21.15.72:0/2972255591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc564005320 con 0x7fc5840737b0 2024-03-19T06:02:51.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.441+0000 7fc582000700 1 -- 172.21.15.72:0/2972255591 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc5780105a0 con 0x7fc5840737b0 2024-03-19T06:02:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.442+0000 7fc582000700 1 --2- 172.21.15.72:0/2972255591 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc56c06c6d0 0x7fc56c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.442+0000 7fc582000700 1 -- 172.21.15.72:0/2972255591 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc578014070 con 0x7fc5840737b0 2024-03-19T06:02:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.442+0000 7fc588e00700 1 --2- 172.21.15.72:0/2972255591 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc56c06c6d0 0x7fc56c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:51.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.444+0000 7fc588e00700 1 --2- 172.21.15.72:0/2972255591 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc56c06c6d0 0x7fc56c06eb80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc570005cd0 tx=0x7fc570005c40 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:51.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.448+0000 7fc582000700 1 -- 172.21.15.72:0/2972255591 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc578051720 con 0x7fc5840737b0 2024-03-19T06:02:51.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:51 smithi172 ceph-mon[35716]: from='client.24285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:51.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:51 smithi172 ceph-mon[35716]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.874+0000 7fc58c200700 1 -- 172.21.15.72:0/2972255591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc564006200 con 0x7fc5840737b0 2024-03-19T06:02:51.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.875+0000 7fc582000700 1 -- 172.21.15.72:0/2972255591 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1831 (secure 0 0 0) 0x7fc5780561c0 con 0x7fc5840737b0 2024-03-19T06:02:51.871 INFO:teuthology.orchestra.run.smithi072.stdout:e13 2024-03-19T06:02:51.871 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:02:51.871 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:02:51.871 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:02:51.871 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:02:51.871 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:02:51.871 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:02:51.871 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 13 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:01:14.992147+0000 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:02:51.872 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:02:51.873 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:02:51.874 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:02:51.874 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:02:51.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.878+0000 7fc58c200700 1 -- 172.21.15.72:0/2972255591 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc56c06c6d0 msgr2=0x7fc56c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.878+0000 7fc58c200700 1 --2- 172.21.15.72:0/2972255591 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc56c06c6d0 0x7fc56c06eb80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc570005cd0 tx=0x7fc570005c40 comp rx=0 tx=0).stop 2024-03-19T06:02:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.878+0000 7fc58c200700 1 -- 172.21.15.72:0/2972255591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5840737b0 msgr2=0x7fc584197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.878+0000 7fc58c200700 1 --2- 172.21.15.72:0/2972255591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5840737b0 0x7fc584197c70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc57800e970 tx=0x7fc57800ec80 comp rx=0 tx=0).stop 2024-03-19T06:02:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.879+0000 7fc58c200700 1 -- 172.21.15.72:0/2972255591 shutdown_connections 2024-03-19T06:02:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.879+0000 7fc58c200700 1 --2- 172.21.15.72:0/2972255591 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc56c06c6d0 0x7fc56c06eb80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.879+0000 7fc58c200700 1 --2- 172.21.15.72:0/2972255591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5840737b0 0x7fc584197c70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.879+0000 7fc58c200700 1 --2- 172.21.15.72:0/2972255591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc584074d80 0x7fc5841981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.879+0000 7fc58c200700 1 -- 172.21.15.72:0/2972255591 >> 172.21.15.72:0/2972255591 conn(0x7fc5840fb7f0 msgr2=0x7fc584106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.879+0000 7fc58c200700 1 -- 172.21.15.72:0/2972255591 shutdown_connections 2024-03-19T06:02:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:51.880+0000 7fc58c200700 1 -- 172.21.15.72:0/2972255591 wait complete. 2024-03-19T06:02:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 13 2024-03-19T06:02:52.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.031+0000 7fb630000700 1 -- 172.21.15.72:0/4218144334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb628100240 msgr2=0x7fb628100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:52.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.031+0000 7fb630000700 1 --2- 172.21.15.72:0/4218144334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb628100240 0x7fb628100650 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009910 tx=0x7fb61c009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:52.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.031+0000 7fb630000700 1 -- 172.21.15.72:0/4218144334 shutdown_connections 2024-03-19T06:02:52.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.031+0000 7fb630000700 1 --2- 172.21.15.72:0/4218144334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb628101440 0x7fb628101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.031+0000 7fb630000700 1 --2- 172.21.15.72:0/4218144334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb628100240 0x7fb628100650 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.031+0000 7fb630000700 1 -- 172.21.15.72:0/4218144334 >> 172.21.15.72:0/4218144334 conn(0x7fb6280fb7f0 msgr2=0x7fb6280fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:52.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.031+0000 7fb630000700 1 -- 172.21.15.72:0/4218144334 shutdown_connections 2024-03-19T06:02:52.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.031+0000 7fb630000700 1 -- 172.21.15.72:0/4218144334 wait complete. 2024-03-19T06:02:52.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.032+0000 7fb630000700 1 Processor -- start 2024-03-19T06:02:52.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.033+0000 7fb630000700 1 -- start start 2024-03-19T06:02:52.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.033+0000 7fb630000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb628100240 0x7fb628197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:52.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.033+0000 7fb630000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb628101440 0x7fb6281981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:52.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.033+0000 7fb630000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6281987f0 con 0x7fb628101440 2024-03-19T06:02:52.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.033+0000 7fb630000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb628198960 con 0x7fb628100240 2024-03-19T06:02:52.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.033+0000 7fb62d600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb628100240 0x7fb628197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:52.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.033+0000 7fb62d600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb628100240 0x7fb628197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:40690/0 (socket says 172.21.15.72:40690) 2024-03-19T06:02:52.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.033+0000 7fb62d600700 1 -- 172.21.15.72:0/2771129839 learned_addr learned my addr 172.21.15.72:0/2771129839 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:52.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.034+0000 7fb62cc00700 1 --2- 172.21.15.72:0/2771129839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb628101440 0x7fb6281981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:52.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.034+0000 7fb62cc00700 1 -- 172.21.15.72:0/2771129839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb628100240 msgr2=0x7fb628197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:52.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.034+0000 7fb62cc00700 1 --2- 172.21.15.72:0/2771129839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb628100240 0x7fb628197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.034+0000 7fb62cc00700 1 -- 172.21.15.72:0/2771129839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c0095f0 con 0x7fb628101440 2024-03-19T06:02:52.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.035+0000 7fb62cc00700 1 --2- 172.21.15.72:0/2771129839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb628101440 0x7fb6281981f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e970 tx=0x7fb61400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:52.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.035+0000 7fb626000700 1 -- 172.21.15.72:0/2771129839 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb61400c9d0 con 0x7fb628101440 2024-03-19T06:02:52.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.035+0000 7fb626000700 1 -- 172.21.15.72:0/2771129839 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb614010430 con 0x7fb628101440 2024-03-19T06:02:52.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.035+0000 7fb626000700 1 -- 172.21.15.72:0/2771129839 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb614018650 con 0x7fb628101440 2024-03-19T06:02:52.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.035+0000 7fb630000700 1 -- 172.21.15.72:0/2771129839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62819d3f0 con 0x7fb628101440 2024-03-19T06:02:52.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.035+0000 7fb630000700 1 -- 172.21.15.72:0/2771129839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62819d940 con 0x7fb628101440 2024-03-19T06:02:52.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.037+0000 7fb630000700 1 -- 172.21.15.72:0/2771129839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb628105520 con 0x7fb628101440 2024-03-19T06:02:52.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.039+0000 7fb626000700 1 -- 172.21.15.72:0/2771129839 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb6140105a0 con 0x7fb628101440 2024-03-19T06:02:52.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.041+0000 7fb626000700 1 --2- 172.21.15.72:0/2771129839 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb61006c680 0x7fb61006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:52.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.041+0000 7fb626000700 1 -- 172.21.15.72:0/2771129839 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fb614014070 con 0x7fb628101440 2024-03-19T06:02:52.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.041+0000 7fb62d600700 1 --2- 172.21.15.72:0/2771129839 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb61006c680 0x7fb61006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:52.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.042+0000 7fb62d600700 1 --2- 172.21.15.72:0/2771129839 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb61006c680 0x7fb61006eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00b6f0 tx=0x7fb61c005a90 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:52.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.046+0000 7fb626000700 1 -- 172.21.15.72:0/2771129839 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb614056620 con 0x7fb628101440 2024-03-19T06:02:52.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.298+0000 7fb630000700 1 -- 172.21.15.72:0/2771129839 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb628061190 con 0x7fb61006c680 2024-03-19T06:02:52.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.300+0000 7fb626000700 1 -- 172.21.15.72:0/2771129839 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb628061190 con 0x7fb61006c680 2024-03-19T06:02:52.293 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:02:52.293 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:02:52.293 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:02:52.293 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:02:52.293 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-03-19T06:02:52.294 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "", 2024-03-19T06:02:52.294 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f image", 2024-03-19T06:02:52.294 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:02:52.294 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:02:52.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.303+0000 7fb630000700 1 -- 172.21.15.72:0/2771129839 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb61006c680 msgr2=0x7fb61006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:52.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.303+0000 7fb630000700 1 --2- 172.21.15.72:0/2771129839 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb61006c680 0x7fb61006eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00b6f0 tx=0x7fb61c005a90 comp rx=0 tx=0).stop 2024-03-19T06:02:52.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.303+0000 7fb630000700 1 -- 172.21.15.72:0/2771129839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb628101440 msgr2=0x7fb6281981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.303+0000 7fb630000700 1 --2- 172.21.15.72:0/2771129839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb628101440 0x7fb6281981f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e970 tx=0x7fb61400ec80 comp rx=0 tx=0).stop 2024-03-19T06:02:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.303+0000 7fb630000700 1 -- 172.21.15.72:0/2771129839 shutdown_connections 2024-03-19T06:02:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.303+0000 7fb630000700 1 --2- 172.21.15.72:0/2771129839 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb61006c680 0x7fb61006eb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.303+0000 7fb630000700 1 --2- 172.21.15.72:0/2771129839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb628100240 0x7fb628197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.303+0000 7fb630000700 1 --2- 172.21.15.72:0/2771129839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb628101440 0x7fb6281981f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.303+0000 7fb630000700 1 -- 172.21.15.72:0/2771129839 >> 172.21.15.72:0/2771129839 conn(0x7fb6280fb7f0 msgr2=0x7fb628102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.304+0000 7fb630000700 1 -- 172.21.15.72:0/2771129839 shutdown_connections 2024-03-19T06:02:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.304+0000 7fb630000700 1 -- 172.21.15.72:0/2771129839 wait complete. 2024-03-19T06:02:52.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:52 smithi072 ceph-mon[28706]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:52.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:52 smithi072 ceph-mon[28706]: pgmap v283: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:52.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:52 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3837487029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:02:52.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:52 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2972255591' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:02:52.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.507+0000 7fe366400700 1 -- 172.21.15.72:0/3851371226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3600737b0 msgr2=0x7fe360073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:52.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.507+0000 7fe366400700 1 --2- 172.21.15.72:0/3851371226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3600737b0 0x7fe360073c20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009910 tx=0x7fe34c009c20 comp rx=0 tx=0).stop 2024-03-19T06:02:52.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.508+0000 7fe366400700 1 -- 172.21.15.72:0/3851371226 shutdown_connections 2024-03-19T06:02:52.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.508+0000 7fe366400700 1 --2- 172.21.15.72:0/3851371226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3600737b0 0x7fe360073c20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.508+0000 7fe366400700 1 --2- 172.21.15.72:0/3851371226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe360074d80 0x7fe3600731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.508+0000 7fe366400700 1 -- 172.21.15.72:0/3851371226 >> 172.21.15.72:0/3851371226 conn(0x7fe3600fb7f0 msgr2=0x7fe3600fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:52.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.508+0000 7fe366400700 1 -- 172.21.15.72:0/3851371226 shutdown_connections 2024-03-19T06:02:52.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.508+0000 7fe366400700 1 -- 172.21.15.72:0/3851371226 wait complete. 2024-03-19T06:02:52.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.510+0000 7fe366400700 1 Processor -- start 2024-03-19T06:02:52.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.510+0000 7fe366400700 1 -- start start 2024-03-19T06:02:52.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.510+0000 7fe366400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3600737b0 0x7fe36019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:52.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.510+0000 7fe366400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360074d80 0x7fe36019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:52.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.510+0000 7fe366400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36019cbd0 con 0x7fe3600737b0 2024-03-19T06:02:52.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.510+0000 7fe366400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36019cd10 con 0x7fe360074d80 2024-03-19T06:02:52.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.511+0000 7fe35ea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360074d80 0x7fe36019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:52.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.511+0000 7fe35ea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360074d80 0x7fe36019c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:40708/0 (socket says 172.21.15.72:40708) 2024-03-19T06:02:52.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.511+0000 7fe35ea00700 1 -- 172.21.15.72:0/1675746565 learned_addr learned my addr 172.21.15.72:0/1675746565 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:02:52.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.511+0000 7fe35ea00700 1 -- 172.21.15.72:0/1675746565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3600737b0 msgr2=0x7fe36019c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:52.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.511+0000 7fe35ea00700 1 --2- 172.21.15.72:0/1675746565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3600737b0 0x7fe36019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.511+0000 7fe35ea00700 1 -- 172.21.15.72:0/1675746565 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c0095f0 con 0x7fe360074d80 2024-03-19T06:02:52.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.512+0000 7fe35ea00700 1 --2- 172.21.15.72:0/1675746565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360074d80 0x7fe36019c5b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0092e0 tx=0x7fe34c00f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:52.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.512+0000 7fe357e00700 1 -- 172.21.15.72:0/1675746565 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe34c01d070 con 0x7fe360074d80 2024-03-19T06:02:52.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.512+0000 7fe357e00700 1 -- 172.21.15.72:0/1675746565 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe34c0052a0 con 0x7fe360074d80 2024-03-19T06:02:52.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.512+0000 7fe357e00700 1 -- 172.21.15.72:0/1675746565 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe34c017630 con 0x7fe360074d80 2024-03-19T06:02:52.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.512+0000 7fe366400700 1 -- 172.21.15.72:0/1675746565 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3601a1760 con 0x7fe360074d80 2024-03-19T06:02:52.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.512+0000 7fe366400700 1 -- 172.21.15.72:0/1675746565 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3601a1c50 con 0x7fe360074d80 2024-03-19T06:02:52.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.515+0000 7fe366400700 1 -- 172.21.15.72:0/1675746565 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe340005320 con 0x7fe360074d80 2024-03-19T06:02:52.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.516+0000 7fe357e00700 1 -- 172.21.15.72:0/1675746565 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe34c003680 con 0x7fe360074d80 2024-03-19T06:02:52.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.518+0000 7fe357e00700 1 --2- 172.21.15.72:0/1675746565 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe34406c680 0x7fe34406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:02:52.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.518+0000 7fe357e00700 1 -- 172.21.15.72:0/1675746565 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fe34c08cd00 con 0x7fe360074d80 2024-03-19T06:02:52.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.519+0000 7fe35f400700 1 --2- 172.21.15.72:0/1675746565 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe34406c680 0x7fe34406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:02:52.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.520+0000 7fe35f400700 1 --2- 172.21.15.72:0/1675746565 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe34406c680 0x7fe34406eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe350005950 tx=0x7fe3500058e0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:02:52.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.525+0000 7fe357e00700 1 -- 172.21.15.72:0/1675746565 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe34c05ae50 con 0x7fe360074d80 2024-03-19T06:02:52.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:52 smithi172 ceph-mon[35716]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:52.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:52 smithi172 ceph-mon[35716]: pgmap v283: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:52.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:52 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3837487029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:02:52.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:52 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2972255591' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:02:52.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.991+0000 7fe366400700 1 -- 172.21.15.72:0/1675746565 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe340005190 con 0x7fe360074d80 2024-03-19T06:02:52.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.993+0000 7fe357e00700 1 -- 172.21.15.72:0/1675746565 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe34c05a9e0 con 0x7fe360074d80 2024-03-19T06:02:52.986 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:02:52.986 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:02:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:02:52.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.996+0000 7fe366400700 1 -- 172.21.15.72:0/1675746565 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe34406c680 msgr2=0x7fe34406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:52.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.996+0000 7fe366400700 1 --2- 172.21.15.72:0/1675746565 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe34406c680 0x7fe34406eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe350005950 tx=0x7fe3500058e0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.996+0000 7fe366400700 1 -- 172.21.15.72:0/1675746565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360074d80 msgr2=0x7fe36019c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:02:52.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.996+0000 7fe366400700 1 --2- 172.21.15.72:0/1675746565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360074d80 0x7fe36019c5b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0092e0 tx=0x7fe34c00f740 comp rx=0 tx=0).stop 2024-03-19T06:02:52.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.996+0000 7fe366400700 1 -- 172.21.15.72:0/1675746565 shutdown_connections 2024-03-19T06:02:52.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.996+0000 7fe366400700 1 --2- 172.21.15.72:0/1675746565 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fe34406c680 0x7fe34406eb30 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe350005950 tx=0x7fe3500058e0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.996+0000 7fe366400700 1 --2- 172.21.15.72:0/1675746565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3600737b0 0x7fe36019c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.996+0000 7fe366400700 1 --2- 172.21.15.72:0/1675746565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360074d80 0x7fe36019c5b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:02:52.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.996+0000 7fe366400700 1 -- 172.21.15.72:0/1675746565 >> 172.21.15.72:0/1675746565 conn(0x7fe3600fb7f0 msgr2=0x7fe360101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:02:52.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.998+0000 7fe366400700 1 -- 172.21.15.72:0/1675746565 shutdown_connections 2024-03-19T06:02:52.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:02:52.998+0000 7fe366400700 1 -- 172.21.15.72:0/1675746565 wait complete. 2024-03-19T06:02:53.330 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:53 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1675746565' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:02:53.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:53 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1675746565' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:02:54.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:54 smithi072 ceph-mon[28706]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:54.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:54 smithi072 ceph-mon[28706]: pgmap v284: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:54.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:54 smithi172 ceph-mon[35716]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:02:54.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:54 smithi172 ceph-mon[35716]: pgmap v284: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:56.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:56 smithi072 ceph-mon[28706]: pgmap v285: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:56.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:56 smithi172 ceph-mon[35716]: pgmap v285: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:58.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:02:58 smithi072 ceph-mon[28706]: pgmap v286: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:02:58.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:02:58 smithi172 ceph-mon[35716]: pgmap v286: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:00.251 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:00 smithi072 ceph-mon[28706]: pgmap v287: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:00.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:00 smithi172 ceph-mon[35716]: pgmap v287: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:01.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:03:01.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:03:02.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:02 smithi072 ceph-mon[28706]: pgmap v288: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:02.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:02.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:03:02.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:02 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:02.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:02 smithi172 ceph-mon[35716]: pgmap v288: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:02.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:02.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:03:02.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:02 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:03.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:03 smithi072 ceph-mon[28706]: Upgrade: Target is version 19.0.0-1934-gb0ea271b (unknown) 2024-03-19T06:03:03.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:03 smithi072 ceph-mon[28706]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, digests ['quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399'] 2024-03-19T06:03:03.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:03 smithi072 ceph-mon[28706]: Upgrade: Need to upgrade myself (mgr.smithi072.jydpjk) 2024-03-19T06:03:03.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:03 smithi172 ceph-mon[35716]: Upgrade: Target is version 19.0.0-1934-gb0ea271b (unknown) 2024-03-19T06:03:03.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:03 smithi172 ceph-mon[35716]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, digests ['quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399'] 2024-03-19T06:03:03.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:03 smithi172 ceph-mon[35716]: Upgrade: Need to upgrade myself (mgr.smithi072.jydpjk) 2024-03-19T06:03:04.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:04 smithi072 ceph-mon[28706]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 on smithi172 2024-03-19T06:03:04.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:04 smithi072 ceph-mon[28706]: pgmap v289: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:04.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:04 smithi172 ceph-mon[35716]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 on smithi172 2024-03-19T06:03:04.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:04 smithi172 ceph-mon[35716]: pgmap v289: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:06.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:06 smithi072 ceph-mon[28706]: pgmap v290: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:06.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:06 smithi172 ceph-mon[35716]: pgmap v290: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:08.245 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:08 smithi172 ceph-mon[35716]: pgmap v291: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:08.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:08 smithi072 ceph-mon[28706]: pgmap v291: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:10.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:10 smithi072 ceph-mon[28706]: pgmap v292: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:10.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:10 smithi172 ceph-mon[35716]: pgmap v292: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:12.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:12 smithi172 ceph-mon[35716]: pgmap v293: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:12.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:12 smithi072 ceph-mon[28706]: pgmap v293: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:14.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:14 smithi172 ceph-mon[35716]: pgmap v294: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:14.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:14 smithi072 ceph-mon[28706]: pgmap v294: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:16.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:16 smithi072 ceph-mon[28706]: pgmap v295: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:16.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:16 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:03:16.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:16 smithi172 ceph-mon[35716]: pgmap v295: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:16.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:16 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:03:17.917 INFO:tasks.workunit.client.1.smithi172.stderr:Updating files: 58% (7233/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 94% (11613/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-19T06:03:18.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:18 smithi172 ceph-mon[35716]: pgmap v296: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:18.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:18 smithi072 ceph-mon[28706]: pgmap v296: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:18.692 INFO:tasks.workunit.client.1.smithi172.stderr:Note: switching to 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'. 2024-03-19T06:03:18.693 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-03-19T06:03:18.693 INFO:tasks.workunit.client.1.smithi172.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-19T06:03:18.693 INFO:tasks.workunit.client.1.smithi172.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-19T06:03:18.693 INFO:tasks.workunit.client.1.smithi172.stderr:state without impacting any branches by switching back to a branch. 2024-03-19T06:03:18.693 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-03-19T06:03:18.693 INFO:tasks.workunit.client.1.smithi172.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-19T06:03:18.693 INFO:tasks.workunit.client.1.smithi172.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-19T06:03:18.693 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-03-19T06:03:18.693 INFO:tasks.workunit.client.1.smithi172.stderr: git switch -c 2024-03-19T06:03:18.693 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-03-19T06:03:18.693 INFO:tasks.workunit.client.1.smithi172.stderr:Or undo this operation with: 2024-03-19T06:03:18.693 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-03-19T06:03:18.694 INFO:tasks.workunit.client.1.smithi172.stderr: git switch - 2024-03-19T06:03:18.694 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-03-19T06:03:18.694 INFO:tasks.workunit.client.1.smithi172.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-19T06:03:18.694 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-03-19T06:03:18.694 INFO:tasks.workunit.client.1.smithi172.stderr:HEAD is now at b0ea271bb96 Merge PR #52373 into wip-vshankar-testing-20240307.022905 2024-03-19T06:03:18.702 DEBUG:teuthology.orchestra.run.smithi172:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-03-19T06:03:18.773 INFO:tasks.workunit.client.1.smithi172.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-19T06:03:18.780 INFO:tasks.workunit.client.1.smithi172.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-19T06:03:18.780 INFO:tasks.workunit.client.1.smithi172.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-19T06:03:19.718 INFO:tasks.workunit.client.1.smithi172.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-19T06:03:19.838 INFO:tasks.workunit.client.1.smithi172.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-19T06:03:19.926 INFO:tasks.workunit.client.1.smithi172.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-19T06:03:19.932 INFO:tasks.workunit.client.1.smithi172.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-19T06:03:19.932 INFO:tasks.workunit.client.1.smithi172.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-19T06:03:20.023 INFO:tasks.workunit.client.1.smithi172.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-19T06:03:20.032 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-19T06:03:20.032 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-03-19T06:03:20.081 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-03-19T06:03:20.084 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-03-19T06:03:20.084 DEBUG:teuthology.orchestra.run.smithi172:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-03-19T06:03:20.216 INFO:tasks.workunit.client.1.smithi172.stderr:+ mkdir -p fsstress 2024-03-19T06:03:20.224 INFO:tasks.workunit.client.1.smithi172.stderr:+ pushd fsstress 2024-03-19T06:03:20.226 INFO:tasks.workunit.client.1.smithi172.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-03-19T06:03:20.226 INFO:tasks.workunit.client.1.smithi172.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-03-19T06:03:20.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:20 smithi072 ceph-mon[28706]: pgmap v297: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:20.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:20 smithi172 ceph-mon[35716]: pgmap v297: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:21.886 INFO:tasks.workunit.client.1.smithi172.stderr:+ tar xzf ltp-full.tgz 2024-03-19T06:03:22.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:22 smithi072 ceph-mon[28706]: pgmap v298: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:22.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:22 smithi172 ceph-mon[35716]: pgmap v298: 65 pgs: 65 active+clean; 590 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:03:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.192+0000 7f26b4e00700 1 -- 172.21.15.72:0/2418546397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26b0074d80 msgr2=0x7f26b00731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.192+0000 7f26b4e00700 1 --2- 172.21.15.72:0/2418546397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26b0074d80 0x7f26b00731e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009940 tx=0x7f26a0009c50 comp rx=0 tx=0).stop 2024-03-19T06:03:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.192+0000 7f26b4e00700 1 -- 172.21.15.72:0/2418546397 shutdown_connections 2024-03-19T06:03:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.192+0000 7f26b4e00700 1 --2- 172.21.15.72:0/2418546397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26b00737b0 0x7f26b0073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.192+0000 7f26b4e00700 1 --2- 172.21.15.72:0/2418546397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26b0074d80 0x7f26b00731e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.192+0000 7f26b4e00700 1 -- 172.21.15.72:0/2418546397 >> 172.21.15.72:0/2418546397 conn(0x7f26b00fb6a0 msgr2=0x7f26b00fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.192+0000 7f26b4e00700 1 -- 172.21.15.72:0/2418546397 shutdown_connections 2024-03-19T06:03:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.192+0000 7f26b4e00700 1 -- 172.21.15.72:0/2418546397 wait complete. 2024-03-19T06:03:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.193+0000 7f26b4e00700 1 Processor -- start 2024-03-19T06:03:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.193+0000 7f26b4e00700 1 -- start start 2024-03-19T06:03:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.193+0000 7f26b4e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26b00737b0 0x7f26b0197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.193+0000 7f26b4e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26b0074d80 0x7f26b0198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.193+0000 7f26b4e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b0198650 con 0x7f26b0074d80 2024-03-19T06:03:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.193+0000 7f26b4e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b0198790 con 0x7f26b00737b0 2024-03-19T06:03:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.194+0000 7f26ad400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26b0074d80 0x7f26b0198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.194+0000 7f26ad400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26b0074d80 0x7f26b0198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48452/0 (socket says 172.21.15.72:48452) 2024-03-19T06:03:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.194+0000 7f26ad400700 1 -- 172.21.15.72:0/461154753 learned_addr learned my addr 172.21.15.72:0/461154753 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.194+0000 7f26ade00700 1 --2- 172.21.15.72:0/461154753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26b00737b0 0x7f26b0197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.194+0000 7f26ad400700 1 -- 172.21.15.72:0/461154753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26b00737b0 msgr2=0x7f26b0197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.194+0000 7f26ad400700 1 --2- 172.21.15.72:0/461154753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26b00737b0 0x7f26b0197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.194+0000 7f26ad400700 1 -- 172.21.15.72:0/461154753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a00095f0 con 0x7f26b0074d80 2024-03-19T06:03:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.194+0000 7f26ade00700 1 --2- 172.21.15.72:0/461154753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26b00737b0 0x7f26b0197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:03:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.194+0000 7f26ad400700 1 --2- 172.21.15.72:0/461154753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26b0074d80 0x7f26b0198030 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f269c00c8a0 tx=0x7f269c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.195+0000 7f26a6a00700 1 -- 172.21.15.72:0/461154753 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f269c00cea0 con 0x7f26b0074d80 2024-03-19T06:03:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.195+0000 7f26a6a00700 1 -- 172.21.15.72:0/461154753 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f269c004830 con 0x7f26b0074d80 2024-03-19T06:03:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.195+0000 7f26a6a00700 1 -- 172.21.15.72:0/461154753 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f269c0055b0 con 0x7f26b0074d80 2024-03-19T06:03:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.195+0000 7f26b4e00700 1 -- 172.21.15.72:0/461154753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b019d240 con 0x7f26b0074d80 2024-03-19T06:03:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.195+0000 7f26b4e00700 1 -- 172.21.15.72:0/461154753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b019d810 con 0x7f26b0074d80 2024-03-19T06:03:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.196+0000 7f26b4e00700 1 -- 172.21.15.72:0/461154753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b010ae70 con 0x7f26b0074d80 2024-03-19T06:03:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.197+0000 7f26a6a00700 1 -- 172.21.15.72:0/461154753 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f269c007ad0 con 0x7f26b0074d80 2024-03-19T06:03:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.198+0000 7f26a6a00700 1 --2- 172.21.15.72:0/461154753 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f269406c680 0x7f269406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.198+0000 7f26a6a00700 1 -- 172.21.15.72:0/461154753 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f269c08b5b0 con 0x7f26b0074d80 2024-03-19T06:03:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.198+0000 7f26ade00700 1 --2- 172.21.15.72:0/461154753 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f269406c680 0x7f269406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.199+0000 7f26ade00700 1 --2- 172.21.15.72:0/461154753 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f269406c680 0x7f269406eb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009910 tx=0x7f26a0005fd0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:23.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.203+0000 7f26a6a00700 1 -- 172.21.15.72:0/461154753 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f269c059700 con 0x7f26b0074d80 2024-03-19T06:03:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.448+0000 7f26b4e00700 1 -- 172.21.15.72:0/461154753 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26b0107630 con 0x7f269406c680 2024-03-19T06:03:23.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.450+0000 7f26a6a00700 1 -- 172.21.15.72:0/461154753 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f26b0107630 con 0x7f269406c680 2024-03-19T06:03:23.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.453+0000 7f26b4e00700 1 -- 172.21.15.72:0/461154753 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f269406c680 msgr2=0x7f269406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:23.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.453+0000 7f26b4e00700 1 --2- 172.21.15.72:0/461154753 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f269406c680 0x7f269406eb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009910 tx=0x7f26a0005fd0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.453+0000 7f26b4e00700 1 -- 172.21.15.72:0/461154753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26b0074d80 msgr2=0x7f26b0198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.453+0000 7f26b4e00700 1 --2- 172.21.15.72:0/461154753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26b0074d80 0x7f26b0198030 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f269c00c8a0 tx=0x7f269c00cc60 comp rx=0 tx=0).stop 2024-03-19T06:03:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.454+0000 7f26b4e00700 1 -- 172.21.15.72:0/461154753 shutdown_connections 2024-03-19T06:03:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.454+0000 7f26b4e00700 1 --2- 172.21.15.72:0/461154753 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f269406c680 0x7f269406eb30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.454+0000 7f26b4e00700 1 --2- 172.21.15.72:0/461154753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26b00737b0 0x7f26b0197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.454+0000 7f26b4e00700 1 --2- 172.21.15.72:0/461154753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26b0074d80 0x7f26b0198030 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.454+0000 7f26b4e00700 1 -- 172.21.15.72:0/461154753 >> 172.21.15.72:0/461154753 conn(0x7f26b00fb6a0 msgr2=0x7f26b0105f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.454+0000 7f26b4e00700 1 -- 172.21.15.72:0/461154753 shutdown_connections 2024-03-19T06:03:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.454+0000 7f26b4e00700 1 -- 172.21.15.72:0/461154753 wait complete. 2024-03-19T06:03:23.469 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:03:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.619+0000 7f473f200700 1 -- 172.21.15.72:0/322460848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4740074c80 msgr2=0x7f4740073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.619+0000 7f473f200700 1 --2- 172.21.15.72:0/322460848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4740074c80 0x7f4740073180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4730009910 tx=0x7f4730009c20 comp rx=0 tx=0).stop 2024-03-19T06:03:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.620+0000 7f473f200700 1 -- 172.21.15.72:0/322460848 shutdown_connections 2024-03-19T06:03:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.620+0000 7f473f200700 1 --2- 172.21.15.72:0/322460848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47400736c0 0x7f4740073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.620+0000 7f473f200700 1 --2- 172.21.15.72:0/322460848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4740074c80 0x7f4740073180 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.620+0000 7f473f200700 1 -- 172.21.15.72:0/322460848 >> 172.21.15.72:0/322460848 conn(0x7f47400fb680 msgr2=0x7f47400fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.620+0000 7f473f200700 1 -- 172.21.15.72:0/322460848 shutdown_connections 2024-03-19T06:03:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.620+0000 7f473f200700 1 -- 172.21.15.72:0/322460848 wait complete. 2024-03-19T06:03:23.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.622+0000 7f473f200700 1 Processor -- start 2024-03-19T06:03:23.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.622+0000 7f473f200700 1 -- start start 2024-03-19T06:03:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.622+0000 7f473f200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47400736c0 0x7f47401979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.622+0000 7f473f200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4740074c80 0x7f4740197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.622+0000 7f473f200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4740198520 con 0x7f47400736c0 2024-03-19T06:03:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.622+0000 7f473f200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4740198660 con 0x7f4740074c80 2024-03-19T06:03:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.623+0000 7f473de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47400736c0 0x7f47401979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.623+0000 7f473de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47400736c0 0x7f47401979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48470/0 (socket says 172.21.15.72:48470) 2024-03-19T06:03:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.623+0000 7f473de00700 1 -- 172.21.15.72:0/2941728605 learned_addr learned my addr 172.21.15.72:0/2941728605 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.623+0000 7f473de00700 1 -- 172.21.15.72:0/2941728605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4740074c80 msgr2=0x7f4740197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.623+0000 7f473de00700 1 --2- 172.21.15.72:0/2941728605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4740074c80 0x7f4740197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.623+0000 7f473de00700 1 -- 172.21.15.72:0/2941728605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300095f0 con 0x7f47400736c0 2024-03-19T06:03:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.623+0000 7f473de00700 1 --2- 172.21.15.72:0/2941728605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47400736c0 0x7f47401979c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f473000bd70 tx=0x7f473000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.624+0000 7f4736a00700 1 -- 172.21.15.72:0/2941728605 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f473001d070 con 0x7f47400736c0 2024-03-19T06:03:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.624+0000 7f473f200700 1 -- 172.21.15.72:0/2941728605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474019d110 con 0x7f47400736c0 2024-03-19T06:03:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.624+0000 7f4736a00700 1 -- 172.21.15.72:0/2941728605 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f473000f460 con 0x7f47400736c0 2024-03-19T06:03:23.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.624+0000 7f4736a00700 1 -- 172.21.15.72:0/2941728605 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4730021620 con 0x7f47400736c0 2024-03-19T06:03:23.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.624+0000 7f473f200700 1 -- 172.21.15.72:0/2941728605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474019d660 con 0x7f47400736c0 2024-03-19T06:03:23.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.625+0000 7f473f200700 1 -- 172.21.15.72:0/2941728605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474010aca0 con 0x7f47400736c0 2024-03-19T06:03:23.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.627+0000 7f4736a00700 1 -- 172.21.15.72:0/2941728605 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f473000fa40 con 0x7f47400736c0 2024-03-19T06:03:23.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.628+0000 7f4736a00700 1 --2- 172.21.15.72:0/2941728605 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f472406c680 0x7f472406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:23.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.628+0000 7f4736a00700 1 -- 172.21.15.72:0/2941728605 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f473008cb60 con 0x7f47400736c0 2024-03-19T06:03:23.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.629+0000 7f473d400700 1 --2- 172.21.15.72:0/2941728605 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f472406c680 0x7f472406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:23.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.630+0000 7f473d400700 1 --2- 172.21.15.72:0/2941728605 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f472406c680 0x7f472406eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f472c005950 tx=0x7f472c0058e0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.637+0000 7f4736a00700 1 -- 172.21.15.72:0/2941728605 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f473005acb0 con 0x7f47400736c0 2024-03-19T06:03:23.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.881+0000 7f473f200700 1 -- 172.21.15.72:0/2941728605 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4740107650 con 0x7f472406c680 2024-03-19T06:03:23.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.882+0000 7f4736a00700 1 -- 172.21.15.72:0/2941728605 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f4740107650 con 0x7f472406c680 2024-03-19T06:03:23.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.885+0000 7f473f200700 1 -- 172.21.15.72:0/2941728605 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f472406c680 msgr2=0x7f472406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.885+0000 7f473f200700 1 --2- 172.21.15.72:0/2941728605 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f472406c680 0x7f472406eb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f472c005950 tx=0x7f472c0058e0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.885+0000 7f473f200700 1 -- 172.21.15.72:0/2941728605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47400736c0 msgr2=0x7f47401979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.885+0000 7f473f200700 1 --2- 172.21.15.72:0/2941728605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47400736c0 0x7f47401979c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f473000bd70 tx=0x7f473000be50 comp rx=0 tx=0).stop 2024-03-19T06:03:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.885+0000 7f473f200700 1 -- 172.21.15.72:0/2941728605 shutdown_connections 2024-03-19T06:03:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.885+0000 7f473f200700 1 --2- 172.21.15.72:0/2941728605 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f472406c680 0x7f472406eb30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.885+0000 7f473f200700 1 --2- 172.21.15.72:0/2941728605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47400736c0 0x7f47401979c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.885+0000 7f473f200700 1 --2- 172.21.15.72:0/2941728605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4740074c80 0x7f4740197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.885+0000 7f473f200700 1 -- 172.21.15.72:0/2941728605 >> 172.21.15.72:0/2941728605 conn(0x7f47400fb680 msgr2=0x7f4740105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.885+0000 7f473f200700 1 -- 172.21.15.72:0/2941728605 shutdown_connections 2024-03-19T06:03:23.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:23.885+0000 7f473f200700 1 -- 172.21.15.72:0/2941728605 wait complete. 2024-03-19T06:03:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.035+0000 7f7a54400700 1 -- 172.21.15.72:0/3113787129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a4c106840 msgr2=0x7f7a4c106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.035+0000 7f7a54400700 1 --2- 172.21.15.72:0/3113787129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a4c106840 0x7f7a4c106c50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009910 tx=0x7f7a40009c20 comp rx=0 tx=0).stop 2024-03-19T06:03:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.035+0000 7f7a54400700 1 -- 172.21.15.72:0/3113787129 shutdown_connections 2024-03-19T06:03:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.035+0000 7f7a54400700 1 --2- 172.21.15.72:0/3113787129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a4c107a40 0x7f7a4c107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.035+0000 7f7a54400700 1 --2- 172.21.15.72:0/3113787129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a4c106840 0x7f7a4c106c50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.035+0000 7f7a54400700 1 -- 172.21.15.72:0/3113787129 >> 172.21.15.72:0/3113787129 conn(0x7f7a4c075970 msgr2=0x7f7a4c077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.035+0000 7f7a54400700 1 -- 172.21.15.72:0/3113787129 shutdown_connections 2024-03-19T06:03:24.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.035+0000 7f7a54400700 1 -- 172.21.15.72:0/3113787129 wait complete. 2024-03-19T06:03:24.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.036+0000 7f7a54400700 1 Processor -- start 2024-03-19T06:03:24.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.036+0000 7f7a54400700 1 -- start start 2024-03-19T06:03:24.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.037+0000 7f7a54400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a4c106840 0x7f7a4c19c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.037+0000 7f7a54400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a4c107a40 0x7f7a4c19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.037+0000 7f7a54400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c19cd10 con 0x7f7a4c106840 2024-03-19T06:03:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.037+0000 7f7a54400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c19ce50 con 0x7f7a4c107a40 2024-03-19T06:03:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.037+0000 7f7a51a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a4c106840 0x7f7a4c19c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.037+0000 7f7a51a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a4c106840 0x7f7a4c19c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58290/0 (socket says 172.21.15.72:58290) 2024-03-19T06:03:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.037+0000 7f7a51a00700 1 -- 172.21.15.72:0/740370529 learned_addr learned my addr 172.21.15.72:0/740370529 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.037+0000 7f7a51a00700 1 -- 172.21.15.72:0/740370529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a4c107a40 msgr2=0x7f7a4c19c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.037+0000 7f7a51a00700 1 --2- 172.21.15.72:0/740370529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a4c107a40 0x7f7a4c19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.037+0000 7f7a51a00700 1 -- 172.21.15.72:0/740370529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a400095f0 con 0x7f7a4c106840 2024-03-19T06:03:24.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.037+0000 7f7a51a00700 1 --2- 172.21.15.72:0/740370529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a4c106840 0x7f7a4c19c1b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000bd70 tx=0x7f7a4000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:24.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.038+0000 7f7a4a000700 1 -- 172.21.15.72:0/740370529 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4001d070 con 0x7f7a4c106840 2024-03-19T06:03:24.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.038+0000 7f7a4a000700 1 -- 172.21.15.72:0/740370529 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7a4000f460 con 0x7f7a4c106840 2024-03-19T06:03:24.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.038+0000 7f7a54400700 1 -- 172.21.15.72:0/740370529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c1a18a0 con 0x7f7a4c106840 2024-03-19T06:03:24.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.038+0000 7f7a4a000700 1 -- 172.21.15.72:0/740370529 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a40021640 con 0x7f7a4c106840 2024-03-19T06:03:24.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.038+0000 7f7a54400700 1 -- 172.21.15.72:0/740370529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c1a1d90 con 0x7f7a4c106840 2024-03-19T06:03:24.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.039+0000 7f7a54400700 1 -- 172.21.15.72:0/740370529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c10f410 con 0x7f7a4c106840 2024-03-19T06:03:24.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.040+0000 7f7a4a000700 1 -- 172.21.15.72:0/740370529 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7a4000fab0 con 0x7f7a4c106840 2024-03-19T06:03:24.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.041+0000 7f7a4a000700 1 --2- 172.21.15.72:0/740370529 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7a3406c680 0x7f7a3406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:24.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.041+0000 7f7a4a000700 1 -- 172.21.15.72:0/740370529 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f7a4008cce0 con 0x7f7a4c106840 2024-03-19T06:03:24.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.041+0000 7f7a51000700 1 --2- 172.21.15.72:0/740370529 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7a3406c680 0x7f7a3406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:24.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.042+0000 7f7a51000700 1 --2- 172.21.15.72:0/740370529 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7a3406c680 0x7f7a3406eb30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0097b0 tx=0x7f7a3c006d20 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:24.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.049+0000 7f7a4a000700 1 -- 172.21.15.72:0/740370529 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7a4005ae30 con 0x7f7a4c106840 2024-03-19T06:03:24.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.283+0000 7f7a54400700 1 -- 172.21.15.72:0/740370529 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a4c10c390 con 0x7f7a3406c680 2024-03-19T06:03:24.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.295+0000 7f7a4a000700 1 -- 172.21.15.72:0/740370529 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f7a4c10c390 con 0x7f7a3406c680 2024-03-19T06:03:24.288 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:24 smithi072 ceph-mon[28706]: pgmap v299: 65 pgs: 65 active+clean; 607 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.6 KiB/s wr, 0 op/s 2024-03-19T06:03:24.288 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:03:24.288 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (7m) 112s ago 9m 13.7M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:03:24.288 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (10m) 112s ago 10m 7545k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:03:24.288 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (8m) 117s ago 8m 7402k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (10m) 112s ago 10m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (8m) 117s ago 8m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (7m) 112s ago 9m 72.8M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (2m) 112s ago 2m 11.7M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (2m) 112s ago 2m 14.9M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (2m) 117s ago 2m 11.5M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (2m) 117s ago 2m 14.2M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:9283,8765,8443 running (11m) 112s ago 11m 488M - 18.2.0 dc2bc1663786 af0e8bfc899d 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (8m) 117s ago 8m 437M - 18.2.0 dc2bc1663786 16f76f54583f 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (11m) 112s ago 12m 44.9M 2048M 18.2.0 dc2bc1663786 77289e9e2b33 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (8m) 117s ago 8m 33.7M 2048M 18.2.0 dc2bc1663786 31fba31e7d8a 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (10m) 112s ago 10m 7810k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (8m) 117s ago 8m 8006k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (7m) 112s ago 7m 47.1M 3947M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:03:24.289 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (6m) 112s ago 6m 47.5M 3947M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:03:24.290 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (6m) 112s ago 6m 46.5M 3947M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:03:24.290 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (5m) 117s ago 5m 45.1M 4971M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:03:24.290 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (4m) 117s ago 4m 42.8M 4971M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:03:24.290 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (4m) 117s ago 4m 42.5M 4971M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:03:24.290 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (7m) 112s ago 9m 53.1M - 2.43.0 a07b618ecd1d ea7a91af5b4a 2024-03-19T06:03:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.298+0000 7f7a54400700 1 -- 172.21.15.72:0/740370529 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7a3406c680 msgr2=0x7f7a3406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.298+0000 7f7a54400700 1 --2- 172.21.15.72:0/740370529 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7a3406c680 0x7f7a3406eb30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0097b0 tx=0x7f7a3c006d20 comp rx=0 tx=0).stop 2024-03-19T06:03:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.298+0000 7f7a54400700 1 -- 172.21.15.72:0/740370529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a4c106840 msgr2=0x7f7a4c19c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.298+0000 7f7a54400700 1 --2- 172.21.15.72:0/740370529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a4c106840 0x7f7a4c19c1b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000bd70 tx=0x7f7a4000be50 comp rx=0 tx=0).stop 2024-03-19T06:03:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.298+0000 7f7a54400700 1 -- 172.21.15.72:0/740370529 shutdown_connections 2024-03-19T06:03:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.298+0000 7f7a54400700 1 --2- 172.21.15.72:0/740370529 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f7a3406c680 0x7f7a3406eb30 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0097b0 tx=0x7f7a3c006d20 comp rx=0 tx=0).stop 2024-03-19T06:03:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.298+0000 7f7a54400700 1 --2- 172.21.15.72:0/740370529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a4c106840 0x7f7a4c19c1b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.298+0000 7f7a54400700 1 --2- 172.21.15.72:0/740370529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a4c107a40 0x7f7a4c19c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.298+0000 7f7a54400700 1 -- 172.21.15.72:0/740370529 >> 172.21.15.72:0/740370529 conn(0x7f7a4c075970 msgr2=0x7f7a4c10ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.298+0000 7f7a54400700 1 -- 172.21.15.72:0/740370529 shutdown_connections 2024-03-19T06:03:24.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.298+0000 7f7a54400700 1 -- 172.21.15.72:0/740370529 wait complete. 2024-03-19T06:03:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.446+0000 7f2df8200700 1 -- 172.21.15.72:0/1338732995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2df0101440 msgr2=0x7f2df0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.446+0000 7f2df8200700 1 --2- 172.21.15.72:0/1338732995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2df0101440 0x7f2df0101890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009910 tx=0x7f2ddc009c20 comp rx=0 tx=0).stop 2024-03-19T06:03:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.446+0000 7f2df8200700 1 -- 172.21.15.72:0/1338732995 shutdown_connections 2024-03-19T06:03:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.446+0000 7f2df8200700 1 --2- 172.21.15.72:0/1338732995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2df0101440 0x7f2df0101890 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.446+0000 7f2df8200700 1 --2- 172.21.15.72:0/1338732995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0100240 0x7f2df0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.446+0000 7f2df8200700 1 -- 172.21.15.72:0/1338732995 >> 172.21.15.72:0/1338732995 conn(0x7f2df00fb7f0 msgr2=0x7f2df00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.446+0000 7f2df8200700 1 -- 172.21.15.72:0/1338732995 shutdown_connections 2024-03-19T06:03:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.447+0000 7f2df8200700 1 -- 172.21.15.72:0/1338732995 wait complete. 2024-03-19T06:03:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.448+0000 7f2df8200700 1 Processor -- start 2024-03-19T06:03:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.448+0000 7f2df8200700 1 -- start start 2024-03-19T06:03:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.449+0000 7f2df8200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0100240 0x7f2df0197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.449+0000 7f2df8200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2df0101440 0x7f2df0198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.449+0000 7f2df8200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df01988a0 con 0x7f2df0101440 2024-03-19T06:03:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.449+0000 7f2df8200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df01989e0 con 0x7f2df0100240 2024-03-19T06:03:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.449+0000 7f2df4e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2df0101440 0x7f2df0198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.449+0000 7f2df4e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2df0101440 0x7f2df0198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58306/0 (socket says 172.21.15.72:58306) 2024-03-19T06:03:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.449+0000 7f2df4e00700 1 -- 172.21.15.72:0/3144009660 learned_addr learned my addr 172.21.15.72:0/3144009660 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.449+0000 7f2df5800700 1 --2- 172.21.15.72:0/3144009660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0100240 0x7f2df0197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.449+0000 7f2df4e00700 1 -- 172.21.15.72:0/3144009660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0100240 msgr2=0x7f2df0197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.449+0000 7f2df4e00700 1 --2- 172.21.15.72:0/3144009660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0100240 0x7f2df0197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.449+0000 7f2df4e00700 1 -- 172.21.15.72:0/3144009660 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc0095f0 con 0x7f2df0101440 2024-03-19T06:03:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.450+0000 7f2df5800700 1 --2- 172.21.15.72:0/3144009660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0100240 0x7f2df0197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:03:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.450+0000 7f2df4e00700 1 --2- 172.21.15.72:0/3144009660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2df0101440 0x7f2df0198280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00b5c0 tx=0x7f2ddc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.450+0000 7f2dee000700 1 -- 172.21.15.72:0/3144009660 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ddc01d070 con 0x7f2df0101440 2024-03-19T06:03:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.450+0000 7f2dee000700 1 -- 172.21.15.72:0/3144009660 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2ddc022470 con 0x7f2df0101440 2024-03-19T06:03:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.450+0000 7f2df8200700 1 -- 172.21.15.72:0/3144009660 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df019d430 con 0x7f2df0101440 2024-03-19T06:03:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.450+0000 7f2df8200700 1 -- 172.21.15.72:0/3144009660 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df019d920 con 0x7f2df0101440 2024-03-19T06:03:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.450+0000 7f2dee000700 1 -- 172.21.15.72:0/3144009660 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ddc00f690 con 0x7f2df0101440 2024-03-19T06:03:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.452+0000 7f2df8200700 1 -- 172.21.15.72:0/3144009660 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df0105520 con 0x7f2df0101440 2024-03-19T06:03:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.453+0000 7f2dee000700 1 -- 172.21.15.72:0/3144009660 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2ddc004b70 con 0x7f2df0101440 2024-03-19T06:03:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.454+0000 7f2dee000700 1 --2- 172.21.15.72:0/3144009660 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2dd806c680 0x7f2dd806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:24.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.454+0000 7f2dee000700 1 -- 172.21.15.72:0/3144009660 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f2ddc08d070 con 0x7f2df0101440 2024-03-19T06:03:24.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.455+0000 7f2df5800700 1 --2- 172.21.15.72:0/3144009660 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2dd806c680 0x7f2dd806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.455+0000 7f2df5800700 1 --2- 172.21.15.72:0/3144009660 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2dd806c680 0x7f2dd806eb30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2df01012a0 tx=0x7f2de4008040 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:24.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.458+0000 7f2dee000700 1 -- 172.21.15.72:0/3144009660 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2ddc05b1f0 con 0x7f2df0101440 2024-03-19T06:03:24.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:24 smithi172 ceph-mon[35716]: pgmap v299: 65 pgs: 65 active+clean; 607 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.6 KiB/s wr, 0 op/s 2024-03-19T06:03:24.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.772+0000 7f2df8200700 1 -- 172.21.15.72:0/3144009660 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2df0061960 con 0x7f2df0101440 2024-03-19T06:03:24.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.773+0000 7f2dee000700 1 -- 172.21.15.72:0/3144009660 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f2ddc05ad80 con 0x7f2df0101440 2024-03-19T06:03:24.766 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:03:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:03:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:03:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:03:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:03:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:03:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:03:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:03:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:03:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:03:24.766 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:03:24.767 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:03:24.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:03:24.767 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:03:24.767 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-03-19T06:03:24.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:03:24.767 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:03:24.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.777+0000 7f2df8200700 1 -- 172.21.15.72:0/3144009660 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2dd806c680 msgr2=0x7f2dd806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:24.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.777+0000 7f2df8200700 1 --2- 172.21.15.72:0/3144009660 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2dd806c680 0x7f2dd806eb30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2df01012a0 tx=0x7f2de4008040 comp rx=0 tx=0).stop 2024-03-19T06:03:24.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.777+0000 7f2df8200700 1 -- 172.21.15.72:0/3144009660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2df0101440 msgr2=0x7f2df0198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:24.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.777+0000 7f2df8200700 1 --2- 172.21.15.72:0/3144009660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2df0101440 0x7f2df0198280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00b5c0 tx=0x7f2ddc00be20 comp rx=0 tx=0).stop 2024-03-19T06:03:24.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.777+0000 7f2df8200700 1 -- 172.21.15.72:0/3144009660 shutdown_connections 2024-03-19T06:03:24.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.777+0000 7f2df8200700 1 --2- 172.21.15.72:0/3144009660 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2dd806c680 0x7f2dd806eb30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.777+0000 7f2df8200700 1 --2- 172.21.15.72:0/3144009660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0100240 0x7f2df0197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.777+0000 7f2df8200700 1 --2- 172.21.15.72:0/3144009660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2df0101440 0x7f2df0198280 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.777+0000 7f2df8200700 1 -- 172.21.15.72:0/3144009660 >> 172.21.15.72:0/3144009660 conn(0x7f2df00fb7f0 msgr2=0x7f2df0102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:24.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.778+0000 7f2df8200700 1 -- 172.21.15.72:0/3144009660 shutdown_connections 2024-03-19T06:03:24.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.778+0000 7f2df8200700 1 -- 172.21.15.72:0/3144009660 wait complete. 2024-03-19T06:03:24.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.941+0000 7febc8600700 1 -- 172.21.15.72:0/2241886746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc0069230 msgr2=0x7febc0102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:24.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.941+0000 7febc8600700 1 --2- 172.21.15.72:0/2241886746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc0069230 0x7febc0102e10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7febb4009910 tx=0x7febb4009c20 comp rx=0 tx=0).stop 2024-03-19T06:03:24.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.941+0000 7febc8600700 1 -- 172.21.15.72:0/2241886746 shutdown_connections 2024-03-19T06:03:24.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.941+0000 7febc8600700 1 --2- 172.21.15.72:0/2241886746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc0103350 0x7febc0105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.941+0000 7febc8600700 1 --2- 172.21.15.72:0/2241886746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc0069230 0x7febc0102e10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.941+0000 7febc8600700 1 -- 172.21.15.72:0/2241886746 >> 172.21.15.72:0/2241886746 conn(0x7febc00fa780 msgr2=0x7febc00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:24.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.942+0000 7febc8600700 1 -- 172.21.15.72:0/2241886746 shutdown_connections 2024-03-19T06:03:24.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.942+0000 7febc8600700 1 -- 172.21.15.72:0/2241886746 wait complete. 2024-03-19T06:03:24.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.943+0000 7febc8600700 1 Processor -- start 2024-03-19T06:03:24.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.943+0000 7febc8600700 1 -- start start 2024-03-19T06:03:24.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.944+0000 7febc8600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc0069230 0x7febc0100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:24.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.944+0000 7febc8600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc0103350 0x7febc00fedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:24.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.944+0000 7febc8600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00ff2f0 con 0x7febc0103350 2024-03-19T06:03:24.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.944+0000 7febc8600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00ff430 con 0x7febc0069230 2024-03-19T06:03:24.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.944+0000 7febc5200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc0103350 0x7febc00fedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:24.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.944+0000 7febc5200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc0103350 0x7febc00fedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58320/0 (socket says 172.21.15.72:58320) 2024-03-19T06:03:24.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.944+0000 7febc5200700 1 -- 172.21.15.72:0/982753176 learned_addr learned my addr 172.21.15.72:0/982753176 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:24.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.944+0000 7febc5c00700 1 --2- 172.21.15.72:0/982753176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc0069230 0x7febc0100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:24.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.945+0000 7febc5200700 1 -- 172.21.15.72:0/982753176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc0069230 msgr2=0x7febc0100760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:24.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.945+0000 7febc5200700 1 --2- 172.21.15.72:0/982753176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc0069230 0x7febc0100760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:24.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.945+0000 7febc5200700 1 -- 172.21.15.72:0/982753176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb40095f0 con 0x7febc0103350 2024-03-19T06:03:24.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.945+0000 7febc5200700 1 --2- 172.21.15.72:0/982753176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc0103350 0x7febc00fedb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7febac00c8f0 tx=0x7febac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:24.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.945+0000 7febbe000700 1 -- 172.21.15.72:0/982753176 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febac007a70 con 0x7febc0103350 2024-03-19T06:03:24.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.945+0000 7febbe000700 1 -- 172.21.15.72:0/982753176 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7febac004ce0 con 0x7febc0103350 2024-03-19T06:03:24.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.945+0000 7febc8600700 1 -- 172.21.15.72:0/982753176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc00ff710 con 0x7febc0103350 2024-03-19T06:03:24.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.946+0000 7febbe000700 1 -- 172.21.15.72:0/982753176 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febac005610 con 0x7febc0103350 2024-03-19T06:03:24.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.946+0000 7febc8600700 1 -- 172.21.15.72:0/982753176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc019db40 con 0x7febc0103350 2024-03-19T06:03:24.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.947+0000 7febc8600700 1 -- 172.21.15.72:0/982753176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc018fbf0 con 0x7febc0103350 2024-03-19T06:03:24.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.948+0000 7febbe000700 1 -- 172.21.15.72:0/982753176 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7febac004e50 con 0x7febc0103350 2024-03-19T06:03:24.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.949+0000 7febbe000700 1 --2- 172.21.15.72:0/982753176 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7feba806c680 0x7feba806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:24.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.949+0000 7febbe000700 1 -- 172.21.15.72:0/982753176 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7febac013070 con 0x7febc0103350 2024-03-19T06:03:24.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.949+0000 7febc5c00700 1 --2- 172.21.15.72:0/982753176 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7feba806c680 0x7feba806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:24.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.950+0000 7febc5c00700 1 --2- 172.21.15.72:0/982753176 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7feba806c680 0x7feba806eb30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7febb4009fd0 tx=0x7febb400b540 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:24.957+0000 7febbe000700 1 -- 172.21.15.72:0/982753176 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7febac059950 con 0x7febc0103350 2024-03-19T06:03:25.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.234+0000 7febc8600700 1 -- 172.21.15.72:0/982753176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7febc002cc30 con 0x7febc0103350 2024-03-19T06:03:25.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.234+0000 7febbe000700 1 -- 172.21.15.72:0/982753176 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1831 (secure 0 0 0) 0x7febac0594e0 con 0x7febc0103350 2024-03-19T06:03:25.227 INFO:teuthology.orchestra.run.smithi072.stdout:e13 2024-03-19T06:03:25.227 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:03:25.227 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:03:25.227 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 13 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:01:14.992147+0000 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:03:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:03:25.229 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:03:25.230 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:03:25.230 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:03:25.230 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:03:25.230 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:03:25.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.237+0000 7febc8600700 1 -- 172.21.15.72:0/982753176 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7feba806c680 msgr2=0x7feba806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:25.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.237+0000 7febc8600700 1 --2- 172.21.15.72:0/982753176 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7feba806c680 0x7feba806eb30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7febb4009fd0 tx=0x7febb400b540 comp rx=0 tx=0).stop 2024-03-19T06:03:25.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.237+0000 7febc8600700 1 -- 172.21.15.72:0/982753176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc0103350 msgr2=0x7febc00fedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.237+0000 7febc8600700 1 --2- 172.21.15.72:0/982753176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc0103350 0x7febc00fedb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7febac00c8f0 tx=0x7febac00ccb0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.237+0000 7febc8600700 1 -- 172.21.15.72:0/982753176 shutdown_connections 2024-03-19T06:03:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.237+0000 7febc8600700 1 --2- 172.21.15.72:0/982753176 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7feba806c680 0x7feba806eb30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.237+0000 7febc8600700 1 --2- 172.21.15.72:0/982753176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc0069230 0x7febc0100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.237+0000 7febc8600700 1 --2- 172.21.15.72:0/982753176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc0103350 0x7febc00fedb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.237+0000 7febc8600700 1 -- 172.21.15.72:0/982753176 >> 172.21.15.72:0/982753176 conn(0x7febc00fa780 msgr2=0x7febc00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.237+0000 7febc8600700 1 -- 172.21.15.72:0/982753176 shutdown_connections 2024-03-19T06:03:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.237+0000 7febc8600700 1 -- 172.21.15.72:0/982753176 wait complete. 2024-03-19T06:03:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 13 2024-03-19T06:03:25.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:25 smithi072 ceph-mon[28706]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:25.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:25 smithi072 ceph-mon[28706]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:25.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:25 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3144009660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:03:25.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.386+0000 7fb5e2600700 1 -- 172.21.15.72:0/241699989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc1012c0 msgr2=0x7fb5dc101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.386+0000 7fb5e2600700 1 --2- 172.21.15.72:0/241699989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc1012c0 0x7fb5dc101730 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009910 tx=0x7fb5c8009c20 comp rx=0 tx=0).stop 2024-03-19T06:03:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.386+0000 7fb5e2600700 1 -- 172.21.15.72:0/241699989 shutdown_connections 2024-03-19T06:03:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.386+0000 7fb5e2600700 1 --2- 172.21.15.72:0/241699989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc1012c0 0x7fb5dc101730 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.386+0000 7fb5e2600700 1 --2- 172.21.15.72:0/241699989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc100020 0x7fb5dc100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.386+0000 7fb5e2600700 1 -- 172.21.15.72:0/241699989 >> 172.21.15.72:0/241699989 conn(0x7fb5dc0fb650 msgr2=0x7fb5dc0fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.386+0000 7fb5e2600700 1 -- 172.21.15.72:0/241699989 shutdown_connections 2024-03-19T06:03:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.386+0000 7fb5e2600700 1 -- 172.21.15.72:0/241699989 wait complete. 2024-03-19T06:03:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.387+0000 7fb5e2600700 1 Processor -- start 2024-03-19T06:03:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.387+0000 7fb5e2600700 1 -- start start 2024-03-19T06:03:25.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.387+0000 7fb5e2600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc100020 0x7fb5dc197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.387+0000 7fb5e2600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc1012c0 0x7fb5dc197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.387+0000 7fb5e2600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc198600 con 0x7fb5dc100020 2024-03-19T06:03:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.387+0000 7fb5e2600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc198740 con 0x7fb5dc1012c0 2024-03-19T06:03:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.388+0000 7fb5e1200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc100020 0x7fb5dc197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.388+0000 7fb5e1200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc100020 0x7fb5dc197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58332/0 (socket says 172.21.15.72:58332) 2024-03-19T06:03:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.388+0000 7fb5e1200700 1 -- 172.21.15.72:0/2662905061 learned_addr learned my addr 172.21.15.72:0/2662905061 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.388+0000 7fb5dbe00700 1 --2- 172.21.15.72:0/2662905061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc1012c0 0x7fb5dc197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.388+0000 7fb5e1200700 1 -- 172.21.15.72:0/2662905061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc1012c0 msgr2=0x7fb5dc197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.388+0000 7fb5e1200700 1 --2- 172.21.15.72:0/2662905061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc1012c0 0x7fb5dc197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.388+0000 7fb5e1200700 1 -- 172.21.15.72:0/2662905061 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c80095f0 con 0x7fb5dc100020 2024-03-19T06:03:25.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.389+0000 7fb5e1200700 1 --2- 172.21.15.72:0/2662905061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc100020 0x7fb5dc197aa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000b4b0 tx=0x7fb5d000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:25.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.389+0000 7fb5d9600700 1 -- 172.21.15.72:0/2662905061 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5d0011800 con 0x7fb5dc100020 2024-03-19T06:03:25.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.389+0000 7fb5d9600700 1 -- 172.21.15.72:0/2662905061 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb5d0011e10 con 0x7fb5dc100020 2024-03-19T06:03:25.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.389+0000 7fb5e2600700 1 -- 172.21.15.72:0/2662905061 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc19d1f0 con 0x7fb5dc100020 2024-03-19T06:03:25.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.389+0000 7fb5e2600700 1 -- 172.21.15.72:0/2662905061 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc19d7c0 con 0x7fb5dc100020 2024-03-19T06:03:25.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.389+0000 7fb5d9600700 1 -- 172.21.15.72:0/2662905061 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5d000f2e0 con 0x7fb5dc100020 2024-03-19T06:03:25.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.390+0000 7fb5e2600700 1 -- 172.21.15.72:0/2662905061 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc1053a0 con 0x7fb5dc100020 2024-03-19T06:03:25.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.391+0000 7fb5d9600700 1 -- 172.21.15.72:0/2662905061 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb5d0010380 con 0x7fb5dc100020 2024-03-19T06:03:25.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.392+0000 7fb5d9600700 1 --2- 172.21.15.72:0/2662905061 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb5c406c680 0x7fb5c406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:25.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.392+0000 7fb5d9600700 1 -- 172.21.15.72:0/2662905061 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fb5d008b5b0 con 0x7fb5dc100020 2024-03-19T06:03:25.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.393+0000 7fb5dbe00700 1 --2- 172.21.15.72:0/2662905061 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb5c406c680 0x7fb5c406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:25.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.393+0000 7fb5dbe00700 1 --2- 172.21.15.72:0/2662905061 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb5c406c680 0x7fb5c406eb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8006010 tx=0x7fb5c800b580 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:25.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.396+0000 7fb5d9600700 1 -- 172.21.15.72:0/2662905061 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb5d0059680 con 0x7fb5dc100020 2024-03-19T06:03:25.492 INFO:tasks.workunit.client.0.smithi072.stderr:Updating files: 58% (7129/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 75% (9302/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-19T06:03:25.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.657+0000 7fb5e2600700 1 -- 172.21.15.72:0/2662905061 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5dc061190 con 0x7fb5c406c680 2024-03-19T06:03:25.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.660+0000 7fb5d9600700 1 -- 172.21.15.72:0/2662905061 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fb5dc061190 con 0x7fb5c406c680 2024-03-19T06:03:25.653 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:03:25.653 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:03:25.653 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:03:25.653 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:03:25.653 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-03-19T06:03:25.653 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "0/23 daemons upgraded", 2024-03-19T06:03:25.653 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 image on host smithi172", 2024-03-19T06:03:25.653 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:03:25.653 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:03:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:25 smithi172 ceph-mon[35716]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:25 smithi172 ceph-mon[35716]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:25 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3144009660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:03:25.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.662+0000 7fb5e2600700 1 -- 172.21.15.72:0/2662905061 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb5c406c680 msgr2=0x7fb5c406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:25.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.662+0000 7fb5e2600700 1 --2- 172.21.15.72:0/2662905061 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb5c406c680 0x7fb5c406eb30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8006010 tx=0x7fb5c800b580 comp rx=0 tx=0).stop 2024-03-19T06:03:25.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.662+0000 7fb5e2600700 1 -- 172.21.15.72:0/2662905061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc100020 msgr2=0x7fb5dc197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:25.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.662+0000 7fb5e2600700 1 --2- 172.21.15.72:0/2662905061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc100020 0x7fb5dc197aa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000b4b0 tx=0x7fb5d000b870 comp rx=0 tx=0).stop 2024-03-19T06:03:25.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.663+0000 7fb5e2600700 1 -- 172.21.15.72:0/2662905061 shutdown_connections 2024-03-19T06:03:25.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.663+0000 7fb5e2600700 1 --2- 172.21.15.72:0/2662905061 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fb5c406c680 0x7fb5c406eb30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.663+0000 7fb5e2600700 1 --2- 172.21.15.72:0/2662905061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5dc100020 0x7fb5dc197aa0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.663+0000 7fb5e2600700 1 --2- 172.21.15.72:0/2662905061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc1012c0 0x7fb5dc197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.663+0000 7fb5e2600700 1 -- 172.21.15.72:0/2662905061 >> 172.21.15.72:0/2662905061 conn(0x7fb5dc0fb650 msgr2=0x7fb5dc1024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:25.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.663+0000 7fb5e2600700 1 -- 172.21.15.72:0/2662905061 shutdown_connections 2024-03-19T06:03:25.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.663+0000 7fb5e2600700 1 -- 172.21.15.72:0/2662905061 wait complete. 2024-03-19T06:03:25.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.818+0000 7f2fe7200700 1 -- 172.21.15.72:0/214147111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8074ce0 msgr2=0x7f2fe80731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:25.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.818+0000 7f2fe7200700 1 --2- 172.21.15.72:0/214147111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8074ce0 0x7f2fe80731e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009940 tx=0x7f2fd8009c50 comp rx=0 tx=0).stop 2024-03-19T06:03:25.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.818+0000 7f2fe7200700 1 -- 172.21.15.72:0/214147111 shutdown_connections 2024-03-19T06:03:25.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.818+0000 7f2fe7200700 1 --2- 172.21.15.72:0/214147111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe8073720 0x7f2fe8073b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.818+0000 7f2fe7200700 1 --2- 172.21.15.72:0/214147111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8074ce0 0x7f2fe80731e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.818+0000 7f2fe7200700 1 -- 172.21.15.72:0/214147111 >> 172.21.15.72:0/214147111 conn(0x7f2fe80fb650 msgr2=0x7f2fe80fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:25.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.818+0000 7f2fe7200700 1 -- 172.21.15.72:0/214147111 shutdown_connections 2024-03-19T06:03:25.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.818+0000 7f2fe7200700 1 -- 172.21.15.72:0/214147111 wait complete. 2024-03-19T06:03:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.819+0000 7f2fe7200700 1 Processor -- start 2024-03-19T06:03:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.819+0000 7f2fe7200700 1 -- start start 2024-03-19T06:03:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.819+0000 7f2fe7200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8073720 0x7f2fe8197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.819+0000 7f2fe7200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe8074ce0 0x7f2fe8197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.819+0000 7f2fe7200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8198590 con 0x7f2fe8073720 2024-03-19T06:03:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.819+0000 7f2fe7200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81986d0 con 0x7f2fe8074ce0 2024-03-19T06:03:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.820+0000 7f2fe5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8073720 0x7f2fe8197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.820+0000 7f2fe5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8073720 0x7f2fe8197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58362/0 (socket says 172.21.15.72:58362) 2024-03-19T06:03:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.820+0000 7f2fe5e00700 1 -- 172.21.15.72:0/2565169054 learned_addr learned my addr 172.21.15.72:0/2565169054 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.820+0000 7f2fe5e00700 1 -- 172.21.15.72:0/2565169054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe8074ce0 msgr2=0x7f2fe8197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.820+0000 7f2fe5400700 1 --2- 172.21.15.72:0/2565169054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe8074ce0 0x7f2fe8197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.820+0000 7f2fe5e00700 1 --2- 172.21.15.72:0/2565169054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe8074ce0 0x7f2fe8197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:25.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.820+0000 7f2fe5e00700 1 -- 172.21.15.72:0/2565169054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd80095f0 con 0x7f2fe8073720 2024-03-19T06:03:25.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.820+0000 7f2fe5e00700 1 --2- 172.21.15.72:0/2565169054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8073720 0x7f2fe8197a30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80055f0 tx=0x7f2fd80056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:25.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.821+0000 7f2fdea00700 1 -- 172.21.15.72:0/2565169054 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd801d070 con 0x7f2fe8073720 2024-03-19T06:03:25.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.821+0000 7f2fdea00700 1 -- 172.21.15.72:0/2565169054 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2fd800f460 con 0x7f2fe8073720 2024-03-19T06:03:25.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.821+0000 7f2fe7200700 1 -- 172.21.15.72:0/2565169054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe819d120 con 0x7f2fe8073720 2024-03-19T06:03:25.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.821+0000 7f2fdea00700 1 -- 172.21.15.72:0/2565169054 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd8021640 con 0x7f2fe8073720 2024-03-19T06:03:25.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.821+0000 7f2fe7200700 1 -- 172.21.15.72:0/2565169054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe819d690 con 0x7f2fe8073720 2024-03-19T06:03:25.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.822+0000 7f2fe7200700 1 -- 172.21.15.72:0/2565169054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe810ace0 con 0x7f2fe8073720 2024-03-19T06:03:25.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.823+0000 7f2fdea00700 1 -- 172.21.15.72:0/2565169054 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2fd800fa40 con 0x7f2fe8073720 2024-03-19T06:03:25.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.824+0000 7f2fdea00700 1 --2- 172.21.15.72:0/2565169054 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2fcc06c680 0x7f2fcc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:25.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.824+0000 7f2fdea00700 1 -- 172.21.15.72:0/2565169054 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f2fd808cc80 con 0x7f2fe8073720 2024-03-19T06:03:25.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.825+0000 7f2fe5400700 1 --2- 172.21.15.72:0/2565169054 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2fcc06c680 0x7f2fcc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:25.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.825+0000 7f2fe5400700 1 --2- 172.21.15.72:0/2565169054 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2fcc06c680 0x7f2fcc06eb30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4005950 tx=0x7f2fd4005cf0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:25.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:25.830+0000 7f2fdea00700 1 -- 172.21.15.72:0/2565169054 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2fd805adf0 con 0x7f2fe8073720 2024-03-19T06:03:26.072 INFO:tasks.workunit.client.0.smithi072.stderr:Note: switching to 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'. 2024-03-19T06:03:26.072 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-19T06:03:26.072 INFO:tasks.workunit.client.0.smithi072.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-19T06:03:26.072 INFO:tasks.workunit.client.0.smithi072.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-19T06:03:26.072 INFO:tasks.workunit.client.0.smithi072.stderr:state without impacting any branches by switching back to a branch. 2024-03-19T06:03:26.072 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-19T06:03:26.072 INFO:tasks.workunit.client.0.smithi072.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-19T06:03:26.072 INFO:tasks.workunit.client.0.smithi072.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-19T06:03:26.073 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-19T06:03:26.073 INFO:tasks.workunit.client.0.smithi072.stderr: git switch -c 2024-03-19T06:03:26.073 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-19T06:03:26.073 INFO:tasks.workunit.client.0.smithi072.stderr:Or undo this operation with: 2024-03-19T06:03:26.073 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-19T06:03:26.073 INFO:tasks.workunit.client.0.smithi072.stderr: git switch - 2024-03-19T06:03:26.073 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-19T06:03:26.073 INFO:tasks.workunit.client.0.smithi072.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-19T06:03:26.073 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-03-19T06:03:26.073 INFO:tasks.workunit.client.0.smithi072.stderr:HEAD is now at b0ea271bb96 Merge PR #52373 into wip-vshankar-testing-20240307.022905 2024-03-19T06:03:26.081 DEBUG:teuthology.orchestra.run.smithi072:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-19T06:03:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.149+0000 7f2fe7200700 1 -- 172.21.15.72:0/2565169054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2fe810aed0 con 0x7f2fe8073720 2024-03-19T06:03:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.150+0000 7f2fdea00700 1 -- 172.21.15.72:0/2565169054 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f2fd805a980 con 0x7f2fe8073720 2024-03-19T06:03:26.143 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:03:26.143 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:03:26.143 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:03:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.152+0000 7f2fe7200700 1 -- 172.21.15.72:0/2565169054 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2fcc06c680 msgr2=0x7f2fcc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.152+0000 7f2fe7200700 1 --2- 172.21.15.72:0/2565169054 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2fcc06c680 0x7f2fcc06eb30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4005950 tx=0x7f2fd4005cf0 comp rx=0 tx=0).stop 2024-03-19T06:03:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.152+0000 7f2fe7200700 1 -- 172.21.15.72:0/2565169054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8073720 msgr2=0x7f2fe8197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.152+0000 7f2fe7200700 1 --2- 172.21.15.72:0/2565169054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8073720 0x7f2fe8197a30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80055f0 tx=0x7f2fd80056d0 comp rx=0 tx=0).stop 2024-03-19T06:03:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.152+0000 7f2fe7200700 1 -- 172.21.15.72:0/2565169054 shutdown_connections 2024-03-19T06:03:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.152+0000 7f2fe7200700 1 --2- 172.21.15.72:0/2565169054 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f2fcc06c680 0x7f2fcc06eb30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.152+0000 7f2fe7200700 1 --2- 172.21.15.72:0/2565169054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8073720 0x7f2fe8197a30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.152+0000 7f2fe7200700 1 --2- 172.21.15.72:0/2565169054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe8074ce0 0x7f2fe8197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.152+0000 7f2fe7200700 1 -- 172.21.15.72:0/2565169054 >> 172.21.15.72:0/2565169054 conn(0x7f2fe80fb650 msgr2=0x7f2fe8105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.153+0000 7f2fe7200700 1 -- 172.21.15.72:0/2565169054 shutdown_connections 2024-03-19T06:03:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:26.153+0000 7f2fe7200700 1 -- 172.21.15.72:0/2565169054 wait complete. 2024-03-19T06:03:26.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:26 smithi072 ceph-mon[28706]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:26.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:26 smithi072 ceph-mon[28706]: pgmap v300: 65 pgs: 65 active+clean; 917 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 28 KiB/s wr, 1 op/s 2024-03-19T06:03:26.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:26 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/982753176' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:03:26.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:26 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2565169054' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:03:26.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:26 smithi172 ceph-mon[35716]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:26.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:26 smithi172 ceph-mon[35716]: pgmap v300: 65 pgs: 65 active+clean; 917 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 28 KiB/s wr, 1 op/s 2024-03-19T06:03:26.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:26 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/982753176' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:03:26.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:26 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2565169054' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:03:27.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:27 smithi072 ceph-mon[28706]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:27.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:27 smithi172 ceph-mon[35716]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:28.557 INFO:tasks.workunit.client.0.smithi072.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-19T06:03:28.564 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-19T06:03:28.564 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-19T06:03:28.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:28 smithi072 ceph-mon[28706]: pgmap v301: 65 pgs: 65 active+clean; 12 MiB data, 191 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 942 KiB/s wr, 8 op/s 2024-03-19T06:03:28.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:28 smithi172 ceph-mon[35716]: pgmap v301: 65 pgs: 65 active+clean; 12 MiB data, 191 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 942 KiB/s wr, 8 op/s 2024-03-19T06:03:30.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:30 smithi072 ceph-mon[28706]: pgmap v302: 65 pgs: 65 active+clean; 12 MiB data, 198 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1015 KiB/s wr, 15 op/s 2024-03-19T06:03:30.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:30 smithi172 ceph-mon[35716]: pgmap v302: 65 pgs: 65 active+clean; 12 MiB data, 198 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1015 KiB/s wr, 15 op/s 2024-03-19T06:03:31.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:31 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:03:31.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:31 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:03:32.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:32 smithi072 ceph-mon[28706]: pgmap v303: 65 pgs: 65 active+clean; 14 MiB data, 200 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 21 op/s 2024-03-19T06:03:32.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:32 smithi172 ceph-mon[35716]: pgmap v303: 65 pgs: 65 active+clean; 14 MiB data, 200 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 21 op/s 2024-03-19T06:03:34.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:34 smithi072 ceph-mon[28706]: pgmap v304: 65 pgs: 65 active+clean; 15 MiB data, 205 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 31 op/s 2024-03-19T06:03:34.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:34 smithi072 ceph-mon[28706]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:03:34.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:34 smithi172 ceph-mon[35716]: pgmap v304: 65 pgs: 65 active+clean; 15 MiB data, 205 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 31 op/s 2024-03-19T06:03:34.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:34 smithi172 ceph-mon[35716]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:03:36.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:36 smithi072 ceph-mon[28706]: pgmap v305: 65 pgs: 65 active+clean; 17 MiB data, 208 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 35 op/s 2024-03-19T06:03:36.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:36 smithi172 ceph-mon[35716]: pgmap v305: 65 pgs: 65 active+clean; 17 MiB data, 208 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 35 op/s 2024-03-19T06:03:37.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:37 smithi072 ceph-mon[28706]: pgmap v306: 65 pgs: 65 active+clean; 17 MiB data, 211 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 39 op/s 2024-03-19T06:03:37.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:37 smithi172 ceph-mon[35716]: pgmap v306: 65 pgs: 65 active+clean; 17 MiB data, 211 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 39 op/s 2024-03-19T06:03:38.314 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-19T06:03:38.490 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-19T06:03:38.576 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-19T06:03:38.582 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-19T06:03:38.582 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-19T06:03:38.661 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-19T06:03:38.672 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T06:03:38.672 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-19T06:03:38.764 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-03-19T06:03:38.765 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-03-19T06:03:38.766 DEBUG:teuthology.orchestra.run.smithi072:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-03-19T06:03:38.885 INFO:tasks.workunit.client.0.smithi072.stderr:+ mkdir -p fsstress 2024-03-19T06:03:38.892 INFO:tasks.workunit.client.0.smithi072.stderr:+ pushd fsstress 2024-03-19T06:03:38.897 INFO:tasks.workunit.client.0.smithi072.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-19T06:03:38.897 INFO:tasks.workunit.client.0.smithi072.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-03-19T06:03:40.077 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:39 smithi072 ceph-mon[28706]: pgmap v307: 65 pgs: 65 active+clean; 17 MiB data, 214 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 497 KiB/s wr, 34 op/s 2024-03-19T06:03:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:39 smithi172 ceph-mon[35716]: pgmap v307: 65 pgs: 65 active+clean; 17 MiB data, 214 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 497 KiB/s wr, 34 op/s 2024-03-19T06:03:40.845 INFO:tasks.workunit.client.0.smithi072.stderr:+ tar xzf ltp-full.tgz 2024-03-19T06:03:42.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:42 smithi072 ceph-mon[28706]: pgmap v308: 65 pgs: 65 active+clean; 21 MiB data, 217 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 717 KiB/s wr, 35 op/s 2024-03-19T06:03:42.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:42 smithi172 ceph-mon[35716]: pgmap v308: 65 pgs: 65 active+clean; 21 MiB data, 217 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 717 KiB/s wr, 35 op/s 2024-03-19T06:03:44.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:44 smithi072 ceph-mon[28706]: pgmap v309: 65 pgs: 65 active+clean; 29 MiB data, 243 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 39 op/s 2024-03-19T06:03:44.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:44 smithi172 ceph-mon[35716]: pgmap v309: 65 pgs: 65 active+clean; 29 MiB data, 243 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 39 op/s 2024-03-19T06:03:46.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:46 smithi172 ceph-mon[35716]: pgmap v310: 65 pgs: 65 active+clean; 34 MiB data, 252 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 36 op/s 2024-03-19T06:03:46.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:46 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:03:46.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:46 smithi072 ceph-mon[28706]: pgmap v310: 65 pgs: 65 active+clean; 34 MiB data, 252 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 36 op/s 2024-03-19T06:03:46.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:46 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:03:48.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:48 smithi172 ceph-mon[35716]: pgmap v311: 65 pgs: 65 active+clean; 37 MiB data, 269 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 42 op/s 2024-03-19T06:03:48.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:48 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:48.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:48 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.qkcahs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T06:03:48.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:48 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T06:03:48.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:48 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:03:48.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:48 smithi072 ceph-mon[28706]: pgmap v311: 65 pgs: 65 active+clean; 37 MiB data, 269 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 42 op/s 2024-03-19T06:03:48.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:48 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:48.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:48 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.qkcahs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T06:03:48.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:48 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T06:03:48.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:48 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:03:49.392 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:49 smithi172 ceph-mon[35716]: Upgrade: Updating mgr.smithi172.qkcahs 2024-03-19T06:03:49.392 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:49 smithi172 ceph-mon[35716]: Deploying daemon mgr.smithi172.qkcahs on smithi172 2024-03-19T06:03:49.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:49 smithi072 ceph-mon[28706]: Upgrade: Updating mgr.smithi172.qkcahs 2024-03-19T06:03:49.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:49 smithi072 ceph-mon[28706]: Deploying daemon mgr.smithi172.qkcahs on smithi172 2024-03-19T06:03:50.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:50 smithi072 ceph-mon[28706]: pgmap v312: 65 pgs: 65 active+clean; 38 MiB data, 277 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 50 op/s 2024-03-19T06:03:50.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:50 smithi172 ceph-mon[35716]: pgmap v312: 65 pgs: 65 active+clean; 38 MiB data, 277 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 50 op/s 2024-03-19T06:03:52.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:52 smithi172 ceph-mon[35716]: pgmap v313: 65 pgs: 65 active+clean; 41 MiB data, 292 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 59 op/s 2024-03-19T06:03:52.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:52 smithi072 ceph-mon[28706]: pgmap v313: 65 pgs: 65 active+clean; 41 MiB data, 292 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 59 op/s 2024-03-19T06:03:54.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:53 smithi172 ceph-mon[35716]: pgmap v314: 65 pgs: 65 active+clean; 47 MiB data, 315 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 71 op/s 2024-03-19T06:03:54.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:54.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:54.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:03:54.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:54.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:53 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:54.283 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:53 smithi072 ceph-mon[28706]: pgmap v314: 65 pgs: 65 active+clean; 47 MiB data, 315 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 71 op/s 2024-03-19T06:03:54.283 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:54.283 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:54.283 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:03:54.283 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:54.283 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:53 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:55.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:55 smithi172 ceph-mon[35716]: pgmap v315: 65 pgs: 65 active+clean; 50 MiB data, 321 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 69 op/s 2024-03-19T06:03:56.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:55 smithi072 ceph-mon[28706]: pgmap v315: 65 pgs: 65 active+clean; 50 MiB data, 321 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 69 op/s 2024-03-19T06:03:56.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.356+0000 7fa3ddc00700 1 -- 172.21.15.72:0/1699936920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3d8106860 msgr2=0x7fa3d8106c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:56.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.356+0000 7fa3ddc00700 1 --2- 172.21.15.72:0/1699936920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3d8106860 0x7fa3d8106c70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009910 tx=0x7fa3c8009c20 comp rx=0 tx=0).stop 2024-03-19T06:03:56.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.356+0000 7fa3ddc00700 1 -- 172.21.15.72:0/1699936920 shutdown_connections 2024-03-19T06:03:56.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.356+0000 7fa3ddc00700 1 --2- 172.21.15.72:0/1699936920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3d8107a60 0x7fa3d8107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:56.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.356+0000 7fa3ddc00700 1 --2- 172.21.15.72:0/1699936920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3d8106860 0x7fa3d8106c70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:56.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.356+0000 7fa3ddc00700 1 -- 172.21.15.72:0/1699936920 >> 172.21.15.72:0/1699936920 conn(0x7fa3d8069b40 msgr2=0x7fa3d8069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:56.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.356+0000 7fa3ddc00700 1 -- 172.21.15.72:0/1699936920 shutdown_connections 2024-03-19T06:03:56.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.357+0000 7fa3ddc00700 1 -- 172.21.15.72:0/1699936920 wait complete. 2024-03-19T06:03:56.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.358+0000 7fa3ddc00700 1 Processor -- start 2024-03-19T06:03:56.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.358+0000 7fa3ddc00700 1 -- start start 2024-03-19T06:03:56.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.358+0000 7fa3ddc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3d8106860 0x7fa3d819c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:56.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.358+0000 7fa3ddc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3d8107a60 0x7fa3d819c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:56.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.358+0000 7fa3ddc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d819cc40 con 0x7fa3d8107a60 2024-03-19T06:03:56.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.358+0000 7fa3ddc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d819cd80 con 0x7fa3d8106860 2024-03-19T06:03:56.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.359+0000 7fa3d6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3d8107a60 0x7fa3d819c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:56.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.359+0000 7fa3d6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3d8107a60 0x7fa3d819c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55044/0 (socket says 172.21.15.72:55044) 2024-03-19T06:03:56.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.359+0000 7fa3d6000700 1 -- 172.21.15.72:0/2543931459 learned_addr learned my addr 172.21.15.72:0/2543931459 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.359+0000 7fa3d6a00700 1 --2- 172.21.15.72:0/2543931459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3d8106860 0x7fa3d819c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.359+0000 7fa3d6000700 1 -- 172.21.15.72:0/2543931459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3d8106860 msgr2=0x7fa3d819c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.359+0000 7fa3d6000700 1 --2- 172.21.15.72:0/2543931459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3d8106860 0x7fa3d819c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.359+0000 7fa3d6000700 1 -- 172.21.15.72:0/2543931459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c80095f0 con 0x7fa3d8107a60 2024-03-19T06:03:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.360+0000 7fa3d6000700 1 --2- 172.21.15.72:0/2543931459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3d8107a60 0x7fa3d819c620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400d900 tx=0x7fa3c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.360+0000 7fa3cf400700 1 -- 172.21.15.72:0/2543931459 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3c40041f0 con 0x7fa3d8107a60 2024-03-19T06:03:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.360+0000 7fa3cf400700 1 -- 172.21.15.72:0/2543931459 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa3c4004ce0 con 0x7fa3d8107a60 2024-03-19T06:03:56.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.360+0000 7fa3ddc00700 1 -- 172.21.15.72:0/2543931459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d81a1830 con 0x7fa3d8107a60 2024-03-19T06:03:56.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.360+0000 7fa3cf400700 1 -- 172.21.15.72:0/2543931459 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3c400b750 con 0x7fa3d8107a60 2024-03-19T06:03:56.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.360+0000 7fa3ddc00700 1 -- 172.21.15.72:0/2543931459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d81a1d80 con 0x7fa3d8107a60 2024-03-19T06:03:56.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.362+0000 7fa3ddc00700 1 -- 172.21.15.72:0/2543931459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d810f3b0 con 0x7fa3d8107a60 2024-03-19T06:03:56.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.363+0000 7fa3cf400700 1 -- 172.21.15.72:0/2543931459 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa3c4004350 con 0x7fa3d8107a60 2024-03-19T06:03:56.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.364+0000 7fa3cf400700 1 --2- 172.21.15.72:0/2543931459 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa3bc06c680 0x7fa3bc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:56.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.364+0000 7fa3cf400700 1 -- 172.21.15.72:0/2543931459 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fa3c408b900 con 0x7fa3d8107a60 2024-03-19T06:03:56.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.364+0000 7fa3d6a00700 1 --2- 172.21.15.72:0/2543931459 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa3bc06c680 0x7fa3bc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:56.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.365+0000 7fa3d6a00700 1 --2- 172.21.15.72:0/2543931459 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa3bc06c680 0x7fa3bc06eb30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8000c00 tx=0x7fa3c8005fb0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:56.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.370+0000 7fa3cf400700 1 -- 172.21.15.72:0/2543931459 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa3c4059af0 con 0x7fa3d8107a60 2024-03-19T06:03:56.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.696+0000 7fa3ddc00700 1 -- 172.21.15.72:0/2543931459 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3d810c3b0 con 0x7fa3bc06c680 2024-03-19T06:03:56.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.698+0000 7fa3cf400700 1 -- 172.21.15.72:0/2543931459 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fa3d810c3b0 con 0x7fa3bc06c680 2024-03-19T06:03:56.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.702+0000 7fa3ddc00700 1 -- 172.21.15.72:0/2543931459 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa3bc06c680 msgr2=0x7fa3bc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:56.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.702+0000 7fa3ddc00700 1 --2- 172.21.15.72:0/2543931459 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa3bc06c680 0x7fa3bc06eb30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8000c00 tx=0x7fa3c8005fb0 comp rx=0 tx=0).stop 2024-03-19T06:03:56.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.702+0000 7fa3ddc00700 1 -- 172.21.15.72:0/2543931459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3d8107a60 msgr2=0x7fa3d819c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:56.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.702+0000 7fa3ddc00700 1 --2- 172.21.15.72:0/2543931459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3d8107a60 0x7fa3d819c620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400d900 tx=0x7fa3c400dcc0 comp rx=0 tx=0).stop 2024-03-19T06:03:56.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.702+0000 7fa3ddc00700 1 -- 172.21.15.72:0/2543931459 shutdown_connections 2024-03-19T06:03:56.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.702+0000 7fa3ddc00700 1 --2- 172.21.15.72:0/2543931459 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fa3bc06c680 0x7fa3bc06eb30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:56.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.702+0000 7fa3ddc00700 1 --2- 172.21.15.72:0/2543931459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3d8106860 0x7fa3d819c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:56.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.702+0000 7fa3ddc00700 1 --2- 172.21.15.72:0/2543931459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3d8107a60 0x7fa3d819c620 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:56.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.702+0000 7fa3ddc00700 1 -- 172.21.15.72:0/2543931459 >> 172.21.15.72:0/2543931459 conn(0x7fa3d8069b40 msgr2=0x7fa3d810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:56.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.702+0000 7fa3ddc00700 1 -- 172.21.15.72:0/2543931459 shutdown_connections 2024-03-19T06:03:56.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.702+0000 7fa3ddc00700 1 -- 172.21.15.72:0/2543931459 wait complete. 2024-03-19T06:03:56.710 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:03:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.892+0000 7f07e4a00700 1 -- 172.21.15.72:0/3425861045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e0069270 msgr2=0x7f07e0102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.892+0000 7f07e4a00700 1 --2- 172.21.15.72:0/3425861045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e0069270 0x7f07e0102dd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009910 tx=0x7f07d0009c20 comp rx=0 tx=0).stop 2024-03-19T06:03:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.893+0000 7f07e4a00700 1 -- 172.21.15.72:0/3425861045 shutdown_connections 2024-03-19T06:03:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.893+0000 7f07e4a00700 1 --2- 172.21.15.72:0/3425861045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e0103310 0x7f07e0105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.893+0000 7f07e4a00700 1 --2- 172.21.15.72:0/3425861045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e0069270 0x7f07e0102dd0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.893+0000 7f07e4a00700 1 -- 172.21.15.72:0/3425861045 >> 172.21.15.72:0/3425861045 conn(0x7f07e00fa780 msgr2=0x7f07e00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.894+0000 7f07e4a00700 1 -- 172.21.15.72:0/3425861045 shutdown_connections 2024-03-19T06:03:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.894+0000 7f07e4a00700 1 -- 172.21.15.72:0/3425861045 wait complete. 2024-03-19T06:03:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.895+0000 7f07e4a00700 1 Processor -- start 2024-03-19T06:03:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.895+0000 7f07e4a00700 1 -- start start 2024-03-19T06:03:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.896+0000 7f07e4a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e0103310 0x7f07e019c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.896+0000 7f07e4a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e019c650 0x7f07e01a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.896+0000 7f07e4a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e019cb50 con 0x7f07e0103310 2024-03-19T06:03:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.896+0000 7f07e4a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e019ccc0 con 0x7f07e019c650 2024-03-19T06:03:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.896+0000 7f07dde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e0103310 0x7f07e019c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.896+0000 7f07dde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e0103310 0x7f07e019c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55058/0 (socket says 172.21.15.72:55058) 2024-03-19T06:03:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.896+0000 7f07dde00700 1 -- 172.21.15.72:0/887771830 learned_addr learned my addr 172.21.15.72:0/887771830 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.896+0000 7f07dd400700 1 --2- 172.21.15.72:0/887771830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e019c650 0x7f07e01a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.896+0000 7f07dde00700 1 -- 172.21.15.72:0/887771830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e019c650 msgr2=0x7f07e01a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.896+0000 7f07dde00700 1 --2- 172.21.15.72:0/887771830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e019c650 0x7f07e01a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.896+0000 7f07dde00700 1 -- 172.21.15.72:0/887771830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00095f0 con 0x7f07e0103310 2024-03-19T06:03:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.897+0000 7f07dde00700 1 --2- 172.21.15.72:0/887771830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e0103310 0x7f07e019c110 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f07d000f690 tx=0x7f07d000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.898+0000 7f07d6a00700 1 -- 172.21.15.72:0/887771830 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07d001d070 con 0x7f07e0103310 2024-03-19T06:03:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.898+0000 7f07e4a00700 1 -- 172.21.15.72:0/887771830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e01a1c00 con 0x7f07e0103310 2024-03-19T06:03:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.898+0000 7f07d6a00700 1 -- 172.21.15.72:0/887771830 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f07d0005dc0 con 0x7f07e0103310 2024-03-19T06:03:56.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.898+0000 7f07d6a00700 1 -- 172.21.15.72:0/887771830 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07d0017630 con 0x7f07e0103310 2024-03-19T06:03:56.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.898+0000 7f07e4a00700 1 -- 172.21.15.72:0/887771830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e01a20c0 con 0x7f07e0103310 2024-03-19T06:03:56.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.900+0000 7f07e4a00700 1 -- 172.21.15.72:0/887771830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e0108cb0 con 0x7f07e0103310 2024-03-19T06:03:56.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.901+0000 7f07d6a00700 1 -- 172.21.15.72:0/887771830 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f07d0003910 con 0x7f07e0103310 2024-03-19T06:03:56.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.902+0000 7f07d6a00700 1 --2- 172.21.15.72:0/887771830 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f07c406c680 0x7f07c406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:56.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.902+0000 7f07d6a00700 1 -- 172.21.15.72:0/887771830 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f07d008cc10 con 0x7f07e0103310 2024-03-19T06:03:56.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.902+0000 7f07dd400700 1 --2- 172.21.15.72:0/887771830 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f07c406c680 0x7f07c406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:56.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.903+0000 7f07dd400700 1 --2- 172.21.15.72:0/887771830 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f07c406c680 0x7f07c406eb30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009c60 tx=0x7f07cc009260 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:56.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:56.908+0000 7f07d6a00700 1 -- 172.21.15.72:0/887771830 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f07d005ad60 con 0x7f07e0103310 2024-03-19T06:03:57.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.222+0000 7f07e4a00700 1 -- 172.21.15.72:0/887771830 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07e00694e0 con 0x7f07c406c680 2024-03-19T06:03:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.223+0000 7f07d6a00700 1 -- 172.21.15.72:0/887771830 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f07e00694e0 con 0x7f07c406c680 2024-03-19T06:03:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.227+0000 7f07e4a00700 1 -- 172.21.15.72:0/887771830 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f07c406c680 msgr2=0x7f07c406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.227+0000 7f07e4a00700 1 --2- 172.21.15.72:0/887771830 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f07c406c680 0x7f07c406eb30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009c60 tx=0x7f07cc009260 comp rx=0 tx=0).stop 2024-03-19T06:03:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.227+0000 7f07e4a00700 1 -- 172.21.15.72:0/887771830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e0103310 msgr2=0x7f07e019c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.227+0000 7f07e4a00700 1 --2- 172.21.15.72:0/887771830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e0103310 0x7f07e019c110 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f07d000f690 tx=0x7f07d000f6c0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.227+0000 7f07e4a00700 1 -- 172.21.15.72:0/887771830 shutdown_connections 2024-03-19T06:03:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.227+0000 7f07e4a00700 1 --2- 172.21.15.72:0/887771830 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f07c406c680 0x7f07c406eb30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.227+0000 7f07e4a00700 1 --2- 172.21.15.72:0/887771830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e0103310 0x7f07e019c110 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.227+0000 7f07e4a00700 1 --2- 172.21.15.72:0/887771830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e019c650 0x7f07e01a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.227+0000 7f07e4a00700 1 -- 172.21.15.72:0/887771830 >> 172.21.15.72:0/887771830 conn(0x7f07e00fa780 msgr2=0x7f07e00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:57.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.227+0000 7f07e4a00700 1 -- 172.21.15.72:0/887771830 shutdown_connections 2024-03-19T06:03:57.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.227+0000 7f07e4a00700 1 -- 172.21.15.72:0/887771830 wait complete. 2024-03-19T06:03:57.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.419+0000 7f847aa00700 1 -- 172.21.15.72:0/2770285575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8474103310 msgr2=0x7f8474105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:57.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.419+0000 7f847aa00700 1 --2- 172.21.15.72:0/2770285575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8474103310 0x7f8474105790 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8460009910 tx=0x7f8460009c20 comp rx=0 tx=0).stop 2024-03-19T06:03:57.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.419+0000 7f847aa00700 1 -- 172.21.15.72:0/2770285575 shutdown_connections 2024-03-19T06:03:57.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.419+0000 7f847aa00700 1 --2- 172.21.15.72:0/2770285575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8474103310 0x7f8474105790 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.419+0000 7f847aa00700 1 --2- 172.21.15.72:0/2770285575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474069270 0x7f8474102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.419+0000 7f847aa00700 1 -- 172.21.15.72:0/2770285575 >> 172.21.15.72:0/2770285575 conn(0x7f84740fa780 msgr2=0x7f84740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:57.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.419+0000 7f847aa00700 1 -- 172.21.15.72:0/2770285575 shutdown_connections 2024-03-19T06:03:57.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.419+0000 7f847aa00700 1 -- 172.21.15.72:0/2770285575 wait complete. 2024-03-19T06:03:57.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.421+0000 7f847aa00700 1 Processor -- start 2024-03-19T06:03:57.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.421+0000 7f847aa00700 1 -- start start 2024-03-19T06:03:57.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.421+0000 7f847aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474103310 0x7f8474197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:57.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.422+0000 7f847aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84741981e0 0x7f847419d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:57.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.422+0000 7f847aa00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8474198680 con 0x7f84741981e0 2024-03-19T06:03:57.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.422+0000 7f847aa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84741987f0 con 0x7f8474103310 2024-03-19T06:03:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.422+0000 7f8473e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474103310 0x7f8474197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.422+0000 7f8473400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84741981e0 0x7f847419d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.422+0000 7f8473e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474103310 0x7f8474197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:47918/0 (socket says 172.21.15.72:47918) 2024-03-19T06:03:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.422+0000 7f8473e00700 1 -- 172.21.15.72:0/340310323 learned_addr learned my addr 172.21.15.72:0/340310323 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.423+0000 7f8473400700 1 -- 172.21.15.72:0/340310323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474103310 msgr2=0x7f8474197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.423+0000 7f8473400700 1 --2- 172.21.15.72:0/340310323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474103310 0x7f8474197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.423+0000 7f8473400700 1 -- 172.21.15.72:0/340310323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84600095f0 con 0x7f84741981e0 2024-03-19T06:03:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.423+0000 7f8473e00700 1 --2- 172.21.15.72:0/340310323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474103310 0x7f8474197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:03:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.423+0000 7f8473400700 1 --2- 172.21.15.72:0/340310323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84741981e0 0x7f847419d240 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8460005b40 tx=0x7f846000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.423+0000 7f8470c00700 1 -- 172.21.15.72:0/340310323 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f846001d070 con 0x7f84741981e0 2024-03-19T06:03:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.423+0000 7f847aa00700 1 -- 172.21.15.72:0/340310323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847419d780 con 0x7f84741981e0 2024-03-19T06:03:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.424+0000 7f847aa00700 1 -- 172.21.15.72:0/340310323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847419dc40 con 0x7f84741981e0 2024-03-19T06:03:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.424+0000 7f8470c00700 1 -- 172.21.15.72:0/340310323 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8460005dc0 con 0x7f84741981e0 2024-03-19T06:03:57.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.424+0000 7f8470c00700 1 -- 172.21.15.72:0/340310323 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8460022470 con 0x7f84741981e0 2024-03-19T06:03:57.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.425+0000 7f847aa00700 1 -- 172.21.15.72:0/340310323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8454005320 con 0x7f84741981e0 2024-03-19T06:03:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.426+0000 7f8470c00700 1 -- 172.21.15.72:0/340310323 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f84600050d0 con 0x7f84741981e0 2024-03-19T06:03:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.427+0000 7f8470c00700 1 --2- 172.21.15.72:0/340310323 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f845806c6d0 0x7f845806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.427+0000 7f8470c00700 1 -- 172.21.15.72:0/340310323 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f846008cc30 con 0x7f84741981e0 2024-03-19T06:03:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.428+0000 7f8473e00700 1 --2- 172.21.15.72:0/340310323 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f845806c6d0 0x7f845806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:57.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.429+0000 7f8473e00700 1 --2- 172.21.15.72:0/340310323 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f845806c6d0 0x7f845806eb80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8474198b80 tx=0x7f8464009260 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.433+0000 7f8470c00700 1 -- 172.21.15.72:0/340310323 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f84600572f0 con 0x7f84741981e0 2024-03-19T06:03:57.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.758+0000 7f847aa00700 1 -- 172.21.15.72:0/340310323 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8454000bf0 con 0x7f845806c6d0 2024-03-19T06:03:57.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.772+0000 7f8470c00700 1 -- 172.21.15.72:0/340310323 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f8454000bf0 con 0x7f845806c6d0 2024-03-19T06:03:57.764 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:03:57.764 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (8m) 2m ago 10m 13.7M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:03:57.764 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (10m) 2m ago 10m 7545k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:03:57.764 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (9m) 0s ago 9m 7596k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:03:57.764 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (10m) 2m ago 10m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:03:57.764 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (9m) 0s ago 9m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:03:57.764 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (8m) 2m ago 10m 72.8M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:03:57.764 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (2m) 2m ago 2m 11.7M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:03:57.764 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (3m) 2m ago 2m 14.9M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (2m) 0s ago 2m 12.8M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (2m) 0s ago 2m 33.7M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:9283,8765,8443 running (12m) 2m ago 12m 488M - 18.2.0 dc2bc1663786 af0e8bfc899d 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (5s) 0s ago 8m 56.6M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 1aabb23d2304 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (12m) 2m ago 12m 44.9M 2048M 18.2.0 dc2bc1663786 77289e9e2b33 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (8m) 0s ago 8m 34.5M 2048M 18.2.0 dc2bc1663786 31fba31e7d8a 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (10m) 2m ago 10m 7810k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (9m) 0s ago 9m 7964k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (7m) 2m ago 7m 47.1M 3947M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (7m) 2m ago 7m 47.5M 3947M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (6m) 2m ago 6m 46.5M 3947M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (6m) 0s ago 6m 64.0M 4971M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (5m) 0s ago 5m 59.8M 4971M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:03:57.765 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (4m) 0s ago 4m 57.9M 4971M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:03:57.766 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (8m) 2m ago 9m 53.1M - 2.43.0 a07b618ecd1d ea7a91af5b4a 2024-03-19T06:03:57.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.774+0000 7f847aa00700 1 -- 172.21.15.72:0/340310323 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f845806c6d0 msgr2=0x7f845806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:57.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.774+0000 7f847aa00700 1 --2- 172.21.15.72:0/340310323 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f845806c6d0 0x7f845806eb80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8474198b80 tx=0x7f8464009260 comp rx=0 tx=0).stop 2024-03-19T06:03:57.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.774+0000 7f847aa00700 1 -- 172.21.15.72:0/340310323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84741981e0 msgr2=0x7f847419d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:57.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.774+0000 7f847aa00700 1 --2- 172.21.15.72:0/340310323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84741981e0 0x7f847419d240 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8460005b40 tx=0x7f846000fa00 comp rx=0 tx=0).stop 2024-03-19T06:03:57.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.775+0000 7f847aa00700 1 -- 172.21.15.72:0/340310323 shutdown_connections 2024-03-19T06:03:57.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.775+0000 7f847aa00700 1 --2- 172.21.15.72:0/340310323 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f845806c6d0 0x7f845806eb80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.775+0000 7f847aa00700 1 --2- 172.21.15.72:0/340310323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474103310 0x7f8474197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.775+0000 7f847aa00700 1 --2- 172.21.15.72:0/340310323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84741981e0 0x7f847419d240 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.775+0000 7f847aa00700 1 -- 172.21.15.72:0/340310323 >> 172.21.15.72:0/340310323 conn(0x7f84740fa780 msgr2=0x7f8474100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:57.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.775+0000 7f847aa00700 1 -- 172.21.15.72:0/340310323 shutdown_connections 2024-03-19T06:03:57.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.775+0000 7f847aa00700 1 -- 172.21.15.72:0/340310323 wait complete. 2024-03-19T06:03:57.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.945+0000 7f1dc2e00700 1 -- 172.21.15.72:0/257417083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dbc103640 msgr2=0x7f1dbc103a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:57.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.945+0000 7f1dc2e00700 1 --2- 172.21.15.72:0/257417083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dbc103640 0x7f1dbc103a90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009910 tx=0x7f1da4009c20 comp rx=0 tx=0).stop 2024-03-19T06:03:57.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.946+0000 7f1dc2e00700 1 -- 172.21.15.72:0/257417083 shutdown_connections 2024-03-19T06:03:57.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.946+0000 7f1dc2e00700 1 --2- 172.21.15.72:0/257417083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dbc103640 0x7f1dbc103a90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.946+0000 7f1dc2e00700 1 --2- 172.21.15.72:0/257417083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc102490 0x7f1dbc1028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.946+0000 7f1dc2e00700 1 -- 172.21.15.72:0/257417083 >> 172.21.15.72:0/257417083 conn(0x7f1dbc0fda60 msgr2=0x7f1dbc0ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:57.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.946+0000 7f1dc2e00700 1 -- 172.21.15.72:0/257417083 shutdown_connections 2024-03-19T06:03:57.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.946+0000 7f1dc2e00700 1 -- 172.21.15.72:0/257417083 wait complete. 2024-03-19T06:03:57.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.948+0000 7f1dc2e00700 1 Processor -- start 2024-03-19T06:03:57.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.948+0000 7f1dc2e00700 1 -- start start 2024-03-19T06:03:57.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.948+0000 7f1dc2e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc102490 0x7f1dbc197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:57.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.948+0000 7f1dc2e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dbc103640 0x7f1dbc1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:57.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.948+0000 7f1dc2e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc1987f0 con 0x7f1dbc103640 2024-03-19T06:03:57.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.948+0000 7f1dc2e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc198960 con 0x7f1dbc102490 2024-03-19T06:03:57.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.949+0000 7f1dbbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc102490 0x7f1dbc197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:57.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.949+0000 7f1db3400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dbc103640 0x7f1dbc1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:57.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.949+0000 7f1dbbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc102490 0x7f1dbc197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:47936/0 (socket says 172.21.15.72:47936) 2024-03-19T06:03:57.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.949+0000 7f1dbbe00700 1 -- 172.21.15.72:0/2969255616 learned_addr learned my addr 172.21.15.72:0/2969255616 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:57.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.950+0000 7f1dbbe00700 1 -- 172.21.15.72:0/2969255616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dbc103640 msgr2=0x7f1dbc1981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:57.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.950+0000 7f1dbbe00700 1 --2- 172.21.15.72:0/2969255616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dbc103640 0x7f1dbc1981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:57.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.950+0000 7f1dbbe00700 1 -- 172.21.15.72:0/2969255616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40095f0 con 0x7f1dbc102490 2024-03-19T06:03:57.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.950+0000 7f1dbbe00700 1 --2- 172.21.15.72:0/2969255616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc102490 0x7f1dbc197cb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00d900 tx=0x7f1dac00dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:57.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.950+0000 7f1db9600700 1 -- 172.21.15.72:0/2969255616 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dac0041f0 con 0x7f1dbc102490 2024-03-19T06:03:57.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.950+0000 7f1db9600700 1 -- 172.21.15.72:0/2969255616 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1dac004350 con 0x7f1dbc102490 2024-03-19T06:03:57.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.950+0000 7f1db9600700 1 -- 172.21.15.72:0/2969255616 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dac003d20 con 0x7f1dbc102490 2024-03-19T06:03:57.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.951+0000 7f1dc2e00700 1 -- 172.21.15.72:0/2969255616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dbc19d3f0 con 0x7f1dbc102490 2024-03-19T06:03:57.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.951+0000 7f1dc2e00700 1 -- 172.21.15.72:0/2969255616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dbc19d8f0 con 0x7f1dbc102490 2024-03-19T06:03:57.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.952+0000 7f1dc2e00700 1 -- 172.21.15.72:0/2969255616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dbc10af90 con 0x7f1dbc102490 2024-03-19T06:03:57.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.954+0000 7f1db9600700 1 -- 172.21.15.72:0/2969255616 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f1dac009730 con 0x7f1dbc102490 2024-03-19T06:03:57.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.955+0000 7f1db9600700 1 --2- 172.21.15.72:0/2969255616 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1da006c680 0x7f1da006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:57.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.955+0000 7f1db9600700 1 -- 172.21.15.72:0/2969255616 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f1dac08bbb0 con 0x7f1dbc102490 2024-03-19T06:03:57.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.956+0000 7f1db3400700 1 --2- 172.21.15.72:0/2969255616 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1da006c680 0x7f1da006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:57.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.956+0000 7f1db3400700 1 --2- 172.21.15.72:0/2969255616 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1da006c680 0x7f1da006eb30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc1991c0 tx=0x7f1da400b560 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:57.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:57.962+0000 7f1db9600700 1 -- 172.21.15.72:0/2969255616 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1dac0562f0 con 0x7f1dbc102490 2024-03-19T06:03:58.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:58 smithi172 ceph-mon[35716]: pgmap v316: 65 pgs: 65 active+clean; 51 MiB data, 333 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 69 op/s 2024-03-19T06:03:58.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:58 smithi172 ceph-mon[35716]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:58.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:58 smithi172 ceph-mon[35716]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:58.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:58 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:58.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:58 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:58.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.416+0000 7f1dc2e00700 1 -- 172.21.15.72:0/2969255616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1dbc19e410 con 0x7f1dbc102490 2024-03-19T06:03:58.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.416+0000 7f1db9600700 1 -- 172.21.15.72:0/2969255616 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f1dac003e80 con 0x7f1dbc102490 2024-03-19T06:03:58.409 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:03:58.409 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:03:58.409 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:03:58.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:03:58.409 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:03:58.409 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:03:58.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:03:58.409 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:03:58.410 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:03:58.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:03:58.410 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:03:58.410 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:03:58.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:03:58.410 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:03:58.410 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-03-19T06:03:58.410 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:03:58.410 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:03:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.420+0000 7f1dc2e00700 1 -- 172.21.15.72:0/2969255616 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1da006c680 msgr2=0x7f1da006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.420+0000 7f1dc2e00700 1 --2- 172.21.15.72:0/2969255616 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1da006c680 0x7f1da006eb30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc1991c0 tx=0x7f1da400b560 comp rx=0 tx=0).stop 2024-03-19T06:03:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.420+0000 7f1dc2e00700 1 -- 172.21.15.72:0/2969255616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc102490 msgr2=0x7f1dbc197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.420+0000 7f1dc2e00700 1 --2- 172.21.15.72:0/2969255616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc102490 0x7f1dbc197cb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00d900 tx=0x7f1dac00dc10 comp rx=0 tx=0).stop 2024-03-19T06:03:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.420+0000 7f1dc2e00700 1 -- 172.21.15.72:0/2969255616 shutdown_connections 2024-03-19T06:03:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.420+0000 7f1dc2e00700 1 --2- 172.21.15.72:0/2969255616 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7f1da006c680 0x7f1da006eb30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.420+0000 7f1dc2e00700 1 --2- 172.21.15.72:0/2969255616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc102490 0x7f1dbc197cb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.420+0000 7f1dc2e00700 1 --2- 172.21.15.72:0/2969255616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dbc103640 0x7f1dbc1981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:58.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.420+0000 7f1dc2e00700 1 -- 172.21.15.72:0/2969255616 >> 172.21.15.72:0/2969255616 conn(0x7f1dbc0fda60 msgr2=0x7f1dbc106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:58.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.421+0000 7f1dc2e00700 1 -- 172.21.15.72:0/2969255616 shutdown_connections 2024-03-19T06:03:58.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.421+0000 7f1dc2e00700 1 -- 172.21.15.72:0/2969255616 wait complete. 2024-03-19T06:03:58.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:58 smithi072 ceph-mon[28706]: pgmap v316: 65 pgs: 65 active+clean; 51 MiB data, 333 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 69 op/s 2024-03-19T06:03:58.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:58 smithi072 ceph-mon[28706]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:58.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:58 smithi072 ceph-mon[28706]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:58.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:58 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:58.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:58 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.616+0000 7fc6ed400700 1 -- 172.21.15.72:0/593643216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e8101440 msgr2=0x7fc6e8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.616+0000 7fc6ed400700 1 --2- 172.21.15.72:0/593643216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e8101440 0x7fc6e8101890 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009910 tx=0x7fc6d4009c20 comp rx=0 tx=0).stop 2024-03-19T06:03:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.617+0000 7fc6ed400700 1 -- 172.21.15.72:0/593643216 shutdown_connections 2024-03-19T06:03:58.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.617+0000 7fc6ed400700 1 --2- 172.21.15.72:0/593643216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e8101440 0x7fc6e8101890 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:58.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.617+0000 7fc6ed400700 1 --2- 172.21.15.72:0/593643216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6e8100240 0x7fc6e8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:58.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.617+0000 7fc6ed400700 1 -- 172.21.15.72:0/593643216 >> 172.21.15.72:0/593643216 conn(0x7fc6e80fb7f0 msgr2=0x7fc6e80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:58.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.617+0000 7fc6ed400700 1 -- 172.21.15.72:0/593643216 shutdown_connections 2024-03-19T06:03:58.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.617+0000 7fc6ed400700 1 -- 172.21.15.72:0/593643216 wait complete. 2024-03-19T06:03:58.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.618+0000 7fc6ed400700 1 Processor -- start 2024-03-19T06:03:58.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.619+0000 7fc6ed400700 1 -- start start 2024-03-19T06:03:58.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.619+0000 7fc6ed400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6e8100240 0x7fc6e8195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:58.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.619+0000 7fc6ed400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e8101440 0x7fc6e8195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:58.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.619+0000 7fc6ed400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8196610 con 0x7fc6e8101440 2024-03-19T06:03:58.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.619+0000 7fc6ed400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8196750 con 0x7fc6e8100240 2024-03-19T06:03:58.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.620+0000 7fc6e5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e8101440 0x7fc6e8195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:58.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.620+0000 7fc6e5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e8101440 0x7fc6e8195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55094/0 (socket says 172.21.15.72:55094) 2024-03-19T06:03:58.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.620+0000 7fc6e5e00700 1 -- 172.21.15.72:0/4114795991 learned_addr learned my addr 172.21.15.72:0/4114795991 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:58.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.620+0000 7fc6e6800700 1 --2- 172.21.15.72:0/4114795991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6e8100240 0x7fc6e8195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:58.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.620+0000 7fc6e5e00700 1 -- 172.21.15.72:0/4114795991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6e8100240 msgr2=0x7fc6e8195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:58.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.620+0000 7fc6e5e00700 1 --2- 172.21.15.72:0/4114795991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6e8100240 0x7fc6e8195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:58.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.620+0000 7fc6e5e00700 1 -- 172.21.15.72:0/4114795991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d40095f0 con 0x7fc6e8101440 2024-03-19T06:03:58.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.620+0000 7fc6e5e00700 1 --2- 172.21.15.72:0/4114795991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e8101440 0x7fc6e8195ff0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400b6a0 tx=0x7fc6d400bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:58.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.621+0000 7fc6df400700 1 -- 172.21.15.72:0/4114795991 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d401d070 con 0x7fc6e8101440 2024-03-19T06:03:58.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.621+0000 7fc6df400700 1 -- 172.21.15.72:0/4114795991 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc6d400f460 con 0x7fc6e8101440 2024-03-19T06:03:58.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.621+0000 7fc6df400700 1 -- 172.21.15.72:0/4114795991 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d4021620 con 0x7fc6e8101440 2024-03-19T06:03:58.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.621+0000 7fc6ed400700 1 -- 172.21.15.72:0/4114795991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e8072f80 con 0x7fc6e8101440 2024-03-19T06:03:58.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.621+0000 7fc6ed400700 1 -- 172.21.15.72:0/4114795991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e8073470 con 0x7fc6e8101440 2024-03-19T06:03:58.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.623+0000 7fc6ed400700 1 -- 172.21.15.72:0/4114795991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e8108d90 con 0x7fc6e8101440 2024-03-19T06:03:58.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.625+0000 7fc6df400700 1 -- 172.21.15.72:0/4114795991 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc6d400fa60 con 0x7fc6e8101440 2024-03-19T06:03:58.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.626+0000 7fc6df400700 1 --2- 172.21.15.72:0/4114795991 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc6cc06c7a0 0x7fc6cc06ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:58.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.626+0000 7fc6df400700 1 -- 172.21.15.72:0/4114795991 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc6d408ca50 con 0x7fc6e8101440 2024-03-19T06:03:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.628+0000 7fc6e6800700 1 --2- 172.21.15.72:0/4114795991 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc6cc06c7a0 0x7fc6cc06ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.629+0000 7fc6e6800700 1 --2- 172.21.15.72:0/4114795991 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc6cc06c7a0 0x7fc6cc06ec50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc6e81012a0 tx=0x7fc6d8009260 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:58.632+0000 7fc6df400700 1 -- 172.21.15.72:0/4114795991 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc6d405aba0 con 0x7fc6e8101440 2024-03-19T06:03:59.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.034+0000 7fc6ed400700 1 -- 172.21.15.72:0/4114795991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc6e8108f80 con 0x7fc6e8101440 2024-03-19T06:03:59.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.035+0000 7fc6df400700 1 -- 172.21.15.72:0/4114795991 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1848 (secure 0 0 0) 0x7fc6d4005c00 con 0x7fc6e8101440 2024-03-19T06:03:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-03-19T06:03:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:03:59.027 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:03:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:03:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:03:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:03:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:03:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-03-19T06:03:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:03:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:03:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:03:33.243075+0000 2024-03-19T06:03:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:03:59.028 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:03:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:03:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:03:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:03:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:03:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:03:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:03:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:03:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:03:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:03:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:03:59.029 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:03:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:03:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:03:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:03:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:03:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:03:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:03:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:03:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:03:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:03:59.030 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:03:59.030 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:03:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:03:59.031 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:03:59.031 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:03:59.031 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:03:59.031 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:03:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.039+0000 7fc6ed400700 1 -- 172.21.15.72:0/4114795991 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc6cc06c7a0 msgr2=0x7fc6cc06ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.039+0000 7fc6ed400700 1 --2- 172.21.15.72:0/4114795991 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc6cc06c7a0 0x7fc6cc06ec50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc6e81012a0 tx=0x7fc6d8009260 comp rx=0 tx=0).stop 2024-03-19T06:03:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.039+0000 7fc6ed400700 1 -- 172.21.15.72:0/4114795991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e8101440 msgr2=0x7fc6e8195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.039+0000 7fc6ed400700 1 --2- 172.21.15.72:0/4114795991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e8101440 0x7fc6e8195ff0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400b6a0 tx=0x7fc6d400bec0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.039+0000 7fc6ed400700 1 -- 172.21.15.72:0/4114795991 shutdown_connections 2024-03-19T06:03:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.039+0000 7fc6ed400700 1 --2- 172.21.15.72:0/4114795991 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fc6cc06c7a0 0x7fc6cc06ec50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.039+0000 7fc6ed400700 1 --2- 172.21.15.72:0/4114795991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6e8100240 0x7fc6e8195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.039+0000 7fc6ed400700 1 --2- 172.21.15.72:0/4114795991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e8101440 0x7fc6e8195ff0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.039+0000 7fc6ed400700 1 -- 172.21.15.72:0/4114795991 >> 172.21.15.72:0/4114795991 conn(0x7fc6e80fb7f0 msgr2=0x7fc6e8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.039+0000 7fc6ed400700 1 -- 172.21.15.72:0/4114795991 shutdown_connections 2024-03-19T06:03:59.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.039+0000 7fc6ed400700 1 -- 172.21.15.72:0/4114795991 wait complete. 2024-03-19T06:03:59.035 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-03-19T06:03:59.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.225+0000 7fd6ce400700 1 -- 172.21.15.72:0/3808307414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6c81012c0 msgr2=0x7fd6c8101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:59.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.225+0000 7fd6ce400700 1 --2- 172.21.15.72:0/3808307414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6c81012c0 0x7fd6c8101730 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009910 tx=0x7fd6b4009c20 comp rx=0 tx=0).stop 2024-03-19T06:03:59.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.225+0000 7fd6ce400700 1 -- 172.21.15.72:0/3808307414 shutdown_connections 2024-03-19T06:03:59.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.225+0000 7fd6ce400700 1 --2- 172.21.15.72:0/3808307414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6c81012c0 0x7fd6c8101730 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.225+0000 7fd6ce400700 1 --2- 172.21.15.72:0/3808307414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6c8100020 0x7fd6c8100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.225+0000 7fd6ce400700 1 -- 172.21.15.72:0/3808307414 >> 172.21.15.72:0/3808307414 conn(0x7fd6c80fb650 msgr2=0x7fd6c80fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:59.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.225+0000 7fd6ce400700 1 -- 172.21.15.72:0/3808307414 shutdown_connections 2024-03-19T06:03:59.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.225+0000 7fd6ce400700 1 -- 172.21.15.72:0/3808307414 wait complete. 2024-03-19T06:03:59.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.226+0000 7fd6ce400700 1 Processor -- start 2024-03-19T06:03:59.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.227+0000 7fd6ce400700 1 -- start start 2024-03-19T06:03:59.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.227+0000 7fd6ce400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6c8100020 0x7fd6c8197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:59.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.227+0000 7fd6ce400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6c81012c0 0x7fd6c8197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:59.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.227+0000 7fd6ce400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c8198560 con 0x7fd6c8100020 2024-03-19T06:03:59.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.227+0000 7fd6ce400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c81986a0 con 0x7fd6c81012c0 2024-03-19T06:03:59.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.227+0000 7fd6cd000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6c8100020 0x7fd6c8197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:59.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.227+0000 7fd6cd000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6c8100020 0x7fd6c8197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55112/0 (socket says 172.21.15.72:55112) 2024-03-19T06:03:59.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.227+0000 7fd6cd000700 1 -- 172.21.15.72:0/1086497728 learned_addr learned my addr 172.21.15.72:0/1086497728 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:59.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.228+0000 7fd6c7e00700 1 --2- 172.21.15.72:0/1086497728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6c81012c0 0x7fd6c8197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:59.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.228+0000 7fd6cd000700 1 -- 172.21.15.72:0/1086497728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6c81012c0 msgr2=0x7fd6c8197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:59.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.228+0000 7fd6cd000700 1 --2- 172.21.15.72:0/1086497728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6c81012c0 0x7fd6c8197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.228+0000 7fd6cd000700 1 -- 172.21.15.72:0/1086497728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b40095f0 con 0x7fd6c8100020 2024-03-19T06:03:59.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.228+0000 7fd6cd000700 1 --2- 172.21.15.72:0/1086497728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6c8100020 0x7fd6c8197a00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00d8d0 tx=0x7fd6bc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.228+0000 7fd6c5600700 1 -- 172.21.15.72:0/1086497728 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6bc0098a0 con 0x7fd6c8100020 2024-03-19T06:03:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.229+0000 7fd6c5600700 1 -- 172.21.15.72:0/1086497728 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd6bc010460 con 0x7fd6c8100020 2024-03-19T06:03:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.229+0000 7fd6ce400700 1 -- 172.21.15.72:0/1086497728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c819d150 con 0x7fd6c8100020 2024-03-19T06:03:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.229+0000 7fd6ce400700 1 -- 172.21.15.72:0/1086497728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c819d6a0 con 0x7fd6c8100020 2024-03-19T06:03:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.229+0000 7fd6c5600700 1 -- 172.21.15.72:0/1086497728 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6bc00f5f0 con 0x7fd6c8100020 2024-03-19T06:03:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.230+0000 7fd6ce400700 1 -- 172.21.15.72:0/1086497728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a8005320 con 0x7fd6c8100020 2024-03-19T06:03:59.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.231+0000 7fd6c5600700 1 -- 172.21.15.72:0/1086497728 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd6bc00f750 con 0x7fd6c8100020 2024-03-19T06:03:59.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.232+0000 7fd6c5600700 1 --2- 172.21.15.72:0/1086497728 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd6b006c680 0x7fd6b006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:59.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.233+0000 7fd6c7e00700 1 --2- 172.21.15.72:0/1086497728 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd6b006c680 0x7fd6b006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:59.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.233+0000 7fd6c7e00700 1 --2- 172.21.15.72:0/1086497728 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd6b006c680 0x7fd6b006eb30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4006010 tx=0x7fd6b400b560 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:59.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.235+0000 7fd6c5600700 1 -- 172.21.15.72:0/1086497728 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd6bc059b00 con 0x7fd6c8100020 2024-03-19T06:03:59.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.237+0000 7fd6c5600700 1 -- 172.21.15.72:0/1086497728 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd6bc0598d0 con 0x7fd6c8100020 2024-03-19T06:03:59.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:59 smithi072 ceph-mon[28706]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:59.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:59 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2969255616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:03:59.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:59.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:59 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:59.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:03:59 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/4114795991' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:03:59.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:59 smithi172 ceph-mon[35716]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:03:59.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:59 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2969255616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:03:59.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:59.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:59 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:03:59.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:03:59 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/4114795991' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:03:59.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.553+0000 7fd6ce400700 1 -- 172.21.15.72:0/1086497728 --> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6a8000bf0 con 0x7fd6b006c680 2024-03-19T06:03:59.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.555+0000 7fd6c5600700 1 -- 172.21.15.72:0/1086497728 <== mgr.14219 v2:172.21.15.72:6800/1154232723 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fd6a8000bf0 con 0x7fd6b006c680 2024-03-19T06:03:59.546 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:03:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:03:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:03:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:03:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-03-19T06:03:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "1/23 daemons upgraded", 2024-03-19T06:03:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mgr daemons", 2024-03-19T06:03:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:03:59.547 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:03:59.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.558+0000 7fd6ce400700 1 -- 172.21.15.72:0/1086497728 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd6b006c680 msgr2=0x7fd6b006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:59.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.558+0000 7fd6ce400700 1 --2- 172.21.15.72:0/1086497728 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd6b006c680 0x7fd6b006eb30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4006010 tx=0x7fd6b400b560 comp rx=0 tx=0).stop 2024-03-19T06:03:59.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.558+0000 7fd6ce400700 1 -- 172.21.15.72:0/1086497728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6c8100020 msgr2=0x7fd6c8197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:59.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.558+0000 7fd6ce400700 1 --2- 172.21.15.72:0/1086497728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6c8100020 0x7fd6c8197a00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00d8d0 tx=0x7fd6bc00dbe0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.558+0000 7fd6ce400700 1 -- 172.21.15.72:0/1086497728 shutdown_connections 2024-03-19T06:03:59.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.558+0000 7fd6ce400700 1 --2- 172.21.15.72:0/1086497728 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fd6b006c680 0x7fd6b006eb30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.558+0000 7fd6ce400700 1 --2- 172.21.15.72:0/1086497728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6c8100020 0x7fd6c8197a00 secure :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00d8d0 tx=0x7fd6bc00dbe0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.558+0000 7fd6ce400700 1 --2- 172.21.15.72:0/1086497728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6c81012c0 0x7fd6c8197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.558+0000 7fd6ce400700 1 -- 172.21.15.72:0/1086497728 >> 172.21.15.72:0/1086497728 conn(0x7fd6c80fb650 msgr2=0x7fd6c80fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:59.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.558+0000 7fd6ce400700 1 -- 172.21.15.72:0/1086497728 shutdown_connections 2024-03-19T06:03:59.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.558+0000 7fd6ce400700 1 -- 172.21.15.72:0/1086497728 wait complete. 2024-03-19T06:03:59.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.705+0000 7fdd1d800700 1 -- 172.21.15.72:0/460619723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18101440 msgr2=0x7fdd18101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:59.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.705+0000 7fdd1d800700 1 --2- 172.21.15.72:0/460619723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18101440 0x7fdd18101890 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009910 tx=0x7fdd04009c20 comp rx=0 tx=0).stop 2024-03-19T06:03:59.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.706+0000 7fdd1d800700 1 -- 172.21.15.72:0/460619723 shutdown_connections 2024-03-19T06:03:59.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.706+0000 7fdd1d800700 1 --2- 172.21.15.72:0/460619723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18101440 0x7fdd18101890 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.706+0000 7fdd1d800700 1 --2- 172.21.15.72:0/460619723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd18100240 0x7fdd18100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.706+0000 7fdd1d800700 1 -- 172.21.15.72:0/460619723 >> 172.21.15.72:0/460619723 conn(0x7fdd180fb7f0 msgr2=0x7fdd180fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:03:59.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.706+0000 7fdd1d800700 1 -- 172.21.15.72:0/460619723 shutdown_connections 2024-03-19T06:03:59.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.706+0000 7fdd1d800700 1 -- 172.21.15.72:0/460619723 wait complete. 2024-03-19T06:03:59.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.707+0000 7fdd1d800700 1 Processor -- start 2024-03-19T06:03:59.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.707+0000 7fdd1d800700 1 -- start start 2024-03-19T06:03:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.707+0000 7fdd1d800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18100240 0x7fdd18074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.707+0000 7fdd1d800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd18101440 0x7fdd18073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.707+0000 7fdd1d800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18073680 con 0x7fdd18100240 2024-03-19T06:03:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.707+0000 7fdd1d800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180737c0 con 0x7fdd18101440 2024-03-19T06:03:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.708+0000 7fdd16a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18100240 0x7fdd18074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.708+0000 7fdd16a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18100240 0x7fdd18074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55142/0 (socket says 172.21.15.72:55142) 2024-03-19T06:03:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.708+0000 7fdd16a00700 1 -- 172.21.15.72:0/3116421045 learned_addr learned my addr 172.21.15.72:0/3116421045 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:03:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.708+0000 7fdd16000700 1 --2- 172.21.15.72:0/3116421045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd18101440 0x7fdd18073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.708+0000 7fdd16a00700 1 -- 172.21.15.72:0/3116421045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd18101440 msgr2=0x7fdd18073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:03:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.708+0000 7fdd16a00700 1 --2- 172.21.15.72:0/3116421045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd18101440 0x7fdd18073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:03:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.708+0000 7fdd16a00700 1 -- 172.21.15.72:0/3116421045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd040095f0 con 0x7fdd18100240 2024-03-19T06:03:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.709+0000 7fdd16a00700 1 --2- 172.21.15.72:0/3116421045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18100240 0x7fdd18074af0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800e8f0 tx=0x7fdd0800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.709+0000 7fdd0f400700 1 -- 172.21.15.72:0/3116421045 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd08009790 con 0x7fdd18100240 2024-03-19T06:03:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.709+0000 7fdd0f400700 1 -- 172.21.15.72:0/3116421045 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdd0800c810 con 0x7fdd18100240 2024-03-19T06:03:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.709+0000 7fdd1d800700 1 -- 172.21.15.72:0/3116421045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd18073aa0 con 0x7fdd18100240 2024-03-19T06:03:59.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.709+0000 7fdd0f400700 1 -- 172.21.15.72:0/3116421045 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd08003d20 con 0x7fdd18100240 2024-03-19T06:03:59.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.709+0000 7fdd1d800700 1 -- 172.21.15.72:0/3116421045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1819db10 con 0x7fdd18100240 2024-03-19T06:03:59.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.710+0000 7fdd1d800700 1 -- 172.21.15.72:0/3116421045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd18108d90 con 0x7fdd18100240 2024-03-19T06:03:59.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.712+0000 7fdd0f400700 1 -- 172.21.15.72:0/3116421045 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdd080041f0 con 0x7fdd18100240 2024-03-19T06:03:59.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.713+0000 7fdd0f400700 1 --2- 172.21.15.72:0/3116421045 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fdcfc06c680 0x7fdcfc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:03:59.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.713+0000 7fdd0f400700 1 -- 172.21.15.72:0/3116421045 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fdd08014070 con 0x7fdd18100240 2024-03-19T06:03:59.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.713+0000 7fdd16000700 1 --2- 172.21.15.72:0/3116421045 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fdcfc06c680 0x7fdcfc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:03:59.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.714+0000 7fdd16000700 1 --2- 172.21.15.72:0/3116421045 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fdcfc06c680 0x7fdcfc06eb30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009fd0 tx=0x7fdd04005fd0 comp rx=0 tx=0).ready entity=mgr.14219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:03:59.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:03:59.718+0000 7fdd0f400700 1 -- 172.21.15.72:0/3116421045 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdd08059e00 con 0x7fdd18100240 2024-03-19T06:04:00.079 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:04:00.079 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:04:00.079 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:04:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.086+0000 7fdd1d800700 1 -- 172.21.15.72:0/3116421045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdd18108f80 con 0x7fdd18100240 2024-03-19T06:04:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.086+0000 7fdd0f400700 1 -- 172.21.15.72:0/3116421045 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fdd08059990 con 0x7fdd18100240 2024-03-19T06:04:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.091+0000 7fdd1d800700 1 -- 172.21.15.72:0/3116421045 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fdcfc06c680 msgr2=0x7fdcfc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.091+0000 7fdd1d800700 1 --2- 172.21.15.72:0/3116421045 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fdcfc06c680 0x7fdcfc06eb30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009fd0 tx=0x7fdd04005fd0 comp rx=0 tx=0).stop 2024-03-19T06:04:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.091+0000 7fdd1d800700 1 -- 172.21.15.72:0/3116421045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18100240 msgr2=0x7fdd18074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.091+0000 7fdd1d800700 1 --2- 172.21.15.72:0/3116421045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18100240 0x7fdd18074af0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800e8f0 tx=0x7fdd0800ec00 comp rx=0 tx=0).stop 2024-03-19T06:04:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.091+0000 7fdd1d800700 1 -- 172.21.15.72:0/3116421045 shutdown_connections 2024-03-19T06:04:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.091+0000 7fdd1d800700 1 --2- 172.21.15.72:0/3116421045 >> [v2:172.21.15.72:6800/1154232723,v1:172.21.15.72:6801/1154232723] conn(0x7fdcfc06c680 0x7fdcfc06eb30 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009fd0 tx=0x7fdd04005fd0 comp rx=0 tx=0).stop 2024-03-19T06:04:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.091+0000 7fdd1d800700 1 --2- 172.21.15.72:0/3116421045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18100240 0x7fdd18074af0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.091+0000 7fdd1d800700 1 --2- 172.21.15.72:0/3116421045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd18101440 0x7fdd18073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.091+0000 7fdd1d800700 1 -- 172.21.15.72:0/3116421045 >> 172.21.15.72:0/3116421045 conn(0x7fdd180fb7f0 msgr2=0x7fdd18104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.092+0000 7fdd1d800700 1 -- 172.21.15.72:0/3116421045 shutdown_connections 2024-03-19T06:04:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:00.092+0000 7fdd1d800700 1 -- 172.21.15.72:0/3116421045 wait complete. 2024-03-19T06:04:00.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:00 smithi172 ceph-mon[35716]: pgmap v317: 65 pgs: 65 active+clean; 53 MiB data, 347 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 67 op/s 2024-03-19T06:04:00.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:00 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3116421045' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:04:00.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:00 smithi072 ceph-mon[28706]: pgmap v317: 65 pgs: 65 active+clean; 53 MiB data, 347 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 67 op/s 2024-03-19T06:04:00.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:00 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3116421045' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:04:01.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:01 smithi072 ceph-mon[28706]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:04:01.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:01 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:04:01.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:01 smithi172 ceph-mon[35716]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:04:01.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:01 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:04:02.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:02 smithi172 ceph-mon[35716]: pgmap v318: 65 pgs: 65 active+clean; 59 MiB data, 356 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 71 op/s 2024-03-19T06:04:02.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:02 smithi072 ceph-mon[28706]: pgmap v318: 65 pgs: 65 active+clean; 59 MiB data, 356 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 71 op/s 2024-03-19T06:04:04.474 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: pgmap v319: 65 pgs: 65 active+clean; 68 MiB data, 396 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 97 op/s 2024-03-19T06:04:04.474 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: Standby manager daemon smithi172.qkcahs restarted 2024-03-19T06:04:04.474 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: Standby manager daemon smithi172.qkcahs started 2024-03-19T06:04:04.474 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/crt"}]: dispatch 2024-03-19T06:04:04.474 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T06:04:04.474 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/key"}]: dispatch 2024-03-19T06:04:04.474 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T06:04:04.474 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:04:04.474 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:04:04.474 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:04:04.475 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:04:04.475 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:04:04.475 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:04:04.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: pgmap v319: 65 pgs: 65 active+clean; 68 MiB data, 396 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 97 op/s 2024-03-19T06:04:04.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: Standby manager daemon smithi172.qkcahs restarted 2024-03-19T06:04:04.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: Standby manager daemon smithi172.qkcahs started 2024-03-19T06:04:04.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/crt"}]: dispatch 2024-03-19T06:04:04.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T06:04:04.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/key"}]: dispatch 2024-03-19T06:04:04.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T06:04:04.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:04:04.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr fail", "who": "smithi072.jydpjk"}]: dispatch 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: osdmap e46: 6 total, 6 up, 6 in 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "mgr fail", "who": "smithi072.jydpjk"}]': finished 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: mgrmap e20: smithi172.qkcahs(active, starting, since 0.015569s) 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:04:04.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.nparnw"}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mgr metadata", "who": "smithi172.qkcahs", "id": "smithi172.qkcahs"}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: Manager daemon smithi172.qkcahs is now available 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:04:04.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:04:04.598 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:04:04.598 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.qkcahs/mirror_snapshot_schedule"}]: dispatch 2024-03-19T06:04:04.598 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.qkcahs/mirror_snapshot_schedule"}]: dispatch 2024-03-19T06:04:04.598 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.qkcahs/trash_purge_schedule"}]: dispatch 2024-03-19T06:04:04.598 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:04 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.qkcahs/trash_purge_schedule"}]: dispatch 2024-03-19T06:04:04.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr fail", "who": "smithi072.jydpjk"}]: dispatch 2024-03-19T06:04:04.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: osdmap e46: 6 total, 6 up, 6 in 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.14219 172.21.15.72:0/29288268' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "mgr fail", "who": "smithi072.jydpjk"}]': finished 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: mgrmap e20: smithi172.qkcahs(active, starting, since 0.015569s) 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.nparnw"}]: dispatch 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mgr metadata", "who": "smithi172.qkcahs", "id": "smithi172.qkcahs"}]: dispatch 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T06:04:04.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T06:04:04.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-19T06:04:04.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-19T06:04:04.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-19T06:04:04.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: Manager daemon smithi172.qkcahs is now available 2024-03-19T06:04:04.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:04:04.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:04:04.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:04:04.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.qkcahs/mirror_snapshot_schedule"}]: dispatch 2024-03-19T06:04:04.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.qkcahs/mirror_snapshot_schedule"}]: dispatch 2024-03-19T06:04:04.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.qkcahs/trash_purge_schedule"}]: dispatch 2024-03-19T06:04:04.829 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:04 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.qkcahs/trash_purge_schedule"}]: dispatch 2024-03-19T06:04:06.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:05 smithi072 ceph-mon[28706]: Deploying cephadm binary to smithi172 2024-03-19T06:04:06.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:05 smithi072 ceph-mon[28706]: Deploying cephadm binary to smithi072 2024-03-19T06:04:06.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:05 smithi072 ceph-mon[28706]: [19/Mar/2024:06:04:04] ENGINE Bus STARTING 2024-03-19T06:04:06.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:05 smithi072 ceph-mon[28706]: mgrmap e21: smithi172.qkcahs(active, since 1.01577s) 2024-03-19T06:04:06.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:05 smithi072 ceph-mon[28706]: [19/Mar/2024:06:04:04] ENGINE Serving on http://172.21.15.172:8765 2024-03-19T06:04:06.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:05 smithi072 ceph-mon[28706]: pgmap v3: 65 pgs: 65 active+clean; 78 MiB data, 423 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:04:06.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:05 smithi072 ceph-mon[28706]: [19/Mar/2024:06:04:05] ENGINE Serving on https://172.21.15.172:7150 2024-03-19T06:04:06.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:05 smithi072 ceph-mon[28706]: [19/Mar/2024:06:04:05] ENGINE Bus STARTED 2024-03-19T06:04:06.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:05 smithi172 ceph-mon[35716]: Deploying cephadm binary to smithi172 2024-03-19T06:04:06.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:05 smithi172 ceph-mon[35716]: Deploying cephadm binary to smithi072 2024-03-19T06:04:06.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:05 smithi172 ceph-mon[35716]: [19/Mar/2024:06:04:04] ENGINE Bus STARTING 2024-03-19T06:04:06.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:05 smithi172 ceph-mon[35716]: mgrmap e21: smithi172.qkcahs(active, since 1.01577s) 2024-03-19T06:04:06.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:05 smithi172 ceph-mon[35716]: [19/Mar/2024:06:04:04] ENGINE Serving on http://172.21.15.172:8765 2024-03-19T06:04:06.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:05 smithi172 ceph-mon[35716]: pgmap v3: 65 pgs: 65 active+clean; 78 MiB data, 423 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:04:06.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:05 smithi172 ceph-mon[35716]: [19/Mar/2024:06:04:05] ENGINE Serving on https://172.21.15.172:7150 2024-03-19T06:04:06.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:05 smithi172 ceph-mon[35716]: [19/Mar/2024:06:04:05] ENGINE Bus STARTED 2024-03-19T06:04:07.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:06 smithi072 ceph-mon[28706]: pgmap v4: 65 pgs: 65 active+clean; 78 MiB data, 423 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:04:07.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:06 smithi172 ceph-mon[35716]: pgmap v4: 65 pgs: 65 active+clean; 78 MiB data, 423 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:04:07.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:06 smithi172 ceph-mon[35716]: mgrmap e22: smithi172.qkcahs(active, since 2s) 2024-03-19T06:04:07.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:07 smithi072 ceph-mon[28706]: mgrmap e22: smithi172.qkcahs(active, since 2s) 2024-03-19T06:04:09.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:08 smithi072 ceph-mon[28706]: pgmap v5: 65 pgs: 65 active+clean; 78 MiB data, 423 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:04:09.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:08 smithi072 ceph-mon[28706]: mgrmap e23: smithi172.qkcahs(active, since 4s) 2024-03-19T06:04:09.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:09 smithi172 ceph-mon[35716]: pgmap v5: 65 pgs: 65 active+clean; 78 MiB data, 423 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:04:09.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:09 smithi172 ceph-mon[35716]: mgrmap e23: smithi172.qkcahs(active, since 4s) 2024-03-19T06:04:11.299 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:11 smithi072 ceph-mon[28706]: pgmap v6: 65 pgs: 65 active+clean; 85 MiB data, 446 MiB used, 536 GiB / 536 GiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 69 op/s 2024-03-19T06:04:11.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:11 smithi172 ceph-mon[35716]: pgmap v6: 65 pgs: 65 active+clean; 85 MiB data, 446 MiB used, 536 GiB / 536 GiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 69 op/s 2024-03-19T06:04:13.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:13 smithi072 ceph-mon[28706]: pgmap v7: 65 pgs: 65 active+clean; 85 MiB data, 446 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 1003 KiB/s wr, 49 op/s 2024-03-19T06:04:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:13 smithi172 ceph-mon[35716]: pgmap v7: 65 pgs: 65 active+clean; 85 MiB data, 446 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 1003 KiB/s wr, 49 op/s 2024-03-19T06:04:15.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:15 smithi172 ceph-mon[35716]: pgmap v8: 65 pgs: 65 active+clean; 85 MiB data, 446 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 780 KiB/s wr, 38 op/s 2024-03-19T06:04:15.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:15 smithi172 ceph-mon[35716]: Standby manager daemon smithi072.jydpjk started 2024-03-19T06:04:15.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:15 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.72:0/2157909545' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.jydpjk/crt"}]: dispatch 2024-03-19T06:04:15.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:15 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.72:0/2157909545' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T06:04:15.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:15 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.72:0/2157909545' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.jydpjk/key"}]: dispatch 2024-03-19T06:04:15.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:15 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.72:0/2157909545' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T06:04:15.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:15 smithi072 ceph-mon[28706]: pgmap v8: 65 pgs: 65 active+clean; 85 MiB data, 446 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 780 KiB/s wr, 38 op/s 2024-03-19T06:04:15.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:15 smithi072 ceph-mon[28706]: Standby manager daemon smithi072.jydpjk started 2024-03-19T06:04:15.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:15 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.72:0/2157909545' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.jydpjk/crt"}]: dispatch 2024-03-19T06:04:15.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:15 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.72:0/2157909545' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T06:04:15.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:15 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.72:0/2157909545' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.jydpjk/key"}]: dispatch 2024-03-19T06:04:15.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:15 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.72:0/2157909545' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T06:04:16.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:16 smithi072 ceph-mon[28706]: mgrmap e24: smithi172.qkcahs(active, since 11s), standbys: smithi072.jydpjk 2024-03-19T06:04:16.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:16 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mgr metadata", "who": "smithi072.jydpjk", "id": "smithi072.jydpjk"}]: dispatch 2024-03-19T06:04:16.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:16 smithi172 ceph-mon[35716]: mgrmap e24: smithi172.qkcahs(active, since 11s), standbys: smithi072.jydpjk 2024-03-19T06:04:16.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:16 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mgr metadata", "who": "smithi072.jydpjk", "id": "smithi072.jydpjk"}]: dispatch 2024-03-19T06:04:18.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:17 smithi072 ceph-mon[28706]: pgmap v9: 65 pgs: 65 active+clean; 95 MiB data, 482 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 79 op/s 2024-03-19T06:04:18.077 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:17 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:18.077 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:17 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:18.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:17 smithi172 ceph-mon[35716]: pgmap v9: 65 pgs: 65 active+clean; 95 MiB data, 482 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 79 op/s 2024-03-19T06:04:18.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:17 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:18.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:17 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:19.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:19 smithi172 ceph-mon[35716]: pgmap v10: 65 pgs: 65 active+clean; 95 MiB data, 482 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 1.4 MiB/s wr, 72 op/s 2024-03-19T06:04:19.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:19 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:19.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:19 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:19.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:19 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:19.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:19 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:19.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:19 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:04:19.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:19 smithi072 ceph-mon[28706]: pgmap v10: 65 pgs: 65 active+clean; 95 MiB data, 482 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 1.4 MiB/s wr, 72 op/s 2024-03-19T06:04:19.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:19 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:19.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:19 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:19.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:19 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:19.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:19 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:19.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:19 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:04:21.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:21 smithi072 ceph-mon[28706]: pgmap v11: 65 pgs: 65 active+clean; 109 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 2.6 MiB/s wr, 128 op/s 2024-03-19T06:04:21.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:21 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:21.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:21 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:21.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:21 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:21.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:21 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:21.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:21 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:21.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:21 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:21.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:21 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:21.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:21 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:21.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:21 smithi072 ceph-mon[28706]: Adjusting osd_memory_target on smithi072 to 1216M 2024-03-19T06:04:21.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:21 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:21.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:21 smithi172 ceph-mon[35716]: pgmap v11: 65 pgs: 65 active+clean; 109 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 2.6 MiB/s wr, 128 op/s 2024-03-19T06:04:21.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:21 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:21.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:21 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:21.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:21 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:21.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:21 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:21.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:21 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:21.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:21 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:21.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:21 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:21.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:21 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:21.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:21 smithi172 ceph-mon[35716]: Adjusting osd_memory_target on smithi072 to 1216M 2024-03-19T06:04:21.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:21 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:23.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:23 smithi072 ceph-mon[28706]: pgmap v12: 65 pgs: 65 active+clean; 109 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 99 op/s 2024-03-19T06:04:23.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:23 smithi172 ceph-mon[35716]: pgmap v12: 65 pgs: 65 active+clean; 109 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 99 op/s 2024-03-19T06:04:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: pgmap v13: 65 pgs: 65 active+clean; 109 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 99 op/s 2024-03-19T06:04:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: Adjusting osd_memory_target on smithi172 to 2241M 2024-03-19T06:04:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:04:25.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:04:25.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: Updating smithi072:/etc/ceph/ceph.conf 2024-03-19T06:04:25.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:25 smithi072 ceph-mon[28706]: Updating smithi172:/etc/ceph/ceph.conf 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: pgmap v13: 65 pgs: 65 active+clean; 109 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 99 op/s 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: Adjusting osd_memory_target on smithi172 to 2241M 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:04:25.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:04:25.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: Updating smithi072:/etc/ceph/ceph.conf 2024-03-19T06:04:25.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:25 smithi172 ceph-mon[35716]: Updating smithi172:/etc/ceph/ceph.conf 2024-03-19T06:04:26.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:26 smithi072 ceph-mon[28706]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T06:04:26.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:26 smithi072 ceph-mon[28706]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T06:04:26.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:26 smithi172 ceph-mon[35716]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T06:04:26.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:26 smithi172 ceph-mon[35716]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T06:04:27.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:27 smithi072 ceph-mon[28706]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-19T06:04:27.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:27 smithi072 ceph-mon[28706]: pgmap v14: 65 pgs: 65 active+clean; 117 MiB data, 567 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 122 op/s 2024-03-19T06:04:27.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:27 smithi072 ceph-mon[28706]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-03-19T06:04:27.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:27 smithi072 ceph-mon[28706]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T06:04:27.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:27 smithi172 ceph-mon[35716]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-19T06:04:27.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:27 smithi172 ceph-mon[35716]: pgmap v14: 65 pgs: 65 active+clean; 117 MiB data, 567 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 122 op/s 2024-03-19T06:04:27.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:27 smithi172 ceph-mon[35716]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-03-19T06:04:27.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:27 smithi172 ceph-mon[35716]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T06:04:28.830 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:28 smithi072 ceph-mon[28706]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T06:04:28.830 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:28 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.831 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:28 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.831 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:28 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.831 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:28 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.831 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:28 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.831 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:28 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.831 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:28 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.831 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:28 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.831 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:28 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:28 smithi172 ceph-mon[35716]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T06:04:28.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:28 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:28 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:28 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:28 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:28 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:28 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:28 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:28 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:28.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:28 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:29.689 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:29 smithi072 ceph-mon[28706]: pgmap v15: 65 pgs: 65 active+clean; 117 MiB data, 567 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 78 op/s 2024-03-19T06:04:29.689 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:29 smithi072 ceph-mon[28706]: Reconfiguring prometheus.smithi072 (dependencies changed)... 2024-03-19T06:04:29.689 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:29 smithi072 ceph-mon[28706]: Reconfiguring daemon prometheus.smithi072 on smithi072 2024-03-19T06:04:29.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:29 smithi172 ceph-mon[35716]: pgmap v15: 65 pgs: 65 active+clean; 117 MiB data, 567 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 78 op/s 2024-03-19T06:04:29.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:29 smithi172 ceph-mon[35716]: Reconfiguring prometheus.smithi072 (dependencies changed)... 2024-03-19T06:04:29.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:29 smithi172 ceph-mon[35716]: Reconfiguring daemon prometheus.smithi072 on smithi072 2024-03-19T06:04:30.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.281+0000 7f6250600700 1 -- 172.21.15.72:0/4168253693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100cd0 msgr2=0x7f62481030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:30.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.281+0000 7f6250600700 1 --2- 172.21.15.72:0/4168253693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100cd0 0x7f62481030b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f623c009910 tx=0x7f623c009c20 comp rx=0 tx=0).stop 2024-03-19T06:04:30.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.282+0000 7f6250600700 1 -- 172.21.15.72:0/4168253693 shutdown_connections 2024-03-19T06:04:30.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.282+0000 7f6250600700 1 --2- 172.21.15.72:0/4168253693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62481035f0 0x7f62481059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:30.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.282+0000 7f6250600700 1 --2- 172.21.15.72:0/4168253693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100cd0 0x7f62481030b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:30.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.282+0000 7f6250600700 1 -- 172.21.15.72:0/4168253693 >> 172.21.15.72:0/4168253693 conn(0x7f62480fa6d0 msgr2=0x7f62480fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:30.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.282+0000 7f6250600700 1 -- 172.21.15.72:0/4168253693 shutdown_connections 2024-03-19T06:04:30.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.283+0000 7f6250600700 1 -- 172.21.15.72:0/4168253693 wait complete. 2024-03-19T06:04:30.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.284+0000 7f6250600700 1 Processor -- start 2024-03-19T06:04:30.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.284+0000 7f6250600700 1 -- start start 2024-03-19T06:04:30.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.284+0000 7f6250600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6248100cd0 0x7f6248195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:30.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.284+0000 7f6250600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62481035f0 0x7f6248195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:30.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.284+0000 7f6250600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62481965b0 con 0x7f62481035f0 2024-03-19T06:04:30.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.284+0000 7f6250600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62481966f0 con 0x7f6248100cd0 2024-03-19T06:04:30.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.285+0000 7f624d200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62481035f0 0x7f6248195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:30.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.285+0000 7f624d200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62481035f0 0x7f6248195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47424/0 (socket says 172.21.15.72:47424) 2024-03-19T06:04:30.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.285+0000 7f624d200700 1 -- 172.21.15.72:0/2911606187 learned_addr learned my addr 172.21.15.72:0/2911606187 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:04:30.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.285+0000 7f624dc00700 1 --2- 172.21.15.72:0/2911606187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6248100cd0 0x7f6248195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:30.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.285+0000 7f624d200700 1 -- 172.21.15.72:0/2911606187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6248100cd0 msgr2=0x7f6248195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:30.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.285+0000 7f624d200700 1 --2- 172.21.15.72:0/2911606187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6248100cd0 0x7f6248195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:30.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.285+0000 7f624d200700 1 -- 172.21.15.72:0/2911606187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c0095f0 con 0x7f62481035f0 2024-03-19T06:04:30.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.286+0000 7f624d200700 1 --2- 172.21.15.72:0/2911606187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62481035f0 0x7f6248195f90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f623400d8d0 tx=0x7f623400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:30.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.286+0000 7f6246000700 1 -- 172.21.15.72:0/2911606187 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6234009940 con 0x7f62481035f0 2024-03-19T06:04:30.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.286+0000 7f6246000700 1 -- 172.21.15.72:0/2911606187 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6234010460 con 0x7f62481035f0 2024-03-19T06:04:30.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.286+0000 7f6250600700 1 -- 172.21.15.72:0/2911606187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624819b1a0 con 0x7f62481035f0 2024-03-19T06:04:30.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.286+0000 7f6246000700 1 -- 172.21.15.72:0/2911606187 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f623400f5f0 con 0x7f62481035f0 2024-03-19T06:04:30.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.286+0000 7f6250600700 1 -- 172.21.15.72:0/2911606187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624819b6f0 con 0x7f62481035f0 2024-03-19T06:04:30.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.287+0000 7f6250600700 1 -- 172.21.15.72:0/2911606187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624818fc60 con 0x7f62481035f0 2024-03-19T06:04:30.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.289+0000 7f6246000700 1 -- 172.21.15.72:0/2911606187 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 90908+0+0 (secure 0 0 0) 0x7f62340105d0 con 0x7f62481035f0 2024-03-19T06:04:30.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.290+0000 7f6246000700 1 --2- 172.21.15.72:0/2911606187 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f623006d290 0x7f623006f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:30.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.290+0000 7f6246000700 1 -- 172.21.15.72:0/2911606187 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f623408c970 con 0x7f62481035f0 2024-03-19T06:04:30.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.291+0000 7f624dc00700 1 --2- 172.21.15.72:0/2911606187 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f623006d290 0x7f623006f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:30.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.292+0000 7f624dc00700 1 --2- 172.21.15.72:0/2911606187 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f623006d290 0x7f623006f740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f623c005b40 tx=0x7f623c005a90 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:30.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.297+0000 7f6246000700 1 -- 172.21.15.72:0/2911606187 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f6234059e00 con 0x7f62481035f0 2024-03-19T06:04:30.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.578+0000 7f6250600700 1 -- 172.21.15.72:0/2911606187 --> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6248061190 con 0x7f623006d290 2024-03-19T06:04:30.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.583+0000 7f6246000700 1 -- 172.21.15.72:0/2911606187 <== mgr.24319 v2:172.21.15.172:6828/1633747146 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f6248061190 con 0x7f623006d290 2024-03-19T06:04:30.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.586+0000 7f6250600700 1 -- 172.21.15.72:0/2911606187 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f623006d290 msgr2=0x7f623006f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:30.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.586+0000 7f6250600700 1 --2- 172.21.15.72:0/2911606187 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f623006d290 0x7f623006f740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f623c005b40 tx=0x7f623c005a90 comp rx=0 tx=0).stop 2024-03-19T06:04:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.586+0000 7f6250600700 1 -- 172.21.15.72:0/2911606187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62481035f0 msgr2=0x7f6248195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.586+0000 7f6250600700 1 --2- 172.21.15.72:0/2911606187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62481035f0 0x7f6248195f90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f623400d8d0 tx=0x7f623400dc90 comp rx=0 tx=0).stop 2024-03-19T06:04:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.587+0000 7f6250600700 1 -- 172.21.15.72:0/2911606187 shutdown_connections 2024-03-19T06:04:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.587+0000 7f6250600700 1 --2- 172.21.15.72:0/2911606187 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f623006d290 0x7f623006f740 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.587+0000 7f6250600700 1 --2- 172.21.15.72:0/2911606187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6248100cd0 0x7f6248195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.587+0000 7f6250600700 1 --2- 172.21.15.72:0/2911606187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62481035f0 0x7f6248195f90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.587+0000 7f6250600700 1 -- 172.21.15.72:0/2911606187 >> 172.21.15.72:0/2911606187 conn(0x7f62480fa6d0 msgr2=0x7f62480fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.587+0000 7f6250600700 1 -- 172.21.15.72:0/2911606187 shutdown_connections 2024-03-19T06:04:30.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.587+0000 7f6250600700 1 -- 172.21.15.72:0/2911606187 wait complete. 2024-03-19T06:04:30.597 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:04:30.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.767+0000 7fcfbfc00700 1 -- 172.21.15.72:0/1660393415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfb8100240 msgr2=0x7fcfb8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:30.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.767+0000 7fcfbfc00700 1 --2- 172.21.15.72:0/1660393415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfb8100240 0x7fcfb8100650 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00b0a0 tx=0x7fcfac00b3b0 comp rx=0 tx=0).stop 2024-03-19T06:04:30.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.768+0000 7fcfbfc00700 1 -- 172.21.15.72:0/1660393415 shutdown_connections 2024-03-19T06:04:30.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.768+0000 7fcfbfc00700 1 --2- 172.21.15.72:0/1660393415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfb8101440 0x7fcfb8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:30.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.768+0000 7fcfbfc00700 1 --2- 172.21.15.72:0/1660393415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfb8100240 0x7fcfb8100650 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:30.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.768+0000 7fcfbfc00700 1 -- 172.21.15.72:0/1660393415 >> 172.21.15.72:0/1660393415 conn(0x7fcfb80fb7f0 msgr2=0x7fcfb80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:30.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.768+0000 7fcfbfc00700 1 -- 172.21.15.72:0/1660393415 shutdown_connections 2024-03-19T06:04:30.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.768+0000 7fcfbfc00700 1 -- 172.21.15.72:0/1660393415 wait complete. 2024-03-19T06:04:30.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.769+0000 7fcfbfc00700 1 Processor -- start 2024-03-19T06:04:30.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.769+0000 7fcfbfc00700 1 -- start start 2024-03-19T06:04:30.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.769+0000 7fcfbfc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfb8100240 0x7fcfb8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:30.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.769+0000 7fcfbfc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfb8101440 0x7fcfb8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:30.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.769+0000 7fcfbfc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8073680 con 0x7fcfb8101440 2024-03-19T06:04:30.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.769+0000 7fcfbfc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80737c0 con 0x7fcfb8100240 2024-03-19T06:04:30.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.770+0000 7fcfb7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfb8101440 0x7fcfb8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:30.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.770+0000 7fcfb7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfb8101440 0x7fcfb8073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47446/0 (socket says 172.21.15.72:47446) 2024-03-19T06:04:30.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.770+0000 7fcfb7e00700 1 -- 172.21.15.72:0/47994677 learned_addr learned my addr 172.21.15.72:0/47994677 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:04:30.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.770+0000 7fcfbd200700 1 --2- 172.21.15.72:0/47994677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfb8100240 0x7fcfb8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:30.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.770+0000 7fcfb7e00700 1 -- 172.21.15.72:0/47994677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfb8100240 msgr2=0x7fcfb8074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:30.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.770+0000 7fcfb7e00700 1 --2- 172.21.15.72:0/47994677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfb8100240 0x7fcfb8074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:30.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.771+0000 7fcfb7e00700 1 -- 172.21.15.72:0/47994677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac009d00 con 0x7fcfb8101440 2024-03-19T06:04:30.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.771+0000 7fcfb7e00700 1 --2- 172.21.15.72:0/47994677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfb8101440 0x7fcfb8073140 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400c8a0 tx=0x7fcfa400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:30.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.771+0000 7fcfb5600700 1 -- 172.21.15.72:0/47994677 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfa40078e0 con 0x7fcfb8101440 2024-03-19T06:04:30.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.771+0000 7fcfb5600700 1 -- 172.21.15.72:0/47994677 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcfa400f450 con 0x7fcfb8101440 2024-03-19T06:04:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.771+0000 7fcfbfc00700 1 -- 172.21.15.72:0/47994677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb8073aa0 con 0x7fcfb8101440 2024-03-19T06:04:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.771+0000 7fcfb5600700 1 -- 172.21.15.72:0/47994677 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfa400e5e0 con 0x7fcfb8101440 2024-03-19T06:04:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.771+0000 7fcfbfc00700 1 -- 172.21.15.72:0/47994677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb819db90 con 0x7fcfb8101440 2024-03-19T06:04:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.773+0000 7fcfbfc00700 1 -- 172.21.15.72:0/47994677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb8108d90 con 0x7fcfb8101440 2024-03-19T06:04:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.773+0000 7fcfb5600700 1 -- 172.21.15.72:0/47994677 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 90908+0+0 (secure 0 0 0) 0x7fcfa400f5c0 con 0x7fcfb8101440 2024-03-19T06:04:30.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.774+0000 7fcfb5600700 1 --2- 172.21.15.72:0/47994677 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fcfa006d280 0x7fcfa006f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:30.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.775+0000 7fcfb5600700 1 -- 172.21.15.72:0/47994677 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fcfa408ca50 con 0x7fcfb8101440 2024-03-19T06:04:30.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.775+0000 7fcfbd200700 1 --2- 172.21.15.72:0/47994677 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fcfa006d280 0x7fcfa006f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:30.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.778+0000 7fcfbd200700 1 --2- 172.21.15.72:0/47994677 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fcfa006d280 0x7fcfa006f730 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009fd0 tx=0x7fcfac000f40 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:30.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:30.781+0000 7fcfb5600700 1 -- 172.21.15.72:0/47994677 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fcfa4059e60 con 0x7fcfb8101440 2024-03-19T06:04:31.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.071+0000 7fcfbfc00700 1 -- 172.21.15.72:0/47994677 --> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfb819e140 con 0x7fcfa006d280 2024-03-19T06:04:31.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.074+0000 7fcfb5600700 1 -- 172.21.15.72:0/47994677 <== mgr.24319 v2:172.21.15.172:6828/1633747146 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fcfb819e140 con 0x7fcfa006d280 2024-03-19T06:04:31.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.078+0000 7fcfbfc00700 1 -- 172.21.15.72:0/47994677 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fcfa006d280 msgr2=0x7fcfa006f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:31.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.078+0000 7fcfbfc00700 1 --2- 172.21.15.72:0/47994677 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fcfa006d280 0x7fcfa006f730 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009fd0 tx=0x7fcfac000f40 comp rx=0 tx=0).stop 2024-03-19T06:04:31.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.078+0000 7fcfbfc00700 1 -- 172.21.15.72:0/47994677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfb8101440 msgr2=0x7fcfb8073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:31.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.078+0000 7fcfbfc00700 1 --2- 172.21.15.72:0/47994677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfb8101440 0x7fcfb8073140 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400c8a0 tx=0x7fcfa400cbb0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.078+0000 7fcfbfc00700 1 -- 172.21.15.72:0/47994677 shutdown_connections 2024-03-19T06:04:31.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.078+0000 7fcfbfc00700 1 --2- 172.21.15.72:0/47994677 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fcfa006d280 0x7fcfa006f730 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.078+0000 7fcfbfc00700 1 --2- 172.21.15.72:0/47994677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfb8100240 0x7fcfb8074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.078+0000 7fcfbfc00700 1 --2- 172.21.15.72:0/47994677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfb8101440 0x7fcfb8073140 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.078+0000 7fcfbfc00700 1 -- 172.21.15.72:0/47994677 >> 172.21.15.72:0/47994677 conn(0x7fcfb80fb7f0 msgr2=0x7fcfb8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:31.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.079+0000 7fcfbfc00700 1 -- 172.21.15.72:0/47994677 shutdown_connections 2024-03-19T06:04:31.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.079+0000 7fcfbfc00700 1 -- 172.21.15.72:0/47994677 wait complete. 2024-03-19T06:04:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.248+0000 7fd337a00700 1 -- 172.21.15.72:0/1750081478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd330107a60 msgr2=0x7fd330107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.248+0000 7fd337a00700 1 --2- 172.21.15.72:0/1750081478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd330107a60 0x7fd330107eb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009910 tx=0x7fd31c009c20 comp rx=0 tx=0).stop 2024-03-19T06:04:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.248+0000 7fd337a00700 1 -- 172.21.15.72:0/1750081478 shutdown_connections 2024-03-19T06:04:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.248+0000 7fd337a00700 1 --2- 172.21.15.72:0/1750081478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd330107a60 0x7fd330107eb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.248+0000 7fd337a00700 1 --2- 172.21.15.72:0/1750081478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330106860 0x7fd330106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.248+0000 7fd337a00700 1 -- 172.21.15.72:0/1750081478 >> 172.21.15.72:0/1750081478 conn(0x7fd3300758b0 msgr2=0x7fd330077d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.248+0000 7fd337a00700 1 -- 172.21.15.72:0/1750081478 shutdown_connections 2024-03-19T06:04:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.248+0000 7fd337a00700 1 -- 172.21.15.72:0/1750081478 wait complete. 2024-03-19T06:04:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.249+0000 7fd337a00700 1 Processor -- start 2024-03-19T06:04:31.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.250+0000 7fd337a00700 1 -- start start 2024-03-19T06:04:31.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.250+0000 7fd337a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd330106860 0x7fd330071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:31.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.250+0000 7fd337a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330107a60 0x7fd3300722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:31.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.250+0000 7fd337a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3300728c0 con 0x7fd330106860 2024-03-19T06:04:31.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.250+0000 7fd337a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3301a9e90 con 0x7fd330107a60 2024-03-19T06:04:31.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.250+0000 7fd335000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd330106860 0x7fd330071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:31.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.250+0000 7fd335000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd330106860 0x7fd330071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47464/0 (socket says 172.21.15.72:47464) 2024-03-19T06:04:31.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.250+0000 7fd335000700 1 -- 172.21.15.72:0/1541184856 learned_addr learned my addr 172.21.15.72:0/1541184856 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:04:31.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.251+0000 7fd32fe00700 1 --2- 172.21.15.72:0/1541184856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330107a60 0x7fd3300722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:31.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.251+0000 7fd335000700 1 -- 172.21.15.72:0/1541184856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330107a60 msgr2=0x7fd3300722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:31.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.251+0000 7fd335000700 1 --2- 172.21.15.72:0/1541184856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330107a60 0x7fd3300722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.251+0000 7fd335000700 1 -- 172.21.15.72:0/1541184856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c0095f0 con 0x7fd330106860 2024-03-19T06:04:31.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.251+0000 7fd32fe00700 1 --2- 172.21.15.72:0/1541184856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330107a60 0x7fd3300722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:04:31.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.251+0000 7fd335000700 1 --2- 172.21.15.72:0/1541184856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd330106860 0x7fd330071d60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd32400d900 tx=0x7fd32400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:31.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.251+0000 7fd32d600700 1 -- 172.21.15.72:0/1541184856 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3240041f0 con 0x7fd330106860 2024-03-19T06:04:31.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.252+0000 7fd337a00700 1 -- 172.21.15.72:0/1541184856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3301aa090 con 0x7fd330106860 2024-03-19T06:04:31.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.252+0000 7fd32d600700 1 -- 172.21.15.72:0/1541184856 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd324004350 con 0x7fd330106860 2024-03-19T06:04:31.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.252+0000 7fd32d600700 1 -- 172.21.15.72:0/1541184856 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd324003d40 con 0x7fd330106860 2024-03-19T06:04:31.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.252+0000 7fd337a00700 1 -- 172.21.15.72:0/1541184856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3301aa560 con 0x7fd330106860 2024-03-19T06:04:31.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.254+0000 7fd337a00700 1 -- 172.21.15.72:0/1541184856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33010f3b0 con 0x7fd330106860 2024-03-19T06:04:31.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.254+0000 7fd32d600700 1 -- 172.21.15.72:0/1541184856 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 90908+0+0 (secure 0 0 0) 0x7fd324009730 con 0x7fd330106860 2024-03-19T06:04:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.255+0000 7fd32d600700 1 --2- 172.21.15.72:0/1541184856 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fd31806d280 0x7fd31806f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.256+0000 7fd32d600700 1 -- 172.21.15.72:0/1541184856 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fd32408cbc0 con 0x7fd330106860 2024-03-19T06:04:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.256+0000 7fd32fe00700 1 --2- 172.21.15.72:0/1541184856 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fd31806d280 0x7fd31806f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.257+0000 7fd32fe00700 1 --2- 172.21.15.72:0/1541184856 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fd31806d280 0x7fd31806f730 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd31c006010 tx=0x7fd31c00b580 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:31.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.260+0000 7fd32d600700 1 -- 172.21.15.72:0/1541184856 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fd324059fd0 con 0x7fd330106860 2024-03-19T06:04:31.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.575+0000 7fd337a00700 1 -- 172.21.15.72:0/1541184856 --> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd33010c3b0 con 0x7fd31806d280 2024-03-19T06:04:31.567 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:31 smithi072 ceph-mon[28706]: pgmap v16: 65 pgs: 65 active+clean; 124 MiB data, 592 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 120 op/s 2024-03-19T06:04:31.568 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:31 smithi072 ceph-mon[28706]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:04:31.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.591+0000 7fd32d600700 1 -- 172.21.15.72:0/1541184856 <== mgr.24319 v2:172.21.15.172:6828/1633747146 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd33010c3b0 con 0x7fd31806d280 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (8m) 13s ago 10m 13.8M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (11m) 13s ago 11m 7768k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (9m) 14s ago 9m 7620k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (11m) 13s ago 11m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (9m) 14s ago 9m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (8m) 13s ago 10m 74.2M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (3m) 13s ago 3m 13.3M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (3m) 13s ago 3m 84.1M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (3m) 14s ago 3m 13.2M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (3m) 14s ago 3m 80.0M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:9283,8765,8443 running (12m) 13s ago 12m 333M - 18.2.0 dc2bc1663786 af0e8bfc899d 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (39s) 14s ago 9m 489M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 1aabb23d2304 2024-03-19T06:04:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (13m) 13s ago 13m 49.5M 2048M 18.2.0 dc2bc1663786 77289e9e2b33 2024-03-19T06:04:31.585 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (9m) 14s ago 9m 38.7M 2048M 18.2.0 dc2bc1663786 31fba31e7d8a 2024-03-19T06:04:31.585 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (11m) 13s ago 11m 7620k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:04:31.585 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (9m) 14s ago 9m 7776k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:04:31.585 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (8m) 13s ago 8m 69.2M 1216M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:04:31.585 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (7m) 13s ago 7m 72.6M 1216M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:04:31.585 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (7m) 13s ago 7m 59.1M 1216M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:04:31.585 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (6m) 14s ago 6m 72.8M 2241M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:04:31.585 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (6m) 14s ago 6m 63.2M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:04:31.585 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (5m) 14s ago 5m 64.5M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:04:31.585 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (8m) 13s ago 10m 62.1M - 2.43.0 a07b618ecd1d ea7a91af5b4a 2024-03-19T06:04:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.595+0000 7fd337a00700 1 -- 172.21.15.72:0/1541184856 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fd31806d280 msgr2=0x7fd31806f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.595+0000 7fd337a00700 1 --2- 172.21.15.72:0/1541184856 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fd31806d280 0x7fd31806f730 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd31c006010 tx=0x7fd31c00b580 comp rx=0 tx=0).stop 2024-03-19T06:04:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.595+0000 7fd337a00700 1 -- 172.21.15.72:0/1541184856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd330106860 msgr2=0x7fd330071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.595+0000 7fd337a00700 1 --2- 172.21.15.72:0/1541184856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd330106860 0x7fd330071d60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd32400d900 tx=0x7fd32400dcc0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.595+0000 7fd337a00700 1 -- 172.21.15.72:0/1541184856 shutdown_connections 2024-03-19T06:04:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.595+0000 7fd337a00700 1 --2- 172.21.15.72:0/1541184856 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fd31806d280 0x7fd31806f730 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.595+0000 7fd337a00700 1 --2- 172.21.15.72:0/1541184856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd330106860 0x7fd330071d60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.595+0000 7fd337a00700 1 --2- 172.21.15.72:0/1541184856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd330107a60 0x7fd3300722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.595+0000 7fd337a00700 1 -- 172.21.15.72:0/1541184856 >> 172.21.15.72:0/1541184856 conn(0x7fd3300758b0 msgr2=0x7fd33010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:31.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.596+0000 7fd337a00700 1 -- 172.21.15.72:0/1541184856 shutdown_connections 2024-03-19T06:04:31.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.596+0000 7fd337a00700 1 -- 172.21.15.72:0/1541184856 wait complete. 2024-03-19T06:04:31.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.770+0000 7fc24b600700 1 -- 172.21.15.72:0/4242301880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2440ff140 msgr2=0x7fc2440ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:31.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.770+0000 7fc24b600700 1 --2- 172.21.15.72:0/4242301880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2440ff140 0x7fc2440ff550 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc238009910 tx=0x7fc238009c20 comp rx=0 tx=0).stop 2024-03-19T06:04:31.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.770+0000 7fc24b600700 1 -- 172.21.15.72:0/4242301880 shutdown_connections 2024-03-19T06:04:31.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.770+0000 7fc24b600700 1 --2- 172.21.15.72:0/4242301880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc244100340 0x7fc244100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.770+0000 7fc24b600700 1 --2- 172.21.15.72:0/4242301880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2440ff140 0x7fc2440ff550 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.770+0000 7fc24b600700 1 -- 172.21.15.72:0/4242301880 >> 172.21.15.72:0/4242301880 conn(0x7fc2440fa6d0 msgr2=0x7fc2440fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:31.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.771+0000 7fc24b600700 1 -- 172.21.15.72:0/4242301880 shutdown_connections 2024-03-19T06:04:31.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.771+0000 7fc24b600700 1 -- 172.21.15.72:0/4242301880 wait complete. 2024-03-19T06:04:31.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.772+0000 7fc24b600700 1 Processor -- start 2024-03-19T06:04:31.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.772+0000 7fc24b600700 1 -- start start 2024-03-19T06:04:31.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.772+0000 7fc24b600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2440ff140 0x7fc2441030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:31.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.772+0000 7fc24b600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc244100340 0x7fc244101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:31.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.772+0000 7fc24b600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244101c60 con 0x7fc244100340 2024-03-19T06:04:31.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.772+0000 7fc24b600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244101da0 con 0x7fc2440ff140 2024-03-19T06:04:31.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.772+0000 7fc243e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc244100340 0x7fc244101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.773+0000 7fc243e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc244100340 0x7fc244101720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47482/0 (socket says 172.21.15.72:47482) 2024-03-19T06:04:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.773+0000 7fc243e00700 1 -- 172.21.15.72:0/3747322180 learned_addr learned my addr 172.21.15.72:0/3747322180 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:04:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.773+0000 7fc248c00700 1 --2- 172.21.15.72:0/3747322180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2440ff140 0x7fc2441030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.773+0000 7fc243e00700 1 -- 172.21.15.72:0/3747322180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2440ff140 msgr2=0x7fc2441030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.773+0000 7fc243e00700 1 --2- 172.21.15.72:0/3747322180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2440ff140 0x7fc2441030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.773+0000 7fc243e00700 1 -- 172.21.15.72:0/3747322180 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2380095f0 con 0x7fc244100340 2024-03-19T06:04:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.774+0000 7fc243e00700 1 --2- 172.21.15.72:0/3747322180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc244100340 0x7fc244101720 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc23000b4b0 tx=0x7fc23000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:31.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.774+0000 7fc241600700 1 -- 172.21.15.72:0/3747322180 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc230011800 con 0x7fc244100340 2024-03-19T06:04:31.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.774+0000 7fc241600700 1 -- 172.21.15.72:0/3747322180 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc230011e10 con 0x7fc244100340 2024-03-19T06:04:31.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.774+0000 7fc241600700 1 -- 172.21.15.72:0/3747322180 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc23000f2e0 con 0x7fc244100340 2024-03-19T06:04:31.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.774+0000 7fc24b600700 1 -- 172.21.15.72:0/3747322180 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc244102080 con 0x7fc244100340 2024-03-19T06:04:31.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.774+0000 7fc24b600700 1 -- 172.21.15.72:0/3747322180 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24419dbc0 con 0x7fc244100340 2024-03-19T06:04:31.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.775+0000 7fc24b600700 1 -- 172.21.15.72:0/3747322180 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc244107d10 con 0x7fc244100340 2024-03-19T06:04:31.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.777+0000 7fc241600700 1 -- 172.21.15.72:0/3747322180 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 90908+0+0 (secure 0 0 0) 0x7fc230010380 con 0x7fc244100340 2024-03-19T06:04:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.778+0000 7fc241600700 1 --2- 172.21.15.72:0/3747322180 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fc22c06d2c0 0x7fc22c06f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.778+0000 7fc241600700 1 -- 172.21.15.72:0/3747322180 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fc23008c480 con 0x7fc244100340 2024-03-19T06:04:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.779+0000 7fc248c00700 1 --2- 172.21.15.72:0/3747322180 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fc22c06d2c0 0x7fc22c06f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:31.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.780+0000 7fc248c00700 1 --2- 172.21.15.72:0/3747322180 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fc22c06d2c0 0x7fc22c06f770 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc238006010 tx=0x7fc23800b540 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:31.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:31.782+0000 7fc241600700 1 -- 172.21.15.72:0/3747322180 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fc230059a00 con 0x7fc244100340 2024-03-19T06:04:31.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:31 smithi172 ceph-mon[35716]: pgmap v16: 65 pgs: 65 active+clean; 124 MiB data, 592 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 120 op/s 2024-03-19T06:04:31.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:31 smithi172 ceph-mon[35716]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:04:32.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.183+0000 7fc24b600700 1 -- 172.21.15.72:0/3747322180 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc244107f00 con 0x7fc244100340 2024-03-19T06:04:32.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.184+0000 7fc241600700 1 -- 172.21.15.72:0/3747322180 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7fc230059590 con 0x7fc244100340 2024-03-19T06:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-03-19T06:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 1 2024-03-19T06:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-03-19T06:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 1 2024-03-19T06:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:04:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.187+0000 7fc24b600700 1 -- 172.21.15.72:0/3747322180 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fc22c06d2c0 msgr2=0x7fc22c06f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.187+0000 7fc24b600700 1 --2- 172.21.15.72:0/3747322180 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fc22c06d2c0 0x7fc22c06f770 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc238006010 tx=0x7fc23800b540 comp rx=0 tx=0).stop 2024-03-19T06:04:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.187+0000 7fc24b600700 1 -- 172.21.15.72:0/3747322180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc244100340 msgr2=0x7fc244101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.187+0000 7fc24b600700 1 --2- 172.21.15.72:0/3747322180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc244100340 0x7fc244101720 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc23000b4b0 tx=0x7fc23000b870 comp rx=0 tx=0).stop 2024-03-19T06:04:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.187+0000 7fc24b600700 1 -- 172.21.15.72:0/3747322180 shutdown_connections 2024-03-19T06:04:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.187+0000 7fc24b600700 1 --2- 172.21.15.72:0/3747322180 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fc22c06d2c0 0x7fc22c06f770 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.187+0000 7fc24b600700 1 --2- 172.21.15.72:0/3747322180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2440ff140 0x7fc2441030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.187+0000 7fc24b600700 1 --2- 172.21.15.72:0/3747322180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc244100340 0x7fc244101720 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.187+0000 7fc24b600700 1 -- 172.21.15.72:0/3747322180 >> 172.21.15.72:0/3747322180 conn(0x7fc2440fa6d0 msgr2=0x7fc244068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.187+0000 7fc24b600700 1 -- 172.21.15.72:0/3747322180 shutdown_connections 2024-03-19T06:04:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.187+0000 7fc24b600700 1 -- 172.21.15.72:0/3747322180 wait complete. 2024-03-19T06:04:32.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.375+0000 7f4265a00700 1 -- 172.21.15.72:0/2287443137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4260073730 msgr2=0x7f4260073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:32.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.375+0000 7f4265a00700 1 --2- 172.21.15.72:0/2287443137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4260073730 0x7f4260073ba0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f424c009910 tx=0x7f424c009c20 comp rx=0 tx=0).stop 2024-03-19T06:04:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.376+0000 7f4265a00700 1 -- 172.21.15.72:0/2287443137 shutdown_connections 2024-03-19T06:04:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.376+0000 7f4265a00700 1 --2- 172.21.15.72:0/2287443137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4260073730 0x7f4260073ba0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.376+0000 7f4265a00700 1 --2- 172.21.15.72:0/2287443137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4260074d00 0x7f4260073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.376+0000 7f4265a00700 1 -- 172.21.15.72:0/2287443137 >> 172.21.15.72:0/2287443137 conn(0x7f42600fb7f0 msgr2=0x7f42600fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.376+0000 7f4265a00700 1 -- 172.21.15.72:0/2287443137 shutdown_connections 2024-03-19T06:04:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.376+0000 7f4265a00700 1 -- 172.21.15.72:0/2287443137 wait complete. 2024-03-19T06:04:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.377+0000 7f4265a00700 1 Processor -- start 2024-03-19T06:04:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.377+0000 7f4265a00700 1 -- start start 2024-03-19T06:04:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.378+0000 7f4265a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4260073730 0x7f4260197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.378+0000 7f4265a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4260074d00 0x7f42601981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.378+0000 7f4265a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42601987b0 con 0x7f4260073730 2024-03-19T06:04:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.378+0000 7f4265a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4260198920 con 0x7f4260074d00 2024-03-19T06:04:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.379+0000 7f425e000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4260074d00 0x7f42601981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.379+0000 7f425e000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4260074d00 0x7f42601981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:41120/0 (socket says 172.21.15.72:41120) 2024-03-19T06:04:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.379+0000 7f425e000700 1 -- 172.21.15.72:0/577429509 learned_addr learned my addr 172.21.15.72:0/577429509 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:04:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.379+0000 7f425ea00700 1 --2- 172.21.15.72:0/577429509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4260073730 0x7f4260197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.379+0000 7f425e000700 1 -- 172.21.15.72:0/577429509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4260073730 msgr2=0x7f4260197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.379+0000 7f425e000700 1 --2- 172.21.15.72:0/577429509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4260073730 0x7f4260197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.379+0000 7f425e000700 1 -- 172.21.15.72:0/577429509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c0095f0 con 0x7f4260074d00 2024-03-19T06:04:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.379+0000 7f425ea00700 1 --2- 172.21.15.72:0/577429509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4260073730 0x7f4260197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:04:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.380+0000 7f425e000700 1 --2- 172.21.15.72:0/577429509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4260074d00 0x7f42601981b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f424c00bd70 tx=0x7f424c00be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.380+0000 7f4257400700 1 -- 172.21.15.72:0/577429509 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f424c01d070 con 0x7f4260074d00 2024-03-19T06:04:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.380+0000 7f4265a00700 1 -- 172.21.15.72:0/577429509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426019d350 con 0x7f4260074d00 2024-03-19T06:04:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.380+0000 7f4265a00700 1 -- 172.21.15.72:0/577429509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426019d840 con 0x7f4260074d00 2024-03-19T06:04:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.380+0000 7f4257400700 1 -- 172.21.15.72:0/577429509 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f424c022470 con 0x7f4260074d00 2024-03-19T06:04:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.380+0000 7f4257400700 1 -- 172.21.15.72:0/577429509 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f424c00f670 con 0x7f4260074d00 2024-03-19T06:04:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.381+0000 7f4265a00700 1 -- 172.21.15.72:0/577429509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426010af70 con 0x7f4260074d00 2024-03-19T06:04:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.383+0000 7f4257400700 1 -- 172.21.15.72:0/577429509 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 24) v1 ==== 90908+0+0 (secure 0 0 0) 0x7f424c022a10 con 0x7f4260074d00 2024-03-19T06:04:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.384+0000 7f4257400700 1 --2- 172.21.15.72:0/577429509 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f424406d290 0x7f424406f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.384+0000 7f4257400700 1 -- 172.21.15.72:0/577429509 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f424c08dfe0 con 0x7f4260074d00 2024-03-19T06:04:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.384+0000 7f425ea00700 1 --2- 172.21.15.72:0/577429509 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f424406d290 0x7f424406f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.385+0000 7f425ea00700 1 --2- 172.21.15.72:0/577429509 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f424406d290 0x7f424406f740 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4250005950 tx=0x7f42500058e0 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.390+0000 7f4257400700 1 -- 172.21.15.72:0/577429509 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f424c057970 con 0x7f4260074d00 2024-03-19T06:04:32.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.707+0000 7f4265a00700 1 -- 172.21.15.72:0/577429509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f426019dea0 con 0x7f4260074d00 2024-03-19T06:04:32.700 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:32 smithi072 ceph-mon[28706]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:04:32.700 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:32 smithi072 ceph-mon[28706]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:04:32.700 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:32 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3747322180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:04:32.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.708+0000 7f4257400700 1 -- 172.21.15.72:0/577429509 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f424c027750 con 0x7f4260074d00 2024-03-19T06:04:32.701 INFO:teuthology.orchestra.run.smithi072.stdout:e14 2024-03-19T06:04:32.701 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:04:32.701 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:04:32.701 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:04:32.701 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 14 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:03:33.243075+0000 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:04:32.702 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:04:32.703 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:04:32.704 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:04:32.704 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:04:32.704 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:04:32.704 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:04:32.704 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:04:32.704 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:04:32.704 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:04:32.704 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:04:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.711+0000 7f4265a00700 1 -- 172.21.15.72:0/577429509 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f424406d290 msgr2=0x7f424406f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.712+0000 7f4265a00700 1 --2- 172.21.15.72:0/577429509 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f424406d290 0x7f424406f740 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4250005950 tx=0x7f42500058e0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.712+0000 7f4265a00700 1 -- 172.21.15.72:0/577429509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4260074d00 msgr2=0x7f42601981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.712+0000 7f4265a00700 1 --2- 172.21.15.72:0/577429509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4260074d00 0x7f42601981b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f424c00bd70 tx=0x7f424c00be50 comp rx=0 tx=0).stop 2024-03-19T06:04:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.712+0000 7f4265a00700 1 -- 172.21.15.72:0/577429509 shutdown_connections 2024-03-19T06:04:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.712+0000 7f4265a00700 1 --2- 172.21.15.72:0/577429509 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f424406d290 0x7f424406f740 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.712+0000 7f4265a00700 1 --2- 172.21.15.72:0/577429509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4260073730 0x7f4260197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.712+0000 7f4265a00700 1 --2- 172.21.15.72:0/577429509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4260074d00 0x7f42601981b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.712+0000 7f4265a00700 1 -- 172.21.15.72:0/577429509 >> 172.21.15.72:0/577429509 conn(0x7f42600fb7f0 msgr2=0x7f42601060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.712+0000 7f4265a00700 1 -- 172.21.15.72:0/577429509 shutdown_connections 2024-03-19T06:04:32.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.712+0000 7f4265a00700 1 -- 172.21.15.72:0/577429509 wait complete. 2024-03-19T06:04:32.706 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-03-19T06:04:32.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.879+0000 7f712f200700 1 -- 172.21.15.72:0/2518923472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7130101240 msgr2=0x7f7130101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:32.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.879+0000 7f712f200700 1 --2- 172.21.15.72:0/2518923472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7130101240 0x7f7130101690 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f711c009910 tx=0x7f711c009c20 comp rx=0 tx=0).stop 2024-03-19T06:04:32.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.879+0000 7f712f200700 1 -- 172.21.15.72:0/2518923472 shutdown_connections 2024-03-19T06:04:32.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.879+0000 7f712f200700 1 --2- 172.21.15.72:0/2518923472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7130101240 0x7f7130101690 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.879+0000 7f712f200700 1 --2- 172.21.15.72:0/2518923472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7130100040 0x7f7130100450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.879+0000 7f712f200700 1 -- 172.21.15.72:0/2518923472 >> 172.21.15.72:0/2518923472 conn(0x7f71300fb5b0 msgr2=0x7f71300fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:32.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.879+0000 7f712f200700 1 -- 172.21.15.72:0/2518923472 shutdown_connections 2024-03-19T06:04:32.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.879+0000 7f712f200700 1 -- 172.21.15.72:0/2518923472 wait complete. 2024-03-19T06:04:32.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.880+0000 7f712f200700 1 Processor -- start 2024-03-19T06:04:32.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.880+0000 7f712f200700 1 -- start start 2024-03-19T06:04:32.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.880+0000 7f712f200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7130100040 0x7f7130197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:32.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.880+0000 7f712f200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7130101240 0x7f7130197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:32.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.880+0000 7f712f200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7130198520 con 0x7f7130101240 2024-03-19T06:04:32.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.880+0000 7f712f200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7130198660 con 0x7f7130100040 2024-03-19T06:04:32.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.881+0000 7f712d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7130101240 0x7f7130197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:32.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.881+0000 7f712d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7130101240 0x7f7130197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47520/0 (socket says 172.21.15.72:47520) 2024-03-19T06:04:32.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.881+0000 7f712d400700 1 -- 172.21.15.72:0/3617626433 learned_addr learned my addr 172.21.15.72:0/3617626433 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:04:32.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.881+0000 7f712de00700 1 --2- 172.21.15.72:0/3617626433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7130100040 0x7f7130197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:32.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.881+0000 7f712d400700 1 -- 172.21.15.72:0/3617626433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7130100040 msgr2=0x7f7130197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:32.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.881+0000 7f712d400700 1 --2- 172.21.15.72:0/3617626433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7130100040 0x7f7130197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:32.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.881+0000 7f712d400700 1 -- 172.21.15.72:0/3617626433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c0095f0 con 0x7f7130101240 2024-03-19T06:04:32.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.882+0000 7f712d400700 1 --2- 172.21.15.72:0/3617626433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7130101240 0x7f7130197f90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f711c00bd70 tx=0x7f711c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:32.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.882+0000 7f7126a00700 1 -- 172.21.15.72:0/3617626433 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f711c01d070 con 0x7f7130101240 2024-03-19T06:04:32.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.882+0000 7f712f200700 1 -- 172.21.15.72:0/3617626433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713019d0c0 con 0x7f7130101240 2024-03-19T06:04:32.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.882+0000 7f7126a00700 1 -- 172.21.15.72:0/3617626433 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f711c022470 con 0x7f7130101240 2024-03-19T06:04:32.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.882+0000 7f7126a00700 1 -- 172.21.15.72:0/3617626433 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f711c00f670 con 0x7f7130101240 2024-03-19T06:04:32.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.882+0000 7f712f200700 1 -- 172.21.15.72:0/3617626433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713019d580 con 0x7f7130101240 2024-03-19T06:04:32.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.884+0000 7f712f200700 1 -- 172.21.15.72:0/3617626433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7130105320 con 0x7f7130101240 2024-03-19T06:04:32.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.884+0000 7f7126a00700 1 -- 172.21.15.72:0/3617626433 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 90908+0+0 (secure 0 0 0) 0x7f711c022a50 con 0x7f7130101240 2024-03-19T06:04:32.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.886+0000 7f7126a00700 1 --2- 172.21.15.72:0/3617626433 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f711406d290 0x7f711406f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:32.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.886+0000 7f7126a00700 1 -- 172.21.15.72:0/3617626433 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f711c08e1d0 con 0x7f7130101240 2024-03-19T06:04:32.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.887+0000 7f712de00700 1 --2- 172.21.15.72:0/3617626433 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f711406d290 0x7f711406f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:32.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.888+0000 7f712de00700 1 --2- 172.21.15.72:0/3617626433 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f711406d290 0x7f711406f740 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7120005fd0 tx=0x7f7120005e50 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:32.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:32.891+0000 7f7126a00700 1 -- 172.21.15.72:0/3617626433 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f711c05b5f0 con 0x7f7130101240 2024-03-19T06:04:32.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:32 smithi172 ceph-mon[35716]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:04:32.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:32 smithi172 ceph-mon[35716]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:04:32.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:32 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3747322180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:04:33.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.237+0000 7f712f200700 1 -- 172.21.15.72:0/3617626433 --> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7130061190 con 0x7f711406d290 2024-03-19T06:04:33.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.240+0000 7f7126a00700 1 -- 172.21.15.72:0/3617626433 <== mgr.24319 v2:172.21.15.172:6828/1633747146 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f7130061190 con 0x7f711406d290 2024-03-19T06:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-03-19T06:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "1/23 daemons upgraded", 2024-03-19T06:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "", 2024-03-19T06:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:04:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.243+0000 7f712f200700 1 -- 172.21.15.72:0/3617626433 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f711406d290 msgr2=0x7f711406f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.243+0000 7f712f200700 1 --2- 172.21.15.72:0/3617626433 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f711406d290 0x7f711406f740 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7120005fd0 tx=0x7f7120005e50 comp rx=0 tx=0).stop 2024-03-19T06:04:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.243+0000 7f712f200700 1 -- 172.21.15.72:0/3617626433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7130101240 msgr2=0x7f7130197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.243+0000 7f712f200700 1 --2- 172.21.15.72:0/3617626433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7130101240 0x7f7130197f90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f711c00bd70 tx=0x7f711c00be50 comp rx=0 tx=0).stop 2024-03-19T06:04:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.244+0000 7f712f200700 1 -- 172.21.15.72:0/3617626433 shutdown_connections 2024-03-19T06:04:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.244+0000 7f712f200700 1 --2- 172.21.15.72:0/3617626433 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f711406d290 0x7f711406f740 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.244+0000 7f712f200700 1 --2- 172.21.15.72:0/3617626433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7130100040 0x7f7130197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.244+0000 7f712f200700 1 --2- 172.21.15.72:0/3617626433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7130101240 0x7f7130197f90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.244+0000 7f712f200700 1 -- 172.21.15.72:0/3617626433 >> 172.21.15.72:0/3617626433 conn(0x7f71300fb5b0 msgr2=0x7f7130102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.244+0000 7f712f200700 1 -- 172.21.15.72:0/3617626433 shutdown_connections 2024-03-19T06:04:33.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.244+0000 7f712f200700 1 -- 172.21.15.72:0/3617626433 wait complete. 2024-03-19T06:04:33.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.455+0000 7fe2bc600700 1 -- 172.21.15.72:0/1707971537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b40737b0 msgr2=0x7fe2b4073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:33.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.455+0000 7fe2bc600700 1 --2- 172.21.15.72:0/1707971537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b40737b0 0x7fe2b4073c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009910 tx=0x7fe2a0009c20 comp rx=0 tx=0).stop 2024-03-19T06:04:33.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.455+0000 7fe2bc600700 1 -- 172.21.15.72:0/1707971537 shutdown_connections 2024-03-19T06:04:33.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.455+0000 7fe2bc600700 1 --2- 172.21.15.72:0/1707971537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b40737b0 0x7fe2b4073c20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:33.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.455+0000 7fe2bc600700 1 --2- 172.21.15.72:0/1707971537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b4074d80 0x7fe2b40731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:33.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.455+0000 7fe2bc600700 1 -- 172.21.15.72:0/1707971537 >> 172.21.15.72:0/1707971537 conn(0x7fe2b40fb7f0 msgr2=0x7fe2b40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:33.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.456+0000 7fe2bc600700 1 -- 172.21.15.72:0/1707971537 shutdown_connections 2024-03-19T06:04:33.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.456+0000 7fe2bc600700 1 -- 172.21.15.72:0/1707971537 wait complete. 2024-03-19T06:04:33.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.457+0000 7fe2bc600700 1 Processor -- start 2024-03-19T06:04:33.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.457+0000 7fe2bc600700 1 -- start start 2024-03-19T06:04:33.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.458+0000 7fe2bc600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b40737b0 0x7fe2b419c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:33.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.458+0000 7fe2bc600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4074d80 0x7fe2b419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:33.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.458+0000 7fe2bc600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b419cbd0 con 0x7fe2b4074d80 2024-03-19T06:04:33.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.458+0000 7fe2bc600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b419cd10 con 0x7fe2b40737b0 2024-03-19T06:04:33.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.458+0000 7fe2b9200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4074d80 0x7fe2b419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:33.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.458+0000 7fe2b9c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b40737b0 0x7fe2b419c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:33.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.458+0000 7fe2b9c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b40737b0 0x7fe2b419c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:41160/0 (socket says 172.21.15.72:41160) 2024-03-19T06:04:33.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.458+0000 7fe2b9c00700 1 -- 172.21.15.72:0/2155258555 learned_addr learned my addr 172.21.15.72:0/2155258555 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:04:33.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.459+0000 7fe2b9200700 1 -- 172.21.15.72:0/2155258555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b40737b0 msgr2=0x7fe2b419c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:33.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.459+0000 7fe2b9200700 1 --2- 172.21.15.72:0/2155258555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b40737b0 0x7fe2b419c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:33.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.459+0000 7fe2b9200700 1 -- 172.21.15.72:0/2155258555 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a00095f0 con 0x7fe2b4074d80 2024-03-19T06:04:33.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.459+0000 7fe2b9200700 1 --2- 172.21.15.72:0/2155258555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4074d80 0x7fe2b419c5b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0000c00 tx=0x7fe2a000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:33.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.459+0000 7fe2b2000700 1 -- 172.21.15.72:0/2155258555 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2a001d070 con 0x7fe2b4074d80 2024-03-19T06:04:33.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.459+0000 7fe2b2000700 1 -- 172.21.15.72:0/2155258555 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe2a000f460 con 0x7fe2b4074d80 2024-03-19T06:04:33.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.459+0000 7fe2b2000700 1 -- 172.21.15.72:0/2155258555 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2a0021620 con 0x7fe2b4074d80 2024-03-19T06:04:33.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.460+0000 7fe2bc600700 1 -- 172.21.15.72:0/2155258555 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b406a8b0 con 0x7fe2b4074d80 2024-03-19T06:04:33.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.460+0000 7fe2bc600700 1 -- 172.21.15.72:0/2155258555 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b406ada0 con 0x7fe2b4074d80 2024-03-19T06:04:33.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.462+0000 7fe2a7400700 1 -- 172.21.15.72:0/2155258555 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2900052f0 con 0x7fe2b4074d80 2024-03-19T06:04:33.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.463+0000 7fe2b2000700 1 -- 172.21.15.72:0/2155258555 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 90908+0+0 (secure 0 0 0) 0x7fe2a000fa60 con 0x7fe2b4074d80 2024-03-19T06:04:33.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.464+0000 7fe2b2000700 1 --2- 172.21.15.72:0/2155258555 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fe29c06d280 0x7fe29c06f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:04:33.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.464+0000 7fe2b2000700 1 -- 172.21.15.72:0/2155258555 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fe2a008dc20 con 0x7fe2b4074d80 2024-03-19T06:04:33.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.464+0000 7fe2b9c00700 1 --2- 172.21.15.72:0/2155258555 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fe29c06d280 0x7fe29c06f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:04:33.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.466+0000 7fe2b9c00700 1 --2- 172.21.15.72:0/2155258555 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fe29c06d280 0x7fe29c06f730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8005950 tx=0x7fe2a800b500 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:04:33.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.473+0000 7fe2b2000700 1 -- 172.21.15.72:0/2155258555 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fe2a005b0f0 con 0x7fe2b4074d80 2024-03-19T06:04:33.537 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:33 smithi072 ceph-mon[28706]: pgmap v17: 65 pgs: 65 active+clean; 124 MiB data, 592 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 64 op/s 2024-03-19T06:04:33.538 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:33 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/577429509' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:04:33.736 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:33 smithi172 ceph-mon[35716]: pgmap v17: 65 pgs: 65 active+clean; 124 MiB data, 592 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 64 op/s 2024-03-19T06:04:33.736 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:33 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/577429509' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:04:33.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.853+0000 7fe2a7400700 1 -- 172.21.15.72:0/2155258555 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe290005160 con 0x7fe2b4074d80 2024-03-19T06:04:33.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.853+0000 7fe2b2000700 1 -- 172.21.15.72:0/2155258555 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe2a005ac80 con 0x7fe2b4074d80 2024-03-19T06:04:33.846 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:04:33.846 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:04:33.846 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:04:33.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.856+0000 7fe2a7400700 1 -- 172.21.15.72:0/2155258555 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fe29c06d280 msgr2=0x7fe29c06f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.856+0000 7fe2a7400700 1 --2- 172.21.15.72:0/2155258555 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fe29c06d280 0x7fe29c06f730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8005950 tx=0x7fe2a800b500 comp rx=0 tx=0).stop 2024-03-19T06:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.856+0000 7fe2a7400700 1 -- 172.21.15.72:0/2155258555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4074d80 msgr2=0x7fe2b419c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.856+0000 7fe2a7400700 1 --2- 172.21.15.72:0/2155258555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4074d80 0x7fe2b419c5b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0000c00 tx=0x7fe2a000bd70 comp rx=0 tx=0).stop 2024-03-19T06:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.856+0000 7fe2a7400700 1 -- 172.21.15.72:0/2155258555 shutdown_connections 2024-03-19T06:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.856+0000 7fe2a7400700 1 --2- 172.21.15.72:0/2155258555 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fe29c06d280 0x7fe29c06f730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.856+0000 7fe2a7400700 1 --2- 172.21.15.72:0/2155258555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b40737b0 0x7fe2b419c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.856+0000 7fe2a7400700 1 --2- 172.21.15.72:0/2155258555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4074d80 0x7fe2b419c5b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.856+0000 7fe2a7400700 1 -- 172.21.15.72:0/2155258555 >> 172.21.15.72:0/2155258555 conn(0x7fe2b40fb7f0 msgr2=0x7fe2b4101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.857+0000 7fe2a7400700 1 -- 172.21.15.72:0/2155258555 shutdown_connections 2024-03-19T06:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:04:33.857+0000 7fe2a7400700 1 -- 172.21.15.72:0/2155258555 wait complete. 2024-03-19T06:04:34.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:34 smithi072 ceph-mon[28706]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:04:34.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:34 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2155258555' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:04:34.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:34 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:04:34.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:34 smithi172 ceph-mon[35716]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:04:34.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:34 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2155258555' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:04:34.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:34 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:04:35.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:35 smithi072 ceph-mon[28706]: pgmap v18: 65 pgs: 65 active+clean; 124 MiB data, 592 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 64 op/s 2024-03-19T06:04:35.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:35 smithi172 ceph-mon[35716]: pgmap v18: 65 pgs: 65 active+clean; 124 MiB data, 592 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 64 op/s 2024-03-19T06:04:37.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:37 smithi072 ceph-mon[28706]: pgmap v19: 65 pgs: 65 active+clean; 133 MiB data, 628 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 108 op/s 2024-03-19T06:04:37.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:37 smithi172 ceph-mon[35716]: pgmap v19: 65 pgs: 65 active+clean; 133 MiB data, 628 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 108 op/s 2024-03-19T06:04:39.826 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:39 smithi172 ceph-mon[35716]: pgmap v20: 65 pgs: 65 active+clean; 133 MiB data, 628 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 85 op/s 2024-03-19T06:04:39.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:39 smithi072 ceph-mon[28706]: pgmap v20: 65 pgs: 65 active+clean; 133 MiB data, 628 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 85 op/s 2024-03-19T06:04:41.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:41 smithi072 ceph-mon[28706]: pgmap v21: 65 pgs: 65 active+clean; 142 MiB data, 657 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 124 op/s 2024-03-19T06:04:41.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:41 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:41.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:41 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:41.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:41 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T06:04:41.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:41 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:04:41.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:41 smithi172 ceph-mon[35716]: pgmap v21: 65 pgs: 65 active+clean; 142 MiB data, 657 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 124 op/s 2024-03-19T06:04:41.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:41 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:41.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:41 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:41.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:41 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T06:04:41.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:41 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:04:42.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:42 smithi072 ceph-mon[28706]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T06:04:42.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:42 smithi072 ceph-mon[28706]: Upgrade: Need to upgrade myself (mgr.smithi172.qkcahs) 2024-03-19T06:04:42.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:42 smithi072 ceph-mon[28706]: Upgrade: Need to upgrade myself (mgr.smithi172.qkcahs) 2024-03-19T06:04:42.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:42 smithi172 ceph-mon[35716]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T06:04:42.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:42 smithi172 ceph-mon[35716]: Upgrade: Need to upgrade myself (mgr.smithi172.qkcahs) 2024-03-19T06:04:42.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:42 smithi172 ceph-mon[35716]: Upgrade: Need to upgrade myself (mgr.smithi172.qkcahs) 2024-03-19T06:04:43.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:43 smithi072 ceph-mon[28706]: pgmap v22: 65 pgs: 65 active+clean; 142 MiB data, 657 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 83 op/s 2024-03-19T06:04:43.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:43 smithi172 ceph-mon[35716]: pgmap v22: 65 pgs: 65 active+clean; 142 MiB data, 657 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 83 op/s 2024-03-19T06:04:45.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:45 smithi072 ceph-mon[28706]: pgmap v23: 65 pgs: 65 active+clean; 142 MiB data, 657 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 83 op/s 2024-03-19T06:04:45.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:45 smithi072 ceph-mon[28706]: Upgrade: Updating mgr.smithi072.jydpjk 2024-03-19T06:04:45.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:45 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:45.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:45 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.jydpjk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T06:04:45.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:45 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.jydpjk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T06:04:45.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:45 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T06:04:45.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:45 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:04:45.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:45 smithi072 ceph-mon[28706]: Deploying daemon mgr.smithi072.jydpjk on smithi072 2024-03-19T06:04:45.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:45 smithi172 ceph-mon[35716]: pgmap v23: 65 pgs: 65 active+clean; 142 MiB data, 657 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 83 op/s 2024-03-19T06:04:45.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:45 smithi172 ceph-mon[35716]: Upgrade: Updating mgr.smithi072.jydpjk 2024-03-19T06:04:45.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:45 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:45.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:45 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.jydpjk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T06:04:45.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:45 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.jydpjk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T06:04:45.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:45 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T06:04:45.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:45 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:04:45.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:45 smithi172 ceph-mon[35716]: Deploying daemon mgr.smithi072.jydpjk on smithi072 2024-03-19T06:04:47.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:47 smithi072 ceph-mon[28706]: pgmap v24: 65 pgs: 65 active+clean; 148 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 120 op/s 2024-03-19T06:04:47.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:47 smithi172 ceph-mon[35716]: pgmap v24: 65 pgs: 65 active+clean; 148 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 120 op/s 2024-03-19T06:04:49.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:49 smithi072 ceph-mon[28706]: pgmap v25: 65 pgs: 65 active+clean; 148 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 76 op/s 2024-03-19T06:04:49.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:49 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:04:49.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:49 smithi172 ceph-mon[35716]: pgmap v25: 65 pgs: 65 active+clean; 148 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 MiB/s wr, 76 op/s 2024-03-19T06:04:49.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:49 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:04:51.524 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:51 smithi072 ceph-mon[28706]: pgmap v26: 65 pgs: 65 active+clean; 156 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 129 op/s 2024-03-19T06:04:51.525 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:51 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:51.525 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:51 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:51.525 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:51 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:04:51.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:51 smithi172 ceph-mon[35716]: pgmap v26: 65 pgs: 65 active+clean; 156 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 129 op/s 2024-03-19T06:04:51.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:51 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:51.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:51 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:51.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:51 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:04:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:52 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:52 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:52 smithi072 ceph-mon[28706]: pgmap v27: 65 pgs: 65 active+clean; 156 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 90 op/s 2024-03-19T06:04:53.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:52 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:53.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:52 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:04:53.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:52 smithi172 ceph-mon[35716]: pgmap v27: 65 pgs: 65 active+clean; 156 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 90 op/s 2024-03-19T06:04:55.048 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:55 smithi072 ceph-mon[28706]: pgmap v28: 65 pgs: 65 active+clean; 156 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 90 op/s 2024-03-19T06:04:55.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:55 smithi172 ceph-mon[35716]: pgmap v28: 65 pgs: 65 active+clean; 156 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 90 op/s 2024-03-19T06:04:57.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:57 smithi072 ceph-mon[28706]: pgmap v29: 65 pgs: 65 active+clean; 168 MiB data, 765 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 168 op/s 2024-03-19T06:04:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:57 smithi172 ceph-mon[35716]: pgmap v29: 65 pgs: 65 active+clean; 168 MiB data, 765 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 168 op/s 2024-03-19T06:04:58.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:58 smithi072 ceph-mon[28706]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:04:58.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:58 smithi172 ceph-mon[35716]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:04:59.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:04:59 smithi072 ceph-mon[28706]: pgmap v30: 65 pgs: 65 active+clean; 168 MiB data, 765 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 130 op/s 2024-03-19T06:04:59.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:04:59 smithi172 ceph-mon[35716]: pgmap v30: 65 pgs: 65 active+clean; 168 MiB data, 765 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 130 op/s 2024-03-19T06:05:01.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:01 smithi072 ceph-mon[28706]: pgmap v31: 65 pgs: 65 active+clean; 180 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 213 op/s 2024-03-19T06:05:01.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:01 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:01.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:01 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:01.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:01 smithi172 ceph-mon[35716]: pgmap v31: 65 pgs: 65 active+clean; 180 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 213 op/s 2024-03-19T06:05:01.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:01 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:01.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:01 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:02.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:02 smithi072 ceph-mon[28706]: Standby manager daemon smithi072.jydpjk restarted 2024-03-19T06:05:02.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:02 smithi072 ceph-mon[28706]: Standby manager daemon smithi072.jydpjk started 2024-03-19T06:05:02.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:02 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.jydpjk/crt"}]: dispatch 2024-03-19T06:05:02.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:02 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T06:05:02.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:02 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.jydpjk/key"}]: dispatch 2024-03-19T06:05:02.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:02 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T06:05:02.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:02 smithi172 ceph-mon[35716]: Standby manager daemon smithi072.jydpjk restarted 2024-03-19T06:05:02.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:02 smithi172 ceph-mon[35716]: Standby manager daemon smithi072.jydpjk started 2024-03-19T06:05:02.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:02 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.jydpjk/crt"}]: dispatch 2024-03-19T06:05:02.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:02 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T06:05:02.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:02 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi072.jydpjk/key"}]: dispatch 2024-03-19T06:05:02.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:02 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T06:05:03.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:03 smithi072 ceph-mon[28706]: pgmap v32: 65 pgs: 65 active+clean; 180 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 160 op/s 2024-03-19T06:05:03.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:03 smithi072 ceph-mon[28706]: mgrmap e25: smithi172.qkcahs(active, since 58s), standbys: smithi072.jydpjk 2024-03-19T06:05:03.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:03 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:03.498 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:03 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:03.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:03 smithi172 ceph-mon[35716]: pgmap v32: 65 pgs: 65 active+clean; 180 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 160 op/s 2024-03-19T06:05:03.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:03 smithi172 ceph-mon[35716]: mgrmap e25: smithi172.qkcahs(active, since 58s), standbys: smithi072.jydpjk 2024-03-19T06:05:03.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:03 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:03.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:03 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:04.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.053+0000 7f7082200700 1 -- 172.21.15.72:0/3411706754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f707c103640 msgr2=0x7f707c103a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:04.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.053+0000 7f7082200700 1 --2- 172.21.15.72:0/3411706754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f707c103640 0x7f707c103a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7068009910 tx=0x7f7068009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:04.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.053+0000 7f7082200700 1 -- 172.21.15.72:0/3411706754 shutdown_connections 2024-03-19T06:05:04.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.053+0000 7f7082200700 1 --2- 172.21.15.72:0/3411706754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f707c103640 0x7f707c103a90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.053+0000 7f7082200700 1 --2- 172.21.15.72:0/3411706754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f707c102490 0x7f707c1028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.053+0000 7f7082200700 1 -- 172.21.15.72:0/3411706754 >> 172.21.15.72:0/3411706754 conn(0x7f707c0fda60 msgr2=0x7f707c0ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:04.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.054+0000 7f7082200700 1 -- 172.21.15.72:0/3411706754 shutdown_connections 2024-03-19T06:05:04.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.054+0000 7f7082200700 1 -- 172.21.15.72:0/3411706754 wait complete. 2024-03-19T06:05:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.055+0000 7f7082200700 1 Processor -- start 2024-03-19T06:05:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.055+0000 7f7082200700 1 -- start start 2024-03-19T06:05:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.055+0000 7f7082200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f707c102490 0x7f707c1938a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.055+0000 7f7082200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f707c103640 0x7f707c193de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.055+0000 7f7082200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c194320 con 0x7f707c102490 2024-03-19T06:05:04.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.055+0000 7f7082200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c194460 con 0x7f707c103640 2024-03-19T06:05:04.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.056+0000 7f707b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f707c102490 0x7f707c1938a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:04.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.056+0000 7f707b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f707c102490 0x7f707c1938a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37114/0 (socket says 172.21.15.72:37114) 2024-03-19T06:05:04.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.056+0000 7f707b400700 1 -- 172.21.15.72:0/2198759340 learned_addr learned my addr 172.21.15.72:0/2198759340 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:04.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.056+0000 7f707aa00700 1 --2- 172.21.15.72:0/2198759340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f707c103640 0x7f707c193de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:04.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.056+0000 7f707b400700 1 -- 172.21.15.72:0/2198759340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f707c103640 msgr2=0x7f707c193de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:04.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.056+0000 7f707b400700 1 --2- 172.21.15.72:0/2198759340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f707c103640 0x7f707c193de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.056+0000 7f707b400700 1 -- 172.21.15.72:0/2198759340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70680095f0 con 0x7f707c102490 2024-03-19T06:05:04.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.057+0000 7f707b400700 1 --2- 172.21.15.72:0/2198759340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f707c102490 0x7f707c1938a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f706c00c910 tx=0x7f706c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:04.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.057+0000 7f7073e00700 1 -- 172.21.15.72:0/2198759340 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f706c0041f0 con 0x7f707c102490 2024-03-19T06:05:04.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.057+0000 7f7073e00700 1 -- 172.21.15.72:0/2198759340 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f706c007db0 con 0x7f707c102490 2024-03-19T06:05:04.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.057+0000 7f7073e00700 1 -- 172.21.15.72:0/2198759340 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f706c003d60 con 0x7f707c102490 2024-03-19T06:05:04.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.057+0000 7f7082200700 1 -- 172.21.15.72:0/2198759340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c1a9fb0 con 0x7f707c102490 2024-03-19T06:05:04.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.057+0000 7f7082200700 1 -- 172.21.15.72:0/2198759340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c1aa470 con 0x7f707c102490 2024-03-19T06:05:04.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.059+0000 7f7082200700 1 -- 172.21.15.72:0/2198759340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c10af90 con 0x7f707c102490 2024-03-19T06:05:04.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.060+0000 7f7073e00700 1 -- 172.21.15.72:0/2198759340 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91798+0+0 (secure 0 0 0) 0x7f706c007900 con 0x7f707c102490 2024-03-19T06:05:04.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.062+0000 7f7073e00700 1 --2- 172.21.15.72:0/2198759340 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f706006dd60 0x7f7060070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:04.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.062+0000 7f7073e00700 1 -- 172.21.15.72:0/2198759340 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f706c08d5a0 con 0x7f707c102490 2024-03-19T06:05:04.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.062+0000 7f707aa00700 1 --2- 172.21.15.72:0/2198759340 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f706006dd60 0x7f7060070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:04.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.064+0000 7f707aa00700 1 --2- 172.21.15.72:0/2198759340 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f706006dd60 0x7f7060070210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f70680059d0 tx=0x7f7068005920 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:04.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.071+0000 7f7073e00700 1 -- 172.21.15.72:0/2198759340 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f706c05a990 con 0x7f707c102490 2024-03-19T06:05:04.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:04 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:05:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.395+0000 7f7082200700 1 -- 172.21.15.72:0/2198759340 --> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f707c107f90 con 0x7f706006dd60 2024-03-19T06:05:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.398+0000 7f7073e00700 1 -- 172.21.15.72:0/2198759340 <== mgr.24319 v2:172.21.15.172:6828/1633747146 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f707c107f90 con 0x7f706006dd60 2024-03-19T06:05:04.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.401+0000 7f7082200700 1 -- 172.21.15.72:0/2198759340 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f706006dd60 msgr2=0x7f7060070210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:04.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.401+0000 7f7082200700 1 --2- 172.21.15.72:0/2198759340 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f706006dd60 0x7f7060070210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f70680059d0 tx=0x7f7068005920 comp rx=0 tx=0).stop 2024-03-19T06:05:04.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.401+0000 7f7082200700 1 -- 172.21.15.72:0/2198759340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f707c102490 msgr2=0x7f707c1938a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:04.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.401+0000 7f7082200700 1 --2- 172.21.15.72:0/2198759340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f707c102490 0x7f707c1938a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f706c00c910 tx=0x7f706c00ccd0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.401+0000 7f7082200700 1 -- 172.21.15.72:0/2198759340 shutdown_connections 2024-03-19T06:05:04.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.401+0000 7f7082200700 1 --2- 172.21.15.72:0/2198759340 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f706006dd60 0x7f7060070210 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.401+0000 7f7082200700 1 --2- 172.21.15.72:0/2198759340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f707c102490 0x7f707c1938a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.401+0000 7f7082200700 1 --2- 172.21.15.72:0/2198759340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f707c103640 0x7f707c193de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.401+0000 7f7082200700 1 -- 172.21.15.72:0/2198759340 >> 172.21.15.72:0/2198759340 conn(0x7f707c0fda60 msgr2=0x7f707c106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:04.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.401+0000 7f7082200700 1 -- 172.21.15.72:0/2198759340 shutdown_connections 2024-03-19T06:05:04.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.401+0000 7f7082200700 1 -- 172.21.15.72:0/2198759340 wait complete. 2024-03-19T06:05:04.408 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:05:04.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.560+0000 7fc6ec600700 1 -- 172.21.15.72:0/2873367783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e4102430 msgr2=0x7fc6e4102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:04.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.560+0000 7fc6ec600700 1 --2- 172.21.15.72:0/2873367783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e4102430 0x7fc6e4102840 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009910 tx=0x7fc6d8009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:04.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.560+0000 7fc6ec600700 1 -- 172.21.15.72:0/2873367783 shutdown_connections 2024-03-19T06:05:04.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.560+0000 7fc6ec600700 1 --2- 172.21.15.72:0/2873367783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6e41036d0 0x7fc6e4103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.560+0000 7fc6ec600700 1 --2- 172.21.15.72:0/2873367783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e4102430 0x7fc6e4102840 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.560+0000 7fc6ec600700 1 -- 172.21.15.72:0/2873367783 >> 172.21.15.72:0/2873367783 conn(0x7fc6e40fda80 msgr2=0x7fc6e40ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:04.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.560+0000 7fc6ec600700 1 -- 172.21.15.72:0/2873367783 shutdown_connections 2024-03-19T06:05:04.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.560+0000 7fc6ec600700 1 -- 172.21.15.72:0/2873367783 wait complete. 2024-03-19T06:05:04.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.561+0000 7fc6ec600700 1 Processor -- start 2024-03-19T06:05:04.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.562+0000 7fc6ec600700 1 -- start start 2024-03-19T06:05:04.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.562+0000 7fc6ec600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e4102430 0x7fc6e4197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.562+0000 7fc6ec600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6e41036d0 0x7fc6e4198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.562+0000 7fc6ec600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4198850 con 0x7fc6e4102430 2024-03-19T06:05:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.562+0000 7fc6ec600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e419d260 con 0x7fc6e41036d0 2024-03-19T06:05:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.562+0000 7fc6e9c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e4102430 0x7fc6e4197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.562+0000 7fc6e9c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e4102430 0x7fc6e4197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37128/0 (socket says 172.21.15.72:37128) 2024-03-19T06:05:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.562+0000 7fc6e9c00700 1 -- 172.21.15.72:0/840266225 learned_addr learned my addr 172.21.15.72:0/840266225 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.562+0000 7fc6e9200700 1 --2- 172.21.15.72:0/840266225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6e41036d0 0x7fc6e4198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.563+0000 7fc6e9c00700 1 -- 172.21.15.72:0/840266225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6e41036d0 msgr2=0x7fc6e4198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.563+0000 7fc6e9c00700 1 --2- 172.21.15.72:0/840266225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6e41036d0 0x7fc6e4198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.563+0000 7fc6e9c00700 1 -- 172.21.15.72:0/840266225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d80095f0 con 0x7fc6e4102430 2024-03-19T06:05:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.563+0000 7fc6e9c00700 1 --2- 172.21.15.72:0/840266225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e4102430 0x7fc6e4197cf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8005b40 tx=0x7fc6d800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.563+0000 7fc6e2000700 1 -- 172.21.15.72:0/840266225 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d801d070 con 0x7fc6e4102430 2024-03-19T06:05:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.563+0000 7fc6e2000700 1 -- 172.21.15.72:0/840266225 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc6d800f460 con 0x7fc6e4102430 2024-03-19T06:05:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.563+0000 7fc6e2000700 1 -- 172.21.15.72:0/840266225 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d8021640 con 0x7fc6e4102430 2024-03-19T06:05:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.563+0000 7fc6ec600700 1 -- 172.21.15.72:0/840266225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e419d400 con 0x7fc6e4102430 2024-03-19T06:05:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.563+0000 7fc6ec600700 1 -- 172.21.15.72:0/840266225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e419d8c0 con 0x7fc6e4102430 2024-03-19T06:05:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.564+0000 7fc6ec600700 1 -- 172.21.15.72:0/840266225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e410af10 con 0x7fc6e4102430 2024-03-19T06:05:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.565+0000 7fc6e2000700 1 -- 172.21.15.72:0/840266225 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91798+0+0 (secure 0 0 0) 0x7fc6d800fa90 con 0x7fc6e4102430 2024-03-19T06:05:04.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.566+0000 7fc6e2000700 1 --2- 172.21.15.72:0/840266225 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fc6cc06dd50 0x7fc6cc070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:04.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.566+0000 7fc6e2000700 1 -- 172.21.15.72:0/840266225 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fc6d808eba0 con 0x7fc6e4102430 2024-03-19T06:05:04.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.567+0000 7fc6e9200700 1 --2- 172.21.15.72:0/840266225 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fc6cc06dd50 0x7fc6cc070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:04.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.568+0000 7fc6e9200700 1 --2- 172.21.15.72:0/840266225 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fc6cc06dd50 0x7fc6cc070200 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0005950 tx=0x7fc6d00058e0 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.571+0000 7fc6e2000700 1 -- 172.21.15.72:0/840266225 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fc6d8058460 con 0x7fc6e4102430 2024-03-19T06:05:04.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:04 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:05:04.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.852+0000 7fc6ec600700 1 -- 172.21.15.72:0/840266225 --> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6e4108020 con 0x7fc6cc06dd50 2024-03-19T06:05:04.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.855+0000 7fc6e2000700 1 -- 172.21.15.72:0/840266225 <== mgr.24319 v2:172.21.15.172:6828/1633747146 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fc6e4108020 con 0x7fc6cc06dd50 2024-03-19T06:05:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.858+0000 7fc6ec600700 1 -- 172.21.15.72:0/840266225 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fc6cc06dd50 msgr2=0x7fc6cc070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.858+0000 7fc6ec600700 1 --2- 172.21.15.72:0/840266225 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fc6cc06dd50 0x7fc6cc070200 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0005950 tx=0x7fc6d00058e0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.858+0000 7fc6ec600700 1 -- 172.21.15.72:0/840266225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e4102430 msgr2=0x7fc6e4197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.858+0000 7fc6ec600700 1 --2- 172.21.15.72:0/840266225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e4102430 0x7fc6e4197cf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8005b40 tx=0x7fc6d800be20 comp rx=0 tx=0).stop 2024-03-19T06:05:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.858+0000 7fc6ec600700 1 -- 172.21.15.72:0/840266225 shutdown_connections 2024-03-19T06:05:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.858+0000 7fc6ec600700 1 --2- 172.21.15.72:0/840266225 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fc6cc06dd50 0x7fc6cc070200 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.858+0000 7fc6ec600700 1 --2- 172.21.15.72:0/840266225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e4102430 0x7fc6e4197cf0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.858+0000 7fc6ec600700 1 --2- 172.21.15.72:0/840266225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6e41036d0 0x7fc6e4198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.858+0000 7fc6ec600700 1 -- 172.21.15.72:0/840266225 >> 172.21.15.72:0/840266225 conn(0x7fc6e40fda80 msgr2=0x7fc6e4106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.859+0000 7fc6ec600700 1 -- 172.21.15.72:0/840266225 shutdown_connections 2024-03-19T06:05:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:04.859+0000 7fc6ec600700 1 -- 172.21.15.72:0/840266225 wait complete. 2024-03-19T06:05:05.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.023+0000 7fbbf1c00700 1 -- 172.21.15.72:0/3240455500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbec0fef70 msgr2=0x7fbbec0ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.023+0000 7fbbf1c00700 1 --2- 172.21.15.72:0/3240455500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbec0fef70 0x7fbbec0ff380 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009910 tx=0x7fbbdc009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.024+0000 7fbbf1c00700 1 -- 172.21.15.72:0/3240455500 shutdown_connections 2024-03-19T06:05:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.024+0000 7fbbf1c00700 1 --2- 172.21.15.72:0/3240455500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec100170 0x7fbbec1005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.024+0000 7fbbf1c00700 1 --2- 172.21.15.72:0/3240455500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbec0fef70 0x7fbbec0ff380 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.024+0000 7fbbf1c00700 1 -- 172.21.15.72:0/3240455500 >> 172.21.15.72:0/3240455500 conn(0x7fbbec0fa520 msgr2=0x7fbbec0fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.024+0000 7fbbf1c00700 1 -- 172.21.15.72:0/3240455500 shutdown_connections 2024-03-19T06:05:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.024+0000 7fbbf1c00700 1 -- 172.21.15.72:0/3240455500 wait complete. 2024-03-19T06:05:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.025+0000 7fbbf1c00700 1 Processor -- start 2024-03-19T06:05:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.025+0000 7fbbf1c00700 1 -- start start 2024-03-19T06:05:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.026+0000 7fbbf1c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbec0fef70 0x7fbbec197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.026+0000 7fbbf1c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec100170 0x7fbbec197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.026+0000 7fbbf1c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec198590 con 0x7fbbec0fef70 2024-03-19T06:05:05.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.026+0000 7fbbf1c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec1986d0 con 0x7fbbec100170 2024-03-19T06:05:05.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.026+0000 7fbbebe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbec0fef70 0x7fbbec197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:05.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.026+0000 7fbbebe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbec0fef70 0x7fbbec197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37150/0 (socket says 172.21.15.72:37150) 2024-03-19T06:05:05.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.026+0000 7fbbebe00700 1 -- 172.21.15.72:0/2343602413 learned_addr learned my addr 172.21.15.72:0/2343602413 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:05.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.026+0000 7fbbe3e00700 1 --2- 172.21.15.72:0/2343602413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec100170 0x7fbbec197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:05.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.027+0000 7fbbebe00700 1 -- 172.21.15.72:0/2343602413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec100170 msgr2=0x7fbbec197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:05.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.027+0000 7fbbebe00700 1 --2- 172.21.15.72:0/2343602413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec100170 0x7fbbec197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.027+0000 7fbbebe00700 1 -- 172.21.15.72:0/2343602413 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0095f0 con 0x7fbbec0fef70 2024-03-19T06:05:05.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.027+0000 7fbbebe00700 1 --2- 172.21.15.72:0/2343602413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbec0fef70 0x7fbbec197a30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00bd70 tx=0x7fbbdc00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:05.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.027+0000 7fbbe9600700 1 -- 172.21.15.72:0/2343602413 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbdc01d070 con 0x7fbbec0fef70 2024-03-19T06:05:05.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.028+0000 7fbbe9600700 1 -- 172.21.15.72:0/2343602413 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbbdc005a00 con 0x7fbbec0fef70 2024-03-19T06:05:05.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.028+0000 7fbbf1c00700 1 -- 172.21.15.72:0/2343602413 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec19d120 con 0x7fbbec0fef70 2024-03-19T06:05:05.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.028+0000 7fbbe9600700 1 -- 172.21.15.72:0/2343602413 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbdc021410 con 0x7fbbec0fef70 2024-03-19T06:05:05.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.028+0000 7fbbf1c00700 1 -- 172.21.15.72:0/2343602413 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec19d610 con 0x7fbbec0fef70 2024-03-19T06:05:05.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.029+0000 7fbbf1c00700 1 -- 172.21.15.72:0/2343602413 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbec106260 con 0x7fbbec0fef70 2024-03-19T06:05:05.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.030+0000 7fbbe9600700 1 -- 172.21.15.72:0/2343602413 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91798+0+0 (secure 0 0 0) 0x7fbbdc00f860 con 0x7fbbec0fef70 2024-03-19T06:05:05.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.031+0000 7fbbe9600700 1 --2- 172.21.15.72:0/2343602413 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fbbd006dd50 0x7fbbd0070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:05.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.031+0000 7fbbe9600700 1 -- 172.21.15.72:0/2343602413 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fbbdc08ebc0 con 0x7fbbec0fef70 2024-03-19T06:05:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.032+0000 7fbbe3e00700 1 --2- 172.21.15.72:0/2343602413 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fbbd006dd50 0x7fbbd0070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:05.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.034+0000 7fbbe3e00700 1 --2- 172.21.15.72:0/2343602413 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fbbd006dd50 0x7fbbd0070200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4005950 tx=0x7fbbd400a300 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:05.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.037+0000 7fbbe9600700 1 -- 172.21.15.72:0/2343602413 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fbbdc05bfd0 con 0x7fbbec0fef70 2024-03-19T06:05:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.317+0000 7fbbf1c00700 1 -- 172.21.15.72:0/2343602413 --> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbec061190 con 0x7fbbd006dd50 2024-03-19T06:05:05.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.354+0000 7fbbe9600700 1 -- 172.21.15.72:0/2343602413 <== mgr.24319 v2:172.21.15.172:6828/1633747146 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fbbec061190 con 0x7fbbd006dd50 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (9m) 4s ago 11m 13.9M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (11m) 4s ago 11m 7814k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (10m) 48s ago 10m 7620k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (11m) 4s ago 11m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (10m) 48s ago 10m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (9m) 4s ago 11m 70.7M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (3m) 4s ago 3m 13.7M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (4m) 4s ago 4m 101M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (3m) 48s ago 3m 13.2M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (4m) 48s ago 4m 80.0M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (15s) 4s ago 13m 64.8M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (73s) 48s ago 10m 489M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 1aabb23d2304 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (13m) 4s ago 13m 50.7M 2048M 18.2.0 dc2bc1663786 77289e9e2b33 2024-03-19T06:05:05.347 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (9m) 48s ago 9m 38.7M 2048M 18.2.0 dc2bc1663786 31fba31e7d8a 2024-03-19T06:05:05.348 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (11m) 4s ago 11m 8056k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:05:05.348 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (10m) 48s ago 10m 7776k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:05:05.348 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (9m) 4s ago 9m 77.7M 1216M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:05:05.348 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (8m) 4s ago 8m 84.3M 1216M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:05:05.348 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (7m) 4s ago 7m 71.0M 1216M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:05:05.348 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (7m) 48s ago 7m 72.8M 2241M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:05:05.348 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (6m) 48s ago 6m 63.2M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:05:05.348 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (6m) 48s ago 6m 64.5M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:05:05.348 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (24s) 4s ago 10m 49.2M - 2.43.0 a07b618ecd1d 6f898c87718b 2024-03-19T06:05:05.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.357+0000 7fbbf1c00700 1 -- 172.21.15.72:0/2343602413 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fbbd006dd50 msgr2=0x7fbbd0070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:05.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.357+0000 7fbbf1c00700 1 --2- 172.21.15.72:0/2343602413 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fbbd006dd50 0x7fbbd0070200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4005950 tx=0x7fbbd400a300 comp rx=0 tx=0).stop 2024-03-19T06:05:05.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.357+0000 7fbbf1c00700 1 -- 172.21.15.72:0/2343602413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbec0fef70 msgr2=0x7fbbec197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:05.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.357+0000 7fbbf1c00700 1 --2- 172.21.15.72:0/2343602413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbec0fef70 0x7fbbec197a30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00bd70 tx=0x7fbbdc00bda0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.357+0000 7fbbf1c00700 1 -- 172.21.15.72:0/2343602413 shutdown_connections 2024-03-19T06:05:05.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.357+0000 7fbbf1c00700 1 --2- 172.21.15.72:0/2343602413 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fbbd006dd50 0x7fbbd0070200 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.357+0000 7fbbf1c00700 1 --2- 172.21.15.72:0/2343602413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbec0fef70 0x7fbbec197a30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.357+0000 7fbbf1c00700 1 --2- 172.21.15.72:0/2343602413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec100170 0x7fbbec197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.357+0000 7fbbf1c00700 1 -- 172.21.15.72:0/2343602413 >> 172.21.15.72:0/2343602413 conn(0x7fbbec0fa520 msgr2=0x7fbbec1033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:05.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.358+0000 7fbbf1c00700 1 -- 172.21.15.72:0/2343602413 shutdown_connections 2024-03-19T06:05:05.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.358+0000 7fbbf1c00700 1 -- 172.21.15.72:0/2343602413 wait complete. 2024-03-19T06:05:05.514 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:05 smithi072 ceph-mon[28706]: pgmap v33: 65 pgs: 65 active+clean; 180 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 160 op/s 2024-03-19T06:05:05.515 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:05 smithi072 ceph-mon[28706]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.535+0000 7fe60e000700 1 -- 172.21.15.72:0/1112893471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe608069270 msgr2=0x7fe608102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.535+0000 7fe60e000700 1 --2- 172.21.15.72:0/1112893471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe608069270 0x7fe608102dd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009910 tx=0x7fe5f8009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.535+0000 7fe60e000700 1 -- 172.21.15.72:0/1112893471 shutdown_connections 2024-03-19T06:05:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.535+0000 7fe60e000700 1 --2- 172.21.15.72:0/1112893471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe608103310 0x7fe608105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.535+0000 7fe60e000700 1 --2- 172.21.15.72:0/1112893471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe608069270 0x7fe608102dd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.535+0000 7fe60e000700 1 -- 172.21.15.72:0/1112893471 >> 172.21.15.72:0/1112893471 conn(0x7fe6080fa780 msgr2=0x7fe6080fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.535+0000 7fe60e000700 1 -- 172.21.15.72:0/1112893471 shutdown_connections 2024-03-19T06:05:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.535+0000 7fe60e000700 1 -- 172.21.15.72:0/1112893471 wait complete. 2024-03-19T06:05:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.537+0000 7fe60e000700 1 Processor -- start 2024-03-19T06:05:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.537+0000 7fe60e000700 1 -- start start 2024-03-19T06:05:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.537+0000 7fe60e000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe608103310 0x7fe608197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.537+0000 7fe60e000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6081982e0 0x7fe60819d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.537+0000 7fe60e000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe608198750 con 0x7fe6081982e0 2024-03-19T06:05:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.537+0000 7fe60e000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6081988c0 con 0x7fe608103310 2024-03-19T06:05:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.537+0000 7fe606a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6081982e0 0x7fe60819d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.537+0000 7fe606a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6081982e0 0x7fe60819d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37170/0 (socket says 172.21.15.72:37170) 2024-03-19T06:05:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.537+0000 7fe606a00700 1 -- 172.21.15.72:0/456325730 learned_addr learned my addr 172.21.15.72:0/456325730 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.538+0000 7fe607400700 1 --2- 172.21.15.72:0/456325730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe608103310 0x7fe608197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.538+0000 7fe606a00700 1 -- 172.21.15.72:0/456325730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe608103310 msgr2=0x7fe608197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.538+0000 7fe606a00700 1 --2- 172.21.15.72:0/456325730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe608103310 0x7fe608197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.538+0000 7fe606a00700 1 -- 172.21.15.72:0/456325730 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f80095f0 con 0x7fe6081982e0 2024-03-19T06:05:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.538+0000 7fe606a00700 1 --2- 172.21.15.72:0/456325730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6081982e0 0x7fe60819d310 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400b4b0 tx=0x7fe5f400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.538+0000 7fe5ffe00700 1 -- 172.21.15.72:0/456325730 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f4011800 con 0x7fe6081982e0 2024-03-19T06:05:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.538+0000 7fe5ffe00700 1 -- 172.21.15.72:0/456325730 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe5f4011e10 con 0x7fe6081982e0 2024-03-19T06:05:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.538+0000 7fe5ffe00700 1 -- 172.21.15.72:0/456325730 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f400f2e0 con 0x7fe6081982e0 2024-03-19T06:05:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.539+0000 7fe60e000700 1 -- 172.21.15.72:0/456325730 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60819d8b0 con 0x7fe6081982e0 2024-03-19T06:05:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.539+0000 7fe60e000700 1 -- 172.21.15.72:0/456325730 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60819ddd0 con 0x7fe6081982e0 2024-03-19T06:05:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.540+0000 7fe60e000700 1 -- 172.21.15.72:0/456325730 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6080fc340 con 0x7fe6081982e0 2024-03-19T06:05:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.541+0000 7fe5ffe00700 1 -- 172.21.15.72:0/456325730 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91798+0+0 (secure 0 0 0) 0x7fe5f4010380 con 0x7fe6081982e0 2024-03-19T06:05:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.542+0000 7fe5ffe00700 1 --2- 172.21.15.72:0/456325730 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fe5ec06dd50 0x7fe5ec070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.542+0000 7fe5ffe00700 1 -- 172.21.15.72:0/456325730 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fe5f408d2f0 con 0x7fe6081982e0 2024-03-19T06:05:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.543+0000 7fe607400700 1 --2- 172.21.15.72:0/456325730 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fe5ec06dd50 0x7fe5ec070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:05.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.544+0000 7fe607400700 1 --2- 172.21.15.72:0/456325730 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fe5ec06dd50 0x7fe5ec070200 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009fd0 tx=0x7fe5f800b540 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:05.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.547+0000 7fe5ffe00700 1 -- 172.21.15.72:0/456325730 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fe5f4056d60 con 0x7fe6081982e0 2024-03-19T06:05:05.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:05 smithi172 ceph-mon[35716]: pgmap v33: 65 pgs: 65 active+clean; 180 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 160 op/s 2024-03-19T06:05:05.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:05 smithi172 ceph-mon[35716]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:05.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.933+0000 7fe60e000700 1 -- 172.21.15.72:0/456325730 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe608069490 con 0x7fe6081982e0 2024-03-19T06:05:05.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.934+0000 7fe5ffe00700 1 -- 172.21.15.72:0/456325730 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fe5f405a420 con 0x7fe6081982e0 2024-03-19T06:05:05.927 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:05:05.927 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:05:05.927 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:05:05.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:05:05.927 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:05:05.928 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:05:05.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:05:05.928 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:05:05.928 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:05:05.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:05:05.928 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:05:05.929 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:05:05.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:05:05.929 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:05:05.929 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-03-19T06:05:05.929 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:05:05.929 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:05:05.930 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:05:05.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.937+0000 7fe60e000700 1 -- 172.21.15.72:0/456325730 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fe5ec06dd50 msgr2=0x7fe5ec070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:05.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.937+0000 7fe60e000700 1 --2- 172.21.15.72:0/456325730 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fe5ec06dd50 0x7fe5ec070200 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009fd0 tx=0x7fe5f800b540 comp rx=0 tx=0).stop 2024-03-19T06:05:05.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.937+0000 7fe60e000700 1 -- 172.21.15.72:0/456325730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6081982e0 msgr2=0x7fe60819d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:05.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.937+0000 7fe60e000700 1 --2- 172.21.15.72:0/456325730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6081982e0 0x7fe60819d310 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400b4b0 tx=0x7fe5f400b870 comp rx=0 tx=0).stop 2024-03-19T06:05:05.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.938+0000 7fe60e000700 1 -- 172.21.15.72:0/456325730 shutdown_connections 2024-03-19T06:05:05.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.938+0000 7fe60e000700 1 --2- 172.21.15.72:0/456325730 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fe5ec06dd50 0x7fe5ec070200 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.938+0000 7fe60e000700 1 --2- 172.21.15.72:0/456325730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe608103310 0x7fe608197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.938+0000 7fe60e000700 1 --2- 172.21.15.72:0/456325730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6081982e0 0x7fe60819d310 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:05.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.938+0000 7fe60e000700 1 -- 172.21.15.72:0/456325730 >> 172.21.15.72:0/456325730 conn(0x7fe6080fa780 msgr2=0x7fe6081006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:05.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.938+0000 7fe60e000700 1 -- 172.21.15.72:0/456325730 shutdown_connections 2024-03-19T06:05:05.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:05.938+0000 7fe60e000700 1 -- 172.21.15.72:0/456325730 wait complete. 2024-03-19T06:05:06.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.121+0000 7f0acf000700 1 -- 172.21.15.72:0/2352022680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac81003d0 msgr2=0x7f0ac8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:06.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.121+0000 7f0acf000700 1 --2- 172.21.15.72:0/2352022680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac81003d0 0x7f0ac8100840 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009910 tx=0x7f0ab4009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:06.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.121+0000 7f0acf000700 1 -- 172.21.15.72:0/2352022680 shutdown_connections 2024-03-19T06:05:06.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.121+0000 7f0acf000700 1 --2- 172.21.15.72:0/2352022680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac81003d0 0x7f0ac8100840 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:06.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.121+0000 7f0acf000700 1 --2- 172.21.15.72:0/2352022680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ac80ff130 0x7f0ac80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:06.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.122+0000 7f0acf000700 1 -- 172.21.15.72:0/2352022680 >> 172.21.15.72:0/2352022680 conn(0x7f0ac80fa780 msgr2=0x7f0ac80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:06.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.122+0000 7f0acf000700 1 -- 172.21.15.72:0/2352022680 shutdown_connections 2024-03-19T06:05:06.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.122+0000 7f0acf000700 1 -- 172.21.15.72:0/2352022680 wait complete. 2024-03-19T06:05:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.123+0000 7f0acf000700 1 Processor -- start 2024-03-19T06:05:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.123+0000 7f0acf000700 1 -- start start 2024-03-19T06:05:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.124+0000 7f0acf000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac80ff130 0x7f0ac8197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.124+0000 7f0acf000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ac81003d0 0x7f0ac81981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.124+0000 7f0acf000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac81987b0 con 0x7f0ac80ff130 2024-03-19T06:05:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.124+0000 7f0acf000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8198920 con 0x7f0ac81003d0 2024-03-19T06:05:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.124+0000 7f0ac7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac80ff130 0x7f0ac8197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.124+0000 7f0ac7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac80ff130 0x7f0ac8197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37184/0 (socket says 172.21.15.72:37184) 2024-03-19T06:05:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.124+0000 7f0ac7e00700 1 -- 172.21.15.72:0/1379088840 learned_addr learned my addr 172.21.15.72:0/1379088840 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.124+0000 7f0ac7e00700 1 -- 172.21.15.72:0/1379088840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ac81003d0 msgr2=0x7f0ac81981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.124+0000 7f0ac7400700 1 --2- 172.21.15.72:0/1379088840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ac81003d0 0x7f0ac81981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.124+0000 7f0ac7e00700 1 --2- 172.21.15.72:0/1379088840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ac81003d0 0x7f0ac81981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.124+0000 7f0ac7e00700 1 -- 172.21.15.72:0/1379088840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab40095f0 con 0x7f0ac80ff130 2024-03-19T06:05:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.125+0000 7f0ac7e00700 1 --2- 172.21.15.72:0/1379088840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac80ff130 0x7f0ac8197c70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800ada0 tx=0x7f0ab800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.125+0000 7f0ac4c00700 1 -- 172.21.15.72:0/1379088840 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ab800f070 con 0x7f0ac80ff130 2024-03-19T06:05:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.125+0000 7f0ac4c00700 1 -- 172.21.15.72:0/1379088840 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0ab8007bf0 con 0x7f0ac80ff130 2024-03-19T06:05:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.125+0000 7f0acf000700 1 -- 172.21.15.72:0/1379088840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac819d3b0 con 0x7f0ac80ff130 2024-03-19T06:05:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.125+0000 7f0ac4c00700 1 -- 172.21.15.72:0/1379088840 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ab8005670 con 0x7f0ac80ff130 2024-03-19T06:05:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.125+0000 7f0acf000700 1 -- 172.21.15.72:0/1379088840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac819d900 con 0x7f0ac80ff130 2024-03-19T06:05:06.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.126+0000 7f0acf000700 1 -- 172.21.15.72:0/1379088840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac8107c10 con 0x7f0ac80ff130 2024-03-19T06:05:06.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.127+0000 7f0ac4c00700 1 -- 172.21.15.72:0/1379088840 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91798+0+0 (secure 0 0 0) 0x7f0ab80058e0 con 0x7f0ac80ff130 2024-03-19T06:05:06.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.128+0000 7f0ac4c00700 1 --2- 172.21.15.72:0/1379088840 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f0aac06dd50 0x7f0aac070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:06.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.128+0000 7f0ac4c00700 1 -- 172.21.15.72:0/1379088840 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f0ab808d3a0 con 0x7f0ac80ff130 2024-03-19T06:05:06.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.129+0000 7f0ac7400700 1 --2- 172.21.15.72:0/1379088840 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f0aac06dd50 0x7f0aac070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:06.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.130+0000 7f0ac7400700 1 --2- 172.21.15.72:0/1379088840 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f0aac06dd50 0x7f0aac070200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4000c00 tx=0x7f0ab4005fb0 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:06.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.133+0000 7f0ac4c00700 1 -- 172.21.15.72:0/1379088840 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f0ab8056be0 con 0x7f0ac80ff130 2024-03-19T06:05:06.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.421+0000 7f0acf000700 1 -- 172.21.15.72:0/1379088840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0ac819df40 con 0x7f0ac80ff130 2024-03-19T06:05:06.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:06 smithi072 ceph-mon[28706]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:06.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:06 smithi172 ceph-mon[35716]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:06.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:06 smithi172 ceph-mon[35716]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:06.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:06 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/456325730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:05:06.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.676+0000 7f0ac4c00700 1 -- 172.21.15.72:0/1379088840 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1865 (secure 0 0 0) 0x7f0ab805a2a0 con 0x7f0ac80ff130 2024-03-19T06:05:06.673 INFO:teuthology.orchestra.run.smithi072.stdout:e15 2024-03-19T06:05:06.673 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:05:06.673 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:05:06.673 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:05:06.673 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 15 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:04:57.207619+0000 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:05:06.674 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:05:06.675 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:05:06.676 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:05:06.676 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:05:06.676 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:05:06.676 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:05:06.676 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:05:06.676 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:05:06.676 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:05:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.681+0000 7f0acf000700 1 -- 172.21.15.72:0/1379088840 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f0aac06dd50 msgr2=0x7f0aac070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.681+0000 7f0acf000700 1 --2- 172.21.15.72:0/1379088840 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f0aac06dd50 0x7f0aac070200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4000c00 tx=0x7f0ab4005fb0 comp rx=0 tx=0).stop 2024-03-19T06:05:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.681+0000 7f0acf000700 1 -- 172.21.15.72:0/1379088840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac80ff130 msgr2=0x7f0ac8197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.681+0000 7f0acf000700 1 --2- 172.21.15.72:0/1379088840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac80ff130 0x7f0ac8197c70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800ada0 tx=0x7f0ab800c330 comp rx=0 tx=0).stop 2024-03-19T06:05:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.684+0000 7f0acf000700 1 -- 172.21.15.72:0/1379088840 shutdown_connections 2024-03-19T06:05:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.684+0000 7f0acf000700 1 --2- 172.21.15.72:0/1379088840 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f0aac06dd50 0x7f0aac070200 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.684+0000 7f0acf000700 1 --2- 172.21.15.72:0/1379088840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac80ff130 0x7f0ac8197c70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.684+0000 7f0acf000700 1 --2- 172.21.15.72:0/1379088840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ac81003d0 0x7f0ac81981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.684+0000 7f0acf000700 1 -- 172.21.15.72:0/1379088840 >> 172.21.15.72:0/1379088840 conn(0x7f0ac80fa780 msgr2=0x7f0ac8068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.684+0000 7f0acf000700 1 -- 172.21.15.72:0/1379088840 shutdown_connections 2024-03-19T06:05:06.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.684+0000 7f0acf000700 1 -- 172.21.15.72:0/1379088840 wait complete. 2024-03-19T06:05:06.678 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2024-03-19T06:05:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.870+0000 7f35e8a00700 1 -- 172.21.15.72:0/1129617457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e4102230 msgr2=0x7f35e4102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.870+0000 7f35e8a00700 1 --2- 172.21.15.72:0/1129617457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e4102230 0x7f35e4102640 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009910 tx=0x7f35d4009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.870+0000 7f35e8a00700 1 -- 172.21.15.72:0/1129617457 shutdown_connections 2024-03-19T06:05:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.870+0000 7f35e8a00700 1 --2- 172.21.15.72:0/1129617457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e41034d0 0x7f35e4103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.870+0000 7f35e8a00700 1 --2- 172.21.15.72:0/1129617457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e4102230 0x7f35e4102640 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.870+0000 7f35e8a00700 1 -- 172.21.15.72:0/1129617457 >> 172.21.15.72:0/1129617457 conn(0x7f35e40fd8d0 msgr2=0x7f35e40ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.870+0000 7f35e8a00700 1 -- 172.21.15.72:0/1129617457 shutdown_connections 2024-03-19T06:05:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.870+0000 7f35e8a00700 1 -- 172.21.15.72:0/1129617457 wait complete. 2024-03-19T06:05:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.871+0000 7f35e8a00700 1 Processor -- start 2024-03-19T06:05:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.872+0000 7f35e8a00700 1 -- start start 2024-03-19T06:05:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.872+0000 7f35e8a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e4102230 0x7f35e4197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.872+0000 7f35e8a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e41034d0 0x7f35e4197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.872+0000 7f35e8a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e4198570 con 0x7f35e41034d0 2024-03-19T06:05:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.872+0000 7f35e8a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e41986b0 con 0x7f35e4102230 2024-03-19T06:05:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.872+0000 7f35e1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e41034d0 0x7f35e4197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.872+0000 7f35e1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e41034d0 0x7f35e4197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37200/0 (socket says 172.21.15.72:37200) 2024-03-19T06:05:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.872+0000 7f35e1e00700 1 -- 172.21.15.72:0/2715239325 learned_addr learned my addr 172.21.15.72:0/2715239325 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.873+0000 7f35e2800700 1 --2- 172.21.15.72:0/2715239325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e4102230 0x7f35e4197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.873+0000 7f35e1e00700 1 -- 172.21.15.72:0/2715239325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e4102230 msgr2=0x7f35e4197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.873+0000 7f35e1e00700 1 --2- 172.21.15.72:0/2715239325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e4102230 0x7f35e4197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.873+0000 7f35e1e00700 1 -- 172.21.15.72:0/2715239325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40095f0 con 0x7f35e41034d0 2024-03-19T06:05:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.873+0000 7f35e2800700 1 --2- 172.21.15.72:0/2715239325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e4102230 0x7f35e4197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:05:06.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.874+0000 7f35e1e00700 1 --2- 172.21.15.72:0/2715239325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e41034d0 0x7f35e4197f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c8a0 tx=0x7f35d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:06.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.874+0000 7f35db400700 1 -- 172.21.15.72:0/2715239325 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d000cea0 con 0x7f35e41034d0 2024-03-19T06:05:06.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.874+0000 7f35db400700 1 -- 172.21.15.72:0/2715239325 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35d0004830 con 0x7f35e41034d0 2024-03-19T06:05:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.874+0000 7f35e8a00700 1 -- 172.21.15.72:0/2715239325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e419d160 con 0x7f35e41034d0 2024-03-19T06:05:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.874+0000 7f35db400700 1 -- 172.21.15.72:0/2715239325 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d00055b0 con 0x7f35e41034d0 2024-03-19T06:05:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.874+0000 7f35e8a00700 1 -- 172.21.15.72:0/2715239325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e419d6b0 con 0x7f35e41034d0 2024-03-19T06:05:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.876+0000 7f35e8a00700 1 -- 172.21.15.72:0/2715239325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c4005320 con 0x7f35e41034d0 2024-03-19T06:05:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.877+0000 7f35db400700 1 -- 172.21.15.72:0/2715239325 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 91798+0+0 (secure 0 0 0) 0x7f35d0007ad0 con 0x7f35e41034d0 2024-03-19T06:05:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.878+0000 7f35db400700 1 --2- 172.21.15.72:0/2715239325 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f35c806dd50 0x7f35c8070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.878+0000 7f35db400700 1 -- 172.21.15.72:0/2715239325 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f35d008d680 con 0x7f35e41034d0 2024-03-19T06:05:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.879+0000 7f35e2800700 1 --2- 172.21.15.72:0/2715239325 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f35c806dd50 0x7f35c8070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:06.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.880+0000 7f35e2800700 1 --2- 172.21.15.72:0/2715239325 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f35c806dd50 0x7f35c8070200 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f35d4006010 tx=0x7f35d400b560 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:06.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:06.885+0000 7f35db400700 1 -- 172.21.15.72:0/2715239325 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f35d005a9f0 con 0x7f35e41034d0 2024-03-19T06:05:07.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:06 smithi072 ceph-mon[28706]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:07.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:06 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/456325730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:05:07.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.260+0000 7f35e8a00700 1 -- 172.21.15.72:0/2715239325 --> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35c4000bf0 con 0x7f35c806dd50 2024-03-19T06:05:07.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.263+0000 7f35db400700 1 -- 172.21.15.72:0/2715239325 <== mgr.24319 v2:172.21.15.172:6828/1633747146 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f35c4000bf0 con 0x7f35c806dd50 2024-03-19T06:05:07.255 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:05:07.255 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:05:07.255 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:05:07.255 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:05:07.255 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:05:07.255 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr" 2024-03-19T06:05:07.255 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:05:07.255 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "2/23 daemons upgraded", 2024-03-19T06:05:07.255 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mgr daemons", 2024-03-19T06:05:07.255 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:05:07.255 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:05:07.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.266+0000 7f35e8a00700 1 -- 172.21.15.72:0/2715239325 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f35c806dd50 msgr2=0x7f35c8070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:07.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.266+0000 7f35e8a00700 1 --2- 172.21.15.72:0/2715239325 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f35c806dd50 0x7f35c8070200 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f35d4006010 tx=0x7f35d400b560 comp rx=0 tx=0).stop 2024-03-19T06:05:07.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.266+0000 7f35e8a00700 1 -- 172.21.15.72:0/2715239325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e41034d0 msgr2=0x7f35e4197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:07.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.266+0000 7f35e8a00700 1 --2- 172.21.15.72:0/2715239325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e41034d0 0x7f35e4197f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f35d000c8a0 tx=0x7f35d000cc60 comp rx=0 tx=0).stop 2024-03-19T06:05:07.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.266+0000 7f35e8a00700 1 -- 172.21.15.72:0/2715239325 shutdown_connections 2024-03-19T06:05:07.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.266+0000 7f35e8a00700 1 --2- 172.21.15.72:0/2715239325 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7f35c806dd50 0x7f35c8070200 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:07.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.266+0000 7f35e8a00700 1 --2- 172.21.15.72:0/2715239325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e4102230 0x7f35e4197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.266+0000 7f35e8a00700 1 --2- 172.21.15.72:0/2715239325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e41034d0 0x7f35e4197f50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.266+0000 7f35e8a00700 1 -- 172.21.15.72:0/2715239325 >> 172.21.15.72:0/2715239325 conn(0x7f35e40fd8d0 msgr2=0x7f35e4106700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.266+0000 7f35e8a00700 1 -- 172.21.15.72:0/2715239325 shutdown_connections 2024-03-19T06:05:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.266+0000 7f35e8a00700 1 -- 172.21.15.72:0/2715239325 wait complete. 2024-03-19T06:05:07.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.440+0000 7fb111600700 1 -- 172.21.15.72:0/208197607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb10c101200 msgr2=0x7fb10c103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:07.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.440+0000 7fb111600700 1 --2- 172.21.15.72:0/208197607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb10c101200 0x7fb10c103680 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009910 tx=0x7fb0f4009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:07.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.440+0000 7fb111600700 1 -- 172.21.15.72:0/208197607 shutdown_connections 2024-03-19T06:05:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.440+0000 7fb111600700 1 --2- 172.21.15.72:0/208197607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb10c101200 0x7fb10c103680 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.440+0000 7fb111600700 1 --2- 172.21.15.72:0/208197607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10c0fe8a0 0x7fb10c100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.440+0000 7fb111600700 1 -- 172.21.15.72:0/208197607 >> 172.21.15.72:0/208197607 conn(0x7fb10c0fa4d0 msgr2=0x7fb10c0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.440+0000 7fb111600700 1 -- 172.21.15.72:0/208197607 shutdown_connections 2024-03-19T06:05:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.440+0000 7fb111600700 1 -- 172.21.15.72:0/208197607 wait complete. 2024-03-19T06:05:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.442+0000 7fb111600700 1 Processor -- start 2024-03-19T06:05:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.442+0000 7fb111600700 1 -- start start 2024-03-19T06:05:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.443+0000 7fb111600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb10c0fe8a0 0x7fb10c19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.443+0000 7fb111600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10c101200 0x7fb10c19c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.443+0000 7fb111600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c19c970 con 0x7fb10c0fe8a0 2024-03-19T06:05:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.443+0000 7fb111600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c19cab0 con 0x7fb10c101200 2024-03-19T06:05:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.444+0000 7fb10be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb10c0fe8a0 0x7fb10c19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.444+0000 7fb103e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10c101200 0x7fb10c19c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.444+0000 7fb103e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10c101200 0x7fb10c19c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:47910/0 (socket says 172.21.15.72:47910) 2024-03-19T06:05:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.444+0000 7fb103e00700 1 -- 172.21.15.72:0/2446935843 learned_addr learned my addr 172.21.15.72:0/2446935843 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.444+0000 7fb103e00700 1 -- 172.21.15.72:0/2446935843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb10c0fe8a0 msgr2=0x7fb10c19be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.444+0000 7fb103e00700 1 --2- 172.21.15.72:0/2446935843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb10c0fe8a0 0x7fb10c19be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.444+0000 7fb103e00700 1 -- 172.21.15.72:0/2446935843 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f40095f0 con 0x7fb10c101200 2024-03-19T06:05:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.445+0000 7fb10be00700 1 --2- 172.21.15.72:0/2446935843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb10c0fe8a0 0x7fb10c19be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:05:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.445+0000 7fb103e00700 1 --2- 172.21.15.72:0/2446935843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10c101200 0x7fb10c19c350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4006010 tx=0x7fb0f400bd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:07.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.447+0000 7fb109600700 1 -- 172.21.15.72:0/2446935843 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0f401d070 con 0x7fb10c101200 2024-03-19T06:05:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.447+0000 7fb109600700 1 -- 172.21.15.72:0/2446935843 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb0f400f460 con 0x7fb10c101200 2024-03-19T06:05:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.447+0000 7fb109600700 1 -- 172.21.15.72:0/2446935843 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0f4021620 con 0x7fb10c101200 2024-03-19T06:05:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.447+0000 7fb111600700 1 -- 172.21.15.72:0/2446935843 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c06a8b0 con 0x7fb10c101200 2024-03-19T06:05:07.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.448+0000 7fb111600700 1 -- 172.21.15.72:0/2446935843 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c06ada0 con 0x7fb10c101200 2024-03-19T06:05:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.450+0000 7fb111600700 1 -- 172.21.15.72:0/2446935843 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c196040 con 0x7fb10c101200 2024-03-19T06:05:07.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.452+0000 7fb109600700 1 -- 172.21.15.72:0/2446935843 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) v1 ==== 91798+0+0 (secure 0 0 0) 0x7fb0f400f5d0 con 0x7fb10c101200 2024-03-19T06:05:07.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.454+0000 7fb109600700 1 --2- 172.21.15.72:0/2446935843 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fb0f006dd50 0x7fb0f0070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:07.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.454+0000 7fb109600700 1 -- 172.21.15.72:0/2446935843 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fb0f408f090 con 0x7fb10c101200 2024-03-19T06:05:07.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.454+0000 7fb10be00700 1 --2- 172.21.15.72:0/2446935843 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fb0f006dd50 0x7fb0f0070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:07.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.456+0000 7fb10be00700 1 --2- 172.21.15.72:0/2446935843 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fb0f006dd50 0x7fb0f0070200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc005950 tx=0x7fb0fc00a300 comp rx=0 tx=0).ready entity=mgr.24319 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:07.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.458+0000 7fb109600700 1 -- 172.21.15.72:0/2446935843 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fb0f405c500 con 0x7fb10c101200 2024-03-19T06:05:07.557 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:07 smithi172 ceph-mon[35716]: pgmap v34: 65 pgs: 65 active+clean; 188 MiB data, 798 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 249 op/s 2024-03-19T06:05:07.557 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:07 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1379088840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:05:07.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:07 smithi072 ceph-mon[28706]: pgmap v34: 65 pgs: 65 active+clean; 188 MiB data, 798 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 249 op/s 2024-03-19T06:05:07.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:07 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1379088840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:05:07.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.843+0000 7fb111600700 1 -- 172.21.15.72:0/2446935843 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb10c02cc30 con 0x7fb10c101200 2024-03-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.844+0000 7fb109600700 1 -- 172.21.15.72:0/2446935843 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fb0f4026090 con 0x7fb10c101200 2024-03-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.848+0000 7fb111600700 1 -- 172.21.15.72:0/2446935843 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fb0f006dd50 msgr2=0x7fb0f0070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:07.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.848+0000 7fb111600700 1 --2- 172.21.15.72:0/2446935843 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fb0f006dd50 0x7fb0f0070200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc005950 tx=0x7fb0fc00a300 comp rx=0 tx=0).stop 2024-03-19T06:05:07.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.848+0000 7fb111600700 1 -- 172.21.15.72:0/2446935843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10c101200 msgr2=0x7fb10c19c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:07.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.848+0000 7fb111600700 1 --2- 172.21.15.72:0/2446935843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10c101200 0x7fb10c19c350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4006010 tx=0x7fb0f400bd50 comp rx=0 tx=0).stop 2024-03-19T06:05:07.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.848+0000 7fb111600700 1 -- 172.21.15.72:0/2446935843 shutdown_connections 2024-03-19T06:05:07.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.848+0000 7fb111600700 1 --2- 172.21.15.72:0/2446935843 >> [v2:172.21.15.172:6828/1633747146,v1:172.21.15.172:6829/1633747146] conn(0x7fb0f006dd50 0x7fb0f0070200 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:07.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.848+0000 7fb111600700 1 --2- 172.21.15.72:0/2446935843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb10c0fe8a0 0x7fb10c19be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:07.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.848+0000 7fb111600700 1 --2- 172.21.15.72:0/2446935843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10c101200 0x7fb10c19c350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:07.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.848+0000 7fb111600700 1 -- 172.21.15.72:0/2446935843 >> 172.21.15.72:0/2446935843 conn(0x7fb10c0fa4d0 msgr2=0x7fb10c0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:07.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.848+0000 7fb111600700 1 -- 172.21.15.72:0/2446935843 shutdown_connections 2024-03-19T06:05:07.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:07.848+0000 7fb111600700 1 -- 172.21.15.72:0/2446935843 wait complete. 2024-03-19T06:05:08.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:08 smithi072 ceph-mon[28706]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:08.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:08 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2446935843' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:05:08.576 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:08 smithi172 ceph-mon[35716]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:08.576 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:08 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2446935843' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:05:09.284 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:09 smithi172 ceph-mon[35716]: pgmap v35: 65 pgs: 65 active+clean; 188 MiB data, 798 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 171 op/s 2024-03-19T06:05:09.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:09 smithi072 ceph-mon[28706]: pgmap v35: 65 pgs: 65 active+clean; 188 MiB data, 798 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.7 MiB/s wr, 171 op/s 2024-03-19T06:05:11.514 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:11 smithi072 ceph-mon[28706]: pgmap v36: 65 pgs: 65 active+clean; 198 MiB data, 827 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 225 op/s 2024-03-19T06:05:11.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:11 smithi172 ceph-mon[35716]: pgmap v36: 65 pgs: 65 active+clean; 198 MiB data, 827 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 225 op/s 2024-03-19T06:05:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:05:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:05:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:05:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mgr fail", "who": "smithi172.qkcahs"}]: dispatch 2024-03-19T06:05:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mgr fail", "who": "smithi172.qkcahs"}]: dispatch 2024-03-19T06:05:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: osdmap e47: 6 total, 6 up, 6 in 2024-03-19T06:05:13.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd='[{"prefix": "mgr fail", "who": "smithi172.qkcahs"}]': finished 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: mgrmap e26: smithi072.jydpjk(active, starting, since 0.0180645s) 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.nparnw"}]: dispatch 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi072.jydpjk", "id": "smithi072.jydpjk"}]: dispatch 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T06:05:13.406 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T06:05:13.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-19T06:05:13.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-19T06:05:13.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-19T06:05:13.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: Manager daemon smithi072.jydpjk is now available 2024-03-19T06:05:13.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:05:13.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:05:13.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:05:13.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/mirror_snapshot_schedule"}]: dispatch 2024-03-19T06:05:13.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/trash_purge_schedule"}]: dispatch 2024-03-19T06:05:13.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:13.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:13.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:05:13.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:05:13.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' 2024-03-19T06:05:13.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:05:13.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.24319 172.21.15.172:0/825048368' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mgr fail", "who": "smithi172.qkcahs"}]: dispatch 2024-03-19T06:05:13.499 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "mgr fail", "who": "smithi172.qkcahs"}]: dispatch 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: osdmap e47: 6 total, 6 up, 6 in 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.24319 ' entity='mgr.smithi172.qkcahs' cmd='[{"prefix": "mgr fail", "who": "smithi172.qkcahs"}]': finished 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: mgrmap e26: smithi072.jydpjk(active, starting, since 0.0180645s) 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.nparnw"}]: dispatch 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi072.jydpjk", "id": "smithi072.jydpjk"}]: dispatch 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T06:05:13.500 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T06:05:13.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T06:05:13.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T06:05:13.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-19T06:05:13.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-19T06:05:13.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-19T06:05:13.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: Manager daemon smithi072.jydpjk is now available 2024-03-19T06:05:13.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:05:13.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:05:13.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:05:13.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/mirror_snapshot_schedule"}]: dispatch 2024-03-19T06:05:13.501 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/trash_purge_schedule"}]: dispatch 2024-03-19T06:05:14.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:14 smithi072 ceph-mon[28706]: [19/Mar/2024:06:05:13] ENGINE Bus STARTING 2024-03-19T06:05:14.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:14 smithi072 ceph-mon[28706]: [19/Mar/2024:06:05:13] ENGINE Serving on http://172.21.15.72:8765 2024-03-19T06:05:14.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:14 smithi072 ceph-mon[28706]: [19/Mar/2024:06:05:13] ENGINE Serving on https://172.21.15.72:7150 2024-03-19T06:05:14.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:14 smithi072 ceph-mon[28706]: [19/Mar/2024:06:05:13] ENGINE Bus STARTED 2024-03-19T06:05:14.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:14 smithi072 ceph-mon[28706]: mgrmap e27: smithi072.jydpjk(active, since 1.01893s) 2024-03-19T06:05:14.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:14 smithi072 ceph-mon[28706]: pgmap v3: 65 pgs: 65 active+clean; 207 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:05:14.853 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:14 smithi172 ceph-mon[35716]: [19/Mar/2024:06:05:13] ENGINE Bus STARTING 2024-03-19T06:05:14.853 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:14 smithi172 ceph-mon[35716]: [19/Mar/2024:06:05:13] ENGINE Serving on http://172.21.15.72:8765 2024-03-19T06:05:14.853 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:14 smithi172 ceph-mon[35716]: [19/Mar/2024:06:05:13] ENGINE Serving on https://172.21.15.72:7150 2024-03-19T06:05:14.854 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:14 smithi172 ceph-mon[35716]: [19/Mar/2024:06:05:13] ENGINE Bus STARTED 2024-03-19T06:05:14.854 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:14 smithi172 ceph-mon[35716]: mgrmap e27: smithi072.jydpjk(active, since 1.01893s) 2024-03-19T06:05:14.854 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:14 smithi172 ceph-mon[35716]: pgmap v3: 65 pgs: 65 active+clean; 207 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:05:15.228 INFO:tasks.workunit.client.1.smithi172.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-03-19T06:05:15.253 INFO:tasks.workunit.client.1.smithi172.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-03-19T06:05:15.253 INFO:tasks.workunit.client.1.smithi172.stderr:+ make 2024-03-19T06:05:15.559 INFO:tasks.workunit.client.1.smithi172.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-03-19T06:05:15.725 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:15 smithi172 ceph-mon[35716]: pgmap v4: 65 pgs: 65 active+clean; 207 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:05:15.726 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:15 smithi172 ceph-mon[35716]: mgrmap e28: smithi072.jydpjk(active, since 2s) 2024-03-19T06:05:15.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:15 smithi072 ceph-mon[28706]: pgmap v4: 65 pgs: 65 active+clean; 207 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:05:15.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:15 smithi072 ceph-mon[28706]: mgrmap e28: smithi072.jydpjk(active, since 2s) 2024-03-19T06:05:16.879 INFO:tasks.workunit.client.1.smithi172.stderr:++ readlink -f fsstress 2024-03-19T06:05:16.884 INFO:tasks.workunit.client.1.smithi172.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-03-19T06:05:16.884 INFO:tasks.workunit.client.1.smithi172.stderr:+ popd 2024-03-19T06:05:16.886 INFO:tasks.workunit.client.1.smithi172.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-03-19T06:05:16.887 INFO:tasks.workunit.client.1.smithi172.stderr:+ popd 2024-03-19T06:05:16.888 INFO:tasks.workunit.client.1.smithi172.stdout:~/cephtest/mnt.1/client.1/tmp 2024-03-19T06:05:16.888 INFO:tasks.workunit.client.1.smithi172.stderr:++ mktemp -d -p . 2024-03-19T06:05:16.894 INFO:tasks.workunit.client.1.smithi172.stderr:+ T=./tmp.nIpYvxUuyy 2024-03-19T06:05:16.894 INFO:tasks.workunit.client.1.smithi172.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.nIpYvxUuyy -l 1 -n 1000 -p 10 -v 2024-03-19T06:05:16.899 INFO:tasks.workunit.client.1.smithi172.stdout:seed = 1710541436 2024-03-19T06:05:16.908 INFO:tasks.workunit.client.1.smithi172.stdout:1/0: fsync - no filename 2024-03-19T06:05:16.908 INFO:tasks.workunit.client.1.smithi172.stdout:1/1: chown . 417 1 2024-03-19T06:05:16.908 INFO:tasks.workunit.client.1.smithi172.stdout:1/2: readlink - no filename 2024-03-19T06:05:16.909 INFO:tasks.workunit.client.1.smithi172.stdout:0/0: creat f0 x:0 0 0 2024-03-19T06:05:16.910 INFO:tasks.workunit.client.1.smithi172.stdout:0/1: chown f0 16 1 2024-03-19T06:05:16.911 INFO:tasks.workunit.client.1.smithi172.stdout:1/3: getdents . 0 2024-03-19T06:05:16.912 INFO:tasks.workunit.client.1.smithi172.stdout:1/4: write - no filename 2024-03-19T06:05:16.914 INFO:tasks.workunit.client.1.smithi172.stdout:3/0: stat - no entries 2024-03-19T06:05:16.914 INFO:tasks.workunit.client.1.smithi172.stdout:1/5: creat f0 x:0 0 0 2024-03-19T06:05:16.916 INFO:tasks.workunit.client.1.smithi172.stdout:4/0: unlink - no file 2024-03-19T06:05:16.916 INFO:tasks.workunit.client.1.smithi172.stdout:1/6: mknod c1 0 2024-03-19T06:05:16.918 INFO:tasks.workunit.client.1.smithi172.stdout:1/7: chown c1 214197 1 2024-03-19T06:05:16.918 INFO:tasks.workunit.client.1.smithi172.stdout:3/1: mkdir d0 0 2024-03-19T06:05:16.918 INFO:tasks.workunit.client.1.smithi172.stdout:3/2: write - no filename 2024-03-19T06:05:16.918 INFO:tasks.workunit.client.1.smithi172.stdout:3/3: write - no filename 2024-03-19T06:05:16.920 INFO:tasks.workunit.client.1.smithi172.stdout:5/0: dread - no filename 2024-03-19T06:05:16.920 INFO:tasks.workunit.client.1.smithi172.stdout:5/1: rename - no filename 2024-03-19T06:05:16.921 INFO:tasks.workunit.client.1.smithi172.stdout:5/2: write - no filename 2024-03-19T06:05:16.921 INFO:tasks.workunit.client.1.smithi172.stdout:5/3: write - no filename 2024-03-19T06:05:16.922 INFO:tasks.workunit.client.1.smithi172.stdout:4/1: mknod c0 0 2024-03-19T06:05:16.922 INFO:tasks.workunit.client.1.smithi172.stdout:4/2: write - no filename 2024-03-19T06:05:16.924 INFO:tasks.workunit.client.1.smithi172.stdout:6/0: rename - no filename 2024-03-19T06:05:16.924 INFO:tasks.workunit.client.1.smithi172.stdout:6/1: dread - no filename 2024-03-19T06:05:16.924 INFO:tasks.workunit.client.1.smithi172.stdout:6/2: dread - no filename 2024-03-19T06:05:16.924 INFO:tasks.workunit.client.1.smithi172.stdout:3/4: getdents d0 0 2024-03-19T06:05:17.038 INFO:tasks.workunit.client.1.smithi172.stdout:3/5: rename d0 to d0/d1 22 2024-03-19T06:05:17.039 INFO:tasks.workunit.client.1.smithi172.stdout:4/3: symlink l1 0 2024-03-19T06:05:17.039 INFO:tasks.workunit.client.1.smithi172.stdout:4/4: write - no filename 2024-03-19T06:05:17.041 INFO:tasks.workunit.client.1.smithi172.stdout:5/4: creat f0 x:0 0 0 2024-03-19T06:05:17.045 INFO:tasks.workunit.client.1.smithi172.stdout:7/0: write - no filename 2024-03-19T06:05:17.046 INFO:tasks.workunit.client.1.smithi172.stdout:4/5: mknod c2 0 2024-03-19T06:05:17.046 INFO:tasks.workunit.client.1.smithi172.stdout:4/6: write - no filename 2024-03-19T06:05:17.047 INFO:tasks.workunit.client.1.smithi172.stdout:7/1: chown . 892661 1 2024-03-19T06:05:17.047 INFO:tasks.workunit.client.1.smithi172.stdout:7/2: readlink - no filename 2024-03-19T06:05:17.047 INFO:tasks.workunit.client.1.smithi172.stdout:7/3: dwrite - no filename 2024-03-19T06:05:17.049 INFO:tasks.workunit.client.1.smithi172.stdout:5/5: symlink l1 0 2024-03-19T06:05:17.052 INFO:tasks.workunit.client.1.smithi172.stdout:5/6: write f0 [998365,124892] 0 2024-03-19T06:05:17.055 INFO:tasks.workunit.client.1.smithi172.stdout:6/3: mknod c0 0 2024-03-19T06:05:17.055 INFO:tasks.workunit.client.1.smithi172.stdout:6/4: read - no filename 2024-03-19T06:05:17.055 INFO:tasks.workunit.client.1.smithi172.stdout:6/5: write - no filename 2024-03-19T06:05:17.055 INFO:tasks.workunit.client.1.smithi172.stdout:6/6: dread - no filename 2024-03-19T06:05:17.056 INFO:tasks.workunit.client.1.smithi172.stdout:8/0: dread - no filename 2024-03-19T06:05:17.056 INFO:tasks.workunit.client.1.smithi172.stdout:8/1: dwrite - no filename 2024-03-19T06:05:17.060 INFO:tasks.workunit.client.1.smithi172.stdout:1/8: dwrite f0 [0,4194304] 0 2024-03-19T06:05:17.062 INFO:tasks.workunit.client.1.smithi172.stdout:3/6: creat d0/f2 x:0 0 0 2024-03-19T06:05:17.063 INFO:tasks.workunit.client.1.smithi172.stdout:3/7: chown d0/f2 1004 1 2024-03-19T06:05:17.064 INFO:tasks.workunit.client.1.smithi172.stdout:3/8: truncate d0/f2 550033 0 2024-03-19T06:05:17.066 INFO:tasks.workunit.client.1.smithi172.stdout:3/9: write d0/f2 [191769,54335] 0 2024-03-19T06:05:17.069 INFO:tasks.workunit.client.1.smithi172.stdout:4/7: rename c0 to c3 0 2024-03-19T06:05:17.079 INFO:tasks.workunit.client.1.smithi172.stdout:9/0: chown . 60477 1 2024-03-19T06:05:17.084 INFO:tasks.workunit.client.1.smithi172.stdout:1/9: unlink c1 0 2024-03-19T06:05:17.086 INFO:tasks.workunit.client.1.smithi172.stdout:1/10: stat f0 0 2024-03-19T06:05:17.087 INFO:tasks.workunit.client.1.smithi172.stdout:1/11: stat f0 0 2024-03-19T06:05:17.089 INFO:tasks.workunit.client.1.smithi172.stdout:3/10: mknod d0/c3 0 2024-03-19T06:05:17.090 INFO:tasks.workunit.client.1.smithi172.stdout:4/8: mknod c4 0 2024-03-19T06:05:17.090 INFO:tasks.workunit.client.1.smithi172.stdout:4/9: write - no filename 2024-03-19T06:05:17.090 INFO:tasks.workunit.client.1.smithi172.stdout:3/11: chown d0/c3 0 1 2024-03-19T06:05:17.091 INFO:tasks.workunit.client.1.smithi172.stdout:4/10: readlink l1 0 2024-03-19T06:05:17.091 INFO:tasks.workunit.client.1.smithi172.stdout:4/11: dwrite - no filename 2024-03-19T06:05:17.091 INFO:tasks.workunit.client.1.smithi172.stdout:4/12: dread - no filename 2024-03-19T06:05:17.094 INFO:tasks.workunit.client.1.smithi172.stdout:5/7: link f0 f2 0 2024-03-19T06:05:17.097 INFO:tasks.workunit.client.1.smithi172.stdout:8/2: mkdir d0 0 2024-03-19T06:05:17.097 INFO:tasks.workunit.client.1.smithi172.stdout:8/3: truncate - no filename 2024-03-19T06:05:17.097 INFO:tasks.workunit.client.1.smithi172.stdout:8/4: write - no filename 2024-03-19T06:05:17.097 INFO:tasks.workunit.client.1.smithi172.stdout:8/5: dread - no filename 2024-03-19T06:05:17.097 INFO:tasks.workunit.client.1.smithi172.stdout:8/6: write - no filename 2024-03-19T06:05:17.102 INFO:tasks.workunit.client.1.smithi172.stdout:4/13: symlink l5 0 2024-03-19T06:05:17.102 INFO:tasks.workunit.client.1.smithi172.stdout:4/14: dwrite - no filename 2024-03-19T06:05:17.102 INFO:tasks.workunit.client.1.smithi172.stdout:4/15: truncate - no filename 2024-03-19T06:05:17.103 INFO:tasks.workunit.client.1.smithi172.stdout:5/8: mknod c3 0 2024-03-19T06:05:17.106 INFO:tasks.workunit.client.1.smithi172.stdout:9/1: creat f0 x:0 0 0 2024-03-19T06:05:17.112 INFO:tasks.workunit.client.1.smithi172.stdout:4/16: creat f6 x:0 0 0 2024-03-19T06:05:17.113 INFO:tasks.workunit.client.1.smithi172.stdout:5/9: chown l1 7827 1 2024-03-19T06:05:17.115 INFO:tasks.workunit.client.1.smithi172.stdout:9/2: mkdir d1 0 2024-03-19T06:05:17.117 INFO:tasks.workunit.client.1.smithi172.stdout:8/7: creat d0/f1 x:0 0 0 2024-03-19T06:05:17.118 INFO:tasks.workunit.client.1.smithi172.stdout:4/17: chown c4 38990769 1 2024-03-19T06:05:17.122 INFO:tasks.workunit.client.1.smithi172.stdout:5/10: creat f4 x:0 0 0 2024-03-19T06:05:17.125 INFO:tasks.workunit.client.1.smithi172.stdout:4/18: creat f7 x:0 0 0 2024-03-19T06:05:17.127 INFO:tasks.workunit.client.1.smithi172.stdout:5/11: mkdir d5 0 2024-03-19T06:05:17.127 INFO:tasks.workunit.client.1.smithi172.stdout:8/8: chown d0/f1 7241593 1 2024-03-19T06:05:17.127 INFO:tasks.workunit.client.1.smithi172.stdout:9/3: symlink d1/l2 0 2024-03-19T06:05:17.128 INFO:tasks.workunit.client.1.smithi172.stdout:3/12: dwrite d0/f2 [0,4194304] 0 2024-03-19T06:05:17.130 INFO:tasks.workunit.client.1.smithi172.stdout:9/4: chown d1 1813847 1 2024-03-19T06:05:17.132 INFO:tasks.workunit.client.1.smithi172.stdout:8/9: truncate d0/f1 1033644 0 2024-03-19T06:05:17.133 INFO:tasks.workunit.client.1.smithi172.stdout:3/13: write d0/f2 [1106226,127027] 0 2024-03-19T06:05:17.135 INFO:tasks.workunit.client.1.smithi172.stdout:9/5: rmdir d1 39 2024-03-19T06:05:17.136 INFO:tasks.workunit.client.1.smithi172.stdout:5/12: creat d5/f6 x:0 0 0 2024-03-19T06:05:17.142 INFO:tasks.workunit.client.1.smithi172.stdout:5/13: creat d5/f7 x:0 0 0 2024-03-19T06:05:17.178 INFO:tasks.workunit.client.1.smithi172.stdout:5/14: dwrite f0 [0,4194304] 0 2024-03-19T06:05:17.185 INFO:tasks.workunit.client.1.smithi172.stdout:5/15: rename f0 to d5/f8 0 2024-03-19T06:05:17.190 INFO:tasks.workunit.client.1.smithi172.stdout:5/16: creat d5/f9 x:0 0 0 2024-03-19T06:05:17.193 INFO:tasks.workunit.client.1.smithi172.stdout:5/17: rename d5 to d5/da 22 2024-03-19T06:05:17.194 INFO:tasks.workunit.client.1.smithi172.stdout:3/14: fsync d0/f2 0 2024-03-19T06:05:17.194 INFO:tasks.workunit.client.1.smithi172.stdout:6/7: getdents . 0 2024-03-19T06:05:17.194 INFO:tasks.workunit.client.1.smithi172.stdout:6/8: dwrite - no filename 2024-03-19T06:05:17.194 INFO:tasks.workunit.client.1.smithi172.stdout:6/9: readlink - no filename 2024-03-19T06:05:17.194 INFO:tasks.workunit.client.1.smithi172.stdout:6/10: readlink - no filename 2024-03-19T06:05:17.194 INFO:tasks.workunit.client.1.smithi172.stdout:6/11: rmdir - no directory 2024-03-19T06:05:17.194 INFO:tasks.workunit.client.1.smithi172.stdout:6/12: rmdir - no directory 2024-03-19T06:05:17.194 INFO:tasks.workunit.client.1.smithi172.stdout:6/13: dread - no filename 2024-03-19T06:05:17.194 INFO:tasks.workunit.client.1.smithi172.stdout:5/18: read - d5/f9 zero size 2024-03-19T06:05:17.195 INFO:tasks.workunit.client.1.smithi172.stdout:6/14: chown c0 32 1 2024-03-19T06:05:17.198 INFO:tasks.workunit.client.1.smithi172.stdout:1/12: getdents . 0 2024-03-19T06:05:17.199 INFO:tasks.workunit.client.1.smithi172.stdout:5/19: write d5/f7 [42374,662] 0 2024-03-19T06:05:17.199 INFO:tasks.workunit.client.1.smithi172.stdout:3/15: rename d0/f2 to d0/f4 0 2024-03-19T06:05:17.200 INFO:tasks.workunit.client.1.smithi172.stdout:5/20: readlink l1 0 2024-03-19T06:05:17.201 INFO:tasks.workunit.client.1.smithi172.stdout:1/13: chown f0 2061375 1 2024-03-19T06:05:17.201 INFO:tasks.workunit.client.1.smithi172.stdout:6/15: mknod c1 0 2024-03-19T06:05:17.203 INFO:tasks.workunit.client.1.smithi172.stdout:6/16: chown c1 10 1 2024-03-19T06:05:17.203 INFO:tasks.workunit.client.1.smithi172.stdout:6/17: dread - no filename 2024-03-19T06:05:17.203 INFO:tasks.workunit.client.1.smithi172.stdout:6/18: rmdir - no directory 2024-03-19T06:05:17.204 INFO:tasks.workunit.client.1.smithi172.stdout:5/21: creat d5/fb x:0 0 0 2024-03-19T06:05:17.205 INFO:tasks.workunit.client.1.smithi172.stdout:4/19: fsync f6 0 2024-03-19T06:05:17.208 INFO:tasks.workunit.client.1.smithi172.stdout:4/20: read - f7 zero size 2024-03-19T06:05:17.208 INFO:tasks.workunit.client.1.smithi172.stdout:8/10: fsync d0/f1 0 2024-03-19T06:05:17.208 INFO:tasks.workunit.client.1.smithi172.stdout:5/22: write d5/fb [313497,119149] 0 2024-03-19T06:05:17.210 INFO:tasks.workunit.client.1.smithi172.stdout:9/6: creat d1/f3 x:0 0 0 2024-03-19T06:05:17.213 INFO:tasks.workunit.client.1.smithi172.stdout:4/21: write f6 [883127,7771] 0 2024-03-19T06:05:17.214 INFO:tasks.workunit.client.1.smithi172.stdout:5/23: write d5/f6 [200055,65080] 0 2024-03-19T06:05:17.218 INFO:tasks.workunit.client.1.smithi172.stdout:3/16: rmdir d0 39 2024-03-19T06:05:17.218 INFO:tasks.workunit.client.1.smithi172.stdout:4/22: write f6 [18504,111428] 0 2024-03-19T06:05:17.218 INFO:tasks.workunit.client.1.smithi172.stdout:6/19: getdents . 0 2024-03-19T06:05:17.219 INFO:tasks.workunit.client.1.smithi172.stdout:6/20: write - no filename 2024-03-19T06:05:17.219 INFO:tasks.workunit.client.1.smithi172.stdout:6/21: dread - no filename 2024-03-19T06:05:17.219 INFO:tasks.workunit.client.1.smithi172.stdout:6/22: dwrite - no filename 2024-03-19T06:05:17.220 INFO:tasks.workunit.client.1.smithi172.stdout:4/23: dread - f7 zero size 2024-03-19T06:05:17.220 INFO:tasks.workunit.client.1.smithi172.stdout:6/23: mknod c2 0 2024-03-19T06:05:17.221 INFO:tasks.workunit.client.1.smithi172.stdout:5/24: write d5/f9 [586250,93696] 0 2024-03-19T06:05:17.222 INFO:tasks.workunit.client.1.smithi172.stdout:8/11: truncate d0/f1 258016 0 2024-03-19T06:05:17.226 INFO:tasks.workunit.client.1.smithi172.stdout:1/14: dread f0 [0,4194304] 0 2024-03-19T06:05:17.230 INFO:tasks.workunit.client.1.smithi172.stdout:4/24: unlink l1 0 2024-03-19T06:05:17.234 INFO:tasks.workunit.client.1.smithi172.stdout:4/25: truncate f7 826611 0 2024-03-19T06:05:17.236 INFO:tasks.workunit.client.1.smithi172.stdout:6/24: rename c2 to c3 0 2024-03-19T06:05:17.237 INFO:tasks.workunit.client.1.smithi172.stdout:6/25: dwrite - no filename 2024-03-19T06:05:17.237 INFO:tasks.workunit.client.1.smithi172.stdout:6/26: dwrite - no filename 2024-03-19T06:05:17.237 INFO:tasks.workunit.client.1.smithi172.stdout:6/27: write - no filename 2024-03-19T06:05:17.239 INFO:tasks.workunit.client.1.smithi172.stdout:4/26: creat f8 x:0 0 0 2024-03-19T06:05:17.250 INFO:tasks.workunit.client.1.smithi172.stdout:4/27: symlink l9 0 2024-03-19T06:05:17.255 INFO:tasks.workunit.client.1.smithi172.stdout:8/12: link d0/f1 d0/f2 0 2024-03-19T06:05:17.258 INFO:tasks.workunit.client.1.smithi172.stdout:4/28: mknod ca 0 2024-03-19T06:05:17.259 INFO:tasks.workunit.client.1.smithi172.stdout:1/15: dread f0 [0,4194304] 0 2024-03-19T06:05:17.264 INFO:tasks.workunit.client.1.smithi172.stdout:6/28: rename c3 to c4 0 2024-03-19T06:05:17.264 INFO:tasks.workunit.client.1.smithi172.stdout:6/29: dread - no filename 2024-03-19T06:05:17.264 INFO:tasks.workunit.client.1.smithi172.stdout:6/30: dread - no filename 2024-03-19T06:05:17.264 INFO:tasks.workunit.client.1.smithi172.stdout:6/31: rmdir - no directory 2024-03-19T06:05:17.266 INFO:tasks.workunit.client.1.smithi172.stdout:9/7: dwrite f0 [0,4194304] 0 2024-03-19T06:05:17.268 INFO:tasks.workunit.client.1.smithi172.stdout:5/25: dwrite d5/f8 [0,4194304] 0 2024-03-19T06:05:17.268 INFO:tasks.workunit.client.1.smithi172.stdout:8/13: truncate d0/f2 400055 0 2024-03-19T06:05:17.271 INFO:tasks.workunit.client.1.smithi172.stdout:4/29: link f7 fb 0 2024-03-19T06:05:17.273 INFO:tasks.workunit.client.1.smithi172.stdout:9/8: dread - d1/f3 zero size 2024-03-19T06:05:17.273 INFO:tasks.workunit.client.1.smithi172.stdout:3/17: dwrite d0/f4 [4194304,4194304] 0 2024-03-19T06:05:17.273 INFO:tasks.workunit.client.1.smithi172.stdout:6/32: mkdir d5 0 2024-03-19T06:05:17.275 INFO:tasks.workunit.client.1.smithi172.stdout:5/26: rmdir d5 39 2024-03-19T06:05:17.281 INFO:tasks.workunit.client.1.smithi172.stdout:3/18: mkdir d0/d5 0 2024-03-19T06:05:17.285 INFO:tasks.workunit.client.1.smithi172.stdout:5/27: fsync d5/f6 0 2024-03-19T06:05:17.289 INFO:tasks.workunit.client.1.smithi172.stdout:6/33: creat d5/f6 x:0 0 0 2024-03-19T06:05:17.295 INFO:tasks.workunit.client.1.smithi172.stdout:9/9: fsync f0 0 2024-03-19T06:05:17.302 INFO:tasks.workunit.client.1.smithi172.stdout:6/34: chown c1 8263030 1 2024-03-19T06:05:17.302 INFO:tasks.workunit.client.1.smithi172.stdout:6/35: chown d5 87779 1 2024-03-19T06:05:17.303 INFO:tasks.workunit.client.1.smithi172.stdout:1/16: dwrite f0 [0,4194304] 0 2024-03-19T06:05:17.304 INFO:tasks.workunit.client.1.smithi172.stdout:9/10: rename d1/l2 to d1/l4 0 2024-03-19T06:05:17.306 INFO:tasks.workunit.client.1.smithi172.stdout:6/36: dread - d5/f6 zero size 2024-03-19T06:05:17.309 INFO:tasks.workunit.client.1.smithi172.stdout:9/11: symlink d1/l5 0 2024-03-19T06:05:17.310 INFO:tasks.workunit.client.1.smithi172.stdout:1/17: write f0 [4207575,18196] 0 2024-03-19T06:05:17.314 INFO:tasks.workunit.client.1.smithi172.stdout:4/30: dwrite f6 [0,4194304] 0 2024-03-19T06:05:17.424 INFO:tasks.workunit.client.1.smithi172.stdout:1/18: write f0 [4514929,103721] 0 2024-03-19T06:05:17.426 INFO:tasks.workunit.client.1.smithi172.stdout:3/19: dread d0/f4 [0,4194304] 0 2024-03-19T06:05:17.428 INFO:tasks.workunit.client.1.smithi172.stdout:1/19: stat f0 0 2024-03-19T06:05:17.436 INFO:tasks.workunit.client.1.smithi172.stdout:9/12: rmdir d1 39 2024-03-19T06:05:17.439 INFO:tasks.workunit.client.1.smithi172.stdout:5/28: dwrite d5/f9 [0,4194304] 0 2024-03-19T06:05:17.442 INFO:tasks.workunit.client.1.smithi172.stdout:1/20: write f0 [5175073,111556] 0 2024-03-19T06:05:17.448 INFO:tasks.workunit.client.1.smithi172.stdout:5/29: write d5/fb [463686,97590] 0 2024-03-19T06:05:17.457 INFO:tasks.workunit.client.1.smithi172.stdout:6/37: dwrite d5/f6 [0,4194304] 0 2024-03-19T06:05:17.457 INFO:tasks.workunit.client.1.smithi172.stdout:5/30: write d5/fb [1507052,721] 0 2024-03-19T06:05:17.462 INFO:tasks.workunit.client.1.smithi172.stdout:5/31: dread d5/f7 [0,4194304] 0 2024-03-19T06:05:17.472 INFO:tasks.workunit.client.1.smithi172.stdout:6/38: dread d5/f6 [0,4194304] 0 2024-03-19T06:05:17.480 INFO:tasks.workunit.client.1.smithi172.stdout:6/39: dread d5/f6 [0,4194304] 0 2024-03-19T06:05:17.528 INFO:tasks.workunit.client.1.smithi172.stdout:4/31: creat fc x:0 0 0 2024-03-19T06:05:17.529 INFO:tasks.workunit.client.1.smithi172.stdout:4/32: write f6 [2090062,51696] 0 2024-03-19T06:05:17.529 INFO:tasks.workunit.client.1.smithi172.stdout:3/20: write d0/f4 [7699545,48552] 0 2024-03-19T06:05:17.533 INFO:tasks.workunit.client.1.smithi172.stdout:9/13: write d1/f3 [283491,109428] 0 2024-03-19T06:05:17.534 INFO:tasks.workunit.client.1.smithi172.stdout:1/21: creat f2 x:0 0 0 2024-03-19T06:05:17.537 INFO:tasks.workunit.client.1.smithi172.stdout:1/22: truncate f2 730891 0 2024-03-19T06:05:17.538 INFO:tasks.workunit.client.1.smithi172.stdout:5/32: creat d5/fc x:0 0 0 2024-03-19T06:05:17.540 INFO:tasks.workunit.client.1.smithi172.stdout:5/33: write d5/fc [83144,30403] 0 2024-03-19T06:05:17.542 INFO:tasks.workunit.client.1.smithi172.stdout:3/21: unlink d0/c3 0 2024-03-19T06:05:17.544 INFO:tasks.workunit.client.1.smithi172.stdout:5/34: truncate d5/f9 4738648 0 2024-03-19T06:05:17.544 INFO:tasks.workunit.client.1.smithi172.stdout:9/14: creat d1/f6 x:0 0 0 2024-03-19T06:05:17.546 INFO:tasks.workunit.client.1.smithi172.stdout:9/15: truncate d1/f6 300458 0 2024-03-19T06:05:17.548 INFO:tasks.workunit.client.1.smithi172.stdout:9/16: write d1/f6 [1072603,108778] 0 2024-03-19T06:05:17.550 INFO:tasks.workunit.client.1.smithi172.stdout:5/35: unlink f4 0 2024-03-19T06:05:17.550 INFO:tasks.workunit.client.1.smithi172.stdout:9/17: chown d1 5 1 2024-03-19T06:05:17.551 INFO:tasks.workunit.client.1.smithi172.stdout:5/36: chown l1 1230543 1 2024-03-19T06:05:17.553 INFO:tasks.workunit.client.1.smithi172.stdout:5/37: fsync d5/fb 0 2024-03-19T06:05:17.554 INFO:tasks.workunit.client.1.smithi172.stdout:1/23: dread f0 [0,4194304] 0 2024-03-19T06:05:17.557 INFO:tasks.workunit.client.1.smithi172.stdout:5/38: rename d5/f6 to d5/fd 0 2024-03-19T06:05:17.557 INFO:tasks.workunit.client.1.smithi172.stdout:5/39: readlink l1 0 2024-03-19T06:05:17.558 INFO:tasks.workunit.client.1.smithi172.stdout:1/24: dread f2 [0,4194304] 0 2024-03-19T06:05:17.560 INFO:tasks.workunit.client.1.smithi172.stdout:5/40: dread d5/f7 [0,4194304] 0 2024-03-19T06:05:17.561 INFO:tasks.workunit.client.1.smithi172.stdout:5/41: stat l1 0 2024-03-19T06:05:17.563 INFO:tasks.workunit.client.1.smithi172.stdout:5/42: creat d5/fe x:0 0 0 2024-03-19T06:05:17.565 INFO:tasks.workunit.client.1.smithi172.stdout:5/43: truncate d5/f9 5209684 0 2024-03-19T06:05:17.570 INFO:tasks.workunit.client.1.smithi172.stdout:5/44: rename d5/fc to d5/ff 0 2024-03-19T06:05:17.573 INFO:tasks.workunit.client.1.smithi172.stdout:5/45: mknod d5/c10 0 2024-03-19T06:05:17.575 INFO:tasks.workunit.client.1.smithi172.stdout:5/46: fsync f2 0 2024-03-19T06:05:17.579 INFO:tasks.workunit.client.1.smithi172.stdout:5/47: mknod d5/c11 0 2024-03-19T06:05:17.581 INFO:tasks.workunit.client.1.smithi172.stdout:1/25: dwrite f2 [0,4194304] 0 2024-03-19T06:05:17.581 INFO:tasks.workunit.client.1.smithi172.stdout:5/48: dread - d5/fe zero size 2024-03-19T06:05:17.584 INFO:tasks.workunit.client.1.smithi172.stdout:1/26: unlink f2 0 2024-03-19T06:05:17.589 INFO:tasks.workunit.client.1.smithi172.stdout:5/49: creat d5/f12 x:0 0 0 2024-03-19T06:05:17.595 INFO:tasks.workunit.client.1.smithi172.stdout:5/50: write d5/f7 [237083,20762] 0 2024-03-19T06:05:17.607 INFO:tasks.workunit.client.1.smithi172.stdout:4/33: write f7 [1340259,11850] 0 2024-03-19T06:05:17.610 INFO:tasks.workunit.client.1.smithi172.stdout:6/40: truncate d5/f6 288517 0 2024-03-19T06:05:17.611 INFO:tasks.workunit.client.1.smithi172.stdout:1/27: dwrite f0 [0,4194304] 0 2024-03-19T06:05:17.611 INFO:tasks.workunit.client.1.smithi172.stdout:4/34: write f8 [479809,55520] 0 2024-03-19T06:05:17.612 INFO:tasks.workunit.client.1.smithi172.stdout:3/22: truncate d0/f4 658097 0 2024-03-19T06:05:17.630 INFO:tasks.workunit.client.1.smithi172.stdout:6/41: read d5/f6 [139931,87378] 0 2024-03-19T06:05:17.635 INFO:tasks.workunit.client.1.smithi172.stdout:3/23: dread d0/f4 [0,4194304] 0 2024-03-19T06:05:17.640 INFO:tasks.workunit.client.1.smithi172.stdout:4/35: dwrite fb [0,4194304] 0 2024-03-19T06:05:17.641 INFO:tasks.workunit.client.1.smithi172.stdout:6/42: rename c4 to d5/c7 0 2024-03-19T06:05:17.641 INFO:tasks.workunit.client.1.smithi172.stdout:1/28: dwrite f0 [0,4194304] 0 2024-03-19T06:05:17.641 INFO:tasks.workunit.client.1.smithi172.stdout:3/24: creat d0/f6 x:0 0 0 2024-03-19T06:05:17.645 INFO:tasks.workunit.client.1.smithi172.stdout:6/43: creat d5/f8 x:0 0 0 2024-03-19T06:05:17.645 INFO:tasks.workunit.client.1.smithi172.stdout:4/36: creat fd x:0 0 0 2024-03-19T06:05:17.647 INFO:tasks.workunit.client.1.smithi172.stdout:1/29: rename f0 to f3 0 2024-03-19T06:05:17.649 INFO:tasks.workunit.client.1.smithi172.stdout:4/37: write fb [1392691,14066] 0 2024-03-19T06:05:17.650 INFO:tasks.workunit.client.1.smithi172.stdout:6/44: dread - d5/f8 zero size 2024-03-19T06:05:17.651 INFO:tasks.workunit.client.1.smithi172.stdout:3/25: symlink d0/d5/l7 0 2024-03-19T06:05:17.658 INFO:tasks.workunit.client.1.smithi172.stdout:1/30: write f3 [5542239,71253] 0 2024-03-19T06:05:17.659 INFO:tasks.workunit.client.1.smithi172.stdout:3/26: creat d0/d5/f8 x:0 0 0 2024-03-19T06:05:17.666 INFO:tasks.workunit.client.1.smithi172.stdout:1/31: mknod c4 0 2024-03-19T06:05:17.669 INFO:tasks.workunit.client.1.smithi172.stdout:1/32: write f3 [3999402,128870] 0 2024-03-19T06:05:17.672 INFO:tasks.workunit.client.1.smithi172.stdout:1/33: creat f5 x:0 0 0 2024-03-19T06:05:17.674 INFO:tasks.workunit.client.1.smithi172.stdout:1/34: creat f6 x:0 0 0 2024-03-19T06:05:17.675 INFO:tasks.workunit.client.1.smithi172.stdout:4/38: dwrite f8 [0,4194304] 0 2024-03-19T06:05:17.678 INFO:tasks.workunit.client.1.smithi172.stdout:6/45: write d5/f6 [647531,25065] 0 2024-03-19T06:05:17.683 INFO:tasks.workunit.client.1.smithi172.stdout:4/39: chown fc 9 1 2024-03-19T06:05:17.687 INFO:tasks.workunit.client.1.smithi172.stdout:4/40: truncate f7 5074652 0 2024-03-19T06:05:17.690 INFO:tasks.workunit.client.1.smithi172.stdout:6/46: rename c1 to d5/c9 0 2024-03-19T06:05:17.694 INFO:tasks.workunit.client.1.smithi172.stdout:3/27: dwrite d0/f6 [0,4194304] 0 2024-03-19T06:05:17.696 INFO:tasks.workunit.client.1.smithi172.stdout:6/47: dread - d5/f8 zero size 2024-03-19T06:05:17.696 INFO:tasks.workunit.client.1.smithi172.stdout:1/35: truncate f3 2703004 0 2024-03-19T06:05:17.696 INFO:tasks.workunit.client.1.smithi172.stdout:1/36: readlink - no filename 2024-03-19T06:05:17.698 INFO:tasks.workunit.client.1.smithi172.stdout:3/28: mkdir d0/d5/d9 0 2024-03-19T06:05:17.699 INFO:tasks.workunit.client.1.smithi172.stdout:6/48: creat d5/fa x:0 0 0 2024-03-19T06:05:17.699 INFO:tasks.workunit.client.1.smithi172.stdout:1/37: symlink l7 0 2024-03-19T06:05:17.700 INFO:tasks.workunit.client.1.smithi172.stdout:3/29: chown d0/d5 18877 1 2024-03-19T06:05:17.702 INFO:tasks.workunit.client.1.smithi172.stdout:6/49: write d5/f8 [924548,86275] 0 2024-03-19T06:05:17.703 INFO:tasks.workunit.client.1.smithi172.stdout:1/38: mknod c8 0 2024-03-19T06:05:17.703 INFO:tasks.workunit.client.1.smithi172.stdout:6/50: fsync d5/f6 0 2024-03-19T06:05:17.704 INFO:tasks.workunit.client.1.smithi172.stdout:1/39: fsync f6 0 2024-03-19T06:05:17.708 INFO:tasks.workunit.client.1.smithi172.stdout:1/40: symlink l9 0 2024-03-19T06:05:17.709 INFO:tasks.workunit.client.1.smithi172.stdout:1/41: dread - f6 zero size 2024-03-19T06:05:17.709 INFO:tasks.workunit.client.1.smithi172.stdout:6/51: creat d5/fb x:0 0 0 2024-03-19T06:05:17.710 INFO:tasks.workunit.client.1.smithi172.stdout:4/41: dread f6 [0,4194304] 0 2024-03-19T06:05:17.712 INFO:tasks.workunit.client.1.smithi172.stdout:1/42: unlink f5 0 2024-03-19T06:05:17.714 INFO:tasks.workunit.client.1.smithi172.stdout:6/52: creat d5/fc x:0 0 0 2024-03-19T06:05:17.715 INFO:tasks.workunit.client.1.smithi172.stdout:1/43: mkdir da 0 2024-03-19T06:05:17.717 INFO:tasks.workunit.client.1.smithi172.stdout:1/44: write f6 [696972,87005] 0 2024-03-19T06:05:17.718 INFO:tasks.workunit.client.1.smithi172.stdout:6/53: symlink d5/ld 0 2024-03-19T06:05:17.722 INFO:tasks.workunit.client.1.smithi172.stdout:6/54: creat d5/fe x:0 0 0 2024-03-19T06:05:17.724 INFO:tasks.workunit.client.1.smithi172.stdout:6/55: read - d5/fa zero size 2024-03-19T06:05:17.724 INFO:tasks.workunit.client.1.smithi172.stdout:3/30: getdents d0/d5 0 2024-03-19T06:05:17.728 INFO:tasks.workunit.client.1.smithi172.stdout:6/56: mknod d5/cf 0 2024-03-19T06:05:17.730 INFO:tasks.workunit.client.1.smithi172.stdout:3/31: symlink d0/d5/d9/la 0 2024-03-19T06:05:17.730 INFO:tasks.workunit.client.1.smithi172.stdout:4/42: dwrite fc [0,4194304] 0 2024-03-19T06:05:17.731 INFO:tasks.workunit.client.1.smithi172.stdout:4/43: read f7 [672598,30125] 0 2024-03-19T06:05:17.734 INFO:tasks.workunit.client.1.smithi172.stdout:3/32: creat d0/d5/fb x:0 0 0 2024-03-19T06:05:17.736 INFO:tasks.workunit.client.1.smithi172.stdout:4/44: creat fe x:0 0 0 2024-03-19T06:05:17.737 INFO:tasks.workunit.client.1.smithi172.stdout:4/45: write fe [773517,9413] 0 2024-03-19T06:05:17.738 INFO:tasks.workunit.client.1.smithi172.stdout:4/46: readlink l9 0 2024-03-19T06:05:17.738 INFO:tasks.workunit.client.1.smithi172.stdout:3/33: mknod d0/d5/d9/cc 0 2024-03-19T06:05:17.739 INFO:tasks.workunit.client.1.smithi172.stdout:4/47: chown f6 1964 1 2024-03-19T06:05:17.743 INFO:tasks.workunit.client.1.smithi172.stdout:4/48: mkdir df 0 2024-03-19T06:05:17.743 INFO:tasks.workunit.client.1.smithi172.stdout:3/34: write d0/f4 [1527231,89844] 0 2024-03-19T06:05:17.747 INFO:tasks.workunit.client.1.smithi172.stdout:4/49: chown ca 1647 1 2024-03-19T06:05:17.748 INFO:tasks.workunit.client.1.smithi172.stdout:3/35: dread - d0/d5/f8 zero size 2024-03-19T06:05:17.752 INFO:tasks.workunit.client.1.smithi172.stdout:6/57: dwrite d5/fe [0,4194304] 0 2024-03-19T06:05:17.754 INFO:tasks.workunit.client.1.smithi172.stdout:6/58: readlink d5/ld 0 2024-03-19T06:05:17.755 INFO:tasks.workunit.client.1.smithi172.stdout:3/36: creat d0/d5/d9/fd x:0 0 0 2024-03-19T06:05:17.756 INFO:tasks.workunit.client.1.smithi172.stdout:3/37: readlink d0/d5/d9/la 0 2024-03-19T06:05:17.761 INFO:tasks.workunit.client.1.smithi172.stdout:3/38: creat d0/fe x:0 0 0 2024-03-19T06:05:17.765 INFO:tasks.workunit.client.1.smithi172.stdout:3/39: unlink d0/d5/l7 0 2024-03-19T06:05:17.769 INFO:tasks.workunit.client.1.smithi172.stdout:3/40: mknod d0/cf 0 2024-03-19T06:05:17.773 INFO:tasks.workunit.client.1.smithi172.stdout:4/50: dwrite f8 [0,4194304] 0 2024-03-19T06:05:17.780 INFO:tasks.workunit.client.1.smithi172.stdout:6/59: dwrite d5/f6 [0,4194304] 0 2024-03-19T06:05:17.781 INFO:tasks.workunit.client.1.smithi172.stdout:4/51: unlink fc 0 2024-03-19T06:05:17.785 INFO:tasks.workunit.client.1.smithi172.stdout:6/60: rmdir d5 39 2024-03-19T06:05:17.787 INFO:tasks.workunit.client.1.smithi172.stdout:4/52: creat df/f10 x:0 0 0 2024-03-19T06:05:17.796 INFO:tasks.workunit.client.1.smithi172.stdout:6/61: truncate d5/fe 4812481 0 2024-03-19T06:05:17.798 INFO:tasks.workunit.client.1.smithi172.stdout:4/53: truncate f7 2431046 0 2024-03-19T06:05:17.800 INFO:tasks.workunit.client.1.smithi172.stdout:4/54: truncate fd 764070 0 2024-03-19T06:05:17.805 INFO:tasks.workunit.client.1.smithi172.stdout:3/41: dwrite d0/d5/d9/fd [0,4194304] 0 2024-03-19T06:05:17.812 INFO:tasks.workunit.client.1.smithi172.stdout:3/42: write d0/d5/d9/fd [3042592,29683] 0 2024-03-19T06:05:17.820 INFO:tasks.workunit.client.1.smithi172.stdout:6/62: dwrite d5/fb [0,4194304] 0 2024-03-19T06:05:17.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:17 smithi072 ceph-mon[28706]: pgmap v5: 65 pgs: 65 active+clean; 207 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:05:17.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:17 smithi072 ceph-mon[28706]: mgrmap e29: smithi072.jydpjk(active, since 4s) 2024-03-19T06:05:17.828 INFO:tasks.workunit.client.1.smithi172.stdout:3/43: dread d0/d5/d9/fd [0,4194304] 0 2024-03-19T06:05:17.833 INFO:tasks.workunit.client.1.smithi172.stdout:3/44: creat d0/d5/f10 x:0 0 0 2024-03-19T06:05:17.837 INFO:tasks.workunit.client.1.smithi172.stdout:6/63: dread d5/fe [0,4194304] 0 2024-03-19T06:05:17.837 INFO:tasks.workunit.client.1.smithi172.stdout:3/45: creat d0/d5/f11 x:0 0 0 2024-03-19T06:05:17.841 INFO:tasks.workunit.client.1.smithi172.stdout:3/46: creat d0/f12 x:0 0 0 2024-03-19T06:05:17.841 INFO:tasks.workunit.client.1.smithi172.stdout:3/47: dread - d0/d5/fb zero size 2024-03-19T06:05:17.843 INFO:tasks.workunit.client.1.smithi172.stdout:3/48: write d0/d5/f10 [703632,79697] 0 2024-03-19T06:05:17.848 INFO:tasks.workunit.client.1.smithi172.stdout:3/49: truncate d0/d5/f11 467322 0 2024-03-19T06:05:17.852 INFO:tasks.workunit.client.1.smithi172.stdout:3/50: mkdir d0/d13 0 2024-03-19T06:05:17.856 INFO:tasks.workunit.client.1.smithi172.stdout:3/51: mkdir d0/d5/d14 0 2024-03-19T06:05:17.858 INFO:tasks.workunit.client.1.smithi172.stdout:6/64: dwrite d5/fc [0,4194304] 0 2024-03-19T06:05:17.858 INFO:tasks.workunit.client.1.smithi172.stdout:3/52: readlink d0/d5/d9/la 0 2024-03-19T06:05:17.859 INFO:tasks.workunit.client.1.smithi172.stdout:6/65: dread - d5/fa zero size 2024-03-19T06:05:17.864 INFO:tasks.workunit.client.1.smithi172.stdout:3/53: unlink d0/cf 0 2024-03-19T06:05:17.867 INFO:tasks.workunit.client.1.smithi172.stdout:3/54: mknod d0/d13/c15 0 2024-03-19T06:05:17.872 INFO:tasks.workunit.client.1.smithi172.stdout:3/55: creat d0/d5/d14/f16 x:0 0 0 2024-03-19T06:05:17.873 INFO:tasks.workunit.client.1.smithi172.stdout:6/66: dread d5/fb [0,4194304] 0 2024-03-19T06:05:17.875 INFO:tasks.workunit.client.1.smithi172.stdout:3/56: creat d0/d5/d14/f17 x:0 0 0 2024-03-19T06:05:17.876 INFO:tasks.workunit.client.1.smithi172.stdout:6/67: write d5/fb [4862408,3354] 0 2024-03-19T06:05:17.877 INFO:tasks.workunit.client.1.smithi172.stdout:3/57: chown d0/d13/c15 4393 1 2024-03-19T06:05:17.877 INFO:tasks.workunit.client.1.smithi172.stdout:6/68: readlink d5/ld 0 2024-03-19T06:05:17.879 INFO:tasks.workunit.client.1.smithi172.stdout:6/69: write d5/f8 [499275,29867] 0 2024-03-19T06:05:17.880 INFO:tasks.workunit.client.1.smithi172.stdout:3/58: creat d0/d5/d9/f18 x:0 0 0 2024-03-19T06:05:17.883 INFO:tasks.workunit.client.1.smithi172.stdout:3/59: symlink d0/d13/l19 0 2024-03-19T06:05:17.885 INFO:tasks.workunit.client.1.smithi172.stdout:6/70: link d5/fe d5/f10 0 2024-03-19T06:05:17.886 INFO:tasks.workunit.client.1.smithi172.stdout:6/71: chown d5/f6 4185338 1 2024-03-19T06:05:17.886 INFO:tasks.workunit.client.1.smithi172.stdout:3/60: creat d0/d13/f1a x:0 0 0 2024-03-19T06:05:17.887 INFO:tasks.workunit.client.1.smithi172.stdout:6/72: chown d5/cf 113977 1 2024-03-19T06:05:17.887 INFO:tasks.workunit.client.1.smithi172.stdout:3/61: write d0/d5/f10 [785386,96840] 0 2024-03-19T06:05:17.890 INFO:tasks.workunit.client.1.smithi172.stdout:6/73: mkdir d5/d11 0 2024-03-19T06:05:17.891 INFO:tasks.workunit.client.1.smithi172.stdout:3/62: write d0/d5/d9/fd [2374343,88612] 0 2024-03-19T06:05:17.892 INFO:tasks.workunit.client.1.smithi172.stdout:6/74: mkdir d5/d12 0 2024-03-19T06:05:17.893 INFO:tasks.workunit.client.1.smithi172.stdout:3/63: mknod d0/d13/c1b 0 2024-03-19T06:05:17.900 INFO:tasks.workunit.client.1.smithi172.stdout:6/75: dread d5/f8 [0,4194304] 0 2024-03-19T06:05:17.901 INFO:tasks.workunit.client.1.smithi172.stdout:3/64: rmdir d0/d5 39 2024-03-19T06:05:17.902 INFO:tasks.workunit.client.1.smithi172.stdout:3/65: chown d0/d13/l19 684 1 2024-03-19T06:05:17.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:17 smithi172 ceph-mon[35716]: pgmap v5: 65 pgs: 65 active+clean; 207 MiB data, 820 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:05:17.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:17 smithi172 ceph-mon[35716]: mgrmap e29: smithi072.jydpjk(active, since 4s) 2024-03-19T06:05:17.905 INFO:tasks.workunit.client.1.smithi172.stdout:3/66: stat d0/d5/d14/f17 0 2024-03-19T06:05:17.908 INFO:tasks.workunit.client.1.smithi172.stdout:3/67: read d0/d5/d9/fd [194698,130074] 0 2024-03-19T06:05:17.914 INFO:tasks.workunit.client.1.smithi172.stdout:3/68: truncate d0/d5/d14/f17 822349 0 2024-03-19T06:05:17.916 INFO:tasks.workunit.client.1.smithi172.stdout:3/69: truncate d0/d5/d14/f16 632241 0 2024-03-19T06:05:17.917 INFO:tasks.workunit.client.1.smithi172.stdout:6/76: dwrite d5/fc [0,4194304] 0 2024-03-19T06:05:17.918 INFO:tasks.workunit.client.1.smithi172.stdout:3/70: read d0/f6 [2017723,89313] 0 2024-03-19T06:05:17.924 INFO:tasks.workunit.client.1.smithi172.stdout:6/77: creat d5/f13 x:0 0 0 2024-03-19T06:05:17.926 INFO:tasks.workunit.client.1.smithi172.stdout:3/71: link d0/d5/f11 d0/d5/f1c 0 2024-03-19T06:05:17.928 INFO:tasks.workunit.client.1.smithi172.stdout:3/72: chown d0/f4 3041 1 2024-03-19T06:05:17.930 INFO:tasks.workunit.client.1.smithi172.stdout:3/73: write d0/fe [33128,70338] 0 2024-03-19T06:05:17.935 INFO:tasks.workunit.client.1.smithi172.stdout:3/74: unlink d0/d5/d9/cc 0 2024-03-19T06:05:17.935 INFO:tasks.workunit.client.1.smithi172.stdout:6/78: write d5/fe [5692473,115977] 0 2024-03-19T06:05:17.936 INFO:tasks.workunit.client.1.smithi172.stdout:3/75: symlink d0/d5/d14/l1d 0 2024-03-19T06:05:17.940 INFO:tasks.workunit.client.1.smithi172.stdout:6/79: creat d5/d12/f14 x:0 0 0 2024-03-19T06:05:17.942 INFO:tasks.workunit.client.1.smithi172.stdout:6/80: write d5/f8 [1770672,17534] 0 2024-03-19T06:05:18.018 INFO:tasks.workunit.client.1.smithi172.stdout:3/76: dwrite d0/d5/f1c [0,4194304] 0 2024-03-19T06:05:18.025 INFO:tasks.workunit.client.1.smithi172.stdout:3/77: symlink d0/d5/d9/l1e 0 2024-03-19T06:05:18.028 INFO:tasks.workunit.client.1.smithi172.stdout:6/81: dwrite d5/f6 [0,4194304] 0 2024-03-19T06:05:18.029 INFO:tasks.workunit.client.1.smithi172.stdout:3/78: symlink d0/d5/d9/l1f 0 2024-03-19T06:05:18.032 INFO:tasks.workunit.client.1.smithi172.stdout:3/79: chown d0/d5/d9/l1e 356964634 1 2024-03-19T06:05:18.033 INFO:tasks.workunit.client.1.smithi172.stdout:3/80: fdatasync d0/d5/f8 0 2024-03-19T06:05:18.044 INFO:tasks.workunit.client.1.smithi172.stdout:3/81: dread d0/d5/f11 [0,4194304] 0 2024-03-19T06:05:18.046 INFO:tasks.workunit.client.1.smithi172.stdout:3/82: chown d0/d5/f8 74 1 2024-03-19T06:05:18.048 INFO:tasks.workunit.client.1.smithi172.stdout:3/83: symlink d0/d13/l20 0 2024-03-19T06:05:18.048 INFO:tasks.workunit.client.1.smithi172.stdout:3/84: readlink d0/d5/d9/l1e 0 2024-03-19T06:05:18.051 INFO:tasks.workunit.client.1.smithi172.stdout:3/85: mkdir d0/d13/d21 0 2024-03-19T06:05:18.055 INFO:tasks.workunit.client.1.smithi172.stdout:3/86: rename d0/d13/l19 to d0/d5/l22 0 2024-03-19T06:05:18.058 INFO:tasks.workunit.client.1.smithi172.stdout:3/87: creat d0/d5/f23 x:0 0 0 2024-03-19T06:05:18.059 INFO:tasks.workunit.client.1.smithi172.stdout:3/88: rmdir d0/d5/d14 39 2024-03-19T06:05:18.062 INFO:tasks.workunit.client.1.smithi172.stdout:3/89: mkdir d0/d24 0 2024-03-19T06:05:18.064 INFO:tasks.workunit.client.1.smithi172.stdout:3/90: fsync d0/d5/d9/fd 0 2024-03-19T06:05:18.073 INFO:tasks.workunit.client.1.smithi172.stdout:3/91: dread d0/d5/f11 [0,4194304] 0 2024-03-19T06:05:18.075 INFO:tasks.workunit.client.1.smithi172.stdout:3/92: truncate d0/d5/d9/f18 976753 0 2024-03-19T06:05:18.077 INFO:tasks.workunit.client.1.smithi172.stdout:3/93: write d0/d5/f8 [804032,60990] 0 2024-03-19T06:05:18.086 INFO:tasks.workunit.client.1.smithi172.stdout:3/94: rename d0/d13 to d0/d5/d9/d25 0 2024-03-19T06:05:18.110 INFO:tasks.workunit.client.1.smithi172.stdout:3/95: dwrite d0/d5/d9/d25/f1a [0,4194304] 0 2024-03-19T06:05:18.122 INFO:tasks.workunit.client.1.smithi172.stdout:3/96: dread d0/d5/d9/d25/f1a [0,4194304] 0 2024-03-19T06:05:18.128 INFO:tasks.workunit.client.1.smithi172.stdout:3/97: link d0/d5/f23 d0/d5/f26 0 2024-03-19T06:05:18.131 INFO:tasks.workunit.client.1.smithi172.stdout:3/98: unlink d0/d5/d9/l1f 0 2024-03-19T06:05:18.133 INFO:tasks.workunit.client.1.smithi172.stdout:3/99: chown d0/d5/fb 16 1 2024-03-19T06:05:18.134 INFO:tasks.workunit.client.1.smithi172.stdout:3/100: dread - d0/d5/fb zero size 2024-03-19T06:05:18.138 INFO:tasks.workunit.client.1.smithi172.stdout:3/101: dread d0/fe [0,4194304] 0 2024-03-19T06:05:18.141 INFO:tasks.workunit.client.1.smithi172.stdout:3/102: write d0/d5/d9/f18 [205773,65040] 0 2024-03-19T06:05:19.710 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:19 smithi072 ceph-mon[28706]: pgmap v6: 65 pgs: 65 active+clean; 215 MiB data, 863 MiB used, 536 GiB / 536 GiB avail; 184 KiB/s rd, 1.3 MiB/s wr, 33 op/s 2024-03-19T06:05:19.894 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:19 smithi172 ceph-mon[35716]: pgmap v6: 65 pgs: 65 active+clean; 215 MiB data, 863 MiB used, 536 GiB / 536 GiB avail; 184 KiB/s rd, 1.3 MiB/s wr, 33 op/s 2024-03-19T06:05:20.094 INFO:tasks.workunit.client.1.smithi172.stdout:0/2: sync 2024-03-19T06:05:20.097 INFO:tasks.workunit.client.1.smithi172.stdout:0/3: symlink l1 0 2024-03-19T06:05:20.099 INFO:tasks.workunit.client.1.smithi172.stdout:0/4: write f0 [1021620,42782] 0 2024-03-19T06:05:20.113 INFO:tasks.workunit.client.1.smithi172.stdout:0/5: dread f0 [0,4194304] 0 2024-03-19T06:05:20.151 INFO:tasks.workunit.client.1.smithi172.stdout:0/6: dwrite f0 [0,4194304] 0 2024-03-19T06:05:20.154 INFO:tasks.workunit.client.1.smithi172.stdout:0/7: read f0 [88699,101970] 0 2024-03-19T06:05:20.196 INFO:tasks.workunit.client.1.smithi172.stdout:0/8: dwrite f0 [0,4194304] 0 2024-03-19T06:05:20.204 INFO:tasks.workunit.client.1.smithi172.stdout:0/9: creat f2 x:0 0 0 2024-03-19T06:05:20.209 INFO:tasks.workunit.client.1.smithi172.stdout:0/10: link f2 f3 0 2024-03-19T06:05:20.234 INFO:tasks.workunit.client.1.smithi172.stdout:0/11: dwrite f2 [0,4194304] 0 2024-03-19T06:05:20.239 INFO:tasks.workunit.client.1.smithi172.stdout:0/12: symlink l4 0 2024-03-19T06:05:20.242 INFO:tasks.workunit.client.1.smithi172.stdout:0/13: rename l4 to l5 0 2024-03-19T06:05:20.244 INFO:tasks.workunit.client.1.smithi172.stdout:0/14: write f2 [4073397,16873] 0 2024-03-19T06:05:20.266 INFO:tasks.workunit.client.1.smithi172.stdout:0/15: dwrite f2 [0,4194304] 0 2024-03-19T06:05:20.313 INFO:tasks.workunit.client.1.smithi172.stdout:0/16: chown l5 371 1 2024-03-19T06:05:20.379 INFO:tasks.workunit.client.1.smithi172.stdout:7/4: sync 2024-03-19T06:05:20.379 INFO:tasks.workunit.client.1.smithi172.stdout:7/5: dwrite - no filename 2024-03-19T06:05:20.379 INFO:tasks.workunit.client.1.smithi172.stdout:2/0: sync 2024-03-19T06:05:20.380 INFO:tasks.workunit.client.1.smithi172.stdout:7/6: chown . 1 1 2024-03-19T06:05:20.380 INFO:tasks.workunit.client.1.smithi172.stdout:7/7: chown . 10497 1 2024-03-19T06:05:20.384 INFO:tasks.workunit.client.1.smithi172.stdout:2/1: creat f0 x:0 0 0 2024-03-19T06:05:20.386 INFO:tasks.workunit.client.1.smithi172.stdout:7/8: mkdir d0 0 2024-03-19T06:05:20.386 INFO:tasks.workunit.client.1.smithi172.stdout:7/9: read - no filename 2024-03-19T06:05:20.392 INFO:tasks.workunit.client.1.smithi172.stdout:7/10: mknod d0/c1 0 2024-03-19T06:05:20.392 INFO:tasks.workunit.client.1.smithi172.stdout:7/11: truncate - no filename 2024-03-19T06:05:20.393 INFO:tasks.workunit.client.1.smithi172.stdout:7/12: rename d0 to d0/d2 22 2024-03-19T06:05:20.398 INFO:tasks.workunit.client.1.smithi172.stdout:7/13: rename d0/c1 to d0/c3 0 2024-03-19T06:05:20.408 INFO:tasks.workunit.client.1.smithi172.stdout:7/14: stat d0/c3 0 2024-03-19T06:05:20.416 INFO:tasks.workunit.client.1.smithi172.stdout:7/15: rename d0/c3 to d0/c4 0 2024-03-19T06:05:20.416 INFO:tasks.workunit.client.1.smithi172.stdout:7/16: dread - no filename 2024-03-19T06:05:20.421 INFO:tasks.workunit.client.1.smithi172.stdout:7/17: creat d0/f5 x:0 0 0 2024-03-19T06:05:20.421 INFO:tasks.workunit.client.1.smithi172.stdout:2/2: dwrite f0 [0,4194304] 0 2024-03-19T06:05:20.427 INFO:tasks.workunit.client.1.smithi172.stdout:7/18: write d0/f5 [843554,75902] 0 2024-03-19T06:05:20.430 INFO:tasks.workunit.client.1.smithi172.stdout:7/19: chown d0 502253 1 2024-03-19T06:05:20.444 INFO:tasks.workunit.client.1.smithi172.stdout:7/20: dread d0/f5 [0,4194304] 0 2024-03-19T06:05:20.458 INFO:tasks.workunit.client.1.smithi172.stdout:2/3: dwrite f0 [0,4194304] 0 2024-03-19T06:05:20.485 INFO:tasks.workunit.client.1.smithi172.stdout:2/4: fdatasync f0 0 2024-03-19T06:05:20.498 INFO:tasks.workunit.client.1.smithi172.stdout:9/18: sync 2024-03-19T06:05:20.498 INFO:tasks.workunit.client.1.smithi172.stdout:5/51: sync 2024-03-19T06:05:20.499 INFO:tasks.workunit.client.1.smithi172.stdout:8/14: sync 2024-03-19T06:05:20.501 INFO:tasks.workunit.client.1.smithi172.stdout:5/52: truncate d5/ff 184118 0 2024-03-19T06:05:20.508 INFO:tasks.workunit.client.1.smithi172.stdout:7/21: write d0/f5 [1464563,54051] 0 2024-03-19T06:05:20.509 INFO:tasks.workunit.client.1.smithi172.stdout:7/22: stat d0 0 2024-03-19T06:05:20.510 INFO:tasks.workunit.client.1.smithi172.stdout:9/19: rmdir d1 39 2024-03-19T06:05:20.511 INFO:tasks.workunit.client.1.smithi172.stdout:9/20: fsync f0 0 2024-03-19T06:05:20.511 INFO:tasks.workunit.client.1.smithi172.stdout:7/23: write d0/f5 [2365721,10086] 0 2024-03-19T06:05:20.516 INFO:tasks.workunit.client.1.smithi172.stdout:9/21: write d1/f6 [1058288,112366] 0 2024-03-19T06:05:20.517 INFO:tasks.workunit.client.1.smithi172.stdout:7/24: creat d0/f6 x:0 0 0 2024-03-19T06:05:20.518 INFO:tasks.workunit.client.1.smithi172.stdout:9/22: stat f0 0 2024-03-19T06:05:20.520 INFO:tasks.workunit.client.1.smithi172.stdout:7/25: creat d0/f7 x:0 0 0 2024-03-19T06:05:20.521 INFO:tasks.workunit.client.1.smithi172.stdout:9/23: mkdir d1/d7 0 2024-03-19T06:05:20.524 INFO:tasks.workunit.client.1.smithi172.stdout:7/26: rename d0/f5 to d0/f8 0 2024-03-19T06:05:20.527 INFO:tasks.workunit.client.1.smithi172.stdout:9/24: symlink d1/d7/l8 0 2024-03-19T06:05:20.529 INFO:tasks.workunit.client.1.smithi172.stdout:9/25: read f0 [1567379,40605] 0 2024-03-19T06:05:20.532 INFO:tasks.workunit.client.1.smithi172.stdout:9/26: creat d1/f9 x:0 0 0 2024-03-19T06:05:20.534 INFO:tasks.workunit.client.1.smithi172.stdout:9/27: creat d1/fa x:0 0 0 2024-03-19T06:05:20.536 INFO:tasks.workunit.client.1.smithi172.stdout:9/28: dread - d1/f9 zero size 2024-03-19T06:05:20.542 INFO:tasks.workunit.client.1.smithi172.stdout:7/27: dwrite d0/f7 [0,4194304] 0 2024-03-19T06:05:20.552 INFO:tasks.workunit.client.1.smithi172.stdout:7/28: dread d0/f7 [0,4194304] 0 2024-03-19T06:05:20.553 INFO:tasks.workunit.client.1.smithi172.stdout:7/29: rename d0 to d0/d9 22 2024-03-19T06:05:20.554 INFO:tasks.workunit.client.1.smithi172.stdout:2/5: truncate f0 1644574 0 2024-03-19T06:05:20.556 INFO:tasks.workunit.client.1.smithi172.stdout:7/30: creat d0/fa x:0 0 0 2024-03-19T06:05:20.557 INFO:tasks.workunit.client.1.smithi172.stdout:8/15: write d0/f2 [1255126,29712] 0 2024-03-19T06:05:20.559 INFO:tasks.workunit.client.1.smithi172.stdout:7/31: mkdir d0/db 0 2024-03-19T06:05:20.560 INFO:tasks.workunit.client.1.smithi172.stdout:7/32: chown d0/db 1023 1 2024-03-19T06:05:20.561 INFO:tasks.workunit.client.1.smithi172.stdout:8/16: creat d0/f3 x:0 0 0 2024-03-19T06:05:20.566 INFO:tasks.workunit.client.1.smithi172.stdout:9/29: rmdir d1 39 2024-03-19T06:05:20.568 INFO:tasks.workunit.client.1.smithi172.stdout:7/33: rename d0/f8 to d0/db/fc 0 2024-03-19T06:05:20.572 INFO:tasks.workunit.client.1.smithi172.stdout:8/17: dread d0/f1 [0,4194304] 0 2024-03-19T06:05:20.572 INFO:tasks.workunit.client.1.smithi172.stdout:1/45: sync 2024-03-19T06:05:20.573 INFO:tasks.workunit.client.1.smithi172.stdout:3/103: sync 2024-03-19T06:05:20.573 INFO:tasks.workunit.client.1.smithi172.stdout:0/17: sync 2024-03-19T06:05:20.573 INFO:tasks.workunit.client.1.smithi172.stdout:6/82: sync 2024-03-19T06:05:20.573 INFO:tasks.workunit.client.1.smithi172.stdout:4/55: sync 2024-03-19T06:05:20.575 INFO:tasks.workunit.client.1.smithi172.stdout:2/6: dread f0 [0,4194304] 0 2024-03-19T06:05:20.575 INFO:tasks.workunit.client.1.smithi172.stdout:8/18: read d0/f2 [190748,81173] 0 2024-03-19T06:05:20.576 INFO:tasks.workunit.client.1.smithi172.stdout:8/19: stat d0 0 2024-03-19T06:05:20.578 INFO:tasks.workunit.client.1.smithi172.stdout:2/7: stat f0 0 2024-03-19T06:05:20.578 INFO:tasks.workunit.client.1.smithi172.stdout:4/56: chown fd 19 1 2024-03-19T06:05:20.578 INFO:tasks.workunit.client.1.smithi172.stdout:3/104: rmdir d0/d5/d9 39 2024-03-19T06:05:20.582 INFO:tasks.workunit.client.1.smithi172.stdout:7/34: link d0/c4 d0/db/cd 0 2024-03-19T06:05:20.582 INFO:tasks.workunit.client.1.smithi172.stdout:7/35: stat d0/f7 0 2024-03-19T06:05:20.583 INFO:tasks.workunit.client.1.smithi172.stdout:6/83: chown d5/c9 194180 1 2024-03-19T06:05:20.583 INFO:tasks.workunit.client.1.smithi172.stdout:1/46: rename l7 to da/lb 0 2024-03-19T06:05:20.583 INFO:tasks.workunit.client.1.smithi172.stdout:7/36: write d0/fa [39638,58459] 0 2024-03-19T06:05:20.584 INFO:tasks.workunit.client.1.smithi172.stdout:6/84: truncate d5/f13 815782 0 2024-03-19T06:05:20.586 INFO:tasks.workunit.client.1.smithi172.stdout:4/57: mkdir df/d11 0 2024-03-19T06:05:20.586 INFO:tasks.workunit.client.1.smithi172.stdout:7/37: symlink d0/le 0 2024-03-19T06:05:20.587 INFO:tasks.workunit.client.1.smithi172.stdout:7/38: fsync d0/fa 0 2024-03-19T06:05:20.588 INFO:tasks.workunit.client.1.smithi172.stdout:6/85: truncate d5/d12/f14 990508 0 2024-03-19T06:05:20.589 INFO:tasks.workunit.client.1.smithi172.stdout:3/105: creat d0/d5/d14/f27 x:0 0 0 2024-03-19T06:05:20.589 INFO:tasks.workunit.client.1.smithi172.stdout:6/86: fdatasync d5/fb 0 2024-03-19T06:05:20.590 INFO:tasks.workunit.client.1.smithi172.stdout:7/39: dread d0/fa [0,4194304] 0 2024-03-19T06:05:20.593 INFO:tasks.workunit.client.1.smithi172.stdout:2/8: getdents . 0 2024-03-19T06:05:20.595 INFO:tasks.workunit.client.1.smithi172.stdout:3/106: truncate d0/d5/d14/f27 2733 0 2024-03-19T06:05:20.595 INFO:tasks.workunit.client.1.smithi172.stdout:0/18: truncate f3 3896997 0 2024-03-19T06:05:20.597 INFO:tasks.workunit.client.1.smithi172.stdout:1/47: unlink da/lb 0 2024-03-19T06:05:20.597 INFO:tasks.workunit.client.1.smithi172.stdout:7/40: write d0/fa [732097,67042] 0 2024-03-19T06:05:20.598 INFO:tasks.workunit.client.1.smithi172.stdout:6/87: symlink d5/d11/l15 0 2024-03-19T06:05:20.599 INFO:tasks.workunit.client.1.smithi172.stdout:0/19: chown l5 882546 1 2024-03-19T06:05:20.601 INFO:tasks.workunit.client.1.smithi172.stdout:1/48: readlink l9 0 2024-03-19T06:05:20.602 INFO:tasks.workunit.client.1.smithi172.stdout:3/107: mknod d0/d24/c28 0 2024-03-19T06:05:20.606 INFO:tasks.workunit.client.1.smithi172.stdout:0/20: creat f6 x:0 0 0 2024-03-19T06:05:20.606 INFO:tasks.workunit.client.1.smithi172.stdout:7/41: creat d0/db/ff x:0 0 0 2024-03-19T06:05:20.606 INFO:tasks.workunit.client.1.smithi172.stdout:6/88: write d5/f8 [2532051,66649] 0 2024-03-19T06:05:20.609 INFO:tasks.workunit.client.1.smithi172.stdout:8/20: dwrite d0/f3 [0,4194304] 0 2024-03-19T06:05:20.609 INFO:tasks.workunit.client.1.smithi172.stdout:3/108: dread - d0/d5/f23 zero size 2024-03-19T06:05:20.616 INFO:tasks.workunit.client.1.smithi172.stdout:1/49: write f3 [1714426,75249] 0 2024-03-19T06:05:20.618 INFO:tasks.workunit.client.1.smithi172.stdout:8/21: chown d0/f1 7561 1 2024-03-19T06:05:20.619 INFO:tasks.workunit.client.1.smithi172.stdout:7/42: unlink d0/f6 0 2024-03-19T06:05:20.624 INFO:tasks.workunit.client.1.smithi172.stdout:6/89: mkdir d5/d16 0 2024-03-19T06:05:20.628 INFO:tasks.workunit.client.1.smithi172.stdout:4/58: dwrite df/f10 [0,4194304] 0 2024-03-19T06:05:20.636 INFO:tasks.workunit.client.1.smithi172.stdout:2/9: dwrite f0 [0,4194304] 0 2024-03-19T06:05:20.637 INFO:tasks.workunit.client.1.smithi172.stdout:6/90: write d5/fe [5293459,123271] 0 2024-03-19T06:05:20.641 INFO:tasks.workunit.client.1.smithi172.stdout:3/109: symlink d0/d5/d9/l29 0 2024-03-19T06:05:20.650 INFO:tasks.workunit.client.1.smithi172.stdout:4/59: dread fd [0,4194304] 0 2024-03-19T06:05:20.653 INFO:tasks.workunit.client.1.smithi172.stdout:6/91: mkdir d5/d11/d17 0 2024-03-19T06:05:20.653 INFO:tasks.workunit.client.1.smithi172.stdout:4/60: read df/f10 [69302,108939] 0 2024-03-19T06:05:20.661 INFO:tasks.workunit.client.1.smithi172.stdout:3/110: rename d0/d5/l22 to d0/d5/d9/l2a 0 2024-03-19T06:05:20.662 INFO:tasks.workunit.client.1.smithi172.stdout:8/22: dwrite d0/f3 [0,4194304] 0 2024-03-19T06:05:20.667 INFO:tasks.workunit.client.1.smithi172.stdout:8/23: chown d0 0 1 2024-03-19T06:05:20.669 INFO:tasks.workunit.client.1.smithi172.stdout:1/50: truncate f3 1205925 0 2024-03-19T06:05:20.678 INFO:tasks.workunit.client.1.smithi172.stdout:4/61: truncate fb 3373491 0 2024-03-19T06:05:20.680 INFO:tasks.workunit.client.1.smithi172.stdout:1/51: mknod da/cc 0 2024-03-19T06:05:20.682 INFO:tasks.workunit.client.1.smithi172.stdout:2/10: dwrite f0 [0,4194304] 0 2024-03-19T06:05:20.683 INFO:tasks.workunit.client.1.smithi172.stdout:7/43: dwrite d0/db/fc [0,4194304] 0 2024-03-19T06:05:20.684 INFO:tasks.workunit.client.1.smithi172.stdout:6/92: creat d5/d16/f18 x:0 0 0 2024-03-19T06:05:20.685 INFO:tasks.workunit.client.1.smithi172.stdout:1/52: mkdir da/dd 0 2024-03-19T06:05:20.687 INFO:tasks.workunit.client.1.smithi172.stdout:7/44: stat d0/db 0 2024-03-19T06:05:20.687 INFO:tasks.workunit.client.1.smithi172.stdout:2/11: creat f1 x:0 0 0 2024-03-19T06:05:20.689 INFO:tasks.workunit.client.1.smithi172.stdout:1/53: rename da/dd to da/dd/de 22 2024-03-19T06:05:20.694 INFO:tasks.workunit.client.1.smithi172.stdout:6/93: creat d5/f19 x:0 0 0 2024-03-19T06:05:20.699 INFO:tasks.workunit.client.1.smithi172.stdout:0/21: dwrite f3 [0,4194304] 0 2024-03-19T06:05:20.700 INFO:tasks.workunit.client.1.smithi172.stdout:4/62: dread fd [0,4194304] 0 2024-03-19T06:05:20.703 INFO:tasks.workunit.client.1.smithi172.stdout:2/12: unlink f0 0 2024-03-19T06:05:20.703 INFO:tasks.workunit.client.1.smithi172.stdout:2/13: readlink - no filename 2024-03-19T06:05:20.704 INFO:tasks.workunit.client.1.smithi172.stdout:7/45: rename d0/f7 to d0/f10 0 2024-03-19T06:05:20.706 INFO:tasks.workunit.client.1.smithi172.stdout:2/14: dread - f1 zero size 2024-03-19T06:05:20.711 INFO:tasks.workunit.client.1.smithi172.stdout:3/111: dwrite d0/d5/f11 [0,4194304] 0 2024-03-19T06:05:20.713 INFO:tasks.workunit.client.1.smithi172.stdout:6/94: rename d5/c7 to d5/d11/d17/c1a 0 2024-03-19T06:05:20.718 INFO:tasks.workunit.client.1.smithi172.stdout:0/22: link f0 f7 0 2024-03-19T06:05:20.720 INFO:tasks.workunit.client.1.smithi172.stdout:8/24: dread d0/f3 [0,4194304] 0 2024-03-19T06:05:20.725 INFO:tasks.workunit.client.1.smithi172.stdout:3/112: symlink d0/d5/d9/l2b 0 2024-03-19T06:05:20.727 INFO:tasks.workunit.client.1.smithi172.stdout:6/95: chown c0 4130680 1 2024-03-19T06:05:20.729 INFO:tasks.workunit.client.1.smithi172.stdout:0/23: write f0 [4124201,104410] 0 2024-03-19T06:05:20.743 INFO:tasks.workunit.client.1.smithi172.stdout:8/25: write d0/f3 [2908316,103463] 0 2024-03-19T06:05:20.749 INFO:tasks.workunit.client.1.smithi172.stdout:4/63: fsync f7 0 2024-03-19T06:05:20.755 INFO:tasks.workunit.client.1.smithi172.stdout:1/54: dwrite f6 [0,4194304] 0 2024-03-19T06:05:20.757 INFO:tasks.workunit.client.1.smithi172.stdout:6/96: rename d5/d12 to d5/d11/d17/d1b 0 2024-03-19T06:05:20.757 INFO:tasks.workunit.client.1.smithi172.stdout:8/26: symlink d0/l4 0 2024-03-19T06:05:20.758 INFO:tasks.workunit.client.1.smithi172.stdout:3/113: dread d0/d5/d14/f17 [0,4194304] 0 2024-03-19T06:05:20.766 INFO:tasks.workunit.client.1.smithi172.stdout:2/15: dwrite f1 [0,4194304] 0 2024-03-19T06:05:20.766 INFO:tasks.workunit.client.1.smithi172.stdout:0/24: truncate f7 1016351 0 2024-03-19T06:05:20.768 INFO:tasks.workunit.client.1.smithi172.stdout:4/64: mkdir df/d11/d12 0 2024-03-19T06:05:20.768 INFO:tasks.workunit.client.1.smithi172.stdout:7/46: dwrite d0/fa [0,4194304] 0 2024-03-19T06:05:20.768 INFO:tasks.workunit.client.1.smithi172.stdout:7/47: chown d0 120947894 1 2024-03-19T06:05:20.769 INFO:tasks.workunit.client.1.smithi172.stdout:3/114: creat d0/d5/d9/f2c x:0 0 0 2024-03-19T06:05:20.771 INFO:tasks.workunit.client.1.smithi172.stdout:8/27: chown d0/f2 12 1 2024-03-19T06:05:20.772 INFO:tasks.workunit.client.1.smithi172.stdout:0/25: creat f8 x:0 0 0 2024-03-19T06:05:20.775 INFO:tasks.workunit.client.1.smithi172.stdout:2/16: mknod c2 0 2024-03-19T06:05:20.775 INFO:tasks.workunit.client.1.smithi172.stdout:4/65: mknod df/d11/c13 0 2024-03-19T06:05:20.780 INFO:tasks.workunit.client.1.smithi172.stdout:2/17: chown f1 3 1 2024-03-19T06:05:20.781 INFO:tasks.workunit.client.1.smithi172.stdout:8/28: write d0/f1 [1615100,28823] 0 2024-03-19T06:05:20.786 INFO:tasks.workunit.client.1.smithi172.stdout:7/48: write d0/f10 [1132843,71298] 0 2024-03-19T06:05:20.788 INFO:tasks.workunit.client.1.smithi172.stdout:5/53: sync 2024-03-19T06:05:20.788 INFO:tasks.workunit.client.1.smithi172.stdout:9/30: sync 2024-03-19T06:05:20.788 INFO:tasks.workunit.client.1.smithi172.stdout:6/97: link d5/d11/d17/c1a d5/d16/c1c 0 2024-03-19T06:05:20.801 INFO:tasks.workunit.client.1.smithi172.stdout:8/29: truncate d0/f3 5213085 0 2024-03-19T06:05:20.803 INFO:tasks.workunit.client.1.smithi172.stdout:1/55: dwrite f6 [0,4194304] 0 2024-03-19T06:05:20.807 INFO:tasks.workunit.client.1.smithi172.stdout:5/54: link f2 d5/f13 0 2024-03-19T06:05:20.808 INFO:tasks.workunit.client.1.smithi172.stdout:9/31: mknod d1/cb 0 2024-03-19T06:05:20.818 INFO:tasks.workunit.client.1.smithi172.stdout:1/56: mknod da/cf 0 2024-03-19T06:05:20.818 INFO:tasks.workunit.client.1.smithi172.stdout:0/26: dread f3 [0,4194304] 0 2024-03-19T06:05:20.818 INFO:tasks.workunit.client.1.smithi172.stdout:4/66: dread fb [0,4194304] 0 2024-03-19T06:05:20.819 INFO:tasks.workunit.client.1.smithi172.stdout:5/55: mkdir d5/d14 0 2024-03-19T06:05:20.821 INFO:tasks.workunit.client.1.smithi172.stdout:3/115: dwrite d0/d5/f10 [0,4194304] 0 2024-03-19T06:05:20.825 INFO:tasks.workunit.client.1.smithi172.stdout:9/32: chown d1/l5 49 1 2024-03-19T06:05:20.830 INFO:tasks.workunit.client.1.smithi172.stdout:1/57: stat f6 0 2024-03-19T06:05:20.832 INFO:tasks.workunit.client.1.smithi172.stdout:8/30: dread d0/f2 [0,4194304] 0 2024-03-19T06:05:20.832 INFO:tasks.workunit.client.1.smithi172.stdout:7/49: link d0/fa d0/db/f11 0 2024-03-19T06:05:20.841 INFO:tasks.workunit.client.1.smithi172.stdout:0/27: symlink l9 0 2024-03-19T06:05:20.842 INFO:tasks.workunit.client.1.smithi172.stdout:2/18: dwrite f1 [4194304,4194304] 0 2024-03-19T06:05:20.842 INFO:tasks.workunit.client.1.smithi172.stdout:7/50: read - d0/db/ff zero size 2024-03-19T06:05:20.844 INFO:tasks.workunit.client.1.smithi172.stdout:9/33: rmdir d1/d7 39 2024-03-19T06:05:20.846 INFO:tasks.workunit.client.1.smithi172.stdout:3/116: creat d0/d24/f2d x:0 0 0 2024-03-19T06:05:20.850 INFO:tasks.workunit.client.1.smithi172.stdout:5/56: mkdir d5/d14/d15 0 2024-03-19T06:05:20.855 INFO:tasks.workunit.client.1.smithi172.stdout:7/51: chown d0/f10 387 1 2024-03-19T06:05:20.856 INFO:tasks.workunit.client.1.smithi172.stdout:1/58: mkdir da/dd/d10 0 2024-03-19T06:05:20.864 INFO:tasks.workunit.client.1.smithi172.stdout:6/98: dwrite d5/d11/d17/d1b/f14 [0,4194304] 0 2024-03-19T06:05:20.866 INFO:tasks.workunit.client.1.smithi172.stdout:6/99: chown d5/d16/f18 2169328 1 2024-03-19T06:05:20.870 INFO:tasks.workunit.client.1.smithi172.stdout:3/117: creat d0/d24/f2e x:0 0 0 2024-03-19T06:05:20.878 INFO:tasks.workunit.client.1.smithi172.stdout:5/57: rename d5/f7 to d5/f16 0 2024-03-19T06:05:20.880 INFO:tasks.workunit.client.1.smithi172.stdout:6/100: write d5/f6 [808376,65999] 0 2024-03-19T06:05:20.884 INFO:tasks.workunit.client.1.smithi172.stdout:0/28: link f7 fa 0 2024-03-19T06:05:20.886 INFO:tasks.workunit.client.1.smithi172.stdout:4/67: dwrite f6 [0,4194304] 0 2024-03-19T06:05:20.888 INFO:tasks.workunit.client.1.smithi172.stdout:5/58: chown d5/fe 28865449 1 2024-03-19T06:05:20.897 INFO:tasks.workunit.client.1.smithi172.stdout:0/29: rename l5 to lb 0 2024-03-19T06:05:20.899 INFO:tasks.workunit.client.1.smithi172.stdout:6/101: write d5/d11/d17/d1b/f14 [4741376,32549] 0 2024-03-19T06:05:20.904 INFO:tasks.workunit.client.1.smithi172.stdout:0/30: creat fc x:0 0 0 2024-03-19T06:05:20.904 INFO:tasks.workunit.client.1.smithi172.stdout:1/59: dread f6 [0,4194304] 0 2024-03-19T06:05:20.916 INFO:tasks.workunit.client.1.smithi172.stdout:5/59: rename d5/f9 to d5/d14/f17 0 2024-03-19T06:05:20.916 INFO:tasks.workunit.client.1.smithi172.stdout:2/19: dwrite f1 [0,4194304] 0 2024-03-19T06:05:20.921 INFO:tasks.workunit.client.1.smithi172.stdout:6/102: write d5/f8 [3617478,99154] 0 2024-03-19T06:05:20.922 INFO:tasks.workunit.client.1.smithi172.stdout:3/118: link d0/d5/d14/l1d d0/d5/d9/d25/d21/l2f 0 2024-03-19T06:05:20.924 INFO:tasks.workunit.client.1.smithi172.stdout:9/34: dwrite d1/f3 [0,4194304] 0 2024-03-19T06:05:20.930 INFO:tasks.workunit.client.1.smithi172.stdout:1/60: creat da/dd/f11 x:0 0 0 2024-03-19T06:05:20.932 INFO:tasks.workunit.client.1.smithi172.stdout:8/31: dwrite d0/f2 [0,4194304] 0 2024-03-19T06:05:20.937 INFO:tasks.workunit.client.1.smithi172.stdout:6/103: write d5/f19 [783681,103540] 0 2024-03-19T06:05:20.939 INFO:tasks.workunit.client.1.smithi172.stdout:2/20: chown c2 122051896 1 2024-03-19T06:05:20.939 INFO:tasks.workunit.client.1.smithi172.stdout:3/119: stat d0/d5/d9/fd 0 2024-03-19T06:05:20.942 INFO:tasks.workunit.client.1.smithi172.stdout:2/21: stat f1 0 2024-03-19T06:05:20.944 INFO:tasks.workunit.client.1.smithi172.stdout:8/32: symlink d0/l5 0 2024-03-19T06:05:20.949 INFO:tasks.workunit.client.1.smithi172.stdout:8/33: chown d0 13683 1 2024-03-19T06:05:20.950 INFO:tasks.workunit.client.1.smithi172.stdout:1/61: dread - da/dd/f11 zero size 2024-03-19T06:05:20.951 INFO:tasks.workunit.client.1.smithi172.stdout:3/120: rmdir d0/d5/d14 39 2024-03-19T06:05:20.954 INFO:tasks.workunit.client.1.smithi172.stdout:6/104: stat d5/f6 0 2024-03-19T06:05:20.960 INFO:tasks.workunit.client.1.smithi172.stdout:8/34: read d0/f2 [2494103,96522] 0 2024-03-19T06:05:20.966 INFO:tasks.workunit.client.1.smithi172.stdout:2/22: truncate f1 451714 0 2024-03-19T06:05:20.969 INFO:tasks.workunit.client.1.smithi172.stdout:4/68: dwrite f6 [4194304,4194304] 0 2024-03-19T06:05:20.969 INFO:tasks.workunit.client.1.smithi172.stdout:1/62: symlink da/l12 0 2024-03-19T06:05:20.970 INFO:tasks.workunit.client.1.smithi172.stdout:6/105: creat d5/f1d x:0 0 0 2024-03-19T06:05:20.973 INFO:tasks.workunit.client.1.smithi172.stdout:0/31: dwrite fc [0,4194304] 0 2024-03-19T06:05:20.974 INFO:tasks.workunit.client.1.smithi172.stdout:8/35: creat d0/f6 x:0 0 0 2024-03-19T06:05:20.977 INFO:tasks.workunit.client.1.smithi172.stdout:9/35: dwrite d1/fa [0,4194304] 0 2024-03-19T06:05:20.980 INFO:tasks.workunit.client.1.smithi172.stdout:1/63: fdatasync f6 0 2024-03-19T06:05:20.980 INFO:tasks.workunit.client.1.smithi172.stdout:6/106: rename d5/d11/l15 to d5/d11/l1e 0 2024-03-19T06:05:20.980 INFO:tasks.workunit.client.1.smithi172.stdout:5/60: dread d5/f8 [0,4194304] 0 2024-03-19T06:05:20.981 INFO:tasks.workunit.client.1.smithi172.stdout:4/69: mknod df/d11/c14 0 2024-03-19T06:05:20.990 INFO:tasks.workunit.client.1.smithi172.stdout:4/70: readlink l9 0 2024-03-19T06:05:20.990 INFO:tasks.workunit.client.1.smithi172.stdout:8/36: link d0/f3 d0/f7 0 2024-03-19T06:05:20.994 INFO:tasks.workunit.client.1.smithi172.stdout:3/121: dwrite d0/d5/f10 [0,4194304] 0 2024-03-19T06:05:20.995 INFO:tasks.workunit.client.1.smithi172.stdout:6/107: rmdir d5/d11 39 2024-03-19T06:05:20.996 INFO:tasks.workunit.client.1.smithi172.stdout:5/61: rename d5/f8 to d5/f18 0 2024-03-19T06:05:20.996 INFO:tasks.workunit.client.1.smithi172.stdout:3/122: fsync d0/d24/f2d 0 2024-03-19T06:05:20.998 INFO:tasks.workunit.client.1.smithi172.stdout:6/108: chown d5/f1d 92569683 1 2024-03-19T06:05:21.006 INFO:tasks.workunit.client.1.smithi172.stdout:5/62: dread d5/ff [0,4194304] 0 2024-03-19T06:05:21.007 INFO:tasks.workunit.client.1.smithi172.stdout:2/23: dread f1 [0,4194304] 0 2024-03-19T06:05:21.012 INFO:tasks.workunit.client.1.smithi172.stdout:5/63: chown d5/fe 66 1 2024-03-19T06:05:21.013 INFO:tasks.workunit.client.1.smithi172.stdout:0/32: write f0 [1910563,100084] 0 2024-03-19T06:05:21.014 INFO:tasks.workunit.client.1.smithi172.stdout:2/24: read f1 [273739,66812] 0 2024-03-19T06:05:21.017 INFO:tasks.workunit.client.1.smithi172.stdout:6/109: mknod d5/d11/d17/c1f 0 2024-03-19T06:05:21.023 INFO:tasks.workunit.client.1.smithi172.stdout:0/33: creat fd x:0 0 0 2024-03-19T06:05:21.025 INFO:tasks.workunit.client.1.smithi172.stdout:5/64: unlink d5/f13 0 2024-03-19T06:05:21.028 INFO:tasks.workunit.client.1.smithi172.stdout:6/110: chown d5/d11/d17/d1b 3 1 2024-03-19T06:05:21.029 INFO:tasks.workunit.client.1.smithi172.stdout:0/34: chown f6 20317 1 2024-03-19T06:05:21.030 INFO:tasks.workunit.client.1.smithi172.stdout:2/25: dread f1 [0,4194304] 0 2024-03-19T06:05:21.031 INFO:tasks.workunit.client.1.smithi172.stdout:3/123: truncate d0/d5/f1c 3866827 0 2024-03-19T06:05:21.034 INFO:tasks.workunit.client.1.smithi172.stdout:8/37: dwrite d0/f6 [0,4194304] 0 2024-03-19T06:05:21.035 INFO:tasks.workunit.client.1.smithi172.stdout:1/64: dwrite da/dd/f11 [0,4194304] 0 2024-03-19T06:05:21.037 INFO:tasks.workunit.client.1.smithi172.stdout:6/111: rmdir d5/d16 39 2024-03-19T06:05:21.039 INFO:tasks.workunit.client.1.smithi172.stdout:0/35: write f8 [807501,103976] 0 2024-03-19T06:05:21.039 INFO:tasks.workunit.client.1.smithi172.stdout:4/71: dwrite f8 [0,4194304] 0 2024-03-19T06:05:21.040 INFO:tasks.workunit.client.1.smithi172.stdout:3/124: chown d0/d5/d9/f2c 52689 1 2024-03-19T06:05:21.044 INFO:tasks.workunit.client.1.smithi172.stdout:2/26: dread f1 [0,4194304] 0 2024-03-19T06:05:21.044 INFO:tasks.workunit.client.1.smithi172.stdout:8/38: creat d0/f8 x:0 0 0 2024-03-19T06:05:21.046 INFO:tasks.workunit.client.1.smithi172.stdout:1/65: write f6 [5089679,78354] 0 2024-03-19T06:05:21.049 INFO:tasks.workunit.client.1.smithi172.stdout:0/36: unlink fc 0 2024-03-19T06:05:21.051 INFO:tasks.workunit.client.1.smithi172.stdout:5/65: truncate d5/fb 293597 0 2024-03-19T06:05:21.054 INFO:tasks.workunit.client.1.smithi172.stdout:2/27: fdatasync f1 0 2024-03-19T06:05:21.054 INFO:tasks.workunit.client.1.smithi172.stdout:0/37: fsync f3 0 2024-03-19T06:05:21.055 INFO:tasks.workunit.client.1.smithi172.stdout:3/125: fdatasync d0/d5/f11 0 2024-03-19T06:05:21.058 INFO:tasks.workunit.client.1.smithi172.stdout:4/72: dread f7 [0,4194304] 0 2024-03-19T06:05:21.061 INFO:tasks.workunit.client.1.smithi172.stdout:3/126: write d0/d5/f10 [1492928,17417] 0 2024-03-19T06:05:21.061 INFO:tasks.workunit.client.1.smithi172.stdout:2/28: creat f3 x:0 0 0 2024-03-19T06:05:21.061 INFO:tasks.workunit.client.1.smithi172.stdout:2/29: rmdir - no directory 2024-03-19T06:05:21.063 INFO:tasks.workunit.client.1.smithi172.stdout:0/38: mknod ce 0 2024-03-19T06:05:21.066 INFO:tasks.workunit.client.1.smithi172.stdout:4/73: chown f7 0 1 2024-03-19T06:05:21.069 INFO:tasks.workunit.client.1.smithi172.stdout:0/39: rename fd to ff 0 2024-03-19T06:05:21.074 INFO:tasks.workunit.client.1.smithi172.stdout:4/74: write df/f10 [1300776,25554] 0 2024-03-19T06:05:21.074 INFO:tasks.workunit.client.1.smithi172.stdout:8/39: truncate d0/f1 1718162 0 2024-03-19T06:05:21.076 INFO:tasks.workunit.client.1.smithi172.stdout:0/40: rename fa to f10 0 2024-03-19T06:05:21.078 INFO:tasks.workunit.client.1.smithi172.stdout:8/40: dread - d0/f8 zero size 2024-03-19T06:05:21.078 INFO:tasks.workunit.client.1.smithi172.stdout:0/41: fdatasync f2 0 2024-03-19T06:05:21.079 INFO:tasks.workunit.client.1.smithi172.stdout:7/52: sync 2024-03-19T06:05:21.081 INFO:tasks.workunit.client.1.smithi172.stdout:3/127: truncate d0/d5/d14/f27 951982 0 2024-03-19T06:05:21.084 INFO:tasks.workunit.client.1.smithi172.stdout:7/53: symlink d0/db/l12 0 2024-03-19T06:05:21.084 INFO:tasks.workunit.client.1.smithi172.stdout:0/42: write f3 [3219294,26868] 0 2024-03-19T06:05:21.084 INFO:tasks.workunit.client.1.smithi172.stdout:8/41: dread - d0/f8 zero size 2024-03-19T06:05:21.087 INFO:tasks.workunit.client.1.smithi172.stdout:6/112: dwrite d5/fb [4194304,4194304] 0 2024-03-19T06:05:21.088 INFO:tasks.workunit.client.1.smithi172.stdout:0/43: stat f6 0 2024-03-19T06:05:21.089 INFO:tasks.workunit.client.1.smithi172.stdout:1/66: dwrite f6 [0,4194304] 0 2024-03-19T06:05:21.091 INFO:tasks.workunit.client.1.smithi172.stdout:8/42: readlink d0/l4 0 2024-03-19T06:05:21.092 INFO:tasks.workunit.client.1.smithi172.stdout:8/43: stat d0/f6 0 2024-03-19T06:05:21.094 INFO:tasks.workunit.client.1.smithi172.stdout:0/44: truncate f8 1328206 0 2024-03-19T06:05:21.094 INFO:tasks.workunit.client.1.smithi172.stdout:1/67: write f6 [958651,58072] 0 2024-03-19T06:05:21.095 INFO:tasks.workunit.client.1.smithi172.stdout:7/54: creat d0/db/f13 x:0 0 0 2024-03-19T06:05:21.096 INFO:tasks.workunit.client.1.smithi172.stdout:5/66: write d5/fb [654286,21269] 0 2024-03-19T06:05:21.097 INFO:tasks.workunit.client.1.smithi172.stdout:0/45: fsync f2 0 2024-03-19T06:05:21.098 INFO:tasks.workunit.client.1.smithi172.stdout:3/128: rename d0/d5/d9/f18 to d0/d5/d14/f30 0 2024-03-19T06:05:21.101 INFO:tasks.workunit.client.1.smithi172.stdout:6/113: unlink d5/d11/d17/d1b/f14 0 2024-03-19T06:05:21.101 INFO:tasks.workunit.client.1.smithi172.stdout:6/114: chown d5/fa 7 1 2024-03-19T06:05:21.106 INFO:tasks.workunit.client.1.smithi172.stdout:7/55: mknod d0/c14 0 2024-03-19T06:05:21.107 INFO:tasks.workunit.client.1.smithi172.stdout:1/68: symlink da/dd/l13 0 2024-03-19T06:05:21.109 INFO:tasks.workunit.client.1.smithi172.stdout:5/67: creat d5/d14/f19 x:0 0 0 2024-03-19T06:05:21.111 INFO:tasks.workunit.client.1.smithi172.stdout:3/129: creat d0/d24/f31 x:0 0 0 2024-03-19T06:05:21.112 INFO:tasks.workunit.client.1.smithi172.stdout:0/46: fsync ff 0 2024-03-19T06:05:21.121 INFO:tasks.workunit.client.1.smithi172.stdout:1/69: mkdir da/dd/d10/d14 0 2024-03-19T06:05:21.130 INFO:tasks.workunit.client.1.smithi172.stdout:7/56: write d0/db/f11 [1749311,115841] 0 2024-03-19T06:05:21.132 INFO:tasks.workunit.client.1.smithi172.stdout:8/44: link d0/f1 d0/f9 0 2024-03-19T06:05:21.138 INFO:tasks.workunit.client.1.smithi172.stdout:8/45: readlink d0/l5 0 2024-03-19T06:05:21.149 INFO:tasks.workunit.client.1.smithi172.stdout:8/46: stat d0/f9 0 2024-03-19T06:05:21.152 INFO:tasks.workunit.client.1.smithi172.stdout:3/130: dwrite d0/d5/f8 [0,4194304] 0 2024-03-19T06:05:21.156 INFO:tasks.workunit.client.1.smithi172.stdout:0/47: dwrite ff [0,4194304] 0 2024-03-19T06:05:21.158 INFO:tasks.workunit.client.1.smithi172.stdout:8/47: mknod d0/ca 0 2024-03-19T06:05:21.164 INFO:tasks.workunit.client.1.smithi172.stdout:5/68: dwrite d5/fd [0,4194304] 0 2024-03-19T06:05:21.164 INFO:tasks.workunit.client.1.smithi172.stdout:8/48: chown d0/f3 2 1 2024-03-19T06:05:21.171 INFO:tasks.workunit.client.1.smithi172.stdout:1/70: dwrite da/dd/f11 [0,4194304] 0 2024-03-19T06:05:21.173 INFO:tasks.workunit.client.1.smithi172.stdout:5/69: mknod d5/c1a 0 2024-03-19T06:05:21.179 INFO:tasks.workunit.client.1.smithi172.stdout:0/48: dread f7 [0,4194304] 0 2024-03-19T06:05:21.181 INFO:tasks.workunit.client.1.smithi172.stdout:1/71: creat da/dd/d10/d14/f15 x:0 0 0 2024-03-19T06:05:21.181 INFO:tasks.workunit.client.1.smithi172.stdout:3/131: link d0/d5/d9/la d0/d5/d9/d25/d21/l32 0 2024-03-19T06:05:21.181 INFO:tasks.workunit.client.1.smithi172.stdout:0/49: write f8 [554296,65528] 0 2024-03-19T06:05:21.187 INFO:tasks.workunit.client.1.smithi172.stdout:1/72: mknod da/dd/d10/c16 0 2024-03-19T06:05:21.188 INFO:tasks.workunit.client.1.smithi172.stdout:3/132: mkdir d0/d5/d14/d33 0 2024-03-19T06:05:21.196 INFO:tasks.workunit.client.1.smithi172.stdout:9/36: sync 2024-03-19T06:05:21.197 INFO:tasks.workunit.client.1.smithi172.stdout:3/133: mkdir d0/d5/d9/d34 0 2024-03-19T06:05:21.200 INFO:tasks.workunit.client.1.smithi172.stdout:1/73: getdents da 0 2024-03-19T06:05:21.207 INFO:tasks.workunit.client.1.smithi172.stdout:9/37: chown d1/cb 1 1 2024-03-19T06:05:21.213 INFO:tasks.workunit.client.1.smithi172.stdout:1/74: mknod da/dd/d10/c17 0 2024-03-19T06:05:21.214 INFO:tasks.workunit.client.1.smithi172.stdout:5/70: dwrite d5/d14/f17 [0,4194304] 0 2024-03-19T06:05:21.217 INFO:tasks.workunit.client.1.smithi172.stdout:1/75: chown c8 488 1 2024-03-19T06:05:21.218 INFO:tasks.workunit.client.1.smithi172.stdout:0/50: dwrite ff [4194304,4194304] 0 2024-03-19T06:05:21.219 INFO:tasks.workunit.client.1.smithi172.stdout:8/49: dwrite d0/f9 [0,4194304] 0 2024-03-19T06:05:21.219 INFO:tasks.workunit.client.1.smithi172.stdout:3/134: creat d0/d5/f35 x:0 0 0 2024-03-19T06:05:21.222 INFO:tasks.workunit.client.1.smithi172.stdout:8/50: write d0/f1 [2726941,116033] 0 2024-03-19T06:05:21.227 INFO:tasks.workunit.client.1.smithi172.stdout:3/135: chown d0/d24/f2d 3165014 1 2024-03-19T06:05:21.227 INFO:tasks.workunit.client.1.smithi172.stdout:8/51: stat d0/l4 0 2024-03-19T06:05:21.227 INFO:tasks.workunit.client.1.smithi172.stdout:8/52: readlink d0/l5 0 2024-03-19T06:05:21.229 INFO:tasks.workunit.client.1.smithi172.stdout:1/76: mknod da/dd/d10/c18 0 2024-03-19T06:05:21.243 INFO:tasks.workunit.client.1.smithi172.stdout:3/136: getdents d0/d5/d14/d33 0 2024-03-19T06:05:21.247 INFO:tasks.workunit.client.1.smithi172.stdout:1/77: creat da/dd/f19 x:0 0 0 2024-03-19T06:05:21.250 INFO:tasks.workunit.client.1.smithi172.stdout:3/137: mkdir d0/d24/d36 0 2024-03-19T06:05:21.255 INFO:tasks.workunit.client.1.smithi172.stdout:5/71: dwrite d5/fe [0,4194304] 0 2024-03-19T06:05:21.262 INFO:tasks.workunit.client.1.smithi172.stdout:9/38: dwrite d1/fa [4194304,4194304] 0 2024-03-19T06:05:21.267 INFO:tasks.workunit.client.1.smithi172.stdout:5/72: chown d5/d14/f19 159590 1 2024-03-19T06:05:21.269 INFO:tasks.workunit.client.1.smithi172.stdout:1/78: dread f3 [0,4194304] 0 2024-03-19T06:05:21.269 INFO:tasks.workunit.client.1.smithi172.stdout:9/39: fdatasync d1/f3 0 2024-03-19T06:05:21.271 INFO:tasks.workunit.client.1.smithi172.stdout:3/138: dread d0/d5/d14/f27 [0,4194304] 0 2024-03-19T06:05:21.271 INFO:tasks.workunit.client.1.smithi172.stdout:5/73: chown d5/c10 314030455 1 2024-03-19T06:05:21.273 INFO:tasks.workunit.client.1.smithi172.stdout:5/74: dread - d5/f12 zero size 2024-03-19T06:05:21.274 INFO:tasks.workunit.client.1.smithi172.stdout:0/51: dwrite f0 [0,4194304] 0 2024-03-19T06:05:21.277 INFO:tasks.workunit.client.1.smithi172.stdout:8/53: dread d0/f3 [0,4194304] 0 2024-03-19T06:05:21.278 INFO:tasks.workunit.client.1.smithi172.stdout:5/75: truncate d5/f12 256035 0 2024-03-19T06:05:21.283 INFO:tasks.workunit.client.1.smithi172.stdout:1/79: rename f6 to da/dd/d10/f1a 0 2024-03-19T06:05:21.284 INFO:tasks.workunit.client.1.smithi172.stdout:9/40: mkdir d1/d7/dc 0 2024-03-19T06:05:21.285 INFO:tasks.workunit.client.1.smithi172.stdout:0/52: unlink f3 0 2024-03-19T06:05:21.288 INFO:tasks.workunit.client.1.smithi172.stdout:8/54: unlink d0/f6 0 2024-03-19T06:05:21.290 INFO:tasks.workunit.client.1.smithi172.stdout:2/30: sync 2024-03-19T06:05:21.290 INFO:tasks.workunit.client.1.smithi172.stdout:8/55: dread - d0/f8 zero size 2024-03-19T06:05:21.293 INFO:tasks.workunit.client.1.smithi172.stdout:1/80: unlink da/dd/d10/d14/f15 0 2024-03-19T06:05:21.297 INFO:tasks.workunit.client.1.smithi172.stdout:2/31: link f3 f4 0 2024-03-19T06:05:21.305 INFO:tasks.workunit.client.1.smithi172.stdout:9/41: rename d1/f3 to d1/fd 0 2024-03-19T06:05:21.308 INFO:tasks.workunit.client.1.smithi172.stdout:1/81: rename da/dd/f11 to da/f1b 0 2024-03-19T06:05:21.309 INFO:tasks.workunit.client.1.smithi172.stdout:2/32: rename f1 to f5 0 2024-03-19T06:05:21.310 INFO:tasks.workunit.client.1.smithi172.stdout:3/139: dwrite d0/d5/d14/f27 [0,4194304] 0 2024-03-19T06:05:21.310 INFO:tasks.workunit.client.1.smithi172.stdout:9/42: stat d1/fa 0 2024-03-19T06:05:21.313 INFO:tasks.workunit.client.1.smithi172.stdout:1/82: readlink da/l12 0 2024-03-19T06:05:21.317 INFO:tasks.workunit.client.1.smithi172.stdout:0/53: truncate f0 790430 0 2024-03-19T06:05:21.319 INFO:tasks.workunit.client.1.smithi172.stdout:0/54: chown f7 182 1 2024-03-19T06:05:21.320 INFO:tasks.workunit.client.1.smithi172.stdout:8/56: dread d0/f2 [0,4194304] 0 2024-03-19T06:05:21.320 INFO:tasks.workunit.client.1.smithi172.stdout:1/83: rename c4 to da/dd/c1c 0 2024-03-19T06:05:21.321 INFO:tasks.workunit.client.1.smithi172.stdout:5/76: dwrite f2 [0,4194304] 0 2024-03-19T06:05:21.322 INFO:tasks.workunit.client.1.smithi172.stdout:1/84: chown l9 853869949 1 2024-03-19T06:05:21.324 INFO:tasks.workunit.client.1.smithi172.stdout:0/55: mkdir d11 0 2024-03-19T06:05:21.324 INFO:tasks.workunit.client.1.smithi172.stdout:5/77: chown d5/c1a 35669781 1 2024-03-19T06:05:21.326 INFO:tasks.workunit.client.1.smithi172.stdout:8/57: creat d0/fb x:0 0 0 2024-03-19T06:05:21.327 INFO:tasks.workunit.client.1.smithi172.stdout:1/85: fsync f3 0 2024-03-19T06:05:21.331 INFO:tasks.workunit.client.1.smithi172.stdout:5/78: symlink d5/l1b 0 2024-03-19T06:05:21.333 INFO:tasks.workunit.client.1.smithi172.stdout:1/86: read - da/dd/f19 zero size 2024-03-19T06:05:21.333 INFO:tasks.workunit.client.1.smithi172.stdout:8/58: mknod d0/cc 0 2024-03-19T06:05:21.339 INFO:tasks.workunit.client.1.smithi172.stdout:1/87: fdatasync da/dd/f19 0 2024-03-19T06:05:21.339 INFO:tasks.workunit.client.1.smithi172.stdout:8/59: rename d0/fb to d0/fd 0 2024-03-19T06:05:21.339 INFO:tasks.workunit.client.1.smithi172.stdout:3/140: dread d0/d5/d14/f27 [0,4194304] 0 2024-03-19T06:05:21.342 INFO:tasks.workunit.client.1.smithi172.stdout:1/88: unlink f3 0 2024-03-19T06:05:21.344 INFO:tasks.workunit.client.1.smithi172.stdout:2/33: dwrite f4 [0,4194304] 0 2024-03-19T06:05:21.347 INFO:tasks.workunit.client.1.smithi172.stdout:3/141: mkdir d0/d37 0 2024-03-19T06:05:21.350 INFO:tasks.workunit.client.1.smithi172.stdout:1/89: write da/dd/d10/f1a [5252462,56173] 0 2024-03-19T06:05:21.351 INFO:tasks.workunit.client.1.smithi172.stdout:2/34: unlink f4 0 2024-03-19T06:05:21.354 INFO:tasks.workunit.client.1.smithi172.stdout:0/56: truncate ff 1415082 0 2024-03-19T06:05:21.355 INFO:tasks.workunit.client.1.smithi172.stdout:2/35: creat f6 x:0 0 0 2024-03-19T06:05:21.358 INFO:tasks.workunit.client.1.smithi172.stdout:1/90: unlink da/dd/l13 0 2024-03-19T06:05:21.358 INFO:tasks.workunit.client.1.smithi172.stdout:2/36: chown f6 2 1 2024-03-19T06:05:21.363 INFO:tasks.workunit.client.1.smithi172.stdout:0/57: creat d11/f12 x:0 0 0 2024-03-19T06:05:21.364 INFO:tasks.workunit.client.1.smithi172.stdout:8/60: dread d0/f7 [0,4194304] 0 2024-03-19T06:05:21.366 INFO:tasks.workunit.client.1.smithi172.stdout:3/142: getdents d0/d24 0 2024-03-19T06:05:21.366 INFO:tasks.workunit.client.1.smithi172.stdout:8/61: stat d0/f7 0 2024-03-19T06:05:21.369 INFO:tasks.workunit.client.1.smithi172.stdout:8/62: symlink d0/le 0 2024-03-19T06:05:21.369 INFO:tasks.workunit.client.1.smithi172.stdout:0/58: write ff [481723,16237] 0 2024-03-19T06:05:21.372 INFO:tasks.workunit.client.1.smithi172.stdout:8/63: write d0/f8 [316036,130304] 0 2024-03-19T06:05:21.378 INFO:tasks.workunit.client.1.smithi172.stdout:8/64: write d0/f1 [2636734,94222] 0 2024-03-19T06:05:21.382 INFO:tasks.workunit.client.1.smithi172.stdout:2/37: dread f3 [0,4194304] 0 2024-03-19T06:05:21.386 INFO:tasks.workunit.client.1.smithi172.stdout:2/38: write f6 [86000,101988] 0 2024-03-19T06:05:21.388 INFO:tasks.workunit.client.1.smithi172.stdout:0/59: getdents d11 0 2024-03-19T06:05:21.388 INFO:tasks.workunit.client.1.smithi172.stdout:1/91: dread da/dd/d10/f1a [4194304,4194304] 0 2024-03-19T06:05:21.391 INFO:tasks.workunit.client.1.smithi172.stdout:8/65: dread d0/f8 [0,4194304] 0 2024-03-19T06:05:21.391 INFO:tasks.workunit.client.1.smithi172.stdout:2/39: write f6 [830861,44323] 0 2024-03-19T06:05:21.391 INFO:tasks.workunit.client.1.smithi172.stdout:0/60: creat d11/f13 x:0 0 0 2024-03-19T06:05:21.398 INFO:tasks.workunit.client.1.smithi172.stdout:1/92: write da/dd/d10/f1a [4774344,31226] 0 2024-03-19T06:05:21.398 INFO:tasks.workunit.client.1.smithi172.stdout:3/143: dwrite d0/d5/d14/f16 [0,4194304] 0 2024-03-19T06:05:21.398 INFO:tasks.workunit.client.1.smithi172.stdout:0/61: mkdir d11/d14 0 2024-03-19T06:05:21.402 INFO:tasks.workunit.client.1.smithi172.stdout:1/93: unlink da/cf 0 2024-03-19T06:05:21.403 INFO:tasks.workunit.client.1.smithi172.stdout:1/94: readlink da/l12 0 2024-03-19T06:05:21.407 INFO:tasks.workunit.client.1.smithi172.stdout:1/95: creat da/dd/d10/f1d x:0 0 0 2024-03-19T06:05:21.412 INFO:tasks.workunit.client.1.smithi172.stdout:1/96: creat da/dd/d10/f1e x:0 0 0 2024-03-19T06:05:21.416 INFO:tasks.workunit.client.1.smithi172.stdout:1/97: dread - da/dd/d10/f1e zero size 2024-03-19T06:05:21.417 INFO:tasks.workunit.client.1.smithi172.stdout:8/66: dread d0/f9 [0,4194304] 0 2024-03-19T06:05:21.419 INFO:tasks.workunit.client.1.smithi172.stdout:6/115: sync 2024-03-19T06:05:21.419 INFO:tasks.workunit.client.1.smithi172.stdout:4/75: sync 2024-03-19T06:05:21.420 INFO:tasks.workunit.client.1.smithi172.stdout:7/57: sync 2024-03-19T06:05:21.420 INFO:tasks.workunit.client.1.smithi172.stdout:3/144: dwrite d0/d24/f31 [0,4194304] 0 2024-03-19T06:05:21.428 INFO:tasks.workunit.client.1.smithi172.stdout:4/76: rename l9 to df/d11/l15 0 2024-03-19T06:05:21.428 INFO:tasks.workunit.client.1.smithi172.stdout:4/77: stat ca 0 2024-03-19T06:05:21.429 INFO:tasks.workunit.client.1.smithi172.stdout:6/116: mknod d5/d11/d17/c20 0 2024-03-19T06:05:21.434 INFO:tasks.workunit.client.1.smithi172.stdout:8/67: dread d0/f2 [0,4194304] 0 2024-03-19T06:05:21.435 INFO:tasks.workunit.client.1.smithi172.stdout:1/98: dread da/dd/d10/f1a [0,4194304] 0 2024-03-19T06:05:21.435 INFO:tasks.workunit.client.1.smithi172.stdout:4/78: rename fd to df/d11/d12/f16 0 2024-03-19T06:05:21.439 INFO:tasks.workunit.client.1.smithi172.stdout:1/99: dread - da/dd/d10/f1d zero size 2024-03-19T06:05:21.440 INFO:tasks.workunit.client.1.smithi172.stdout:8/68: mknod d0/cf 0 2024-03-19T06:05:21.440 INFO:tasks.workunit.client.1.smithi172.stdout:3/145: rmdir d0/d5/d14/d33 0 2024-03-19T06:05:21.442 INFO:tasks.workunit.client.1.smithi172.stdout:6/117: rename d5/fc to d5/d11/d17/d1b/f21 0 2024-03-19T06:05:21.446 INFO:tasks.workunit.client.1.smithi172.stdout:1/100: unlink da/dd/d10/f1a 0 2024-03-19T06:05:21.449 INFO:tasks.workunit.client.1.smithi172.stdout:1/101: write da/dd/d10/f1d [347869,32706] 0 2024-03-19T06:05:21.451 INFO:tasks.workunit.client.1.smithi172.stdout:0/62: dwrite f2 [0,4194304] 0 2024-03-19T06:05:21.456 INFO:tasks.workunit.client.1.smithi172.stdout:7/58: truncate d0/f10 1232044 0 2024-03-19T06:05:21.457 INFO:tasks.workunit.client.1.smithi172.stdout:8/69: write d0/f7 [5907890,94628] 0 2024-03-19T06:05:21.458 INFO:tasks.workunit.client.1.smithi172.stdout:7/59: creat d0/f15 x:0 0 0 2024-03-19T06:05:21.460 INFO:tasks.workunit.client.1.smithi172.stdout:8/70: write d0/f7 [769509,341] 0 2024-03-19T06:05:21.461 INFO:tasks.workunit.client.1.smithi172.stdout:4/79: dread df/d11/d12/f16 [0,4194304] 0 2024-03-19T06:05:21.463 INFO:tasks.workunit.client.1.smithi172.stdout:1/102: fdatasync da/dd/d10/f1d 0 2024-03-19T06:05:21.470 INFO:tasks.workunit.client.1.smithi172.stdout:6/118: dwrite d5/d16/f18 [0,4194304] 0 2024-03-19T06:05:21.473 INFO:tasks.workunit.client.1.smithi172.stdout:1/103: creat da/dd/f1f x:0 0 0 2024-03-19T06:05:21.474 INFO:tasks.workunit.client.1.smithi172.stdout:1/104: stat da/dd 0 2024-03-19T06:05:21.478 INFO:tasks.workunit.client.1.smithi172.stdout:4/80: link df/d11/c13 df/d11/c17 0 2024-03-19T06:05:21.481 INFO:tasks.workunit.client.1.smithi172.stdout:0/63: dwrite f8 [0,4194304] 0 2024-03-19T06:05:21.481 INFO:tasks.workunit.client.1.smithi172.stdout:1/105: write da/f1b [2265738,126241] 0 2024-03-19T06:05:21.484 INFO:tasks.workunit.client.1.smithi172.stdout:4/81: write f6 [9305236,38379] 0 2024-03-19T06:05:21.485 INFO:tasks.workunit.client.1.smithi172.stdout:0/64: dread - f6 zero size 2024-03-19T06:05:21.485 INFO:tasks.workunit.client.1.smithi172.stdout:6/119: unlink d5/d11/d17/c1a 0 2024-03-19T06:05:21.493 INFO:tasks.workunit.client.1.smithi172.stdout:0/65: truncate d11/f13 131505 0 2024-03-19T06:05:21.495 INFO:tasks.workunit.client.1.smithi172.stdout:6/120: dread d5/f13 [0,4194304] 0 2024-03-19T06:05:21.496 INFO:tasks.workunit.client.1.smithi172.stdout:4/82: rename df/f10 to df/d11/d12/f18 0 2024-03-19T06:05:21.497 INFO:tasks.workunit.client.1.smithi172.stdout:4/83: readlink l5 0 2024-03-19T06:05:21.498 INFO:tasks.workunit.client.1.smithi172.stdout:8/71: dwrite d0/f8 [0,4194304] 0 2024-03-19T06:05:21.500 INFO:tasks.workunit.client.1.smithi172.stdout:6/121: creat d5/d11/f22 x:0 0 0 2024-03-19T06:05:21.503 INFO:tasks.workunit.client.1.smithi172.stdout:0/66: symlink d11/d14/l15 0 2024-03-19T06:05:21.505 INFO:tasks.workunit.client.1.smithi172.stdout:4/84: write df/d11/d12/f18 [2521435,102585] 0 2024-03-19T06:05:21.508 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:21 smithi172 ceph-mon[35716]: pgmap v7: 65 pgs: 65 active+clean; 295 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 286 KiB/s rd, 17 MiB/s wr, 178 op/s 2024-03-19T06:05:21.510 INFO:tasks.workunit.client.1.smithi172.stdout:0/67: creat d11/d14/f16 x:0 0 0 2024-03-19T06:05:21.518 INFO:tasks.workunit.client.1.smithi172.stdout:0/68: symlink d11/d14/l17 0 2024-03-19T06:05:21.523 INFO:tasks.workunit.client.1.smithi172.stdout:0/69: mkdir d11/d18 0 2024-03-19T06:05:21.525 INFO:tasks.workunit.client.1.smithi172.stdout:1/106: dwrite da/dd/d10/f1e [0,4194304] 0 2024-03-19T06:05:21.525 INFO:tasks.workunit.client.1.smithi172.stdout:4/85: rmdir df 39 2024-03-19T06:05:21.526 INFO:tasks.workunit.client.1.smithi172.stdout:0/70: write f2 [5195733,38596] 0 2024-03-19T06:05:21.528 INFO:tasks.workunit.client.1.smithi172.stdout:1/107: chown da/f1b 1856937 1 2024-03-19T06:05:21.530 INFO:tasks.workunit.client.1.smithi172.stdout:0/71: write d11/f13 [435859,99497] 0 2024-03-19T06:05:21.532 INFO:tasks.workunit.client.1.smithi172.stdout:6/122: truncate d5/f6 199100 0 2024-03-19T06:05:21.533 INFO:tasks.workunit.client.1.smithi172.stdout:8/72: dwrite d0/f7 [0,4194304] 0 2024-03-19T06:05:21.537 INFO:tasks.workunit.client.1.smithi172.stdout:1/108: rename da/dd/f19 to da/f20 0 2024-03-19T06:05:21.537 INFO:tasks.workunit.client.1.smithi172.stdout:6/123: unlink d5/cf 0 2024-03-19T06:05:21.539 INFO:tasks.workunit.client.1.smithi172.stdout:8/73: mkdir d0/d10 0 2024-03-19T06:05:21.542 INFO:tasks.workunit.client.1.smithi172.stdout:6/124: mknod d5/d11/c23 0 2024-03-19T06:05:21.545 INFO:tasks.workunit.client.1.smithi172.stdout:8/74: fdatasync d0/f1 0 2024-03-19T06:05:21.546 INFO:tasks.workunit.client.1.smithi172.stdout:0/72: rename lb to d11/d14/l19 0 2024-03-19T06:05:21.547 INFO:tasks.workunit.client.1.smithi172.stdout:1/109: rename da/dd/d10/d14 to da/dd/d10/d14/d21 22 2024-03-19T06:05:21.548 INFO:tasks.workunit.client.1.smithi172.stdout:8/75: write d0/f8 [4356593,70505] 0 2024-03-19T06:05:21.548 INFO:tasks.workunit.client.1.smithi172.stdout:0/73: stat d11/d14/f16 0 2024-03-19T06:05:21.548 INFO:tasks.workunit.client.1.smithi172.stdout:6/125: symlink d5/d11/l24 0 2024-03-19T06:05:21.553 INFO:tasks.workunit.client.1.smithi172.stdout:8/76: creat d0/f11 x:0 0 0 2024-03-19T06:05:21.553 INFO:tasks.workunit.client.1.smithi172.stdout:0/74: dread f7 [0,4194304] 0 2024-03-19T06:05:21.558 INFO:tasks.workunit.client.1.smithi172.stdout:0/75: read d11/f13 [247483,81276] 0 2024-03-19T06:05:21.559 INFO:tasks.workunit.client.1.smithi172.stdout:8/77: write d0/f2 [4662157,93453] 0 2024-03-19T06:05:21.560 INFO:tasks.workunit.client.1.smithi172.stdout:0/76: chown f2 5186 1 2024-03-19T06:05:21.563 INFO:tasks.workunit.client.1.smithi172.stdout:6/126: link d5/d11/d17/d1b/f21 d5/d11/d17/d1b/f25 0 2024-03-19T06:05:21.566 INFO:tasks.workunit.client.1.smithi172.stdout:0/77: rename d11 to d11/d18/d1a 22 2024-03-19T06:05:21.568 INFO:tasks.workunit.client.1.smithi172.stdout:0/78: write f2 [1695254,66633] 0 2024-03-19T06:05:21.572 INFO:tasks.workunit.client.1.smithi172.stdout:4/86: dwrite df/d11/d12/f16 [0,4194304] 0 2024-03-19T06:05:21.574 INFO:tasks.workunit.client.1.smithi172.stdout:0/79: truncate f7 1706918 0 2024-03-19T06:05:21.574 INFO:tasks.workunit.client.1.smithi172.stdout:6/127: unlink d5/d11/l1e 0 2024-03-19T06:05:21.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:21 smithi072 ceph-mon[28706]: pgmap v7: 65 pgs: 65 active+clean; 295 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 286 KiB/s rd, 17 MiB/s wr, 178 op/s 2024-03-19T06:05:21.582 INFO:tasks.workunit.client.1.smithi172.stdout:4/87: write fe [402976,86590] 0 2024-03-19T06:05:21.584 INFO:tasks.workunit.client.1.smithi172.stdout:1/110: dwrite da/dd/d10/f1d [0,4194304] 0 2024-03-19T06:05:21.584 INFO:tasks.workunit.client.1.smithi172.stdout:0/80: write d11/d14/f16 [283405,59539] 0 2024-03-19T06:05:21.589 INFO:tasks.workunit.client.1.smithi172.stdout:0/81: creat d11/f1b x:0 0 0 2024-03-19T06:05:21.590 INFO:tasks.workunit.client.1.smithi172.stdout:8/78: dwrite d0/f8 [0,4194304] 0 2024-03-19T06:05:21.590 INFO:tasks.workunit.client.1.smithi172.stdout:6/128: truncate d5/d11/d17/d1b/f21 981406 0 2024-03-19T06:05:21.594 INFO:tasks.workunit.client.1.smithi172.stdout:6/129: write d5/f8 [1767437,67087] 0 2024-03-19T06:05:21.594 INFO:tasks.workunit.client.1.smithi172.stdout:0/82: creat d11/d14/f1c x:0 0 0 2024-03-19T06:05:21.602 INFO:tasks.workunit.client.1.smithi172.stdout:8/79: rename d0/f7 to d0/f12 0 2024-03-19T06:05:21.603 INFO:tasks.workunit.client.1.smithi172.stdout:1/111: getdents da/dd 0 2024-03-19T06:05:21.607 INFO:tasks.workunit.client.1.smithi172.stdout:8/80: symlink d0/l13 0 2024-03-19T06:05:21.608 INFO:tasks.workunit.client.1.smithi172.stdout:6/130: dread d5/f6 [0,4194304] 0 2024-03-19T06:05:21.608 INFO:tasks.workunit.client.1.smithi172.stdout:1/112: symlink da/l22 0 2024-03-19T06:05:21.613 INFO:tasks.workunit.client.1.smithi172.stdout:1/113: creat da/dd/d10/f23 x:0 0 0 2024-03-19T06:05:21.614 INFO:tasks.workunit.client.1.smithi172.stdout:4/88: write f7 [3540535,38549] 0 2024-03-19T06:05:21.616 INFO:tasks.workunit.client.1.smithi172.stdout:1/114: chown da/dd/d10/c16 1080 1 2024-03-19T06:05:21.617 INFO:tasks.workunit.client.1.smithi172.stdout:0/83: dread f8 [0,4194304] 0 2024-03-19T06:05:21.618 INFO:tasks.workunit.client.1.smithi172.stdout:4/89: fsync df/d11/d12/f18 0 2024-03-19T06:05:21.618 INFO:tasks.workunit.client.1.smithi172.stdout:6/131: link d5/d11/d17/c1f d5/d11/c26 0 2024-03-19T06:05:21.623 INFO:tasks.workunit.client.1.smithi172.stdout:4/90: write fb [4255309,93355] 0 2024-03-19T06:05:21.623 INFO:tasks.workunit.client.1.smithi172.stdout:6/132: mknod d5/d11/c27 0 2024-03-19T06:05:21.626 INFO:tasks.workunit.client.1.smithi172.stdout:8/81: dread d0/f3 [0,4194304] 0 2024-03-19T06:05:21.628 INFO:tasks.workunit.client.1.smithi172.stdout:1/115: link da/f20 da/dd/d10/f24 0 2024-03-19T06:05:21.631 INFO:tasks.workunit.client.1.smithi172.stdout:4/91: creat df/d11/f19 x:0 0 0 2024-03-19T06:05:21.631 INFO:tasks.workunit.client.1.smithi172.stdout:0/84: link d11/d14/l17 d11/d18/l1d 0 2024-03-19T06:05:21.634 INFO:tasks.workunit.client.1.smithi172.stdout:1/116: rename da/dd/d10/c17 to da/dd/d10/d14/c25 0 2024-03-19T06:05:21.634 INFO:tasks.workunit.client.1.smithi172.stdout:8/82: mknod d0/d10/c14 0 2024-03-19T06:05:21.636 INFO:tasks.workunit.client.1.smithi172.stdout:8/83: truncate d0/fd 544833 0 2024-03-19T06:05:21.636 INFO:tasks.workunit.client.1.smithi172.stdout:4/92: creat df/d11/d12/f1a x:0 0 0 2024-03-19T06:05:21.637 INFO:tasks.workunit.client.1.smithi172.stdout:0/85: fdatasync f8 0 2024-03-19T06:05:21.638 INFO:tasks.workunit.client.1.smithi172.stdout:6/133: creat d5/d16/f28 x:0 0 0 2024-03-19T06:05:21.638 INFO:tasks.workunit.client.1.smithi172.stdout:8/84: fsync d0/f8 0 2024-03-19T06:05:21.639 INFO:tasks.workunit.client.1.smithi172.stdout:0/86: dread - d11/d14/f1c zero size 2024-03-19T06:05:21.639 INFO:tasks.workunit.client.1.smithi172.stdout:6/134: chown d5/f6 155721 1 2024-03-19T06:05:21.640 INFO:tasks.workunit.client.1.smithi172.stdout:4/93: readlink df/d11/l15 0 2024-03-19T06:05:21.640 INFO:tasks.workunit.client.1.smithi172.stdout:8/85: chown d0/cf 155987 1 2024-03-19T06:05:21.642 INFO:tasks.workunit.client.1.smithi172.stdout:0/87: symlink d11/l1e 0 2024-03-19T06:05:21.642 INFO:tasks.workunit.client.1.smithi172.stdout:6/135: write d5/f8 [2256303,14320] 0 2024-03-19T06:05:21.643 INFO:tasks.workunit.client.1.smithi172.stdout:0/88: dread - d11/d14/f1c zero size 2024-03-19T06:05:21.645 INFO:tasks.workunit.client.1.smithi172.stdout:0/89: write f8 [4982842,16644] 0 2024-03-19T06:05:21.645 INFO:tasks.workunit.client.1.smithi172.stdout:8/86: creat d0/f15 x:0 0 0 2024-03-19T06:05:21.646 INFO:tasks.workunit.client.1.smithi172.stdout:8/87: dread - d0/f15 zero size 2024-03-19T06:05:21.649 INFO:tasks.workunit.client.1.smithi172.stdout:0/90: creat d11/d14/f1f x:0 0 0 2024-03-19T06:05:21.651 INFO:tasks.workunit.client.1.smithi172.stdout:8/88: symlink d0/l16 0 2024-03-19T06:05:21.653 INFO:tasks.workunit.client.1.smithi172.stdout:0/91: mkdir d11/d14/d20 0 2024-03-19T06:05:21.655 INFO:tasks.workunit.client.1.smithi172.stdout:8/89: mkdir d0/d17 0 2024-03-19T06:05:21.656 INFO:tasks.workunit.client.1.smithi172.stdout:0/92: write d11/d14/f16 [389445,42794] 0 2024-03-19T06:05:21.659 INFO:tasks.workunit.client.1.smithi172.stdout:0/93: write d11/d14/f16 [880947,101419] 0 2024-03-19T06:05:21.660 INFO:tasks.workunit.client.1.smithi172.stdout:0/94: fdatasync f8 0 2024-03-19T06:05:21.662 INFO:tasks.workunit.client.1.smithi172.stdout:8/90: rename d0/d10/c14 to d0/c18 0 2024-03-19T06:05:21.663 INFO:tasks.workunit.client.1.smithi172.stdout:4/94: dwrite df/d11/d12/f18 [0,4194304] 0 2024-03-19T06:05:21.666 INFO:tasks.workunit.client.1.smithi172.stdout:1/117: truncate da/dd/d10/f1d 1962784 0 2024-03-19T06:05:21.668 INFO:tasks.workunit.client.1.smithi172.stdout:4/95: symlink df/l1b 0 2024-03-19T06:05:21.668 INFO:tasks.workunit.client.1.smithi172.stdout:0/95: write f7 [484166,60689] 0 2024-03-19T06:05:21.669 INFO:tasks.workunit.client.1.smithi172.stdout:8/91: mkdir d0/d17/d19 0 2024-03-19T06:05:21.670 INFO:tasks.workunit.client.1.smithi172.stdout:1/118: truncate da/dd/f1f 723754 0 2024-03-19T06:05:21.671 INFO:tasks.workunit.client.1.smithi172.stdout:6/136: write d5/d16/f18 [5202492,89898] 0 2024-03-19T06:05:21.673 INFO:tasks.workunit.client.1.smithi172.stdout:4/96: symlink df/d11/l1c 0 2024-03-19T06:05:21.674 INFO:tasks.workunit.client.1.smithi172.stdout:6/137: read - d5/fa zero size 2024-03-19T06:05:21.680 INFO:tasks.workunit.client.1.smithi172.stdout:0/96: getdents d11/d14/d20 0 2024-03-19T06:05:21.681 INFO:tasks.workunit.client.1.smithi172.stdout:4/97: read f7 [3700403,48109] 0 2024-03-19T06:05:21.683 INFO:tasks.workunit.client.1.smithi172.stdout:1/119: rename da/dd/d10/f1e to da/f26 0 2024-03-19T06:05:21.684 INFO:tasks.workunit.client.1.smithi172.stdout:6/138: rmdir d5/d11/d17 39 2024-03-19T06:05:21.687 INFO:tasks.workunit.client.1.smithi172.stdout:4/98: unlink df/l1b 0 2024-03-19T06:05:21.688 INFO:tasks.workunit.client.1.smithi172.stdout:0/97: rename d11/d14/f1c to d11/d18/f21 0 2024-03-19T06:05:21.692 INFO:tasks.workunit.client.1.smithi172.stdout:4/99: write fb [3078402,47593] 0 2024-03-19T06:05:21.697 INFO:tasks.workunit.client.1.smithi172.stdout:4/100: truncate df/d11/d12/f1a 248126 0 2024-03-19T06:05:21.698 INFO:tasks.workunit.client.1.smithi172.stdout:8/92: truncate d0/f2 3158268 0 2024-03-19T06:05:21.699 INFO:tasks.workunit.client.1.smithi172.stdout:6/139: getdents d5/d11/d17/d1b 0 2024-03-19T06:05:21.701 INFO:tasks.workunit.client.1.smithi172.stdout:1/120: getdents da 0 2024-03-19T06:05:21.702 INFO:tasks.workunit.client.1.smithi172.stdout:4/101: write fb [2004132,96944] 0 2024-03-19T06:05:21.704 INFO:tasks.workunit.client.1.smithi172.stdout:4/102: chown df 15552 1 2024-03-19T06:05:21.705 INFO:tasks.workunit.client.1.smithi172.stdout:1/121: chown da/dd/d10 5 1 2024-03-19T06:05:21.707 INFO:tasks.workunit.client.1.smithi172.stdout:8/93: link d0/f12 d0/d10/f1a 0 2024-03-19T06:05:21.709 INFO:tasks.workunit.client.1.smithi172.stdout:6/140: getdents d5 0 2024-03-19T06:05:21.710 INFO:tasks.workunit.client.1.smithi172.stdout:1/122: chown da/dd/d10/c16 472313 1 2024-03-19T06:05:21.710 INFO:tasks.workunit.client.1.smithi172.stdout:4/103: chown df/d11/d12/f16 1 1 2024-03-19T06:05:21.714 INFO:tasks.workunit.client.1.smithi172.stdout:0/98: dwrite f7 [0,4194304] 0 2024-03-19T06:05:21.717 INFO:tasks.workunit.client.1.smithi172.stdout:4/104: read f7 [3715092,69439] 0 2024-03-19T06:05:21.718 INFO:tasks.workunit.client.1.smithi172.stdout:1/123: fdatasync da/dd/d10/f23 0 2024-03-19T06:05:21.719 INFO:tasks.workunit.client.1.smithi172.stdout:0/99: chown d11/d18/f21 1995124504 1 2024-03-19T06:05:21.722 INFO:tasks.workunit.client.1.smithi172.stdout:4/105: rmdir df/d11/d12 39 2024-03-19T06:05:21.722 INFO:tasks.workunit.client.1.smithi172.stdout:8/94: chown d0/f9 249 1 2024-03-19T06:05:21.722 INFO:tasks.workunit.client.1.smithi172.stdout:1/124: mkdir da/dd/d10/d14/d27 0 2024-03-19T06:05:21.724 INFO:tasks.workunit.client.1.smithi172.stdout:0/100: unlink f0 0 2024-03-19T06:05:21.726 INFO:tasks.workunit.client.1.smithi172.stdout:8/95: truncate d0/f15 420354 0 2024-03-19T06:05:21.728 INFO:tasks.workunit.client.1.smithi172.stdout:4/106: rmdir df/d11 39 2024-03-19T06:05:21.728 INFO:tasks.workunit.client.1.smithi172.stdout:1/125: mknod da/dd/d10/c28 0 2024-03-19T06:05:21.734 INFO:tasks.workunit.client.1.smithi172.stdout:4/107: write f7 [2988736,5630] 0 2024-03-19T06:05:21.740 INFO:tasks.workunit.client.1.smithi172.stdout:2/40: sync 2024-03-19T06:05:21.740 INFO:tasks.workunit.client.1.smithi172.stdout:5/79: sync 2024-03-19T06:05:21.740 INFO:tasks.workunit.client.1.smithi172.stdout:9/43: sync 2024-03-19T06:05:21.740 INFO:tasks.workunit.client.1.smithi172.stdout:7/60: sync 2024-03-19T06:05:21.740 INFO:tasks.workunit.client.1.smithi172.stdout:3/146: sync 2024-03-19T06:05:21.740 INFO:tasks.workunit.client.1.smithi172.stdout:6/141: dwrite d5/d16/f28 [0,4194304] 0 2024-03-19T06:05:21.740 INFO:tasks.workunit.client.1.smithi172.stdout:3/147: chown d0/d5/d9 63796 1 2024-03-19T06:05:21.741 INFO:tasks.workunit.client.1.smithi172.stdout:5/80: fsync d5/d14/f19 0 2024-03-19T06:05:21.743 INFO:tasks.workunit.client.1.smithi172.stdout:8/96: write d0/f12 [381434,28044] 0 2024-03-19T06:05:21.744 INFO:tasks.workunit.client.1.smithi172.stdout:2/41: mkdir d7 0 2024-03-19T06:05:21.745 INFO:tasks.workunit.client.1.smithi172.stdout:8/97: readlink d0/l4 0 2024-03-19T06:05:21.756 INFO:tasks.workunit.client.1.smithi172.stdout:7/61: link d0/db/f11 d0/f16 0 2024-03-19T06:05:21.758 INFO:tasks.workunit.client.1.smithi172.stdout:6/142: symlink d5/d16/l29 0 2024-03-19T06:05:21.760 INFO:tasks.workunit.client.1.smithi172.stdout:5/81: rename d5/f12 to d5/d14/d15/f1c 0 2024-03-19T06:05:21.764 INFO:tasks.workunit.client.1.smithi172.stdout:3/148: creat d0/d5/d9/d25/d21/f38 x:0 0 0 2024-03-19T06:05:21.765 INFO:tasks.workunit.client.1.smithi172.stdout:7/62: mkdir d0/db/d17 0 2024-03-19T06:05:21.766 INFO:tasks.workunit.client.1.smithi172.stdout:0/101: dwrite f2 [4194304,4194304] 0 2024-03-19T06:05:21.774 INFO:tasks.workunit.client.1.smithi172.stdout:6/143: write d5/d16/f18 [4233620,42320] 0 2024-03-19T06:05:21.775 INFO:tasks.workunit.client.1.smithi172.stdout:7/63: dread - d0/db/f13 zero size 2024-03-19T06:05:21.776 INFO:tasks.workunit.client.1.smithi172.stdout:4/108: dwrite f8 [0,4194304] 0 2024-03-19T06:05:21.776 INFO:tasks.workunit.client.1.smithi172.stdout:5/82: rename d5/d14/f17 to d5/f1d 0 2024-03-19T06:05:21.777 INFO:tasks.workunit.client.1.smithi172.stdout:8/98: dread d0/f2 [0,4194304] 0 2024-03-19T06:05:21.778 INFO:tasks.workunit.client.1.smithi172.stdout:9/44: dread d1/fd [0,4194304] 0 2024-03-19T06:05:21.779 INFO:tasks.workunit.client.1.smithi172.stdout:7/64: stat d0/f16 0 2024-03-19T06:05:21.783 INFO:tasks.workunit.client.1.smithi172.stdout:0/102: mkdir d11/d22 0 2024-03-19T06:05:21.784 INFO:tasks.workunit.client.1.smithi172.stdout:8/99: rmdir d0/d17 39 2024-03-19T06:05:21.785 INFO:tasks.workunit.client.1.smithi172.stdout:5/83: mknod d5/d14/c1e 0 2024-03-19T06:05:21.787 INFO:tasks.workunit.client.1.smithi172.stdout:6/144: write d5/d16/f28 [4103234,52695] 0 2024-03-19T06:05:21.790 INFO:tasks.workunit.client.1.smithi172.stdout:5/84: stat l1 0 2024-03-19T06:05:21.790 INFO:tasks.workunit.client.1.smithi172.stdout:8/100: chown d0/f11 206 1 2024-03-19T06:05:21.790 INFO:tasks.workunit.client.1.smithi172.stdout:7/65: link d0/c14 d0/c18 0 2024-03-19T06:05:21.791 INFO:tasks.workunit.client.1.smithi172.stdout:4/109: write df/d11/d12/f16 [2681101,14541] 0 2024-03-19T06:05:21.792 INFO:tasks.workunit.client.1.smithi172.stdout:6/145: readlink d5/d16/l29 0 2024-03-19T06:05:21.793 INFO:tasks.workunit.client.1.smithi172.stdout:2/42: dwrite f3 [4194304,4194304] 0 2024-03-19T06:05:21.794 INFO:tasks.workunit.client.1.smithi172.stdout:5/85: mkdir d5/d1f 0 2024-03-19T06:05:21.798 INFO:tasks.workunit.client.1.smithi172.stdout:6/146: dread - d5/fa zero size 2024-03-19T06:05:21.800 INFO:tasks.workunit.client.1.smithi172.stdout:4/110: readlink df/d11/l1c 0 2024-03-19T06:05:21.802 INFO:tasks.workunit.client.1.smithi172.stdout:7/66: mknod d0/db/c19 0 2024-03-19T06:05:21.802 INFO:tasks.workunit.client.1.smithi172.stdout:0/103: write d11/d18/f21 [505428,38510] 0 2024-03-19T06:05:21.806 INFO:tasks.workunit.client.1.smithi172.stdout:2/43: creat d7/f8 x:0 0 0 2024-03-19T06:05:21.808 INFO:tasks.workunit.client.1.smithi172.stdout:4/111: dread - df/d11/f19 zero size 2024-03-19T06:05:21.810 INFO:tasks.workunit.client.1.smithi172.stdout:2/44: write d7/f8 [342077,83526] 0 2024-03-19T06:05:21.815 INFO:tasks.workunit.client.1.smithi172.stdout:6/147: dread d5/f13 [0,4194304] 0 2024-03-19T06:05:21.816 INFO:tasks.workunit.client.1.smithi172.stdout:7/67: mknod d0/db/d17/c1a 0 2024-03-19T06:05:21.818 INFO:tasks.workunit.client.1.smithi172.stdout:6/148: fdatasync d5/f1d 0 2024-03-19T06:05:21.819 INFO:tasks.workunit.client.1.smithi172.stdout:5/86: getdents d5 0 2024-03-19T06:05:21.823 INFO:tasks.workunit.client.1.smithi172.stdout:6/149: fsync d5/fa 0 2024-03-19T06:05:21.825 INFO:tasks.workunit.client.1.smithi172.stdout:5/87: mknod d5/d14/c20 0 2024-03-19T06:05:21.825 INFO:tasks.workunit.client.1.smithi172.stdout:9/45: dwrite d1/f9 [0,4194304] 0 2024-03-19T06:05:21.825 INFO:tasks.workunit.client.1.smithi172.stdout:7/68: creat d0/db/d17/f1b x:0 0 0 2024-03-19T06:05:21.828 INFO:tasks.workunit.client.1.smithi172.stdout:4/112: rename df/d11/d12/f18 to df/d11/f1d 0 2024-03-19T06:05:21.830 INFO:tasks.workunit.client.1.smithi172.stdout:2/45: getdents d7 0 2024-03-19T06:05:21.830 INFO:tasks.workunit.client.1.smithi172.stdout:5/88: fdatasync d5/ff 0 2024-03-19T06:05:21.834 INFO:tasks.workunit.client.1.smithi172.stdout:9/46: mkdir d1/d7/dc/de 0 2024-03-19T06:05:21.835 INFO:tasks.workunit.client.1.smithi172.stdout:9/47: chown d1 39715611 1 2024-03-19T06:05:21.837 INFO:tasks.workunit.client.1.smithi172.stdout:5/89: creat d5/d14/d15/f21 x:0 0 0 2024-03-19T06:05:21.837 INFO:tasks.workunit.client.1.smithi172.stdout:4/113: write df/d11/f1d [3755383,83669] 0 2024-03-19T06:05:21.840 INFO:tasks.workunit.client.1.smithi172.stdout:5/90: write d5/d14/f19 [80198,111648] 0 2024-03-19T06:05:21.840 INFO:tasks.workunit.client.1.smithi172.stdout:9/48: symlink d1/lf 0 2024-03-19T06:05:21.845 INFO:tasks.workunit.client.1.smithi172.stdout:2/46: write f5 [269786,11294] 0 2024-03-19T06:05:21.847 INFO:tasks.workunit.client.1.smithi172.stdout:5/91: write d5/f18 [4854476,62948] 0 2024-03-19T06:05:21.848 INFO:tasks.workunit.client.1.smithi172.stdout:9/49: symlink d1/d7/l10 0 2024-03-19T06:05:21.850 INFO:tasks.workunit.client.1.smithi172.stdout:6/150: dread d5/d16/f28 [0,4194304] 0 2024-03-19T06:05:21.852 INFO:tasks.workunit.client.1.smithi172.stdout:4/114: rename f7 to df/d11/d12/f1e 0 2024-03-19T06:05:21.855 INFO:tasks.workunit.client.1.smithi172.stdout:2/47: mknod d7/c9 0 2024-03-19T06:05:21.855 INFO:tasks.workunit.client.1.smithi172.stdout:9/50: chown d1/d7/dc/de 64568047 1 2024-03-19T06:05:21.859 INFO:tasks.workunit.client.1.smithi172.stdout:2/48: chown d7/f8 1522772495 1 2024-03-19T06:05:21.861 INFO:tasks.workunit.client.1.smithi172.stdout:9/51: mknod d1/c11 0 2024-03-19T06:05:21.863 INFO:tasks.workunit.client.1.smithi172.stdout:6/151: truncate d5/f13 881955 0 2024-03-19T06:05:21.867 INFO:tasks.workunit.client.1.smithi172.stdout:2/49: link f3 d7/fa 0 2024-03-19T06:05:21.868 INFO:tasks.workunit.client.1.smithi172.stdout:7/69: dwrite d0/db/d17/f1b [0,4194304] 0 2024-03-19T06:05:21.872 INFO:tasks.workunit.client.1.smithi172.stdout:2/50: chown d7/fa 2770666 1 2024-03-19T06:05:21.877 INFO:tasks.workunit.client.1.smithi172.stdout:6/152: truncate d5/f13 928259 0 2024-03-19T06:05:21.879 INFO:tasks.workunit.client.1.smithi172.stdout:6/153: readlink d5/d11/l24 0 2024-03-19T06:05:21.879 INFO:tasks.workunit.client.1.smithi172.stdout:5/92: dread f2 [0,4194304] 0 2024-03-19T06:05:21.883 INFO:tasks.workunit.client.1.smithi172.stdout:4/115: dread df/d11/d12/f1e [0,4194304] 0 2024-03-19T06:05:21.884 INFO:tasks.workunit.client.1.smithi172.stdout:5/93: chown d5/fe 32664245 1 2024-03-19T06:05:21.885 INFO:tasks.workunit.client.1.smithi172.stdout:9/52: dread d1/f9 [0,4194304] 0 2024-03-19T06:05:21.886 INFO:tasks.workunit.client.1.smithi172.stdout:2/51: truncate f6 160447 0 2024-03-19T06:05:21.889 INFO:tasks.workunit.client.1.smithi172.stdout:5/94: chown d5/d14/c1e 11228623 1 2024-03-19T06:05:21.891 INFO:tasks.workunit.client.1.smithi172.stdout:7/70: dread d0/db/d17/f1b [0,4194304] 0 2024-03-19T06:05:21.896 INFO:tasks.workunit.client.1.smithi172.stdout:9/53: rename d1/d7/l8 to d1/l12 0 2024-03-19T06:05:21.900 INFO:tasks.workunit.client.1.smithi172.stdout:4/116: truncate df/d11/d12/f16 2126848 0 2024-03-19T06:05:21.901 INFO:tasks.workunit.client.1.smithi172.stdout:5/95: link d5/d14/d15/f21 d5/d14/f22 0 2024-03-19T06:05:21.902 INFO:tasks.workunit.client.1.smithi172.stdout:2/52: dread f6 [0,4194304] 0 2024-03-19T06:05:21.903 INFO:tasks.workunit.client.1.smithi172.stdout:9/54: write d1/f9 [2304164,49544] 0 2024-03-19T06:05:21.903 INFO:tasks.workunit.client.1.smithi172.stdout:6/154: dread d5/f8 [0,4194304] 0 2024-03-19T06:05:21.905 INFO:tasks.workunit.client.1.smithi172.stdout:4/117: mknod df/d11/d12/c1f 0 2024-03-19T06:05:21.907 INFO:tasks.workunit.client.1.smithi172.stdout:2/53: mkdir d7/db 0 2024-03-19T06:05:21.907 INFO:tasks.workunit.client.1.smithi172.stdout:5/96: write d5/fb [1234122,21178] 0 2024-03-19T06:05:21.915 INFO:tasks.workunit.client.1.smithi172.stdout:4/118: creat df/d11/f20 x:0 0 0 2024-03-19T06:05:21.917 INFO:tasks.workunit.client.1.smithi172.stdout:9/55: link d1/l5 d1/d7/dc/de/l13 0 2024-03-19T06:05:21.924 INFO:tasks.workunit.client.1.smithi172.stdout:9/56: creat d1/d7/dc/f14 x:0 0 0 2024-03-19T06:05:21.930 INFO:tasks.workunit.client.1.smithi172.stdout:2/54: dread d7/fa [0,4194304] 0 2024-03-19T06:05:21.930 INFO:tasks.workunit.client.1.smithi172.stdout:7/71: dwrite d0/f10 [0,4194304] 0 2024-03-19T06:05:21.930 INFO:tasks.workunit.client.1.smithi172.stdout:5/97: dread d5/fe [0,4194304] 0 2024-03-19T06:05:21.932 INFO:tasks.workunit.client.1.smithi172.stdout:6/155: truncate d5/f8 2046756 0 2024-03-19T06:05:21.935 INFO:tasks.workunit.client.1.smithi172.stdout:5/98: chown d5/l1b 9175 1 2024-03-19T06:05:21.935 INFO:tasks.workunit.client.1.smithi172.stdout:7/72: symlink d0/l1c 0 2024-03-19T06:05:21.936 INFO:tasks.workunit.client.1.smithi172.stdout:6/156: write d5/fa [496598,385] 0 2024-03-19T06:05:21.939 INFO:tasks.workunit.client.1.smithi172.stdout:2/55: creat d7/fc x:0 0 0 2024-03-19T06:05:21.940 INFO:tasks.workunit.client.1.smithi172.stdout:7/73: chown d0/db/ff 127716281 1 2024-03-19T06:05:21.943 INFO:tasks.workunit.client.1.smithi172.stdout:5/99: symlink d5/d14/l23 0 2024-03-19T06:05:21.944 INFO:tasks.workunit.client.1.smithi172.stdout:4/119: dwrite f6 [0,4194304] 0 2024-03-19T06:05:21.944 INFO:tasks.workunit.client.1.smithi172.stdout:5/100: stat d5 0 2024-03-19T06:05:21.956 INFO:tasks.workunit.client.1.smithi172.stdout:6/157: link d5/c9 d5/d11/d17/c2a 0 2024-03-19T06:05:21.957 INFO:tasks.workunit.client.1.smithi172.stdout:9/57: dwrite f0 [0,4194304] 0 2024-03-19T06:05:21.958 INFO:tasks.workunit.client.1.smithi172.stdout:4/120: getdents df 0 2024-03-19T06:05:21.962 INFO:tasks.workunit.client.1.smithi172.stdout:9/58: stat d1/d7/dc 0 2024-03-19T06:05:21.965 INFO:tasks.workunit.client.1.smithi172.stdout:5/101: write d5/d14/f22 [432441,115017] 0 2024-03-19T06:05:21.972 INFO:tasks.workunit.client.1.smithi172.stdout:7/74: dread d0/db/d17/f1b [0,4194304] 0 2024-03-19T06:05:21.973 INFO:tasks.workunit.client.1.smithi172.stdout:9/59: creat d1/d7/dc/f15 x:0 0 0 2024-03-19T06:05:21.977 INFO:tasks.workunit.client.1.smithi172.stdout:2/56: dwrite d7/f8 [0,4194304] 0 2024-03-19T06:05:21.977 INFO:tasks.workunit.client.1.smithi172.stdout:7/75: dread - d0/db/f13 zero size 2024-03-19T06:05:21.981 INFO:tasks.workunit.client.1.smithi172.stdout:7/76: readlink d0/db/l12 0 2024-03-19T06:05:21.982 INFO:tasks.workunit.client.1.smithi172.stdout:9/60: symlink d1/d7/l16 0 2024-03-19T06:05:22.008 INFO:tasks.workunit.client.1.smithi172.stdout:2/57: mknod d7/cd 0 2024-03-19T06:05:22.009 INFO:tasks.workunit.client.1.smithi172.stdout:9/61: readlink d1/l5 0 2024-03-19T06:05:22.009 INFO:tasks.workunit.client.1.smithi172.stdout:6/158: truncate d5/d16/f18 863223 0 2024-03-19T06:05:22.015 INFO:tasks.workunit.client.1.smithi172.stdout:7/77: mkdir d0/db/d17/d1d 0 2024-03-19T06:05:22.015 INFO:tasks.workunit.client.1.smithi172.stdout:2/58: mkdir d7/de 0 2024-03-19T06:05:22.015 INFO:tasks.workunit.client.1.smithi172.stdout:2/59: fdatasync f5 0 2024-03-19T06:05:22.015 INFO:tasks.workunit.client.1.smithi172.stdout:4/121: dwrite df/d11/f1d [0,4194304] 0 2024-03-19T06:05:22.015 INFO:tasks.workunit.client.1.smithi172.stdout:6/159: chown d5/f13 2767 1 2024-03-19T06:05:22.018 INFO:tasks.workunit.client.1.smithi172.stdout:9/62: mknod d1/d7/dc/de/c17 0 2024-03-19T06:05:22.018 INFO:tasks.workunit.client.1.smithi172.stdout:7/78: creat d0/db/d17/f1e x:0 0 0 2024-03-19T06:05:22.028 INFO:tasks.workunit.client.1.smithi172.stdout:9/63: rename d1/l5 to d1/l18 0 2024-03-19T06:05:22.029 INFO:tasks.workunit.client.1.smithi172.stdout:9/64: chown d1/f6 2671 1 2024-03-19T06:05:22.036 INFO:tasks.workunit.client.1.smithi172.stdout:9/65: creat d1/d7/dc/de/f19 x:0 0 0 2024-03-19T06:05:22.041 INFO:tasks.workunit.client.1.smithi172.stdout:2/60: truncate d7/fa 8210104 0 2024-03-19T06:05:22.043 INFO:tasks.workunit.client.1.smithi172.stdout:4/122: dread f6 [4194304,4194304] 0 2024-03-19T06:05:22.050 INFO:tasks.workunit.client.1.smithi172.stdout:6/160: dwrite d5/d16/f28 [0,4194304] 0 2024-03-19T06:05:22.051 INFO:tasks.workunit.client.1.smithi172.stdout:4/123: mkdir df/d11/d12/d21 0 2024-03-19T06:05:22.051 INFO:tasks.workunit.client.1.smithi172.stdout:7/79: dwrite d0/db/ff [0,4194304] 0 2024-03-19T06:05:22.067 INFO:tasks.workunit.client.1.smithi172.stdout:9/66: dread d1/f9 [0,4194304] 0 2024-03-19T06:05:22.067 INFO:tasks.workunit.client.1.smithi172.stdout:9/67: chown d1/d7 334 1 2024-03-19T06:05:22.075 INFO:tasks.workunit.client.1.smithi172.stdout:7/80: write d0/fa [717371,15293] 0 2024-03-19T06:05:22.078 INFO:tasks.workunit.client.1.smithi172.stdout:9/68: truncate d1/d7/dc/de/f19 215218 0 2024-03-19T06:05:22.083 INFO:tasks.workunit.client.1.smithi172.stdout:9/69: rmdir d1 39 2024-03-19T06:05:22.084 INFO:tasks.workunit.client.1.smithi172.stdout:4/124: dwrite f8 [0,4194304] 0 2024-03-19T06:05:22.089 INFO:tasks.workunit.client.1.smithi172.stdout:4/125: mknod df/d11/c22 0 2024-03-19T06:05:22.091 INFO:tasks.workunit.client.1.smithi172.stdout:9/70: rmdir d1/d7/dc/de 39 2024-03-19T06:05:22.094 INFO:tasks.workunit.client.1.smithi172.stdout:2/61: dread d7/fa [0,4194304] 0 2024-03-19T06:05:22.097 INFO:tasks.workunit.client.1.smithi172.stdout:6/161: dwrite d5/f6 [0,4194304] 0 2024-03-19T06:05:22.097 INFO:tasks.workunit.client.1.smithi172.stdout:2/62: symlink d7/de/lf 0 2024-03-19T06:05:22.101 INFO:tasks.workunit.client.1.smithi172.stdout:9/71: write d1/d7/dc/f15 [841913,89218] 0 2024-03-19T06:05:22.107 INFO:tasks.workunit.client.1.smithi172.stdout:6/162: dread d5/f13 [0,4194304] 0 2024-03-19T06:05:22.113 INFO:tasks.workunit.client.1.smithi172.stdout:6/163: write d5/fa [956523,18438] 0 2024-03-19T06:05:22.115 INFO:tasks.workunit.client.1.smithi172.stdout:6/164: creat d5/d11/d17/d1b/f2b x:0 0 0 2024-03-19T06:05:22.115 INFO:tasks.workunit.client.1.smithi172.stdout:1/126: sync 2024-03-19T06:05:22.116 INFO:tasks.workunit.client.1.smithi172.stdout:9/72: symlink d1/d7/dc/de/l1a 0 2024-03-19T06:05:22.120 INFO:tasks.workunit.client.1.smithi172.stdout:6/165: chown d5/d16 2 1 2024-03-19T06:05:22.130 INFO:tasks.workunit.client.1.smithi172.stdout:9/73: mknod d1/d7/c1b 0 2024-03-19T06:05:22.131 INFO:tasks.workunit.client.1.smithi172.stdout:6/166: mkdir d5/d2c 0 2024-03-19T06:05:22.132 INFO:tasks.workunit.client.1.smithi172.stdout:7/81: dwrite d0/f10 [0,4194304] 0 2024-03-19T06:05:22.137 INFO:tasks.workunit.client.1.smithi172.stdout:1/127: write da/f26 [4960443,63231] 0 2024-03-19T06:05:22.137 INFO:tasks.workunit.client.1.smithi172.stdout:9/74: unlink d1/fd 0 2024-03-19T06:05:22.143 INFO:tasks.workunit.client.1.smithi172.stdout:7/82: write d0/db/d17/f1e [859547,13240] 0 2024-03-19T06:05:22.152 INFO:tasks.workunit.client.1.smithi172.stdout:4/126: dwrite df/d11/d12/f1e [4194304,4194304] 0 2024-03-19T06:05:22.153 INFO:tasks.workunit.client.1.smithi172.stdout:7/83: unlink d0/le 0 2024-03-19T06:05:22.155 INFO:tasks.workunit.client.1.smithi172.stdout:2/63: dwrite d7/f8 [0,4194304] 0 2024-03-19T06:05:22.158 INFO:tasks.workunit.client.1.smithi172.stdout:2/64: readlink d7/de/lf 0 2024-03-19T06:05:22.158 INFO:tasks.workunit.client.1.smithi172.stdout:4/127: write df/d11/d12/f1e [115229,79761] 0 2024-03-19T06:05:22.161 INFO:tasks.workunit.client.1.smithi172.stdout:1/128: dread da/dd/d10/f1d [0,4194304] 0 2024-03-19T06:05:22.162 INFO:tasks.workunit.client.1.smithi172.stdout:7/84: unlink d0/fa 0 2024-03-19T06:05:22.166 INFO:tasks.workunit.client.1.smithi172.stdout:1/129: chown da/dd/d10/f1d 1 1 2024-03-19T06:05:22.171 INFO:tasks.workunit.client.1.smithi172.stdout:6/167: rename d5/d16/c1c to d5/d16/c2d 0 2024-03-19T06:05:22.171 INFO:tasks.workunit.client.1.smithi172.stdout:1/130: chown da/f26 112383696 1 2024-03-19T06:05:22.172 INFO:tasks.workunit.client.1.smithi172.stdout:4/128: symlink df/d11/d12/d21/l23 0 2024-03-19T06:05:22.176 INFO:tasks.workunit.client.1.smithi172.stdout:4/129: write fb [5173423,120218] 0 2024-03-19T06:05:22.179 INFO:tasks.workunit.client.1.smithi172.stdout:3/149: sync 2024-03-19T06:05:22.179 INFO:tasks.workunit.client.1.smithi172.stdout:8/101: sync 2024-03-19T06:05:22.179 INFO:tasks.workunit.client.1.smithi172.stdout:0/104: sync 2024-03-19T06:05:22.180 INFO:tasks.workunit.client.1.smithi172.stdout:5/102: sync 2024-03-19T06:05:22.181 INFO:tasks.workunit.client.1.smithi172.stdout:6/168: rename d5/d11/d17/c2a to d5/c2e 0 2024-03-19T06:05:22.183 INFO:tasks.workunit.client.1.smithi172.stdout:9/75: dwrite d1/f9 [0,4194304] 0 2024-03-19T06:05:22.185 INFO:tasks.workunit.client.1.smithi172.stdout:1/131: getdents da/dd/d10/d14/d27 0 2024-03-19T06:05:22.187 INFO:tasks.workunit.client.1.smithi172.stdout:2/65: dread d7/f8 [0,4194304] 0 2024-03-19T06:05:22.192 INFO:tasks.workunit.client.1.smithi172.stdout:5/103: chown d5/l1b 85 1 2024-03-19T06:05:22.196 INFO:tasks.workunit.client.1.smithi172.stdout:9/76: stat d1/l12 0 2024-03-19T06:05:22.207 INFO:tasks.workunit.client.1.smithi172.stdout:3/150: rename d0/d5/fb to d0/d5/d9/d25/f39 0 2024-03-19T06:05:22.207 INFO:tasks.workunit.client.1.smithi172.stdout:5/104: rmdir d5 39 2024-03-19T06:05:22.208 INFO:tasks.workunit.client.1.smithi172.stdout:1/132: creat da/dd/d10/f29 x:0 0 0 2024-03-19T06:05:22.209 INFO:tasks.workunit.client.1.smithi172.stdout:3/151: dread - d0/d24/f2d zero size 2024-03-19T06:05:22.217 INFO:tasks.workunit.client.1.smithi172.stdout:1/133: dread da/dd/f1f [0,4194304] 0 2024-03-19T06:05:22.219 INFO:tasks.workunit.client.1.smithi172.stdout:6/169: getdents d5/d2c 0 2024-03-19T06:05:22.219 INFO:tasks.workunit.client.1.smithi172.stdout:0/105: dwrite d11/d14/f16 [0,4194304] 0 2024-03-19T06:05:22.219 INFO:tasks.workunit.client.1.smithi172.stdout:2/66: mknod d7/db/c10 0 2024-03-19T06:05:22.221 INFO:tasks.workunit.client.1.smithi172.stdout:3/152: mkdir d0/d5/d9/d3a 0 2024-03-19T06:05:22.221 INFO:tasks.workunit.client.1.smithi172.stdout:4/130: getdents df/d11/d12 0 2024-03-19T06:05:22.223 INFO:tasks.workunit.client.1.smithi172.stdout:9/77: creat d1/f1c x:0 0 0 2024-03-19T06:05:22.228 INFO:tasks.workunit.client.1.smithi172.stdout:0/106: symlink d11/d14/l23 0 2024-03-19T06:05:22.230 INFO:tasks.workunit.client.1.smithi172.stdout:6/170: truncate d5/f13 1197512 0 2024-03-19T06:05:22.232 INFO:tasks.workunit.client.1.smithi172.stdout:2/67: link d7/de/lf d7/l11 0 2024-03-19T06:05:22.232 INFO:tasks.workunit.client.1.smithi172.stdout:1/134: symlink da/dd/d10/d14/d27/l2a 0 2024-03-19T06:05:22.236 INFO:tasks.workunit.client.1.smithi172.stdout:1/135: stat da/f1b 0 2024-03-19T06:05:22.236 INFO:tasks.workunit.client.1.smithi172.stdout:5/105: link d5/d14/f22 d5/d14/d15/f24 0 2024-03-19T06:05:22.241 INFO:tasks.workunit.client.1.smithi172.stdout:1/136: read - da/dd/d10/f24 zero size 2024-03-19T06:05:22.242 INFO:tasks.workunit.client.1.smithi172.stdout:6/171: truncate d5/d11/d17/d1b/f2b 531092 0 2024-03-19T06:05:22.243 INFO:tasks.workunit.client.1.smithi172.stdout:0/107: rename d11/d14/l15 to d11/d14/l24 0 2024-03-19T06:05:22.245 INFO:tasks.workunit.client.1.smithi172.stdout:7/85: write d0/f16 [662528,124993] 0 2024-03-19T06:05:22.246 INFO:tasks.workunit.client.1.smithi172.stdout:5/106: write d5/f1d [5537226,93467] 0 2024-03-19T06:05:22.251 INFO:tasks.workunit.client.1.smithi172.stdout:2/68: unlink d7/l11 0 2024-03-19T06:05:22.252 INFO:tasks.workunit.client.1.smithi172.stdout:1/137: dread - da/dd/d10/f24 zero size 2024-03-19T06:05:22.255 INFO:tasks.workunit.client.1.smithi172.stdout:5/107: fdatasync d5/fe 0 2024-03-19T06:05:22.255 INFO:tasks.workunit.client.1.smithi172.stdout:4/131: dread f8 [0,4194304] 0 2024-03-19T06:05:22.256 INFO:tasks.workunit.client.1.smithi172.stdout:3/153: dwrite d0/d24/f2e [0,4194304] 0 2024-03-19T06:05:22.260 INFO:tasks.workunit.client.1.smithi172.stdout:2/69: chown d7/f8 2 1 2024-03-19T06:05:22.261 INFO:tasks.workunit.client.1.smithi172.stdout:7/86: stat d0/c14 0 2024-03-19T06:05:22.265 INFO:tasks.workunit.client.1.smithi172.stdout:4/132: creat df/f24 x:0 0 0 2024-03-19T06:05:22.271 INFO:tasks.workunit.client.1.smithi172.stdout:5/108: dread d5/fb [0,4194304] 0 2024-03-19T06:05:22.271 INFO:tasks.workunit.client.1.smithi172.stdout:6/172: dread d5/d16/f28 [0,4194304] 0 2024-03-19T06:05:22.272 INFO:tasks.workunit.client.1.smithi172.stdout:0/108: getdents d11/d14 0 2024-03-19T06:05:22.273 INFO:tasks.workunit.client.1.smithi172.stdout:1/138: getdents da/dd 0 2024-03-19T06:05:22.273 INFO:tasks.workunit.client.1.smithi172.stdout:9/78: truncate d1/d7/dc/de/f19 74343 0 2024-03-19T06:05:22.274 INFO:tasks.workunit.client.1.smithi172.stdout:9/79: dread - d1/f1c zero size 2024-03-19T06:05:22.274 INFO:tasks.workunit.client.1.smithi172.stdout:3/154: symlink d0/d5/d9/d25/d21/l3b 0 2024-03-19T06:05:22.280 INFO:tasks.workunit.client.1.smithi172.stdout:5/109: fdatasync f2 0 2024-03-19T06:05:22.282 INFO:tasks.workunit.client.1.smithi172.stdout:1/139: creat da/dd/f2b x:0 0 0 2024-03-19T06:05:22.285 INFO:tasks.workunit.client.1.smithi172.stdout:3/155: creat d0/d5/d9/d25/d21/f3c x:0 0 0 2024-03-19T06:05:22.286 INFO:tasks.workunit.client.1.smithi172.stdout:2/70: write f3 [258946,53934] 0 2024-03-19T06:05:22.288 INFO:tasks.workunit.client.1.smithi172.stdout:0/109: symlink d11/d14/d20/l25 0 2024-03-19T06:05:22.288 INFO:tasks.workunit.client.1.smithi172.stdout:2/71: stat f5 0 2024-03-19T06:05:22.295 INFO:tasks.workunit.client.1.smithi172.stdout:6/173: mkdir d5/d11/d2f 0 2024-03-19T06:05:22.297 INFO:tasks.workunit.client.1.smithi172.stdout:5/110: rename d5/d14/d15/f21 to d5/d14/f25 0 2024-03-19T06:05:22.301 INFO:tasks.workunit.client.1.smithi172.stdout:1/140: creat da/dd/d10/f2c x:0 0 0 2024-03-19T06:05:22.301 INFO:tasks.workunit.client.1.smithi172.stdout:6/174: unlink c0 0 2024-03-19T06:05:22.305 INFO:tasks.workunit.client.1.smithi172.stdout:9/80: getdents d1/d7/dc 0 2024-03-19T06:05:22.307 INFO:tasks.workunit.client.1.smithi172.stdout:1/141: chown da/dd 32128 1 2024-03-19T06:05:22.308 INFO:tasks.workunit.client.1.smithi172.stdout:4/133: creat df/d11/f25 x:0 0 0 2024-03-19T06:05:22.312 INFO:tasks.workunit.client.1.smithi172.stdout:5/111: getdents d5 0 2024-03-19T06:05:22.313 INFO:tasks.workunit.client.1.smithi172.stdout:7/87: dwrite d0/db/fc [0,4194304] 0 2024-03-19T06:05:22.319 INFO:tasks.workunit.client.1.smithi172.stdout:2/72: dwrite f3 [0,4194304] 0 2024-03-19T06:05:22.320 INFO:tasks.workunit.client.1.smithi172.stdout:9/81: creat d1/d7/dc/de/f1d x:0 0 0 2024-03-19T06:05:22.320 INFO:tasks.workunit.client.1.smithi172.stdout:1/142: chown da/dd/d10/f2c 1049607916 1 2024-03-19T06:05:22.320 INFO:tasks.workunit.client.1.smithi172.stdout:4/134: stat df/d11/d12/f1a 0 2024-03-19T06:05:22.323 INFO:tasks.workunit.client.1.smithi172.stdout:9/82: fsync d1/f9 0 2024-03-19T06:05:22.325 INFO:tasks.workunit.client.1.smithi172.stdout:3/156: dread d0/d5/f8 [0,4194304] 0 2024-03-19T06:05:22.327 INFO:tasks.workunit.client.1.smithi172.stdout:0/110: dwrite ff [0,4194304] 0 2024-03-19T06:05:22.336 INFO:tasks.workunit.client.1.smithi172.stdout:4/135: fdatasync df/d11/f19 0 2024-03-19T06:05:22.338 INFO:tasks.workunit.client.1.smithi172.stdout:6/175: dread d5/d16/f28 [0,4194304] 0 2024-03-19T06:05:22.339 INFO:tasks.workunit.client.1.smithi172.stdout:5/112: write d5/d14/f22 [626381,109846] 0 2024-03-19T06:05:22.339 INFO:tasks.workunit.client.1.smithi172.stdout:3/157: rmdir d0/d24 39 2024-03-19T06:05:22.340 INFO:tasks.workunit.client.1.smithi172.stdout:1/143: link da/l12 da/dd/d10/l2d 0 2024-03-19T06:05:22.345 INFO:tasks.workunit.client.1.smithi172.stdout:7/88: rename d0/f10 to d0/db/f1f 0 2024-03-19T06:05:22.345 INFO:tasks.workunit.client.1.smithi172.stdout:5/113: rmdir d5/d14 39 2024-03-19T06:05:22.346 INFO:tasks.workunit.client.1.smithi172.stdout:4/136: write f6 [4735971,70741] 0 2024-03-19T06:05:22.353 INFO:tasks.workunit.client.1.smithi172.stdout:6/176: fdatasync d5/d11/d17/d1b/f21 0 2024-03-19T06:05:22.353 INFO:tasks.workunit.client.1.smithi172.stdout:8/102: sync 2024-03-19T06:05:22.358 INFO:tasks.workunit.client.1.smithi172.stdout:4/137: mkdir df/d11/d12/d26 0 2024-03-19T06:05:22.359 INFO:tasks.workunit.client.1.smithi172.stdout:7/89: symlink d0/l20 0 2024-03-19T06:05:22.360 INFO:tasks.workunit.client.1.smithi172.stdout:3/158: creat d0/d5/f3d x:0 0 0 2024-03-19T06:05:22.363 INFO:tasks.workunit.client.1.smithi172.stdout:6/177: stat d5/d11/d17/d1b/f25 0 2024-03-19T06:05:22.363 INFO:tasks.workunit.client.1.smithi172.stdout:9/83: dread d1/fa [0,4194304] 0 2024-03-19T06:05:22.364 INFO:tasks.workunit.client.1.smithi172.stdout:2/73: dread d7/f8 [0,4194304] 0 2024-03-19T06:05:22.365 INFO:tasks.workunit.client.1.smithi172.stdout:5/114: dread d5/fb [0,4194304] 0 2024-03-19T06:05:22.366 INFO:tasks.workunit.client.1.smithi172.stdout:3/159: read - d0/d5/f23 zero size 2024-03-19T06:05:22.368 INFO:tasks.workunit.client.1.smithi172.stdout:5/115: chown l1 76 1 2024-03-19T06:05:22.368 INFO:tasks.workunit.client.1.smithi172.stdout:4/138: write f8 [924119,91639] 0 2024-03-19T06:05:22.370 INFO:tasks.workunit.client.1.smithi172.stdout:7/90: mknod d0/c21 0 2024-03-19T06:05:22.370 INFO:tasks.workunit.client.1.smithi172.stdout:5/116: read d5/fe [3480857,106505] 0 2024-03-19T06:05:22.370 INFO:tasks.workunit.client.1.smithi172.stdout:0/111: dwrite d11/d14/f16 [0,4194304] 0 2024-03-19T06:05:22.371 INFO:tasks.workunit.client.1.smithi172.stdout:1/144: link da/dd/f1f da/dd/d10/d14/f2e 0 2024-03-19T06:05:22.372 INFO:tasks.workunit.client.1.smithi172.stdout:0/112: fsync ff 0 2024-03-19T06:05:22.372 INFO:tasks.workunit.client.1.smithi172.stdout:2/74: symlink d7/de/l12 0 2024-03-19T06:05:22.375 INFO:tasks.workunit.client.1.smithi172.stdout:4/139: read - df/d11/f20 zero size 2024-03-19T06:05:22.376 INFO:tasks.workunit.client.1.smithi172.stdout:1/145: dread - da/dd/d10/f2c zero size 2024-03-19T06:05:22.376 INFO:tasks.workunit.client.1.smithi172.stdout:0/113: read - d11/d14/f1f zero size 2024-03-19T06:05:22.377 INFO:tasks.workunit.client.1.smithi172.stdout:6/178: rename d5/ld to d5/d11/d17/d1b/l30 0 2024-03-19T06:05:22.377 INFO:tasks.workunit.client.1.smithi172.stdout:3/160: chown d0/d24/c28 1 1 2024-03-19T06:05:22.379 INFO:tasks.workunit.client.1.smithi172.stdout:8/103: rmdir d0/d17/d19 0 2024-03-19T06:05:22.384 INFO:tasks.workunit.client.1.smithi172.stdout:5/117: unlink d5/l1b 0 2024-03-19T06:05:22.384 INFO:tasks.workunit.client.1.smithi172.stdout:4/140: rename l5 to df/d11/d12/l27 0 2024-03-19T06:05:22.384 INFO:tasks.workunit.client.1.smithi172.stdout:7/91: fsync d0/f16 0 2024-03-19T06:05:22.386 INFO:tasks.workunit.client.1.smithi172.stdout:4/141: write df/d11/f20 [841850,86020] 0 2024-03-19T06:05:22.390 INFO:tasks.workunit.client.1.smithi172.stdout:1/146: chown da/dd/d10/d14/c25 23381168 1 2024-03-19T06:05:22.391 INFO:tasks.workunit.client.1.smithi172.stdout:0/114: creat d11/f26 x:0 0 0 2024-03-19T06:05:22.393 INFO:tasks.workunit.client.1.smithi172.stdout:9/84: getdents d1/d7/dc 0 2024-03-19T06:05:22.397 INFO:tasks.workunit.client.1.smithi172.stdout:4/142: rename df/d11/c22 to df/d11/d12/c28 0 2024-03-19T06:05:22.409 INFO:tasks.workunit.client.1.smithi172.stdout:5/118: dread d5/f18 [0,4194304] 0 2024-03-19T06:05:22.414 INFO:tasks.workunit.client.1.smithi172.stdout:0/115: getdents d11 0 2024-03-19T06:05:22.416 INFO:tasks.workunit.client.1.smithi172.stdout:6/179: truncate d5/f10 1961289 0 2024-03-19T06:05:22.419 INFO:tasks.workunit.client.1.smithi172.stdout:9/85: getdents d1/d7/dc 0 2024-03-19T06:05:22.420 INFO:tasks.workunit.client.1.smithi172.stdout:8/104: fsync d0/fd 0 2024-03-19T06:05:22.420 INFO:tasks.workunit.client.1.smithi172.stdout:5/119: read d5/fe [202974,107949] 0 2024-03-19T06:05:22.424 INFO:tasks.workunit.client.1.smithi172.stdout:2/75: dwrite f5 [0,4194304] 0 2024-03-19T06:05:22.428 INFO:tasks.workunit.client.1.smithi172.stdout:6/180: truncate d5/fa 1066748 0 2024-03-19T06:05:22.431 INFO:tasks.workunit.client.1.smithi172.stdout:2/76: stat d7/c9 0 2024-03-19T06:05:22.434 INFO:tasks.workunit.client.1.smithi172.stdout:8/105: fsync d0/f12 0 2024-03-19T06:05:22.434 INFO:tasks.workunit.client.1.smithi172.stdout:7/92: dread d0/db/f11 [0,4194304] 0 2024-03-19T06:05:22.436 INFO:tasks.workunit.client.1.smithi172.stdout:5/120: write d5/f1d [1587496,117250] 0 2024-03-19T06:05:22.437 INFO:tasks.workunit.client.1.smithi172.stdout:3/161: dwrite d0/d5/f26 [0,4194304] 0 2024-03-19T06:05:22.445 INFO:tasks.workunit.client.1.smithi172.stdout:1/147: dwrite da/dd/d10/f23 [0,4194304] 0 2024-03-19T06:05:22.450 INFO:tasks.workunit.client.1.smithi172.stdout:5/121: symlink d5/d14/l26 0 2024-03-19T06:05:22.450 INFO:tasks.workunit.client.1.smithi172.stdout:9/86: truncate d1/d7/dc/de/f19 916063 0 2024-03-19T06:05:22.452 INFO:tasks.workunit.client.1.smithi172.stdout:5/122: write d5/fe [2509998,49446] 0 2024-03-19T06:05:22.452 INFO:tasks.workunit.client.1.smithi172.stdout:3/162: creat d0/f3e x:0 0 0 2024-03-19T06:05:22.453 INFO:tasks.workunit.client.1.smithi172.stdout:0/116: dread f2 [0,4194304] 0 2024-03-19T06:05:22.460 INFO:tasks.workunit.client.1.smithi172.stdout:2/77: dread f3 [0,4194304] 0 2024-03-19T06:05:22.463 INFO:tasks.workunit.client.1.smithi172.stdout:1/148: creat da/dd/d10/f2f x:0 0 0 2024-03-19T06:05:22.464 INFO:tasks.workunit.client.1.smithi172.stdout:9/87: creat d1/d7/f1e x:0 0 0 2024-03-19T06:05:22.464 INFO:tasks.workunit.client.1.smithi172.stdout:8/106: dread d0/f1 [0,4194304] 0 2024-03-19T06:05:22.464 INFO:tasks.workunit.client.1.smithi172.stdout:7/93: dread d0/db/ff [0,4194304] 0 2024-03-19T06:05:22.466 INFO:tasks.workunit.client.1.smithi172.stdout:6/181: write d5/f13 [2241589,5891] 0 2024-03-19T06:05:22.468 INFO:tasks.workunit.client.1.smithi172.stdout:2/78: creat d7/db/f13 x:0 0 0 2024-03-19T06:05:22.468 INFO:tasks.workunit.client.1.smithi172.stdout:0/117: chown ce 167504 1 2024-03-19T06:05:22.470 INFO:tasks.workunit.client.1.smithi172.stdout:9/88: creat d1/d7/dc/de/f1f x:0 0 0 2024-03-19T06:05:22.471 INFO:tasks.workunit.client.1.smithi172.stdout:5/123: creat d5/f27 x:0 0 0 2024-03-19T06:05:22.476 INFO:tasks.workunit.client.1.smithi172.stdout:2/79: mkdir d7/db/d14 0 2024-03-19T06:05:22.476 INFO:tasks.workunit.client.1.smithi172.stdout:2/80: chown c2 30883921 1 2024-03-19T06:05:22.476 INFO:tasks.workunit.client.1.smithi172.stdout:9/89: readlink d1/lf 0 2024-03-19T06:05:22.476 INFO:tasks.workunit.client.1.smithi172.stdout:8/107: rename d0/l16 to d0/d10/l1b 0 2024-03-19T06:05:22.477 INFO:tasks.workunit.client.1.smithi172.stdout:5/124: symlink d5/d14/l28 0 2024-03-19T06:05:22.477 INFO:tasks.workunit.client.1.smithi172.stdout:5/125: readlink l1 0 2024-03-19T06:05:22.479 INFO:tasks.workunit.client.1.smithi172.stdout:8/108: write d0/fd [405010,11045] 0 2024-03-19T06:05:22.480 INFO:tasks.workunit.client.1.smithi172.stdout:8/109: fdatasync d0/f8 0 2024-03-19T06:05:22.482 INFO:tasks.workunit.client.1.smithi172.stdout:1/149: rename l9 to da/dd/d10/d14/d27/l30 0 2024-03-19T06:05:22.483 INFO:tasks.workunit.client.1.smithi172.stdout:9/90: symlink d1/l20 0 2024-03-19T06:05:22.484 INFO:tasks.workunit.client.1.smithi172.stdout:8/110: symlink d0/d17/l1c 0 2024-03-19T06:05:22.487 INFO:tasks.workunit.client.1.smithi172.stdout:1/150: mkdir da/dd/d31 0 2024-03-19T06:05:22.492 INFO:tasks.workunit.client.1.smithi172.stdout:6/182: dread d5/f6 [0,4194304] 0 2024-03-19T06:05:22.492 INFO:tasks.workunit.client.1.smithi172.stdout:1/151: write da/dd/d10/f23 [4039447,69830] 0 2024-03-19T06:05:22.495 INFO:tasks.workunit.client.1.smithi172.stdout:2/81: rmdir d7/db 39 2024-03-19T06:05:22.497 INFO:tasks.workunit.client.1.smithi172.stdout:5/126: rmdir d5 39 2024-03-19T06:05:22.497 INFO:tasks.workunit.client.1.smithi172.stdout:1/152: fdatasync da/dd/d10/f29 0 2024-03-19T06:05:22.500 INFO:tasks.workunit.client.1.smithi172.stdout:2/82: write f5 [3423965,54968] 0 2024-03-19T06:05:22.500 INFO:tasks.workunit.client.1.smithi172.stdout:0/118: dwrite d11/d18/f21 [0,4194304] 0 2024-03-19T06:05:22.500 INFO:tasks.workunit.client.1.smithi172.stdout:7/94: rename d0/db/d17 to d0/d22 0 2024-03-19T06:05:22.501 INFO:tasks.workunit.client.1.smithi172.stdout:2/83: readlink d7/de/l12 0 2024-03-19T06:05:22.502 INFO:tasks.workunit.client.1.smithi172.stdout:9/91: dread f0 [0,4194304] 0 2024-03-19T06:05:22.508 INFO:tasks.workunit.client.1.smithi172.stdout:8/111: write d0/f1 [648562,49375] 0 2024-03-19T06:05:22.509 INFO:tasks.workunit.client.1.smithi172.stdout:2/84: unlink f5 0 2024-03-19T06:05:22.510 INFO:tasks.workunit.client.1.smithi172.stdout:7/95: read - d0/db/f13 zero size 2024-03-19T06:05:22.511 INFO:tasks.workunit.client.1.smithi172.stdout:6/183: mkdir d5/d2c/d31 0 2024-03-19T06:05:22.511 INFO:tasks.workunit.client.1.smithi172.stdout:7/96: stat d0/db/f11 0 2024-03-19T06:05:22.515 INFO:tasks.workunit.client.1.smithi172.stdout:1/153: fdatasync da/dd/d10/d14/f2e 0 2024-03-19T06:05:22.517 INFO:tasks.workunit.client.1.smithi172.stdout:5/127: mknod d5/d1f/c29 0 2024-03-19T06:05:22.518 INFO:tasks.workunit.client.1.smithi172.stdout:2/85: write f3 [7582864,126004] 0 2024-03-19T06:05:22.520 INFO:tasks.workunit.client.1.smithi172.stdout:7/97: write d0/f15 [831114,48988] 0 2024-03-19T06:05:22.523 INFO:tasks.workunit.client.1.smithi172.stdout:2/86: read f6 [60061,117464] 0 2024-03-19T06:05:22.526 INFO:tasks.workunit.client.1.smithi172.stdout:0/119: dread f8 [4194304,4194304] 0 2024-03-19T06:05:22.527 INFO:tasks.workunit.client.1.smithi172.stdout:6/184: rename d5/d11/c26 to d5/d16/c32 0 2024-03-19T06:05:22.527 INFO:tasks.workunit.client.1.smithi172.stdout:9/92: dwrite d1/f9 [0,4194304] 0 2024-03-19T06:05:22.531 INFO:tasks.workunit.client.1.smithi172.stdout:2/87: write d7/f8 [3832028,101037] 0 2024-03-19T06:05:22.535 INFO:tasks.workunit.client.1.smithi172.stdout:9/93: symlink d1/d7/dc/de/l21 0 2024-03-19T06:05:22.537 INFO:tasks.workunit.client.1.smithi172.stdout:7/98: dread d0/d22/f1e [0,4194304] 0 2024-03-19T06:05:22.538 INFO:tasks.workunit.client.1.smithi172.stdout:2/88: readlink d7/de/lf 0 2024-03-19T06:05:22.539 INFO:tasks.workunit.client.1.smithi172.stdout:6/185: dread d5/f19 [0,4194304] 0 2024-03-19T06:05:22.541 INFO:tasks.workunit.client.1.smithi172.stdout:1/154: dwrite da/f26 [0,4194304] 0 2024-03-19T06:05:22.541 INFO:tasks.workunit.client.1.smithi172.stdout:0/120: link d11/d14/l17 d11/l27 0 2024-03-19T06:05:22.545 INFO:tasks.workunit.client.1.smithi172.stdout:1/155: stat da/dd/d10/f2f 0 2024-03-19T06:05:22.545 INFO:tasks.workunit.client.1.smithi172.stdout:0/121: write d11/d14/f1f [836926,128792] 0 2024-03-19T06:05:22.545 INFO:tasks.workunit.client.1.smithi172.stdout:9/94: symlink d1/l22 0 2024-03-19T06:05:22.545 INFO:tasks.workunit.client.1.smithi172.stdout:6/186: readlink d5/d11/d17/d1b/l30 0 2024-03-19T06:05:22.549 INFO:tasks.workunit.client.1.smithi172.stdout:9/95: write d1/fa [2804306,92006] 0 2024-03-19T06:05:22.550 INFO:tasks.workunit.client.1.smithi172.stdout:0/122: mknod d11/d14/c28 0 2024-03-19T06:05:22.552 INFO:tasks.workunit.client.1.smithi172.stdout:6/187: chown d5/d11/d17/c20 14 1 2024-03-19T06:05:22.553 INFO:tasks.workunit.client.1.smithi172.stdout:0/123: write f8 [5902607,15720] 0 2024-03-19T06:05:22.554 INFO:tasks.workunit.client.1.smithi172.stdout:6/188: readlink d5/d11/l24 0 2024-03-19T06:05:22.557 INFO:tasks.workunit.client.1.smithi172.stdout:9/96: mkdir d1/d7/dc/d23 0 2024-03-19T06:05:22.561 INFO:tasks.workunit.client.1.smithi172.stdout:9/97: rename d1/d7 to d1/d7/dc/d23/d24 22 2024-03-19T06:05:22.566 INFO:tasks.workunit.client.1.smithi172.stdout:7/99: dread d0/d22/f1b [0,4194304] 0 2024-03-19T06:05:22.566 INFO:tasks.workunit.client.1.smithi172.stdout:6/189: truncate d5/f8 3069649 0 2024-03-19T06:05:22.566 INFO:tasks.workunit.client.1.smithi172.stdout:9/98: chown d1/l20 14 1 2024-03-19T06:05:22.568 INFO:tasks.workunit.client.1.smithi172.stdout:6/190: rmdir d5 39 2024-03-19T06:05:22.569 INFO:tasks.workunit.client.1.smithi172.stdout:1/156: dread da/f26 [0,4194304] 0 2024-03-19T06:05:22.573 INFO:tasks.workunit.client.1.smithi172.stdout:9/99: symlink d1/d7/dc/de/l25 0 2024-03-19T06:05:22.574 INFO:tasks.workunit.client.1.smithi172.stdout:7/100: link d0/d22/f1e d0/db/f23 0 2024-03-19T06:05:22.576 INFO:tasks.workunit.client.1.smithi172.stdout:1/157: creat da/dd/d10/d14/d27/f32 x:0 0 0 2024-03-19T06:05:22.578 INFO:tasks.workunit.client.1.smithi172.stdout:2/89: dwrite d7/db/f13 [0,4194304] 0 2024-03-19T06:05:22.585 INFO:tasks.workunit.client.1.smithi172.stdout:1/158: mkdir da/d33 0 2024-03-19T06:05:22.588 INFO:tasks.workunit.client.1.smithi172.stdout:0/124: dwrite f7 [0,4194304] 0 2024-03-19T06:05:22.589 INFO:tasks.workunit.client.1.smithi172.stdout:7/101: symlink d0/db/l24 0 2024-03-19T06:05:22.591 INFO:tasks.workunit.client.1.smithi172.stdout:1/159: chown da/dd/d10/f23 116 1 2024-03-19T06:05:22.591 INFO:tasks.workunit.client.1.smithi172.stdout:0/125: chown d11/f26 775255496 1 2024-03-19T06:05:22.592 INFO:tasks.workunit.client.1.smithi172.stdout:1/160: fdatasync da/dd/f2b 0 2024-03-19T06:05:22.593 INFO:tasks.workunit.client.1.smithi172.stdout:9/100: write d1/d7/dc/de/f19 [721902,45182] 0 2024-03-19T06:05:22.596 INFO:tasks.workunit.client.1.smithi172.stdout:1/161: dread - da/dd/d10/f2f zero size 2024-03-19T06:05:22.598 INFO:tasks.workunit.client.1.smithi172.stdout:6/191: link d5/f8 d5/f33 0 2024-03-19T06:05:22.600 INFO:tasks.workunit.client.1.smithi172.stdout:2/90: link d7/db/f13 d7/f15 0 2024-03-19T06:05:22.601 INFO:tasks.workunit.client.1.smithi172.stdout:9/101: mkdir d1/d26 0 2024-03-19T06:05:22.604 INFO:tasks.workunit.client.1.smithi172.stdout:6/192: dread d5/d11/d17/d1b/f2b [0,4194304] 0 2024-03-19T06:05:22.604 INFO:tasks.workunit.client.1.smithi172.stdout:1/162: creat da/dd/d31/f34 x:0 0 0 2024-03-19T06:05:22.607 INFO:tasks.workunit.client.1.smithi172.stdout:7/102: write d0/db/f23 [523349,100150] 0 2024-03-19T06:05:22.607 INFO:tasks.workunit.client.1.smithi172.stdout:1/163: truncate da/dd/f2b 284328 0 2024-03-19T06:05:22.610 INFO:tasks.workunit.client.1.smithi172.stdout:6/193: write d5/f19 [962324,50256] 0 2024-03-19T06:05:22.612 INFO:tasks.workunit.client.1.smithi172.stdout:7/103: write d0/f16 [4458906,10114] 0 2024-03-19T06:05:22.615 INFO:tasks.workunit.client.1.smithi172.stdout:2/91: truncate f3 4208995 0 2024-03-19T06:05:22.616 INFO:tasks.workunit.client.1.smithi172.stdout:6/194: chown d5/d16/c32 282807 1 2024-03-19T06:05:22.617 INFO:tasks.workunit.client.1.smithi172.stdout:7/104: write d0/d22/f1b [2808870,68725] 0 2024-03-19T06:05:22.619 INFO:tasks.workunit.client.1.smithi172.stdout:1/164: write da/dd/d10/f1d [2533562,50958] 0 2024-03-19T06:05:22.624 INFO:tasks.workunit.client.1.smithi172.stdout:7/105: write d0/db/f11 [2420208,114240] 0 2024-03-19T06:05:22.624 INFO:tasks.workunit.client.1.smithi172.stdout:2/92: fsync d7/fa 0 2024-03-19T06:05:22.626 INFO:tasks.workunit.client.1.smithi172.stdout:6/195: creat d5/d2c/d31/f34 x:0 0 0 2024-03-19T06:05:22.628 INFO:tasks.workunit.client.1.smithi172.stdout:2/93: readlink d7/de/lf 0 2024-03-19T06:05:22.629 INFO:tasks.workunit.client.1.smithi172.stdout:0/126: dwrite f10 [0,4194304] 0 2024-03-19T06:05:22.634 INFO:tasks.workunit.client.1.smithi172.stdout:7/106: mknod d0/d22/d1d/c25 0 2024-03-19T06:05:22.634 INFO:tasks.workunit.client.1.smithi172.stdout:9/102: dwrite d1/d7/dc/f15 [0,4194304] 0 2024-03-19T06:05:22.634 INFO:tasks.workunit.client.1.smithi172.stdout:6/196: truncate d5/d11/d17/d1b/f2b 1015895 0 2024-03-19T06:05:22.638 INFO:tasks.workunit.client.1.smithi172.stdout:0/127: rename f8 to d11/f29 0 2024-03-19T06:05:22.641 INFO:tasks.workunit.client.1.smithi172.stdout:2/94: link d7/db/f13 d7/db/f16 0 2024-03-19T06:05:22.643 INFO:tasks.workunit.client.1.smithi172.stdout:7/107: creat d0/d22/f26 x:0 0 0 2024-03-19T06:05:22.648 INFO:tasks.workunit.client.1.smithi172.stdout:1/165: dwrite da/dd/d10/f2c [0,4194304] 0 2024-03-19T06:05:22.649 INFO:tasks.workunit.client.1.smithi172.stdout:0/128: mknod d11/d14/c2a 0 2024-03-19T06:05:22.651 INFO:tasks.workunit.client.1.smithi172.stdout:7/108: mkdir d0/d22/d27 0 2024-03-19T06:05:22.651 INFO:tasks.workunit.client.1.smithi172.stdout:1/166: read da/dd/d10/d14/f2e [436242,15395] 0 2024-03-19T06:05:22.652 INFO:tasks.workunit.client.1.smithi172.stdout:1/167: dread - da/dd/d31/f34 zero size 2024-03-19T06:05:22.654 INFO:tasks.workunit.client.1.smithi172.stdout:0/129: creat d11/d14/d20/f2b x:0 0 0 2024-03-19T06:05:22.665 INFO:tasks.workunit.client.1.smithi172.stdout:0/130: dread f10 [0,4194304] 0 2024-03-19T06:05:22.667 INFO:tasks.workunit.client.1.smithi172.stdout:1/168: dread da/dd/d10/f23 [0,4194304] 0 2024-03-19T06:05:22.668 INFO:tasks.workunit.client.1.smithi172.stdout:7/109: link d0/c21 d0/d22/d27/c28 0 2024-03-19T06:05:22.669 INFO:tasks.workunit.client.1.smithi172.stdout:1/169: write da/dd/d31/f34 [1011832,95925] 0 2024-03-19T06:05:22.670 INFO:tasks.workunit.client.1.smithi172.stdout:6/197: write d5/fe [2072693,57036] 0 2024-03-19T06:05:22.671 INFO:tasks.workunit.client.1.smithi172.stdout:7/110: chown d0/d22/c1a 0 1 2024-03-19T06:05:22.671 INFO:tasks.workunit.client.1.smithi172.stdout:0/131: write f2 [940029,2773] 0 2024-03-19T06:05:22.672 INFO:tasks.workunit.client.1.smithi172.stdout:1/170: stat da/dd/d10/d14/f2e 0 2024-03-19T06:05:22.673 INFO:tasks.workunit.client.1.smithi172.stdout:0/132: chown d11/f13 0 1 2024-03-19T06:05:22.673 INFO:tasks.workunit.client.1.smithi172.stdout:6/198: write d5/d11/f22 [67436,90084] 0 2024-03-19T06:05:22.674 INFO:tasks.workunit.client.1.smithi172.stdout:9/103: fdatasync d1/d7/dc/f15 0 2024-03-19T06:05:22.679 INFO:tasks.workunit.client.1.smithi172.stdout:1/171: dread da/dd/d10/d14/f2e [0,4194304] 0 2024-03-19T06:05:22.680 INFO:tasks.workunit.client.1.smithi172.stdout:7/111: creat d0/f29 x:0 0 0 2024-03-19T06:05:22.685 INFO:tasks.workunit.client.1.smithi172.stdout:1/172: creat da/dd/d10/d14/f35 x:0 0 0 2024-03-19T06:05:22.687 INFO:tasks.workunit.client.1.smithi172.stdout:1/173: dread - da/dd/d10/d14/d27/f32 zero size 2024-03-19T06:05:22.687 INFO:tasks.workunit.client.1.smithi172.stdout:0/133: dread d11/f29 [0,4194304] 0 2024-03-19T06:05:22.688 INFO:tasks.workunit.client.1.smithi172.stdout:9/104: rename d1/d7/f1e to d1/f27 0 2024-03-19T06:05:22.688 INFO:tasks.workunit.client.1.smithi172.stdout:7/112: symlink d0/l2a 0 2024-03-19T06:05:22.691 INFO:tasks.workunit.client.1.smithi172.stdout:1/174: fdatasync da/f20 0 2024-03-19T06:05:22.691 INFO:tasks.workunit.client.1.smithi172.stdout:9/105: chown d1/d7/dc/de/l21 53406371 1 2024-03-19T06:05:22.693 INFO:tasks.workunit.client.1.smithi172.stdout:6/199: truncate d5/f10 1778075 0 2024-03-19T06:05:22.696 INFO:tasks.workunit.client.1.smithi172.stdout:7/113: symlink d0/db/l2b 0 2024-03-19T06:05:22.697 INFO:tasks.workunit.client.1.smithi172.stdout:9/106: write d1/d7/dc/de/f19 [1086746,72877] 0 2024-03-19T06:05:22.698 INFO:tasks.workunit.client.1.smithi172.stdout:1/175: mkdir da/dd/d10/d36 0 2024-03-19T06:05:22.700 INFO:tasks.workunit.client.1.smithi172.stdout:9/107: stat d1/d7/c1b 0 2024-03-19T06:05:22.700 INFO:tasks.workunit.client.1.smithi172.stdout:6/200: mkdir d5/d11/d35 0 2024-03-19T06:05:22.707 INFO:tasks.workunit.client.1.smithi172.stdout:1/176: readlink da/dd/d10/l2d 0 2024-03-19T06:05:22.710 INFO:tasks.workunit.client.1.smithi172.stdout:9/108: creat d1/f28 x:0 0 0 2024-03-19T06:05:22.710 INFO:tasks.workunit.client.1.smithi172.stdout:6/201: dread d5/d16/f18 [0,4194304] 0 2024-03-19T06:05:22.711 INFO:tasks.workunit.client.1.smithi172.stdout:1/177: creat da/dd/d10/d14/d27/f37 x:0 0 0 2024-03-19T06:05:22.712 INFO:tasks.workunit.client.1.smithi172.stdout:0/134: dread d11/d18/f21 [0,4194304] 0 2024-03-19T06:05:22.716 INFO:tasks.workunit.client.1.smithi172.stdout:6/202: fdatasync d5/fa 0 2024-03-19T06:05:22.716 INFO:tasks.workunit.client.1.smithi172.stdout:9/109: rmdir d1/d26 0 2024-03-19T06:05:22.721 INFO:tasks.workunit.client.1.smithi172.stdout:1/178: getdents da/dd/d10/d36 0 2024-03-19T06:05:22.721 INFO:tasks.workunit.client.1.smithi172.stdout:0/135: rename d11/d14/d20 to d11/d14/d2c 0 2024-03-19T06:05:22.724 INFO:tasks.workunit.client.1.smithi172.stdout:7/114: dwrite d0/db/f11 [4194304,4194304] 0 2024-03-19T06:05:22.727 INFO:tasks.workunit.client.1.smithi172.stdout:1/179: chown da/dd/d10/l2d 257767694 1 2024-03-19T06:05:22.727 INFO:tasks.workunit.client.1.smithi172.stdout:0/136: write d11/f12 [212965,23848] 0 2024-03-19T06:05:22.727 INFO:tasks.workunit.client.1.smithi172.stdout:6/203: getdents d5/d11/d17/d1b 0 2024-03-19T06:05:22.729 INFO:tasks.workunit.client.1.smithi172.stdout:0/137: chown f6 30798430 1 2024-03-19T06:05:22.731 INFO:tasks.workunit.client.1.smithi172.stdout:7/115: mkdir d0/d2c 0 2024-03-19T06:05:22.734 INFO:tasks.workunit.client.1.smithi172.stdout:6/204: mkdir d5/d11/d17/d36 0 2024-03-19T06:05:22.734 INFO:tasks.workunit.client.1.smithi172.stdout:0/138: symlink d11/d18/l2d 0 2024-03-19T06:05:22.735 INFO:tasks.workunit.client.1.smithi172.stdout:1/180: creat da/dd/d10/d36/f38 x:0 0 0 2024-03-19T06:05:22.737 INFO:tasks.workunit.client.1.smithi172.stdout:1/181: write da/dd/d10/f29 [540917,124363] 0 2024-03-19T06:05:22.737 INFO:tasks.workunit.client.1.smithi172.stdout:0/139: creat d11/d14/f2e x:0 0 0 2024-03-19T06:05:22.739 INFO:tasks.workunit.client.1.smithi172.stdout:7/116: mknod d0/c2d 0 2024-03-19T06:05:22.741 INFO:tasks.workunit.client.1.smithi172.stdout:0/140: rmdir d11/d14/d2c 39 2024-03-19T06:05:22.754 INFO:tasks.workunit.client.1.smithi172.stdout:7/117: dread d0/db/f11 [4194304,4194304] 0 2024-03-19T06:05:22.756 INFO:tasks.workunit.client.1.smithi172.stdout:1/182: truncate da/dd/d10/f23 1850215 0 2024-03-19T06:05:22.758 INFO:tasks.workunit.client.1.smithi172.stdout:7/118: write d0/db/f1f [3052668,108580] 0 2024-03-19T06:05:22.759 INFO:tasks.workunit.client.1.smithi172.stdout:6/205: dwrite d5/d11/d17/d1b/f21 [0,4194304] 0 2024-03-19T06:05:22.759 INFO:tasks.workunit.client.1.smithi172.stdout:0/141: dread d11/d14/f16 [0,4194304] 0 2024-03-19T06:05:22.770 INFO:tasks.workunit.client.1.smithi172.stdout:7/119: mknod d0/d22/d27/c2e 0 2024-03-19T06:05:22.777 INFO:tasks.workunit.client.1.smithi172.stdout:7/120: dread d0/db/f23 [0,4194304] 0 2024-03-19T06:05:22.779 INFO:tasks.workunit.client.1.smithi172.stdout:1/183: dwrite da/dd/d10/f2c [0,4194304] 0 2024-03-19T06:05:22.785 INFO:tasks.workunit.client.1.smithi172.stdout:1/184: creat da/dd/f39 x:0 0 0 2024-03-19T06:05:22.787 INFO:tasks.workunit.client.1.smithi172.stdout:7/121: getdents d0/d22/d1d 0 2024-03-19T06:05:22.788 INFO:tasks.workunit.client.1.smithi172.stdout:6/206: dwrite d5/fb [4194304,4194304] 0 2024-03-19T06:05:22.790 INFO:tasks.workunit.client.1.smithi172.stdout:7/122: fsync d0/f16 0 2024-03-19T06:05:22.790 INFO:tasks.workunit.client.1.smithi172.stdout:0/142: dwrite f10 [0,4194304] 0 2024-03-19T06:05:22.791 INFO:tasks.workunit.client.1.smithi172.stdout:1/185: write da/f26 [5548645,119909] 0 2024-03-19T06:05:22.792 INFO:tasks.workunit.client.1.smithi172.stdout:6/207: write d5/fb [7040333,55912] 0 2024-03-19T06:05:22.795 INFO:tasks.workunit.client.1.smithi172.stdout:1/186: chown da/dd/d10/d14/f35 1931 1 2024-03-19T06:05:22.799 INFO:tasks.workunit.client.1.smithi172.stdout:7/123: truncate d0/d22/f1b 4922177 0 2024-03-19T06:05:22.802 INFO:tasks.workunit.client.1.smithi172.stdout:7/124: write d0/db/f13 [982202,32439] 0 2024-03-19T06:05:22.809 INFO:tasks.workunit.client.1.smithi172.stdout:1/187: dread da/dd/d31/f34 [0,4194304] 0 2024-03-19T06:05:22.815 INFO:tasks.workunit.client.1.smithi172.stdout:0/143: dwrite f7 [0,4194304] 0 2024-03-19T06:05:22.818 INFO:tasks.workunit.client.1.smithi172.stdout:0/144: write d11/f1b [1007984,66414] 0 2024-03-19T06:05:22.826 INFO:tasks.workunit.client.1.smithi172.stdout:1/188: dread da/f26 [0,4194304] 0 2024-03-19T06:05:22.827 INFO:tasks.workunit.client.1.smithi172.stdout:1/189: dread - da/f20 zero size 2024-03-19T06:05:22.834 INFO:tasks.workunit.client.1.smithi172.stdout:1/190: getdents da 0 2024-03-19T06:05:22.838 INFO:tasks.workunit.client.1.smithi172.stdout:0/145: truncate d11/f29 5857153 0 2024-03-19T06:05:22.839 INFO:tasks.workunit.client.1.smithi172.stdout:0/146: readlink d11/d18/l2d 0 2024-03-19T06:05:22.844 INFO:tasks.workunit.client.1.smithi172.stdout:1/191: dwrite da/f26 [0,4194304] 0 2024-03-19T06:05:22.847 INFO:tasks.workunit.client.1.smithi172.stdout:1/192: mknod da/dd/d10/d14/d27/c3a 0 2024-03-19T06:05:22.850 INFO:tasks.workunit.client.1.smithi172.stdout:1/193: chown da/dd/d31/f34 11440210 1 2024-03-19T06:05:22.854 INFO:tasks.workunit.client.1.smithi172.stdout:1/194: unlink da/dd/d10/d14/d27/l2a 0 2024-03-19T06:05:22.855 INFO:tasks.workunit.client.1.smithi172.stdout:1/195: chown da/dd/d31 302146 1 2024-03-19T06:05:22.857 INFO:tasks.workunit.client.1.smithi172.stdout:1/196: dread da/dd/f2b [0,4194304] 0 2024-03-19T06:05:22.858 INFO:tasks.workunit.client.1.smithi172.stdout:1/197: rmdir da 39 2024-03-19T06:05:22.860 INFO:tasks.workunit.client.1.smithi172.stdout:1/198: fdatasync da/dd/f2b 0 2024-03-19T06:05:22.914 INFO:tasks.workunit.client.1.smithi172.stdout:4/143: sync 2024-03-19T06:05:22.932 INFO:tasks.workunit.client.1.smithi172.stdout:4/144: dwrite df/d11/d12/f1a [0,4194304] 0 2024-03-19T06:05:22.949 INFO:tasks.workunit.client.1.smithi172.stdout:4/145: dread df/d11/f1d [0,4194304] 0 2024-03-19T06:05:22.958 INFO:tasks.workunit.client.1.smithi172.stdout:4/146: dread df/d11/d12/f1e [4194304,4194304] 0 2024-03-19T06:05:22.958 INFO:tasks.workunit.client.1.smithi172.stdout:4/147: fdatasync f8 0 2024-03-19T06:05:22.959 INFO:tasks.workunit.client.1.smithi172.stdout:4/148: chown df/f24 257 1 2024-03-19T06:05:22.961 INFO:tasks.workunit.client.1.smithi172.stdout:4/149: rmdir df/d11/d12 39 2024-03-19T06:05:23.006 INFO:tasks.workunit.client.1.smithi172.stdout:4/150: rename fe to df/d11/d12/f29 0 2024-03-19T06:05:23.007 INFO:tasks.workunit.client.1.smithi172.stdout:4/151: chown df/d11 7973 1 2024-03-19T06:05:23.008 INFO:tasks.workunit.client.1.smithi172.stdout:4/152: readlink df/d11/l1c 0 2024-03-19T06:05:23.012 INFO:tasks.workunit.client.1.smithi172.stdout:4/153: stat df/d11/d12/c28 0 2024-03-19T06:05:23.017 INFO:tasks.workunit.client.1.smithi172.stdout:4/154: creat df/d11/d12/d21/f2a x:0 0 0 2024-03-19T06:05:23.022 INFO:tasks.workunit.client.1.smithi172.stdout:4/155: mkdir df/d2b 0 2024-03-19T06:05:23.028 INFO:tasks.workunit.client.1.smithi172.stdout:4/156: symlink df/d11/d12/d21/l2c 0 2024-03-19T06:05:23.031 INFO:tasks.workunit.client.1.smithi172.stdout:4/157: chown df/d11/l1c 50 1 2024-03-19T06:05:23.036 INFO:tasks.workunit.client.1.smithi172.stdout:4/158: mkdir df/d2b/d2d 0 2024-03-19T06:05:23.037 INFO:tasks.workunit.client.1.smithi172.stdout:4/159: dread - df/f24 zero size 2024-03-19T06:05:23.064 INFO:tasks.workunit.client.1.smithi172.stdout:3/163: sync 2024-03-19T06:05:23.065 INFO:tasks.workunit.client.1.smithi172.stdout:9/110: sync 2024-03-19T06:05:23.065 INFO:tasks.workunit.client.1.smithi172.stdout:5/128: sync 2024-03-19T06:05:23.065 INFO:tasks.workunit.client.1.smithi172.stdout:8/112: sync 2024-03-19T06:05:23.065 INFO:tasks.workunit.client.1.smithi172.stdout:2/95: sync 2024-03-19T06:05:23.070 INFO:tasks.workunit.client.1.smithi172.stdout:2/96: chown d7/db/d14 2238418 1 2024-03-19T06:05:23.072 INFO:tasks.workunit.client.1.smithi172.stdout:8/113: rmdir d0/d10 39 2024-03-19T06:05:23.075 INFO:tasks.workunit.client.1.smithi172.stdout:3/164: dread - d0/d5/d9/d25/d21/f3c zero size 2024-03-19T06:05:23.075 INFO:tasks.workunit.client.1.smithi172.stdout:2/97: readlink d7/de/l12 0 2024-03-19T06:05:23.076 INFO:tasks.workunit.client.1.smithi172.stdout:8/114: readlink d0/l4 0 2024-03-19T06:05:23.076 INFO:tasks.workunit.client.1.smithi172.stdout:4/160: dwrite df/d11/d12/d21/f2a [0,4194304] 0 2024-03-19T06:05:23.076 INFO:tasks.workunit.client.1.smithi172.stdout:5/129: creat d5/d1f/f2a x:0 0 0 2024-03-19T06:05:23.081 INFO:tasks.workunit.client.1.smithi172.stdout:9/111: mkdir d1/d7/dc/d29 0 2024-03-19T06:05:23.091 INFO:tasks.workunit.client.1.smithi172.stdout:2/98: mknod d7/de/c17 0 2024-03-19T06:05:23.094 INFO:tasks.workunit.client.1.smithi172.stdout:5/130: rename d5/d14/l26 to d5/d1f/l2b 0 2024-03-19T06:05:23.097 INFO:tasks.workunit.client.1.smithi172.stdout:8/115: mkdir d0/d17/d1d 0 2024-03-19T06:05:23.100 INFO:tasks.workunit.client.1.smithi172.stdout:2/99: creat d7/db/f18 x:0 0 0 2024-03-19T06:05:23.103 INFO:tasks.workunit.client.1.smithi172.stdout:2/100: write d7/f8 [2318067,8019] 0 2024-03-19T06:05:23.104 INFO:tasks.workunit.client.1.smithi172.stdout:4/161: creat df/f2e x:0 0 0 2024-03-19T06:05:23.105 INFO:tasks.workunit.client.1.smithi172.stdout:2/101: stat d7/de/c17 0 2024-03-19T06:05:23.106 INFO:tasks.workunit.client.1.smithi172.stdout:3/165: rmdir d0/d24/d36 0 2024-03-19T06:05:23.107 INFO:tasks.workunit.client.1.smithi172.stdout:4/162: write f6 [9129165,1788] 0 2024-03-19T06:05:23.108 INFO:tasks.workunit.client.1.smithi172.stdout:3/166: fdatasync d0/d5/f35 0 2024-03-19T06:05:23.109 INFO:tasks.workunit.client.1.smithi172.stdout:8/116: chown d0/d10/f1a 28 1 2024-03-19T06:05:23.110 INFO:tasks.workunit.client.1.smithi172.stdout:4/163: dread - df/f2e zero size 2024-03-19T06:05:23.111 INFO:tasks.workunit.client.1.smithi172.stdout:9/112: rename d1/d7/dc/de/l13 to d1/d7/l2a 0 2024-03-19T06:05:23.112 INFO:tasks.workunit.client.1.smithi172.stdout:2/102: chown d7/de/c17 53595 1 2024-03-19T06:05:23.114 INFO:tasks.workunit.client.1.smithi172.stdout:3/167: write d0/d5/f26 [4753990,53992] 0 2024-03-19T06:05:23.115 INFO:tasks.workunit.client.1.smithi172.stdout:8/117: read - d0/f11 zero size 2024-03-19T06:05:23.117 INFO:tasks.workunit.client.1.smithi172.stdout:2/103: chown d7/de/c17 105612014 1 2024-03-19T06:05:23.118 INFO:tasks.workunit.client.1.smithi172.stdout:9/113: write d1/f28 [628367,24422] 0 2024-03-19T06:05:23.121 INFO:tasks.workunit.client.1.smithi172.stdout:9/114: fsync d1/f28 0 2024-03-19T06:05:23.124 INFO:tasks.workunit.client.1.smithi172.stdout:5/131: dwrite d5/ff [0,4194304] 0 2024-03-19T06:05:23.126 INFO:tasks.workunit.client.1.smithi172.stdout:3/168: creat d0/d5/d9/d3a/f3f x:0 0 0 2024-03-19T06:05:23.127 INFO:tasks.workunit.client.1.smithi172.stdout:8/118: creat d0/d17/d1d/f1e x:0 0 0 2024-03-19T06:05:23.130 INFO:tasks.workunit.client.1.smithi172.stdout:9/115: rename d1/f27 to d1/d7/dc/d29/f2b 0 2024-03-19T06:05:23.131 INFO:tasks.workunit.client.1.smithi172.stdout:4/164: dread df/d11/f1d [0,4194304] 0 2024-03-19T06:05:23.134 INFO:tasks.workunit.client.1.smithi172.stdout:9/116: dread - d1/d7/dc/de/f1f zero size 2024-03-19T06:05:23.135 INFO:tasks.workunit.client.1.smithi172.stdout:5/132: rename d5/d14/d15/f1c to d5/d1f/f2c 0 2024-03-19T06:05:23.136 INFO:tasks.workunit.client.1.smithi172.stdout:4/165: write df/d11/f25 [656261,100291] 0 2024-03-19T06:05:23.139 INFO:tasks.workunit.client.1.smithi172.stdout:2/104: dread d7/fa [0,4194304] 0 2024-03-19T06:05:23.139 INFO:tasks.workunit.client.1.smithi172.stdout:6/208: sync 2024-03-19T06:05:23.142 INFO:tasks.workunit.client.1.smithi172.stdout:8/119: truncate d0/f3 5468771 0 2024-03-19T06:05:23.144 INFO:tasks.workunit.client.1.smithi172.stdout:9/117: creat d1/d7/dc/d23/f2c x:0 0 0 2024-03-19T06:05:23.147 INFO:tasks.workunit.client.1.smithi172.stdout:5/133: rename d5/d14/c1e to d5/d1f/c2d 0 2024-03-19T06:05:23.153 INFO:tasks.workunit.client.1.smithi172.stdout:6/209: unlink d5/d11/d17/d1b/f2b 0 2024-03-19T06:05:23.153 INFO:tasks.workunit.client.1.smithi172.stdout:3/169: dwrite d0/d5/f1c [0,4194304] 0 2024-03-19T06:05:23.154 INFO:tasks.workunit.client.1.smithi172.stdout:9/118: mknod d1/d7/dc/de/c2d 0 2024-03-19T06:05:23.154 INFO:tasks.workunit.client.1.smithi172.stdout:4/166: dread df/d11/d12/f29 [0,4194304] 0 2024-03-19T06:05:23.156 INFO:tasks.workunit.client.1.smithi172.stdout:5/134: symlink d5/d1f/l2e 0 2024-03-19T06:05:23.157 INFO:tasks.workunit.client.1.smithi172.stdout:6/210: creat d5/f37 x:0 0 0 2024-03-19T06:05:23.158 INFO:tasks.workunit.client.1.smithi172.stdout:8/120: link d0/fd d0/f1f 0 2024-03-19T06:05:23.159 INFO:tasks.workunit.client.1.smithi172.stdout:9/119: creat d1/d7/f2e x:0 0 0 2024-03-19T06:05:23.159 INFO:tasks.workunit.client.1.smithi172.stdout:4/167: rmdir df/d2b 39 2024-03-19T06:05:23.163 INFO:tasks.workunit.client.1.smithi172.stdout:5/135: mkdir d5/d1f/d2f 0 2024-03-19T06:05:23.163 INFO:tasks.workunit.client.1.smithi172.stdout:2/105: dread d7/fa [0,4194304] 0 2024-03-19T06:05:23.163 INFO:tasks.workunit.client.1.smithi172.stdout:8/121: write d0/f9 [194769,115181] 0 2024-03-19T06:05:23.166 INFO:tasks.workunit.client.1.smithi172.stdout:2/106: fdatasync d7/f8 0 2024-03-19T06:05:23.169 INFO:tasks.workunit.client.1.smithi172.stdout:4/168: creat df/d11/d12/d21/f2f x:0 0 0 2024-03-19T06:05:23.170 INFO:tasks.workunit.client.1.smithi172.stdout:3/170: mknod d0/c40 0 2024-03-19T06:05:23.171 INFO:tasks.workunit.client.1.smithi172.stdout:2/107: mknod d7/db/c19 0 2024-03-19T06:05:23.179 INFO:tasks.workunit.client.1.smithi172.stdout:3/171: rename d0/d5 to d0/d5/d9/d3a/d41 22 2024-03-19T06:05:23.180 INFO:tasks.workunit.client.1.smithi172.stdout:0/147: sync 2024-03-19T06:05:23.180 INFO:tasks.workunit.client.1.smithi172.stdout:1/199: sync 2024-03-19T06:05:23.180 INFO:tasks.workunit.client.1.smithi172.stdout:7/125: sync 2024-03-19T06:05:23.180 INFO:tasks.workunit.client.1.smithi172.stdout:9/120: link d1/d7/dc/de/l21 d1/d7/dc/l2f 0 2024-03-19T06:05:23.195 INFO:tasks.workunit.client.1.smithi172.stdout:6/211: truncate d5/d11/d17/d1b/f25 1294670 0 2024-03-19T06:05:23.195 INFO:tasks.workunit.client.1.smithi172.stdout:1/200: chown da/dd/d10/d14/d27/c3a 66800314 1 2024-03-19T06:05:23.195 INFO:tasks.workunit.client.1.smithi172.stdout:5/136: dwrite d5/ff [0,4194304] 0 2024-03-19T06:05:23.195 INFO:tasks.workunit.client.1.smithi172.stdout:9/121: fsync f0 0 2024-03-19T06:05:23.196 INFO:tasks.workunit.client.1.smithi172.stdout:6/212: read - d5/f1d zero size 2024-03-19T06:05:23.199 INFO:tasks.workunit.client.1.smithi172.stdout:0/148: creat d11/d18/f2f x:0 0 0 2024-03-19T06:05:23.199 INFO:tasks.workunit.client.1.smithi172.stdout:2/108: link d7/f15 d7/db/f1a 0 2024-03-19T06:05:23.204 INFO:tasks.workunit.client.1.smithi172.stdout:1/201: mkdir da/d3b 0 2024-03-19T06:05:23.211 INFO:tasks.workunit.client.1.smithi172.stdout:4/169: dread fb [0,4194304] 0 2024-03-19T06:05:23.211 INFO:tasks.workunit.client.1.smithi172.stdout:2/109: mkdir d7/d1b 0 2024-03-19T06:05:23.213 INFO:tasks.workunit.client.1.smithi172.stdout:3/172: dread d0/d24/f2e [0,4194304] 0 2024-03-19T06:05:23.215 INFO:tasks.workunit.client.1.smithi172.stdout:0/149: unlink d11/d18/l1d 0 2024-03-19T06:05:23.216 INFO:tasks.workunit.client.1.smithi172.stdout:4/170: fsync df/d11/d12/d21/f2a 0 2024-03-19T06:05:23.222 INFO:tasks.workunit.client.1.smithi172.stdout:8/122: dread d0/f12 [0,4194304] 0 2024-03-19T06:05:23.225 INFO:tasks.workunit.client.1.smithi172.stdout:1/202: truncate da/dd/d10/d14/d27/f37 173613 0 2024-03-19T06:05:23.225 INFO:tasks.workunit.client.1.smithi172.stdout:0/150: read f2 [2611686,65798] 0 2024-03-19T06:05:23.226 INFO:tasks.workunit.client.1.smithi172.stdout:5/137: dread d5/d14/f22 [0,4194304] 0 2024-03-19T06:05:23.227 INFO:tasks.workunit.client.1.smithi172.stdout:7/126: dwrite d0/f15 [0,4194304] 0 2024-03-19T06:05:23.231 INFO:tasks.workunit.client.1.smithi172.stdout:8/123: write d0/f2 [2847782,87567] 0 2024-03-19T06:05:23.244 INFO:tasks.workunit.client.1.smithi172.stdout:0/151: readlink d11/l1e 0 2024-03-19T06:05:23.244 INFO:tasks.workunit.client.1.smithi172.stdout:8/124: mkdir d0/d17/d1d/d20 0 2024-03-19T06:05:23.244 INFO:tasks.workunit.client.1.smithi172.stdout:6/213: dwrite d5/fb [0,4194304] 0 2024-03-19T06:05:23.244 INFO:tasks.workunit.client.1.smithi172.stdout:4/171: creat df/d11/d12/d26/f30 x:0 0 0 2024-03-19T06:05:23.252 INFO:tasks.workunit.client.1.smithi172.stdout:9/122: dwrite d1/d7/dc/de/f1d [0,4194304] 0 2024-03-19T06:05:23.252 INFO:tasks.workunit.client.1.smithi172.stdout:5/138: dread d5/d14/f25 [0,4194304] 0 2024-03-19T06:05:23.254 INFO:tasks.workunit.client.1.smithi172.stdout:9/123: chown d1/f1c 228023 1 2024-03-19T06:05:23.262 INFO:tasks.workunit.client.1.smithi172.stdout:7/127: creat d0/d2c/f2f x:0 0 0 2024-03-19T06:05:23.262 INFO:tasks.workunit.client.1.smithi172.stdout:8/125: dread d0/f1f [0,4194304] 0 2024-03-19T06:05:23.264 INFO:tasks.workunit.client.1.smithi172.stdout:6/214: fsync d5/f33 0 2024-03-19T06:05:23.264 INFO:tasks.workunit.client.1.smithi172.stdout:5/139: symlink d5/d14/l30 0 2024-03-19T06:05:23.268 INFO:tasks.workunit.client.1.smithi172.stdout:4/172: rmdir df/d11 39 2024-03-19T06:05:23.268 INFO:tasks.workunit.client.1.smithi172.stdout:2/110: dread d7/fa [0,4194304] 0 2024-03-19T06:05:23.269 INFO:tasks.workunit.client.1.smithi172.stdout:1/203: link da/f20 da/f3c 0 2024-03-19T06:05:23.270 INFO:tasks.workunit.client.1.smithi172.stdout:2/111: chown f3 15 1 2024-03-19T06:05:23.271 INFO:tasks.workunit.client.1.smithi172.stdout:8/126: write d0/f8 [5269786,122574] 0 2024-03-19T06:05:23.274 INFO:tasks.workunit.client.1.smithi172.stdout:7/128: truncate d0/db/f13 1985861 0 2024-03-19T06:05:23.277 INFO:tasks.workunit.client.1.smithi172.stdout:8/127: creat d0/d17/f21 x:0 0 0 2024-03-19T06:05:23.278 INFO:tasks.workunit.client.1.smithi172.stdout:1/204: creat da/d3b/f3d x:0 0 0 2024-03-19T06:05:23.283 INFO:tasks.workunit.client.1.smithi172.stdout:4/173: unlink df/d11/d12/d21/l2c 0 2024-03-19T06:05:23.283 INFO:tasks.workunit.client.1.smithi172.stdout:6/215: truncate d5/d16/f18 1494447 0 2024-03-19T06:05:23.285 INFO:tasks.workunit.client.1.smithi172.stdout:7/129: rename d0/f16 to d0/d2c/f30 0 2024-03-19T06:05:23.285 INFO:tasks.workunit.client.1.smithi172.stdout:4/174: read - df/f24 zero size 2024-03-19T06:05:23.285 INFO:tasks.workunit.client.1.smithi172.stdout:8/128: mknod d0/d17/c22 0 2024-03-19T06:05:23.288 INFO:tasks.workunit.client.1.smithi172.stdout:5/140: getdents d5/d1f 0 2024-03-19T06:05:23.292 INFO:tasks.workunit.client.1.smithi172.stdout:9/124: truncate d1/fa 7049251 0 2024-03-19T06:05:23.294 INFO:tasks.workunit.client.1.smithi172.stdout:7/130: symlink d0/l31 0 2024-03-19T06:05:23.294 INFO:tasks.workunit.client.1.smithi172.stdout:3/173: dread d0/d5/d14/f27 [0,4194304] 0 2024-03-19T06:05:23.294 INFO:tasks.workunit.client.1.smithi172.stdout:4/175: write df/d11/f1d [42532,71653] 0 2024-03-19T06:05:23.295 INFO:tasks.workunit.client.1.smithi172.stdout:6/216: rename d5/d2c/d31/f34 to d5/d11/d2f/f38 0 2024-03-19T06:05:23.298 INFO:tasks.workunit.client.1.smithi172.stdout:7/131: creat d0/d22/d1d/f32 x:0 0 0 2024-03-19T06:05:23.298 INFO:tasks.workunit.client.1.smithi172.stdout:4/176: write df/d11/d12/f1a [1770348,37968] 0 2024-03-19T06:05:23.300 INFO:tasks.workunit.client.1.smithi172.stdout:5/141: rename d5/d14/f25 to d5/d1f/f31 0 2024-03-19T06:05:23.302 INFO:tasks.workunit.client.1.smithi172.stdout:5/142: chown d5/d1f/c29 12726557 1 2024-03-19T06:05:23.304 INFO:tasks.workunit.client.1.smithi172.stdout:3/174: symlink d0/d5/l42 0 2024-03-19T06:05:23.304 INFO:tasks.workunit.client.1.smithi172.stdout:4/177: chown df/d2b/d2d 103413974 1 2024-03-19T06:05:23.305 INFO:tasks.workunit.client.1.smithi172.stdout:5/143: write d5/fd [716351,113463] 0 2024-03-19T06:05:23.305 INFO:tasks.workunit.client.1.smithi172.stdout:8/129: link d0/c18 d0/d17/c23 0 2024-03-19T06:05:23.313 INFO:tasks.workunit.client.1.smithi172.stdout:8/130: fsync d0/d10/f1a 0 2024-03-19T06:05:23.315 INFO:tasks.workunit.client.1.smithi172.stdout:4/178: mknod df/d2b/c31 0 2024-03-19T06:05:23.316 INFO:tasks.workunit.client.1.smithi172.stdout:9/125: dwrite d1/d7/dc/f15 [0,4194304] 0 2024-03-19T06:05:23.317 INFO:tasks.workunit.client.1.smithi172.stdout:4/179: fdatasync df/d11/d12/d21/f2f 0 2024-03-19T06:05:23.319 INFO:tasks.workunit.client.1.smithi172.stdout:5/144: mknod d5/c32 0 2024-03-19T06:05:23.320 INFO:tasks.workunit.client.1.smithi172.stdout:4/180: readlink df/d11/l1c 0 2024-03-19T06:05:23.321 INFO:tasks.workunit.client.1.smithi172.stdout:8/131: mknod d0/d10/c24 0 2024-03-19T06:05:23.321 INFO:tasks.workunit.client.1.smithi172.stdout:5/145: stat d5/d1f/f2c 0 2024-03-19T06:05:23.325 INFO:tasks.workunit.client.1.smithi172.stdout:8/132: stat d0/l13 0 2024-03-19T06:05:23.327 INFO:tasks.workunit.client.1.smithi172.stdout:9/126: rename d1/d7/l16 to d1/d7/dc/d29/l30 0 2024-03-19T06:05:23.330 INFO:tasks.workunit.client.1.smithi172.stdout:5/146: creat d5/d14/f33 x:0 0 0 2024-03-19T06:05:23.330 INFO:tasks.workunit.client.1.smithi172.stdout:7/132: dread d0/db/f13 [0,4194304] 0 2024-03-19T06:05:23.334 INFO:tasks.workunit.client.1.smithi172.stdout:5/147: mkdir d5/d14/d34 0 2024-03-19T06:05:23.335 INFO:tasks.workunit.client.1.smithi172.stdout:7/133: dread - d0/d22/f26 zero size 2024-03-19T06:05:23.343 INFO:tasks.workunit.client.1.smithi172.stdout:9/127: dread d1/f28 [0,4194304] 0 2024-03-19T06:05:23.346 INFO:tasks.workunit.client.1.smithi172.stdout:3/175: dwrite d0/d5/d14/f27 [0,4194304] 0 2024-03-19T06:05:23.349 INFO:tasks.workunit.client.1.smithi172.stdout:5/148: write d5/f16 [308472,9738] 0 2024-03-19T06:05:23.350 INFO:tasks.workunit.client.1.smithi172.stdout:6/217: dwrite d5/d11/d17/d1b/f21 [0,4194304] 0 2024-03-19T06:05:23.357 INFO:tasks.workunit.client.1.smithi172.stdout:8/133: dread d0/f2 [0,4194304] 0 2024-03-19T06:05:23.357 INFO:tasks.workunit.client.1.smithi172.stdout:2/112: sync 2024-03-19T06:05:23.357 INFO:tasks.workunit.client.1.smithi172.stdout:0/152: sync 2024-03-19T06:05:23.367 INFO:tasks.workunit.client.1.smithi172.stdout:5/149: write d5/d1f/f2a [607891,51976] 0 2024-03-19T06:05:23.372 INFO:tasks.workunit.client.1.smithi172.stdout:4/181: dwrite df/d11/f25 [0,4194304] 0 2024-03-19T06:05:23.374 INFO:tasks.workunit.client.1.smithi172.stdout:7/134: dwrite d0/f29 [0,4194304] 0 2024-03-19T06:05:23.378 INFO:tasks.workunit.client.1.smithi172.stdout:7/135: dread - d0/d22/f26 zero size 2024-03-19T06:05:23.384 INFO:tasks.workunit.client.1.smithi172.stdout:2/113: truncate d7/db/f16 4116914 0 2024-03-19T06:05:23.389 INFO:tasks.workunit.client.1.smithi172.stdout:9/128: rename d1/d7/dc/d29 to d1/d7/dc/d31 0 2024-03-19T06:05:23.391 INFO:tasks.workunit.client.1.smithi172.stdout:9/129: chown d1/f9 194358 1 2024-03-19T06:05:23.399 INFO:tasks.workunit.client.1.smithi172.stdout:6/218: dwrite d5/f6 [0,4194304] 0 2024-03-19T06:05:23.402 INFO:tasks.workunit.client.1.smithi172.stdout:7/136: unlink d0/db/l2b 0 2024-03-19T06:05:23.408 INFO:tasks.workunit.client.1.smithi172.stdout:1/205: sync 2024-03-19T06:05:23.420 INFO:tasks.workunit.client.1.smithi172.stdout:5/150: rmdir d5 39 2024-03-19T06:05:23.420 INFO:tasks.workunit.client.1.smithi172.stdout:9/130: dwrite d1/d7/dc/de/f1f [0,4194304] 0 2024-03-19T06:05:23.420 INFO:tasks.workunit.client.1.smithi172.stdout:8/134: truncate d0/f3 1069220 0 2024-03-19T06:05:23.424 INFO:tasks.workunit.client.1.smithi172.stdout:4/182: creat df/d11/f32 x:0 0 0 2024-03-19T06:05:23.431 INFO:tasks.workunit.client.1.smithi172.stdout:8/135: creat d0/d17/f25 x:0 0 0 2024-03-19T06:05:23.434 INFO:tasks.workunit.client.1.smithi172.stdout:8/136: stat d0/l4 0 2024-03-19T06:05:23.435 INFO:tasks.workunit.client.1.smithi172.stdout:4/183: creat df/d11/d12/f33 x:0 0 0 2024-03-19T06:05:23.438 INFO:tasks.workunit.client.1.smithi172.stdout:1/206: link c8 da/d3b/c3e 0 2024-03-19T06:05:23.440 INFO:tasks.workunit.client.1.smithi172.stdout:9/131: mknod d1/d7/c32 0 2024-03-19T06:05:23.446 INFO:tasks.workunit.client.1.smithi172.stdout:6/219: getdents d5/d2c 0 2024-03-19T06:05:23.446 INFO:tasks.workunit.client.1.smithi172.stdout:8/137: mkdir d0/d17/d26 0 2024-03-19T06:05:23.447 INFO:tasks.workunit.client.1.smithi172.stdout:7/137: dwrite d0/d22/f1b [0,4194304] 0 2024-03-19T06:05:23.447 INFO:tasks.workunit.client.1.smithi172.stdout:5/151: rename d5/d1f/c29 to d5/d14/d34/c35 0 2024-03-19T06:05:23.447 INFO:tasks.workunit.client.1.smithi172.stdout:1/207: fsync da/dd/d10/d14/d27/f37 0 2024-03-19T06:05:23.448 INFO:tasks.workunit.client.1.smithi172.stdout:0/153: truncate d11/d18/f21 1208730 0 2024-03-19T06:05:23.451 INFO:tasks.workunit.client.1.smithi172.stdout:0/154: stat d11/d14/c2a 0 2024-03-19T06:05:23.451 INFO:tasks.workunit.client.1.smithi172.stdout:9/132: rename f0 to d1/d7/dc/d23/f33 0 2024-03-19T06:05:23.451 INFO:tasks.workunit.client.1.smithi172.stdout:7/138: write d0/d22/d1d/f32 [1013162,58158] 0 2024-03-19T06:05:23.455 INFO:tasks.workunit.client.1.smithi172.stdout:3/176: creat d0/f43 x:0 0 0 2024-03-19T06:05:23.456 INFO:tasks.workunit.client.1.smithi172.stdout:1/208: mkdir da/dd/d10/d14/d27/d3f 0 2024-03-19T06:05:23.461 INFO:tasks.workunit.client.1.smithi172.stdout:5/152: creat d5/f36 x:0 0 0 2024-03-19T06:05:23.463 INFO:tasks.workunit.client.1.smithi172.stdout:8/138: rename d0/d17/d1d to d0/d10/d27 0 2024-03-19T06:05:23.464 INFO:tasks.workunit.client.1.smithi172.stdout:9/133: mkdir d1/d7/dc/de/d34 0 2024-03-19T06:05:23.474 INFO:tasks.workunit.client.1.smithi172.stdout:3/177: fdatasync d0/f6 0 2024-03-19T06:05:23.474 INFO:tasks.workunit.client.1.smithi172.stdout:8/139: truncate d0/d17/f21 466876 0 2024-03-19T06:05:23.478 INFO:tasks.workunit.client.1.smithi172.stdout:5/153: write d5/d1f/f31 [83288,17026] 0 2024-03-19T06:05:23.484 INFO:tasks.workunit.client.1.smithi172.stdout:6/220: link d5/c2e d5/d11/c39 0 2024-03-19T06:05:23.484 INFO:tasks.workunit.client.1.smithi172.stdout:7/139: dwrite d0/db/fc [0,4194304] 0 2024-03-19T06:05:23.484 INFO:tasks.workunit.client.1.smithi172.stdout:2/114: dwrite d7/db/f1a [0,4194304] 0 2024-03-19T06:05:23.484 INFO:tasks.workunit.client.1.smithi172.stdout:9/134: link d1/f1c d1/d7/dc/d31/f35 0 2024-03-19T06:05:23.486 INFO:tasks.workunit.client.1.smithi172.stdout:3/178: unlink d0/f43 0 2024-03-19T06:05:23.489 INFO:tasks.workunit.client.1.smithi172.stdout:5/154: mknod d5/d1f/c37 0 2024-03-19T06:05:23.491 INFO:tasks.workunit.client.1.smithi172.stdout:8/140: mkdir d0/d10/d27/d20/d28 0 2024-03-19T06:05:23.496 INFO:tasks.workunit.client.1.smithi172.stdout:0/155: truncate d11/f13 214013 0 2024-03-19T06:05:23.499 INFO:tasks.workunit.client.1.smithi172.stdout:1/209: dwrite da/dd/d10/d36/f38 [0,4194304] 0 2024-03-19T06:05:23.502 INFO:tasks.workunit.client.1.smithi172.stdout:7/140: rmdir d0/d22/d27 39 2024-03-19T06:05:23.502 INFO:tasks.workunit.client.1.smithi172.stdout:1/210: chown da/f26 1035238401 1 2024-03-19T06:05:23.505 INFO:tasks.workunit.client.1.smithi172.stdout:8/141: unlink d0/d17/l1c 0 2024-03-19T06:05:23.508 INFO:tasks.workunit.client.1.smithi172.stdout:1/211: write da/dd/d10/f29 [78034,7269] 0 2024-03-19T06:05:23.508 INFO:tasks.workunit.client.1.smithi172.stdout:7/141: write d0/db/f1f [1263779,76759] 0 2024-03-19T06:05:23.508 INFO:tasks.workunit.client.1.smithi172.stdout:9/135: symlink d1/l36 0 2024-03-19T06:05:23.509 INFO:tasks.workunit.client.1.smithi172.stdout:5/155: mkdir d5/d1f/d2f/d38 0 2024-03-19T06:05:23.510 INFO:tasks.workunit.client.1.smithi172.stdout:3/179: symlink d0/d5/d9/d3a/l44 0 2024-03-19T06:05:23.517 INFO:tasks.workunit.client.1.smithi172.stdout:2/115: dwrite d7/fc [0,4194304] 0 2024-03-19T06:05:23.518 INFO:tasks.workunit.client.1.smithi172.stdout:5/156: symlink d5/d1f/l39 0 2024-03-19T06:05:23.520 INFO:tasks.workunit.client.1.smithi172.stdout:1/212: readlink da/dd/d10/d14/d27/l30 0 2024-03-19T06:05:23.521 INFO:tasks.workunit.client.1.smithi172.stdout:5/157: chown d5/d1f/c37 497 1 2024-03-19T06:05:23.523 INFO:tasks.workunit.client.1.smithi172.stdout:9/136: write d1/d7/dc/d23/f2c [407264,97772] 0 2024-03-19T06:05:23.523 INFO:tasks.workunit.client.1.smithi172.stdout:2/116: write d7/db/f1a [1892168,122184] 0 2024-03-19T06:05:23.525 INFO:tasks.workunit.client.1.smithi172.stdout:5/158: chown d5/d14/f33 0 1 2024-03-19T06:05:23.527 INFO:tasks.workunit.client.1.smithi172.stdout:7/142: fdatasync d0/db/f1f 0 2024-03-19T06:05:23.528 INFO:tasks.workunit.client.1.smithi172.stdout:0/156: chown d11/d18/f21 69913 1 2024-03-19T06:05:23.529 INFO:tasks.workunit.client.1.smithi172.stdout:8/142: rename d0/d10/d27/d20 to d0/d10/d27/d29 0 2024-03-19T06:05:23.532 INFO:tasks.workunit.client.1.smithi172.stdout:1/213: creat da/dd/d31/f40 x:0 0 0 2024-03-19T06:05:23.538 INFO:tasks.workunit.client.1.smithi172.stdout:0/157: mknod d11/c30 0 2024-03-19T06:05:23.538 INFO:tasks.workunit.client.1.smithi172.stdout:8/143: creat d0/d17/f2a x:0 0 0 2024-03-19T06:05:23.538 INFO:tasks.workunit.client.1.smithi172.stdout:3/180: dread d0/d5/d14/f30 [0,4194304] 0 2024-03-19T06:05:23.543 INFO:tasks.workunit.client.1.smithi172.stdout:2/117: creat d7/db/d14/f1c x:0 0 0 2024-03-19T06:05:23.543 INFO:tasks.workunit.client.1.smithi172.stdout:1/214: mknod da/c41 0 2024-03-19T06:05:23.545 INFO:tasks.workunit.client.1.smithi172.stdout:3/181: symlink d0/d5/d9/d25/l45 0 2024-03-19T06:05:23.545 INFO:tasks.workunit.client.1.smithi172.stdout:1/215: dread - da/dd/d31/f40 zero size 2024-03-19T06:05:23.547 INFO:tasks.workunit.client.1.smithi172.stdout:7/143: creat d0/db/f33 x:0 0 0 2024-03-19T06:05:23.549 INFO:tasks.workunit.client.1.smithi172.stdout:2/118: link f3 d7/db/f1d 0 2024-03-19T06:05:23.550 INFO:tasks.workunit.client.1.smithi172.stdout:3/182: unlink d0/f3e 0 2024-03-19T06:05:23.554 INFO:tasks.workunit.client.1.smithi172.stdout:1/216: write da/dd/d10/d36/f38 [4180930,113543] 0 2024-03-19T06:05:23.554 INFO:tasks.workunit.client.1.smithi172.stdout:9/137: dread d1/f6 [0,4194304] 0 2024-03-19T06:05:23.558 INFO:tasks.workunit.client.1.smithi172.stdout:0/158: dwrite f10 [0,4194304] 0 2024-03-19T06:05:23.559 INFO:tasks.workunit.client.1.smithi172.stdout:0/159: stat ff 0 2024-03-19T06:05:23.560 INFO:tasks.workunit.client.1.smithi172.stdout:0/160: read - d11/d18/f2f zero size 2024-03-19T06:05:23.563 INFO:tasks.workunit.client.1.smithi172.stdout:1/217: mknod da/c42 0 2024-03-19T06:05:23.566 INFO:tasks.workunit.client.1.smithi172.stdout:3/183: rename d0/c40 to d0/d5/d14/c46 0 2024-03-19T06:05:23.568 INFO:tasks.workunit.client.1.smithi172.stdout:9/138: mknod d1/d7/c37 0 2024-03-19T06:05:23.570 INFO:tasks.workunit.client.1.smithi172.stdout:0/161: rmdir d11/d18 39 2024-03-19T06:05:23.573 INFO:tasks.workunit.client.1.smithi172.stdout:3/184: fsync d0/d5/d9/d25/d21/f38 0 2024-03-19T06:05:23.574 INFO:tasks.workunit.client.1.smithi172.stdout:0/162: write d11/f1b [1896256,96811] 0 2024-03-19T06:05:23.574 INFO:tasks.workunit.client.1.smithi172.stdout:2/119: truncate d7/f15 2879293 0 2024-03-19T06:05:23.580 INFO:tasks.workunit.client.1.smithi172.stdout:7/144: dwrite d0/db/f1f [0,4194304] 0 2024-03-19T06:05:23.581 INFO:tasks.workunit.client.1.smithi172.stdout:2/120: creat d7/de/f1e x:0 0 0 2024-03-19T06:05:23.584 INFO:tasks.workunit.client.1.smithi172.stdout:9/139: symlink d1/l38 0 2024-03-19T06:05:23.585 INFO:tasks.workunit.client.1.smithi172.stdout:3/185: mknod d0/d5/d9/d3a/c47 0 2024-03-19T06:05:23.587 INFO:tasks.workunit.client.1.smithi172.stdout:0/163: rename d11/d14/d2c/f2b to d11/d14/d2c/f31 0 2024-03-19T06:05:23.588 INFO:tasks.workunit.client.1.smithi172.stdout:0/164: fdatasync d11/f12 0 2024-03-19T06:05:23.590 INFO:tasks.workunit.client.1.smithi172.stdout:7/145: mknod d0/d2c/c34 0 2024-03-19T06:05:23.594 INFO:tasks.workunit.client.1.smithi172.stdout:2/121: creat d7/d1b/f1f x:0 0 0 2024-03-19T06:05:23.597 INFO:tasks.workunit.client.1.smithi172.stdout:0/165: mkdir d11/d22/d32 0 2024-03-19T06:05:23.601 INFO:tasks.workunit.client.1.smithi172.stdout:1/218: dwrite da/dd/d10/d14/f35 [0,4194304] 0 2024-03-19T06:05:23.601 INFO:tasks.workunit.client.1.smithi172.stdout:7/146: mkdir d0/d22/d35 0 2024-03-19T06:05:23.602 INFO:tasks.workunit.client.1.smithi172.stdout:9/140: link d1/l36 d1/d7/dc/l39 0 2024-03-19T06:05:23.606 INFO:tasks.workunit.client.1.smithi172.stdout:9/141: chown d1/d7/dc/de 48 1 2024-03-19T06:05:23.608 INFO:tasks.workunit.client.1.smithi172.stdout:4/184: sync 2024-03-19T06:05:23.612 INFO:tasks.workunit.client.1.smithi172.stdout:7/147: rename d0/db to d0/d22/d1d/d36 0 2024-03-19T06:05:23.617 INFO:tasks.workunit.client.1.smithi172.stdout:1/219: symlink da/dd/d10/d14/d27/l43 0 2024-03-19T06:05:23.621 INFO:tasks.workunit.client.1.smithi172.stdout:0/166: truncate f2 5928033 0 2024-03-19T06:05:23.621 INFO:tasks.workunit.client.1.smithi172.stdout:7/148: write d0/d22/f26 [588802,90685] 0 2024-03-19T06:05:23.624 INFO:tasks.workunit.client.1.smithi172.stdout:0/167: write d11/f12 [426909,46563] 0 2024-03-19T06:05:23.624 INFO:tasks.workunit.client.1.smithi172.stdout:1/220: mknod da/dd/d31/c44 0 2024-03-19T06:05:23.625 INFO:tasks.workunit.client.1.smithi172.stdout:2/122: truncate d7/db/f1a 361797 0 2024-03-19T06:05:23.629 INFO:tasks.workunit.client.1.smithi172.stdout:7/149: symlink d0/d22/d27/l37 0 2024-03-19T06:05:23.633 INFO:tasks.workunit.client.1.smithi172.stdout:0/168: truncate f7 4217832 0 2024-03-19T06:05:23.637 INFO:tasks.workunit.client.1.smithi172.stdout:4/185: dwrite df/d11/d12/d21/f2a [0,4194304] 0 2024-03-19T06:05:23.637 INFO:tasks.workunit.client.1.smithi172.stdout:9/142: dwrite d1/d7/dc/de/f19 [0,4194304] 0 2024-03-19T06:05:23.638 INFO:tasks.workunit.client.1.smithi172.stdout:1/221: rename da/dd/d10/d14/d27 to da/dd/d10/d14/d27/d45 22 2024-03-19T06:05:23.639 INFO:tasks.workunit.client.1.smithi172.stdout:0/169: symlink d11/d22/d32/l33 0 2024-03-19T06:05:23.640 INFO:tasks.workunit.client.1.smithi172.stdout:4/186: dread - df/d11/d12/f33 zero size 2024-03-19T06:05:23.642 INFO:tasks.workunit.client.1.smithi172.stdout:4/187: stat df/d11/d12/f16 0 2024-03-19T06:05:23.642 INFO:tasks.workunit.client.1.smithi172.stdout:7/150: link d0/d22/d1d/d36/f23 d0/d22/d1d/f38 0 2024-03-19T06:05:23.644 INFO:tasks.workunit.client.1.smithi172.stdout:1/222: creat da/dd/d10/d14/f46 x:0 0 0 2024-03-19T06:05:23.650 INFO:tasks.workunit.client.1.smithi172.stdout:1/223: write da/dd/d10/d14/d27/f32 [16879,105662] 0 2024-03-19T06:05:23.651 INFO:tasks.workunit.client.1.smithi172.stdout:0/170: creat d11/d22/f34 x:0 0 0 2024-03-19T06:05:23.655 INFO:tasks.workunit.client.1.smithi172.stdout:4/188: mkdir df/d11/d12/d34 0 2024-03-19T06:05:23.658 INFO:tasks.workunit.client.1.smithi172.stdout:4/189: truncate df/d11/d12/f33 562045 0 2024-03-19T06:05:23.664 INFO:tasks.workunit.client.1.smithi172.stdout:0/171: creat d11/d22/d32/f35 x:0 0 0 2024-03-19T06:05:23.670 INFO:tasks.workunit.client.1.smithi172.stdout:7/151: link d0/d22/d1d/d36/f23 d0/d22/d1d/d36/f39 0 2024-03-19T06:05:23.672 INFO:tasks.workunit.client.1.smithi172.stdout:0/172: unlink d11/d18/l2d 0 2024-03-19T06:05:23.673 INFO:tasks.workunit.client.1.smithi172.stdout:7/152: mkdir d0/d22/d1d/d3a 0 2024-03-19T06:05:23.675 INFO:tasks.workunit.client.1.smithi172.stdout:0/173: mkdir d11/d14/d2c/d36 0 2024-03-19T06:05:23.676 INFO:tasks.workunit.client.1.smithi172.stdout:0/174: read - d11/d22/f34 zero size 2024-03-19T06:05:23.679 INFO:tasks.workunit.client.1.smithi172.stdout:0/175: read f10 [1913906,103529] 0 2024-03-19T06:05:23.681 INFO:tasks.workunit.client.1.smithi172.stdout:7/153: unlink d0/c18 0 2024-03-19T06:05:23.681 INFO:tasks.workunit.client.1.smithi172.stdout:1/224: rmdir da/dd 39 2024-03-19T06:05:23.682 INFO:tasks.workunit.client.1.smithi172.stdout:2/123: write d7/db/f16 [976876,130751] 0 2024-03-19T06:05:23.682 INFO:tasks.workunit.client.1.smithi172.stdout:7/154: chown d0/f29 57992 1 2024-03-19T06:05:23.684 INFO:tasks.workunit.client.1.smithi172.stdout:9/143: write d1/fa [675228,12233] 0 2024-03-19T06:05:23.690 INFO:tasks.workunit.client.1.smithi172.stdout:2/124: chown d7/db/d14/f1c 0 1 2024-03-19T06:05:23.690 INFO:tasks.workunit.client.1.smithi172.stdout:9/144: chown d1/d7/dc/de/f1d 419497 1 2024-03-19T06:05:23.692 INFO:tasks.workunit.client.1.smithi172.stdout:7/155: write d0/d2c/f30 [121123,106876] 0 2024-03-19T06:05:23.692 INFO:tasks.workunit.client.1.smithi172.stdout:4/190: write df/d11/d12/f16 [376812,1512] 0 2024-03-19T06:05:23.694 INFO:tasks.workunit.client.1.smithi172.stdout:1/225: mkdir da/dd/d31/d47 0 2024-03-19T06:05:23.699 INFO:tasks.workunit.client.1.smithi172.stdout:9/145: fsync d1/d7/dc/d31/f35 0 2024-03-19T06:05:23.699 INFO:tasks.workunit.client.1.smithi172.stdout:1/226: chown da/dd 2471 1 2024-03-19T06:05:23.704 INFO:tasks.workunit.client.1.smithi172.stdout:1/227: creat da/d3b/f48 x:0 0 0 2024-03-19T06:05:23.706 INFO:tasks.workunit.client.1.smithi172.stdout:9/146: fsync d1/d7/dc/d31/f35 0 2024-03-19T06:05:23.708 INFO:tasks.workunit.client.1.smithi172.stdout:7/156: rename d0/l1c to d0/d22/d27/l3b 0 2024-03-19T06:05:23.714 INFO:tasks.workunit.client.1.smithi172.stdout:9/147: symlink d1/d7/l3a 0 2024-03-19T06:05:23.720 INFO:tasks.workunit.client.1.smithi172.stdout:2/125: dread f3 [0,4194304] 0 2024-03-19T06:05:23.722 INFO:tasks.workunit.client.1.smithi172.stdout:0/176: dwrite d11/d14/f16 [0,4194304] 0 2024-03-19T06:05:23.723 INFO:tasks.workunit.client.1.smithi172.stdout:4/191: dwrite df/d11/f25 [4194304,4194304] 0 2024-03-19T06:05:23.723 INFO:tasks.workunit.client.1.smithi172.stdout:6/221: sync 2024-03-19T06:05:23.724 INFO:tasks.workunit.client.1.smithi172.stdout:7/157: write d0/d22/d1d/f38 [1298875,41368] 0 2024-03-19T06:05:23.726 INFO:tasks.workunit.client.1.smithi172.stdout:2/126: write d7/d1b/f1f [317986,48997] 0 2024-03-19T06:05:23.735 INFO:tasks.workunit.client.1.smithi172.stdout:6/222: creat d5/d11/d17/f3a x:0 0 0 2024-03-19T06:05:23.741 INFO:tasks.workunit.client.1.smithi172.stdout:2/127: rmdir d7 39 2024-03-19T06:05:23.743 INFO:tasks.workunit.client.1.smithi172.stdout:0/177: dread d11/f13 [0,4194304] 0 2024-03-19T06:05:23.743 INFO:tasks.workunit.client.1.smithi172.stdout:6/223: symlink d5/d2c/l3b 0 2024-03-19T06:05:23.744 INFO:tasks.workunit.client.1.smithi172.stdout:7/158: truncate d0/d22/d1d/d36/f13 3031082 0 2024-03-19T06:05:23.746 INFO:tasks.workunit.client.1.smithi172.stdout:4/192: write df/d11/d12/d21/f2a [4693618,128574] 0 2024-03-19T06:05:23.750 INFO:tasks.workunit.client.1.smithi172.stdout:1/228: dwrite da/dd/f1f [0,4194304] 0 2024-03-19T06:05:23.751 INFO:tasks.workunit.client.1.smithi172.stdout:6/224: write d5/fe [907666,128223] 0 2024-03-19T06:05:23.753 INFO:tasks.workunit.client.1.smithi172.stdout:2/128: creat d7/d1b/f20 x:0 0 0 2024-03-19T06:05:23.754 INFO:tasks.workunit.client.1.smithi172.stdout:7/159: creat d0/d2c/f3c x:0 0 0 2024-03-19T06:05:23.758 INFO:tasks.workunit.client.1.smithi172.stdout:9/148: dread d1/d7/dc/f15 [0,4194304] 0 2024-03-19T06:05:23.758 INFO:tasks.workunit.client.1.smithi172.stdout:1/229: rename da/dd/d31/d47 to da/dd/d31/d47/d49 22 2024-03-19T06:05:23.758 INFO:tasks.workunit.client.1.smithi172.stdout:6/225: write d5/f13 [321222,128399] 0 2024-03-19T06:05:23.759 INFO:tasks.workunit.client.1.smithi172.stdout:2/129: mknod d7/de/c21 0 2024-03-19T06:05:23.764 INFO:tasks.workunit.client.1.smithi172.stdout:1/230: chown da/dd/d10/d14/d27/l43 1 1 2024-03-19T06:05:23.765 INFO:tasks.workunit.client.1.smithi172.stdout:4/193: getdents df/d11 0 2024-03-19T06:05:23.768 INFO:tasks.workunit.client.1.smithi172.stdout:2/130: creat d7/d1b/f22 x:0 0 0 2024-03-19T06:05:23.768 INFO:tasks.workunit.client.1.smithi172.stdout:4/194: stat df/d11/l1c 0 2024-03-19T06:05:23.771 INFO:tasks.workunit.client.1.smithi172.stdout:1/231: write da/dd/d10/f2c [2667785,9832] 0 2024-03-19T06:05:23.771 INFO:tasks.workunit.client.1.smithi172.stdout:6/226: write d5/d16/f28 [4842735,116948] 0 2024-03-19T06:05:23.774 INFO:tasks.workunit.client.1.smithi172.stdout:1/232: chown da/c42 86 1 2024-03-19T06:05:23.776 INFO:tasks.workunit.client.1.smithi172.stdout:2/131: creat d7/db/f23 x:0 0 0 2024-03-19T06:05:23.782 INFO:tasks.workunit.client.1.smithi172.stdout:6/227: symlink d5/d11/d2f/l3c 0 2024-03-19T06:05:23.782 INFO:tasks.workunit.client.1.smithi172.stdout:5/159: sync 2024-03-19T06:05:23.787 INFO:tasks.workunit.client.1.smithi172.stdout:6/228: mkdir d5/d2c/d31/d3d 0 2024-03-19T06:05:23.788 INFO:tasks.workunit.client.1.smithi172.stdout:9/149: truncate d1/d7/dc/de/f1f 826842 0 2024-03-19T06:05:23.793 INFO:tasks.workunit.client.1.smithi172.stdout:9/150: fdatasync d1/fa 0 2024-03-19T06:05:23.793 INFO:tasks.workunit.client.1.smithi172.stdout:6/229: stat d5/d11/d35 0 2024-03-19T06:05:23.795 INFO:tasks.workunit.client.1.smithi172.stdout:5/160: rmdir d5/d1f/d2f/d38 0 2024-03-19T06:05:23.799 INFO:tasks.workunit.client.1.smithi172.stdout:9/151: dread - d1/d7/f2e zero size 2024-03-19T06:05:23.800 INFO:tasks.workunit.client.1.smithi172.stdout:5/161: unlink f2 0 2024-03-19T06:05:23.811 INFO:tasks.workunit.client.1.smithi172.stdout:5/162: write d5/d1f/f31 [769968,11789] 0 2024-03-19T06:05:23.813 INFO:tasks.workunit.client.1.smithi172.stdout:4/195: dwrite df/d11/f32 [0,4194304] 0 2024-03-19T06:05:23.818 INFO:tasks.workunit.client.1.smithi172.stdout:1/233: dwrite da/dd/d10/f2c [4194304,4194304] 0 2024-03-19T06:05:23.819 INFO:tasks.workunit.client.1.smithi172.stdout:4/196: chown df/d11/d12/c28 1544419279 1 2024-03-19T06:05:23.823 INFO:tasks.workunit.client.1.smithi172.stdout:0/178: dwrite f10 [0,4194304] 0 2024-03-19T06:05:23.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:23 smithi072 ceph-mon[28706]: pgmap v8: 65 pgs: 65 active+clean; 295 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 222 KiB/s rd, 14 MiB/s wr, 138 op/s 2024-03-19T06:05:23.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:23 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:23.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:23 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:23.829 INFO:tasks.workunit.client.1.smithi172.stdout:1/234: unlink da/l12 0 2024-03-19T06:05:23.829 INFO:tasks.workunit.client.1.smithi172.stdout:5/163: write d5/d1f/f2c [534353,78718] 0 2024-03-19T06:05:23.830 INFO:tasks.workunit.client.1.smithi172.stdout:7/160: dwrite d0/d22/d1d/d36/f23 [0,4194304] 0 2024-03-19T06:05:23.836 INFO:tasks.workunit.client.1.smithi172.stdout:4/197: rename df/d11/d12/f16 to df/d11/d12/d26/f35 0 2024-03-19T06:05:23.838 INFO:tasks.workunit.client.1.smithi172.stdout:9/152: getdents d1/d7/dc/d23 0 2024-03-19T06:05:23.840 INFO:tasks.workunit.client.1.smithi172.stdout:7/161: write d0/d22/d1d/d36/f39 [2664094,45537] 0 2024-03-19T06:05:23.840 INFO:tasks.workunit.client.1.smithi172.stdout:7/162: stat d0/l31 0 2024-03-19T06:05:23.843 INFO:tasks.workunit.client.1.smithi172.stdout:9/153: fsync d1/fa 0 2024-03-19T06:05:23.846 INFO:tasks.workunit.client.1.smithi172.stdout:9/154: readlink d1/d7/l3a 0 2024-03-19T06:05:23.848 INFO:tasks.workunit.client.1.smithi172.stdout:0/179: truncate f2 6419729 0 2024-03-19T06:05:23.850 INFO:tasks.workunit.client.1.smithi172.stdout:0/180: stat d11/d14/c2a 0 2024-03-19T06:05:23.855 INFO:tasks.workunit.client.1.smithi172.stdout:7/163: getdents d0/d22/d35 0 2024-03-19T06:05:23.855 INFO:tasks.workunit.client.1.smithi172.stdout:0/181: truncate d11/d22/f34 324976 0 2024-03-19T06:05:23.855 INFO:tasks.workunit.client.1.smithi172.stdout:0/182: write d11/f12 [50246,22120] 0 2024-03-19T06:05:23.856 INFO:tasks.workunit.client.1.smithi172.stdout:6/230: dread d5/fa [0,4194304] 0 2024-03-19T06:05:23.862 INFO:tasks.workunit.client.1.smithi172.stdout:1/235: dread da/dd/d10/d14/f35 [0,4194304] 0 2024-03-19T06:05:23.866 INFO:tasks.workunit.client.1.smithi172.stdout:6/231: creat d5/d11/d17/f3e x:0 0 0 2024-03-19T06:05:23.874 INFO:tasks.workunit.client.1.smithi172.stdout:6/232: chown d5/d16/c32 0 1 2024-03-19T06:05:23.875 INFO:tasks.workunit.client.1.smithi172.stdout:1/236: mknod da/d33/c4a 0 2024-03-19T06:05:23.885 INFO:tasks.workunit.client.1.smithi172.stdout:5/164: dwrite d5/f1d [0,4194304] 0 2024-03-19T06:05:23.886 INFO:tasks.workunit.client.1.smithi172.stdout:6/233: mknod d5/d16/c3f 0 2024-03-19T06:05:23.888 INFO:tasks.workunit.client.1.smithi172.stdout:0/183: link d11/d14/l17 d11/d14/d2c/d36/l37 0 2024-03-19T06:05:23.889 INFO:tasks.workunit.client.1.smithi172.stdout:1/237: chown da/f20 1427 1 2024-03-19T06:05:23.901 INFO:tasks.workunit.client.1.smithi172.stdout:0/184: mkdir d11/d18/d38 0 2024-03-19T06:05:23.901 INFO:tasks.workunit.client.1.smithi172.stdout:4/198: dwrite fb [4194304,4194304] 0 2024-03-19T06:05:23.901 INFO:tasks.workunit.client.1.smithi172.stdout:6/234: dread - d5/d11/d17/f3a zero size 2024-03-19T06:05:23.901 INFO:tasks.workunit.client.1.smithi172.stdout:5/165: creat d5/d14/d34/f3a x:0 0 0 2024-03-19T06:05:23.901 INFO:tasks.workunit.client.1.smithi172.stdout:0/185: chown d11/d14/l23 86472132 1 2024-03-19T06:05:23.910 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:23 smithi172 ceph-mon[35716]: pgmap v8: 65 pgs: 65 active+clean; 295 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 222 KiB/s rd, 14 MiB/s wr, 138 op/s 2024-03-19T06:05:23.910 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:23 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:23.911 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:23 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:23.911 INFO:tasks.workunit.client.1.smithi172.stdout:5/166: write d5/d1f/f2c [734406,22851] 0 2024-03-19T06:05:23.911 INFO:tasks.workunit.client.1.smithi172.stdout:4/199: write fb [2697527,85844] 0 2024-03-19T06:05:23.911 INFO:tasks.workunit.client.1.smithi172.stdout:1/238: write da/dd/d10/f1d [2250272,84707] 0 2024-03-19T06:05:23.913 INFO:tasks.workunit.client.1.smithi172.stdout:7/164: dwrite d0/d22/d1d/d36/f23 [0,4194304] 0 2024-03-19T06:05:23.917 INFO:tasks.workunit.client.1.smithi172.stdout:4/200: stat df/d11/d12/c1f 0 2024-03-19T06:05:23.917 INFO:tasks.workunit.client.1.smithi172.stdout:6/235: write d5/d11/d2f/f38 [619558,43283] 0 2024-03-19T06:05:23.918 INFO:tasks.workunit.client.1.smithi172.stdout:5/167: fdatasync d5/d14/f19 0 2024-03-19T06:05:23.921 INFO:tasks.workunit.client.1.smithi172.stdout:7/165: read - d0/d2c/f3c zero size 2024-03-19T06:05:23.924 INFO:tasks.workunit.client.1.smithi172.stdout:9/155: dwrite d1/d7/dc/d31/f35 [0,4194304] 0 2024-03-19T06:05:23.925 INFO:tasks.workunit.client.1.smithi172.stdout:7/166: fsync d0/d22/f1b 0 2024-03-19T06:05:23.927 INFO:tasks.workunit.client.1.smithi172.stdout:7/167: readlink d0/l20 0 2024-03-19T06:05:23.929 INFO:tasks.workunit.client.1.smithi172.stdout:5/168: stat d5/f36 0 2024-03-19T06:05:23.929 INFO:tasks.workunit.client.1.smithi172.stdout:6/236: write d5/fa [1273083,72000] 0 2024-03-19T06:05:23.931 INFO:tasks.workunit.client.1.smithi172.stdout:5/169: write d5/d14/f22 [1306239,43273] 0 2024-03-19T06:05:23.933 INFO:tasks.workunit.client.1.smithi172.stdout:4/201: mknod df/d11/c36 0 2024-03-19T06:05:23.934 INFO:tasks.workunit.client.1.smithi172.stdout:0/186: symlink d11/d18/d38/l39 0 2024-03-19T06:05:23.936 INFO:tasks.workunit.client.1.smithi172.stdout:0/187: chown d11/d22/d32 912 1 2024-03-19T06:05:23.937 INFO:tasks.workunit.client.1.smithi172.stdout:5/170: creat d5/d14/f3b x:0 0 0 2024-03-19T06:05:23.938 INFO:tasks.workunit.client.1.smithi172.stdout:0/188: readlink d11/d14/l23 0 2024-03-19T06:05:23.938 INFO:tasks.workunit.client.1.smithi172.stdout:6/237: mkdir d5/d11/d35/d40 0 2024-03-19T06:05:23.940 INFO:tasks.workunit.client.1.smithi172.stdout:9/156: fsync d1/d7/dc/de/f1f 0 2024-03-19T06:05:23.945 INFO:tasks.workunit.client.1.smithi172.stdout:0/189: mknod d11/d14/d2c/d36/c3a 0 2024-03-19T06:05:23.949 INFO:tasks.workunit.client.1.smithi172.stdout:0/190: read f7 [25289,52964] 0 2024-03-19T06:05:23.950 INFO:tasks.workunit.client.1.smithi172.stdout:9/157: mknod d1/d7/dc/de/c3b 0 2024-03-19T06:05:23.953 INFO:tasks.workunit.client.1.smithi172.stdout:0/191: dread - d11/d18/f2f zero size 2024-03-19T06:05:23.953 INFO:tasks.workunit.client.1.smithi172.stdout:1/239: dwrite da/dd/d10/f1d [0,4194304] 0 2024-03-19T06:05:23.964 INFO:tasks.workunit.client.1.smithi172.stdout:0/192: read d11/f12 [164887,8959] 0 2024-03-19T06:05:23.966 INFO:tasks.workunit.client.1.smithi172.stdout:9/158: link d1/d7/dc/f15 d1/d7/dc/d23/f3c 0 2024-03-19T06:05:23.966 INFO:tasks.workunit.client.1.smithi172.stdout:0/193: stat d11 0 2024-03-19T06:05:23.968 INFO:tasks.workunit.client.1.smithi172.stdout:3/186: sync 2024-03-19T06:05:23.968 INFO:tasks.workunit.client.1.smithi172.stdout:8/144: sync 2024-03-19T06:05:23.969 INFO:tasks.workunit.client.1.smithi172.stdout:7/168: dwrite d0/d22/d1d/d36/f23 [0,4194304] 0 2024-03-19T06:05:23.974 INFO:tasks.workunit.client.1.smithi172.stdout:8/145: chown d0/d17/d26 29008827 1 2024-03-19T06:05:23.976 INFO:tasks.workunit.client.1.smithi172.stdout:3/187: truncate d0/fe 155734 0 2024-03-19T06:05:23.978 INFO:tasks.workunit.client.1.smithi172.stdout:8/146: chown d0/f3 5707153 1 2024-03-19T06:05:23.978 INFO:tasks.workunit.client.1.smithi172.stdout:7/169: mkdir d0/d22/d3d 0 2024-03-19T06:05:23.979 INFO:tasks.workunit.client.1.smithi172.stdout:8/147: stat d0/f12 0 2024-03-19T06:05:24.031 INFO:tasks.workunit.client.1.smithi172.stdout:3/188: write d0/d5/f23 [3754373,119387] 0 2024-03-19T06:05:24.032 INFO:tasks.workunit.client.1.smithi172.stdout:8/148: fdatasync d0/fd 0 2024-03-19T06:05:24.032 INFO:tasks.workunit.client.1.smithi172.stdout:6/238: rmdir d5/d11 39 2024-03-19T06:05:24.033 INFO:tasks.workunit.client.1.smithi172.stdout:9/159: rmdir d1/d7/dc/de 39 2024-03-19T06:05:24.036 INFO:tasks.workunit.client.1.smithi172.stdout:8/149: write d0/d17/f25 [519045,17405] 0 2024-03-19T06:05:24.036 INFO:tasks.workunit.client.1.smithi172.stdout:3/189: symlink d0/d5/d9/l48 0 2024-03-19T06:05:24.037 INFO:tasks.workunit.client.1.smithi172.stdout:4/202: unlink df/d11/f19 0 2024-03-19T06:05:24.040 INFO:tasks.workunit.client.1.smithi172.stdout:6/239: truncate d5/d16/f18 1629601 0 2024-03-19T06:05:24.041 INFO:tasks.workunit.client.1.smithi172.stdout:9/160: mkdir d1/d3d 0 2024-03-19T06:05:24.043 INFO:tasks.workunit.client.1.smithi172.stdout:5/171: dread d5/f18 [0,4194304] 0 2024-03-19T06:05:24.043 INFO:tasks.workunit.client.1.smithi172.stdout:6/240: truncate d5/f37 640672 0 2024-03-19T06:05:24.043 INFO:tasks.workunit.client.1.smithi172.stdout:3/190: rename d0/d5/f35 to d0/d24/f49 0 2024-03-19T06:05:24.044 INFO:tasks.workunit.client.1.smithi172.stdout:8/150: dread d0/f1f [0,4194304] 0 2024-03-19T06:05:24.044 INFO:tasks.workunit.client.1.smithi172.stdout:5/172: chown d5/d1f 6 1 2024-03-19T06:05:24.045 INFO:tasks.workunit.client.1.smithi172.stdout:3/191: fdatasync d0/d5/d9/d3a/f3f 0 2024-03-19T06:05:24.046 INFO:tasks.workunit.client.1.smithi172.stdout:4/203: creat df/d11/f37 x:0 0 0 2024-03-19T06:05:24.049 INFO:tasks.workunit.client.1.smithi172.stdout:6/241: mknod d5/d16/c41 0 2024-03-19T06:05:24.050 INFO:tasks.workunit.client.1.smithi172.stdout:8/151: dread d0/f1f [0,4194304] 0 2024-03-19T06:05:24.052 INFO:tasks.workunit.client.1.smithi172.stdout:3/192: fsync d0/f4 0 2024-03-19T06:05:24.054 INFO:tasks.workunit.client.1.smithi172.stdout:8/152: read d0/f2 [72641,125310] 0 2024-03-19T06:05:24.059 INFO:tasks.workunit.client.1.smithi172.stdout:4/204: getdents df/d11/d12/d34 0 2024-03-19T06:05:24.059 INFO:tasks.workunit.client.1.smithi172.stdout:3/193: creat d0/d24/f4a x:0 0 0 2024-03-19T06:05:24.062 INFO:tasks.workunit.client.1.smithi172.stdout:8/153: mkdir d0/d10/d2b 0 2024-03-19T06:05:24.066 INFO:tasks.workunit.client.1.smithi172.stdout:5/173: dwrite d5/d1f/f2a [0,4194304] 0 2024-03-19T06:05:24.069 INFO:tasks.workunit.client.1.smithi172.stdout:5/174: chown d5/d1f/c2d 1018 1 2024-03-19T06:05:24.070 INFO:tasks.workunit.client.1.smithi172.stdout:3/194: dread d0/fe [0,4194304] 0 2024-03-19T06:05:24.071 INFO:tasks.workunit.client.1.smithi172.stdout:5/175: chown d5/d1f/l2e 0 1 2024-03-19T06:05:24.074 INFO:tasks.workunit.client.1.smithi172.stdout:3/195: symlink d0/d5/d9/d25/d21/l4b 0 2024-03-19T06:05:24.077 INFO:tasks.workunit.client.1.smithi172.stdout:5/176: mkdir d5/d3c 0 2024-03-19T06:05:24.081 INFO:tasks.workunit.client.1.smithi172.stdout:6/242: dread d5/d16/f18 [0,4194304] 0 2024-03-19T06:05:24.084 INFO:tasks.workunit.client.1.smithi172.stdout:9/161: dread d1/d7/dc/d23/f33 [0,4194304] 0 2024-03-19T06:05:24.084 INFO:tasks.workunit.client.1.smithi172.stdout:6/243: chown d5/d16 290047090 1 2024-03-19T06:05:24.086 INFO:tasks.workunit.client.1.smithi172.stdout:3/196: mknod d0/d5/d9/c4c 0 2024-03-19T06:05:24.087 INFO:tasks.workunit.client.1.smithi172.stdout:5/177: mkdir d5/d3d 0 2024-03-19T06:05:24.088 INFO:tasks.workunit.client.1.smithi172.stdout:8/154: dwrite d0/d10/d27/f1e [0,4194304] 0 2024-03-19T06:05:24.088 INFO:tasks.workunit.client.1.smithi172.stdout:9/162: chown d1/d7/dc/d23/f3c 3985 1 2024-03-19T06:05:24.091 INFO:tasks.workunit.client.1.smithi172.stdout:3/197: dread - d0/f12 zero size 2024-03-19T06:05:24.093 INFO:tasks.workunit.client.1.smithi172.stdout:5/178: write d5/ff [2349024,112879] 0 2024-03-19T06:05:24.094 INFO:tasks.workunit.client.1.smithi172.stdout:6/244: creat d5/d11/d35/f42 x:0 0 0 2024-03-19T06:05:24.094 INFO:tasks.workunit.client.1.smithi172.stdout:8/155: dread d0/d17/f21 [0,4194304] 0 2024-03-19T06:05:24.096 INFO:tasks.workunit.client.1.smithi172.stdout:3/198: readlink d0/d5/d9/d25/d21/l2f 0 2024-03-19T06:05:24.098 INFO:tasks.workunit.client.1.smithi172.stdout:3/199: chown d0/d5/d14/f16 62823 1 2024-03-19T06:05:24.098 INFO:tasks.workunit.client.1.smithi172.stdout:4/205: dread df/d11/f1d [0,4194304] 0 2024-03-19T06:05:24.100 INFO:tasks.workunit.client.1.smithi172.stdout:3/200: stat d0/d5/d9/d25/d21/l2f 0 2024-03-19T06:05:24.100 INFO:tasks.workunit.client.1.smithi172.stdout:8/156: fdatasync d0/f3 0 2024-03-19T06:05:24.104 INFO:tasks.workunit.client.1.smithi172.stdout:8/157: fsync d0/d17/f25 0 2024-03-19T06:05:24.108 INFO:tasks.workunit.client.1.smithi172.stdout:3/201: chown d0/d5/d14/f17 1550033590 1 2024-03-19T06:05:24.108 INFO:tasks.workunit.client.1.smithi172.stdout:5/179: creat d5/d14/d34/f3e x:0 0 0 2024-03-19T06:05:24.109 INFO:tasks.workunit.client.1.smithi172.stdout:8/158: readlink d0/l4 0 2024-03-19T06:05:24.109 INFO:tasks.workunit.client.1.smithi172.stdout:5/180: readlink l1 0 2024-03-19T06:05:24.111 INFO:tasks.workunit.client.1.smithi172.stdout:4/206: creat df/d2b/d2d/f38 x:0 0 0 2024-03-19T06:05:24.115 INFO:tasks.workunit.client.1.smithi172.stdout:3/202: write d0/d24/f4a [215878,72144] 0 2024-03-19T06:05:24.117 INFO:tasks.workunit.client.1.smithi172.stdout:9/163: write d1/d7/dc/d23/f3c [595785,83180] 0 2024-03-19T06:05:24.117 INFO:tasks.workunit.client.1.smithi172.stdout:6/245: write d5/f8 [2961791,16462] 0 2024-03-19T06:05:24.123 INFO:tasks.workunit.client.1.smithi172.stdout:4/207: creat df/d11/d12/d34/f39 x:0 0 0 2024-03-19T06:05:24.123 INFO:tasks.workunit.client.1.smithi172.stdout:9/164: write d1/f28 [330883,45556] 0 2024-03-19T06:05:24.126 INFO:tasks.workunit.client.1.smithi172.stdout:6/246: truncate d5/d16/f18 1548215 0 2024-03-19T06:05:24.131 INFO:tasks.workunit.client.1.smithi172.stdout:6/247: chown d5/c2e 20330 1 2024-03-19T06:05:24.140 INFO:tasks.workunit.client.1.smithi172.stdout:2/132: sync 2024-03-19T06:05:24.146 INFO:tasks.workunit.client.1.smithi172.stdout:6/248: mkdir d5/d11/d43 0 2024-03-19T06:05:24.154 INFO:tasks.workunit.client.1.smithi172.stdout:2/133: dread f6 [0,4194304] 0 2024-03-19T06:05:24.158 INFO:tasks.workunit.client.1.smithi172.stdout:5/181: dwrite d5/d14/d34/f3a [0,4194304] 0 2024-03-19T06:05:24.159 INFO:tasks.workunit.client.1.smithi172.stdout:8/159: dwrite d0/f1 [0,4194304] 0 2024-03-19T06:05:24.161 INFO:tasks.workunit.client.1.smithi172.stdout:8/160: dread - d0/d17/f2a zero size 2024-03-19T06:05:24.164 INFO:tasks.workunit.client.1.smithi172.stdout:6/249: dread d5/f19 [0,4194304] 0 2024-03-19T06:05:24.170 INFO:tasks.workunit.client.1.smithi172.stdout:2/134: creat d7/db/f24 x:0 0 0 2024-03-19T06:05:24.170 INFO:tasks.workunit.client.1.smithi172.stdout:5/182: chown d5/d14/f3b 359 1 2024-03-19T06:05:24.171 INFO:tasks.workunit.client.1.smithi172.stdout:3/203: dread d0/d5/f26 [0,4194304] 0 2024-03-19T06:05:24.171 INFO:tasks.workunit.client.1.smithi172.stdout:6/250: chown d5/d11/d43 18987 1 2024-03-19T06:05:24.171 INFO:tasks.workunit.client.1.smithi172.stdout:9/165: dwrite d1/d7/dc/de/f1f [0,4194304] 0 2024-03-19T06:05:24.173 INFO:tasks.workunit.client.1.smithi172.stdout:8/161: dread d0/f3 [0,4194304] 0 2024-03-19T06:05:24.177 INFO:tasks.workunit.client.1.smithi172.stdout:2/135: truncate d7/db/f1a 1608530 0 2024-03-19T06:05:24.187 INFO:tasks.workunit.client.1.smithi172.stdout:6/251: mknod d5/d11/d43/c44 0 2024-03-19T06:05:24.187 INFO:tasks.workunit.client.1.smithi172.stdout:8/162: symlink d0/d10/d2b/l2c 0 2024-03-19T06:05:24.188 INFO:tasks.workunit.client.1.smithi172.stdout:2/136: write f3 [4425687,122117] 0 2024-03-19T06:05:24.195 INFO:tasks.workunit.client.1.smithi172.stdout:6/252: mkdir d5/d11/d43/d45 0 2024-03-19T06:05:24.196 INFO:tasks.workunit.client.1.smithi172.stdout:8/163: chown d0/d17/f21 11 1 2024-03-19T06:05:24.196 INFO:tasks.workunit.client.1.smithi172.stdout:2/137: rename d7/c9 to d7/db/c25 0 2024-03-19T06:05:24.201 INFO:tasks.workunit.client.1.smithi172.stdout:5/183: dwrite d5/d14/d34/f3a [0,4194304] 0 2024-03-19T06:05:24.204 INFO:tasks.workunit.client.1.smithi172.stdout:5/184: write d5/f36 [56879,93362] 0 2024-03-19T06:05:24.204 INFO:tasks.workunit.client.1.smithi172.stdout:8/164: creat d0/f2d x:0 0 0 2024-03-19T06:05:24.205 INFO:tasks.workunit.client.1.smithi172.stdout:8/165: dread - d0/f2d zero size 2024-03-19T06:05:24.207 INFO:tasks.workunit.client.1.smithi172.stdout:6/253: symlink d5/d11/l46 0 2024-03-19T06:05:24.207 INFO:tasks.workunit.client.1.smithi172.stdout:9/166: dwrite d1/d7/dc/d31/f35 [0,4194304] 0 2024-03-19T06:05:24.211 INFO:tasks.workunit.client.1.smithi172.stdout:5/185: creat d5/d14/d34/f3f x:0 0 0 2024-03-19T06:05:24.211 INFO:tasks.workunit.client.1.smithi172.stdout:2/138: creat d7/f26 x:0 0 0 2024-03-19T06:05:24.212 INFO:tasks.workunit.client.1.smithi172.stdout:8/166: creat d0/d10/d27/f2e x:0 0 0 2024-03-19T06:05:24.215 INFO:tasks.workunit.client.1.smithi172.stdout:9/167: rmdir d1 39 2024-03-19T06:05:24.216 INFO:tasks.workunit.client.1.smithi172.stdout:6/254: symlink d5/d11/d35/l47 0 2024-03-19T06:05:24.218 INFO:tasks.workunit.client.1.smithi172.stdout:6/255: chown d5/d11 178251840 1 2024-03-19T06:05:24.220 INFO:tasks.workunit.client.1.smithi172.stdout:6/256: fsync d5/d11/d17/f3e 0 2024-03-19T06:05:24.223 INFO:tasks.workunit.client.1.smithi172.stdout:9/168: truncate d1/d7/dc/d31/f35 4822149 0 2024-03-19T06:05:24.229 INFO:tasks.workunit.client.1.smithi172.stdout:6/257: mkdir d5/d11/d17/d36/d48 0 2024-03-19T06:05:24.232 INFO:tasks.workunit.client.1.smithi172.stdout:9/169: symlink d1/d7/dc/d31/l3e 0 2024-03-19T06:05:24.237 INFO:tasks.workunit.client.1.smithi172.stdout:6/258: write d5/f6 [2369737,88990] 0 2024-03-19T06:05:24.237 INFO:tasks.workunit.client.1.smithi172.stdout:3/204: dread d0/d24/f31 [0,4194304] 0 2024-03-19T06:05:24.240 INFO:tasks.workunit.client.1.smithi172.stdout:2/139: dread d7/db/f16 [0,4194304] 0 2024-03-19T06:05:24.240 INFO:tasks.workunit.client.1.smithi172.stdout:9/170: symlink d1/d7/dc/l3f 0 2024-03-19T06:05:24.242 INFO:tasks.workunit.client.1.smithi172.stdout:6/259: dread - d5/d11/d17/f3e zero size 2024-03-19T06:05:24.244 INFO:tasks.workunit.client.1.smithi172.stdout:2/140: chown d7/db/f1a 867391 1 2024-03-19T06:05:24.246 INFO:tasks.workunit.client.1.smithi172.stdout:5/186: dwrite d5/fb [0,4194304] 0 2024-03-19T06:05:24.248 INFO:tasks.workunit.client.1.smithi172.stdout:3/205: rename d0/d24 to d0/d5/d9/d34/d4d 0 2024-03-19T06:05:24.249 INFO:tasks.workunit.client.1.smithi172.stdout:2/141: chown d7/db/f1d 61499 1 2024-03-19T06:05:24.249 INFO:tasks.workunit.client.1.smithi172.stdout:6/260: rmdir d5/d11 39 2024-03-19T06:05:24.249 INFO:tasks.workunit.client.1.smithi172.stdout:9/171: write d1/d7/dc/de/f1d [2553969,15926] 0 2024-03-19T06:05:24.250 INFO:tasks.workunit.client.1.smithi172.stdout:5/187: chown d5/ff 4 1 2024-03-19T06:05:24.256 INFO:tasks.workunit.client.1.smithi172.stdout:5/188: mkdir d5/d14/d15/d40 0 2024-03-19T06:05:24.258 INFO:tasks.workunit.client.1.smithi172.stdout:9/172: write d1/f6 [1355104,83020] 0 2024-03-19T06:05:24.259 INFO:tasks.workunit.client.1.smithi172.stdout:9/173: write d1/f6 [389014,40792] 0 2024-03-19T06:05:24.260 INFO:tasks.workunit.client.1.smithi172.stdout:3/206: symlink d0/l4e 0 2024-03-19T06:05:24.260 INFO:tasks.workunit.client.1.smithi172.stdout:5/189: symlink d5/d14/l41 0 2024-03-19T06:05:24.262 INFO:tasks.workunit.client.1.smithi172.stdout:5/190: write d5/ff [3717445,23657] 0 2024-03-19T06:05:24.274 INFO:tasks.workunit.client.1.smithi172.stdout:6/261: dwrite d5/d11/d17/f3a [0,4194304] 0 2024-03-19T06:05:24.277 INFO:tasks.workunit.client.1.smithi172.stdout:5/191: getdents d5/d14 0 2024-03-19T06:05:24.280 INFO:tasks.workunit.client.1.smithi172.stdout:9/174: dwrite d1/d7/dc/d23/f2c [0,4194304] 0 2024-03-19T06:05:24.286 INFO:tasks.workunit.client.1.smithi172.stdout:6/262: dread d5/d11/d2f/f38 [0,4194304] 0 2024-03-19T06:05:24.286 INFO:tasks.workunit.client.1.smithi172.stdout:9/175: symlink d1/l40 0 2024-03-19T06:05:24.289 INFO:tasks.workunit.client.1.smithi172.stdout:6/263: rmdir d5/d2c 39 2024-03-19T06:05:24.291 INFO:tasks.workunit.client.1.smithi172.stdout:6/264: mknod d5/d11/d43/c49 0 2024-03-19T06:05:24.294 INFO:tasks.workunit.client.1.smithi172.stdout:6/265: symlink d5/d11/d2f/l4a 0 2024-03-19T06:05:24.302 INFO:tasks.workunit.client.1.smithi172.stdout:9/176: dwrite d1/d7/dc/f14 [0,4194304] 0 2024-03-19T06:05:24.304 INFO:tasks.workunit.client.1.smithi172.stdout:9/177: chown d1/d7/dc/d23/f33 6378 1 2024-03-19T06:05:24.309 INFO:tasks.workunit.client.1.smithi172.stdout:9/178: creat d1/d7/dc/de/d34/f41 x:0 0 0 2024-03-19T06:05:24.320 INFO:tasks.workunit.client.1.smithi172.stdout:6/266: dread d5/f8 [0,4194304] 0 2024-03-19T06:05:24.321 INFO:tasks.workunit.client.1.smithi172.stdout:6/267: chown d5/d16/c3f 24 1 2024-03-19T06:05:24.322 INFO:tasks.workunit.client.1.smithi172.stdout:9/179: dread d1/d7/dc/f14 [0,4194304] 0 2024-03-19T06:05:24.326 INFO:tasks.workunit.client.1.smithi172.stdout:6/268: creat d5/d11/f4b x:0 0 0 2024-03-19T06:05:24.329 INFO:tasks.workunit.client.1.smithi172.stdout:1/240: sync 2024-03-19T06:05:24.330 INFO:tasks.workunit.client.1.smithi172.stdout:6/269: creat d5/d11/d43/f4c x:0 0 0 2024-03-19T06:05:24.333 INFO:tasks.workunit.client.1.smithi172.stdout:1/241: chown da/dd/d10/f29 10 1 2024-03-19T06:05:24.334 INFO:tasks.workunit.client.1.smithi172.stdout:6/270: link d5/f8 d5/d11/d43/f4d 0 2024-03-19T06:05:24.337 INFO:tasks.workunit.client.1.smithi172.stdout:6/271: symlink d5/d11/d2f/l4e 0 2024-03-19T06:05:24.339 INFO:tasks.workunit.client.1.smithi172.stdout:6/272: chown d5/d11/d43/c49 0 1 2024-03-19T06:05:24.344 INFO:tasks.workunit.client.1.smithi172.stdout:6/273: mknod d5/d2c/c4f 0 2024-03-19T06:05:24.350 INFO:tasks.workunit.client.1.smithi172.stdout:1/242: dwrite da/dd/d31/f40 [0,4194304] 0 2024-03-19T06:05:24.353 INFO:tasks.workunit.client.1.smithi172.stdout:1/243: write da/d3b/f3d [901719,86242] 0 2024-03-19T06:05:24.356 INFO:tasks.workunit.client.1.smithi172.stdout:1/244: chown da/d33/c4a 15 1 2024-03-19T06:05:24.361 INFO:tasks.workunit.client.1.smithi172.stdout:6/274: dread d5/d11/d17/d1b/f25 [0,4194304] 0 2024-03-19T06:05:24.364 INFO:tasks.workunit.client.1.smithi172.stdout:6/275: mknod d5/d11/d43/c50 0 2024-03-19T06:05:24.378 INFO:tasks.workunit.client.1.smithi172.stdout:1/245: dwrite da/dd/d10/f24 [0,4194304] 0 2024-03-19T06:05:24.384 INFO:tasks.workunit.client.1.smithi172.stdout:1/246: mknod da/dd/c4b 0 2024-03-19T06:05:24.385 INFO:tasks.workunit.client.1.smithi172.stdout:6/276: dwrite d5/f13 [0,4194304] 0 2024-03-19T06:05:24.394 INFO:tasks.workunit.client.1.smithi172.stdout:6/277: dread d5/f33 [0,4194304] 0 2024-03-19T06:05:24.399 INFO:tasks.workunit.client.1.smithi172.stdout:6/278: mknod d5/c51 0 2024-03-19T06:05:24.401 INFO:tasks.workunit.client.1.smithi172.stdout:6/279: mknod d5/d2c/c52 0 2024-03-19T06:05:24.404 INFO:tasks.workunit.client.1.smithi172.stdout:6/280: mkdir d5/d11/d35/d40/d53 0 2024-03-19T06:05:24.407 INFO:tasks.workunit.client.1.smithi172.stdout:6/281: creat d5/d2c/d31/d3d/f54 x:0 0 0 2024-03-19T06:05:24.409 INFO:tasks.workunit.client.1.smithi172.stdout:6/282: chown d5/d11/c23 5810 1 2024-03-19T06:05:24.420 INFO:tasks.workunit.client.1.smithi172.stdout:6/283: dread d5/f6 [0,4194304] 0 2024-03-19T06:05:24.433 INFO:tasks.workunit.client.1.smithi172.stdout:6/284: dwrite d5/fb [4194304,4194304] 0 2024-03-19T06:05:24.440 INFO:tasks.workunit.client.1.smithi172.stdout:6/285: link d5/d11/d2f/l4e d5/d2c/l55 0 2024-03-19T06:05:24.444 INFO:tasks.workunit.client.1.smithi172.stdout:6/286: rename d5/d16/f28 to d5/d11/d17/d1b/f56 0 2024-03-19T06:05:24.469 INFO:tasks.workunit.client.1.smithi172.stdout:6/287: dwrite d5/d11/d43/f4d [0,4194304] 0 2024-03-19T06:05:24.477 INFO:tasks.workunit.client.1.smithi172.stdout:6/288: unlink d5/d16/c32 0 2024-03-19T06:05:24.480 INFO:tasks.workunit.client.1.smithi172.stdout:6/289: write d5/f19 [188032,14738] 0 2024-03-19T06:05:24.486 INFO:tasks.workunit.client.1.smithi172.stdout:6/290: unlink d5/f1d 0 2024-03-19T06:05:24.501 INFO:tasks.workunit.client.1.smithi172.stdout:6/291: dwrite d5/d2c/d31/d3d/f54 [0,4194304] 0 2024-03-19T06:05:24.506 INFO:tasks.workunit.client.1.smithi172.stdout:6/292: rename d5/f6 to d5/d2c/d31/f57 0 2024-03-19T06:05:24.510 INFO:tasks.workunit.client.1.smithi172.stdout:6/293: fsync d5/d11/d17/d1b/f56 0 2024-03-19T06:05:24.514 INFO:tasks.workunit.client.1.smithi172.stdout:6/294: symlink d5/d11/d35/d40/d53/l58 0 2024-03-19T06:05:24.515 INFO:tasks.workunit.client.1.smithi172.stdout:6/295: stat d5/d11/c39 0 2024-03-19T06:05:24.517 INFO:tasks.workunit.client.1.smithi172.stdout:4/208: sync 2024-03-19T06:05:24.517 INFO:tasks.workunit.client.1.smithi172.stdout:0/194: sync 2024-03-19T06:05:24.517 INFO:tasks.workunit.client.1.smithi172.stdout:7/170: sync 2024-03-19T06:05:24.518 INFO:tasks.workunit.client.1.smithi172.stdout:6/296: symlink d5/l59 0 2024-03-19T06:05:24.520 INFO:tasks.workunit.client.1.smithi172.stdout:4/209: symlink df/d11/d12/l3a 0 2024-03-19T06:05:24.524 INFO:tasks.workunit.client.1.smithi172.stdout:0/195: symlink d11/d14/l3b 0 2024-03-19T06:05:24.526 INFO:tasks.workunit.client.1.smithi172.stdout:0/196: chown f7 0 1 2024-03-19T06:05:24.526 INFO:tasks.workunit.client.1.smithi172.stdout:6/297: dread d5/fa [0,4194304] 0 2024-03-19T06:05:24.526 INFO:tasks.workunit.client.1.smithi172.stdout:7/171: dread d0/d22/f26 [0,4194304] 0 2024-03-19T06:05:24.528 INFO:tasks.workunit.client.1.smithi172.stdout:6/298: chown d5/d11/d17/d36 396422 1 2024-03-19T06:05:24.529 INFO:tasks.workunit.client.1.smithi172.stdout:0/197: rmdir d11/d14/d2c/d36 39 2024-03-19T06:05:24.529 INFO:tasks.workunit.client.1.smithi172.stdout:6/299: chown d5/d11/f4b 193248 1 2024-03-19T06:05:24.530 INFO:tasks.workunit.client.1.smithi172.stdout:7/172: creat d0/d22/d27/f3e x:0 0 0 2024-03-19T06:05:24.532 INFO:tasks.workunit.client.1.smithi172.stdout:0/198: mkdir d11/d14/d2c/d3c 0 2024-03-19T06:05:24.532 INFO:tasks.workunit.client.1.smithi172.stdout:7/173: write d0/d22/f1e [4657137,115261] 0 2024-03-19T06:05:24.533 INFO:tasks.workunit.client.1.smithi172.stdout:6/300: creat d5/d2c/d31/f5a x:0 0 0 2024-03-19T06:05:24.535 INFO:tasks.workunit.client.1.smithi172.stdout:0/199: creat d11/d22/f3d x:0 0 0 2024-03-19T06:05:24.537 INFO:tasks.workunit.client.1.smithi172.stdout:6/301: write d5/d2c/d31/f5a [747467,35359] 0 2024-03-19T06:05:24.538 INFO:tasks.workunit.client.1.smithi172.stdout:0/200: rmdir d11/d18/d38 39 2024-03-19T06:05:24.541 INFO:tasks.workunit.client.1.smithi172.stdout:6/302: write d5/d11/d17/f3e [592458,71643] 0 2024-03-19T06:05:24.542 INFO:tasks.workunit.client.1.smithi172.stdout:0/201: chown l9 4 1 2024-03-19T06:05:24.543 INFO:tasks.workunit.client.1.smithi172.stdout:4/210: dwrite df/d11/f1d [0,4194304] 0 2024-03-19T06:05:24.547 INFO:tasks.workunit.client.1.smithi172.stdout:6/303: mknod d5/d11/d2f/c5b 0 2024-03-19T06:05:24.550 INFO:tasks.workunit.client.1.smithi172.stdout:6/304: chown d5/d16 631 1 2024-03-19T06:05:24.551 INFO:tasks.workunit.client.1.smithi172.stdout:4/211: creat df/d2b/f3b x:0 0 0 2024-03-19T06:05:24.552 INFO:tasks.workunit.client.1.smithi172.stdout:6/305: dread - d5/d11/d43/f4c zero size 2024-03-19T06:05:24.553 INFO:tasks.workunit.client.1.smithi172.stdout:6/306: chown d5/d11/d17/f3a 1958103 1 2024-03-19T06:05:24.561 INFO:tasks.workunit.client.1.smithi172.stdout:6/307: creat d5/d11/d43/d45/f5c x:0 0 0 2024-03-19T06:05:24.563 INFO:tasks.workunit.client.1.smithi172.stdout:6/308: truncate d5/f37 703657 0 2024-03-19T06:05:24.566 INFO:tasks.workunit.client.1.smithi172.stdout:7/174: dread d0/d22/d1d/d36/ff [0,4194304] 0 2024-03-19T06:05:24.566 INFO:tasks.workunit.client.1.smithi172.stdout:6/309: read - d5/d11/d43/d45/f5c zero size 2024-03-19T06:05:24.569 INFO:tasks.workunit.client.1.smithi172.stdout:6/310: fdatasync d5/d11/d17/f3a 0 2024-03-19T06:05:24.572 INFO:tasks.workunit.client.1.smithi172.stdout:7/175: write d0/d22/d1d/d36/f39 [3052728,23733] 0 2024-03-19T06:05:24.574 INFO:tasks.workunit.client.1.smithi172.stdout:8/167: sync 2024-03-19T06:05:24.575 INFO:tasks.workunit.client.1.smithi172.stdout:3/207: sync 2024-03-19T06:05:24.575 INFO:tasks.workunit.client.1.smithi172.stdout:5/192: sync 2024-03-19T06:05:24.575 INFO:tasks.workunit.client.1.smithi172.stdout:2/142: sync 2024-03-19T06:05:24.575 INFO:tasks.workunit.client.1.smithi172.stdout:9/180: sync 2024-03-19T06:05:24.575 INFO:tasks.workunit.client.1.smithi172.stdout:1/247: sync 2024-03-19T06:05:24.577 INFO:tasks.workunit.client.1.smithi172.stdout:6/311: symlink d5/d11/d43/l5d 0 2024-03-19T06:05:24.578 INFO:tasks.workunit.client.1.smithi172.stdout:8/168: chown d0/f9 30313615 1 2024-03-19T06:05:24.581 INFO:tasks.workunit.client.1.smithi172.stdout:0/202: dwrite d11/f13 [0,4194304] 0 2024-03-19T06:05:24.583 INFO:tasks.workunit.client.1.smithi172.stdout:3/208: fdatasync d0/d5/d9/d34/d4d/f2d 0 2024-03-19T06:05:24.585 INFO:tasks.workunit.client.1.smithi172.stdout:9/181: readlink d1/l36 0 2024-03-19T06:05:24.587 INFO:tasks.workunit.client.1.smithi172.stdout:3/209: dread - d0/d5/d9/d34/d4d/f2d zero size 2024-03-19T06:05:24.588 INFO:tasks.workunit.client.1.smithi172.stdout:5/193: creat d5/d14/d15/f42 x:0 0 0 2024-03-19T06:05:24.588 INFO:tasks.workunit.client.1.smithi172.stdout:4/212: dwrite df/d11/f32 [0,4194304] 0 2024-03-19T06:05:24.590 INFO:tasks.workunit.client.1.smithi172.stdout:2/143: dread d7/d1b/f1f [0,4194304] 0 2024-03-19T06:05:24.593 INFO:tasks.workunit.client.1.smithi172.stdout:8/169: mkdir d0/d17/d26/d2f 0 2024-03-19T06:05:24.595 INFO:tasks.workunit.client.1.smithi172.stdout:9/182: stat d1/d7/dc/de/l21 0 2024-03-19T06:05:24.596 INFO:tasks.workunit.client.1.smithi172.stdout:0/203: symlink d11/d18/d38/l3e 0 2024-03-19T06:05:24.601 INFO:tasks.workunit.client.1.smithi172.stdout:5/194: rename d5/d1f/c37 to d5/d3c/c43 0 2024-03-19T06:05:24.602 INFO:tasks.workunit.client.1.smithi172.stdout:7/176: dread d0/d22/d1d/f32 [0,4194304] 0 2024-03-19T06:05:24.611 INFO:tasks.workunit.client.1.smithi172.stdout:0/204: mkdir d11/d18/d38/d3f 0 2024-03-19T06:05:24.611 INFO:tasks.workunit.client.1.smithi172.stdout:1/248: dwrite da/f3c [0,4194304] 0 2024-03-19T06:05:24.612 INFO:tasks.workunit.client.1.smithi172.stdout:6/312: link d5/d16/c2d d5/d11/d17/d36/c5e 0 2024-03-19T06:05:24.612 INFO:tasks.workunit.client.1.smithi172.stdout:2/144: rename f3 to d7/db/f27 0 2024-03-19T06:05:24.615 INFO:tasks.workunit.client.1.smithi172.stdout:7/177: creat d0/d22/d1d/d3a/f3f x:0 0 0 2024-03-19T06:05:24.621 INFO:tasks.workunit.client.1.smithi172.stdout:0/205: rmdir d11/d22 39 2024-03-19T06:05:24.626 INFO:tasks.workunit.client.1.smithi172.stdout:2/145: creat d7/db/d14/f28 x:0 0 0 2024-03-19T06:05:24.636 INFO:tasks.workunit.client.1.smithi172.stdout:7/178: readlink d0/d22/d27/l37 0 2024-03-19T06:05:24.640 INFO:tasks.workunit.client.1.smithi172.stdout:0/206: rmdir d11/d18/d38 39 2024-03-19T06:05:24.641 INFO:tasks.workunit.client.1.smithi172.stdout:2/146: dread - d7/db/d14/f1c zero size 2024-03-19T06:05:24.645 INFO:tasks.workunit.client.1.smithi172.stdout:3/210: dread d0/d5/d9/d34/d4d/f31 [0,4194304] 0 2024-03-19T06:05:24.647 INFO:tasks.workunit.client.1.smithi172.stdout:8/170: dwrite d0/f2d [0,4194304] 0 2024-03-19T06:05:24.650 INFO:tasks.workunit.client.1.smithi172.stdout:1/249: creat da/dd/d10/d36/f4c x:0 0 0 2024-03-19T06:05:24.650 INFO:tasks.workunit.client.1.smithi172.stdout:5/195: dwrite d5/f1d [0,4194304] 0 2024-03-19T06:05:24.652 INFO:tasks.workunit.client.1.smithi172.stdout:7/179: unlink d0/d22/d1d/f38 0 2024-03-19T06:05:24.654 INFO:tasks.workunit.client.1.smithi172.stdout:4/213: dwrite df/d11/d12/f33 [0,4194304] 0 2024-03-19T06:05:24.656 INFO:tasks.workunit.client.1.smithi172.stdout:9/183: dwrite d1/d7/dc/d31/f2b [0,4194304] 0 2024-03-19T06:05:24.660 INFO:tasks.workunit.client.1.smithi172.stdout:5/196: chown l1 1951 1 2024-03-19T06:05:24.663 INFO:tasks.workunit.client.1.smithi172.stdout:8/171: creat d0/d10/d27/d29/d28/f30 x:0 0 0 2024-03-19T06:05:24.663 INFO:tasks.workunit.client.1.smithi172.stdout:8/172: fdatasync d0/f2 0 2024-03-19T06:05:24.665 INFO:tasks.workunit.client.1.smithi172.stdout:6/313: dread d5/fe [0,4194304] 0 2024-03-19T06:05:24.667 INFO:tasks.workunit.client.1.smithi172.stdout:4/214: rmdir df/d11/d12/d21 39 2024-03-19T06:05:24.667 INFO:tasks.workunit.client.1.smithi172.stdout:1/250: creat da/dd/d31/f4d x:0 0 0 2024-03-19T06:05:24.668 INFO:tasks.workunit.client.1.smithi172.stdout:7/180: mkdir d0/d22/d1d/d36/d40 0 2024-03-19T06:05:24.669 INFO:tasks.workunit.client.1.smithi172.stdout:8/173: fsync d0/fd 0 2024-03-19T06:05:24.674 INFO:tasks.workunit.client.1.smithi172.stdout:7/181: dread - d0/d2c/f2f zero size 2024-03-19T06:05:24.678 INFO:tasks.workunit.client.1.smithi172.stdout:6/314: dread d5/f19 [0,4194304] 0 2024-03-19T06:05:24.678 INFO:tasks.workunit.client.1.smithi172.stdout:5/197: mknod d5/c44 0 2024-03-19T06:05:24.678 INFO:tasks.workunit.client.1.smithi172.stdout:4/215: mkdir df/d11/d12/d3c 0 2024-03-19T06:05:24.681 INFO:tasks.workunit.client.1.smithi172.stdout:5/198: fdatasync d5/d14/f19 0 2024-03-19T06:05:24.683 INFO:tasks.workunit.client.1.smithi172.stdout:2/147: getdents d7/db/d14 0 2024-03-19T06:05:24.685 INFO:tasks.workunit.client.1.smithi172.stdout:9/184: getdents d1/d7/dc/de 0 2024-03-19T06:05:24.687 INFO:tasks.workunit.client.1.smithi172.stdout:5/199: truncate d5/d14/f33 1017781 0 2024-03-19T06:05:24.697 INFO:tasks.workunit.client.1.smithi172.stdout:2/148: rename d7/fa to d7/de/f29 0 2024-03-19T06:05:24.699 INFO:tasks.workunit.client.1.smithi172.stdout:4/216: creat df/f3d x:0 0 0 2024-03-19T06:05:24.700 INFO:tasks.workunit.client.1.smithi172.stdout:7/182: truncate d0/d2c/f30 1326468 0 2024-03-19T06:05:24.706 INFO:tasks.workunit.client.1.smithi172.stdout:9/185: mknod d1/d7/dc/de/d34/c42 0 2024-03-19T06:05:24.707 INFO:tasks.workunit.client.1.smithi172.stdout:7/183: chown d0/d22/d1d/d3a/f3f 0 1 2024-03-19T06:05:24.708 INFO:tasks.workunit.client.1.smithi172.stdout:2/149: rmdir d7/db 39 2024-03-19T06:05:24.711 INFO:tasks.workunit.client.1.smithi172.stdout:4/217: chown df/d11/f32 5 1 2024-03-19T06:05:24.715 INFO:tasks.workunit.client.1.smithi172.stdout:4/218: fdatasync df/d11/f1d 0 2024-03-19T06:05:24.715 INFO:tasks.workunit.client.1.smithi172.stdout:9/186: symlink d1/d7/l43 0 2024-03-19T06:05:24.718 INFO:tasks.workunit.client.1.smithi172.stdout:3/211: dwrite d0/d5/d14/f17 [0,4194304] 0 2024-03-19T06:05:24.721 INFO:tasks.workunit.client.1.smithi172.stdout:8/174: dwrite d0/d17/f2a [0,4194304] 0 2024-03-19T06:05:24.724 INFO:tasks.workunit.client.1.smithi172.stdout:7/184: chown d0/d22/d1d/d36/c19 289 1 2024-03-19T06:05:24.725 INFO:tasks.workunit.client.1.smithi172.stdout:5/200: truncate d5/f1d 595093 0 2024-03-19T06:05:24.727 INFO:tasks.workunit.client.1.smithi172.stdout:4/219: write df/d11/f37 [1042583,88123] 0 2024-03-19T06:05:24.733 INFO:tasks.workunit.client.1.smithi172.stdout:2/150: link d7/f8 d7/d1b/f2a 0 2024-03-19T06:05:24.739 INFO:tasks.workunit.client.1.smithi172.stdout:4/220: mkdir df/d11/d12/d34/d3e 0 2024-03-19T06:05:24.741 INFO:tasks.workunit.client.1.smithi172.stdout:6/315: dwrite d5/d11/d17/f3a [0,4194304] 0 2024-03-19T06:05:24.744 INFO:tasks.workunit.client.1.smithi172.stdout:7/185: mkdir d0/d22/d3d/d41 0 2024-03-19T06:05:24.747 INFO:tasks.workunit.client.1.smithi172.stdout:8/175: link d0/l5 d0/d17/l31 0 2024-03-19T06:05:24.749 INFO:tasks.workunit.client.1.smithi172.stdout:5/201: link d5/d14/f19 d5/d1f/d2f/f45 0 2024-03-19T06:05:24.751 INFO:tasks.workunit.client.1.smithi172.stdout:1/251: dwrite da/dd/d10/f23 [0,4194304] 0 2024-03-19T06:05:24.755 INFO:tasks.workunit.client.1.smithi172.stdout:8/176: fsync d0/f15 0 2024-03-19T06:05:24.758 INFO:tasks.workunit.client.1.smithi172.stdout:5/202: write d5/d14/d34/f3f [570685,32939] 0 2024-03-19T06:05:24.766 INFO:tasks.workunit.client.1.smithi172.stdout:4/221: creat df/d11/d12/d3c/f3f x:0 0 0 2024-03-19T06:05:24.769 INFO:tasks.workunit.client.1.smithi172.stdout:0/207: dread ff [0,4194304] 0 2024-03-19T06:05:24.772 INFO:tasks.workunit.client.1.smithi172.stdout:6/316: creat d5/f5f x:0 0 0 2024-03-19T06:05:24.775 INFO:tasks.workunit.client.1.smithi172.stdout:3/212: dread d0/f4 [0,4194304] 0 2024-03-19T06:05:24.776 INFO:tasks.workunit.client.1.smithi172.stdout:2/151: link d7/f15 d7/db/d14/f2b 0 2024-03-19T06:05:24.776 INFO:tasks.workunit.client.1.smithi172.stdout:9/187: dwrite d1/f1c [4194304,4194304] 0 2024-03-19T06:05:24.786 INFO:tasks.workunit.client.1.smithi172.stdout:2/152: mkdir d7/db/d2c 0 2024-03-19T06:05:24.789 INFO:tasks.workunit.client.1.smithi172.stdout:3/213: mknod d0/d5/d14/c4f 0 2024-03-19T06:05:24.790 INFO:tasks.workunit.client.1.smithi172.stdout:1/252: truncate da/f3c 2250250 0 2024-03-19T06:05:24.790 INFO:tasks.workunit.client.1.smithi172.stdout:4/222: unlink c3 0 2024-03-19T06:05:24.792 INFO:tasks.workunit.client.1.smithi172.stdout:2/153: fdatasync f6 0 2024-03-19T06:05:24.792 INFO:tasks.workunit.client.1.smithi172.stdout:7/186: dwrite d0/f29 [4194304,4194304] 0 2024-03-19T06:05:24.797 INFO:tasks.workunit.client.1.smithi172.stdout:2/154: readlink d7/de/l12 0 2024-03-19T06:05:24.803 INFO:tasks.workunit.client.1.smithi172.stdout:4/223: creat df/d2b/f40 x:0 0 0 2024-03-19T06:05:24.806 INFO:tasks.workunit.client.1.smithi172.stdout:3/214: rename d0/f12 to d0/d5/d9/d25/d21/f50 0 2024-03-19T06:05:24.807 INFO:tasks.workunit.client.1.smithi172.stdout:1/253: mkdir da/d33/d4e 0 2024-03-19T06:05:24.812 INFO:tasks.workunit.client.1.smithi172.stdout:4/224: write df/d11/f32 [3363298,73703] 0 2024-03-19T06:05:24.819 INFO:tasks.workunit.client.1.smithi172.stdout:9/188: dwrite d1/f6 [0,4194304] 0 2024-03-19T06:05:24.819 INFO:tasks.workunit.client.1.smithi172.stdout:2/155: link d7/f26 d7/d1b/f2d 0 2024-03-19T06:05:24.819 INFO:tasks.workunit.client.1.smithi172.stdout:4/225: read - df/f3d zero size 2024-03-19T06:05:24.826 INFO:tasks.workunit.client.1.smithi172.stdout:0/208: dwrite d11/d22/f34 [0,4194304] 0 2024-03-19T06:05:24.837 INFO:tasks.workunit.client.1.smithi172.stdout:8/177: dwrite d0/d17/f21 [0,4194304] 0 2024-03-19T06:05:24.842 INFO:tasks.workunit.client.1.smithi172.stdout:0/209: unlink d11/d14/l17 0 2024-03-19T06:05:24.844 INFO:tasks.workunit.client.1.smithi172.stdout:6/317: dwrite d5/fa [0,4194304] 0 2024-03-19T06:05:24.851 INFO:tasks.workunit.client.1.smithi172.stdout:0/210: truncate f6 358030 0 2024-03-19T06:05:24.854 INFO:tasks.workunit.client.1.smithi172.stdout:2/156: dread d7/db/f1a [0,4194304] 0 2024-03-19T06:05:24.856 INFO:tasks.workunit.client.1.smithi172.stdout:1/254: dread da/dd/d10/f29 [0,4194304] 0 2024-03-19T06:05:24.857 INFO:tasks.workunit.client.1.smithi172.stdout:0/211: dread - d11/f26 zero size 2024-03-19T06:05:24.858 INFO:tasks.workunit.client.1.smithi172.stdout:9/189: getdents d1/d7/dc/de/d34 0 2024-03-19T06:05:24.861 INFO:tasks.workunit.client.1.smithi172.stdout:8/178: link d0/f2 d0/d10/d27/d29/f32 0 2024-03-19T06:05:24.863 INFO:tasks.workunit.client.1.smithi172.stdout:4/226: dread df/d11/f37 [0,4194304] 0 2024-03-19T06:05:24.864 INFO:tasks.workunit.client.1.smithi172.stdout:3/215: dwrite d0/d5/d14/f17 [0,4194304] 0 2024-03-19T06:05:24.869 INFO:tasks.workunit.client.1.smithi172.stdout:8/179: chown d0/d10/d27/d29/d28/f30 128390 1 2024-03-19T06:05:24.871 INFO:tasks.workunit.client.1.smithi172.stdout:1/255: chown da/f3c 131303518 1 2024-03-19T06:05:24.872 INFO:tasks.workunit.client.1.smithi172.stdout:5/203: dread d5/fd [0,4194304] 0 2024-03-19T06:05:24.873 INFO:tasks.workunit.client.1.smithi172.stdout:4/227: truncate df/d11/f37 2127836 0 2024-03-19T06:05:24.873 INFO:tasks.workunit.client.1.smithi172.stdout:9/190: symlink d1/d7/dc/d31/l44 0 2024-03-19T06:05:24.874 INFO:tasks.workunit.client.1.smithi172.stdout:0/212: mknod d11/d14/c40 0 2024-03-19T06:05:24.876 INFO:tasks.workunit.client.1.smithi172.stdout:1/256: fsync da/dd/f2b 0 2024-03-19T06:05:24.880 INFO:tasks.workunit.client.1.smithi172.stdout:3/216: creat d0/d5/d9/d25/d21/f51 x:0 0 0 2024-03-19T06:05:24.888 INFO:tasks.workunit.client.1.smithi172.stdout:3/217: dread - d0/d5/d9/d34/d4d/f2d zero size 2024-03-19T06:05:24.888 INFO:tasks.workunit.client.1.smithi172.stdout:6/318: dwrite d5/d11/d43/f4c [0,4194304] 0 2024-03-19T06:05:24.888 INFO:tasks.workunit.client.1.smithi172.stdout:8/180: creat d0/d10/d27/d29/f33 x:0 0 0 2024-03-19T06:05:24.890 INFO:tasks.workunit.client.1.smithi172.stdout:8/181: write d0/d17/f21 [3415901,126814] 0 2024-03-19T06:05:24.894 INFO:tasks.workunit.client.1.smithi172.stdout:1/257: stat da/dd/d10/c28 0 2024-03-19T06:05:24.894 INFO:tasks.workunit.client.1.smithi172.stdout:2/157: link d7/db/c25 d7/de/c2e 0 2024-03-19T06:05:24.894 INFO:tasks.workunit.client.1.smithi172.stdout:9/191: creat d1/d7/dc/de/d34/f45 x:0 0 0 2024-03-19T06:05:24.894 INFO:tasks.workunit.client.1.smithi172.stdout:9/192: stat d1/d7/dc/de/f19 0 2024-03-19T06:05:24.895 INFO:tasks.workunit.client.1.smithi172.stdout:2/158: chown d7/db/c10 24689135 1 2024-03-19T06:05:24.896 INFO:tasks.workunit.client.1.smithi172.stdout:6/319: chown d5/d16/c2d 778 1 2024-03-19T06:05:24.896 INFO:tasks.workunit.client.1.smithi172.stdout:0/213: fsync d11/f29 0 2024-03-19T06:05:24.899 INFO:tasks.workunit.client.1.smithi172.stdout:9/193: read d1/d7/dc/d23/f3c [579012,3590] 0 2024-03-19T06:05:24.902 INFO:tasks.workunit.client.1.smithi172.stdout:1/258: truncate da/dd/d10/d14/d27/f32 1030004 0 2024-03-19T06:05:24.907 INFO:tasks.workunit.client.1.smithi172.stdout:8/182: link d0/f2 d0/f34 0 2024-03-19T06:05:24.908 INFO:tasks.workunit.client.1.smithi172.stdout:8/183: write d0/f1f [960334,70648] 0 2024-03-19T06:05:24.910 INFO:tasks.workunit.client.1.smithi172.stdout:1/259: mknod da/d33/c4f 0 2024-03-19T06:05:24.912 INFO:tasks.workunit.client.1.smithi172.stdout:8/184: write d0/d10/d27/d29/d28/f30 [520566,77955] 0 2024-03-19T06:05:24.917 INFO:tasks.workunit.client.1.smithi172.stdout:3/218: fsync d0/d5/d9/d25/d21/f51 0 2024-03-19T06:05:24.925 INFO:tasks.workunit.client.1.smithi172.stdout:8/185: mknod d0/d17/c35 0 2024-03-19T06:05:24.929 INFO:tasks.workunit.client.1.smithi172.stdout:9/194: rmdir d1/d3d 0 2024-03-19T06:05:24.937 INFO:tasks.workunit.client.1.smithi172.stdout:3/219: dwrite d0/d5/d9/d25/d21/f3c [0,4194304] 0 2024-03-19T06:05:24.938 INFO:tasks.workunit.client.1.smithi172.stdout:0/214: link d11/d14/c40 d11/d14/d2c/c41 0 2024-03-19T06:05:24.940 INFO:tasks.workunit.client.1.smithi172.stdout:2/159: truncate d7/de/f29 3320957 0 2024-03-19T06:05:24.945 INFO:tasks.workunit.client.1.smithi172.stdout:1/260: creat da/dd/d10/f50 x:0 0 0 2024-03-19T06:05:24.947 INFO:tasks.workunit.client.1.smithi172.stdout:9/195: symlink d1/d7/dc/l46 0 2024-03-19T06:05:24.949 INFO:tasks.workunit.client.1.smithi172.stdout:8/186: dwrite d0/d10/d27/d29/d28/f30 [0,4194304] 0 2024-03-19T06:05:24.949 INFO:tasks.workunit.client.1.smithi172.stdout:1/261: chown da/dd/f2b 587146 1 2024-03-19T06:05:24.952 INFO:tasks.workunit.client.1.smithi172.stdout:0/215: rmdir d11 39 2024-03-19T06:05:24.957 INFO:tasks.workunit.client.1.smithi172.stdout:1/262: mknod da/dd/d10/d14/d27/c51 0 2024-03-19T06:05:24.964 INFO:tasks.workunit.client.1.smithi172.stdout:1/263: truncate da/dd/d31/f34 1948243 0 2024-03-19T06:05:24.967 INFO:tasks.workunit.client.1.smithi172.stdout:0/216: symlink d11/d18/d38/d3f/l42 0 2024-03-19T06:05:24.968 INFO:tasks.workunit.client.1.smithi172.stdout:1/264: write da/dd/d10/f23 [1440228,29057] 0 2024-03-19T06:05:24.970 INFO:tasks.workunit.client.1.smithi172.stdout:2/160: fsync d7/db/f1d 0 2024-03-19T06:05:24.973 INFO:tasks.workunit.client.1.smithi172.stdout:0/217: fdatasync f7 0 2024-03-19T06:05:24.974 INFO:tasks.workunit.client.1.smithi172.stdout:8/187: dread d0/f34 [0,4194304] 0 2024-03-19T06:05:24.975 INFO:tasks.workunit.client.1.smithi172.stdout:2/161: symlink d7/d1b/l2f 0 2024-03-19T06:05:24.978 INFO:tasks.workunit.client.1.smithi172.stdout:1/265: fdatasync da/dd/d10/d14/f35 0 2024-03-19T06:05:24.980 INFO:tasks.workunit.client.1.smithi172.stdout:9/196: dread d1/d7/dc/f15 [0,4194304] 0 2024-03-19T06:05:24.983 INFO:tasks.workunit.client.1.smithi172.stdout:2/162: link f6 d7/f30 0 2024-03-19T06:05:24.984 INFO:tasks.workunit.client.1.smithi172.stdout:1/266: unlink da/dd/f2b 0 2024-03-19T06:05:24.984 INFO:tasks.workunit.client.1.smithi172.stdout:2/163: read f6 [62485,30728] 0 2024-03-19T06:05:24.985 INFO:tasks.workunit.client.1.smithi172.stdout:3/220: dwrite d0/f4 [0,4194304] 0 2024-03-19T06:05:24.990 INFO:tasks.workunit.client.1.smithi172.stdout:3/221: write d0/d5/d9/d34/d4d/f4a [1250014,101308] 0 2024-03-19T06:05:24.991 INFO:tasks.workunit.client.1.smithi172.stdout:0/218: rename d11/d14/d2c/d3c to d11/d18/d38/d3f/d43 0 2024-03-19T06:05:24.993 INFO:tasks.workunit.client.1.smithi172.stdout:0/219: readlink d11/d14/l23 0 2024-03-19T06:05:24.995 INFO:tasks.workunit.client.1.smithi172.stdout:1/267: mkdir da/d33/d52 0 2024-03-19T06:05:24.996 INFO:tasks.workunit.client.1.smithi172.stdout:9/197: truncate d1/d7/dc/d23/f3c 4498654 0 2024-03-19T06:05:24.998 INFO:tasks.workunit.client.1.smithi172.stdout:3/222: mkdir d0/d5/d14/d52 0 2024-03-19T06:05:25.000 INFO:tasks.workunit.client.1.smithi172.stdout:0/220: readlink l1 0 2024-03-19T06:05:25.003 INFO:tasks.workunit.client.1.smithi172.stdout:1/268: mkdir da/dd/d10/d14/d27/d53 0 2024-03-19T06:05:25.004 INFO:tasks.workunit.client.1.smithi172.stdout:9/198: mkdir d1/d7/dc/d47 0 2024-03-19T06:05:25.005 INFO:tasks.workunit.client.1.smithi172.stdout:8/188: dwrite d0/d17/f2a [0,4194304] 0 2024-03-19T06:05:25.006 INFO:tasks.workunit.client.1.smithi172.stdout:0/221: creat d11/d22/d32/f44 x:0 0 0 2024-03-19T06:05:25.011 INFO:tasks.workunit.client.1.smithi172.stdout:0/222: rmdir d11/d22 39 2024-03-19T06:05:25.012 INFO:tasks.workunit.client.1.smithi172.stdout:2/164: write d7/de/f29 [601398,45944] 0 2024-03-19T06:05:25.017 INFO:tasks.workunit.client.1.smithi172.stdout:1/269: rename da/d33/c4a to da/dd/d31/c54 0 2024-03-19T06:05:25.017 INFO:tasks.workunit.client.1.smithi172.stdout:3/223: link d0/d5/d9/d25/l45 d0/d5/d9/d25/l53 0 2024-03-19T06:05:25.020 INFO:tasks.workunit.client.1.smithi172.stdout:2/165: unlink d7/db/f23 0 2024-03-19T06:05:25.023 INFO:tasks.workunit.client.1.smithi172.stdout:0/223: read - d11/d22/d32/f44 zero size 2024-03-19T06:05:25.024 INFO:tasks.workunit.client.1.smithi172.stdout:8/189: link d0/cf d0/d17/d26/d2f/c36 0 2024-03-19T06:05:25.030 INFO:tasks.workunit.client.1.smithi172.stdout:0/224: mknod d11/c45 0 2024-03-19T06:05:25.031 INFO:tasks.workunit.client.1.smithi172.stdout:2/166: dread d7/db/f16 [0,4194304] 0 2024-03-19T06:05:25.034 INFO:tasks.workunit.client.1.smithi172.stdout:9/199: dwrite d1/d7/dc/de/f1d [0,4194304] 0 2024-03-19T06:05:25.036 INFO:tasks.workunit.client.1.smithi172.stdout:0/225: mkdir d11/d22/d46 0 2024-03-19T06:05:25.036 INFO:tasks.workunit.client.1.smithi172.stdout:0/226: dread - d11/f26 zero size 2024-03-19T06:05:25.037 INFO:tasks.workunit.client.1.smithi172.stdout:8/190: getdents d0/d10/d27/d29/d28 0 2024-03-19T06:05:25.038 INFO:tasks.workunit.client.1.smithi172.stdout:9/200: rmdir d1/d7/dc/d23 39 2024-03-19T06:05:25.042 INFO:tasks.workunit.client.1.smithi172.stdout:8/191: write d0/d10/d27/d29/f33 [844090,26143] 0 2024-03-19T06:05:25.045 INFO:tasks.workunit.client.1.smithi172.stdout:0/227: symlink d11/d14/l47 0 2024-03-19T06:05:25.046 INFO:tasks.workunit.client.1.smithi172.stdout:0/228: fdatasync ff 0 2024-03-19T06:05:25.046 INFO:tasks.workunit.client.1.smithi172.stdout:1/270: dwrite da/dd/d10/f1d [0,4194304] 0 2024-03-19T06:05:25.048 INFO:tasks.workunit.client.1.smithi172.stdout:3/224: truncate d0/d5/f1c 3831314 0 2024-03-19T06:05:25.049 INFO:tasks.workunit.client.1.smithi172.stdout:7/187: sync 2024-03-19T06:05:25.054 INFO:tasks.workunit.client.1.smithi172.stdout:7/188: fsync d0/d2c/f2f 0 2024-03-19T06:05:25.055 INFO:tasks.workunit.client.1.smithi172.stdout:3/225: dread - d0/d5/d9/f2c zero size 2024-03-19T06:05:25.055 INFO:tasks.workunit.client.1.smithi172.stdout:1/271: chown da/f3c 0 1 2024-03-19T06:05:25.055 INFO:tasks.workunit.client.1.smithi172.stdout:9/201: truncate d1/fa 387616 0 2024-03-19T06:05:25.057 INFO:tasks.workunit.client.1.smithi172.stdout:0/229: symlink d11/d18/d38/d3f/l48 0 2024-03-19T06:05:25.062 INFO:tasks.workunit.client.1.smithi172.stdout:3/226: mkdir d0/d5/d9/d54 0 2024-03-19T06:05:25.062 INFO:tasks.workunit.client.1.smithi172.stdout:7/189: mkdir d0/d22/d3d/d41/d42 0 2024-03-19T06:05:25.063 INFO:tasks.workunit.client.1.smithi172.stdout:8/192: getdents d0/d17/d26/d2f 0 2024-03-19T06:05:25.063 INFO:tasks.workunit.client.1.smithi172.stdout:1/272: creat da/d33/d52/f55 x:0 0 0 2024-03-19T06:05:25.065 INFO:tasks.workunit.client.1.smithi172.stdout:9/202: write d1/d7/dc/d31/f35 [5670842,45713] 0 2024-03-19T06:05:25.066 INFO:tasks.workunit.client.1.smithi172.stdout:0/230: creat d11/d22/f49 x:0 0 0 2024-03-19T06:05:25.067 INFO:tasks.workunit.client.1.smithi172.stdout:3/227: symlink d0/l55 0 2024-03-19T06:05:25.068 INFO:tasks.workunit.client.1.smithi172.stdout:0/231: chown f10 3 1 2024-03-19T06:05:25.072 INFO:tasks.workunit.client.1.smithi172.stdout:1/273: dread da/dd/d10/f29 [0,4194304] 0 2024-03-19T06:05:25.073 INFO:tasks.workunit.client.1.smithi172.stdout:9/203: unlink d1/d7/dc/l2f 0 2024-03-19T06:05:25.073 INFO:tasks.workunit.client.1.smithi172.stdout:8/193: creat d0/f37 x:0 0 0 2024-03-19T06:05:25.074 INFO:tasks.workunit.client.1.smithi172.stdout:0/232: creat d11/d22/f4a x:0 0 0 2024-03-19T06:05:25.075 INFO:tasks.workunit.client.1.smithi172.stdout:3/228: unlink d0/d5/d9/d25/f39 0 2024-03-19T06:05:25.083 INFO:tasks.workunit.client.1.smithi172.stdout:9/204: mkdir d1/d7/dc/de/d34/d48 0 2024-03-19T06:05:25.084 INFO:tasks.workunit.client.1.smithi172.stdout:0/233: rmdir d11/d14/d2c/d36 39 2024-03-19T06:05:25.086 INFO:tasks.workunit.client.1.smithi172.stdout:1/274: symlink da/d33/d4e/l56 0 2024-03-19T06:05:25.086 INFO:tasks.workunit.client.1.smithi172.stdout:3/229: symlink d0/d5/d14/d52/l56 0 2024-03-19T06:05:25.090 INFO:tasks.workunit.client.1.smithi172.stdout:1/275: creat da/d33/f57 x:0 0 0 2024-03-19T06:05:25.091 INFO:tasks.workunit.client.1.smithi172.stdout:0/234: chown d11/d14/l19 27042 1 2024-03-19T06:05:25.092 INFO:tasks.workunit.client.1.smithi172.stdout:9/205: symlink d1/d7/dc/d47/l49 0 2024-03-19T06:05:25.094 INFO:tasks.workunit.client.1.smithi172.stdout:3/230: symlink d0/d5/d9/d25/l57 0 2024-03-19T06:05:25.100 INFO:tasks.workunit.client.1.smithi172.stdout:9/206: write d1/d7/dc/d23/f2c [3505094,78110] 0 2024-03-19T06:05:25.105 INFO:tasks.workunit.client.1.smithi172.stdout:7/190: dwrite d0/d22/f1e [0,4194304] 0 2024-03-19T06:05:25.105 INFO:tasks.workunit.client.1.smithi172.stdout:8/194: dread d0/f1 [0,4194304] 0 2024-03-19T06:05:25.107 INFO:tasks.workunit.client.1.smithi172.stdout:7/191: chown d0/d22/d1d/d36/ff 238 1 2024-03-19T06:05:25.109 INFO:tasks.workunit.client.1.smithi172.stdout:1/276: rename da/f26 to da/dd/d10/f58 0 2024-03-19T06:05:25.111 INFO:tasks.workunit.client.1.smithi172.stdout:7/192: chown d0/d2c/f2f 352 1 2024-03-19T06:05:25.114 INFO:tasks.workunit.client.1.smithi172.stdout:1/277: unlink da/f20 0 2024-03-19T06:05:25.114 INFO:tasks.workunit.client.1.smithi172.stdout:7/193: stat d0/d2c/c34 0 2024-03-19T06:05:25.116 INFO:tasks.workunit.client.1.smithi172.stdout:8/195: creat d0/d10/d27/f38 x:0 0 0 2024-03-19T06:05:25.120 INFO:tasks.workunit.client.1.smithi172.stdout:0/235: dwrite f7 [0,4194304] 0 2024-03-19T06:05:25.120 INFO:tasks.workunit.client.1.smithi172.stdout:3/231: rename d0/d5/d9/d25/d21/f51 to d0/d5/d9/d25/f58 0 2024-03-19T06:05:25.125 INFO:tasks.workunit.client.1.smithi172.stdout:3/232: write d0/d5/d9/f2c [945172,70355] 0 2024-03-19T06:05:25.125 INFO:tasks.workunit.client.1.smithi172.stdout:1/278: write da/dd/d10/d14/f35 [786528,113322] 0 2024-03-19T06:05:25.132 INFO:tasks.workunit.client.1.smithi172.stdout:3/233: read d0/d5/d9/d34/d4d/f31 [1302203,1827] 0 2024-03-19T06:05:25.134 INFO:tasks.workunit.client.1.smithi172.stdout:9/207: creat d1/f4a x:0 0 0 2024-03-19T06:05:25.141 INFO:tasks.workunit.client.1.smithi172.stdout:1/279: dread da/dd/d10/d14/d27/f32 [0,4194304] 0 2024-03-19T06:05:25.145 INFO:tasks.workunit.client.1.smithi172.stdout:8/196: rename d0/f1 to d0/f39 0 2024-03-19T06:05:25.147 INFO:tasks.workunit.client.1.smithi172.stdout:3/234: rename d0/d5/f8 to d0/d5/d9/d34/f59 0 2024-03-19T06:05:25.147 INFO:tasks.workunit.client.1.smithi172.stdout:9/208: rmdir d1/d7/dc/d23 39 2024-03-19T06:05:25.147 INFO:tasks.workunit.client.1.smithi172.stdout:1/280: mkdir da/d33/d59 0 2024-03-19T06:05:25.154 INFO:tasks.workunit.client.1.smithi172.stdout:7/194: dwrite d0/d22/f1b [0,4194304] 0 2024-03-19T06:05:25.157 INFO:tasks.workunit.client.1.smithi172.stdout:3/235: read d0/d5/d14/f27 [2460629,119926] 0 2024-03-19T06:05:25.158 INFO:tasks.workunit.client.1.smithi172.stdout:0/236: dwrite d11/f26 [0,4194304] 0 2024-03-19T06:05:25.161 INFO:tasks.workunit.client.1.smithi172.stdout:0/237: chown d11/d18/d38/l39 625 1 2024-03-19T06:05:25.161 INFO:tasks.workunit.client.1.smithi172.stdout:9/209: mknod d1/d7/dc/c4b 0 2024-03-19T06:05:25.165 INFO:tasks.workunit.client.1.smithi172.stdout:9/210: stat d1/d7/dc/de/d34/d48 0 2024-03-19T06:05:25.194 INFO:tasks.workunit.client.1.smithi172.stdout:4/228: sync 2024-03-19T06:05:25.198 INFO:tasks.workunit.client.1.smithi172.stdout:9/211: truncate d1/f4a 781353 0 2024-03-19T06:05:25.198 INFO:tasks.workunit.client.1.smithi172.stdout:3/236: unlink d0/d5/d9/l2a 0 2024-03-19T06:05:25.201 INFO:tasks.workunit.client.1.smithi172.stdout:0/238: creat d11/d14/f4b x:0 0 0 2024-03-19T06:05:25.202 INFO:tasks.workunit.client.1.smithi172.stdout:1/281: dwrite da/dd/d10/d36/f4c [0,4194304] 0 2024-03-19T06:05:25.206 INFO:tasks.workunit.client.1.smithi172.stdout:9/212: mkdir d1/d7/dc/d4c 0 2024-03-19T06:05:25.206 INFO:tasks.workunit.client.1.smithi172.stdout:3/237: creat d0/f5a x:0 0 0 2024-03-19T06:05:25.206 INFO:tasks.workunit.client.1.smithi172.stdout:8/197: dwrite d0/d17/f21 [0,4194304] 0 2024-03-19T06:05:25.209 INFO:tasks.workunit.client.1.smithi172.stdout:0/239: symlink d11/d22/d32/l4c 0 2024-03-19T06:05:25.212 INFO:tasks.workunit.client.1.smithi172.stdout:8/198: mkdir d0/d17/d3a 0 2024-03-19T06:05:25.213 INFO:tasks.workunit.client.1.smithi172.stdout:3/238: creat d0/d5/d9/f5b x:0 0 0 2024-03-19T06:05:25.218 INFO:tasks.workunit.client.1.smithi172.stdout:8/199: write d0/f37 [603611,6423] 0 2024-03-19T06:05:25.221 INFO:tasks.workunit.client.1.smithi172.stdout:4/229: dwrite df/d11/d12/d21/f2a [0,4194304] 0 2024-03-19T06:05:25.224 INFO:tasks.workunit.client.1.smithi172.stdout:9/213: unlink d1/d7/dc/d23/f2c 0 2024-03-19T06:05:25.229 INFO:tasks.workunit.client.1.smithi172.stdout:0/240: mkdir d11/d4d 0 2024-03-19T06:05:25.230 INFO:tasks.workunit.client.1.smithi172.stdout:8/200: mknod d0/d10/d27/d29/d28/c3b 0 2024-03-19T06:05:25.237 INFO:tasks.workunit.client.1.smithi172.stdout:8/201: write d0/f34 [832654,108383] 0 2024-03-19T06:05:25.249 INFO:tasks.workunit.client.1.smithi172.stdout:1/282: dwrite da/dd/d10/d36/f38 [0,4194304] 0 2024-03-19T06:05:25.249 INFO:tasks.workunit.client.1.smithi172.stdout:0/241: dread d11/d14/f1f [0,4194304] 0 2024-03-19T06:05:25.257 INFO:tasks.workunit.client.1.smithi172.stdout:3/239: dwrite d0/d5/d9/d25/d21/f3c [0,4194304] 0 2024-03-19T06:05:25.258 INFO:tasks.workunit.client.1.smithi172.stdout:4/230: truncate df/d11/f25 1275368 0 2024-03-19T06:05:25.261 INFO:tasks.workunit.client.1.smithi172.stdout:9/214: dwrite d1/d7/dc/f15 [0,4194304] 0 2024-03-19T06:05:25.261 INFO:tasks.workunit.client.1.smithi172.stdout:3/240: read d0/f4 [1430949,87110] 0 2024-03-19T06:05:25.266 INFO:tasks.workunit.client.1.smithi172.stdout:0/242: mkdir d11/d14/d2c/d4e 0 2024-03-19T06:05:25.267 INFO:tasks.workunit.client.1.smithi172.stdout:9/215: chown d1/d7/dc/de/f19 0 1 2024-03-19T06:05:25.271 INFO:tasks.workunit.client.1.smithi172.stdout:1/283: write da/f3c [1170649,114039] 0 2024-03-19T06:05:25.272 INFO:tasks.workunit.client.1.smithi172.stdout:8/202: dread d0/d17/f2a [0,4194304] 0 2024-03-19T06:05:25.278 INFO:tasks.workunit.client.1.smithi172.stdout:3/241: rename d0/d5/d9/d25/d21/f38 to d0/d5/d9/d34/d4d/f5c 0 2024-03-19T06:05:25.282 INFO:tasks.workunit.client.1.smithi172.stdout:6/320: sync 2024-03-19T06:05:25.282 INFO:tasks.workunit.client.1.smithi172.stdout:5/204: sync 2024-03-19T06:05:25.283 INFO:tasks.workunit.client.1.smithi172.stdout:2/167: sync 2024-03-19T06:05:25.284 INFO:tasks.workunit.client.1.smithi172.stdout:8/203: rename d0/d17/c35 to d0/d10/d2b/c3c 0 2024-03-19T06:05:25.285 INFO:tasks.workunit.client.1.smithi172.stdout:1/284: creat da/dd/d10/d14/d27/f5a x:0 0 0 2024-03-19T06:05:25.286 INFO:tasks.workunit.client.1.smithi172.stdout:3/242: mknod d0/d5/c5d 0 2024-03-19T06:05:25.291 INFO:tasks.workunit.client.1.smithi172.stdout:5/205: creat d5/d1f/d2f/f46 x:0 0 0 2024-03-19T06:05:25.293 INFO:tasks.workunit.client.1.smithi172.stdout:8/204: mkdir d0/d17/d3a/d3d 0 2024-03-19T06:05:25.294 INFO:tasks.workunit.client.1.smithi172.stdout:5/206: symlink d5/d14/d15/l47 0 2024-03-19T06:05:25.295 INFO:tasks.workunit.client.1.smithi172.stdout:5/207: readlink l1 0 2024-03-19T06:05:25.300 INFO:tasks.workunit.client.1.smithi172.stdout:0/243: dread d11/f1b [0,4194304] 0 2024-03-19T06:05:25.300 INFO:tasks.workunit.client.1.smithi172.stdout:5/208: mkdir d5/d14/d48 0 2024-03-19T06:05:25.303 INFO:tasks.workunit.client.1.smithi172.stdout:1/285: getdents da/d33/d52 0 2024-03-19T06:05:25.306 INFO:tasks.workunit.client.1.smithi172.stdout:2/168: link d7/de/lf d7/l31 0 2024-03-19T06:05:25.312 INFO:tasks.workunit.client.1.smithi172.stdout:4/231: dread fb [0,4194304] 0 2024-03-19T06:05:25.312 INFO:tasks.workunit.client.1.smithi172.stdout:6/321: dread d5/d11/d17/d1b/f25 [0,4194304] 0 2024-03-19T06:05:25.316 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:25 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:25.316 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:25 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:25.316 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:25 smithi172 ceph-mon[35716]: pgmap v9: 65 pgs: 65 active+clean; 520 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 56 MiB/s wr, 203 op/s 2024-03-19T06:05:25.316 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:25 smithi172 ceph-mon[35716]: Standby manager daemon smithi172.qkcahs started 2024-03-19T06:05:25.316 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:25 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/3739782271' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/crt"}]: dispatch 2024-03-19T06:05:25.316 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:25 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/3739782271' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T06:05:25.316 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:25 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/3739782271' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/key"}]: dispatch 2024-03-19T06:05:25.316 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:25 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/3739782271' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T06:05:25.316 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:25 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:25.316 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:25 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:25.318 INFO:tasks.workunit.client.1.smithi172.stdout:1/286: creat da/d33/d4e/f5b x:0 0 0 2024-03-19T06:05:25.319 INFO:tasks.workunit.client.1.smithi172.stdout:5/209: creat d5/d14/f49 x:0 0 0 2024-03-19T06:05:25.319 INFO:tasks.workunit.client.1.smithi172.stdout:6/322: write d5/fb [2578916,64697] 0 2024-03-19T06:05:25.323 INFO:tasks.workunit.client.1.smithi172.stdout:0/244: creat d11/d14/d2c/d36/f4f x:0 0 0 2024-03-19T06:05:25.324 INFO:tasks.workunit.client.1.smithi172.stdout:2/169: creat d7/db/f32 x:0 0 0 2024-03-19T06:05:25.328 INFO:tasks.workunit.client.1.smithi172.stdout:4/232: chown df/d11/c14 246056 1 2024-03-19T06:05:25.331 INFO:tasks.workunit.client.1.smithi172.stdout:8/205: dwrite d0/d10/f1a [0,4194304] 0 2024-03-19T06:05:25.333 INFO:tasks.workunit.client.1.smithi172.stdout:1/287: symlink da/dd/d10/d36/l5c 0 2024-03-19T06:05:25.334 INFO:tasks.workunit.client.1.smithi172.stdout:8/206: chown d0/d10/d27/d29 109 1 2024-03-19T06:05:25.335 INFO:tasks.workunit.client.1.smithi172.stdout:6/323: unlink d5/d11/c27 0 2024-03-19T06:05:25.336 INFO:tasks.workunit.client.1.smithi172.stdout:1/288: stat da/d33/d52/f55 0 2024-03-19T06:05:25.336 INFO:tasks.workunit.client.1.smithi172.stdout:4/233: stat df/d11/l15 0 2024-03-19T06:05:25.337 INFO:tasks.workunit.client.1.smithi172.stdout:6/324: stat d5/d16/c41 0 2024-03-19T06:05:25.341 INFO:tasks.workunit.client.1.smithi172.stdout:3/243: dread d0/d5/d14/f16 [0,4194304] 0 2024-03-19T06:05:25.341 INFO:tasks.workunit.client.1.smithi172.stdout:6/325: read d5/f19 [71976,42361] 0 2024-03-19T06:05:25.342 INFO:tasks.workunit.client.1.smithi172.stdout:0/245: dread d11/f1b [0,4194304] 0 2024-03-19T06:05:25.346 INFO:tasks.workunit.client.1.smithi172.stdout:6/326: dread - d5/d11/d35/f42 zero size 2024-03-19T06:05:25.347 INFO:tasks.workunit.client.1.smithi172.stdout:4/234: mknod df/d11/d12/d21/c41 0 2024-03-19T06:05:25.347 INFO:tasks.workunit.client.1.smithi172.stdout:2/170: getdents d7/de 0 2024-03-19T06:05:25.348 INFO:tasks.workunit.client.1.smithi172.stdout:0/246: fdatasync d11/f12 0 2024-03-19T06:05:25.350 INFO:tasks.workunit.client.1.smithi172.stdout:0/247: write f10 [4088057,108764] 0 2024-03-19T06:05:25.352 INFO:tasks.workunit.client.1.smithi172.stdout:6/327: creat d5/d2c/d31/f60 x:0 0 0 2024-03-19T06:05:25.355 INFO:tasks.workunit.client.1.smithi172.stdout:2/171: link d7/db/f1d d7/d1b/f33 0 2024-03-19T06:05:25.356 INFO:tasks.workunit.client.1.smithi172.stdout:4/235: symlink df/d11/d12/l42 0 2024-03-19T06:05:25.357 INFO:tasks.workunit.client.1.smithi172.stdout:0/248: write d11/f1b [768538,61074] 0 2024-03-19T06:05:25.361 INFO:tasks.workunit.client.1.smithi172.stdout:8/207: dwrite d0/d17/f25 [0,4194304] 0 2024-03-19T06:05:25.362 INFO:tasks.workunit.client.1.smithi172.stdout:8/208: stat d0/l4 0 2024-03-19T06:05:25.364 INFO:tasks.workunit.client.1.smithi172.stdout:0/249: symlink d11/d4d/l50 0 2024-03-19T06:05:25.366 INFO:tasks.workunit.client.1.smithi172.stdout:1/289: dwrite da/dd/d31/f34 [0,4194304] 0 2024-03-19T06:05:25.370 INFO:tasks.workunit.client.1.smithi172.stdout:8/209: rename d0/f12 to d0/d17/d26/f3e 0 2024-03-19T06:05:25.371 INFO:tasks.workunit.client.1.smithi172.stdout:0/250: unlink d11/d18/d38/d3f/l42 0 2024-03-19T06:05:25.379 INFO:tasks.workunit.client.1.smithi172.stdout:8/210: creat d0/d10/d2b/f3f x:0 0 0 2024-03-19T06:05:25.384 INFO:tasks.workunit.client.1.smithi172.stdout:6/328: dwrite d5/d11/d17/f3a [0,4194304] 0 2024-03-19T06:05:25.389 INFO:tasks.workunit.client.1.smithi172.stdout:2/172: dwrite d7/d1b/f1f [0,4194304] 0 2024-03-19T06:05:25.389 INFO:tasks.workunit.client.1.smithi172.stdout:4/236: dwrite df/d11/d12/d34/f39 [0,4194304] 0 2024-03-19T06:05:25.393 INFO:tasks.workunit.client.1.smithi172.stdout:8/211: creat d0/d10/d27/d29/d28/f40 x:0 0 0 2024-03-19T06:05:25.393 INFO:tasks.workunit.client.1.smithi172.stdout:1/290: dread da/dd/d31/f34 [0,4194304] 0 2024-03-19T06:05:25.400 INFO:tasks.workunit.client.1.smithi172.stdout:4/237: creat df/d11/d12/d26/f43 x:0 0 0 2024-03-19T06:05:25.400 INFO:tasks.workunit.client.1.smithi172.stdout:0/251: dwrite d11/f1b [0,4194304] 0 2024-03-19T06:05:25.409 INFO:tasks.workunit.client.1.smithi172.stdout:2/173: creat d7/db/d14/f34 x:0 0 0 2024-03-19T06:05:25.409 INFO:tasks.workunit.client.1.smithi172.stdout:8/212: creat d0/d17/d3a/f41 x:0 0 0 2024-03-19T06:05:25.412 INFO:tasks.workunit.client.1.smithi172.stdout:1/291: rename da/f1b to da/dd/d10/d14/f5d 0 2024-03-19T06:05:25.418 INFO:tasks.workunit.client.1.smithi172.stdout:4/238: mkdir df/d2b/d44 0 2024-03-19T06:05:25.425 INFO:tasks.workunit.client.1.smithi172.stdout:8/213: symlink d0/d10/d27/d29/l42 0 2024-03-19T06:05:25.427 INFO:tasks.workunit.client.1.smithi172.stdout:8/214: read - d0/d17/d3a/f41 zero size 2024-03-19T06:05:25.427 INFO:tasks.workunit.client.1.smithi172.stdout:0/252: rename d11/d14/c2a to d11/d4d/c51 0 2024-03-19T06:05:25.430 INFO:tasks.workunit.client.1.smithi172.stdout:3/244: dwrite d0/d5/d9/fd [0,4194304] 0 2024-03-19T06:05:25.432 INFO:tasks.workunit.client.1.smithi172.stdout:6/329: link d5/d11/l46 d5/d11/d35/d40/d53/l61 0 2024-03-19T06:05:25.433 INFO:tasks.workunit.client.1.smithi172.stdout:8/215: fdatasync d0/d17/f25 0 2024-03-19T06:05:25.434 INFO:tasks.workunit.client.1.smithi172.stdout:2/174: mkdir d7/db/d2c/d35 0 2024-03-19T06:05:25.434 INFO:tasks.workunit.client.1.smithi172.stdout:1/292: mkdir da/dd/d10/d14/d27/d3f/d5e 0 2024-03-19T06:05:25.441 INFO:tasks.workunit.client.1.smithi172.stdout:0/253: mknod d11/d18/d38/d3f/c52 0 2024-03-19T06:05:25.442 INFO:tasks.workunit.client.1.smithi172.stdout:6/330: rename d5/d11/f22 to d5/d11/d17/f62 0 2024-03-19T06:05:25.446 INFO:tasks.workunit.client.1.smithi172.stdout:4/239: dwrite df/f3d [0,4194304] 0 2024-03-19T06:05:25.456 INFO:tasks.workunit.client.1.smithi172.stdout:8/216: dwrite d0/f3 [0,4194304] 0 2024-03-19T06:05:25.458 INFO:tasks.workunit.client.1.smithi172.stdout:3/245: dread d0/d5/d14/f16 [0,4194304] 0 2024-03-19T06:05:25.459 INFO:tasks.workunit.client.1.smithi172.stdout:8/217: fdatasync d0/d17/d3a/f41 0 2024-03-19T06:05:25.459 INFO:tasks.workunit.client.1.smithi172.stdout:1/293: creat da/f5f x:0 0 0 2024-03-19T06:05:25.461 INFO:tasks.workunit.client.1.smithi172.stdout:2/175: symlink d7/db/d2c/d35/l36 0 2024-03-19T06:05:25.461 INFO:tasks.workunit.client.1.smithi172.stdout:8/218: chown d0/d17/d26/f3e 5452085 1 2024-03-19T06:05:25.464 INFO:tasks.workunit.client.1.smithi172.stdout:8/219: write d0/f39 [3020793,22731] 0 2024-03-19T06:05:25.465 INFO:tasks.workunit.client.1.smithi172.stdout:4/240: chown df/d11/c13 47499123 1 2024-03-19T06:05:25.466 INFO:tasks.workunit.client.1.smithi172.stdout:4/241: readlink df/d11/l15 0 2024-03-19T06:05:25.466 INFO:tasks.workunit.client.1.smithi172.stdout:4/242: stat df/d2b 0 2024-03-19T06:05:25.473 INFO:tasks.workunit.client.1.smithi172.stdout:6/331: symlink d5/d16/l63 0 2024-03-19T06:05:25.474 INFO:tasks.workunit.client.1.smithi172.stdout:1/294: rmdir da/dd/d31 39 2024-03-19T06:05:25.476 INFO:tasks.workunit.client.1.smithi172.stdout:6/332: write d5/f5f [767096,78488] 0 2024-03-19T06:05:25.477 INFO:tasks.workunit.client.1.smithi172.stdout:7/195: sync 2024-03-19T06:05:25.486 INFO:tasks.workunit.client.1.smithi172.stdout:1/295: dread - da/dd/d10/f2f zero size 2024-03-19T06:05:25.486 INFO:tasks.workunit.client.1.smithi172.stdout:0/254: creat d11/d14/d2c/d36/f53 x:0 0 0 2024-03-19T06:05:25.487 INFO:tasks.workunit.client.1.smithi172.stdout:3/246: dwrite d0/d5/d9/d34/d4d/f4a [0,4194304] 0 2024-03-19T06:05:25.487 INFO:tasks.workunit.client.1.smithi172.stdout:6/333: creat d5/d11/d43/f64 x:0 0 0 2024-03-19T06:05:25.488 INFO:tasks.workunit.client.1.smithi172.stdout:2/176: dwrite d7/db/f18 [0,4194304] 0 2024-03-19T06:05:25.492 INFO:tasks.workunit.client.1.smithi172.stdout:8/220: dwrite d0/d10/d27/d29/d28/f30 [0,4194304] 0 2024-03-19T06:05:25.494 INFO:tasks.workunit.client.1.smithi172.stdout:4/243: rename df/d11/d12/d34/d3e to df/d45 0 2024-03-19T06:05:25.496 INFO:tasks.workunit.client.1.smithi172.stdout:2/177: fdatasync d7/f26 0 2024-03-19T06:05:25.499 INFO:tasks.workunit.client.1.smithi172.stdout:1/296: write da/dd/d10/d14/f5d [3116495,108531] 0 2024-03-19T06:05:25.499 INFO:tasks.workunit.client.1.smithi172.stdout:7/196: symlink d0/d22/d1d/d36/l43 0 2024-03-19T06:05:25.505 INFO:tasks.workunit.client.1.smithi172.stdout:1/297: write da/dd/d10/d14/f35 [3383428,127270] 0 2024-03-19T06:05:25.505 INFO:tasks.workunit.client.1.smithi172.stdout:0/255: symlink d11/d14/d2c/l54 0 2024-03-19T06:05:25.508 INFO:tasks.workunit.client.1.smithi172.stdout:3/247: creat d0/d5/d14/d52/f5e x:0 0 0 2024-03-19T06:05:25.510 INFO:tasks.workunit.client.1.smithi172.stdout:0/256: chown d11/d18/d38/d3f/l48 43179 1 2024-03-19T06:05:25.511 INFO:tasks.workunit.client.1.smithi172.stdout:2/178: rename d7/db/f1a to d7/db/f37 0 2024-03-19T06:05:25.515 INFO:tasks.workunit.client.1.smithi172.stdout:7/197: mknod d0/d22/d3d/c44 0 2024-03-19T06:05:25.519 INFO:tasks.workunit.client.1.smithi172.stdout:3/248: dread - d0/d5/d9/d34/d4d/f49 zero size 2024-03-19T06:05:25.521 INFO:tasks.workunit.client.1.smithi172.stdout:2/179: creat d7/db/d2c/f38 x:0 0 0 2024-03-19T06:05:25.524 INFO:tasks.workunit.client.1.smithi172.stdout:4/244: dwrite df/d2b/f3b [0,4194304] 0 2024-03-19T06:05:25.527 INFO:tasks.workunit.client.1.smithi172.stdout:7/198: rename d0/d22/d1d/d36/f33 to d0/d22/d1d/f45 0 2024-03-19T06:05:25.533 INFO:tasks.workunit.client.1.smithi172.stdout:6/334: truncate d5/fe 1543014 0 2024-03-19T06:05:25.538 INFO:tasks.workunit.client.1.smithi172.stdout:2/180: rename d7/f30 to d7/db/d14/f39 0 2024-03-19T06:05:25.538 INFO:tasks.workunit.client.1.smithi172.stdout:3/249: link d0/d5/d9/l29 d0/d5/d9/d3a/l5f 0 2024-03-19T06:05:25.541 INFO:tasks.workunit.client.1.smithi172.stdout:2/181: dread - d7/de/f1e zero size 2024-03-19T06:05:25.541 INFO:tasks.workunit.client.1.smithi172.stdout:1/298: fdatasync da/dd/d10/d14/f5d 0 2024-03-19T06:05:25.542 INFO:tasks.workunit.client.1.smithi172.stdout:6/335: mknod d5/d11/d35/d40/d53/c65 0 2024-03-19T06:05:25.544 INFO:tasks.workunit.client.1.smithi172.stdout:3/250: write d0/d5/d9/fd [4556267,85620] 0 2024-03-19T06:05:25.546 INFO:tasks.workunit.client.1.smithi172.stdout:4/245: getdents df/d11/d12/d34 0 2024-03-19T06:05:25.547 INFO:tasks.workunit.client.1.smithi172.stdout:2/182: truncate d7/de/f1e 171988 0 2024-03-19T06:05:25.548 INFO:tasks.workunit.client.1.smithi172.stdout:1/299: mkdir da/d33/d4e/d60 0 2024-03-19T06:05:25.549 INFO:tasks.workunit.client.1.smithi172.stdout:3/251: stat d0/d5/d9/d34/d4d/f2e 0 2024-03-19T06:05:25.553 INFO:tasks.workunit.client.1.smithi172.stdout:8/221: dread d0/f8 [0,4194304] 0 2024-03-19T06:05:25.553 INFO:tasks.workunit.client.1.smithi172.stdout:2/183: symlink d7/db/d2c/d35/l3a 0 2024-03-19T06:05:25.555 INFO:tasks.workunit.client.1.smithi172.stdout:3/252: mkdir d0/d5/d9/d60 0 2024-03-19T06:05:25.555 INFO:tasks.workunit.client.1.smithi172.stdout:4/246: truncate df/d11/d12/d21/f2f 425102 0 2024-03-19T06:05:25.556 INFO:tasks.workunit.client.1.smithi172.stdout:1/300: rename da/dd/d10/d14/d27/c51 to da/dd/d10/d36/c61 0 2024-03-19T06:05:25.560 INFO:tasks.workunit.client.1.smithi172.stdout:2/184: read d7/fc [1018457,127013] 0 2024-03-19T06:05:25.561 INFO:tasks.workunit.client.1.smithi172.stdout:8/222: write d0/d17/f21 [4291959,98725] 0 2024-03-19T06:05:25.565 INFO:tasks.workunit.client.1.smithi172.stdout:4/247: rmdir df/d11/d12/d26 39 2024-03-19T06:05:25.570 INFO:tasks.workunit.client.1.smithi172.stdout:6/336: dwrite d5/f5f [0,4194304] 0 2024-03-19T06:05:25.572 INFO:tasks.workunit.client.1.smithi172.stdout:3/253: rename d0/d5/d14/l1d to d0/d5/d9/d34/d4d/l61 0 2024-03-19T06:05:25.574 INFO:tasks.workunit.client.1.smithi172.stdout:4/248: creat df/d2b/d2d/f46 x:0 0 0 2024-03-19T06:05:25.576 INFO:tasks.workunit.client.1.smithi172.stdout:7/199: dread d0/f15 [0,4194304] 0 2024-03-19T06:05:25.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:25 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:25.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:25 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:25 smithi072 ceph-mon[28706]: pgmap v9: 65 pgs: 65 active+clean; 520 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 56 MiB/s wr, 203 op/s 2024-03-19T06:05:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:25 smithi072 ceph-mon[28706]: Standby manager daemon smithi172.qkcahs started 2024-03-19T06:05:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:25 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/3739782271' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/crt"}]: dispatch 2024-03-19T06:05:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:25 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/3739782271' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T06:05:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:25 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/3739782271' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/key"}]: dispatch 2024-03-19T06:05:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:25 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/3739782271' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T06:05:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:25 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:25.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:25 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:25.577 INFO:tasks.workunit.client.1.smithi172.stdout:8/223: rename d0/d10/d2b/l2c to d0/d10/d27/d29/d28/l43 0 2024-03-19T06:05:25.580 INFO:tasks.workunit.client.1.smithi172.stdout:4/249: symlink df/d11/d12/d34/l47 0 2024-03-19T06:05:25.583 INFO:tasks.workunit.client.1.smithi172.stdout:2/185: rename d7/db/d2c/d35/l3a to d7/db/d2c/l3b 0 2024-03-19T06:05:25.587 INFO:tasks.workunit.client.1.smithi172.stdout:7/200: unlink d0/d22/d1d/d36/ff 0 2024-03-19T06:05:25.590 INFO:tasks.workunit.client.1.smithi172.stdout:7/201: chown d0/d22/d3d/d41 43 1 2024-03-19T06:05:25.591 INFO:tasks.workunit.client.1.smithi172.stdout:3/254: link d0/d5/d14/c4f d0/d37/c62 0 2024-03-19T06:05:25.593 INFO:tasks.workunit.client.1.smithi172.stdout:8/224: dread d0/f1f [0,4194304] 0 2024-03-19T06:05:25.594 INFO:tasks.workunit.client.1.smithi172.stdout:1/301: dread da/dd/d10/d14/f35 [0,4194304] 0 2024-03-19T06:05:25.595 INFO:tasks.workunit.client.1.smithi172.stdout:3/255: readlink d0/d5/d9/l48 0 2024-03-19T06:05:25.596 INFO:tasks.workunit.client.1.smithi172.stdout:2/186: dread d7/db/f37 [0,4194304] 0 2024-03-19T06:05:25.597 INFO:tasks.workunit.client.1.smithi172.stdout:7/202: mkdir d0/d22/d1d/d3a/d46 0 2024-03-19T06:05:25.600 INFO:tasks.workunit.client.1.smithi172.stdout:8/225: mkdir d0/d44 0 2024-03-19T06:05:25.604 INFO:tasks.workunit.client.1.smithi172.stdout:1/302: creat da/dd/d10/d14/f62 x:0 0 0 2024-03-19T06:05:25.604 INFO:tasks.workunit.client.1.smithi172.stdout:3/256: mknod d0/d37/c63 0 2024-03-19T06:05:25.606 INFO:tasks.workunit.client.1.smithi172.stdout:6/337: dwrite d5/fe [0,4194304] 0 2024-03-19T06:05:25.607 INFO:tasks.workunit.client.1.smithi172.stdout:4/250: dwrite df/d2b/d2d/f38 [0,4194304] 0 2024-03-19T06:05:25.608 INFO:tasks.workunit.client.1.smithi172.stdout:1/303: symlink da/dd/l63 0 2024-03-19T06:05:25.609 INFO:tasks.workunit.client.1.smithi172.stdout:3/257: write d0/d5/d9/f2c [1157362,70661] 0 2024-03-19T06:05:25.613 INFO:tasks.workunit.client.1.smithi172.stdout:6/338: creat d5/d2c/f66 x:0 0 0 2024-03-19T06:05:25.615 INFO:tasks.workunit.client.1.smithi172.stdout:9/216: sync 2024-03-19T06:05:25.619 INFO:tasks.workunit.client.1.smithi172.stdout:7/203: dread d0/d22/d1d/d36/f23 [0,4194304] 0 2024-03-19T06:05:25.621 INFO:tasks.workunit.client.1.smithi172.stdout:9/217: mknod d1/d7/dc/de/c4d 0 2024-03-19T06:05:25.627 INFO:tasks.workunit.client.1.smithi172.stdout:4/251: dwrite df/d11/d12/f33 [0,4194304] 0 2024-03-19T06:05:25.632 INFO:tasks.workunit.client.1.smithi172.stdout:1/304: creat da/dd/d10/f64 x:0 0 0 2024-03-19T06:05:25.634 INFO:tasks.workunit.client.1.smithi172.stdout:7/204: symlink d0/d22/d3d/d41/d42/l47 0 2024-03-19T06:05:25.635 INFO:tasks.workunit.client.1.smithi172.stdout:4/252: symlink df/d11/d12/l48 0 2024-03-19T06:05:25.640 INFO:tasks.workunit.client.1.smithi172.stdout:7/205: mknod d0/d22/d1d/d36/c48 0 2024-03-19T06:05:25.721 INFO:tasks.workunit.client.1.smithi172.stdout:4/253: creat df/d11/f49 x:0 0 0 2024-03-19T06:05:25.722 INFO:tasks.workunit.client.1.smithi172.stdout:3/258: truncate d0/d5/d14/f27 2331180 0 2024-03-19T06:05:25.722 INFO:tasks.workunit.client.1.smithi172.stdout:6/339: truncate d5/d2c/d31/f57 441639 0 2024-03-19T06:05:25.724 INFO:tasks.workunit.client.1.smithi172.stdout:9/218: dwrite d1/d7/dc/f15 [0,4194304] 0 2024-03-19T06:05:25.724 INFO:tasks.workunit.client.1.smithi172.stdout:4/254: fdatasync df/d11/d12/f1a 0 2024-03-19T06:05:25.728 INFO:tasks.workunit.client.1.smithi172.stdout:6/340: rename d5/fa to d5/d2c/d31/f67 0 2024-03-19T06:05:25.729 INFO:tasks.workunit.client.1.smithi172.stdout:4/255: write df/d2b/d2d/f46 [782245,96163] 0 2024-03-19T06:05:25.729 INFO:tasks.workunit.client.1.smithi172.stdout:7/206: link d0/d22/d27/l37 d0/d22/d1d/l49 0 2024-03-19T06:05:25.734 INFO:tasks.workunit.client.1.smithi172.stdout:7/207: stat d0/d22/d1d/d36 0 2024-03-19T06:05:25.734 INFO:tasks.workunit.client.1.smithi172.stdout:6/341: truncate d5/f37 1052475 0 2024-03-19T06:05:25.737 INFO:tasks.workunit.client.1.smithi172.stdout:7/208: chown d0/l31 383416320 1 2024-03-19T06:05:25.737 INFO:tasks.workunit.client.1.smithi172.stdout:6/342: fsync d5/d2c/d31/d3d/f54 0 2024-03-19T06:05:25.745 INFO:tasks.workunit.client.1.smithi172.stdout:9/219: link d1/l22 d1/d7/dc/de/d34/l4e 0 2024-03-19T06:05:25.747 INFO:tasks.workunit.client.1.smithi172.stdout:6/343: dread d5/d11/d2f/f38 [0,4194304] 0 2024-03-19T06:05:25.749 INFO:tasks.workunit.client.1.smithi172.stdout:6/344: fdatasync d5/d11/f4b 0 2024-03-19T06:05:25.754 INFO:tasks.workunit.client.1.smithi172.stdout:6/345: creat d5/d11/d35/f68 x:0 0 0 2024-03-19T06:05:25.756 INFO:tasks.workunit.client.1.smithi172.stdout:5/210: sync 2024-03-19T06:05:25.756 INFO:tasks.workunit.client.1.smithi172.stdout:4/256: dread df/d11/f25 [0,4194304] 0 2024-03-19T06:05:25.757 INFO:tasks.workunit.client.1.smithi172.stdout:9/220: write d1/fa [1021224,108346] 0 2024-03-19T06:05:25.760 INFO:tasks.workunit.client.1.smithi172.stdout:5/211: symlink d5/d3c/l4a 0 2024-03-19T06:05:25.764 INFO:tasks.workunit.client.1.smithi172.stdout:7/209: dwrite d0/d22/d1d/d36/f13 [0,4194304] 0 2024-03-19T06:05:25.764 INFO:tasks.workunit.client.1.smithi172.stdout:4/257: write df/d11/d12/f1a [2770923,83602] 0 2024-03-19T06:05:25.768 INFO:tasks.workunit.client.1.smithi172.stdout:9/221: write d1/d7/dc/de/f1f [1592518,76384] 0 2024-03-19T06:05:25.771 INFO:tasks.workunit.client.1.smithi172.stdout:3/259: dwrite d0/d5/d9/d25/d21/f50 [0,4194304] 0 2024-03-19T06:05:25.783 INFO:tasks.workunit.client.1.smithi172.stdout:4/258: symlink df/d11/d12/d21/l4a 0 2024-03-19T06:05:25.789 INFO:tasks.workunit.client.1.smithi172.stdout:4/259: fdatasync df/d11/d12/d21/f2a 0 2024-03-19T06:05:25.791 INFO:tasks.workunit.client.1.smithi172.stdout:6/346: dwrite d5/f19 [0,4194304] 0 2024-03-19T06:05:25.791 INFO:tasks.workunit.client.1.smithi172.stdout:3/260: rename d0/f6 to d0/d5/d9/d34/f64 0 2024-03-19T06:05:25.796 INFO:tasks.workunit.client.1.smithi172.stdout:6/347: chown d5/c9 68556022 1 2024-03-19T06:05:25.797 INFO:tasks.workunit.client.1.smithi172.stdout:3/261: fdatasync d0/d5/d14/f30 0 2024-03-19T06:05:25.800 INFO:tasks.workunit.client.1.smithi172.stdout:4/260: creat df/d11/d12/d21/f4b x:0 0 0 2024-03-19T06:05:25.802 INFO:tasks.workunit.client.1.smithi172.stdout:6/348: chown d5/d16/f18 762101826 1 2024-03-19T06:05:25.803 INFO:tasks.workunit.client.1.smithi172.stdout:3/262: fdatasync d0/d5/d9/fd 0 2024-03-19T06:05:25.806 INFO:tasks.workunit.client.1.smithi172.stdout:9/222: dwrite d1/d7/dc/f15 [0,4194304] 0 2024-03-19T06:05:25.807 INFO:tasks.workunit.client.1.smithi172.stdout:7/210: dwrite d0/d22/d1d/d36/f11 [0,4194304] 0 2024-03-19T06:05:25.814 INFO:tasks.workunit.client.1.smithi172.stdout:6/349: creat d5/d11/d17/d1b/f69 x:0 0 0 2024-03-19T06:05:25.818 INFO:tasks.workunit.client.1.smithi172.stdout:4/261: read f6 [5519,35334] 0 2024-03-19T06:05:25.821 INFO:tasks.workunit.client.1.smithi172.stdout:7/211: creat d0/d22/d3d/f4a x:0 0 0 2024-03-19T06:05:25.823 INFO:tasks.workunit.client.1.smithi172.stdout:7/212: dread - d0/d22/d3d/f4a zero size 2024-03-19T06:05:25.824 INFO:tasks.workunit.client.1.smithi172.stdout:9/223: symlink d1/d7/dc/de/d34/d48/l4f 0 2024-03-19T06:05:25.825 INFO:tasks.workunit.client.1.smithi172.stdout:5/212: dread d5/d14/d34/f3a [0,4194304] 0 2024-03-19T06:05:25.827 INFO:tasks.workunit.client.1.smithi172.stdout:3/263: link d0/d5/d9/d25/d21/l32 d0/d5/d9/d34/d4d/l65 0 2024-03-19T06:05:25.828 INFO:tasks.workunit.client.1.smithi172.stdout:5/213: readlink d5/d14/d15/l47 0 2024-03-19T06:05:25.828 INFO:tasks.workunit.client.1.smithi172.stdout:4/262: creat df/d2b/d44/f4c x:0 0 0 2024-03-19T06:05:25.830 INFO:tasks.workunit.client.1.smithi172.stdout:7/213: unlink d0/d22/d3d/f4a 0 2024-03-19T06:05:25.830 INFO:tasks.workunit.client.1.smithi172.stdout:9/224: creat d1/d7/dc/de/f50 x:0 0 0 2024-03-19T06:05:25.831 INFO:tasks.workunit.client.1.smithi172.stdout:6/350: dwrite d5/f10 [0,4194304] 0 2024-03-19T06:05:25.833 INFO:tasks.workunit.client.1.smithi172.stdout:5/214: mknod d5/d14/d34/c4b 0 2024-03-19T06:05:25.835 INFO:tasks.workunit.client.1.smithi172.stdout:7/214: write d0/d22/f26 [1586347,125777] 0 2024-03-19T06:05:25.838 INFO:tasks.workunit.client.1.smithi172.stdout:3/264: rename d0/d37/c62 to d0/d5/d14/c66 0 2024-03-19T06:05:25.838 INFO:tasks.workunit.client.1.smithi172.stdout:6/351: rename d5/d2c/f66 to d5/d2c/f6a 0 2024-03-19T06:05:25.840 INFO:tasks.workunit.client.1.smithi172.stdout:5/215: creat d5/d14/d15/f4c x:0 0 0 2024-03-19T06:05:25.874 INFO:tasks.workunit.client.1.smithi172.stdout:9/225: truncate d1/f1c 2368762 0 2024-03-19T06:05:25.875 INFO:tasks.workunit.client.1.smithi172.stdout:7/215: mkdir d0/d22/d4b 0 2024-03-19T06:05:25.876 INFO:tasks.workunit.client.1.smithi172.stdout:5/216: write d5/f16 [1074969,3600] 0 2024-03-19T06:05:25.881 INFO:tasks.workunit.client.1.smithi172.stdout:9/226: write d1/d7/dc/de/d34/f41 [867081,38637] 0 2024-03-19T06:05:25.882 INFO:tasks.workunit.client.1.smithi172.stdout:9/227: stat d1/fa 0 2024-03-19T06:05:25.884 INFO:tasks.workunit.client.1.smithi172.stdout:3/265: dwrite d0/d5/f10 [0,4194304] 0 2024-03-19T06:05:25.887 INFO:tasks.workunit.client.1.smithi172.stdout:5/217: rename d5/d1f/f31 to d5/d14/f4d 0 2024-03-19T06:05:25.890 INFO:tasks.workunit.client.1.smithi172.stdout:3/266: chown d0/d5/d9/d34/d4d/l61 0 1 2024-03-19T06:05:25.892 INFO:tasks.workunit.client.1.smithi172.stdout:3/267: fdatasync d0/d5/f3d 0 2024-03-19T06:05:25.893 INFO:tasks.workunit.client.1.smithi172.stdout:5/218: creat d5/d3c/f4e x:0 0 0 2024-03-19T06:05:25.899 INFO:tasks.workunit.client.1.smithi172.stdout:3/268: write d0/d5/d9/d34/f59 [292049,78337] 0 2024-03-19T06:05:25.900 INFO:tasks.workunit.client.1.smithi172.stdout:5/219: symlink d5/d1f/l4f 0 2024-03-19T06:05:25.902 INFO:tasks.workunit.client.1.smithi172.stdout:7/216: dwrite d0/d22/f1e [0,4194304] 0 2024-03-19T06:05:25.904 INFO:tasks.workunit.client.1.smithi172.stdout:3/269: unlink d0/d5/f10 0 2024-03-19T06:05:25.904 INFO:tasks.workunit.client.1.smithi172.stdout:7/217: chown d0/c2d 6 1 2024-03-19T06:05:25.908 INFO:tasks.workunit.client.1.smithi172.stdout:5/220: mknod d5/d1f/d2f/c50 0 2024-03-19T06:05:25.909 INFO:tasks.workunit.client.1.smithi172.stdout:6/352: dread d5/d2c/d31/d3d/f54 [0,4194304] 0 2024-03-19T06:05:25.909 INFO:tasks.workunit.client.1.smithi172.stdout:7/218: write d0/d22/f1b [374111,6119] 0 2024-03-19T06:05:25.913 INFO:tasks.workunit.client.1.smithi172.stdout:0/257: sync 2024-03-19T06:05:25.913 INFO:tasks.workunit.client.1.smithi172.stdout:2/187: sync 2024-03-19T06:05:25.916 INFO:tasks.workunit.client.1.smithi172.stdout:7/219: creat d0/d22/d1d/f4c x:0 0 0 2024-03-19T06:05:25.919 INFO:tasks.workunit.client.1.smithi172.stdout:5/221: fdatasync d5/d1f/d2f/f45 0 2024-03-19T06:05:25.924 INFO:tasks.workunit.client.1.smithi172.stdout:5/222: chown d5/d1f/l39 68 1 2024-03-19T06:05:25.925 INFO:tasks.workunit.client.1.smithi172.stdout:7/220: unlink d0/d22/d3d/d41/d42/l47 0 2024-03-19T06:05:25.926 INFO:tasks.workunit.client.1.smithi172.stdout:0/258: creat d11/d18/d38/f55 x:0 0 0 2024-03-19T06:05:25.926 INFO:tasks.workunit.client.1.smithi172.stdout:2/188: dread d7/f15 [0,4194304] 0 2024-03-19T06:05:25.929 INFO:tasks.workunit.client.1.smithi172.stdout:5/223: unlink d5/c1a 0 2024-03-19T06:05:25.933 INFO:tasks.workunit.client.1.smithi172.stdout:3/270: dwrite d0/d5/d9/d25/d21/f50 [0,4194304] 0 2024-03-19T06:05:25.935 INFO:tasks.workunit.client.1.smithi172.stdout:3/271: chown d0/l55 72078 1 2024-03-19T06:05:25.936 INFO:tasks.workunit.client.1.smithi172.stdout:6/353: dread d5/d11/d17/d1b/f21 [0,4194304] 0 2024-03-19T06:05:25.936 INFO:tasks.workunit.client.1.smithi172.stdout:3/272: stat d0/d5/l42 0 2024-03-19T06:05:25.938 INFO:tasks.workunit.client.1.smithi172.stdout:2/189: mknod d7/db/c3c 0 2024-03-19T06:05:25.941 INFO:tasks.workunit.client.1.smithi172.stdout:0/259: symlink d11/d18/d38/d3f/d43/l56 0 2024-03-19T06:05:25.943 INFO:tasks.workunit.client.1.smithi172.stdout:6/354: creat d5/d2c/f6b x:0 0 0 2024-03-19T06:05:25.943 INFO:tasks.workunit.client.1.smithi172.stdout:9/228: truncate d1/d7/dc/d31/f35 1393060 0 2024-03-19T06:05:25.947 INFO:tasks.workunit.client.1.smithi172.stdout:2/190: rename d7/db/c10 to d7/db/d14/c3d 0 2024-03-19T06:05:25.948 INFO:tasks.workunit.client.1.smithi172.stdout:5/224: dread d5/f16 [0,4194304] 0 2024-03-19T06:05:25.951 INFO:tasks.workunit.client.1.smithi172.stdout:5/225: write d5/d3c/f4e [765732,85676] 0 2024-03-19T06:05:25.951 INFO:tasks.workunit.client.1.smithi172.stdout:0/260: mknod d11/d18/d38/d3f/d43/c57 0 2024-03-19T06:05:25.951 INFO:tasks.workunit.client.1.smithi172.stdout:6/355: fsync d5/d11/d43/f4c 0 2024-03-19T06:05:25.952 INFO:tasks.workunit.client.1.smithi172.stdout:7/221: dwrite d0/f29 [0,4194304] 0 2024-03-19T06:05:25.955 INFO:tasks.workunit.client.1.smithi172.stdout:9/229: symlink d1/d7/dc/d47/l51 0 2024-03-19T06:05:25.955 INFO:tasks.workunit.client.1.smithi172.stdout:2/191: symlink d7/db/l3e 0 2024-03-19T06:05:25.957 INFO:tasks.workunit.client.1.smithi172.stdout:2/192: dread - d7/db/d14/f34 zero size 2024-03-19T06:05:25.962 INFO:tasks.workunit.client.1.smithi172.stdout:0/261: creat d11/d22/d32/f58 x:0 0 0 2024-03-19T06:05:25.962 INFO:tasks.workunit.client.1.smithi172.stdout:9/230: symlink d1/d7/dc/de/d34/d48/l52 0 2024-03-19T06:05:25.980 INFO:tasks.workunit.client.1.smithi172.stdout:8/226: sync 2024-03-19T06:05:25.980 INFO:tasks.workunit.client.1.smithi172.stdout:1/305: sync 2024-03-19T06:05:25.985 INFO:tasks.workunit.client.1.smithi172.stdout:2/193: write d7/db/d14/f2b [605786,74576] 0 2024-03-19T06:05:25.986 INFO:tasks.workunit.client.1.smithi172.stdout:6/356: getdents d5/d11/d17/d36 0 2024-03-19T06:05:25.986 INFO:tasks.workunit.client.1.smithi172.stdout:9/231: truncate d1/d7/f2e 291301 0 2024-03-19T06:05:25.988 INFO:tasks.workunit.client.1.smithi172.stdout:0/262: mkdir d11/d18/d38/d59 0 2024-03-19T06:05:25.988 INFO:tasks.workunit.client.1.smithi172.stdout:3/273: dwrite d0/d5/d9/d34/d4d/f49 [0,4194304] 0 2024-03-19T06:05:25.990 INFO:tasks.workunit.client.1.smithi172.stdout:0/263: readlink l1 0 2024-03-19T06:05:25.996 INFO:tasks.workunit.client.1.smithi172.stdout:6/357: symlink d5/d11/d35/d40/l6c 0 2024-03-19T06:05:25.996 INFO:tasks.workunit.client.1.smithi172.stdout:0/264: write f7 [3190955,90535] 0 2024-03-19T06:05:25.996 INFO:tasks.workunit.client.1.smithi172.stdout:1/306: read da/dd/d10/f24 [804592,41667] 0 2024-03-19T06:05:25.999 INFO:tasks.workunit.client.1.smithi172.stdout:2/194: rename d7/db/f37 to d7/d1b/f3f 0 2024-03-19T06:05:26.001 INFO:tasks.workunit.client.1.smithi172.stdout:3/274: mkdir d0/d5/d9/d60/d67 0 2024-03-19T06:05:26.002 INFO:tasks.workunit.client.1.smithi172.stdout:0/265: readlink d11/d18/d38/l3e 0 2024-03-19T06:05:26.003 INFO:tasks.workunit.client.1.smithi172.stdout:5/226: dwrite d5/d1f/d2f/f45 [0,4194304] 0 2024-03-19T06:05:26.005 INFO:tasks.workunit.client.1.smithi172.stdout:1/307: write da/dd/d10/f50 [1016478,10865] 0 2024-03-19T06:05:26.009 INFO:tasks.workunit.client.1.smithi172.stdout:0/266: write d11/d22/f34 [3965335,6242] 0 2024-03-19T06:05:26.010 INFO:tasks.workunit.client.1.smithi172.stdout:1/308: dread - da/d33/d52/f55 zero size 2024-03-19T06:05:26.011 INFO:tasks.workunit.client.1.smithi172.stdout:5/227: chown d5/d14/d15/f4c 246928 1 2024-03-19T06:05:26.012 INFO:tasks.workunit.client.1.smithi172.stdout:8/227: dwrite d0/f11 [0,4194304] 0 2024-03-19T06:05:26.021 INFO:tasks.workunit.client.1.smithi172.stdout:6/358: dread d5/d11/d17/d1b/f21 [0,4194304] 0 2024-03-19T06:05:26.024 INFO:tasks.workunit.client.1.smithi172.stdout:9/232: dwrite d1/d7/dc/f14 [0,4194304] 0 2024-03-19T06:05:26.025 INFO:tasks.workunit.client.1.smithi172.stdout:0/267: stat d11/d14/d2c/d36/l37 0 2024-03-19T06:05:26.028 INFO:tasks.workunit.client.1.smithi172.stdout:8/228: rename d0/d17/f2a to d0/d17/d26/d2f/f45 0 2024-03-19T06:05:26.033 INFO:tasks.workunit.client.1.smithi172.stdout:1/309: write da/dd/d10/f29 [874204,91531] 0 2024-03-19T06:05:26.039 INFO:tasks.workunit.client.1.smithi172.stdout:0/268: chown d11/d14/d2c/d36/c3a 230741 1 2024-03-19T06:05:26.040 INFO:tasks.workunit.client.1.smithi172.stdout:6/359: rename d5/d11/d17/d1b/f56 to d5/d11/d2f/f6d 0 2024-03-19T06:05:26.042 INFO:tasks.workunit.client.1.smithi172.stdout:1/310: fdatasync da/f3c 0 2024-03-19T06:05:26.043 INFO:tasks.workunit.client.1.smithi172.stdout:8/229: dread d0/f37 [0,4194304] 0 2024-03-19T06:05:26.044 INFO:tasks.workunit.client.1.smithi172.stdout:5/228: write d5/f1d [193414,59312] 0 2024-03-19T06:05:26.045 INFO:tasks.workunit.client.1.smithi172.stdout:6/360: stat d5/d11/d2f/l3c 0 2024-03-19T06:05:26.046 INFO:tasks.workunit.client.1.smithi172.stdout:0/269: chown d11/d14/f16 41113 1 2024-03-19T06:05:26.048 INFO:tasks.workunit.client.1.smithi172.stdout:2/195: dwrite d7/f26 [0,4194304] 0 2024-03-19T06:05:26.048 INFO:tasks.workunit.client.1.smithi172.stdout:9/233: rename d1/f4a to d1/d7/dc/d47/f53 0 2024-03-19T06:05:26.052 INFO:tasks.workunit.client.1.smithi172.stdout:9/234: write d1/fa [627568,118215] 0 2024-03-19T06:05:26.057 INFO:tasks.workunit.client.1.smithi172.stdout:9/235: fsync d1/f9 0 2024-03-19T06:05:26.058 INFO:tasks.workunit.client.1.smithi172.stdout:3/275: dwrite d0/d5/d9/d34/d4d/f49 [0,4194304] 0 2024-03-19T06:05:26.058 INFO:tasks.workunit.client.1.smithi172.stdout:2/196: chown d7/db/f32 115 1 2024-03-19T06:05:26.059 INFO:tasks.workunit.client.1.smithi172.stdout:6/361: mknod d5/d11/d17/d1b/c6e 0 2024-03-19T06:05:26.061 INFO:tasks.workunit.client.1.smithi172.stdout:8/230: mkdir d0/d44/d46 0 2024-03-19T06:05:26.065 INFO:tasks.workunit.client.1.smithi172.stdout:3/276: mknod d0/d37/c68 0 2024-03-19T06:05:26.070 INFO:tasks.workunit.client.1.smithi172.stdout:6/362: rename d5/d16 to d5/d11/d35/d6f 0 2024-03-19T06:05:26.071 INFO:tasks.workunit.client.1.smithi172.stdout:0/270: getdents d11/d18/d38/d3f/d43 0 2024-03-19T06:05:26.075 INFO:tasks.workunit.client.1.smithi172.stdout:4/263: sync 2024-03-19T06:05:26.077 INFO:tasks.workunit.client.1.smithi172.stdout:3/277: unlink d0/d5/d14/f16 0 2024-03-19T06:05:26.079 INFO:tasks.workunit.client.1.smithi172.stdout:6/363: write d5/fb [2359992,92050] 0 2024-03-19T06:05:26.082 INFO:tasks.workunit.client.1.smithi172.stdout:3/278: dread - d0/d5/d14/d52/f5e zero size 2024-03-19T06:05:26.082 INFO:tasks.workunit.client.1.smithi172.stdout:5/229: dwrite d5/d14/f19 [0,4194304] 0 2024-03-19T06:05:26.084 INFO:tasks.workunit.client.1.smithi172.stdout:0/271: truncate d11/d14/d2c/d36/f53 958513 0 2024-03-19T06:05:26.088 INFO:tasks.workunit.client.1.smithi172.stdout:8/231: dread d0/d10/d27/d29/f33 [0,4194304] 0 2024-03-19T06:05:26.088 INFO:tasks.workunit.client.1.smithi172.stdout:1/311: truncate da/dd/f1f 923799 0 2024-03-19T06:05:26.090 INFO:tasks.workunit.client.1.smithi172.stdout:5/230: mknod d5/d14/d34/c51 0 2024-03-19T06:05:26.094 INFO:tasks.workunit.client.1.smithi172.stdout:8/232: read d0/d17/d26/f3e [2955101,105952] 0 2024-03-19T06:05:26.094 INFO:tasks.workunit.client.1.smithi172.stdout:6/364: creat d5/d2c/f70 x:0 0 0 2024-03-19T06:05:26.095 INFO:tasks.workunit.client.1.smithi172.stdout:5/231: fdatasync d5/fe 0 2024-03-19T06:05:26.098 INFO:tasks.workunit.client.1.smithi172.stdout:4/264: creat df/f4d x:0 0 0 2024-03-19T06:05:26.100 INFO:tasks.workunit.client.1.smithi172.stdout:5/232: dread - d5/d14/f49 zero size 2024-03-19T06:05:26.102 INFO:tasks.workunit.client.1.smithi172.stdout:0/272: link d11/d22/f34 d11/d4d/f5a 0 2024-03-19T06:05:26.103 INFO:tasks.workunit.client.1.smithi172.stdout:1/312: truncate da/dd/d10/f24 2810799 0 2024-03-19T06:05:26.105 INFO:tasks.workunit.client.1.smithi172.stdout:4/265: dread - df/d11/f49 zero size 2024-03-19T06:05:26.107 INFO:tasks.workunit.client.1.smithi172.stdout:6/365: symlink d5/d11/d43/d45/l71 0 2024-03-19T06:05:26.109 INFO:tasks.workunit.client.1.smithi172.stdout:8/233: rename d0/d17/f21 to d0/d10/d2b/f47 0 2024-03-19T06:05:26.110 INFO:tasks.workunit.client.1.smithi172.stdout:5/233: creat d5/d14/d34/f52 x:0 0 0 2024-03-19T06:05:26.112 INFO:tasks.workunit.client.1.smithi172.stdout:1/313: truncate da/d33/f57 36722 0 2024-03-19T06:05:26.113 INFO:tasks.workunit.client.1.smithi172.stdout:2/197: dread d7/de/f29 [0,4194304] 0 2024-03-19T06:05:26.114 INFO:tasks.workunit.client.1.smithi172.stdout:7/222: sync 2024-03-19T06:05:26.117 INFO:tasks.workunit.client.1.smithi172.stdout:0/273: getdents d11/d18/d38 0 2024-03-19T06:05:26.119 INFO:tasks.workunit.client.1.smithi172.stdout:2/198: mknod d7/de/c40 0 2024-03-19T06:05:26.119 INFO:tasks.workunit.client.1.smithi172.stdout:3/279: dwrite d0/d5/d9/f2c [0,4194304] 0 2024-03-19T06:05:26.126 INFO:tasks.workunit.client.1.smithi172.stdout:9/236: dread d1/d7/dc/d31/f2b [0,4194304] 0 2024-03-19T06:05:26.129 INFO:tasks.workunit.client.1.smithi172.stdout:8/234: rename d0/d10/d2b/f3f to d0/d17/d26/f48 0 2024-03-19T06:05:26.137 INFO:tasks.workunit.client.1.smithi172.stdout:9/237: rmdir d1/d7/dc/de/d34/d48 39 2024-03-19T06:05:26.137 INFO:tasks.workunit.client.1.smithi172.stdout:4/266: dread df/d2b/d2d/f38 [0,4194304] 0 2024-03-19T06:05:26.139 INFO:tasks.workunit.client.1.smithi172.stdout:3/280: creat d0/d5/d9/d60/d67/f69 x:0 0 0 2024-03-19T06:05:26.140 INFO:tasks.workunit.client.1.smithi172.stdout:6/366: dwrite d5/d11/d17/d1b/f25 [0,4194304] 0 2024-03-19T06:05:26.140 INFO:tasks.workunit.client.1.smithi172.stdout:0/274: symlink d11/d18/l5b 0 2024-03-19T06:05:26.143 INFO:tasks.workunit.client.1.smithi172.stdout:5/234: dwrite d5/d14/d34/f3f [0,4194304] 0 2024-03-19T06:05:26.150 INFO:tasks.workunit.client.1.smithi172.stdout:7/223: rename d0/f29 to d0/d22/d1d/d3a/d46/f4d 0 2024-03-19T06:05:26.151 INFO:tasks.workunit.client.1.smithi172.stdout:4/267: creat df/d11/d12/d34/f4e x:0 0 0 2024-03-19T06:05:26.155 INFO:tasks.workunit.client.1.smithi172.stdout:0/275: creat d11/d18/d38/d3f/f5c x:0 0 0 2024-03-19T06:05:26.155 INFO:tasks.workunit.client.1.smithi172.stdout:5/235: mkdir d5/d1f/d2f/d53 0 2024-03-19T06:05:26.156 INFO:tasks.workunit.client.1.smithi172.stdout:9/238: mkdir d1/d7/dc/d4c/d54 0 2024-03-19T06:05:26.160 INFO:tasks.workunit.client.1.smithi172.stdout:8/235: rename d0/d17 to d0/d44/d46/d49 0 2024-03-19T06:05:26.162 INFO:tasks.workunit.client.1.smithi172.stdout:0/276: write f7 [2709213,43967] 0 2024-03-19T06:05:26.162 INFO:tasks.workunit.client.1.smithi172.stdout:4/268: symlink df/d45/l4f 0 2024-03-19T06:05:26.168 INFO:tasks.workunit.client.1.smithi172.stdout:9/239: mknod d1/d7/dc/d47/c55 0 2024-03-19T06:05:26.169 INFO:tasks.workunit.client.1.smithi172.stdout:8/236: read - d0/d44/d46/d49/d3a/f41 zero size 2024-03-19T06:05:26.169 INFO:tasks.workunit.client.1.smithi172.stdout:1/314: truncate da/dd/f1f 146847 0 2024-03-19T06:05:26.172 INFO:tasks.workunit.client.1.smithi172.stdout:5/236: rename d5/d14/f49 to d5/d14/d15/d40/f54 0 2024-03-19T06:05:26.172 INFO:tasks.workunit.client.1.smithi172.stdout:6/367: dwrite d5/d2c/f6b [0,4194304] 0 2024-03-19T06:05:26.175 INFO:tasks.workunit.client.1.smithi172.stdout:0/277: chown d11/d18/d38/d3f/d43/l56 603221194 1 2024-03-19T06:05:26.179 INFO:tasks.workunit.client.1.smithi172.stdout:2/199: dwrite d7/f8 [0,4194304] 0 2024-03-19T06:05:26.182 INFO:tasks.workunit.client.1.smithi172.stdout:1/315: mknod da/dd/d10/d14/d27/c65 0 2024-03-19T06:05:26.182 INFO:tasks.workunit.client.1.smithi172.stdout:6/368: dread - d5/d2c/d31/f60 zero size 2024-03-19T06:05:26.187 INFO:tasks.workunit.client.1.smithi172.stdout:2/200: chown d7/db 1 1 2024-03-19T06:05:26.189 INFO:tasks.workunit.client.1.smithi172.stdout:2/201: read d7/db/f16 [9270,126034] 0 2024-03-19T06:05:26.190 INFO:tasks.workunit.client.1.smithi172.stdout:0/278: mknod d11/d14/d2c/d36/c5d 0 2024-03-19T06:05:26.195 INFO:tasks.workunit.client.1.smithi172.stdout:5/237: dread d5/d3c/f4e [0,4194304] 0 2024-03-19T06:05:26.195 INFO:tasks.workunit.client.1.smithi172.stdout:6/369: symlink d5/d11/d43/d45/l72 0 2024-03-19T06:05:26.201 INFO:tasks.workunit.client.1.smithi172.stdout:0/279: write d11/d22/d32/f58 [263006,106898] 0 2024-03-19T06:05:26.205 INFO:tasks.workunit.client.1.smithi172.stdout:6/370: write d5/f8 [1494203,8835] 0 2024-03-19T06:05:26.207 INFO:tasks.workunit.client.1.smithi172.stdout:0/280: fdatasync d11/d22/f4a 0 2024-03-19T06:05:26.208 INFO:tasks.workunit.client.1.smithi172.stdout:3/281: dwrite d0/d5/d14/f27 [0,4194304] 0 2024-03-19T06:05:26.213 INFO:tasks.workunit.client.1.smithi172.stdout:9/240: truncate d1/d7/dc/d23/f33 999045 0 2024-03-19T06:05:26.219 INFO:tasks.workunit.client.1.smithi172.stdout:0/281: write d11/d18/d38/f55 [472675,5944] 0 2024-03-19T06:05:26.220 INFO:tasks.workunit.client.1.smithi172.stdout:1/316: dread da/d3b/f3d [0,4194304] 0 2024-03-19T06:05:26.222 INFO:tasks.workunit.client.1.smithi172.stdout:6/371: truncate d5/d11/d17/d1b/f69 951143 0 2024-03-19T06:05:26.233 INFO:tasks.workunit.client.1.smithi172.stdout:8/237: dwrite d0/d44/d46/d49/d26/f3e [0,4194304] 0 2024-03-19T06:05:26.233 INFO:tasks.workunit.client.1.smithi172.stdout:2/202: dwrite d7/db/d14/f2b [0,4194304] 0 2024-03-19T06:05:26.233 INFO:tasks.workunit.client.1.smithi172.stdout:7/224: dread d0/d22/f1b [0,4194304] 0 2024-03-19T06:05:26.238 INFO:tasks.workunit.client.1.smithi172.stdout:2/203: truncate d7/db/f16 4231424 0 2024-03-19T06:05:26.241 INFO:tasks.workunit.client.1.smithi172.stdout:6/372: rename d5/c51 to d5/c73 0 2024-03-19T06:05:26.243 INFO:tasks.workunit.client.1.smithi172.stdout:2/204: fdatasync d7/d1b/f22 0 2024-03-19T06:05:26.251 INFO:tasks.workunit.client.1.smithi172.stdout:5/238: dread d5/fd [0,4194304] 0 2024-03-19T06:05:26.252 INFO:tasks.workunit.client.1.smithi172.stdout:8/238: link d0/f11 d0/d10/f4a 0 2024-03-19T06:05:26.254 INFO:tasks.workunit.client.1.smithi172.stdout:7/225: write d0/d22/d1d/d36/f1f [1156029,122972] 0 2024-03-19T06:05:26.256 INFO:tasks.workunit.client.1.smithi172.stdout:8/239: chown d0/cc 0 1 2024-03-19T06:05:26.257 INFO:tasks.workunit.client.1.smithi172.stdout:5/239: fdatasync d5/ff 0 2024-03-19T06:05:26.257 INFO:tasks.workunit.client.1.smithi172.stdout:2/205: creat d7/db/d2c/d35/f41 x:0 0 0 2024-03-19T06:05:26.261 INFO:tasks.workunit.client.1.smithi172.stdout:1/317: dwrite da/dd/d10/d36/f4c [0,4194304] 0 2024-03-19T06:05:26.265 INFO:tasks.workunit.client.1.smithi172.stdout:1/318: dread - da/dd/d10/f64 zero size 2024-03-19T06:05:26.265 INFO:tasks.workunit.client.1.smithi172.stdout:2/206: truncate d7/db/f32 228748 0 2024-03-19T06:05:26.268 INFO:tasks.workunit.client.1.smithi172.stdout:8/240: write d0/d10/d27/f2e [324020,8775] 0 2024-03-19T06:05:26.270 INFO:tasks.workunit.client.1.smithi172.stdout:9/241: dwrite d1/d7/dc/de/f1d [0,4194304] 0 2024-03-19T06:05:26.271 INFO:tasks.workunit.client.1.smithi172.stdout:8/241: fdatasync d0/f2d 0 2024-03-19T06:05:26.278 INFO:tasks.workunit.client.1.smithi172.stdout:9/242: dread d1/d7/f2e [0,4194304] 0 2024-03-19T06:05:26.279 INFO:tasks.workunit.client.1.smithi172.stdout:9/243: stat d1/l20 0 2024-03-19T06:05:26.280 INFO:tasks.workunit.client.1.smithi172.stdout:7/226: rename d0/d22/d27/f3e to d0/d22/d1d/d36/d40/f4e 0 2024-03-19T06:05:26.283 INFO:tasks.workunit.client.1.smithi172.stdout:4/269: dread df/d11/d12/f1a [0,4194304] 0 2024-03-19T06:05:26.288 INFO:tasks.workunit.client.1.smithi172.stdout:0/282: dread d11/d4d/f5a [0,4194304] 0 2024-03-19T06:05:26.288 INFO:tasks.workunit.client.1.smithi172.stdout:0/283: fdatasync f7 0 2024-03-19T06:05:26.288 INFO:tasks.workunit.client.1.smithi172.stdout:0/284: readlink l9 0 2024-03-19T06:05:26.289 INFO:tasks.workunit.client.1.smithi172.stdout:2/207: link d7/db/f27 d7/de/f42 0 2024-03-19T06:05:26.291 INFO:tasks.workunit.client.1.smithi172.stdout:2/208: chown d7/de 14607 1 2024-03-19T06:05:26.291 INFO:tasks.workunit.client.1.smithi172.stdout:7/227: mknod d0/d22/d27/c4f 0 2024-03-19T06:05:26.293 INFO:tasks.workunit.client.1.smithi172.stdout:1/319: creat da/d33/d4e/d60/f66 x:0 0 0 2024-03-19T06:05:26.296 INFO:tasks.workunit.client.1.smithi172.stdout:4/270: write df/d11/d12/d26/f43 [176445,11708] 0 2024-03-19T06:05:26.297 INFO:tasks.workunit.client.1.smithi172.stdout:0/285: rmdir d11 39 2024-03-19T06:05:26.297 INFO:tasks.workunit.client.1.smithi172.stdout:7/228: mknod d0/d22/d1d/d3a/c50 0 2024-03-19T06:05:26.303 INFO:tasks.workunit.client.1.smithi172.stdout:9/244: creat d1/f56 x:0 0 0 2024-03-19T06:05:26.304 INFO:tasks.workunit.client.1.smithi172.stdout:4/271: write df/d11/d12/d21/f4b [754746,15526] 0 2024-03-19T06:05:26.310 INFO:tasks.workunit.client.1.smithi172.stdout:1/320: mknod da/d33/d4e/d60/c67 0 2024-03-19T06:05:26.310 INFO:tasks.workunit.client.1.smithi172.stdout:8/242: getdents d0/d44/d46/d49/d26 0 2024-03-19T06:05:26.311 INFO:tasks.workunit.client.1.smithi172.stdout:0/286: creat d11/d18/d38/d3f/f5e x:0 0 0 2024-03-19T06:05:26.311 INFO:tasks.workunit.client.1.smithi172.stdout:7/229: write d0/d22/d1d/d36/f23 [1289746,68257] 0 2024-03-19T06:05:26.311 INFO:tasks.workunit.client.1.smithi172.stdout:1/321: fsync da/f5f 0 2024-03-19T06:05:26.312 INFO:tasks.workunit.client.1.smithi172.stdout:2/209: getdents d7/db/d14 0 2024-03-19T06:05:26.312 INFO:tasks.workunit.client.1.smithi172.stdout:4/272: read - df/d11/d12/d26/f30 zero size 2024-03-19T06:05:26.315 INFO:tasks.workunit.client.1.smithi172.stdout:4/273: stat df/d11/c36 0 2024-03-19T06:05:26.317 INFO:tasks.workunit.client.1.smithi172.stdout:3/282: dread d0/d5/d9/d34/f59 [0,4194304] 0 2024-03-19T06:05:26.317 INFO:tasks.workunit.client.1.smithi172.stdout:0/287: rmdir d11/d18/d38 39 2024-03-19T06:05:26.319 INFO:tasks.workunit.client.1.smithi172.stdout:1/322: stat da/dd/d31/f4d 0 2024-03-19T06:05:26.322 INFO:tasks.workunit.client.1.smithi172.stdout:2/210: mkdir d7/d43 0 2024-03-19T06:05:26.323 INFO:tasks.workunit.client.1.smithi172.stdout:6/373: dread d5/d2c/d31/f67 [0,4194304] 0 2024-03-19T06:05:26.323 INFO:tasks.workunit.client.1.smithi172.stdout:0/288: unlink d11/d18/f2f 0 2024-03-19T06:05:26.326 INFO:tasks.workunit.client.1.smithi172.stdout:2/211: readlink d7/db/d2c/d35/l36 0 2024-03-19T06:05:26.327 INFO:tasks.workunit.client.1.smithi172.stdout:8/243: getdents d0/d10 0 2024-03-19T06:05:26.328 INFO:tasks.workunit.client.1.smithi172.stdout:3/283: write d0/d5/d9/d34/f59 [2252365,13186] 0 2024-03-19T06:05:26.328 INFO:tasks.workunit.client.1.smithi172.stdout:0/289: rename d11/d14/d2c/d4e to d11/d14/d2c/d4e/d5f 22 2024-03-19T06:05:26.329 INFO:tasks.workunit.client.1.smithi172.stdout:7/230: truncate d0/d22/d1d/f32 1033090 0 2024-03-19T06:05:26.334 INFO:tasks.workunit.client.1.smithi172.stdout:6/374: mkdir d5/d11/d17/d1b/d74 0 2024-03-19T06:05:26.334 INFO:tasks.workunit.client.1.smithi172.stdout:2/212: write d7/db/d14/f1c [440598,96690] 0 2024-03-19T06:05:26.335 INFO:tasks.workunit.client.1.smithi172.stdout:6/375: stat d5/f13 0 2024-03-19T06:05:26.336 INFO:tasks.workunit.client.1.smithi172.stdout:1/323: dread da/dd/d10/f50 [0,4194304] 0 2024-03-19T06:05:26.336 INFO:tasks.workunit.client.1.smithi172.stdout:8/244: creat d0/d10/d2b/f4b x:0 0 0 2024-03-19T06:05:26.339 INFO:tasks.workunit.client.1.smithi172.stdout:3/284: symlink d0/d5/d9/d60/d67/l6a 0 2024-03-19T06:05:26.340 INFO:tasks.workunit.client.1.smithi172.stdout:2/213: dread - d7/db/f24 zero size 2024-03-19T06:05:26.345 INFO:tasks.workunit.client.1.smithi172.stdout:7/231: rename d0/d22/d3d/c44 to d0/d22/d1d/d3a/d46/c51 0 2024-03-19T06:05:26.347 INFO:tasks.workunit.client.1.smithi172.stdout:8/245: creat d0/d10/d27/d29/f4c x:0 0 0 2024-03-19T06:05:26.347 INFO:tasks.workunit.client.1.smithi172.stdout:0/290: creat d11/f60 x:0 0 0 2024-03-19T06:05:26.348 INFO:tasks.workunit.client.1.smithi172.stdout:1/324: unlink c8 0 2024-03-19T06:05:26.351 INFO:tasks.workunit.client.1.smithi172.stdout:6/376: rename d5/d11/d35/d6f to d5/d11/d35/d40/d53/d75 0 2024-03-19T06:05:26.354 INFO:tasks.workunit.client.1.smithi172.stdout:9/245: dread d1/f6 [0,4194304] 0 2024-03-19T06:05:26.354 INFO:tasks.workunit.client.1.smithi172.stdout:0/291: chown d11/d22/d32/f44 0 1 2024-03-19T06:05:26.356 INFO:tasks.workunit.client.1.smithi172.stdout:6/377: read - d5/d11/d35/f68 zero size 2024-03-19T06:05:26.356 INFO:tasks.workunit.client.1.smithi172.stdout:8/246: symlink d0/d10/d27/d29/d28/l4d 0 2024-03-19T06:05:26.363 INFO:tasks.workunit.client.1.smithi172.stdout:3/285: dwrite d0/d5/d9/d34/d4d/f2d [0,4194304] 0 2024-03-19T06:05:26.364 INFO:tasks.workunit.client.1.smithi172.stdout:9/246: mkdir d1/d7/dc/d4c/d57 0 2024-03-19T06:05:26.367 INFO:tasks.workunit.client.1.smithi172.stdout:6/378: rmdir d5/d11/d35 39 2024-03-19T06:05:26.367 INFO:tasks.workunit.client.1.smithi172.stdout:7/232: truncate d0/d22/d1d/d36/f1f 3022606 0 2024-03-19T06:05:26.367 INFO:tasks.workunit.client.1.smithi172.stdout:2/214: dwrite d7/de/f29 [0,4194304] 0 2024-03-19T06:05:26.373 INFO:tasks.workunit.client.1.smithi172.stdout:9/247: symlink d1/d7/l58 0 2024-03-19T06:05:26.373 INFO:tasks.workunit.client.1.smithi172.stdout:3/286: fsync d0/d5/d9/d34/d4d/f5c 0 2024-03-19T06:05:26.377 INFO:tasks.workunit.client.1.smithi172.stdout:1/325: rename da/d33/d4e/d60/f66 to da/dd/d10/f68 0 2024-03-19T06:05:26.381 INFO:tasks.workunit.client.1.smithi172.stdout:1/326: write da/d33/d52/f55 [1045742,27035] 0 2024-03-19T06:05:26.386 INFO:tasks.workunit.client.1.smithi172.stdout:3/287: unlink d0/f5a 0 2024-03-19T06:05:26.386 INFO:tasks.workunit.client.1.smithi172.stdout:6/379: read d5/d11/d35/d40/d53/d75/f18 [815763,119834] 0 2024-03-19T06:05:26.387 INFO:tasks.workunit.client.1.smithi172.stdout:8/247: link d0/l13 d0/d10/d27/d29/d28/l4e 0 2024-03-19T06:05:26.389 INFO:tasks.workunit.client.1.smithi172.stdout:0/292: link ce d11/d14/d2c/d36/c61 0 2024-03-19T06:05:26.389 INFO:tasks.workunit.client.1.smithi172.stdout:8/248: chown d0/d10/l1b 125 1 2024-03-19T06:05:26.390 INFO:tasks.workunit.client.1.smithi172.stdout:7/233: dwrite d0/d22/d1d/d3a/f3f [0,4194304] 0 2024-03-19T06:05:26.391 INFO:tasks.workunit.client.1.smithi172.stdout:0/293: read - d11/d14/f4b zero size 2024-03-19T06:05:26.401 INFO:tasks.workunit.client.1.smithi172.stdout:7/234: write d0/d22/f26 [2038879,62551] 0 2024-03-19T06:05:26.401 INFO:tasks.workunit.client.1.smithi172.stdout:6/380: symlink d5/d11/d17/d1b/l76 0 2024-03-19T06:05:26.401 INFO:tasks.workunit.client.1.smithi172.stdout:8/249: mkdir d0/d44/d46/d49/d4f 0 2024-03-19T06:05:26.404 INFO:tasks.workunit.client.1.smithi172.stdout:9/248: getdents d1/d7/dc/de 0 2024-03-19T06:05:26.404 INFO:tasks.workunit.client.1.smithi172.stdout:3/288: mkdir d0/d5/d6b 0 2024-03-19T06:05:26.405 INFO:tasks.workunit.client.1.smithi172.stdout:1/327: dread da/dd/f1f [0,4194304] 0 2024-03-19T06:05:26.408 INFO:tasks.workunit.client.1.smithi172.stdout:9/249: rmdir d1 39 2024-03-19T06:05:26.408 INFO:tasks.workunit.client.1.smithi172.stdout:6/381: mknod d5/c77 0 2024-03-19T06:05:26.409 INFO:tasks.workunit.client.1.smithi172.stdout:3/289: dread - d0/d5/d9/d60/d67/f69 zero size 2024-03-19T06:05:26.410 INFO:tasks.workunit.client.1.smithi172.stdout:7/235: mknod d0/d22/d3d/d41/c52 0 2024-03-19T06:05:26.415 INFO:tasks.workunit.client.1.smithi172.stdout:3/290: mkdir d0/d5/d9/d34/d4d/d6c 0 2024-03-19T06:05:26.415 INFO:tasks.workunit.client.1.smithi172.stdout:6/382: chown d5/d11/d35/d40/d53/d75/c3f 8485545 1 2024-03-19T06:05:26.416 INFO:tasks.workunit.client.1.smithi172.stdout:1/328: rename da/dd/d10/d14/d27/c3a to da/d33/c69 0 2024-03-19T06:05:26.418 INFO:tasks.workunit.client.1.smithi172.stdout:9/250: symlink d1/d7/dc/d23/l59 0 2024-03-19T06:05:26.418 INFO:tasks.workunit.client.1.smithi172.stdout:0/294: dwrite d11/d22/f3d [0,4194304] 0 2024-03-19T06:05:26.420 INFO:tasks.workunit.client.1.smithi172.stdout:6/383: creat d5/d2c/d31/f78 x:0 0 0 2024-03-19T06:05:26.423 INFO:tasks.workunit.client.1.smithi172.stdout:1/329: symlink da/dd/d10/d36/l6a 0 2024-03-19T06:05:26.424 INFO:tasks.workunit.client.1.smithi172.stdout:7/236: getdents d0/d22 0 2024-03-19T06:05:26.426 INFO:tasks.workunit.client.1.smithi172.stdout:9/251: chown d1/d7/l3a 12713 1 2024-03-19T06:05:26.427 INFO:tasks.workunit.client.1.smithi172.stdout:0/295: unlink d11/d22/d32/l33 0 2024-03-19T06:05:26.427 INFO:tasks.workunit.client.1.smithi172.stdout:6/384: readlink d5/d11/d35/d40/l6c 0 2024-03-19T06:05:26.428 INFO:tasks.workunit.client.1.smithi172.stdout:1/330: truncate da/dd/d10/f64 305197 0 2024-03-19T06:05:26.429 INFO:tasks.workunit.client.1.smithi172.stdout:7/237: chown d0/d22/d1d/f45 509551 1 2024-03-19T06:05:26.429 INFO:tasks.workunit.client.1.smithi172.stdout:6/385: chown d5/fb 1090 1 2024-03-19T06:05:26.430 INFO:tasks.workunit.client.1.smithi172.stdout:9/252: unlink d1/d7/c1b 0 2024-03-19T06:05:26.434 INFO:tasks.workunit.client.1.smithi172.stdout:7/238: truncate d0/d22/f26 3006662 0 2024-03-19T06:05:26.436 INFO:tasks.workunit.client.1.smithi172.stdout:0/296: mkdir d11/d18/d38/d3f/d43/d62 0 2024-03-19T06:05:26.437 INFO:tasks.workunit.client.1.smithi172.stdout:3/291: dwrite d0/d5/f3d [0,4194304] 0 2024-03-19T06:05:26.438 INFO:tasks.workunit.client.1.smithi172.stdout:0/297: read d11/d4d/f5a [3971617,110058] 0 2024-03-19T06:05:26.438 INFO:tasks.workunit.client.1.smithi172.stdout:1/331: creat da/dd/d10/d14/d27/d53/f6b x:0 0 0 2024-03-19T06:05:26.479 INFO:tasks.workunit.client.1.smithi172.stdout:5/240: sync 2024-03-19T06:05:26.492 INFO:tasks.workunit.client.1.smithi172.stdout:7/239: symlink d0/l53 0 2024-03-19T06:05:26.497 INFO:tasks.workunit.client.1.smithi172.stdout:3/292: symlink d0/d5/d6b/l6d 0 2024-03-19T06:05:26.498 INFO:tasks.workunit.client.1.smithi172.stdout:0/298: creat d11/d18/d38/d59/f63 x:0 0 0 2024-03-19T06:05:26.500 INFO:tasks.workunit.client.1.smithi172.stdout:5/241: dread d5/f16 [0,4194304] 0 2024-03-19T06:05:26.500 INFO:tasks.workunit.client.1.smithi172.stdout:0/299: dread - d11/d22/f4a zero size 2024-03-19T06:05:26.505 INFO:tasks.workunit.client.1.smithi172.stdout:8/250: dread d0/f39 [0,4194304] 0 2024-03-19T06:05:26.505 INFO:tasks.workunit.client.1.smithi172.stdout:1/332: truncate da/dd/d10/d14/f5d 3661936 0 2024-03-19T06:05:26.505 INFO:tasks.workunit.client.1.smithi172.stdout:6/386: dread d5/d11/d17/d1b/f21 [0,4194304] 0 2024-03-19T06:05:26.506 INFO:tasks.workunit.client.1.smithi172.stdout:5/242: unlink d5/d1f/l4f 0 2024-03-19T06:05:26.507 INFO:tasks.workunit.client.1.smithi172.stdout:6/387: chown d5/d11/d17 1925652 1 2024-03-19T06:05:26.507 INFO:tasks.workunit.client.1.smithi172.stdout:1/333: chown da/d33/c69 0 1 2024-03-19T06:05:26.508 INFO:tasks.workunit.client.1.smithi172.stdout:0/300: read d11/d14/f1f [443961,125658] 0 2024-03-19T06:05:26.511 INFO:tasks.workunit.client.1.smithi172.stdout:8/251: truncate d0/d10/f4a 1261637 0 2024-03-19T06:05:26.513 INFO:tasks.workunit.client.1.smithi172.stdout:5/243: truncate d5/d14/d34/f3e 73625 0 2024-03-19T06:05:26.519 INFO:tasks.workunit.client.1.smithi172.stdout:1/334: truncate da/d33/f57 405770 0 2024-03-19T06:05:26.519 INFO:tasks.workunit.client.1.smithi172.stdout:6/388: mkdir d5/d11/d17/d36/d48/d79 0 2024-03-19T06:05:26.520 INFO:tasks.workunit.client.1.smithi172.stdout:1/335: stat da/cc 0 2024-03-19T06:05:26.520 INFO:tasks.workunit.client.1.smithi172.stdout:6/389: write d5/d11/d43/f64 [772890,28984] 0 2024-03-19T06:05:26.520 INFO:tasks.workunit.client.1.smithi172.stdout:8/252: mknod d0/d44/d46/d49/d26/c50 0 2024-03-19T06:05:26.522 INFO:tasks.workunit.client.1.smithi172.stdout:0/301: creat d11/d14/d2c/d4e/f64 x:0 0 0 2024-03-19T06:05:26.522 INFO:tasks.workunit.client.1.smithi172.stdout:5/244: mkdir d5/d55 0 2024-03-19T06:05:26.523 INFO:tasks.workunit.client.1.smithi172.stdout:1/336: write da/dd/f39 [927040,48183] 0 2024-03-19T06:05:26.526 INFO:tasks.workunit.client.1.smithi172.stdout:3/293: dwrite d0/d5/d9/d60/d67/f69 [0,4194304] 0 2024-03-19T06:05:26.527 INFO:tasks.workunit.client.1.smithi172.stdout:6/390: read - d5/d11/f4b zero size 2024-03-19T06:05:26.528 INFO:tasks.workunit.client.1.smithi172.stdout:7/240: dwrite d0/d22/d1d/d36/f13 [0,4194304] 0 2024-03-19T06:05:26.529 INFO:tasks.workunit.client.1.smithi172.stdout:5/245: mkdir d5/d14/d56 0 2024-03-19T06:05:26.532 INFO:tasks.workunit.client.1.smithi172.stdout:0/302: unlink d11/d14/d2c/l25 0 2024-03-19T06:05:26.534 INFO:tasks.workunit.client.1.smithi172.stdout:5/246: read d5/fe [2852575,31258] 0 2024-03-19T06:05:26.536 INFO:tasks.workunit.client.1.smithi172.stdout:1/337: symlink da/dd/d10/d14/d27/d53/l6c 0 2024-03-19T06:05:26.537 INFO:tasks.workunit.client.1.smithi172.stdout:3/294: mknod d0/d5/d6b/c6e 0 2024-03-19T06:05:26.538 INFO:tasks.workunit.client.1.smithi172.stdout:1/338: dread - da/dd/d10/f68 zero size 2024-03-19T06:05:26.540 INFO:tasks.workunit.client.1.smithi172.stdout:0/303: mkdir d11/d4d/d65 0 2024-03-19T06:05:26.542 INFO:tasks.workunit.client.1.smithi172.stdout:8/253: getdents d0/d10/d2b 0 2024-03-19T06:05:26.545 INFO:tasks.workunit.client.1.smithi172.stdout:3/295: write d0/d5/f26 [1491577,5093] 0 2024-03-19T06:05:26.547 INFO:tasks.workunit.client.1.smithi172.stdout:6/391: dread d5/d2c/d31/f5a [0,4194304] 0 2024-03-19T06:05:26.547 INFO:tasks.workunit.client.1.smithi172.stdout:5/247: read d5/d1f/f2a [1008517,39038] 0 2024-03-19T06:05:26.548 INFO:tasks.workunit.client.1.smithi172.stdout:7/241: creat d0/d22/d1d/d36/f54 x:0 0 0 2024-03-19T06:05:26.550 INFO:tasks.workunit.client.1.smithi172.stdout:1/339: write da/dd/d10/f58 [1146574,53567] 0 2024-03-19T06:05:26.553 INFO:tasks.workunit.client.1.smithi172.stdout:8/254: creat d0/d44/d46/d49/d26/f51 x:0 0 0 2024-03-19T06:05:26.558 INFO:tasks.workunit.client.1.smithi172.stdout:0/304: rename d11/d18/d38/l3e to d11/l66 0 2024-03-19T06:05:26.558 INFO:tasks.workunit.client.1.smithi172.stdout:5/248: write d5/d14/d15/d40/f54 [775327,51920] 0 2024-03-19T06:05:26.558 INFO:tasks.workunit.client.1.smithi172.stdout:1/340: fsync da/dd/d10/d14/d27/f37 0 2024-03-19T06:05:26.563 INFO:tasks.workunit.client.1.smithi172.stdout:1/341: write da/dd/d10/f58 [3721799,124770] 0 2024-03-19T06:05:26.564 INFO:tasks.workunit.client.1.smithi172.stdout:1/342: chown da/dd 2 1 2024-03-19T06:05:26.568 INFO:tasks.workunit.client.1.smithi172.stdout:1/343: mknod da/dd/d10/d36/c6d 0 2024-03-19T06:05:26.569 INFO:tasks.workunit.client.1.smithi172.stdout:6/392: write d5/d2c/d31/f57 [837717,18609] 0 2024-03-19T06:05:26.571 INFO:tasks.workunit.client.1.smithi172.stdout:3/296: dwrite d0/d5/d9/f2c [0,4194304] 0 2024-03-19T06:05:26.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:26 smithi072 ceph-mon[28706]: mgrmap e30: smithi072.jydpjk(active, since 12s), standbys: smithi172.qkcahs 2024-03-19T06:05:26.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:26 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi172.qkcahs", "id": "smithi172.qkcahs"}]: dispatch 2024-03-19T06:05:26.601 INFO:tasks.workunit.client.1.smithi172.stdout:3/297: stat d0/d5/d9/d34/d4d 0 2024-03-19T06:05:26.603 INFO:tasks.workunit.client.1.smithi172.stdout:1/344: dread da/dd/d10/d14/d27/f37 [0,4194304] 0 2024-03-19T06:05:26.607 INFO:tasks.workunit.client.1.smithi172.stdout:1/345: fsync da/dd/d10/d14/d27/d53/f6b 0 2024-03-19T06:05:26.607 INFO:tasks.workunit.client.1.smithi172.stdout:5/249: dwrite d5/d14/d34/f3e [0,4194304] 0 2024-03-19T06:05:26.611 INFO:tasks.workunit.client.1.smithi172.stdout:1/346: write da/dd/d10/d36/f4c [741336,29759] 0 2024-03-19T06:05:26.615 INFO:tasks.workunit.client.1.smithi172.stdout:6/393: rename d5/d11/d17/c1f to d5/d11/d43/d45/c7a 0 2024-03-19T06:05:26.617 INFO:tasks.workunit.client.1.smithi172.stdout:3/298: dread d0/d5/d14/f30 [0,4194304] 0 2024-03-19T06:05:26.617 INFO:tasks.workunit.client.1.smithi172.stdout:5/250: write d5/d3c/f4e [1872,111860] 0 2024-03-19T06:05:26.619 INFO:tasks.workunit.client.1.smithi172.stdout:6/394: readlink d5/d11/d43/d45/l71 0 2024-03-19T06:05:26.621 INFO:tasks.workunit.client.1.smithi172.stdout:3/299: chown d0/d37/c68 101791 1 2024-03-19T06:05:26.622 INFO:tasks.workunit.client.1.smithi172.stdout:8/255: dread d0/d10/d27/f1e [0,4194304] 0 2024-03-19T06:05:26.624 INFO:tasks.workunit.client.1.smithi172.stdout:7/242: dread d0/d22/d1d/d36/f1f [0,4194304] 0 2024-03-19T06:05:26.627 INFO:tasks.workunit.client.1.smithi172.stdout:7/243: truncate d0/d2c/f3c 246437 0 2024-03-19T06:05:26.630 INFO:tasks.workunit.client.1.smithi172.stdout:7/244: fdatasync d0/d22/d1d/d36/fc 0 2024-03-19T06:05:26.631 INFO:tasks.workunit.client.1.smithi172.stdout:8/256: symlink d0/l52 0 2024-03-19T06:05:26.631 INFO:tasks.workunit.client.1.smithi172.stdout:1/347: getdents da/dd/d10/d14/d27/d3f 0 2024-03-19T06:05:26.632 INFO:tasks.workunit.client.1.smithi172.stdout:5/251: link d5/d3c/l4a d5/d1f/l57 0 2024-03-19T06:05:26.636 INFO:tasks.workunit.client.1.smithi172.stdout:5/252: read d5/f1d [469440,27111] 0 2024-03-19T06:05:26.636 INFO:tasks.workunit.client.1.smithi172.stdout:7/245: dread d0/d2c/f3c [0,4194304] 0 2024-03-19T06:05:26.638 INFO:tasks.workunit.client.1.smithi172.stdout:7/246: fdatasync d0/d22/d1d/d36/f54 0 2024-03-19T06:05:26.639 INFO:tasks.workunit.client.1.smithi172.stdout:8/257: mknod d0/d44/d46/d49/d26/c53 0 2024-03-19T06:05:26.640 INFO:tasks.workunit.client.1.smithi172.stdout:3/300: truncate d0/d5/f23 941743 0 2024-03-19T06:05:26.641 INFO:tasks.workunit.client.1.smithi172.stdout:6/395: dwrite d5/d2c/d31/f57 [0,4194304] 0 2024-03-19T06:05:26.643 INFO:tasks.workunit.client.1.smithi172.stdout:8/258: chown d0/f9 790660 1 2024-03-19T06:05:26.644 INFO:tasks.workunit.client.1.smithi172.stdout:7/247: read d0/d22/d1d/d36/fc [218920,34775] 0 2024-03-19T06:05:26.645 INFO:tasks.workunit.client.1.smithi172.stdout:5/253: creat d5/f58 x:0 0 0 2024-03-19T06:05:26.646 INFO:tasks.workunit.client.1.smithi172.stdout:3/301: stat d0/d5/d9/d25/l45 0 2024-03-19T06:05:26.647 INFO:tasks.workunit.client.1.smithi172.stdout:5/254: readlink d5/d14/l28 0 2024-03-19T06:05:26.647 INFO:tasks.workunit.client.1.smithi172.stdout:6/396: mkdir d5/d2c/d31/d7b 0 2024-03-19T06:05:26.649 INFO:tasks.workunit.client.1.smithi172.stdout:1/348: rename da/d33/c69 to da/d3b/c6e 0 2024-03-19T06:05:26.652 INFO:tasks.workunit.client.1.smithi172.stdout:4/274: sync 2024-03-19T06:05:26.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:26 smithi172 ceph-mon[35716]: mgrmap e30: smithi072.jydpjk(active, since 12s), standbys: smithi172.qkcahs 2024-03-19T06:05:26.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:26 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi172.qkcahs", "id": "smithi172.qkcahs"}]: dispatch 2024-03-19T06:05:26.654 INFO:tasks.workunit.client.1.smithi172.stdout:3/302: mknod d0/d5/d9/d25/c6f 0 2024-03-19T06:05:26.654 INFO:tasks.workunit.client.1.smithi172.stdout:6/397: mkdir d5/d11/d43/d45/d7c 0 2024-03-19T06:05:26.658 INFO:tasks.workunit.client.1.smithi172.stdout:8/259: mknod d0/d44/d46/d49/d3a/d3d/c54 0 2024-03-19T06:05:26.659 INFO:tasks.workunit.client.1.smithi172.stdout:8/260: fdatasync d0/f2d 0 2024-03-19T06:05:26.659 INFO:tasks.workunit.client.1.smithi172.stdout:7/248: mknod d0/c55 0 2024-03-19T06:05:26.660 INFO:tasks.workunit.client.1.smithi172.stdout:5/255: mknod d5/d55/c59 0 2024-03-19T06:05:26.661 INFO:tasks.workunit.client.1.smithi172.stdout:5/256: stat l1 0 2024-03-19T06:05:26.661 INFO:tasks.workunit.client.1.smithi172.stdout:8/261: chown d0/d44/d46/d49/d3a/d3d/c54 470641 1 2024-03-19T06:05:26.662 INFO:tasks.workunit.client.1.smithi172.stdout:4/275: unlink df/d11/d12/l3a 0 2024-03-19T06:05:26.664 INFO:tasks.workunit.client.1.smithi172.stdout:6/398: creat d5/d11/d17/d36/d48/f7d x:0 0 0 2024-03-19T06:05:26.664 INFO:tasks.workunit.client.1.smithi172.stdout:8/262: chown d0/d10/d27/f38 25 1 2024-03-19T06:05:26.665 INFO:tasks.workunit.client.1.smithi172.stdout:3/303: creat d0/d5/d9/d54/f70 x:0 0 0 2024-03-19T06:05:26.667 INFO:tasks.workunit.client.1.smithi172.stdout:5/257: write d5/d14/f4d [1069217,126668] 0 2024-03-19T06:05:26.669 INFO:tasks.workunit.client.1.smithi172.stdout:5/258: stat d5/d14/l41 0 2024-03-19T06:05:26.669 INFO:tasks.workunit.client.1.smithi172.stdout:7/249: mkdir d0/d22/d1d/d36/d56 0 2024-03-19T06:05:26.669 INFO:tasks.workunit.client.1.smithi172.stdout:3/304: readlink d0/d5/d9/d25/d21/l4b 0 2024-03-19T06:05:26.674 INFO:tasks.workunit.client.1.smithi172.stdout:7/250: chown d0/c4 675 1 2024-03-19T06:05:26.676 INFO:tasks.workunit.client.1.smithi172.stdout:5/259: creat d5/d3c/f5a x:0 0 0 2024-03-19T06:05:26.678 INFO:tasks.workunit.client.1.smithi172.stdout:6/399: mkdir d5/d2c/d31/d7b/d7e 0 2024-03-19T06:05:26.679 INFO:tasks.workunit.client.1.smithi172.stdout:1/349: symlink da/d3b/l6f 0 2024-03-19T06:05:26.681 INFO:tasks.workunit.client.1.smithi172.stdout:7/251: symlink d0/d22/d1d/d36/d40/l57 0 2024-03-19T06:05:26.685 INFO:tasks.workunit.client.1.smithi172.stdout:3/305: rename d0/d5/d14/c4f to d0/d5/d9/d60/d67/c71 0 2024-03-19T06:05:26.686 INFO:tasks.workunit.client.1.smithi172.stdout:6/400: creat d5/d2c/d31/d7b/f7f x:0 0 0 2024-03-19T06:05:26.689 INFO:tasks.workunit.client.1.smithi172.stdout:8/263: dwrite d0/d10/d27/f1e [0,4194304] 0 2024-03-19T06:05:26.694 INFO:tasks.workunit.client.1.smithi172.stdout:5/260: rename d5/d14/d34/f3a to d5/d3d/f5b 0 2024-03-19T06:05:26.696 INFO:tasks.workunit.client.1.smithi172.stdout:3/306: write d0/d5/d9/d25/f58 [732555,20395] 0 2024-03-19T06:05:26.697 INFO:tasks.workunit.client.1.smithi172.stdout:8/264: mkdir d0/d10/d27/d29/d28/d55 0 2024-03-19T06:05:26.701 INFO:tasks.workunit.client.1.smithi172.stdout:1/350: rename da/dd/d10/d14/c25 to da/dd/d10/d36/c70 0 2024-03-19T06:05:26.701 INFO:tasks.workunit.client.1.smithi172.stdout:4/276: dread df/f3d [0,4194304] 0 2024-03-19T06:05:26.702 INFO:tasks.workunit.client.1.smithi172.stdout:5/261: mkdir d5/d14/d15/d40/d5c 0 2024-03-19T06:05:26.724 INFO:tasks.workunit.client.1.smithi172.stdout:3/307: mkdir d0/d37/d72 0 2024-03-19T06:05:26.725 INFO:tasks.workunit.client.1.smithi172.stdout:8/265: creat d0/d10/f56 x:0 0 0 2024-03-19T06:05:26.725 INFO:tasks.workunit.client.1.smithi172.stdout:7/252: dread d0/d22/d1d/d36/f13 [0,4194304] 0 2024-03-19T06:05:26.726 INFO:tasks.workunit.client.1.smithi172.stdout:1/351: write da/dd/d10/f64 [300500,756] 0 2024-03-19T06:05:26.727 INFO:tasks.workunit.client.1.smithi172.stdout:4/277: fsync df/d11/d12/d21/f4b 0 2024-03-19T06:05:26.728 INFO:tasks.workunit.client.1.smithi172.stdout:3/308: stat d0/d5/d9/d25/d21/f50 0 2024-03-19T06:05:26.728 INFO:tasks.workunit.client.1.smithi172.stdout:7/253: fsync d0/d22/d1d/d3a/f3f 0 2024-03-19T06:05:26.729 INFO:tasks.workunit.client.1.smithi172.stdout:5/262: symlink d5/d14/d15/d40/l5d 0 2024-03-19T06:05:26.733 INFO:tasks.workunit.client.1.smithi172.stdout:3/309: creat d0/d5/d9/d60/d67/f73 x:0 0 0 2024-03-19T06:05:26.733 INFO:tasks.workunit.client.1.smithi172.stdout:5/263: write d5/d3c/f5a [283338,27955] 0 2024-03-19T06:05:26.734 INFO:tasks.workunit.client.1.smithi172.stdout:7/254: fsync d0/d22/d1d/f4c 0 2024-03-19T06:05:26.734 INFO:tasks.workunit.client.1.smithi172.stdout:4/278: mkdir df/d11/d12/d21/d50 0 2024-03-19T06:05:26.736 INFO:tasks.workunit.client.1.smithi172.stdout:1/352: creat da/dd/d10/d14/d27/d53/f71 x:0 0 0 2024-03-19T06:05:26.739 INFO:tasks.workunit.client.1.smithi172.stdout:5/264: symlink d5/d14/d56/l5e 0 2024-03-19T06:05:26.742 INFO:tasks.workunit.client.1.smithi172.stdout:3/310: rename d0/d5/d14/d52/f5e to d0/d5/d9/d25/f74 0 2024-03-19T06:05:26.743 INFO:tasks.workunit.client.1.smithi172.stdout:5/265: creat d5/d55/f5f x:0 0 0 2024-03-19T06:05:26.747 INFO:tasks.workunit.client.1.smithi172.stdout:5/266: mkdir d5/d3d/d60 0 2024-03-19T06:05:26.751 INFO:tasks.workunit.client.1.smithi172.stdout:3/311: mknod d0/d5/d9/d34/d4d/d6c/c75 0 2024-03-19T06:05:26.751 INFO:tasks.workunit.client.1.smithi172.stdout:8/266: dwrite d0/f9 [4194304,4194304] 0 2024-03-19T06:05:26.752 INFO:tasks.workunit.client.1.smithi172.stdout:7/255: link d0/c55 d0/d22/d1d/d36/d56/c58 0 2024-03-19T06:05:26.758 INFO:tasks.workunit.client.1.smithi172.stdout:1/353: link da/dd/d10/f1d da/dd/d10/d14/d27/d3f/d5e/f72 0 2024-03-19T06:05:26.761 INFO:tasks.workunit.client.1.smithi172.stdout:4/279: dwrite df/d11/d12/d34/f4e [0,4194304] 0 2024-03-19T06:05:26.762 INFO:tasks.workunit.client.1.smithi172.stdout:7/256: symlink d0/d22/d1d/l59 0 2024-03-19T06:05:26.762 INFO:tasks.workunit.client.1.smithi172.stdout:4/280: write df/d2b/d2d/f46 [106900,22724] 0 2024-03-19T06:05:26.765 INFO:tasks.workunit.client.1.smithi172.stdout:1/354: mkdir da/dd/d10/d14/d73 0 2024-03-19T06:05:26.770 INFO:tasks.workunit.client.1.smithi172.stdout:1/355: chown da/dd/d31 73 1 2024-03-19T06:05:26.771 INFO:tasks.workunit.client.1.smithi172.stdout:5/267: getdents d5/d55 0 2024-03-19T06:05:26.772 INFO:tasks.workunit.client.1.smithi172.stdout:7/257: creat d0/d22/d1d/f5a x:0 0 0 2024-03-19T06:05:26.776 INFO:tasks.workunit.client.1.smithi172.stdout:7/258: read - d0/d2c/f2f zero size 2024-03-19T06:05:26.776 INFO:tasks.workunit.client.1.smithi172.stdout:8/267: write d0/f11 [1758191,86980] 0 2024-03-19T06:05:26.777 INFO:tasks.workunit.client.1.smithi172.stdout:9/253: sync 2024-03-19T06:05:26.777 INFO:tasks.workunit.client.1.smithi172.stdout:2/215: sync 2024-03-19T06:05:26.777 INFO:tasks.workunit.client.1.smithi172.stdout:4/281: symlink df/l51 0 2024-03-19T06:05:26.779 INFO:tasks.workunit.client.1.smithi172.stdout:5/268: chown d5/d1f/d2f/c50 58459240 1 2024-03-19T06:05:26.781 INFO:tasks.workunit.client.1.smithi172.stdout:1/356: mknod da/dd/d10/d14/d27/d3f/c74 0 2024-03-19T06:05:26.782 INFO:tasks.workunit.client.1.smithi172.stdout:9/254: rmdir d1/d7/dc/de 39 2024-03-19T06:05:26.787 INFO:tasks.workunit.client.1.smithi172.stdout:4/282: fdatasync df/d11/d12/d21/f4b 0 2024-03-19T06:05:26.789 INFO:tasks.workunit.client.1.smithi172.stdout:5/269: mknod d5/d14/d48/c61 0 2024-03-19T06:05:26.789 INFO:tasks.workunit.client.1.smithi172.stdout:1/357: chown da/dd/d10/d36/c6d 10 1 2024-03-19T06:05:26.790 INFO:tasks.workunit.client.1.smithi172.stdout:9/255: dread - d1/d7/dc/de/d34/f45 zero size 2024-03-19T06:05:26.791 INFO:tasks.workunit.client.1.smithi172.stdout:7/259: getdents d0/d22 0 2024-03-19T06:05:26.791 INFO:tasks.workunit.client.1.smithi172.stdout:3/312: dwrite d0/d5/d9/d54/f70 [0,4194304] 0 2024-03-19T06:05:26.793 INFO:tasks.workunit.client.1.smithi172.stdout:8/268: truncate d0/f8 2490981 0 2024-03-19T06:05:26.797 INFO:tasks.workunit.client.1.smithi172.stdout:4/283: write df/d11/d12/d3c/f3f [765951,87596] 0 2024-03-19T06:05:26.798 INFO:tasks.workunit.client.1.smithi172.stdout:5/270: mkdir d5/d1f/d2f/d62 0 2024-03-19T06:05:26.801 INFO:tasks.workunit.client.1.smithi172.stdout:7/260: chown d0/d22/d3d/d41/c52 18 1 2024-03-19T06:05:26.802 INFO:tasks.workunit.client.1.smithi172.stdout:0/305: sync 2024-03-19T06:05:26.806 INFO:tasks.workunit.client.1.smithi172.stdout:1/358: creat da/d33/f75 x:0 0 0 2024-03-19T06:05:26.806 INFO:tasks.workunit.client.1.smithi172.stdout:4/284: mknod df/d45/c52 0 2024-03-19T06:05:26.807 INFO:tasks.workunit.client.1.smithi172.stdout:2/216: dwrite d7/f8 [4194304,4194304] 0 2024-03-19T06:05:26.811 INFO:tasks.workunit.client.1.smithi172.stdout:8/269: rename d0/f34 to d0/d10/d27/d29/d28/d55/f57 0 2024-03-19T06:05:26.813 INFO:tasks.workunit.client.1.smithi172.stdout:0/306: truncate d11/d18/d38/f55 1370393 0 2024-03-19T06:05:26.814 INFO:tasks.workunit.client.1.smithi172.stdout:2/217: fdatasync d7/db/f24 0 2024-03-19T06:05:26.817 INFO:tasks.workunit.client.1.smithi172.stdout:4/285: chown df/d11/c14 752471841 1 2024-03-19T06:05:26.822 INFO:tasks.workunit.client.1.smithi172.stdout:2/218: fdatasync d7/db/d14/f2b 0 2024-03-19T06:05:26.826 INFO:tasks.workunit.client.1.smithi172.stdout:9/256: rename d1/d7/dc/de/d34/l4e to d1/d7/dc/d23/l5a 0 2024-03-19T06:05:26.829 INFO:tasks.workunit.client.1.smithi172.stdout:2/219: chown d7/d1b/f1f 949798 1 2024-03-19T06:05:26.832 INFO:tasks.workunit.client.1.smithi172.stdout:9/257: truncate d1/f9 4456229 0 2024-03-19T06:05:26.832 INFO:tasks.workunit.client.1.smithi172.stdout:4/286: creat df/d2b/f53 x:0 0 0 2024-03-19T06:05:26.833 INFO:tasks.workunit.client.1.smithi172.stdout:1/359: creat da/dd/d10/d14/d27/d3f/d5e/f76 x:0 0 0 2024-03-19T06:05:26.833 INFO:tasks.workunit.client.1.smithi172.stdout:3/313: rename d0/d5/d9/d25/c6f to d0/d5/d9/d34/d4d/d6c/c76 0 2024-03-19T06:05:26.839 INFO:tasks.workunit.client.1.smithi172.stdout:5/271: dwrite d5/d14/d15/f4c [0,4194304] 0 2024-03-19T06:05:26.839 INFO:tasks.workunit.client.1.smithi172.stdout:7/261: dread d0/f15 [0,4194304] 0 2024-03-19T06:05:26.839 INFO:tasks.workunit.client.1.smithi172.stdout:3/314: mkdir d0/d5/d9/d54/d77 0 2024-03-19T06:05:26.841 INFO:tasks.workunit.client.1.smithi172.stdout:4/287: creat df/d11/d12/d21/d50/f54 x:0 0 0 2024-03-19T06:05:26.841 INFO:tasks.workunit.client.1.smithi172.stdout:0/307: getdents d11/d14/d2c/d36 0 2024-03-19T06:05:26.846 INFO:tasks.workunit.client.1.smithi172.stdout:9/258: readlink d1/d7/dc/de/d34/d48/l4f 0 2024-03-19T06:05:26.846 INFO:tasks.workunit.client.1.smithi172.stdout:1/360: creat da/f77 x:0 0 0 2024-03-19T06:05:26.847 INFO:tasks.workunit.client.1.smithi172.stdout:1/361: dread - da/dd/d10/f2f zero size 2024-03-19T06:05:26.848 INFO:tasks.workunit.client.1.smithi172.stdout:7/262: symlink d0/d22/d3d/d41/l5b 0 2024-03-19T06:05:26.849 INFO:tasks.workunit.client.1.smithi172.stdout:5/272: creat d5/d55/f63 x:0 0 0 2024-03-19T06:05:26.852 INFO:tasks.workunit.client.1.smithi172.stdout:9/259: rmdir d1/d7/dc/de/d34 39 2024-03-19T06:05:26.854 INFO:tasks.workunit.client.1.smithi172.stdout:5/273: creat d5/d14/d56/f64 x:0 0 0 2024-03-19T06:05:26.854 INFO:tasks.workunit.client.1.smithi172.stdout:7/263: fdatasync d0/d22/d1d/d36/d40/f4e 0 2024-03-19T06:05:26.855 INFO:tasks.workunit.client.1.smithi172.stdout:3/315: creat d0/d5/d9/d54/d77/f78 x:0 0 0 2024-03-19T06:05:26.855 INFO:tasks.workunit.client.1.smithi172.stdout:8/270: dread d0/d10/d27/f1e [0,4194304] 0 2024-03-19T06:05:26.855 INFO:tasks.workunit.client.1.smithi172.stdout:1/362: fdatasync da/dd/d10/f68 0 2024-03-19T06:05:26.859 INFO:tasks.workunit.client.1.smithi172.stdout:9/260: mknod d1/c5b 0 2024-03-19T06:05:26.861 INFO:tasks.workunit.client.1.smithi172.stdout:3/316: chown d0/d5/d9/d25/d21 0 1 2024-03-19T06:05:26.862 INFO:tasks.workunit.client.1.smithi172.stdout:9/261: chown d1/d7/f2e 1348141152 1 2024-03-19T06:05:26.863 INFO:tasks.workunit.client.1.smithi172.stdout:5/274: mknod d5/d1f/d2f/d62/c65 0 2024-03-19T06:05:26.866 INFO:tasks.workunit.client.1.smithi172.stdout:5/275: dread - d5/d55/f63 zero size 2024-03-19T06:05:26.868 INFO:tasks.workunit.client.1.smithi172.stdout:9/262: fdatasync d1/f6 0 2024-03-19T06:05:26.869 INFO:tasks.workunit.client.1.smithi172.stdout:3/317: symlink d0/d5/l79 0 2024-03-19T06:05:26.871 INFO:tasks.workunit.client.1.smithi172.stdout:8/271: getdents d0/d10/d27 0 2024-03-19T06:05:26.872 INFO:tasks.workunit.client.1.smithi172.stdout:5/276: fsync d5/d14/d15/f42 0 2024-03-19T06:05:26.872 INFO:tasks.workunit.client.1.smithi172.stdout:0/308: dwrite ff [0,4194304] 0 2024-03-19T06:05:26.873 INFO:tasks.workunit.client.1.smithi172.stdout:4/288: dwrite df/d11/d12/d34/f39 [0,4194304] 0 2024-03-19T06:05:26.881 INFO:tasks.workunit.client.1.smithi172.stdout:5/277: mkdir d5/d14/d34/d66 0 2024-03-19T06:05:26.890 INFO:tasks.workunit.client.1.smithi172.stdout:3/318: dread - d0/d5/d9/d25/f74 zero size 2024-03-19T06:05:26.890 INFO:tasks.workunit.client.1.smithi172.stdout:0/309: mkdir d11/d18/d38/d3f/d43/d62/d67 0 2024-03-19T06:05:26.891 INFO:tasks.workunit.client.1.smithi172.stdout:7/264: dwrite d0/d22/d1d/d36/f13 [0,4194304] 0 2024-03-19T06:05:26.891 INFO:tasks.workunit.client.1.smithi172.stdout:4/289: creat df/d11/d12/d21/f55 x:0 0 0 2024-03-19T06:05:26.891 INFO:tasks.workunit.client.1.smithi172.stdout:3/319: symlink d0/d37/l7a 0 2024-03-19T06:05:26.895 INFO:tasks.workunit.client.1.smithi172.stdout:0/310: fdatasync d11/d22/f49 0 2024-03-19T06:05:26.897 INFO:tasks.workunit.client.1.smithi172.stdout:3/320: write d0/d5/d9/d54/d77/f78 [159454,122245] 0 2024-03-19T06:05:26.897 INFO:tasks.workunit.client.1.smithi172.stdout:9/263: dread d1/d7/dc/d31/f2b [0,4194304] 0 2024-03-19T06:05:26.902 INFO:tasks.workunit.client.1.smithi172.stdout:9/264: symlink d1/d7/dc/d4c/l5c 0 2024-03-19T06:05:26.905 INFO:tasks.workunit.client.1.smithi172.stdout:0/311: rename d11/d18/d38/d59 to d11/d22/d68 0 2024-03-19T06:05:26.905 INFO:tasks.workunit.client.1.smithi172.stdout:8/272: dwrite d0/f3 [0,4194304] 0 2024-03-19T06:05:26.908 INFO:tasks.workunit.client.1.smithi172.stdout:0/312: chown d11/d18/d38/d3f/l48 392997 1 2024-03-19T06:05:26.912 INFO:tasks.workunit.client.1.smithi172.stdout:3/321: truncate d0/d5/d14/f30 104699 0 2024-03-19T06:05:26.913 INFO:tasks.workunit.client.1.smithi172.stdout:9/265: dread d1/d7/dc/de/d34/f41 [0,4194304] 0 2024-03-19T06:05:26.915 INFO:tasks.workunit.client.1.smithi172.stdout:0/313: unlink d11/l1e 0 2024-03-19T06:05:26.915 INFO:tasks.workunit.client.1.smithi172.stdout:3/322: dread - d0/d5/d9/d3a/f3f zero size 2024-03-19T06:05:26.917 INFO:tasks.workunit.client.1.smithi172.stdout:9/266: read d1/d7/dc/de/f1f [1116889,53884] 0 2024-03-19T06:05:26.918 INFO:tasks.workunit.client.1.smithi172.stdout:3/323: fdatasync d0/f4 0 2024-03-19T06:05:26.920 INFO:tasks.workunit.client.1.smithi172.stdout:4/290: rmdir df/d11/d12 39 2024-03-19T06:05:26.924 INFO:tasks.workunit.client.1.smithi172.stdout:0/314: rename d11/f26 to d11/d18/d38/d3f/d43/d62/f69 0 2024-03-19T06:05:26.929 INFO:tasks.workunit.client.1.smithi172.stdout:4/291: symlink df/d45/l56 0 2024-03-19T06:05:26.930 INFO:tasks.workunit.client.1.smithi172.stdout:0/315: rename d11/d14/d2c/d4e to d11/d14/d2c/d4e/d6a 22 2024-03-19T06:05:26.931 INFO:tasks.workunit.client.1.smithi172.stdout:9/267: creat d1/d7/dc/f5d x:0 0 0 2024-03-19T06:05:26.935 INFO:tasks.workunit.client.1.smithi172.stdout:8/273: dwrite d0/d10/d27/d29/f32 [4194304,4194304] 0 2024-03-19T06:05:26.939 INFO:tasks.workunit.client.1.smithi172.stdout:0/316: creat d11/d22/d46/f6b x:0 0 0 2024-03-19T06:05:26.942 INFO:tasks.workunit.client.1.smithi172.stdout:3/324: dread d0/d5/d9/d25/d21/f50 [0,4194304] 0 2024-03-19T06:05:26.943 INFO:tasks.workunit.client.1.smithi172.stdout:0/317: mknod d11/d22/d68/c6c 0 2024-03-19T06:05:26.952 INFO:tasks.workunit.client.1.smithi172.stdout:0/318: mknod d11/d14/d2c/d36/c6d 0 2024-03-19T06:05:26.953 INFO:tasks.workunit.client.1.smithi172.stdout:3/325: truncate d0/d5/f23 812984 0 2024-03-19T06:05:26.957 INFO:tasks.workunit.client.1.smithi172.stdout:4/292: dread df/d11/d12/d34/f39 [0,4194304] 0 2024-03-19T06:05:26.958 INFO:tasks.workunit.client.1.smithi172.stdout:0/319: creat d11/d18/d38/d3f/f6e x:0 0 0 2024-03-19T06:05:26.960 INFO:tasks.workunit.client.1.smithi172.stdout:9/268: dwrite d1/d7/dc/de/d34/f45 [0,4194304] 0 2024-03-19T06:05:26.960 INFO:tasks.workunit.client.1.smithi172.stdout:3/326: write d0/d5/d9/d25/f58 [866374,59513] 0 2024-03-19T06:05:26.962 INFO:tasks.workunit.client.1.smithi172.stdout:0/320: chown d11/d22/d32/l4c 1940056286 1 2024-03-19T06:05:26.964 INFO:tasks.workunit.client.1.smithi172.stdout:8/274: dwrite d0/d10/d27/f38 [0,4194304] 0 2024-03-19T06:05:26.969 INFO:tasks.workunit.client.1.smithi172.stdout:0/321: symlink d11/d14/d2c/d4e/l6f 0 2024-03-19T06:05:26.971 INFO:tasks.workunit.client.1.smithi172.stdout:6/401: sync 2024-03-19T06:05:26.971 INFO:tasks.workunit.client.1.smithi172.stdout:9/269: creat d1/f5e x:0 0 0 2024-03-19T06:05:26.972 INFO:tasks.workunit.client.1.smithi172.stdout:0/322: stat d11/d18/f21 0 2024-03-19T06:05:26.975 INFO:tasks.workunit.client.1.smithi172.stdout:8/275: creat d0/f58 x:0 0 0 2024-03-19T06:05:26.979 INFO:tasks.workunit.client.1.smithi172.stdout:4/293: getdents df/d11/d12/d21 0 2024-03-19T06:05:26.980 INFO:tasks.workunit.client.1.smithi172.stdout:0/323: write d11/d14/d2c/d36/f53 [724862,109180] 0 2024-03-19T06:05:26.983 INFO:tasks.workunit.client.1.smithi172.stdout:8/276: rename d0/d10/d2b to d0/d10/d27/d29/d59 0 2024-03-19T06:05:26.984 INFO:tasks.workunit.client.1.smithi172.stdout:6/402: link d5/c9 d5/d11/d17/d1b/d74/c80 0 2024-03-19T06:05:26.985 INFO:tasks.workunit.client.1.smithi172.stdout:0/324: mknod d11/d18/d38/c70 0 2024-03-19T06:05:26.986 INFO:tasks.workunit.client.1.smithi172.stdout:4/294: link df/d11/d12/d26/f43 df/d2b/f57 0 2024-03-19T06:05:26.989 INFO:tasks.workunit.client.1.smithi172.stdout:0/325: mknod d11/d22/c71 0 2024-03-19T06:05:26.989 INFO:tasks.workunit.client.1.smithi172.stdout:6/403: write d5/d11/d35/f68 [486586,102950] 0 2024-03-19T06:05:26.993 INFO:tasks.workunit.client.1.smithi172.stdout:0/326: unlink d11/d14/c40 0 2024-03-19T06:05:27.000 INFO:tasks.workunit.client.1.smithi172.stdout:0/327: mknod d11/d14/d2c/c72 0 2024-03-19T06:05:27.002 INFO:tasks.workunit.client.1.smithi172.stdout:6/404: link d5/d11/d17/d1b/f21 d5/d11/d35/d40/d53/d75/f81 0 2024-03-19T06:05:27.003 INFO:tasks.workunit.client.1.smithi172.stdout:0/328: write d11/d18/d38/d3f/f6e [1016603,42724] 0 2024-03-19T06:05:27.008 INFO:tasks.workunit.client.1.smithi172.stdout:4/295: dwrite f8 [0,4194304] 0 2024-03-19T06:05:27.008 INFO:tasks.workunit.client.1.smithi172.stdout:6/405: chown d5/d2c/f6b 230 1 2024-03-19T06:05:27.009 INFO:tasks.workunit.client.1.smithi172.stdout:3/327: dread d0/d5/d9/d34/d4d/f2e [0,4194304] 0 2024-03-19T06:05:27.009 INFO:tasks.workunit.client.1.smithi172.stdout:4/296: dread - df/d2b/f40 zero size 2024-03-19T06:05:27.012 INFO:tasks.workunit.client.1.smithi172.stdout:4/297: chown df/d11/d12/f33 39 1 2024-03-19T06:05:27.016 INFO:tasks.workunit.client.1.smithi172.stdout:9/270: dread d1/d7/dc/f15 [0,4194304] 0 2024-03-19T06:05:27.016 INFO:tasks.workunit.client.1.smithi172.stdout:3/328: chown d0 1862 1 2024-03-19T06:05:27.018 INFO:tasks.workunit.client.1.smithi172.stdout:9/271: chown d1/f9 114458 1 2024-03-19T06:05:27.019 INFO:tasks.workunit.client.1.smithi172.stdout:6/406: creat d5/d11/f82 x:0 0 0 2024-03-19T06:05:27.019 INFO:tasks.workunit.client.1.smithi172.stdout:4/298: fdatasync df/d11/d12/d3c/f3f 0 2024-03-19T06:05:27.022 INFO:tasks.workunit.client.0.smithi072.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-03-19T06:05:27.025 INFO:tasks.workunit.client.1.smithi172.stdout:9/272: fdatasync d1/d7/dc/de/f1f 0 2024-03-19T06:05:27.027 INFO:tasks.workunit.client.1.smithi172.stdout:4/299: mkdir df/d11/d12/d21/d58 0 2024-03-19T06:05:27.032 INFO:tasks.workunit.client.1.smithi172.stdout:9/273: rmdir d1/d7/dc 39 2024-03-19T06:05:27.032 INFO:tasks.workunit.client.1.smithi172.stdout:4/300: fsync fb 0 2024-03-19T06:05:27.037 INFO:tasks.workunit.client.1.smithi172.stdout:4/301: write df/f3d [82673,114297] 0 2024-03-19T06:05:27.038 INFO:tasks.workunit.client.1.smithi172.stdout:6/407: dread d5/d2c/d31/f57 [0,4194304] 0 2024-03-19T06:05:27.042 INFO:tasks.workunit.client.1.smithi172.stdout:4/302: write f6 [9448594,9544] 0 2024-03-19T06:05:27.044 INFO:tasks.workunit.client.1.smithi172.stdout:4/303: chown c4 1973143 1 2024-03-19T06:05:27.049 INFO:tasks.workunit.client.1.smithi172.stdout:3/329: dwrite d0/d5/d9/d25/d21/f50 [0,4194304] 0 2024-03-19T06:05:27.052 INFO:tasks.workunit.client.1.smithi172.stdout:4/304: creat df/d11/d12/d26/f59 x:0 0 0 2024-03-19T06:05:27.054 INFO:tasks.workunit.client.1.smithi172.stdout:9/274: truncate d1/d7/dc/d23/f3c 3817847 0 2024-03-19T06:05:27.062 INFO:tasks.workunit.client.1.smithi172.stdout:0/329: dwrite d11/f29 [4194304,4194304] 0 2024-03-19T06:05:27.067 INFO:tasks.workunit.client.1.smithi172.stdout:3/330: rename d0/d5/d9/d25/d21/f3c to d0/d5/d9/d3a/f7b 0 2024-03-19T06:05:27.068 INFO:tasks.workunit.client.1.smithi172.stdout:6/408: dwrite d5/d2c/d31/f67 [0,4194304] 0 2024-03-19T06:05:27.068 INFO:tasks.workunit.client.0.smithi072.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-19T06:05:27.069 INFO:tasks.workunit.client.0.smithi072.stderr:+ make 2024-03-19T06:05:27.070 INFO:tasks.workunit.client.1.smithi172.stdout:9/275: getdents d1/d7/dc/d47 0 2024-03-19T06:05:27.073 INFO:tasks.workunit.client.1.smithi172.stdout:9/276: chown d1/d7/dc/d31 198266 1 2024-03-19T06:05:27.076 INFO:tasks.workunit.client.1.smithi172.stdout:3/331: read d0/d5/d14/f27 [1642064,93778] 0 2024-03-19T06:05:27.080 INFO:tasks.workunit.client.1.smithi172.stdout:4/305: dwrite df/d11/f49 [0,4194304] 0 2024-03-19T06:05:27.080 INFO:tasks.workunit.client.1.smithi172.stdout:6/409: rename d5/d11/d43/c49 to d5/d2c/c83 0 2024-03-19T06:05:27.084 INFO:tasks.workunit.client.1.smithi172.stdout:6/410: readlink d5/d11/d43/d45/l72 0 2024-03-19T06:05:27.093 INFO:tasks.workunit.client.1.smithi172.stdout:6/411: mkdir d5/d2c/d31/d84 0 2024-03-19T06:05:27.093 INFO:tasks.workunit.client.1.smithi172.stdout:3/332: creat d0/f7c x:0 0 0 2024-03-19T06:05:27.097 INFO:tasks.workunit.client.1.smithi172.stdout:4/306: rename df/d11/d12/c1f to df/d45/c5a 0 2024-03-19T06:05:27.097 INFO:tasks.workunit.client.1.smithi172.stdout:6/412: symlink d5/d2c/d31/l85 0 2024-03-19T06:05:27.098 INFO:tasks.workunit.client.1.smithi172.stdout:9/277: write d1/d7/dc/d31/f35 [665171,30142] 0 2024-03-19T06:05:27.103 INFO:tasks.workunit.client.1.smithi172.stdout:6/413: mknod d5/d2c/d31/c86 0 2024-03-19T06:05:27.104 INFO:tasks.workunit.client.1.smithi172.stdout:4/307: creat df/d11/d12/d21/d58/f5b x:0 0 0 2024-03-19T06:05:27.106 INFO:tasks.workunit.client.1.smithi172.stdout:9/278: creat d1/d7/dc/de/d34/d48/f5f x:0 0 0 2024-03-19T06:05:27.109 INFO:tasks.workunit.client.1.smithi172.stdout:4/308: unlink df/d11/c17 0 2024-03-19T06:05:27.109 INFO:tasks.workunit.client.1.smithi172.stdout:3/333: dread d0/d5/d14/f27 [0,4194304] 0 2024-03-19T06:05:27.112 INFO:tasks.workunit.client.1.smithi172.stdout:6/414: rename d5/d11/d35/d40/d53/d75/c2d to d5/d11/d17/d1b/c87 0 2024-03-19T06:05:27.113 INFO:tasks.workunit.client.1.smithi172.stdout:9/279: symlink d1/d7/dc/de/d34/l60 0 2024-03-19T06:05:27.114 INFO:tasks.workunit.client.1.smithi172.stdout:4/309: truncate df/d11/d12/d21/f2f 426529 0 2024-03-19T06:05:27.115 INFO:tasks.workunit.client.1.smithi172.stdout:9/280: stat d1/d7/dc/de/l1a 0 2024-03-19T06:05:27.116 INFO:tasks.workunit.client.1.smithi172.stdout:4/310: write df/d11/f1d [2801715,9773] 0 2024-03-19T06:05:27.118 INFO:tasks.workunit.client.1.smithi172.stdout:3/334: link d0/d5/d9/d34/d4d/f2e d0/d5/d9/d60/d67/f7d 0 2024-03-19T06:05:27.120 INFO:tasks.workunit.client.1.smithi172.stdout:4/311: symlink df/d2b/d2d/l5c 0 2024-03-19T06:05:27.120 INFO:tasks.workunit.client.1.smithi172.stdout:9/281: dread d1/d7/f2e [0,4194304] 0 2024-03-19T06:05:27.121 INFO:tasks.workunit.client.1.smithi172.stdout:6/415: rmdir d5/d11/d43/d45/d7c 0 2024-03-19T06:05:27.124 INFO:tasks.workunit.client.1.smithi172.stdout:4/312: creat df/d11/d12/d3c/f5d x:0 0 0 2024-03-19T06:05:27.124 INFO:tasks.workunit.client.1.smithi172.stdout:6/416: read - d5/d2c/d31/d7b/f7f zero size 2024-03-19T06:05:27.125 INFO:tasks.workunit.client.1.smithi172.stdout:4/313: readlink df/d2b/d2d/l5c 0 2024-03-19T06:05:27.125 INFO:tasks.workunit.client.1.smithi172.stdout:9/282: creat d1/d7/dc/d47/f61 x:0 0 0 2024-03-19T06:05:27.132 INFO:tasks.workunit.client.1.smithi172.stdout:6/417: write d5/d11/d17/d36/d48/f7d [722422,76888] 0 2024-03-19T06:05:27.132 INFO:tasks.workunit.client.1.smithi172.stdout:9/283: fsync d1/d7/dc/de/f1f 0 2024-03-19T06:05:27.132 INFO:tasks.workunit.client.1.smithi172.stdout:4/314: symlink df/d11/d12/d21/l5e 0 2024-03-19T06:05:27.132 INFO:tasks.workunit.client.1.smithi172.stdout:6/418: dread - d5/d11/d35/f42 zero size 2024-03-19T06:05:27.132 INFO:tasks.workunit.client.1.smithi172.stdout:9/284: dread - d1/d7/dc/f5d zero size 2024-03-19T06:05:27.134 INFO:tasks.workunit.client.1.smithi172.stdout:4/315: creat df/d11/d12/d21/d50/f5f x:0 0 0 2024-03-19T06:05:27.135 INFO:tasks.workunit.client.1.smithi172.stdout:9/285: rename d1/d7/dc/de/f19 to d1/d7/dc/d23/f62 0 2024-03-19T06:05:27.136 INFO:tasks.workunit.client.1.smithi172.stdout:6/419: creat d5/d2c/d31/d7b/d7e/f88 x:0 0 0 2024-03-19T06:05:27.137 INFO:tasks.workunit.client.1.smithi172.stdout:9/286: readlink d1/d7/dc/l46 0 2024-03-19T06:05:27.142 INFO:tasks.workunit.client.1.smithi172.stdout:6/420: dread d5/d11/d17/f62 [0,4194304] 0 2024-03-19T06:05:27.143 INFO:tasks.workunit.client.1.smithi172.stdout:6/421: fdatasync d5/d11/d35/f42 0 2024-03-19T06:05:27.145 INFO:tasks.workunit.client.1.smithi172.stdout:4/316: dread df/d11/f37 [0,4194304] 0 2024-03-19T06:05:27.151 INFO:tasks.workunit.client.1.smithi172.stdout:4/317: dread df/d2b/d2d/f46 [0,4194304] 0 2024-03-19T06:05:27.153 INFO:tasks.workunit.client.1.smithi172.stdout:4/318: write df/d11/f32 [4547993,9823] 0 2024-03-19T06:05:27.155 INFO:tasks.workunit.client.1.smithi172.stdout:4/319: write df/d11/f49 [3470637,12553] 0 2024-03-19T06:05:27.157 INFO:tasks.workunit.client.1.smithi172.stdout:9/287: truncate d1/d7/dc/d47/f53 577887 0 2024-03-19T06:05:27.168 INFO:tasks.workunit.client.1.smithi172.stdout:9/288: mknod d1/d7/dc/d4c/d54/c63 0 2024-03-19T06:05:27.170 INFO:tasks.workunit.client.1.smithi172.stdout:4/320: dwrite df/d11/d12/d21/f4b [0,4194304] 0 2024-03-19T06:05:27.172 INFO:tasks.workunit.client.1.smithi172.stdout:4/321: chown df/d11/c14 0 1 2024-03-19T06:05:27.173 INFO:tasks.workunit.client.1.smithi172.stdout:4/322: dread - df/f4d zero size 2024-03-19T06:05:27.174 INFO:tasks.workunit.client.1.smithi172.stdout:2/220: sync 2024-03-19T06:05:27.177 INFO:tasks.workunit.client.1.smithi172.stdout:4/323: mkdir df/d11/d12/d21/d58/d60 0 2024-03-19T06:05:27.178 INFO:tasks.workunit.client.1.smithi172.stdout:2/221: creat d7/db/d2c/d35/f44 x:0 0 0 2024-03-19T06:05:27.180 INFO:tasks.workunit.client.1.smithi172.stdout:2/222: read - d7/db/d14/f28 zero size 2024-03-19T06:05:27.197 INFO:tasks.workunit.client.1.smithi172.stdout:4/324: dwrite df/d11/f25 [0,4194304] 0 2024-03-19T06:05:27.199 INFO:tasks.workunit.client.1.smithi172.stdout:2/223: dwrite d7/de/f29 [0,4194304] 0 2024-03-19T06:05:27.202 INFO:tasks.workunit.client.1.smithi172.stdout:4/325: creat df/d11/d12/d26/f61 x:0 0 0 2024-03-19T06:05:27.203 INFO:tasks.workunit.client.1.smithi172.stdout:2/224: mkdir d7/db/d45 0 2024-03-19T06:05:27.208 INFO:tasks.workunit.client.1.smithi172.stdout:2/225: write d7/db/d14/f1c [57100,102363] 0 2024-03-19T06:05:27.210 INFO:tasks.workunit.client.1.smithi172.stdout:4/326: creat df/f62 x:0 0 0 2024-03-19T06:05:27.219 INFO:tasks.workunit.client.1.smithi172.stdout:4/327: mkdir df/d11/d12/d21/d50/d63 0 2024-03-19T06:05:27.225 INFO:tasks.workunit.client.1.smithi172.stdout:4/328: creat df/d11/f64 x:0 0 0 2024-03-19T06:05:27.225 INFO:tasks.workunit.client.1.smithi172.stdout:2/226: dread d7/de/f42 [0,4194304] 0 2024-03-19T06:05:27.227 INFO:tasks.workunit.client.1.smithi172.stdout:4/329: mkdir df/d11/d12/d21/d58/d65 0 2024-03-19T06:05:27.229 INFO:tasks.workunit.client.1.smithi172.stdout:2/227: rename d7/fc to d7/db/d14/f46 0 2024-03-19T06:05:27.231 INFO:tasks.workunit.client.1.smithi172.stdout:4/330: creat df/d11/d12/d26/f66 x:0 0 0 2024-03-19T06:05:27.236 INFO:tasks.workunit.client.1.smithi172.stdout:4/331: rename df/d11/d12/d3c to df/d2b/d44/d67 0 2024-03-19T06:05:27.239 INFO:tasks.workunit.client.1.smithi172.stdout:4/332: write df/d11/d12/f1a [427053,38881] 0 2024-03-19T06:05:27.241 INFO:tasks.workunit.client.1.smithi172.stdout:2/228: dread d7/d1b/f2a [0,4194304] 0 2024-03-19T06:05:27.244 INFO:tasks.workunit.client.1.smithi172.stdout:2/229: symlink d7/db/l47 0 2024-03-19T06:05:27.244 INFO:tasks.workunit.client.1.smithi172.stdout:4/333: dread df/d11/f32 [4194304,4194304] 0 2024-03-19T06:05:27.246 INFO:tasks.workunit.client.1.smithi172.stdout:2/230: symlink d7/db/l48 0 2024-03-19T06:05:27.248 INFO:tasks.workunit.client.1.smithi172.stdout:2/231: creat d7/db/f49 x:0 0 0 2024-03-19T06:05:27.249 INFO:tasks.workunit.client.1.smithi172.stdout:4/334: getdents df/d11/d12/d21/d58/d65 0 2024-03-19T06:05:27.251 INFO:tasks.workunit.client.1.smithi172.stdout:2/232: creat d7/db/d2c/f4a x:0 0 0 2024-03-19T06:05:27.256 INFO:tasks.workunit.client.1.smithi172.stdout:2/233: creat d7/db/f4b x:0 0 0 2024-03-19T06:05:27.258 INFO:tasks.workunit.client.1.smithi172.stdout:2/234: write d7/de/f1e [1048253,57465] 0 2024-03-19T06:05:27.264 INFO:tasks.workunit.client.1.smithi172.stdout:2/235: getdents d7/db/d2c 0 2024-03-19T06:05:27.265 INFO:tasks.workunit.client.1.smithi172.stdout:2/236: fdatasync d7/db/f16 0 2024-03-19T06:05:27.266 INFO:tasks.workunit.client.1.smithi172.stdout:4/335: dwrite df/d11/d12/d21/f4b [0,4194304] 0 2024-03-19T06:05:27.268 INFO:tasks.workunit.client.1.smithi172.stdout:2/237: mkdir d7/d4c 0 2024-03-19T06:05:27.270 INFO:tasks.workunit.client.1.smithi172.stdout:4/336: rmdir df/d2b/d2d 39 2024-03-19T06:05:27.272 INFO:tasks.workunit.client.1.smithi172.stdout:2/238: symlink d7/d1b/l4d 0 2024-03-19T06:05:27.277 INFO:tasks.workunit.client.1.smithi172.stdout:4/337: creat df/d11/d12/d21/d58/d65/f68 x:0 0 0 2024-03-19T06:05:27.279 INFO:tasks.workunit.client.1.smithi172.stdout:2/239: rmdir d7/db/d2c/d35 39 2024-03-19T06:05:27.279 INFO:tasks.workunit.client.1.smithi172.stdout:4/338: dread - df/f62 zero size 2024-03-19T06:05:27.281 INFO:tasks.workunit.client.1.smithi172.stdout:2/240: write d7/db/f24 [499715,95858] 0 2024-03-19T06:05:27.283 INFO:tasks.workunit.client.1.smithi172.stdout:4/339: mkdir df/d11/d12/d69 0 2024-03-19T06:05:27.285 INFO:tasks.workunit.client.1.smithi172.stdout:2/241: creat d7/f4e x:0 0 0 2024-03-19T06:05:27.286 INFO:tasks.workunit.client.1.smithi172.stdout:4/340: symlink df/d11/d12/d69/l6a 0 2024-03-19T06:05:27.286 INFO:tasks.workunit.client.1.smithi172.stdout:2/242: fsync d7/f26 0 2024-03-19T06:05:27.289 INFO:tasks.workunit.client.1.smithi172.stdout:2/243: write d7/f8 [9132377,81527] 0 2024-03-19T06:05:27.290 INFO:tasks.workunit.client.1.smithi172.stdout:4/341: creat df/d2b/d2d/f6b x:0 0 0 2024-03-19T06:05:27.292 INFO:tasks.workunit.client.1.smithi172.stdout:2/244: fsync f6 0 2024-03-19T06:05:27.293 INFO:tasks.workunit.client.1.smithi172.stdout:4/342: stat df/d11/d12/d21/d58/f5b 0 2024-03-19T06:05:27.295 INFO:tasks.workunit.client.1.smithi172.stdout:4/343: mknod df/d2b/d44/d67/c6c 0 2024-03-19T06:05:27.296 INFO:tasks.workunit.client.1.smithi172.stdout:2/245: mkdir d7/db/d45/d4f 0 2024-03-19T06:05:27.298 INFO:tasks.workunit.client.1.smithi172.stdout:2/246: dread f6 [0,4194304] 0 2024-03-19T06:05:27.300 INFO:tasks.workunit.client.1.smithi172.stdout:4/344: getdents df 0 2024-03-19T06:05:27.302 INFO:tasks.workunit.client.1.smithi172.stdout:2/247: dread - d7/db/d2c/d35/f41 zero size 2024-03-19T06:05:27.304 INFO:tasks.workunit.client.1.smithi172.stdout:4/345: creat df/d45/f6d x:0 0 0 2024-03-19T06:05:27.307 INFO:tasks.workunit.client.1.smithi172.stdout:4/346: mkdir df/d11/d12/d6e 0 2024-03-19T06:05:27.312 INFO:tasks.workunit.client.1.smithi172.stdout:2/248: dread d7/db/f13 [0,4194304] 0 2024-03-19T06:05:27.312 INFO:tasks.workunit.client.1.smithi172.stdout:4/347: getdents df/d11/d12/d21/d58 0 2024-03-19T06:05:27.316 INFO:tasks.workunit.client.1.smithi172.stdout:4/348: mknod df/d11/d12/d26/c6f 0 2024-03-19T06:05:27.318 INFO:tasks.workunit.client.1.smithi172.stdout:2/249: truncate d7/f15 3466617 0 2024-03-19T06:05:27.320 INFO:tasks.workunit.client.1.smithi172.stdout:4/349: creat df/d11/d12/d21/d58/d60/f70 x:0 0 0 2024-03-19T06:05:27.321 INFO:tasks.workunit.client.1.smithi172.stdout:2/250: creat d7/db/d14/f50 x:0 0 0 2024-03-19T06:05:27.324 INFO:tasks.workunit.client.1.smithi172.stdout:2/251: rename f6 to d7/d4c/f51 0 2024-03-19T06:05:27.325 INFO:tasks.workunit.client.1.smithi172.stdout:2/252: fsync d7/d1b/f22 0 2024-03-19T06:05:27.329 INFO:tasks.workunit.client.1.smithi172.stdout:2/253: creat d7/db/d45/d4f/f52 x:0 0 0 2024-03-19T06:05:27.336 INFO:tasks.workunit.client.1.smithi172.stdout:4/350: dwrite fb [4194304,4194304] 0 2024-03-19T06:05:27.337 INFO:tasks.workunit.client.1.smithi172.stdout:2/254: getdents d7/d4c 0 2024-03-19T06:05:27.339 INFO:tasks.workunit.client.1.smithi172.stdout:4/351: write df/d11/d12/f1a [2137391,76777] 0 2024-03-19T06:05:27.348 INFO:tasks.workunit.client.1.smithi172.stdout:2/255: write d7/db/f16 [1819273,37825] 0 2024-03-19T06:05:27.369 INFO:tasks.workunit.client.0.smithi072.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-03-19T06:05:27.405 INFO:tasks.workunit.client.1.smithi172.stdout:1/363: sync 2024-03-19T06:05:27.409 INFO:tasks.workunit.client.1.smithi172.stdout:1/364: fsync da/dd/d10/d14/f35 0 2024-03-19T06:05:27.412 INFO:tasks.workunit.client.1.smithi172.stdout:1/365: truncate da/dd/d10/f68 184826 0 2024-03-19T06:05:27.415 INFO:tasks.workunit.client.1.smithi172.stdout:1/366: mkdir da/d33/d78 0 2024-03-19T06:05:27.418 INFO:tasks.workunit.client.1.smithi172.stdout:1/367: stat da/dd/d10/f23 0 2024-03-19T06:05:27.422 INFO:tasks.workunit.client.1.smithi172.stdout:1/368: mknod da/dd/d10/c79 0 2024-03-19T06:05:27.423 INFO:tasks.workunit.client.1.smithi172.stdout:1/369: stat da/d33/f75 0 2024-03-19T06:05:27.427 INFO:tasks.workunit.client.1.smithi172.stdout:1/370: mkdir da/d7a 0 2024-03-19T06:05:27.432 INFO:tasks.workunit.client.1.smithi172.stdout:1/371: dread da/d33/f57 [0,4194304] 0 2024-03-19T06:05:27.437 INFO:tasks.workunit.client.1.smithi172.stdout:1/372: symlink da/dd/l7b 0 2024-03-19T06:05:27.466 INFO:tasks.workunit.client.1.smithi172.stdout:1/373: dwrite da/f3c [0,4194304] 0 2024-03-19T06:05:27.473 INFO:tasks.workunit.client.1.smithi172.stdout:1/374: mknod da/dd/d10/d14/d27/d3f/c7c 0 2024-03-19T06:05:27.480 INFO:tasks.workunit.client.1.smithi172.stdout:1/375: truncate da/dd/d10/d14/f46 678698 0 2024-03-19T06:05:27.484 INFO:tasks.workunit.client.1.smithi172.stdout:1/376: write da/dd/f39 [48096,73501] 0 2024-03-19T06:05:27.514 INFO:tasks.workunit.client.1.smithi172.stdout:1/377: dread da/dd/d10/d36/f4c [0,4194304] 0 2024-03-19T06:05:27.515 INFO:tasks.workunit.client.1.smithi172.stdout:1/378: readlink da/l22 0 2024-03-19T06:05:27.520 INFO:tasks.workunit.client.1.smithi172.stdout:1/379: creat da/d33/d4e/f7d x:0 0 0 2024-03-19T06:05:27.523 INFO:tasks.workunit.client.1.smithi172.stdout:1/380: chown da/dd/d10/d36/c6d 87046330 1 2024-03-19T06:05:27.526 INFO:tasks.workunit.client.1.smithi172.stdout:1/381: truncate da/d33/f75 224387 0 2024-03-19T06:05:27.528 INFO:tasks.workunit.client.1.smithi172.stdout:1/382: readlink da/dd/l7b 0 2024-03-19T06:05:27.561 INFO:tasks.workunit.client.1.smithi172.stdout:5/278: sync 2024-03-19T06:05:27.568 INFO:tasks.workunit.client.1.smithi172.stdout:1/383: dwrite da/dd/d10/d14/d27/d3f/d5e/f72 [0,4194304] 0 2024-03-19T06:05:27.570 INFO:tasks.workunit.client.1.smithi172.stdout:5/279: unlink d5/d1f/d2f/f45 0 2024-03-19T06:05:27.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:27 smithi072 ceph-mon[28706]: pgmap v10: 65 pgs: 65 active+clean; 520 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 51 MiB/s wr, 186 op/s 2024-03-19T06:05:27.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:27 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:27.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:27 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:27.578 INFO:tasks.workunit.client.1.smithi172.stdout:5/280: creat d5/f67 x:0 0 0 2024-03-19T06:05:27.579 INFO:tasks.workunit.client.1.smithi172.stdout:0/330: sync 2024-03-19T06:05:27.579 INFO:tasks.workunit.client.1.smithi172.stdout:8/277: sync 2024-03-19T06:05:27.579 INFO:tasks.workunit.client.1.smithi172.stdout:7/265: sync 2024-03-19T06:05:27.579 INFO:tasks.workunit.client.1.smithi172.stdout:6/422: sync 2024-03-19T06:05:27.579 INFO:tasks.workunit.client.1.smithi172.stdout:3/335: sync 2024-03-19T06:05:27.580 INFO:tasks.workunit.client.1.smithi172.stdout:4/352: sync 2024-03-19T06:05:27.580 INFO:tasks.workunit.client.1.smithi172.stdout:9/289: sync 2024-03-19T06:05:27.580 INFO:tasks.workunit.client.1.smithi172.stdout:2/256: sync 2024-03-19T06:05:27.582 INFO:tasks.workunit.client.1.smithi172.stdout:1/384: rename da/dd/d31/f40 to da/dd/d10/d14/d27/d3f/d5e/f7e 0 2024-03-19T06:05:27.582 INFO:tasks.workunit.client.1.smithi172.stdout:8/278: readlink d0/le 0 2024-03-19T06:05:27.584 INFO:tasks.workunit.client.1.smithi172.stdout:1/385: chown da/dd/d10/f29 27981804 1 2024-03-19T06:05:27.584 INFO:tasks.workunit.client.1.smithi172.stdout:8/279: fdatasync d0/d44/d46/d49/d26/f51 0 2024-03-19T06:05:27.585 INFO:tasks.workunit.client.1.smithi172.stdout:5/281: write d5/f1d [71917,45711] 0 2024-03-19T06:05:27.595 INFO:tasks.workunit.client.1.smithi172.stdout:1/386: rename da/d33/d4e/f5b to da/d33/d59/f7f 0 2024-03-19T06:05:27.595 INFO:tasks.workunit.client.1.smithi172.stdout:5/282: symlink d5/d1f/d2f/d62/l68 0 2024-03-19T06:05:27.597 INFO:tasks.workunit.client.1.smithi172.stdout:9/290: chown d1/fa 43479394 1 2024-03-19T06:05:27.599 INFO:tasks.workunit.client.1.smithi172.stdout:6/423: chown d5/d11/d43/d45/l71 0 1 2024-03-19T06:05:27.599 INFO:tasks.workunit.client.1.smithi172.stdout:9/291: read - d1/d7/dc/f5d zero size 2024-03-19T06:05:27.602 INFO:tasks.workunit.client.1.smithi172.stdout:9/292: write d1/d7/dc/d47/f61 [804969,47265] 0 2024-03-19T06:05:27.605 INFO:tasks.workunit.client.1.smithi172.stdout:9/293: write d1/d7/dc/d47/f61 [1118811,129495] 0 2024-03-19T06:05:27.605 INFO:tasks.workunit.client.1.smithi172.stdout:2/257: mknod d7/d4c/c53 0 2024-03-19T06:05:27.607 INFO:tasks.workunit.client.1.smithi172.stdout:2/258: chown d7/d1b/f20 588824 1 2024-03-19T06:05:27.608 INFO:tasks.workunit.client.1.smithi172.stdout:3/336: creat d0/d5/d9/d60/f7e x:0 0 0 2024-03-19T06:05:27.610 INFO:tasks.workunit.client.1.smithi172.stdout:3/337: dread - d0/d5/d9/d3a/f3f zero size 2024-03-19T06:05:27.610 INFO:tasks.workunit.client.1.smithi172.stdout:7/266: mkdir d0/d22/d3d/d41/d42/d5c 0 2024-03-19T06:05:27.612 INFO:tasks.workunit.client.1.smithi172.stdout:8/280: creat d0/d10/d27/d29/d28/d55/f5a x:0 0 0 2024-03-19T06:05:27.614 INFO:tasks.workunit.client.1.smithi172.stdout:5/283: creat d5/d14/f69 x:0 0 0 2024-03-19T06:05:27.615 INFO:tasks.workunit.client.1.smithi172.stdout:8/281: dread - d0/d10/d27/d29/d59/f4b zero size 2024-03-19T06:05:27.619 INFO:tasks.workunit.client.1.smithi172.stdout:6/424: creat d5/d2c/d31/f89 x:0 0 0 2024-03-19T06:05:27.622 INFO:tasks.workunit.client.1.smithi172.stdout:9/294: mknod d1/d7/dc/d23/c64 0 2024-03-19T06:05:27.623 INFO:tasks.workunit.client.1.smithi172.stdout:1/387: dwrite da/dd/d10/f58 [0,4194304] 0 2024-03-19T06:05:27.625 INFO:tasks.workunit.client.1.smithi172.stdout:3/338: mknod d0/d5/d9/d60/c7f 0 2024-03-19T06:05:27.625 INFO:tasks.workunit.client.1.smithi172.stdout:0/331: dread d11/d14/d2c/d36/f53 [0,4194304] 0 2024-03-19T06:05:27.629 INFO:tasks.workunit.client.1.smithi172.stdout:7/267: unlink d0/d22/d3d/d41/c52 0 2024-03-19T06:05:27.633 INFO:tasks.workunit.client.1.smithi172.stdout:8/282: dread d0/d44/d46/d49/d26/f3e [0,4194304] 0 2024-03-19T06:05:27.633 INFO:tasks.workunit.client.1.smithi172.stdout:2/259: mknod d7/d43/c54 0 2024-03-19T06:05:27.635 INFO:tasks.workunit.client.1.smithi172.stdout:9/295: mkdir d1/d7/dc/d23/d65 0 2024-03-19T06:05:27.635 INFO:tasks.workunit.client.1.smithi172.stdout:2/260: read - d7/db/d14/f50 zero size 2024-03-19T06:05:27.636 INFO:tasks.workunit.client.1.smithi172.stdout:1/388: write da/d3b/f48 [318911,58103] 0 2024-03-19T06:05:27.638 INFO:tasks.workunit.client.1.smithi172.stdout:0/332: symlink d11/d18/d38/l73 0 2024-03-19T06:05:27.640 INFO:tasks.workunit.client.1.smithi172.stdout:1/389: chown da/dd/d10/d14/d27/f32 696 1 2024-03-19T06:05:27.645 INFO:tasks.workunit.client.1.smithi172.stdout:8/283: unlink d0/f15 0 2024-03-19T06:05:27.645 INFO:tasks.workunit.client.1.smithi172.stdout:7/268: dwrite d0/d22/d1d/d36/f39 [0,4194304] 0 2024-03-19T06:05:27.648 INFO:tasks.workunit.client.1.smithi172.stdout:6/425: truncate d5/d11/d17/d1b/f21 3174829 0 2024-03-19T06:05:27.650 INFO:tasks.workunit.client.1.smithi172.stdout:3/339: unlink d0/d5/d9/d60/d67/c71 0 2024-03-19T06:05:27.651 INFO:tasks.workunit.client.1.smithi172.stdout:2/261: mkdir d7/d43/d55 0 2024-03-19T06:05:27.652 INFO:tasks.workunit.client.1.smithi172.stdout:4/353: getdents df/d11/d12/d21/d58/d65 0 2024-03-19T06:05:27.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:27 smithi172 ceph-mon[35716]: pgmap v10: 65 pgs: 65 active+clean; 520 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 51 MiB/s wr, 186 op/s 2024-03-19T06:05:27.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:27 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:27.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:27 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:27.654 INFO:tasks.workunit.client.1.smithi172.stdout:4/354: read fb [3697143,47133] 0 2024-03-19T06:05:27.657 INFO:tasks.workunit.client.1.smithi172.stdout:0/333: unlink d11/d4d/l50 0 2024-03-19T06:05:27.657 INFO:tasks.workunit.client.1.smithi172.stdout:9/296: dread d1/d7/dc/d23/f33 [0,4194304] 0 2024-03-19T06:05:27.659 INFO:tasks.workunit.client.1.smithi172.stdout:4/355: truncate df/d11/d12/d21/d58/d65/f68 178396 0 2024-03-19T06:05:27.659 INFO:tasks.workunit.client.1.smithi172.stdout:9/297: write d1/d7/dc/f5d [333112,66350] 0 2024-03-19T06:05:27.660 INFO:tasks.workunit.client.1.smithi172.stdout:8/284: creat d0/d44/f5b x:0 0 0 2024-03-19T06:05:27.661 INFO:tasks.workunit.client.1.smithi172.stdout:7/269: creat d0/d22/d3d/f5d x:0 0 0 2024-03-19T06:05:27.669 INFO:tasks.workunit.client.1.smithi172.stdout:3/340: mknod d0/c80 0 2024-03-19T06:05:27.670 INFO:tasks.workunit.client.1.smithi172.stdout:3/341: chown d0/d5/d9/d25/f58 3 1 2024-03-19T06:05:27.674 INFO:tasks.workunit.client.1.smithi172.stdout:2/262: fdatasync d7/db/d14/f39 0 2024-03-19T06:05:27.676 INFO:tasks.workunit.client.1.smithi172.stdout:5/284: truncate d5/fb 1235098 0 2024-03-19T06:05:27.679 INFO:tasks.workunit.client.1.smithi172.stdout:1/390: link da/dd/d10/f23 da/d3b/f80 0 2024-03-19T06:05:27.680 INFO:tasks.workunit.client.1.smithi172.stdout:1/391: chown da/dd/d10 7364 1 2024-03-19T06:05:27.685 INFO:tasks.workunit.client.1.smithi172.stdout:5/285: rmdir d5/d14/d15 39 2024-03-19T06:05:27.687 INFO:tasks.workunit.client.1.smithi172.stdout:3/342: dwrite d0/d5/d9/d60/d67/f73 [0,4194304] 0 2024-03-19T06:05:27.689 INFO:tasks.workunit.client.1.smithi172.stdout:3/343: write d0/d5/d9/d54/d77/f78 [1030760,32903] 0 2024-03-19T06:05:27.690 INFO:tasks.workunit.client.1.smithi172.stdout:2/263: rename d7/db/d14 to d7/d43/d56 0 2024-03-19T06:05:27.692 INFO:tasks.workunit.client.1.smithi172.stdout:7/270: creat d0/d22/d1d/d36/f5e x:0 0 0 2024-03-19T06:05:27.693 INFO:tasks.workunit.client.1.smithi172.stdout:8/285: dread d0/d10/d27/d29/d59/f47 [0,4194304] 0 2024-03-19T06:05:27.695 INFO:tasks.workunit.client.1.smithi172.stdout:9/298: link d1/d7/dc/d4c/d54/c63 d1/d7/dc/d23/d65/c66 0 2024-03-19T06:05:27.697 INFO:tasks.workunit.client.1.smithi172.stdout:9/299: fsync d1/d7/dc/f14 0 2024-03-19T06:05:27.697 INFO:tasks.workunit.client.1.smithi172.stdout:1/392: stat da/dd/d10/d14/f5d 0 2024-03-19T06:05:27.698 INFO:tasks.workunit.client.1.smithi172.stdout:9/300: readlink d1/d7/dc/d4c/l5c 0 2024-03-19T06:05:27.700 INFO:tasks.workunit.client.1.smithi172.stdout:1/393: write da/dd/d10/f29 [308025,7585] 0 2024-03-19T06:05:27.708 INFO:tasks.workunit.client.1.smithi172.stdout:3/344: creat d0/d5/d6b/f81 x:0 0 0 2024-03-19T06:05:27.711 INFO:tasks.workunit.client.1.smithi172.stdout:2/264: mkdir d7/d43/d57 0 2024-03-19T06:05:27.714 INFO:tasks.workunit.client.1.smithi172.stdout:7/271: dwrite d0/d22/d1d/d36/f54 [0,4194304] 0 2024-03-19T06:05:27.716 INFO:tasks.workunit.client.1.smithi172.stdout:3/345: write d0/d5/d9/d60/f7e [320401,27049] 0 2024-03-19T06:05:27.716 INFO:tasks.workunit.client.1.smithi172.stdout:8/286: dwrite d0/d10/d27/d29/f32 [0,4194304] 0 2024-03-19T06:05:27.720 INFO:tasks.workunit.client.1.smithi172.stdout:8/287: write d0/d44/f5b [508491,29162] 0 2024-03-19T06:05:27.724 INFO:tasks.workunit.client.1.smithi172.stdout:1/394: mkdir da/d33/d81 0 2024-03-19T06:05:27.726 INFO:tasks.workunit.client.1.smithi172.stdout:5/286: mkdir d5/d14/d15/d40/d6a 0 2024-03-19T06:05:27.736 INFO:tasks.workunit.client.1.smithi172.stdout:9/301: link d1/d7/dc/de/d34/d48/f5f d1/f67 0 2024-03-19T06:05:27.736 INFO:tasks.workunit.client.1.smithi172.stdout:6/426: dwrite d5/d11/d35/d40/d53/d75/f81 [0,4194304] 0 2024-03-19T06:05:27.744 INFO:tasks.workunit.client.1.smithi172.stdout:2/265: rename d7/d43 to d7/de/d58 0 2024-03-19T06:05:27.746 INFO:tasks.workunit.client.1.smithi172.stdout:9/302: truncate d1/f5e 726907 0 2024-03-19T06:05:27.749 INFO:tasks.workunit.client.1.smithi172.stdout:5/287: dread d5/d14/d15/d40/f54 [0,4194304] 0 2024-03-19T06:05:27.749 INFO:tasks.workunit.client.1.smithi172.stdout:6/427: unlink d5/d11/d17/d1b/l30 0 2024-03-19T06:05:27.751 INFO:tasks.workunit.client.1.smithi172.stdout:7/272: getdents d0 0 2024-03-19T06:05:27.755 INFO:tasks.workunit.client.1.smithi172.stdout:5/288: chown d5/d3c/f5a 2 1 2024-03-19T06:05:27.755 INFO:tasks.workunit.client.1.smithi172.stdout:9/303: symlink d1/d7/dc/d4c/d57/l68 0 2024-03-19T06:05:27.756 INFO:tasks.workunit.client.1.smithi172.stdout:6/428: truncate d5/d11/f4b 1021345 0 2024-03-19T06:05:27.757 INFO:tasks.workunit.client.1.smithi172.stdout:1/395: dread da/dd/d10/f58 [0,4194304] 0 2024-03-19T06:05:27.758 INFO:tasks.workunit.client.1.smithi172.stdout:7/273: stat d0/c55 0 2024-03-19T06:05:27.760 INFO:tasks.workunit.client.1.smithi172.stdout:8/288: dwrite d0/d10/d27/d29/d28/f40 [0,4194304] 0 2024-03-19T06:05:27.760 INFO:tasks.workunit.client.1.smithi172.stdout:9/304: chown d1/f5e 1183 1 2024-03-19T06:05:27.763 INFO:tasks.workunit.client.1.smithi172.stdout:6/429: mknod d5/d11/d17/d36/c8a 0 2024-03-19T06:05:27.763 INFO:tasks.workunit.client.1.smithi172.stdout:7/274: creat d0/d22/d1d/d36/d40/f5f x:0 0 0 2024-03-19T06:05:27.766 INFO:tasks.workunit.client.1.smithi172.stdout:8/289: write d0/d10/f1a [4935781,80539] 0 2024-03-19T06:05:27.768 INFO:tasks.workunit.client.1.smithi172.stdout:2/266: truncate d7/db/f16 1405412 0 2024-03-19T06:05:27.768 INFO:tasks.workunit.client.1.smithi172.stdout:1/396: mknod da/dd/d31/d47/c82 0 2024-03-19T06:05:27.771 INFO:tasks.workunit.client.1.smithi172.stdout:6/430: rename d5/d11/d35/f68 to d5/d11/d35/d40/f8b 0 2024-03-19T06:05:27.771 INFO:tasks.workunit.client.1.smithi172.stdout:1/397: readlink da/dd/l63 0 2024-03-19T06:05:27.771 INFO:tasks.workunit.client.1.smithi172.stdout:8/290: chown d0/d10/d27/f1e 2993569 1 2024-03-19T06:05:27.782 INFO:tasks.workunit.client.1.smithi172.stdout:8/291: mkdir d0/d44/d46/d49/d4f/d5c 0 2024-03-19T06:05:27.785 INFO:tasks.workunit.client.1.smithi172.stdout:7/275: truncate d0/d22/d1d/d36/f39 2639815 0 2024-03-19T06:05:27.786 INFO:tasks.workunit.client.1.smithi172.stdout:5/289: dwrite d5/f27 [0,4194304] 0 2024-03-19T06:05:27.790 INFO:tasks.workunit.client.1.smithi172.stdout:7/276: truncate d0/d22/d1d/f5a 746908 0 2024-03-19T06:05:27.792 INFO:tasks.workunit.client.1.smithi172.stdout:9/305: dread d1/d7/dc/d23/f3c [0,4194304] 0 2024-03-19T06:05:27.800 INFO:tasks.workunit.client.1.smithi172.stdout:0/334: sync 2024-03-19T06:05:27.801 INFO:tasks.workunit.client.1.smithi172.stdout:6/431: dwrite d5/d2c/d31/d3d/f54 [0,4194304] 0 2024-03-19T06:05:27.801 INFO:tasks.workunit.client.1.smithi172.stdout:9/306: write d1/d7/dc/d31/f35 [914651,45607] 0 2024-03-19T06:05:27.810 INFO:tasks.workunit.client.1.smithi172.stdout:8/292: dread d0/f9 [4194304,4194304] 0 2024-03-19T06:05:27.810 INFO:tasks.workunit.client.1.smithi172.stdout:1/398: dwrite da/dd/d10/f29 [0,4194304] 0 2024-03-19T06:05:27.810 INFO:tasks.workunit.client.1.smithi172.stdout:7/277: rename d0/d2c/f3c to d0/d22/d1d/d36/f60 0 2024-03-19T06:05:27.810 INFO:tasks.workunit.client.1.smithi172.stdout:9/307: fsync d1/d7/dc/d31/f2b 0 2024-03-19T06:05:27.811 INFO:tasks.workunit.client.1.smithi172.stdout:2/267: dread d7/d1b/f1f [0,4194304] 0 2024-03-19T06:05:27.814 INFO:tasks.workunit.client.1.smithi172.stdout:0/335: dread d11/f12 [0,4194304] 0 2024-03-19T06:05:27.814 INFO:tasks.workunit.client.1.smithi172.stdout:1/399: dread - da/dd/d10/d14/d27/f5a zero size 2024-03-19T06:05:27.817 INFO:tasks.workunit.client.1.smithi172.stdout:8/293: write d0/d10/d27/d29/d28/d55/f5a [811743,77409] 0 2024-03-19T06:05:27.819 INFO:tasks.workunit.client.1.smithi172.stdout:7/278: symlink d0/d22/d1d/d36/d56/l61 0 2024-03-19T06:05:27.821 INFO:tasks.workunit.client.1.smithi172.stdout:8/294: chown d0/d10/d27/d29/d28/f30 2 1 2024-03-19T06:05:27.822 INFO:tasks.workunit.client.1.smithi172.stdout:2/268: creat d7/de/d58/d55/f59 x:0 0 0 2024-03-19T06:05:27.822 INFO:tasks.workunit.client.1.smithi172.stdout:9/308: mknod d1/d7/dc/de/d34/c69 0 2024-03-19T06:05:27.823 INFO:tasks.workunit.client.1.smithi172.stdout:7/279: chown d0/d22/d1d/d3a/d46 98 1 2024-03-19T06:05:27.824 INFO:tasks.workunit.client.1.smithi172.stdout:0/336: rename d11/d18/d38/d3f/f5c to d11/d18/d38/d3f/d43/d62/f74 0 2024-03-19T06:05:27.825 INFO:tasks.workunit.client.1.smithi172.stdout:2/269: read d7/d1b/f33 [3361680,36376] 0 2024-03-19T06:05:27.827 INFO:tasks.workunit.client.1.smithi172.stdout:1/400: creat da/d3b/f83 x:0 0 0 2024-03-19T06:05:27.828 INFO:tasks.workunit.client.1.smithi172.stdout:8/295: creat d0/d44/d46/d49/f5d x:0 0 0 2024-03-19T06:05:27.829 INFO:tasks.workunit.client.1.smithi172.stdout:7/280: symlink d0/d22/d3d/l62 0 2024-03-19T06:05:27.830 INFO:tasks.workunit.client.1.smithi172.stdout:6/432: truncate d5/d11/d17/f3e 150633 0 2024-03-19T06:05:27.831 INFO:tasks.workunit.client.1.smithi172.stdout:9/309: creat d1/d7/dc/d47/f6a x:0 0 0 2024-03-19T06:05:27.831 INFO:tasks.workunit.client.1.smithi172.stdout:6/433: read d5/d11/d17/f62 [111905,103587] 0 2024-03-19T06:05:27.832 INFO:tasks.workunit.client.1.smithi172.stdout:0/337: creat d11/d22/d68/f75 x:0 0 0 2024-03-19T06:05:27.834 INFO:tasks.workunit.client.1.smithi172.stdout:8/296: readlink d0/d44/d46/d49/l31 0 2024-03-19T06:05:27.841 INFO:tasks.workunit.client.1.smithi172.stdout:6/434: symlink d5/d11/d17/d1b/d74/l8c 0 2024-03-19T06:05:27.843 INFO:tasks.workunit.client.1.smithi172.stdout:2/270: getdents d7/de/d58 0 2024-03-19T06:05:27.844 INFO:tasks.workunit.client.1.smithi172.stdout:2/271: fsync d7/de/d58/d56/f1c 0 2024-03-19T06:05:27.846 INFO:tasks.workunit.client.1.smithi172.stdout:9/310: rename d1/d7/c37 to d1/c6b 0 2024-03-19T06:05:27.846 INFO:tasks.workunit.client.1.smithi172.stdout:2/272: dread d7/de/d58/d56/f39 [0,4194304] 0 2024-03-19T06:05:27.848 INFO:tasks.workunit.client.1.smithi172.stdout:1/401: getdents da/dd/d10/d14/d27/d3f/d5e 0 2024-03-19T06:05:27.848 INFO:tasks.workunit.client.1.smithi172.stdout:9/311: fdatasync d1/d7/dc/f5d 0 2024-03-19T06:05:27.849 INFO:tasks.workunit.client.1.smithi172.stdout:6/435: mknod d5/d11/d17/c8d 0 2024-03-19T06:05:27.853 INFO:tasks.workunit.client.1.smithi172.stdout:8/297: rename d0/d10/c24 to d0/d10/d27/d29/d28/c5e 0 2024-03-19T06:05:27.856 INFO:tasks.workunit.client.1.smithi172.stdout:7/281: truncate d0/d2c/f30 1225417 0 2024-03-19T06:05:27.886 INFO:tasks.workunit.client.1.smithi172.stdout:0/338: truncate d11/d14/f1f 227400 0 2024-03-19T06:05:27.890 INFO:tasks.workunit.client.1.smithi172.stdout:0/339: dread - d11/d14/f2e zero size 2024-03-19T06:05:27.890 INFO:tasks.workunit.client.1.smithi172.stdout:2/273: dwrite d7/db/d45/d4f/f52 [0,4194304] 0 2024-03-19T06:05:27.891 INFO:tasks.workunit.client.1.smithi172.stdout:9/312: link d1/lf d1/d7/dc/d31/l6c 0 2024-03-19T06:05:27.893 INFO:tasks.workunit.client.1.smithi172.stdout:6/436: dwrite d5/f13 [4194304,4194304] 0 2024-03-19T06:05:27.899 INFO:tasks.workunit.client.1.smithi172.stdout:0/340: symlink d11/d14/d2c/d4e/l76 0 2024-03-19T06:05:27.899 INFO:tasks.workunit.client.1.smithi172.stdout:8/298: dread d0/d10/d27/d29/d28/d55/f57 [0,4194304] 0 2024-03-19T06:05:27.900 INFO:tasks.workunit.client.1.smithi172.stdout:2/274: dread d7/f15 [0,4194304] 0 2024-03-19T06:05:27.901 INFO:tasks.workunit.client.1.smithi172.stdout:2/275: readlink d7/db/l48 0 2024-03-19T06:05:27.902 INFO:tasks.workunit.client.1.smithi172.stdout:6/437: chown d5/d2c/l55 1 1 2024-03-19T06:05:27.902 INFO:tasks.workunit.client.1.smithi172.stdout:8/299: dread - d0/d44/d46/d49/f5d zero size 2024-03-19T06:05:27.904 INFO:tasks.workunit.client.1.smithi172.stdout:6/438: dread - d5/d2c/d31/f78 zero size 2024-03-19T06:05:27.905 INFO:tasks.workunit.client.1.smithi172.stdout:8/300: write d0/d44/d46/d49/f25 [3969682,10208] 0 2024-03-19T06:05:27.907 INFO:tasks.workunit.client.1.smithi172.stdout:7/282: link d0/d22/d1d/d36/f11 d0/d22/d3d/d41/d42/f63 0 2024-03-19T06:05:27.908 INFO:tasks.workunit.client.1.smithi172.stdout:9/313: dread d1/fa [0,4194304] 0 2024-03-19T06:05:27.909 INFO:tasks.workunit.client.1.smithi172.stdout:0/341: rename d11/d14/d2c/f31 to d11/d22/d32/f77 0 2024-03-19T06:05:27.910 INFO:tasks.workunit.client.1.smithi172.stdout:2/276: mkdir d7/d5a 0 2024-03-19T06:05:27.912 INFO:tasks.workunit.client.1.smithi172.stdout:7/283: chown d0/d22/d1d/d36/f60 5 1 2024-03-19T06:05:27.912 INFO:tasks.workunit.client.1.smithi172.stdout:0/342: truncate d11/d22/f34 5176483 0 2024-03-19T06:05:27.916 INFO:tasks.workunit.client.1.smithi172.stdout:6/439: rmdir d5/d11/d17/d36/d48/d79 0 2024-03-19T06:05:27.917 INFO:tasks.workunit.client.1.smithi172.stdout:0/343: chown d11/d14/d2c/d36/l37 493335 1 2024-03-19T06:05:27.920 INFO:tasks.workunit.client.1.smithi172.stdout:8/301: rename d0/d44/d46/d49/c23 to d0/d10/d27/d29/c5f 0 2024-03-19T06:05:27.923 INFO:tasks.workunit.client.1.smithi172.stdout:9/314: write d1/f67 [944564,98459] 0 2024-03-19T06:05:27.924 INFO:tasks.workunit.client.1.smithi172.stdout:0/344: symlink d11/l78 0 2024-03-19T06:05:27.926 INFO:tasks.workunit.client.1.smithi172.stdout:6/440: rename d5/d11/f82 to d5/d11/d17/f8e 0 2024-03-19T06:05:27.930 INFO:tasks.workunit.client.1.smithi172.stdout:6/441: fsync d5/d11/d43/f4c 0 2024-03-19T06:05:27.931 INFO:tasks.workunit.client.1.smithi172.stdout:2/277: dwrite d7/de/f1e [0,4194304] 0 2024-03-19T06:05:27.934 INFO:tasks.workunit.client.1.smithi172.stdout:7/284: dwrite d0/d22/d1d/d36/fc [0,4194304] 0 2024-03-19T06:05:27.938 INFO:tasks.workunit.client.1.smithi172.stdout:7/285: chown d0/d22/d1d/d36/l43 30866288 1 2024-03-19T06:05:27.938 INFO:tasks.workunit.client.1.smithi172.stdout:0/345: truncate f10 514520 0 2024-03-19T06:05:27.941 INFO:tasks.workunit.client.1.smithi172.stdout:0/346: chown d11/d22/d32/f35 0 1 2024-03-19T06:05:27.943 INFO:tasks.workunit.client.1.smithi172.stdout:7/286: chown d0/d22/d1d/d36/f60 445959 1 2024-03-19T06:05:27.944 INFO:tasks.workunit.client.1.smithi172.stdout:4/356: sync 2024-03-19T06:05:27.944 INFO:tasks.workunit.client.1.smithi172.stdout:8/302: dwrite d0/f58 [0,4194304] 0 2024-03-19T06:05:27.944 INFO:tasks.workunit.client.1.smithi172.stdout:3/346: sync 2024-03-19T06:05:27.946 INFO:tasks.workunit.client.1.smithi172.stdout:7/287: readlink d0/d22/d1d/d36/d56/l61 0 2024-03-19T06:05:27.948 INFO:tasks.workunit.client.1.smithi172.stdout:0/347: creat d11/d18/d38/d3f/d43/f79 x:0 0 0 2024-03-19T06:05:27.950 INFO:tasks.workunit.client.1.smithi172.stdout:6/442: dread d5/d11/d35/d40/f8b [0,4194304] 0 2024-03-19T06:05:27.950 INFO:tasks.workunit.client.1.smithi172.stdout:8/303: creat d0/d44/d46/f60 x:0 0 0 2024-03-19T06:05:27.951 INFO:tasks.workunit.client.1.smithi172.stdout:3/347: mkdir d0/d5/d9/d34/d82 0 2024-03-19T06:05:27.954 INFO:tasks.workunit.client.1.smithi172.stdout:8/304: truncate d0/d44/d46/d49/d26/d2f/f45 4824824 0 2024-03-19T06:05:27.960 INFO:tasks.workunit.client.1.smithi172.stdout:6/443: unlink d5/d2c/c52 0 2024-03-19T06:05:27.963 INFO:tasks.workunit.client.1.smithi172.stdout:3/348: symlink d0/d5/d9/d54/l83 0 2024-03-19T06:05:27.966 INFO:tasks.workunit.client.1.smithi172.stdout:9/315: truncate d1/d7/dc/d31/f35 1144506 0 2024-03-19T06:05:27.970 INFO:tasks.workunit.client.1.smithi172.stdout:4/357: getdents df/d11 0 2024-03-19T06:05:27.973 INFO:tasks.workunit.client.1.smithi172.stdout:9/316: write d1/d7/dc/de/f1f [381019,18373] 0 2024-03-19T06:05:27.975 INFO:tasks.workunit.client.1.smithi172.stdout:6/444: rename d5/d2c to d5/d8f 0 2024-03-19T06:05:27.980 INFO:tasks.workunit.client.1.smithi172.stdout:4/358: write df/d11/d12/d21/d58/d65/f68 [629385,20019] 0 2024-03-19T06:05:27.982 INFO:tasks.workunit.client.1.smithi172.stdout:6/445: chown d5/d8f/d31/d7b/f7f 0 1 2024-03-19T06:05:27.985 INFO:tasks.workunit.client.1.smithi172.stdout:9/317: creat d1/d7/dc/d4c/d54/f6d x:0 0 0 2024-03-19T06:05:27.985 INFO:tasks.workunit.client.1.smithi172.stdout:7/288: dwrite d0/d22/d1d/d3a/d46/f4d [8388608,4194304] 0 2024-03-19T06:05:27.986 INFO:tasks.workunit.client.1.smithi172.stdout:3/349: write d0/d5/f26 [1755875,17143] 0 2024-03-19T06:05:27.987 INFO:tasks.workunit.client.1.smithi172.stdout:4/359: mknod df/d11/c71 0 2024-03-19T06:05:27.989 INFO:tasks.workunit.client.1.smithi172.stdout:8/305: dwrite d0/fd [0,4194304] 0 2024-03-19T06:05:27.990 INFO:tasks.workunit.client.1.smithi172.stdout:9/318: chown d1/d7/dc/d4c/d57 3 1 2024-03-19T06:05:27.991 INFO:tasks.workunit.client.1.smithi172.stdout:3/350: dread - d0/d5/d9/f5b zero size 2024-03-19T06:05:27.992 INFO:tasks.workunit.client.1.smithi172.stdout:6/446: creat d5/d8f/d31/d7b/d7e/f90 x:0 0 0 2024-03-19T06:05:27.992 INFO:tasks.workunit.client.1.smithi172.stdout:8/306: dread - d0/d44/d46/f60 zero size 2024-03-19T06:05:27.994 INFO:tasks.workunit.client.1.smithi172.stdout:0/348: dread d11/d22/f3d [0,4194304] 0 2024-03-19T06:05:27.994 INFO:tasks.workunit.client.1.smithi172.stdout:4/360: creat df/d2b/d44/d67/f72 x:0 0 0 2024-03-19T06:05:27.994 INFO:tasks.workunit.client.1.smithi172.stdout:9/319: fsync d1/d7/dc/de/d34/f45 0 2024-03-19T06:05:28.000 INFO:tasks.workunit.client.1.smithi172.stdout:6/447: chown d5/f5f 795924 1 2024-03-19T06:05:28.001 INFO:tasks.workunit.client.1.smithi172.stdout:3/351: creat d0/d5/d9/d60/d67/f84 x:0 0 0 2024-03-19T06:05:28.004 INFO:tasks.workunit.client.1.smithi172.stdout:8/307: unlink d0/f8 0 2024-03-19T06:05:28.005 INFO:tasks.workunit.client.1.smithi172.stdout:9/320: read d1/d7/dc/d23/f33 [443882,124107] 0 2024-03-19T06:05:28.007 INFO:tasks.workunit.client.1.smithi172.stdout:0/349: mknod d11/d14/d2c/c7a 0 2024-03-19T06:05:28.009 INFO:tasks.workunit.client.1.smithi172.stdout:8/308: mkdir d0/d61 0 2024-03-19T06:05:28.010 INFO:tasks.workunit.client.1.smithi172.stdout:3/352: rename d0/d5/d9/d60/c7f to d0/d5/d9/d34/d4d/c85 0 2024-03-19T06:05:28.012 INFO:tasks.workunit.client.1.smithi172.stdout:9/321: creat d1/d7/dc/d23/f6e x:0 0 0 2024-03-19T06:05:28.017 INFO:tasks.workunit.client.1.smithi172.stdout:8/309: rename d0/d10/d27/f2e to d0/d44/f62 0 2024-03-19T06:05:28.018 INFO:tasks.workunit.client.1.smithi172.stdout:4/361: truncate f8 3994351 0 2024-03-19T06:05:28.021 INFO:tasks.workunit.client.1.smithi172.stdout:4/362: rmdir df/d45 39 2024-03-19T06:05:28.023 INFO:tasks.workunit.client.1.smithi172.stdout:9/322: truncate d1/d7/f2e 21405 0 2024-03-19T06:05:28.024 INFO:tasks.workunit.client.1.smithi172.stdout:7/289: dwrite d0/d22/d1d/d36/f39 [0,4194304] 0 2024-03-19T06:05:28.025 INFO:tasks.workunit.client.1.smithi172.stdout:6/448: dwrite d5/f5f [0,4194304] 0 2024-03-19T06:05:28.034 INFO:tasks.workunit.client.1.smithi172.stdout:8/310: getdents d0/d44/d46 0 2024-03-19T06:05:28.037 INFO:tasks.workunit.client.1.smithi172.stdout:0/350: dwrite d11/d22/f3d [0,4194304] 0 2024-03-19T06:05:28.039 INFO:tasks.workunit.client.1.smithi172.stdout:8/311: read - d0/d44/d46/f60 zero size 2024-03-19T06:05:28.039 INFO:tasks.workunit.client.1.smithi172.stdout:9/323: rename d1/d7/dc/f15 to d1/d7/dc/d31/f6f 0 2024-03-19T06:05:28.040 INFO:tasks.workunit.client.1.smithi172.stdout:4/363: creat df/d2b/d2d/f73 x:0 0 0 2024-03-19T06:05:28.040 INFO:tasks.workunit.client.1.smithi172.stdout:3/353: dwrite d0/d5/d9/d34/f59 [0,4194304] 0 2024-03-19T06:05:28.041 INFO:tasks.workunit.client.1.smithi172.stdout:7/290: truncate d0/d22/d1d/d36/f5e 1032670 0 2024-03-19T06:05:28.044 INFO:tasks.workunit.client.1.smithi172.stdout:3/354: chown d0/d5/d9/l1e 1 1 2024-03-19T06:05:28.045 INFO:tasks.workunit.client.1.smithi172.stdout:8/312: read d0/d44/f5b [325390,53746] 0 2024-03-19T06:05:28.051 INFO:tasks.workunit.client.1.smithi172.stdout:7/291: creat d0/d22/d3d/f64 x:0 0 0 2024-03-19T06:05:28.056 INFO:tasks.workunit.client.1.smithi172.stdout:3/355: creat d0/d5/d9/d3a/f86 x:0 0 0 2024-03-19T06:05:28.057 INFO:tasks.workunit.client.1.smithi172.stdout:5/290: sync 2024-03-19T06:05:28.060 INFO:tasks.workunit.client.1.smithi172.stdout:6/449: getdents d5/d8f/d31/d3d 0 2024-03-19T06:05:28.060 INFO:tasks.workunit.client.1.smithi172.stdout:8/313: mknod d0/d44/d46/d49/d4f/d5c/c63 0 2024-03-19T06:05:28.060 INFO:tasks.workunit.client.1.smithi172.stdout:4/364: creat df/d11/d12/d34/f74 x:0 0 0 2024-03-19T06:05:28.066 INFO:tasks.workunit.client.1.smithi172.stdout:8/314: chown d0/f9 974675 1 2024-03-19T06:05:28.066 INFO:tasks.workunit.client.1.smithi172.stdout:5/291: write d5/f36 [1178090,75166] 0 2024-03-19T06:05:28.067 INFO:tasks.workunit.client.1.smithi172.stdout:6/450: rename d5/d11/l24 to d5/d11/d35/d40/l91 0 2024-03-19T06:05:28.069 INFO:tasks.workunit.client.1.smithi172.stdout:6/451: chown d5/f37 17966272 1 2024-03-19T06:05:28.071 INFO:tasks.workunit.client.1.smithi172.stdout:4/365: symlink df/d11/d12/d21/d58/d60/l75 0 2024-03-19T06:05:28.072 INFO:tasks.workunit.client.1.smithi172.stdout:5/292: rmdir d5/d14/d15/d40 39 2024-03-19T06:05:28.074 INFO:tasks.workunit.client.1.smithi172.stdout:8/315: mkdir d0/d64 0 2024-03-19T06:05:28.074 INFO:tasks.workunit.client.1.smithi172.stdout:0/351: dread d11/d4d/f5a [0,4194304] 0 2024-03-19T06:05:28.075 INFO:tasks.workunit.client.1.smithi172.stdout:8/316: stat d0/f11 0 2024-03-19T06:05:28.075 INFO:tasks.workunit.client.1.smithi172.stdout:0/352: fdatasync d11/f60 0 2024-03-19T06:05:28.075 INFO:tasks.workunit.client.1.smithi172.stdout:4/366: mkdir df/d11/d12/d26/d76 0 2024-03-19T06:05:28.076 INFO:tasks.workunit.client.1.smithi172.stdout:9/324: dread d1/f1c [0,4194304] 0 2024-03-19T06:05:28.079 INFO:tasks.workunit.client.1.smithi172.stdout:4/367: write df/f2e [501371,77977] 0 2024-03-19T06:05:28.080 INFO:tasks.workunit.client.1.smithi172.stdout:5/293: dread d5/d3c/f5a [0,4194304] 0 2024-03-19T06:05:28.080 INFO:tasks.workunit.client.1.smithi172.stdout:9/325: chown d1/d7/dc/d31/f2b 140870 1 2024-03-19T06:05:28.080 INFO:tasks.workunit.client.1.smithi172.stdout:0/353: chown d11/d18/d38/d3f/d43/f79 235213 1 2024-03-19T06:05:28.081 INFO:tasks.workunit.client.1.smithi172.stdout:6/452: getdents d5/d8f/d31 0 2024-03-19T06:05:28.083 INFO:tasks.workunit.client.1.smithi172.stdout:0/354: dread - d11/d22/f4a zero size 2024-03-19T06:05:28.086 INFO:tasks.workunit.client.1.smithi172.stdout:7/292: truncate d0/d22/f26 2436109 0 2024-03-19T06:05:28.087 INFO:tasks.workunit.client.1.smithi172.stdout:5/294: mknod d5/d1f/d2f/d62/c6b 0 2024-03-19T06:05:28.089 INFO:tasks.workunit.client.1.smithi172.stdout:5/295: fsync d5/d14/f4d 0 2024-03-19T06:05:28.089 INFO:tasks.workunit.client.1.smithi172.stdout:9/326: creat d1/d7/dc/de/d34/d48/f70 x:0 0 0 2024-03-19T06:05:28.089 INFO:tasks.workunit.client.1.smithi172.stdout:6/453: rename d5/d11/d35 to d5/d11/d35/d40/d53/d75/d92 22 2024-03-19T06:05:28.090 INFO:tasks.workunit.client.1.smithi172.stdout:7/293: symlink d0/d22/d1d/l65 0 2024-03-19T06:05:28.092 INFO:tasks.workunit.client.1.smithi172.stdout:5/296: mkdir d5/d3c/d6c 0 2024-03-19T06:05:28.092 INFO:tasks.workunit.client.1.smithi172.stdout:9/327: write d1/d7/dc/de/f1d [500474,101732] 0 2024-03-19T06:05:28.113 INFO:tasks.workunit.client.1.smithi172.stdout:7/294: unlink d0/d22/d3d/f5d 0 2024-03-19T06:05:28.113 INFO:tasks.workunit.client.1.smithi172.stdout:6/454: chown d5/d11/d43/d45/c7a 15 1 2024-03-19T06:05:28.115 INFO:tasks.workunit.client.1.smithi172.stdout:5/297: write d5/d55/f5f [610321,112946] 0 2024-03-19T06:05:28.117 INFO:tasks.workunit.client.1.smithi172.stdout:6/455: dread - d5/d8f/d31/d7b/d7e/f90 zero size 2024-03-19T06:05:28.118 INFO:tasks.workunit.client.1.smithi172.stdout:9/328: mknod d1/d7/dc/de/c71 0 2024-03-19T06:05:28.119 INFO:tasks.workunit.client.1.smithi172.stdout:6/456: read d5/d8f/d31/f57 [1541347,18762] 0 2024-03-19T06:05:28.120 INFO:tasks.workunit.client.1.smithi172.stdout:3/356: dread d0/d5/d9/d54/f70 [0,4194304] 0 2024-03-19T06:05:28.124 INFO:tasks.workunit.client.1.smithi172.stdout:6/457: creat d5/d11/d17/f93 x:0 0 0 2024-03-19T06:05:28.127 INFO:tasks.workunit.client.1.smithi172.stdout:5/298: rename d5/d14/d34/f3e to d5/d14/d15/d40/d6a/f6d 0 2024-03-19T06:05:28.129 INFO:tasks.workunit.client.1.smithi172.stdout:8/317: dread d0/d10/d27/f1e [0,4194304] 0 2024-03-19T06:05:28.131 INFO:tasks.workunit.client.1.smithi172.stdout:3/357: rmdir d0/d5/d9/d60 39 2024-03-19T06:05:28.132 INFO:tasks.workunit.client.1.smithi172.stdout:4/368: dread df/d11/f32 [0,4194304] 0 2024-03-19T06:05:28.133 INFO:tasks.workunit.client.1.smithi172.stdout:7/295: dwrite d0/d22/f1e [4194304,4194304] 0 2024-03-19T06:05:28.142 INFO:tasks.workunit.client.1.smithi172.stdout:6/458: dwrite d5/d11/d43/f64 [0,4194304] 0 2024-03-19T06:05:28.142 INFO:tasks.workunit.client.1.smithi172.stdout:3/358: rmdir d0/d5/d9/d34/d4d 39 2024-03-19T06:05:28.145 INFO:tasks.workunit.client.1.smithi172.stdout:6/459: truncate d5/d8f/d31/d7b/f7f 1004091 0 2024-03-19T06:05:28.149 INFO:tasks.workunit.client.1.smithi172.stdout:4/369: dread df/d11/f37 [0,4194304] 0 2024-03-19T06:05:28.150 INFO:tasks.workunit.client.1.smithi172.stdout:4/370: readlink df/d11/d12/d21/l5e 0 2024-03-19T06:05:28.155 INFO:tasks.workunit.client.1.smithi172.stdout:7/296: rename d0/d22/d1d/l59 to d0/d2c/l66 0 2024-03-19T06:05:28.155 INFO:tasks.workunit.client.1.smithi172.stdout:8/318: unlink d0/d10/d27/d29/d28/l43 0 2024-03-19T06:05:28.155 INFO:tasks.workunit.client.1.smithi172.stdout:9/329: link d1/l20 d1/d7/dc/de/d34/d48/l72 0 2024-03-19T06:05:28.155 INFO:tasks.workunit.client.1.smithi172.stdout:3/359: chown d0/d5/d9/d34/d4d/c28 21283 1 2024-03-19T06:05:28.157 INFO:tasks.workunit.client.1.smithi172.stdout:3/360: chown d0/d5/l42 3290324 1 2024-03-19T06:05:28.157 INFO:tasks.workunit.client.1.smithi172.stdout:6/460: dread d5/f5f [0,4194304] 0 2024-03-19T06:05:28.160 INFO:tasks.workunit.client.1.smithi172.stdout:8/319: chown d0/cf 306 1 2024-03-19T06:05:28.163 INFO:tasks.workunit.client.1.smithi172.stdout:6/461: rename d5/d11/d35/d40/d53/d75/c3f to d5/d11/d35/c94 0 2024-03-19T06:05:28.163 INFO:tasks.workunit.client.1.smithi172.stdout:4/371: getdents df/d11/d12/d69 0 2024-03-19T06:05:28.164 INFO:tasks.workunit.client.1.smithi172.stdout:7/297: truncate d0/d22/d1d/d36/f11 1073309 0 2024-03-19T06:05:28.165 INFO:tasks.workunit.client.1.smithi172.stdout:8/320: mkdir d0/d10/d27/d65 0 2024-03-19T06:05:28.167 INFO:tasks.workunit.client.1.smithi172.stdout:7/298: chown d0/d2c/f2f 65038296 1 2024-03-19T06:05:28.170 INFO:tasks.workunit.client.1.smithi172.stdout:9/330: dwrite d1/d7/dc/de/f50 [0,4194304] 0 2024-03-19T06:05:28.170 INFO:tasks.workunit.client.1.smithi172.stdout:1/402: sync 2024-03-19T06:05:28.170 INFO:tasks.workunit.client.1.smithi172.stdout:2/278: sync 2024-03-19T06:05:28.188 INFO:tasks.workunit.client.1.smithi172.stdout:6/462: dwrite d5/d11/d17/d1b/f21 [0,4194304] 0 2024-03-19T06:05:28.189 INFO:tasks.workunit.client.1.smithi172.stdout:7/299: dwrite d0/f15 [0,4194304] 0 2024-03-19T06:05:28.193 INFO:tasks.workunit.client.1.smithi172.stdout:4/372: dwrite df/d2b/d2d/f46 [0,4194304] 0 2024-03-19T06:05:28.196 INFO:tasks.workunit.client.1.smithi172.stdout:2/279: truncate d7/de/f42 4124977 0 2024-03-19T06:05:28.203 INFO:tasks.workunit.client.1.smithi172.stdout:1/403: dwrite da/dd/d10/d14/d27/d3f/d5e/f7e [0,4194304] 0 2024-03-19T06:05:28.203 INFO:tasks.workunit.client.1.smithi172.stdout:8/321: dread d0/d10/f4a [0,4194304] 0 2024-03-19T06:05:28.203 INFO:tasks.workunit.client.1.smithi172.stdout:4/373: write df/d11/d12/d21/d58/d60/f70 [874198,72756] 0 2024-03-19T06:05:28.204 INFO:tasks.workunit.client.1.smithi172.stdout:6/463: dread d5/d11/f4b [0,4194304] 0 2024-03-19T06:05:28.205 INFO:tasks.workunit.client.1.smithi172.stdout:7/300: mkdir d0/d22/d3d/d41/d42/d5c/d67 0 2024-03-19T06:05:28.208 INFO:tasks.workunit.client.1.smithi172.stdout:1/404: mkdir da/dd/d10/d14/d84 0 2024-03-19T06:05:28.212 INFO:tasks.workunit.client.1.smithi172.stdout:7/301: unlink d0/l2a 0 2024-03-19T06:05:28.214 INFO:tasks.workunit.client.1.smithi172.stdout:8/322: mknod d0/d44/d46/d49/d4f/d5c/c66 0 2024-03-19T06:05:28.217 INFO:tasks.workunit.client.1.smithi172.stdout:1/405: mknod da/dd/d10/c85 0 2024-03-19T06:05:28.221 INFO:tasks.workunit.client.1.smithi172.stdout:2/280: write d7/db/f13 [839585,115455] 0 2024-03-19T06:05:28.224 INFO:tasks.workunit.client.1.smithi172.stdout:4/374: rename df/d11/f20 to df/d11/f77 0 2024-03-19T06:05:28.224 INFO:tasks.workunit.client.1.smithi172.stdout:2/281: chown d7/db/l47 4163 1 2024-03-19T06:05:28.224 INFO:tasks.workunit.client.1.smithi172.stdout:8/323: symlink d0/d10/d27/d65/l67 0 2024-03-19T06:05:28.227 INFO:tasks.workunit.client.1.smithi172.stdout:1/406: rename da/dd/d10/f50 to da/d33/f86 0 2024-03-19T06:05:28.228 INFO:tasks.workunit.client.1.smithi172.stdout:6/464: dwrite d5/f8 [0,4194304] 0 2024-03-19T06:05:28.229 INFO:tasks.workunit.client.1.smithi172.stdout:7/302: truncate d0/d2c/f30 1074501 0 2024-03-19T06:05:28.231 INFO:tasks.workunit.client.1.smithi172.stdout:4/375: symlink df/d2b/d2d/l78 0 2024-03-19T06:05:28.233 INFO:tasks.workunit.client.1.smithi172.stdout:2/282: rename d7/db/f4b to d7/de/f5b 0 2024-03-19T06:05:28.234 INFO:tasks.workunit.client.1.smithi172.stdout:4/376: dread - df/d2b/f53 zero size 2024-03-19T06:05:28.235 INFO:tasks.workunit.client.1.smithi172.stdout:1/407: creat da/d33/d4e/d60/f87 x:0 0 0 2024-03-19T06:05:28.236 INFO:tasks.workunit.client.1.smithi172.stdout:2/283: dread - d7/db/d2c/f38 zero size 2024-03-19T06:05:28.236 INFO:tasks.workunit.client.1.smithi172.stdout:4/377: chown df/d2b 8952 1 2024-03-19T06:05:28.240 INFO:tasks.workunit.client.1.smithi172.stdout:4/378: mknod df/d2b/d2d/c79 0 2024-03-19T06:05:28.241 INFO:tasks.workunit.client.1.smithi172.stdout:1/408: symlink da/d33/l88 0 2024-03-19T06:05:28.243 INFO:tasks.workunit.client.1.smithi172.stdout:2/284: rmdir d7/db/d45/d4f 39 2024-03-19T06:05:28.247 INFO:tasks.workunit.client.1.smithi172.stdout:4/379: creat df/d11/d12/d21/d58/d60/f7a x:0 0 0 2024-03-19T06:05:28.247 INFO:tasks.workunit.client.1.smithi172.stdout:6/465: getdents d5/d11/d17/d36 0 2024-03-19T06:05:28.249 INFO:tasks.workunit.client.1.smithi172.stdout:2/285: rename d7/d4c/c53 to d7/db/c5c 0 2024-03-19T06:05:28.250 INFO:tasks.workunit.client.1.smithi172.stdout:4/380: write df/d11/d12/d26/f30 [52988,2770] 0 2024-03-19T06:05:28.252 INFO:tasks.workunit.client.1.smithi172.stdout:2/286: chown d7/f15 18667547 1 2024-03-19T06:05:28.252 INFO:tasks.workunit.client.1.smithi172.stdout:4/381: stat df/d11/d12/d21 0 2024-03-19T06:05:28.254 INFO:tasks.workunit.client.1.smithi172.stdout:7/303: dread d0/d22/f26 [0,4194304] 0 2024-03-19T06:05:28.255 INFO:tasks.workunit.client.1.smithi172.stdout:2/287: creat d7/de/f5d x:0 0 0 2024-03-19T06:05:28.255 INFO:tasks.workunit.client.1.smithi172.stdout:1/409: dread da/dd/d10/f1d [0,4194304] 0 2024-03-19T06:05:28.256 INFO:tasks.workunit.client.1.smithi172.stdout:4/382: write df/d11/d12/d26/f35 [598771,113056] 0 2024-03-19T06:05:28.257 INFO:tasks.workunit.client.1.smithi172.stdout:0/355: sync 2024-03-19T06:05:28.257 INFO:tasks.workunit.client.1.smithi172.stdout:7/304: fdatasync d0/d22/d1d/d36/d40/f5f 0 2024-03-19T06:05:28.260 INFO:tasks.workunit.client.1.smithi172.stdout:2/288: rename d7/db/c19 to d7/d1b/c5e 0 2024-03-19T06:05:28.261 INFO:tasks.workunit.client.1.smithi172.stdout:2/289: readlink d7/db/l3e 0 2024-03-19T06:05:28.262 INFO:tasks.workunit.client.1.smithi172.stdout:1/410: unlink da/d33/d59/f7f 0 2024-03-19T06:05:28.262 INFO:tasks.workunit.client.1.smithi172.stdout:6/466: dread d5/d11/d17/d1b/f25 [0,4194304] 0 2024-03-19T06:05:28.263 INFO:tasks.workunit.client.1.smithi172.stdout:7/305: symlink d0/d22/d1d/d36/d56/l68 0 2024-03-19T06:05:28.264 INFO:tasks.workunit.client.1.smithi172.stdout:2/290: mkdir d7/de/d58/d55/d5f 0 2024-03-19T06:05:28.265 INFO:tasks.workunit.client.1.smithi172.stdout:6/467: rmdir d5/d8f/d31/d7b 39 2024-03-19T06:05:28.265 INFO:tasks.workunit.client.1.smithi172.stdout:1/411: write da/dd/d10/d14/d27/f37 [1068083,35510] 0 2024-03-19T06:05:28.265 INFO:tasks.workunit.client.1.smithi172.stdout:7/306: read d0/d22/d1d/f5a [419344,40355] 0 2024-03-19T06:05:28.268 INFO:tasks.workunit.client.1.smithi172.stdout:6/468: write d5/f10 [4173257,8760] 0 2024-03-19T06:05:28.273 INFO:tasks.workunit.client.1.smithi172.stdout:2/291: mknod d7/db/d2c/d35/c60 0 2024-03-19T06:05:28.274 INFO:tasks.workunit.client.1.smithi172.stdout:6/469: mkdir d5/d8f/d31/d3d/d95 0 2024-03-19T06:05:28.276 INFO:tasks.workunit.client.1.smithi172.stdout:7/307: truncate d0/d22/d1d/f32 1339340 0 2024-03-19T06:05:28.277 INFO:tasks.workunit.client.1.smithi172.stdout:0/356: dwrite d11/d22/d68/f75 [0,4194304] 0 2024-03-19T06:05:28.278 INFO:tasks.workunit.client.1.smithi172.stdout:2/292: mkdir d7/de/d61 0 2024-03-19T06:05:28.283 INFO:tasks.workunit.client.1.smithi172.stdout:4/383: truncate df/d11/f32 2505468 0 2024-03-19T06:05:28.284 INFO:tasks.workunit.client.1.smithi172.stdout:2/293: chown d7/f15 29 1 2024-03-19T06:05:28.292 INFO:tasks.workunit.client.1.smithi172.stdout:2/294: creat d7/db/f62 x:0 0 0 2024-03-19T06:05:28.294 INFO:tasks.workunit.client.1.smithi172.stdout:0/357: dwrite ff [0,4194304] 0 2024-03-19T06:05:28.294 INFO:tasks.workunit.client.1.smithi172.stdout:1/412: dwrite da/dd/d10/f23 [0,4194304] 0 2024-03-19T06:05:28.294 INFO:tasks.workunit.client.1.smithi172.stdout:2/295: readlink d7/de/l12 0 2024-03-19T06:05:28.296 INFO:tasks.workunit.client.1.smithi172.stdout:7/308: rename d0/d22/d1d/d36/d40/l57 to d0/d22/d1d/d36/l69 0 2024-03-19T06:05:28.296 INFO:tasks.workunit.client.1.smithi172.stdout:6/470: link d5/c2e d5/d11/d43/d45/c96 0 2024-03-19T06:05:28.299 INFO:tasks.workunit.client.1.smithi172.stdout:0/358: creat d11/d18/d38/d3f/d43/f7b x:0 0 0 2024-03-19T06:05:28.301 INFO:tasks.workunit.client.1.smithi172.stdout:1/413: mknod da/d33/d81/c89 0 2024-03-19T06:05:28.301 INFO:tasks.workunit.client.1.smithi172.stdout:4/384: getdents df/d45 0 2024-03-19T06:05:28.302 INFO:tasks.workunit.client.1.smithi172.stdout:0/359: rmdir d11/d4d 39 2024-03-19T06:05:28.308 INFO:tasks.workunit.client.1.smithi172.stdout:1/414: fdatasync da/dd/d10/f58 0 2024-03-19T06:05:28.312 INFO:tasks.workunit.client.1.smithi172.stdout:5/299: sync 2024-03-19T06:05:28.312 INFO:tasks.workunit.client.1.smithi172.stdout:3/361: sync 2024-03-19T06:05:28.323 INFO:tasks.workunit.client.1.smithi172.stdout:2/296: dwrite d7/f26 [0,4194304] 0 2024-03-19T06:05:28.323 INFO:tasks.workunit.client.1.smithi172.stdout:1/415: rename da/cc to da/d33/d81/c8a 0 2024-03-19T06:05:28.323 INFO:tasks.workunit.client.1.smithi172.stdout:7/309: dwrite d0/d22/d3d/f64 [0,4194304] 0 2024-03-19T06:05:28.326 INFO:tasks.workunit.client.1.smithi172.stdout:0/360: rmdir d11/d18/d38/d3f/d43/d62/d67 0 2024-03-19T06:05:28.331 INFO:tasks.workunit.client.1.smithi172.stdout:3/362: rename d0/d5/d9/l1e to d0/d5/d9/d25/l87 0 2024-03-19T06:05:28.331 INFO:tasks.workunit.client.1.smithi172.stdout:7/310: rmdir d0/d22 39 2024-03-19T06:05:28.331 INFO:tasks.workunit.client.1.smithi172.stdout:5/300: link d5/d1f/l2b d5/d3c/d6c/l6e 0 2024-03-19T06:05:28.331 INFO:tasks.workunit.client.1.smithi172.stdout:1/416: mkdir da/dd/d10/d14/d73/d8b 0 2024-03-19T06:05:28.335 INFO:tasks.workunit.client.1.smithi172.stdout:0/361: truncate d11/d18/d38/d3f/d43/f79 65132 0 2024-03-19T06:05:28.337 INFO:tasks.workunit.client.1.smithi172.stdout:3/363: mkdir d0/d5/d9/d34/d4d/d6c/d88 0 2024-03-19T06:05:28.338 INFO:tasks.workunit.client.1.smithi172.stdout:5/301: creat d5/d14/d56/f6f x:0 0 0 2024-03-19T06:05:28.340 INFO:tasks.workunit.client.1.smithi172.stdout:2/297: rename d7/db/f1d to d7/de/d61/f63 0 2024-03-19T06:05:28.341 INFO:tasks.workunit.client.1.smithi172.stdout:0/362: mkdir d11/d22/d32/d7c 0 2024-03-19T06:05:28.341 INFO:tasks.workunit.client.1.smithi172.stdout:1/417: mknod da/d3b/c8c 0 2024-03-19T06:05:28.342 INFO:tasks.workunit.client.1.smithi172.stdout:4/385: dwrite df/d11/d12/d26/f43 [0,4194304] 0 2024-03-19T06:05:28.342 INFO:tasks.workunit.client.1.smithi172.stdout:5/302: readlink d5/d14/d15/d40/l5d 0 2024-03-19T06:05:28.346 INFO:tasks.workunit.client.1.smithi172.stdout:2/298: chown d7/db/d2c/l3b 295 1 2024-03-19T06:05:28.347 INFO:tasks.workunit.client.1.smithi172.stdout:1/418: stat da/dd/d10/d36/f38 0 2024-03-19T06:05:28.347 INFO:tasks.workunit.client.1.smithi172.stdout:2/299: dread - d7/db/d2c/f4a zero size 2024-03-19T06:05:28.349 INFO:tasks.workunit.client.1.smithi172.stdout:7/311: rename d0/d22/d1d/f5a to d0/d22/d1d/d36/d56/f6a 0 2024-03-19T06:05:28.352 INFO:tasks.workunit.client.1.smithi172.stdout:3/364: write d0/d5/d9/d34/f64 [209965,58128] 0 2024-03-19T06:05:28.352 INFO:tasks.workunit.client.1.smithi172.stdout:9/331: sync 2024-03-19T06:05:28.352 INFO:tasks.workunit.client.1.smithi172.stdout:8/324: sync 2024-03-19T06:05:28.354 INFO:tasks.workunit.client.1.smithi172.stdout:9/332: stat d1/d7/dc/de/c3b 0 2024-03-19T06:05:28.356 INFO:tasks.workunit.client.1.smithi172.stdout:8/325: chown d0/le 223282 1 2024-03-19T06:05:28.357 INFO:tasks.workunit.client.1.smithi172.stdout:6/471: dread d5/fe [0,4194304] 0 2024-03-19T06:05:28.360 INFO:tasks.workunit.client.1.smithi172.stdout:8/326: write d0/d10/f56 [674217,122022] 0 2024-03-19T06:05:28.368 INFO:tasks.workunit.client.1.smithi172.stdout:0/363: dwrite d11/d22/d46/f6b [0,4194304] 0 2024-03-19T06:05:28.376 INFO:tasks.workunit.client.1.smithi172.stdout:1/419: mknod da/d7a/c8d 0 2024-03-19T06:05:28.382 INFO:tasks.workunit.client.1.smithi172.stdout:4/386: creat df/d11/d12/d6e/f7b x:0 0 0 2024-03-19T06:05:28.384 INFO:tasks.workunit.client.1.smithi172.stdout:2/300: dwrite d7/de/d58/d56/f2b [0,4194304] 0 2024-03-19T06:05:28.388 INFO:tasks.workunit.client.1.smithi172.stdout:0/364: creat d11/d14/d2c/d4e/f7d x:0 0 0 2024-03-19T06:05:28.390 INFO:tasks.workunit.client.1.smithi172.stdout:2/301: write d7/de/d58/d56/f34 [271193,4852] 0 2024-03-19T06:05:28.401 INFO:tasks.workunit.client.1.smithi172.stdout:0/365: symlink d11/d14/d2c/d4e/l7e 0 2024-03-19T06:05:28.404 INFO:tasks.workunit.client.1.smithi172.stdout:4/387: mknod df/d11/d12/d26/d76/c7c 0 2024-03-19T06:05:28.404 INFO:tasks.workunit.client.1.smithi172.stdout:2/302: chown d7/de/f42 40200088 1 2024-03-19T06:05:28.405 INFO:tasks.workunit.client.1.smithi172.stdout:9/333: link d1/c11 d1/d7/dc/d4c/c73 0 2024-03-19T06:05:28.406 INFO:tasks.workunit.client.1.smithi172.stdout:6/472: dread d5/f19 [0,4194304] 0 2024-03-19T06:05:28.406 INFO:tasks.workunit.client.1.smithi172.stdout:2/303: fdatasync d7/db/f32 0 2024-03-19T06:05:28.407 INFO:tasks.workunit.client.1.smithi172.stdout:3/365: creat d0/d5/d14/f89 x:0 0 0 2024-03-19T06:05:28.408 INFO:tasks.workunit.client.1.smithi172.stdout:8/327: rename d0/l13 to d0/d64/l68 0 2024-03-19T06:05:28.409 INFO:tasks.workunit.client.1.smithi172.stdout:2/304: dread - d7/db/d2c/f38 zero size 2024-03-19T06:05:28.410 INFO:tasks.workunit.client.1.smithi172.stdout:3/366: readlink d0/d5/d9/d25/l57 0 2024-03-19T06:05:28.410 INFO:tasks.workunit.client.1.smithi172.stdout:2/305: readlink d7/db/l3e 0 2024-03-19T06:05:28.411 INFO:tasks.workunit.client.1.smithi172.stdout:0/366: creat d11/d18/d38/d3f/d43/f7f x:0 0 0 2024-03-19T06:05:28.413 INFO:tasks.workunit.client.1.smithi172.stdout:4/388: symlink df/d11/d12/d21/d50/l7d 0 2024-03-19T06:05:28.415 INFO:tasks.workunit.client.1.smithi172.stdout:6/473: write d5/d11/d17/f8e [127175,18018] 0 2024-03-19T06:05:28.415 INFO:tasks.workunit.client.1.smithi172.stdout:1/420: getdents da/d33/d59 0 2024-03-19T06:05:28.415 INFO:tasks.workunit.client.1.smithi172.stdout:4/389: dread - df/d11/d12/d21/d50/f54 zero size 2024-03-19T06:05:28.418 INFO:tasks.workunit.client.1.smithi172.stdout:1/421: dread - da/d3b/f83 zero size 2024-03-19T06:05:28.418 INFO:tasks.workunit.client.1.smithi172.stdout:0/367: creat d11/d18/d38/f80 x:0 0 0 2024-03-19T06:05:28.419 INFO:tasks.workunit.client.1.smithi172.stdout:4/390: write df/d11/d12/d26/f43 [4411974,15494] 0 2024-03-19T06:05:28.420 INFO:tasks.workunit.client.1.smithi172.stdout:0/368: chown d11/d18/f21 92493990 1 2024-03-19T06:05:28.420 INFO:tasks.workunit.client.1.smithi172.stdout:3/367: symlink d0/d5/d9/d34/d4d/d6c/d88/l8a 0 2024-03-19T06:05:28.432 INFO:tasks.workunit.client.1.smithi172.stdout:7/312: truncate d0/d22/f1e 4020671 0 2024-03-19T06:05:28.433 INFO:tasks.workunit.client.1.smithi172.stdout:1/422: rmdir da/dd/d10 39 2024-03-19T06:05:28.435 INFO:tasks.workunit.client.1.smithi172.stdout:9/334: write d1/d7/dc/d23/f33 [1881392,104108] 0 2024-03-19T06:05:28.438 INFO:tasks.workunit.client.1.smithi172.stdout:0/369: mknod d11/d18/d38/d3f/c81 0 2024-03-19T06:05:28.438 INFO:tasks.workunit.client.1.smithi172.stdout:4/391: creat df/d11/d12/d69/f7e x:0 0 0 2024-03-19T06:05:28.438 INFO:tasks.workunit.client.1.smithi172.stdout:7/313: mkdir d0/d22/d1d/d3a/d6b 0 2024-03-19T06:05:28.439 INFO:tasks.workunit.client.1.smithi172.stdout:1/423: mknod da/dd/d31/d47/c8e 0 2024-03-19T06:05:28.440 INFO:tasks.workunit.client.1.smithi172.stdout:5/303: link d5/c11 d5/c70 0 2024-03-19T06:05:28.441 INFO:tasks.workunit.client.1.smithi172.stdout:0/370: dread - d11/d14/f2e zero size 2024-03-19T06:05:28.442 INFO:tasks.workunit.client.1.smithi172.stdout:9/335: creat d1/d7/dc/d4c/d57/f74 x:0 0 0 2024-03-19T06:05:28.445 INFO:tasks.workunit.client.1.smithi172.stdout:8/328: dwrite d0/d44/d46/d49/d26/d2f/f45 [4194304,4194304] 0 2024-03-19T06:05:28.445 INFO:tasks.workunit.client.1.smithi172.stdout:5/304: fdatasync d5/d55/f5f 0 2024-03-19T06:05:28.445 INFO:tasks.workunit.client.1.smithi172.stdout:0/371: chown d11/d22/d32/d7c 1689374 1 2024-03-19T06:05:28.448 INFO:tasks.workunit.client.1.smithi172.stdout:3/368: getdents d0/d5 0 2024-03-19T06:05:28.448 INFO:tasks.workunit.client.1.smithi172.stdout:6/474: dwrite d5/fe [0,4194304] 0 2024-03-19T06:05:28.448 INFO:tasks.workunit.client.1.smithi172.stdout:0/372: chown d11/d18 69026 1 2024-03-19T06:05:28.453 INFO:tasks.workunit.client.1.smithi172.stdout:8/329: fdatasync d0/d44/d46/d49/d3a/f41 0 2024-03-19T06:05:28.453 INFO:tasks.workunit.client.1.smithi172.stdout:1/424: mkdir da/d33/d8f 0 2024-03-19T06:05:28.453 INFO:tasks.workunit.client.1.smithi172.stdout:5/305: write d5/d1f/f2c [1195003,60848] 0 2024-03-19T06:05:28.453 INFO:tasks.workunit.client.1.smithi172.stdout:6/475: chown d5/d11/d17 640708746 1 2024-03-19T06:05:28.456 INFO:tasks.workunit.client.1.smithi172.stdout:4/392: rename df/d11/d12/d26/d76/c7c to df/d45/c7f 0 2024-03-19T06:05:28.462 INFO:tasks.workunit.client.1.smithi172.stdout:3/369: dread - d0/d5/d14/f89 zero size 2024-03-19T06:05:28.462 INFO:tasks.workunit.client.1.smithi172.stdout:7/314: rename d0/d22/f1b to d0/d22/d1d/d36/d56/f6c 0 2024-03-19T06:05:28.465 INFO:tasks.workunit.client.1.smithi172.stdout:0/373: getdents d11/d22/d32 0 2024-03-19T06:05:28.466 INFO:tasks.workunit.client.1.smithi172.stdout:6/476: rename d5/f33 to d5/d11/d43/d45/f97 0 2024-03-19T06:05:28.471 INFO:tasks.workunit.client.1.smithi172.stdout:0/374: symlink d11/l82 0 2024-03-19T06:05:28.472 INFO:tasks.workunit.client.1.smithi172.stdout:3/370: chown d0/d5/d9/d25/d21/l4b 0 1 2024-03-19T06:05:28.473 INFO:tasks.workunit.client.1.smithi172.stdout:9/336: dwrite d1/d7/dc/f5d [0,4194304] 0 2024-03-19T06:05:28.475 INFO:tasks.workunit.client.1.smithi172.stdout:3/371: chown d0/d5/l79 58100 1 2024-03-19T06:05:28.479 INFO:tasks.workunit.client.1.smithi172.stdout:6/477: mkdir d5/d8f/d31/d3d/d98 0 2024-03-19T06:05:28.481 INFO:tasks.workunit.client.1.smithi172.stdout:5/306: dwrite d5/ff [4194304,4194304] 0 2024-03-19T06:05:28.482 INFO:tasks.workunit.client.1.smithi172.stdout:4/393: link df/d11/d12/d21/l23 df/d11/d12/d21/d58/l80 0 2024-03-19T06:05:28.483 INFO:tasks.workunit.client.1.smithi172.stdout:1/425: truncate da/dd/d10/f58 4026446 0 2024-03-19T06:05:28.485 INFO:tasks.workunit.client.1.smithi172.stdout:6/478: chown d5/d8f/d31/f60 31812718 1 2024-03-19T06:05:28.487 INFO:tasks.workunit.client.1.smithi172.stdout:5/307: write d5/f67 [43287,112576] 0 2024-03-19T06:05:28.491 INFO:tasks.workunit.client.1.smithi172.stdout:0/375: rmdir d11/d4d/d65 0 2024-03-19T06:05:28.495 INFO:tasks.workunit.client.1.smithi172.stdout:9/337: creat d1/f75 x:0 0 0 2024-03-19T06:05:28.498 INFO:tasks.workunit.client.1.smithi172.stdout:4/394: mknod df/d2b/d2d/c81 0 2024-03-19T06:05:28.507 INFO:tasks.workunit.client.1.smithi172.stdout:0/376: truncate d11/d18/d38/d3f/d43/f7f 314314 0 2024-03-19T06:05:28.507 INFO:tasks.workunit.client.1.smithi172.stdout:1/426: truncate da/dd/d10/d14/d27/f5a 268318 0 2024-03-19T06:05:28.507 INFO:tasks.workunit.client.1.smithi172.stdout:6/479: write d5/d11/f4b [1215981,103727] 0 2024-03-19T06:05:28.507 INFO:tasks.workunit.client.1.smithi172.stdout:9/338: creat d1/d7/dc/d47/f76 x:0 0 0 2024-03-19T06:05:28.508 INFO:tasks.workunit.client.1.smithi172.stdout:5/308: symlink d5/d14/d15/d40/d5c/l71 0 2024-03-19T06:05:28.513 INFO:tasks.workunit.client.1.smithi172.stdout:5/309: dread - d5/d14/f69 zero size 2024-03-19T06:05:28.515 INFO:tasks.workunit.client.1.smithi172.stdout:6/480: chown d5/c77 95 1 2024-03-19T06:05:28.516 INFO:tasks.workunit.client.1.smithi172.stdout:0/377: write d11/d14/d2c/d4e/f64 [1024793,2514] 0 2024-03-19T06:05:28.516 INFO:tasks.workunit.client.1.smithi172.stdout:1/427: chown da/dd/d10/d14/d27/f32 573934579 1 2024-03-19T06:05:28.518 INFO:tasks.workunit.client.1.smithi172.stdout:8/330: dread d0/d10/d27/f38 [0,4194304] 0 2024-03-19T06:05:28.520 INFO:tasks.workunit.client.1.smithi172.stdout:3/372: dwrite d0/d5/d9/f2c [4194304,4194304] 0 2024-03-19T06:05:28.520 INFO:tasks.workunit.client.1.smithi172.stdout:4/395: truncate df/d11/d12/d21/d58/d60/f7a 666085 0 2024-03-19T06:05:28.522 INFO:tasks.workunit.client.1.smithi172.stdout:2/306: sync 2024-03-19T06:05:28.522 INFO:tasks.workunit.client.1.smithi172.stdout:5/310: rmdir d5/d1f/d2f/d62 39 2024-03-19T06:05:28.523 INFO:tasks.workunit.client.1.smithi172.stdout:7/315: dwrite d0/d22/d1d/d36/d56/f6a [0,4194304] 0 2024-03-19T06:05:28.524 INFO:tasks.workunit.client.1.smithi172.stdout:8/331: write d0/d10/d27/d29/d28/f40 [2698236,103372] 0 2024-03-19T06:05:28.524 INFO:tasks.workunit.client.1.smithi172.stdout:6/481: dread - d5/d8f/d31/d7b/d7e/f88 zero size 2024-03-19T06:05:28.526 INFO:tasks.workunit.client.1.smithi172.stdout:2/307: readlink d7/de/l12 0 2024-03-19T06:05:28.528 INFO:tasks.workunit.client.1.smithi172.stdout:1/428: write da/d33/f86 [972856,45292] 0 2024-03-19T06:05:28.528 INFO:tasks.workunit.client.1.smithi172.stdout:2/308: fdatasync d7/d1b/f3f 0 2024-03-19T06:05:28.534 INFO:tasks.workunit.client.1.smithi172.stdout:0/378: creat d11/f83 x:0 0 0 2024-03-19T06:05:28.534 INFO:tasks.workunit.client.1.smithi172.stdout:5/311: symlink d5/d14/d15/d40/d6a/l72 0 2024-03-19T06:05:28.538 INFO:tasks.workunit.client.1.smithi172.stdout:8/332: creat d0/d10/d27/d29/d28/d55/f69 x:0 0 0 2024-03-19T06:05:28.538 INFO:tasks.workunit.client.1.smithi172.stdout:5/312: chown d5/d1f/d2f 50336 1 2024-03-19T06:05:28.538 INFO:tasks.workunit.client.1.smithi172.stdout:1/429: mkdir da/d33/d59/d90 0 2024-03-19T06:05:28.539 INFO:tasks.workunit.client.1.smithi172.stdout:2/309: symlink d7/d1b/l64 0 2024-03-19T06:05:28.539 INFO:tasks.workunit.client.1.smithi172.stdout:0/379: mkdir d11/d22/d46/d84 0 2024-03-19T06:05:28.539 INFO:tasks.workunit.client.1.smithi172.stdout:1/430: chown da/dd/d31/f4d 811562 1 2024-03-19T06:05:28.541 INFO:tasks.workunit.client.1.smithi172.stdout:3/373: creat d0/d5/d9/d34/f8b x:0 0 0 2024-03-19T06:05:28.543 INFO:tasks.workunit.client.1.smithi172.stdout:0/380: chown d11/d18/d38/d3f/d43/d62 17 1 2024-03-19T06:05:28.547 INFO:tasks.workunit.client.1.smithi172.stdout:3/374: mkdir d0/d5/d9/d34/d4d/d6c/d8c 0 2024-03-19T06:05:28.550 INFO:tasks.workunit.client.1.smithi172.stdout:0/381: rename d11/d18/d38/d3f/d43/c57 to d11/d22/d32/c85 0 2024-03-19T06:05:28.551 INFO:tasks.workunit.client.1.smithi172.stdout:6/482: link d5/d11/c39 d5/d11/d17/d1b/d74/c99 0 2024-03-19T06:05:28.555 INFO:tasks.workunit.client.1.smithi172.stdout:2/310: rmdir d7/d5a 0 2024-03-19T06:05:28.557 INFO:tasks.workunit.client.1.smithi172.stdout:4/396: dwrite df/d11/d12/f29 [0,4194304] 0 2024-03-19T06:05:28.560 INFO:tasks.workunit.client.1.smithi172.stdout:6/483: fdatasync d5/d11/d17/f93 0 2024-03-19T06:05:28.567 INFO:tasks.workunit.client.1.smithi172.stdout:1/431: dwrite da/f77 [0,4194304] 0 2024-03-19T06:05:28.570 INFO:tasks.workunit.client.1.smithi172.stdout:6/484: dread - d5/d11/d43/d45/f5c zero size 2024-03-19T06:05:28.574 INFO:tasks.workunit.client.1.smithi172.stdout:5/313: dwrite d5/d14/d15/d40/f54 [0,4194304] 0 2024-03-19T06:05:28.575 INFO:tasks.workunit.client.1.smithi172.stdout:3/375: getdents d0/d5/d9/d60 0 2024-03-19T06:05:28.575 INFO:tasks.workunit.client.1.smithi172.stdout:6/485: chown d5/d11/d17/c8d 63054550 1 2024-03-19T06:05:28.577 INFO:tasks.workunit.client.1.smithi172.stdout:1/432: symlink da/d3b/l91 0 2024-03-19T06:05:28.578 INFO:tasks.workunit.client.1.smithi172.stdout:0/382: link d11/d14/d2c/d36/c61 d11/d14/d2c/d4e/c86 0 2024-03-19T06:05:28.578 INFO:tasks.workunit.client.1.smithi172.stdout:2/311: getdents d7/de/d58 0 2024-03-19T06:05:28.579 INFO:tasks.workunit.client.1.smithi172.stdout:8/333: dwrite d0/d44/d46/d49/d26/f48 [0,4194304] 0 2024-03-19T06:05:28.580 INFO:tasks.workunit.client.1.smithi172.stdout:2/312: readlink d7/d1b/l64 0 2024-03-19T06:05:28.580 INFO:tasks.workunit.client.1.smithi172.stdout:3/376: symlink d0/d5/l8d 0 2024-03-19T06:05:28.580 INFO:tasks.workunit.client.1.smithi172.stdout:0/383: stat d11/d14/l3b 0 2024-03-19T06:05:28.583 INFO:tasks.workunit.client.1.smithi172.stdout:6/486: mknod d5/d11/d17/c9a 0 2024-03-19T06:05:28.584 INFO:tasks.workunit.client.1.smithi172.stdout:1/433: read da/dd/d10/f64 [136477,47285] 0 2024-03-19T06:05:28.586 INFO:tasks.workunit.client.1.smithi172.stdout:5/314: rename d5/d14/f33 to d5/d14/d15/d40/f73 0 2024-03-19T06:05:28.591 INFO:tasks.workunit.client.1.smithi172.stdout:5/315: dread d5/d55/f5f [0,4194304] 0 2024-03-19T06:05:28.591 INFO:tasks.workunit.client.1.smithi172.stdout:4/397: link df/d2b/d44/d67/c6c df/d2b/d44/d67/c82 0 2024-03-19T06:05:28.591 INFO:tasks.workunit.client.1.smithi172.stdout:3/377: creat d0/d5/d9/d54/f8e x:0 0 0 2024-03-19T06:05:28.592 INFO:tasks.workunit.client.1.smithi172.stdout:0/384: rmdir d11/d18/d38/d3f/d43/d62 39 2024-03-19T06:05:28.597 INFO:tasks.workunit.client.1.smithi172.stdout:0/385: write d11/d14/f4b [525397,82537] 0 2024-03-19T06:05:28.602 INFO:tasks.workunit.client.1.smithi172.stdout:1/434: link da/d3b/f80 da/dd/d10/d14/d27/d3f/f92 0 2024-03-19T06:05:28.602 INFO:tasks.workunit.client.1.smithi172.stdout:2/313: dwrite d7/de/f1e [0,4194304] 0 2024-03-19T06:05:28.609 INFO:tasks.workunit.client.1.smithi172.stdout:1/435: dread da/d33/f75 [0,4194304] 0 2024-03-19T06:05:28.609 INFO:tasks.workunit.client.1.smithi172.stdout:2/314: write d7/db/d2c/d35/f41 [602000,108331] 0 2024-03-19T06:05:28.618 INFO:tasks.workunit.client.1.smithi172.stdout:2/315: chown d7/db/d2c/d35/l36 139 1 2024-03-19T06:05:28.622 INFO:tasks.workunit.client.1.smithi172.stdout:3/378: dwrite d0/d5/d9/d34/f64 [0,4194304] 0 2024-03-19T06:05:28.625 INFO:tasks.workunit.client.1.smithi172.stdout:6/487: dwrite d5/d11/d35/d40/f8b [0,4194304] 0 2024-03-19T06:05:28.628 INFO:tasks.workunit.client.1.smithi172.stdout:2/316: truncate d7/f4e 769837 0 2024-03-19T06:05:28.629 INFO:tasks.workunit.client.1.smithi172.stdout:4/398: dwrite df/d2b/f40 [0,4194304] 0 2024-03-19T06:05:28.631 INFO:tasks.workunit.client.1.smithi172.stdout:9/339: sync 2024-03-19T06:05:28.635 INFO:tasks.workunit.client.1.smithi172.stdout:6/488: write d5/f13 [578173,28218] 0 2024-03-19T06:05:28.638 INFO:tasks.workunit.client.1.smithi172.stdout:4/399: readlink df/d11/d12/d21/l4a 0 2024-03-19T06:05:28.641 INFO:tasks.workunit.client.1.smithi172.stdout:5/316: dwrite d5/d14/f19 [0,4194304] 0 2024-03-19T06:05:28.645 INFO:tasks.workunit.client.1.smithi172.stdout:3/379: truncate d0/d5/d9/d54/f8e 297392 0 2024-03-19T06:05:28.645 INFO:tasks.workunit.client.1.smithi172.stdout:5/317: fsync d5/d14/f4d 0 2024-03-19T06:05:28.648 INFO:tasks.workunit.client.1.smithi172.stdout:6/489: write d5/d11/d43/d45/f5c [450234,40460] 0 2024-03-19T06:05:28.649 INFO:tasks.workunit.client.1.smithi172.stdout:5/318: write d5/fe [1977612,34253] 0 2024-03-19T06:05:28.650 INFO:tasks.workunit.client.1.smithi172.stdout:2/317: link d7/de/d58/d56/f39 d7/de/d61/f65 0 2024-03-19T06:05:28.652 INFO:tasks.workunit.client.1.smithi172.stdout:1/436: dread da/dd/d10/d14/d27/d3f/d5e/f7e [0,4194304] 0 2024-03-19T06:05:28.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:28 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:05:28.654 INFO:tasks.workunit.client.1.smithi172.stdout:3/380: readlink d0/d5/d9/d25/d21/l4b 0 2024-03-19T06:05:28.657 INFO:tasks.workunit.client.1.smithi172.stdout:9/340: getdents d1/d7/dc/de/d34 0 2024-03-19T06:05:28.659 INFO:tasks.workunit.client.1.smithi172.stdout:6/490: symlink d5/d11/d17/l9b 0 2024-03-19T06:05:28.660 INFO:tasks.workunit.client.1.smithi172.stdout:9/341: fdatasync d1/f5e 0 2024-03-19T06:05:28.662 INFO:tasks.workunit.client.1.smithi172.stdout:3/381: read d0/d5/f26 [529290,3746] 0 2024-03-19T06:05:28.665 INFO:tasks.workunit.client.1.smithi172.stdout:9/342: write d1/d7/dc/de/f1f [2582454,118318] 0 2024-03-19T06:05:28.667 INFO:tasks.workunit.client.1.smithi172.stdout:1/437: getdents da/dd/d10/d14/d27/d53 0 2024-03-19T06:05:28.668 INFO:tasks.workunit.client.1.smithi172.stdout:1/438: fdatasync da/d33/f86 0 2024-03-19T06:05:28.669 INFO:tasks.workunit.client.1.smithi172.stdout:3/382: creat d0/d5/d6b/f8f x:0 0 0 2024-03-19T06:05:28.672 INFO:tasks.workunit.client.1.smithi172.stdout:9/343: write d1/fa [1803819,127481] 0 2024-03-19T06:05:28.673 INFO:tasks.workunit.client.1.smithi172.stdout:4/400: dwrite df/d11/d12/d26/f59 [0,4194304] 0 2024-03-19T06:05:28.673 INFO:tasks.workunit.client.1.smithi172.stdout:5/319: dread d5/f1d [0,4194304] 0 2024-03-19T06:05:28.677 INFO:tasks.workunit.client.1.smithi172.stdout:1/439: creat da/dd/d10/d14/d27/f93 x:0 0 0 2024-03-19T06:05:28.677 INFO:tasks.workunit.client.1.smithi172.stdout:2/318: truncate d7/db/d2c/d35/f41 225790 0 2024-03-19T06:05:28.679 INFO:tasks.workunit.client.1.smithi172.stdout:5/320: truncate d5/d14/d56/f6f 61017 0 2024-03-19T06:05:28.680 INFO:tasks.workunit.client.1.smithi172.stdout:4/401: creat df/d11/d12/d21/d58/f83 x:0 0 0 2024-03-19T06:05:28.682 INFO:tasks.workunit.client.1.smithi172.stdout:6/491: dread d5/d11/d43/f4d [0,4194304] 0 2024-03-19T06:05:28.682 INFO:tasks.workunit.client.1.smithi172.stdout:9/344: symlink d1/d7/dc/de/l77 0 2024-03-19T06:05:28.683 INFO:tasks.workunit.client.1.smithi172.stdout:3/383: dread d0/d5/d9/d60/f7e [0,4194304] 0 2024-03-19T06:05:28.685 INFO:tasks.workunit.client.1.smithi172.stdout:5/321: mknod d5/d3d/c74 0 2024-03-19T06:05:28.686 INFO:tasks.workunit.client.1.smithi172.stdout:4/402: mkdir df/d11/d12/d26/d84 0 2024-03-19T06:05:28.687 INFO:tasks.workunit.client.1.smithi172.stdout:1/440: creat da/dd/d10/d14/d73/d8b/f94 x:0 0 0 2024-03-19T06:05:28.689 INFO:tasks.workunit.client.1.smithi172.stdout:2/319: rename d7/db/d45/d4f to d7/de/d58/d55/d66 0 2024-03-19T06:05:28.689 INFO:tasks.workunit.client.1.smithi172.stdout:4/403: truncate df/d2b/d44/d67/f3f 921708 0 2024-03-19T06:05:28.691 INFO:tasks.workunit.client.1.smithi172.stdout:3/384: mkdir d0/d5/d9/d54/d90 0 2024-03-19T06:05:28.693 INFO:tasks.workunit.client.1.smithi172.stdout:6/492: unlink d5/d11/d17/d1b/d74/c99 0 2024-03-19T06:05:28.696 INFO:tasks.workunit.client.1.smithi172.stdout:9/345: rename d1/d7/dc/d4c to d1/d7/dc/d47/d78 0 2024-03-19T06:05:28.698 INFO:tasks.workunit.client.1.smithi172.stdout:2/320: unlink d7/de/f1e 0 2024-03-19T06:05:28.700 INFO:tasks.workunit.client.1.smithi172.stdout:5/322: dwrite d5/d14/f19 [0,4194304] 0 2024-03-19T06:05:28.700 INFO:tasks.workunit.client.1.smithi172.stdout:9/346: write d1/d7/dc/d23/f33 [2447103,55271] 0 2024-03-19T06:05:28.702 INFO:tasks.workunit.client.1.smithi172.stdout:9/347: readlink d1/d7/l10 0 2024-03-19T06:05:28.702 INFO:tasks.workunit.client.1.smithi172.stdout:3/385: dread d0/d5/f23 [0,4194304] 0 2024-03-19T06:05:28.706 INFO:tasks.workunit.client.1.smithi172.stdout:1/441: mkdir da/d3b/d95 0 2024-03-19T06:05:28.712 INFO:tasks.workunit.client.1.smithi172.stdout:3/386: rmdir d0/d5/d9/d25 39 2024-03-19T06:05:28.712 INFO:tasks.workunit.client.1.smithi172.stdout:5/323: creat d5/d14/d34/f75 x:0 0 0 2024-03-19T06:05:28.712 INFO:tasks.workunit.client.1.smithi172.stdout:7/316: sync 2024-03-19T06:05:28.715 INFO:tasks.workunit.client.1.smithi172.stdout:3/387: read - d0/d5/d9/d60/d67/f84 zero size 2024-03-19T06:05:28.715 INFO:tasks.workunit.client.1.smithi172.stdout:2/321: unlink d7/de/lf 0 2024-03-19T06:05:28.716 INFO:tasks.workunit.client.1.smithi172.stdout:6/493: dwrite d5/d8f/f6b [0,4194304] 0 2024-03-19T06:05:28.717 INFO:tasks.workunit.client.1.smithi172.stdout:3/388: dread - d0/f7c zero size 2024-03-19T06:05:28.720 INFO:tasks.workunit.client.1.smithi172.stdout:9/348: rename d1/d7/dc/d23/f6e to d1/d7/dc/d47/d78/f79 0 2024-03-19T06:05:28.722 INFO:tasks.workunit.client.1.smithi172.stdout:5/324: symlink d5/d55/l76 0 2024-03-19T06:05:28.725 INFO:tasks.workunit.client.1.smithi172.stdout:7/317: creat d0/d22/f6d x:0 0 0 2024-03-19T06:05:28.726 INFO:tasks.workunit.client.1.smithi172.stdout:4/404: rename df/d11/l1c to df/d11/l85 0 2024-03-19T06:05:28.727 INFO:tasks.workunit.client.1.smithi172.stdout:6/494: fdatasync d5/f5f 0 2024-03-19T06:05:28.728 INFO:tasks.workunit.client.1.smithi172.stdout:1/442: creat da/dd/d10/f96 x:0 0 0 2024-03-19T06:05:28.729 INFO:tasks.workunit.client.1.smithi172.stdout:7/318: chown d0/d22/d1d/d36/f13 3 1 2024-03-19T06:05:28.738 INFO:tasks.workunit.client.1.smithi172.stdout:9/349: mkdir d1/d7/dc/d47/d78/d57/d7a 0 2024-03-19T06:05:28.740 INFO:tasks.workunit.client.1.smithi172.stdout:3/389: unlink d0/d5/d14/f27 0 2024-03-19T06:05:28.741 INFO:tasks.workunit.client.1.smithi172.stdout:9/350: truncate d1/d7/dc/d47/f61 1775508 0 2024-03-19T06:05:28.742 INFO:tasks.workunit.client.1.smithi172.stdout:5/325: rename d5/d14/l23 to d5/d14/d34/l77 0 2024-03-19T06:05:28.743 INFO:tasks.workunit.client.1.smithi172.stdout:5/326: chown d5/d1f/f2a 2381883 1 2024-03-19T06:05:28.744 INFO:tasks.workunit.client.1.smithi172.stdout:2/322: creat d7/de/d58/d57/f67 x:0 0 0 2024-03-19T06:05:28.745 INFO:tasks.workunit.client.1.smithi172.stdout:1/443: mkdir da/dd/d31/d97 0 2024-03-19T06:05:28.745 INFO:tasks.workunit.client.1.smithi172.stdout:5/327: write d5/d14/d34/f75 [898431,39804] 0 2024-03-19T06:05:28.746 INFO:tasks.workunit.client.1.smithi172.stdout:0/386: sync 2024-03-19T06:05:28.746 INFO:tasks.workunit.client.1.smithi172.stdout:8/334: sync 2024-03-19T06:05:28.747 INFO:tasks.workunit.client.1.smithi172.stdout:7/319: creat d0/d22/d3d/f6e x:0 0 0 2024-03-19T06:05:28.748 INFO:tasks.workunit.client.1.smithi172.stdout:3/390: readlink d0/d5/d9/d3a/l5f 0 2024-03-19T06:05:28.750 INFO:tasks.workunit.client.1.smithi172.stdout:7/320: dread - d0/d2c/f2f zero size 2024-03-19T06:05:28.750 INFO:tasks.workunit.client.1.smithi172.stdout:2/323: unlink d7/db/f49 0 2024-03-19T06:05:28.755 INFO:tasks.workunit.client.1.smithi172.stdout:0/387: write d11/d22/f34 [4011342,51995] 0 2024-03-19T06:05:28.756 INFO:tasks.workunit.client.1.smithi172.stdout:1/444: truncate da/dd/d10/d14/d27/d3f/d5e/f76 1024055 0 2024-03-19T06:05:28.756 INFO:tasks.workunit.client.1.smithi172.stdout:8/335: mkdir d0/d61/d6a 0 2024-03-19T06:05:28.762 INFO:tasks.workunit.client.1.smithi172.stdout:4/405: rename df/d11/d12/f33 to df/d11/f86 0 2024-03-19T06:05:28.762 INFO:tasks.workunit.client.1.smithi172.stdout:3/391: truncate d0/d5/d9/d25/f74 774069 0 2024-03-19T06:05:28.764 INFO:tasks.workunit.client.1.smithi172.stdout:8/336: creat d0/d61/f6b x:0 0 0 2024-03-19T06:05:28.765 INFO:tasks.workunit.client.1.smithi172.stdout:0/388: rmdir d11/d18/d38/d3f 39 2024-03-19T06:05:28.767 INFO:tasks.workunit.client.1.smithi172.stdout:9/351: dwrite d1/f9 [4194304,4194304] 0 2024-03-19T06:05:28.767 INFO:tasks.workunit.client.1.smithi172.stdout:1/445: mknod da/d7a/c98 0 2024-03-19T06:05:28.768 INFO:tasks.workunit.client.1.smithi172.stdout:8/337: readlink d0/d10/d27/d29/l42 0 2024-03-19T06:05:28.773 INFO:tasks.workunit.client.1.smithi172.stdout:2/324: link c2 d7/de/d58/d55/d5f/c68 0 2024-03-19T06:05:28.779 INFO:tasks.workunit.client.1.smithi172.stdout:1/446: rename da/d3b/l91 to da/d7a/l99 0 2024-03-19T06:05:28.780 INFO:tasks.workunit.client.1.smithi172.stdout:5/328: dwrite d5/d14/d15/d40/d6a/f6d [4194304,4194304] 0 2024-03-19T06:05:28.783 INFO:tasks.workunit.client.1.smithi172.stdout:8/338: dread d0/f11 [0,4194304] 0 2024-03-19T06:05:28.788 INFO:tasks.workunit.client.1.smithi172.stdout:7/321: rmdir d0/d22 39 2024-03-19T06:05:28.789 INFO:tasks.workunit.client.1.smithi172.stdout:6/495: truncate d5/d11/d17/d1b/f25 242328 0 2024-03-19T06:05:28.790 INFO:tasks.workunit.client.1.smithi172.stdout:1/447: creat da/dd/d10/d36/f9a x:0 0 0 2024-03-19T06:05:28.790 INFO:tasks.workunit.client.1.smithi172.stdout:8/339: fdatasync d0/d10/f4a 0 2024-03-19T06:05:28.792 INFO:tasks.workunit.client.1.smithi172.stdout:0/389: dread d11/d18/d38/d3f/f6e [0,4194304] 0 2024-03-19T06:05:28.795 INFO:tasks.workunit.client.1.smithi172.stdout:5/329: creat d5/d1f/d2f/d53/f78 x:0 0 0 2024-03-19T06:05:28.795 INFO:tasks.workunit.client.1.smithi172.stdout:0/390: stat d11/c30 0 2024-03-19T06:05:28.800 INFO:tasks.workunit.client.1.smithi172.stdout:1/448: write da/d33/d4e/d60/f87 [75162,110041] 0 2024-03-19T06:05:28.800 INFO:tasks.workunit.client.1.smithi172.stdout:8/340: mknod d0/c6c 0 2024-03-19T06:05:28.802 INFO:tasks.workunit.client.1.smithi172.stdout:6/496: rmdir d5/d11/d35/d40 39 2024-03-19T06:05:28.804 INFO:tasks.workunit.client.1.smithi172.stdout:9/352: dwrite d1/d7/dc/de/f1d [0,4194304] 0 2024-03-19T06:05:28.807 INFO:tasks.workunit.client.1.smithi172.stdout:6/497: chown d5/d11/c39 2 1 2024-03-19T06:05:28.807 INFO:tasks.workunit.client.1.smithi172.stdout:7/322: mknod d0/d22/d3d/d41/d42/d5c/d67/c6f 0 2024-03-19T06:05:28.808 INFO:tasks.workunit.client.1.smithi172.stdout:5/330: rename d5/d14/d34/l77 to d5/d14/d34/d66/l79 0 2024-03-19T06:05:28.810 INFO:tasks.workunit.client.1.smithi172.stdout:8/341: creat d0/d10/f6d x:0 0 0 2024-03-19T06:05:28.811 INFO:tasks.workunit.client.1.smithi172.stdout:3/392: dread d0/d5/d9/d3a/f7b [0,4194304] 0 2024-03-19T06:05:28.813 INFO:tasks.workunit.client.1.smithi172.stdout:9/353: creat d1/d7/dc/de/d34/d48/f7b x:0 0 0 2024-03-19T06:05:28.816 INFO:tasks.workunit.client.1.smithi172.stdout:7/323: mknod d0/d22/c70 0 2024-03-19T06:05:28.818 INFO:tasks.workunit.client.1.smithi172.stdout:6/498: rename d5/d11/d17/d36/c8a to d5/d11/d17/c9c 0 2024-03-19T06:05:28.819 INFO:tasks.workunit.client.1.smithi172.stdout:8/342: stat d0/d44/d46/d49/d3a/d3d 0 2024-03-19T06:05:28.823 INFO:tasks.workunit.client.1.smithi172.stdout:8/343: fdatasync d0/f3 0 2024-03-19T06:05:28.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:28 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:05:28.827 INFO:tasks.workunit.client.1.smithi172.stdout:0/391: dwrite d11/d14/d2c/d4e/f7d [0,4194304] 0 2024-03-19T06:05:28.827 INFO:tasks.workunit.client.1.smithi172.stdout:1/449: dwrite da/d33/d4e/d60/f87 [0,4194304] 0 2024-03-19T06:05:28.829 INFO:tasks.workunit.client.1.smithi172.stdout:6/499: chown d5/d11/d2f/c5b 13 1 2024-03-19T06:05:28.844 INFO:tasks.workunit.client.1.smithi172.stdout:7/324: creat d0/f71 x:0 0 0 2024-03-19T06:05:28.845 INFO:tasks.workunit.client.1.smithi172.stdout:9/354: creat d1/d7/dc/de/f7c x:0 0 0 2024-03-19T06:05:28.845 INFO:tasks.workunit.client.1.smithi172.stdout:1/450: chown da/dd/d10/c18 2372 1 2024-03-19T06:05:28.846 INFO:tasks.workunit.client.1.smithi172.stdout:6/500: stat d5/d11/d35/d40/d53/l61 0 2024-03-19T06:05:28.847 INFO:tasks.workunit.client.1.smithi172.stdout:2/325: dwrite d7/de/f5b [0,4194304] 0 2024-03-19T06:05:28.850 INFO:tasks.workunit.client.1.smithi172.stdout:5/331: dwrite d5/fb [0,4194304] 0 2024-03-19T06:05:28.864 INFO:tasks.workunit.client.1.smithi172.stdout:5/332: mkdir d5/d14/d15/d40/d6a/d7a 0 2024-03-19T06:05:28.864 INFO:tasks.workunit.client.1.smithi172.stdout:1/451: mkdir da/dd/d10/d14/d84/d9b 0 2024-03-19T06:05:28.866 INFO:tasks.workunit.client.1.smithi172.stdout:0/392: dwrite d11/d22/d32/f35 [0,4194304] 0 2024-03-19T06:05:28.868 INFO:tasks.workunit.client.1.smithi172.stdout:2/326: dread - d7/d1b/f22 zero size 2024-03-19T06:05:28.868 INFO:tasks.workunit.client.1.smithi172.stdout:8/344: dwrite d0/d44/f62 [0,4194304] 0 2024-03-19T06:05:28.869 INFO:tasks.workunit.client.1.smithi172.stdout:5/333: readlink d5/d1f/l39 0 2024-03-19T06:05:28.872 INFO:tasks.workunit.client.1.smithi172.stdout:1/452: read - da/dd/d31/f4d zero size 2024-03-19T06:05:28.874 INFO:tasks.workunit.client.1.smithi172.stdout:5/334: write d5/d14/d15/f24 [1902979,92074] 0 2024-03-19T06:05:28.874 INFO:tasks.workunit.client.1.smithi172.stdout:2/327: creat d7/d1b/f69 x:0 0 0 2024-03-19T06:05:28.875 INFO:tasks.workunit.client.1.smithi172.stdout:0/393: creat d11/d14/d2c/d4e/f87 x:0 0 0 2024-03-19T06:05:28.883 INFO:tasks.workunit.client.1.smithi172.stdout:2/328: mkdir d7/de/d58/d55/d5f/d6a 0 2024-03-19T06:05:28.886 INFO:tasks.workunit.client.1.smithi172.stdout:5/335: creat d5/d14/f7b x:0 0 0 2024-03-19T06:05:28.891 INFO:tasks.workunit.client.1.smithi172.stdout:5/336: chown d5/d14/d34/f75 5218379 1 2024-03-19T06:05:28.891 INFO:tasks.workunit.client.1.smithi172.stdout:2/329: chown d7/db/d2c/d35/f44 8883 1 2024-03-19T06:05:28.895 INFO:tasks.workunit.client.1.smithi172.stdout:8/345: fsync d0/d44/f62 0 2024-03-19T06:05:28.896 INFO:tasks.workunit.client.1.smithi172.stdout:5/337: truncate d5/f18 4442313 0 2024-03-19T06:05:28.898 INFO:tasks.workunit.client.1.smithi172.stdout:9/355: dread d1/d7/dc/d31/f6f [0,4194304] 0 2024-03-19T06:05:28.901 INFO:tasks.workunit.client.1.smithi172.stdout:5/338: dread - d5/d14/d56/f64 zero size 2024-03-19T06:05:28.904 INFO:tasks.workunit.client.1.smithi172.stdout:7/325: dwrite d0/d22/d3d/d41/d42/f63 [0,4194304] 0 2024-03-19T06:05:28.904 INFO:tasks.workunit.client.1.smithi172.stdout:0/394: dwrite d11/d14/d2c/d4e/f87 [0,4194304] 0 2024-03-19T06:05:28.907 INFO:tasks.workunit.client.1.smithi172.stdout:8/346: unlink d0/d10/d27/d29/d28/l4e 0 2024-03-19T06:05:28.908 INFO:tasks.workunit.client.1.smithi172.stdout:9/356: chown d1/d7/dc/d47/d78/d57/l68 702 1 2024-03-19T06:05:28.913 INFO:tasks.workunit.client.1.smithi172.stdout:7/326: mknod d0/d22/d1d/d36/d56/c72 0 2024-03-19T06:05:28.913 INFO:tasks.workunit.client.1.smithi172.stdout:5/339: rename d5/d14/d48/c61 to d5/d14/d15/d40/d6a/c7c 0 2024-03-19T06:05:28.914 INFO:tasks.workunit.client.1.smithi172.stdout:9/357: write d1/d7/dc/de/f1d [2664787,120492] 0 2024-03-19T06:05:28.914 INFO:tasks.workunit.client.1.smithi172.stdout:8/347: stat d0/d10/d27/d29/d28/d55/f69 0 2024-03-19T06:05:28.917 INFO:tasks.workunit.client.1.smithi172.stdout:5/340: dread - d5/d1f/d2f/f46 zero size 2024-03-19T06:05:28.921 INFO:tasks.workunit.client.1.smithi172.stdout:1/453: dread da/dd/d10/f2c [4194304,4194304] 0 2024-03-19T06:05:28.922 INFO:tasks.workunit.client.1.smithi172.stdout:7/327: rename d0/d22/d1d/d36 to d0/d22/d1d/d36/d56/d73 22 2024-03-19T06:05:28.924 INFO:tasks.workunit.client.1.smithi172.stdout:9/358: mkdir d1/d7/dc/d47/d78/d57/d7d 0 2024-03-19T06:05:28.924 INFO:tasks.workunit.client.1.smithi172.stdout:2/330: dwrite d7/d1b/f33 [0,4194304] 0 2024-03-19T06:05:28.927 INFO:tasks.workunit.client.1.smithi172.stdout:1/454: mknod da/dd/d10/d14/d73/d8b/c9c 0 2024-03-19T06:05:28.927 INFO:tasks.workunit.client.1.smithi172.stdout:2/331: dread - d7/de/d58/d56/f28 zero size 2024-03-19T06:05:28.931 INFO:tasks.workunit.client.1.smithi172.stdout:0/395: dwrite d11/d22/d68/f75 [0,4194304] 0 2024-03-19T06:05:28.934 INFO:tasks.workunit.client.1.smithi172.stdout:0/396: chown d11/d18/f21 51493572 1 2024-03-19T06:05:28.946 INFO:tasks.workunit.client.1.smithi172.stdout:1/455: write da/dd/f1f [110319,7220] 0 2024-03-19T06:05:28.950 INFO:tasks.workunit.client.1.smithi172.stdout:8/348: dwrite d0/d44/d46/d49/f5d [0,4194304] 0 2024-03-19T06:05:28.953 INFO:tasks.workunit.client.1.smithi172.stdout:7/328: dwrite d0/f71 [0,4194304] 0 2024-03-19T06:05:28.954 INFO:tasks.workunit.client.1.smithi172.stdout:1/456: creat da/dd/d10/d14/d84/d9b/f9d x:0 0 0 2024-03-19T06:05:28.954 INFO:tasks.workunit.client.1.smithi172.stdout:8/349: mkdir d0/d61/d6e 0 2024-03-19T06:05:28.956 INFO:tasks.workunit.client.1.smithi172.stdout:2/332: dread d7/d1b/f3f [0,4194304] 0 2024-03-19T06:05:28.959 INFO:tasks.workunit.client.1.smithi172.stdout:8/350: mkdir d0/d6f 0 2024-03-19T06:05:28.961 INFO:tasks.workunit.client.1.smithi172.stdout:2/333: fdatasync d7/de/d58/d56/f46 0 2024-03-19T06:05:28.975 INFO:tasks.workunit.client.1.smithi172.stdout:2/334: creat d7/de/d58/d56/f6b x:0 0 0 2024-03-19T06:05:28.975 INFO:tasks.workunit.client.1.smithi172.stdout:4/406: sync 2024-03-19T06:05:28.975 INFO:tasks.workunit.client.1.smithi172.stdout:0/397: truncate d11/f29 6369266 0 2024-03-19T06:05:28.975 INFO:tasks.workunit.client.1.smithi172.stdout:9/359: dread d1/d7/dc/de/f1f [0,4194304] 0 2024-03-19T06:05:28.975 INFO:tasks.workunit.client.1.smithi172.stdout:2/335: mknod d7/db/c6c 0 2024-03-19T06:05:28.977 INFO:tasks.workunit.client.1.smithi172.stdout:1/457: write da/dd/d10/d14/d27/d3f/f92 [241513,114566] 0 2024-03-19T06:05:28.979 INFO:tasks.workunit.client.1.smithi172.stdout:4/407: chown df/d11/c71 892459 1 2024-03-19T06:05:28.982 INFO:tasks.workunit.client.1.smithi172.stdout:5/341: dread d5/fd [0,4194304] 0 2024-03-19T06:05:28.985 INFO:tasks.workunit.client.1.smithi172.stdout:7/329: dwrite d0/d22/d1d/d36/d40/f4e [0,4194304] 0 2024-03-19T06:05:28.991 INFO:tasks.workunit.client.1.smithi172.stdout:5/342: rename d5/d14/f22 to d5/d14/d48/f7d 0 2024-03-19T06:05:28.991 INFO:tasks.workunit.client.1.smithi172.stdout:1/458: read da/dd/d10/f24 [443705,1867] 0 2024-03-19T06:05:28.992 INFO:tasks.workunit.client.1.smithi172.stdout:5/343: fsync d5/d1f/f2c 0 2024-03-19T06:05:28.992 INFO:tasks.workunit.client.1.smithi172.stdout:7/330: getdents d0/d22/d4b 0 2024-03-19T06:05:28.994 INFO:tasks.workunit.client.1.smithi172.stdout:2/336: rmdir d7/de/d58/d56 39 2024-03-19T06:05:28.995 INFO:tasks.workunit.client.1.smithi172.stdout:7/331: chown d0/d22/d3d/l62 3772505 1 2024-03-19T06:05:28.995 INFO:tasks.workunit.client.1.smithi172.stdout:9/360: dread d1/d7/dc/d47/f61 [0,4194304] 0 2024-03-19T06:05:29.000 INFO:tasks.workunit.client.1.smithi172.stdout:0/398: dread d11/d14/d2c/d4e/f87 [0,4194304] 0 2024-03-19T06:05:29.000 INFO:tasks.workunit.client.1.smithi172.stdout:7/332: read - d0/d22/f6d zero size 2024-03-19T06:05:29.005 INFO:tasks.workunit.client.1.smithi172.stdout:4/408: dwrite df/f4d [0,4194304] 0 2024-03-19T06:05:29.005 INFO:tasks.workunit.client.1.smithi172.stdout:9/361: creat d1/d7/dc/d47/d78/f7e x:0 0 0 2024-03-19T06:05:29.009 INFO:tasks.workunit.client.1.smithi172.stdout:7/333: rename d0/d22/d1d/d36/d56/c72 to d0/d22/d1d/c74 0 2024-03-19T06:05:29.016 INFO:tasks.workunit.client.1.smithi172.stdout:1/459: truncate da/dd/d10/d14/f35 4058425 0 2024-03-19T06:05:29.019 INFO:tasks.workunit.client.1.smithi172.stdout:5/344: dwrite d5/d1f/f2a [0,4194304] 0 2024-03-19T06:05:29.020 INFO:tasks.workunit.client.1.smithi172.stdout:1/460: stat da/dd/d10/d14/d27/f37 0 2024-03-19T06:05:29.021 INFO:tasks.workunit.client.1.smithi172.stdout:2/337: dwrite d7/db/d2c/f38 [0,4194304] 0 2024-03-19T06:05:29.021 INFO:tasks.workunit.client.1.smithi172.stdout:7/334: rmdir d0/d22/d3d/d41/d42/d5c 39 2024-03-19T06:05:29.021 INFO:tasks.workunit.client.1.smithi172.stdout:5/345: readlink d5/d14/d15/d40/l5d 0 2024-03-19T06:05:29.022 INFO:tasks.workunit.client.1.smithi172.stdout:9/362: link d1/f6 d1/d7/dc/f7f 0 2024-03-19T06:05:29.024 INFO:tasks.workunit.client.1.smithi172.stdout:2/338: stat d7/d1b/f2d 0 2024-03-19T06:05:29.024 INFO:tasks.workunit.client.1.smithi172.stdout:9/363: stat d1/d7/dc/de/c3b 0 2024-03-19T06:05:29.029 INFO:tasks.workunit.client.1.smithi172.stdout:4/409: getdents df/d11/d12/d21/d58 0 2024-03-19T06:05:29.030 INFO:tasks.workunit.client.1.smithi172.stdout:1/461: read da/dd/d10/f58 [1418086,127700] 0 2024-03-19T06:05:29.034 INFO:tasks.workunit.client.1.smithi172.stdout:9/364: rmdir d1/d7/dc/de/d34 39 2024-03-19T06:05:29.037 INFO:tasks.workunit.client.1.smithi172.stdout:2/339: mknod d7/db/d45/c6d 0 2024-03-19T06:05:29.039 INFO:tasks.workunit.client.1.smithi172.stdout:0/399: dwrite f7 [0,4194304] 0 2024-03-19T06:05:29.042 INFO:tasks.workunit.client.1.smithi172.stdout:7/335: dread d0/d22/d1d/d36/d56/f6a [0,4194304] 0 2024-03-19T06:05:29.045 INFO:tasks.workunit.client.1.smithi172.stdout:9/365: creat d1/d7/dc/d31/f80 x:0 0 0 2024-03-19T06:05:29.045 INFO:tasks.workunit.client.1.smithi172.stdout:5/346: getdents d5/d14/d15/d40 0 2024-03-19T06:05:29.045 INFO:tasks.workunit.client.1.smithi172.stdout:1/462: creat da/d33/d78/f9e x:0 0 0 2024-03-19T06:05:29.046 INFO:tasks.workunit.client.1.smithi172.stdout:2/340: mkdir d7/de/d58/d55/d6e 0 2024-03-19T06:05:29.048 INFO:tasks.workunit.client.1.smithi172.stdout:4/410: truncate df/d11/f77 1238362 0 2024-03-19T06:05:29.049 INFO:tasks.workunit.client.1.smithi172.stdout:1/463: write da/dd/f39 [1574519,72934] 0 2024-03-19T06:05:29.051 INFO:tasks.workunit.client.1.smithi172.stdout:7/336: mknod d0/d22/d27/c75 0 2024-03-19T06:05:29.052 INFO:tasks.workunit.client.1.smithi172.stdout:9/366: symlink d1/d7/dc/d23/l81 0 2024-03-19T06:05:29.052 INFO:tasks.workunit.client.1.smithi172.stdout:1/464: write da/dd/d10/f2f [379262,74358] 0 2024-03-19T06:05:29.054 INFO:tasks.workunit.client.1.smithi172.stdout:1/465: chown da/d7a 58 1 2024-03-19T06:05:29.056 INFO:tasks.workunit.client.1.smithi172.stdout:7/337: mknod d0/d22/d1d/d36/d56/c76 0 2024-03-19T06:05:29.057 INFO:tasks.workunit.client.1.smithi172.stdout:4/411: mknod df/d2b/c87 0 2024-03-19T06:05:29.062 INFO:tasks.workunit.client.1.smithi172.stdout:9/367: mkdir d1/d7/dc/de/d34/d48/d82 0 2024-03-19T06:05:29.064 INFO:tasks.workunit.client.1.smithi172.stdout:4/412: fdatasync df/f24 0 2024-03-19T06:05:29.066 INFO:tasks.workunit.client.1.smithi172.stdout:7/338: mknod d0/d22/d4b/c77 0 2024-03-19T06:05:29.066 INFO:tasks.workunit.client.1.smithi172.stdout:5/347: dwrite d5/f27 [0,4194304] 0 2024-03-19T06:05:29.069 INFO:tasks.workunit.client.1.smithi172.stdout:7/339: fdatasync d0/d22/d1d/d36/f5e 0 2024-03-19T06:05:29.070 INFO:tasks.workunit.client.1.smithi172.stdout:0/400: dwrite d11/d18/d38/d3f/f6e [0,4194304] 0 2024-03-19T06:05:29.072 INFO:tasks.workunit.client.1.smithi172.stdout:2/341: link d7/de/d58/d56/f46 d7/db/d2c/f6f 0 2024-03-19T06:05:29.074 INFO:tasks.workunit.client.1.smithi172.stdout:4/413: creat df/d11/d12/d21/f88 x:0 0 0 2024-03-19T06:05:29.076 INFO:tasks.workunit.client.1.smithi172.stdout:1/466: getdents da/dd/d10/d14/d27/d3f 0 2024-03-19T06:05:29.078 INFO:tasks.workunit.client.1.smithi172.stdout:7/340: creat d0/d22/d1d/d3a/d46/f78 x:0 0 0 2024-03-19T06:05:29.079 INFO:tasks.workunit.client.1.smithi172.stdout:1/467: chown da/d3b/f80 6325383 1 2024-03-19T06:05:29.080 INFO:tasks.workunit.client.1.smithi172.stdout:6/501: sync 2024-03-19T06:05:29.080 INFO:tasks.workunit.client.1.smithi172.stdout:3/393: sync 2024-03-19T06:05:29.081 INFO:tasks.workunit.client.1.smithi172.stdout:0/401: symlink d11/d22/d46/d84/l88 0 2024-03-19T06:05:29.081 INFO:tasks.workunit.client.1.smithi172.stdout:4/414: creat df/d11/d12/d6e/f89 x:0 0 0 2024-03-19T06:05:29.082 INFO:tasks.workunit.client.1.smithi172.stdout:1/468: chown da/d33/d59 0 1 2024-03-19T06:05:29.084 INFO:tasks.workunit.client.1.smithi172.stdout:7/341: fsync d0/d22/f1e 0 2024-03-19T06:05:29.085 INFO:tasks.workunit.client.1.smithi172.stdout:2/342: write d7/db/d2c/f6f [4392664,38040] 0 2024-03-19T06:05:29.085 INFO:tasks.workunit.client.1.smithi172.stdout:1/469: readlink da/dd/d10/d36/l5c 0 2024-03-19T06:05:29.087 INFO:tasks.workunit.client.1.smithi172.stdout:7/342: fsync d0/d22/f6d 0 2024-03-19T06:05:29.087 INFO:tasks.workunit.client.1.smithi172.stdout:3/394: symlink d0/d5/d9/d25/d21/l91 0 2024-03-19T06:05:29.089 INFO:tasks.workunit.client.1.smithi172.stdout:4/415: truncate df/d11/d12/d21/d58/f83 637100 0 2024-03-19T06:05:29.090 INFO:tasks.workunit.client.1.smithi172.stdout:2/343: truncate d7/db/f62 922536 0 2024-03-19T06:05:29.092 INFO:tasks.workunit.client.1.smithi172.stdout:6/502: rename d5/d11/d17/d1b/c87 to d5/d11/d35/d40/d53/c9d 0 2024-03-19T06:05:29.094 INFO:tasks.workunit.client.1.smithi172.stdout:3/395: write d0/d5/d9/d25/f1a [3319134,49436] 0 2024-03-19T06:05:29.094 INFO:tasks.workunit.client.1.smithi172.stdout:7/343: creat d0/d22/d1d/d36/d56/f79 x:0 0 0 2024-03-19T06:05:29.096 INFO:tasks.workunit.client.1.smithi172.stdout:4/416: unlink df/d2b/d2d/l78 0 2024-03-19T06:05:29.098 INFO:tasks.workunit.client.1.smithi172.stdout:6/503: write d5/d11/d35/f42 [73103,45807] 0 2024-03-19T06:05:29.099 INFO:tasks.workunit.client.1.smithi172.stdout:5/348: dread d5/d14/f4d [0,4194304] 0 2024-03-19T06:05:29.100 INFO:tasks.workunit.client.1.smithi172.stdout:9/368: dwrite d1/d7/dc/de/f1f [0,4194304] 0 2024-03-19T06:05:29.100 INFO:tasks.workunit.client.1.smithi172.stdout:7/344: creat d0/d22/d1d/d3a/d46/f7a x:0 0 0 2024-03-19T06:05:29.102 INFO:tasks.workunit.client.1.smithi172.stdout:4/417: dread df/d11/d12/d21/f2f [0,4194304] 0 2024-03-19T06:05:29.106 INFO:tasks.workunit.client.1.smithi172.stdout:4/418: write df/d2b/d44/d67/f72 [375760,27010] 0 2024-03-19T06:05:29.108 INFO:tasks.workunit.client.1.smithi172.stdout:2/344: getdents d7/de/d58/d57 0 2024-03-19T06:05:29.111 INFO:tasks.workunit.client.1.smithi172.stdout:9/369: symlink d1/d7/dc/d47/l83 0 2024-03-19T06:05:29.113 INFO:tasks.workunit.client.1.smithi172.stdout:3/396: truncate d0/f4 615194 0 2024-03-19T06:05:29.113 INFO:tasks.workunit.client.1.smithi172.stdout:7/345: fsync d0/d22/d1d/d3a/d46/f7a 0 2024-03-19T06:05:29.115 INFO:tasks.workunit.client.1.smithi172.stdout:6/504: dread d5/d11/d35/d40/d53/d75/f81 [0,4194304] 0 2024-03-19T06:05:29.117 INFO:tasks.workunit.client.1.smithi172.stdout:2/345: mkdir d7/d4c/d70 0 2024-03-19T06:05:29.118 INFO:tasks.workunit.client.1.smithi172.stdout:9/370: mknod d1/d7/dc/de/c84 0 2024-03-19T06:05:29.119 INFO:tasks.workunit.client.1.smithi172.stdout:4/419: truncate df/d11/f77 689670 0 2024-03-19T06:05:29.120 INFO:tasks.workunit.client.1.smithi172.stdout:5/349: dwrite d5/fe [0,4194304] 0 2024-03-19T06:05:29.122 INFO:tasks.workunit.client.1.smithi172.stdout:2/346: chown c2 501 1 2024-03-19T06:05:29.122 INFO:tasks.workunit.client.1.smithi172.stdout:3/397: mknod d0/d5/d9/d34/d82/c92 0 2024-03-19T06:05:29.122 INFO:tasks.workunit.client.1.smithi172.stdout:6/505: creat d5/d11/d17/d36/d48/f9e x:0 0 0 2024-03-19T06:05:29.124 INFO:tasks.workunit.client.1.smithi172.stdout:7/346: rename d0/d22/d1d/d36/d56/f6a to d0/d22/d1d/f7b 0 2024-03-19T06:05:29.124 INFO:tasks.workunit.client.1.smithi172.stdout:2/347: dread - d7/db/d2c/d35/f44 zero size 2024-03-19T06:05:29.125 INFO:tasks.workunit.client.1.smithi172.stdout:4/420: creat df/d2b/d2d/f8a x:0 0 0 2024-03-19T06:05:29.125 INFO:tasks.workunit.client.1.smithi172.stdout:6/506: chown d5/d8f/d31/f89 1 1 2024-03-19T06:05:29.126 INFO:tasks.workunit.client.1.smithi172.stdout:3/398: write d0/d5/d9/d60/d67/f73 [213538,91936] 0 2024-03-19T06:05:29.126 INFO:tasks.workunit.client.1.smithi172.stdout:9/371: symlink d1/d7/dc/d31/l85 0 2024-03-19T06:05:29.127 INFO:tasks.workunit.client.1.smithi172.stdout:7/347: dread - d0/d2c/f2f zero size 2024-03-19T06:05:29.132 INFO:tasks.workunit.client.1.smithi172.stdout:7/348: rmdir d0/d22/d3d/d41 39 2024-03-19T06:05:29.133 INFO:tasks.workunit.client.1.smithi172.stdout:6/507: mkdir d5/d11/d35/d9f 0 2024-03-19T06:05:29.134 INFO:tasks.workunit.client.1.smithi172.stdout:4/421: mknod df/d11/d12/d26/c8b 0 2024-03-19T06:05:29.137 INFO:tasks.workunit.client.1.smithi172.stdout:7/349: unlink d0/c4 0 2024-03-19T06:05:29.140 INFO:tasks.workunit.client.1.smithi172.stdout:9/372: symlink d1/d7/dc/d47/l86 0 2024-03-19T06:05:29.142 INFO:tasks.workunit.client.1.smithi172.stdout:7/350: dread - d0/d22/d1d/f45 zero size 2024-03-19T06:05:29.142 INFO:tasks.workunit.client.1.smithi172.stdout:5/350: dwrite d5/d1f/d2f/d53/f78 [0,4194304] 0 2024-03-19T06:05:29.145 INFO:tasks.workunit.client.1.smithi172.stdout:4/422: creat df/d2b/d2d/f8c x:0 0 0 2024-03-19T06:05:29.147 INFO:tasks.workunit.client.1.smithi172.stdout:5/351: write d5/ff [6911447,121784] 0 2024-03-19T06:05:29.147 INFO:tasks.workunit.client.1.smithi172.stdout:6/508: mknod d5/d8f/d31/ca0 0 2024-03-19T06:05:29.149 INFO:tasks.workunit.client.1.smithi172.stdout:2/348: dwrite d7/d1b/f2d [0,4194304] 0 2024-03-19T06:05:29.150 INFO:tasks.workunit.client.1.smithi172.stdout:4/423: fsync df/d11/d12/d21/d58/f83 0 2024-03-19T06:05:29.155 INFO:tasks.workunit.client.1.smithi172.stdout:9/373: mknod d1/d7/dc/d31/c87 0 2024-03-19T06:05:29.156 INFO:tasks.workunit.client.1.smithi172.stdout:6/509: mkdir d5/d11/d43/d45/da1 0 2024-03-19T06:05:29.157 INFO:tasks.workunit.client.1.smithi172.stdout:6/510: read d5/d11/d35/d40/f8b [3574397,23530] 0 2024-03-19T06:05:29.159 INFO:tasks.workunit.client.1.smithi172.stdout:3/399: write d0/f4 [793071,76374] 0 2024-03-19T06:05:29.164 INFO:tasks.workunit.client.1.smithi172.stdout:4/424: creat df/d11/d12/d34/f8d x:0 0 0 2024-03-19T06:05:29.165 INFO:tasks.workunit.client.1.smithi172.stdout:4/425: fsync df/f3d 0 2024-03-19T06:05:29.165 INFO:tasks.workunit.client.1.smithi172.stdout:7/351: creat d0/f7c x:0 0 0 2024-03-19T06:05:29.168 INFO:tasks.workunit.client.1.smithi172.stdout:4/426: chown df/d2b/d2d/f73 867 1 2024-03-19T06:05:29.168 INFO:tasks.workunit.client.1.smithi172.stdout:9/374: dread d1/d7/f2e [0,4194304] 0 2024-03-19T06:05:29.170 INFO:tasks.workunit.client.1.smithi172.stdout:8/351: sync 2024-03-19T06:05:29.171 INFO:tasks.workunit.client.1.smithi172.stdout:5/352: creat d5/d1f/d2f/d62/f7e x:0 0 0 2024-03-19T06:05:29.171 INFO:tasks.workunit.client.1.smithi172.stdout:3/400: fsync d0/d5/d9/d54/f70 0 2024-03-19T06:05:29.171 INFO:tasks.workunit.client.1.smithi172.stdout:8/352: chown d0/d10/f4a 785505827 1 2024-03-19T06:05:29.178 INFO:tasks.workunit.client.1.smithi172.stdout:8/353: write d0/d10/d27/d29/d28/d55/f5a [1851369,107914] 0 2024-03-19T06:05:29.179 INFO:tasks.workunit.client.1.smithi172.stdout:4/427: creat df/d2b/d44/f8e x:0 0 0 2024-03-19T06:05:29.181 INFO:tasks.workunit.client.1.smithi172.stdout:9/375: write d1/d7/dc/de/d34/f41 [1628987,36414] 0 2024-03-19T06:05:29.183 INFO:tasks.workunit.client.1.smithi172.stdout:5/353: dread d5/f16 [0,4194304] 0 2024-03-19T06:05:29.184 INFO:tasks.workunit.client.1.smithi172.stdout:8/354: symlink d0/d10/d27/d29/d28/d55/l70 0 2024-03-19T06:05:29.185 INFO:tasks.workunit.client.1.smithi172.stdout:9/376: chown d1/d7/dc/d23/l59 0 1 2024-03-19T06:05:29.185 INFO:tasks.workunit.client.1.smithi172.stdout:9/377: stat d1/l38 0 2024-03-19T06:05:29.186 INFO:tasks.workunit.client.1.smithi172.stdout:5/354: write d5/d55/f63 [844446,100789] 0 2024-03-19T06:05:29.193 INFO:tasks.workunit.client.1.smithi172.stdout:7/352: dread d0/d22/d1d/d36/f5e [0,4194304] 0 2024-03-19T06:05:29.194 INFO:tasks.workunit.client.1.smithi172.stdout:3/401: write d0/fe [1088682,74564] 0 2024-03-19T06:05:29.195 INFO:tasks.workunit.client.1.smithi172.stdout:2/349: dread d7/db/d2c/f6f [0,4194304] 0 2024-03-19T06:05:29.197 INFO:tasks.workunit.client.1.smithi172.stdout:7/353: rmdir d0/d2c 39 2024-03-19T06:05:29.198 INFO:tasks.workunit.client.1.smithi172.stdout:9/378: rmdir d1/d7/dc/d47/d78/d57/d7a 0 2024-03-19T06:05:29.198 INFO:tasks.workunit.client.1.smithi172.stdout:3/402: chown d0/d5/d9/d34/d4d/f5c 1 1 2024-03-19T06:05:29.200 INFO:tasks.workunit.client.1.smithi172.stdout:5/355: getdents d5/d3d 0 2024-03-19T06:05:29.203 INFO:tasks.workunit.client.1.smithi172.stdout:2/350: dread d7/db/d2c/d35/f41 [0,4194304] 0 2024-03-19T06:05:29.204 INFO:tasks.workunit.client.1.smithi172.stdout:8/355: dwrite d0/d44/d46/d49/d26/f3e [0,4194304] 0 2024-03-19T06:05:29.204 INFO:tasks.workunit.client.1.smithi172.stdout:7/354: mkdir d0/d22/d3d/d41/d42/d7d 0 2024-03-19T06:05:29.206 INFO:tasks.workunit.client.1.smithi172.stdout:9/379: creat d1/d7/dc/de/d34/d48/d82/f88 x:0 0 0 2024-03-19T06:05:29.208 INFO:tasks.workunit.client.1.smithi172.stdout:2/351: write d7/f26 [448412,65008] 0 2024-03-19T06:05:29.209 INFO:tasks.workunit.client.1.smithi172.stdout:7/355: fdatasync d0/d22/d1d/d36/d40/f4e 0 2024-03-19T06:05:29.209 INFO:tasks.workunit.client.1.smithi172.stdout:8/356: mkdir d0/d44/d46/d49/d26/d71 0 2024-03-19T06:05:29.209 INFO:tasks.workunit.client.1.smithi172.stdout:4/428: dread df/d2b/d2d/f38 [0,4194304] 0 2024-03-19T06:05:29.210 INFO:tasks.workunit.client.1.smithi172.stdout:5/356: link d5/d14/l28 d5/d55/l7f 0 2024-03-19T06:05:29.212 INFO:tasks.workunit.client.1.smithi172.stdout:9/380: mkdir d1/d7/dc/de/d34/d48/d89 0 2024-03-19T06:05:29.215 INFO:tasks.workunit.client.1.smithi172.stdout:5/357: fsync d5/d14/d34/f75 0 2024-03-19T06:05:29.215 INFO:tasks.workunit.client.1.smithi172.stdout:2/352: truncate d7/f4e 1510632 0 2024-03-19T06:05:29.216 INFO:tasks.workunit.client.1.smithi172.stdout:7/356: fsync d0/d22/d1d/d36/d56/f79 0 2024-03-19T06:05:29.216 INFO:tasks.workunit.client.1.smithi172.stdout:5/358: chown d5 3 1 2024-03-19T06:05:29.216 INFO:tasks.workunit.client.1.smithi172.stdout:4/429: truncate df/d2b/d2d/f8a 69814 0 2024-03-19T06:05:29.220 INFO:tasks.workunit.client.1.smithi172.stdout:9/381: write d1/d7/dc/d47/d78/f79 [261303,16468] 0 2024-03-19T06:05:29.221 INFO:tasks.workunit.client.1.smithi172.stdout:5/359: truncate d5/d14/d56/f6f 847507 0 2024-03-19T06:05:29.230 INFO:tasks.workunit.client.1.smithi172.stdout:7/357: symlink d0/d22/d3d/d41/d42/d7d/l7e 0 2024-03-19T06:05:29.230 INFO:tasks.workunit.client.1.smithi172.stdout:5/360: symlink d5/d14/d15/l80 0 2024-03-19T06:05:29.233 INFO:tasks.workunit.client.1.smithi172.stdout:4/430: rename df/d11/d12/d21/f55 to df/f8f 0 2024-03-19T06:05:29.233 INFO:tasks.workunit.client.1.smithi172.stdout:8/357: dwrite d0/d44/d46/d49/d26/d2f/f45 [0,4194304] 0 2024-03-19T06:05:29.233 INFO:tasks.workunit.client.1.smithi172.stdout:2/353: write d7/d4c/f51 [70792,21514] 0 2024-03-19T06:05:29.236 INFO:tasks.workunit.client.1.smithi172.stdout:4/431: chown df/d11/d12/d21/d50/l7d 45894 1 2024-03-19T06:05:29.237 INFO:tasks.workunit.client.1.smithi172.stdout:7/358: unlink d0/d22/d1d/d36/f11 0 2024-03-19T06:05:29.238 INFO:tasks.workunit.client.1.smithi172.stdout:3/403: dread d0/d5/d9/d34/d4d/f49 [0,4194304] 0 2024-03-19T06:05:29.239 INFO:tasks.workunit.client.1.smithi172.stdout:2/354: mknod d7/de/d58/d57/c71 0 2024-03-19T06:05:29.242 INFO:tasks.workunit.client.1.smithi172.stdout:2/355: stat d7/db/d2c/d35/c60 0 2024-03-19T06:05:29.243 INFO:tasks.workunit.client.1.smithi172.stdout:8/358: creat d0/d44/d46/d49/d26/d71/f72 x:0 0 0 2024-03-19T06:05:29.243 INFO:tasks.workunit.client.1.smithi172.stdout:9/382: dread d1/d7/dc/f7f [0,4194304] 0 2024-03-19T06:05:29.244 INFO:tasks.workunit.client.1.smithi172.stdout:7/359: mknod d0/c7f 0 2024-03-19T06:05:29.248 INFO:tasks.workunit.client.1.smithi172.stdout:8/359: rmdir d0/d10 39 2024-03-19T06:05:29.249 INFO:tasks.workunit.client.1.smithi172.stdout:8/360: readlink d0/l4 0 2024-03-19T06:05:29.249 INFO:tasks.workunit.client.1.smithi172.stdout:9/383: symlink d1/d7/dc/d47/d78/l8a 0 2024-03-19T06:05:29.250 INFO:tasks.workunit.client.1.smithi172.stdout:3/404: read d0/d5/d9/d34/d4d/f31 [1504752,99298] 0 2024-03-19T06:05:29.250 INFO:tasks.workunit.client.1.smithi172.stdout:8/361: chown d0/d44 29058 1 2024-03-19T06:05:29.250 INFO:tasks.workunit.client.1.smithi172.stdout:7/360: write d0/d22/d1d/d3a/d46/f78 [192645,47414] 0 2024-03-19T06:05:29.252 INFO:tasks.workunit.client.1.smithi172.stdout:5/361: dwrite d5/d55/f5f [0,4194304] 0 2024-03-19T06:05:29.254 INFO:tasks.workunit.client.1.smithi172.stdout:9/384: unlink d1/d7/dc/f7f 0 2024-03-19T06:05:29.257 INFO:tasks.workunit.client.1.smithi172.stdout:0/402: sync 2024-03-19T06:05:29.257 INFO:tasks.workunit.client.1.smithi172.stdout:5/362: symlink d5/d14/d34/l81 0 2024-03-19T06:05:29.258 INFO:tasks.workunit.client.1.smithi172.stdout:7/361: chown d0/d22/d27/l3b 3919 1 2024-03-19T06:05:29.259 INFO:tasks.workunit.client.1.smithi172.stdout:0/403: write f10 [2833581,23542] 0 2024-03-19T06:05:29.259 INFO:tasks.workunit.client.1.smithi172.stdout:8/362: creat d0/d44/d46/d49/d3a/d3d/f73 x:0 0 0 2024-03-19T06:05:29.260 INFO:tasks.workunit.client.1.smithi172.stdout:5/363: fdatasync d5/d14/d34/f3f 0 2024-03-19T06:05:29.263 INFO:tasks.workunit.client.1.smithi172.stdout:9/385: chown d1/d7/dc/d47/l86 180 1 2024-03-19T06:05:29.264 INFO:tasks.workunit.client.1.smithi172.stdout:4/432: truncate df/d11/d12/d21/d58/d60/f7a 398326 0 2024-03-19T06:05:29.268 INFO:tasks.workunit.client.1.smithi172.stdout:0/404: dread - d11/d22/d32/f77 zero size 2024-03-19T06:05:29.270 INFO:tasks.workunit.client.1.smithi172.stdout:7/362: fdatasync d0/d22/d1d/d36/f13 0 2024-03-19T06:05:29.271 INFO:tasks.workunit.client.1.smithi172.stdout:2/356: dwrite d7/de/d58/d56/f6b [0,4194304] 0 2024-03-19T06:05:29.272 INFO:tasks.workunit.client.1.smithi172.stdout:5/364: creat d5/d1f/f82 x:0 0 0 2024-03-19T06:05:29.272 INFO:tasks.workunit.client.1.smithi172.stdout:0/405: chown d11/d14/d2c/d4e/l7e 863979735 1 2024-03-19T06:05:29.273 INFO:tasks.workunit.client.1.smithi172.stdout:7/363: chown d0/c2d 2131996 1 2024-03-19T06:05:29.274 INFO:tasks.workunit.client.1.smithi172.stdout:5/365: chown d5/fb 63314290 1 2024-03-19T06:05:29.275 INFO:tasks.workunit.client.1.smithi172.stdout:2/357: write d7/db/d2c/f4a [626630,891] 0 2024-03-19T06:05:29.276 INFO:tasks.workunit.client.1.smithi172.stdout:8/363: mknod d0/d44/d46/d49/d4f/c74 0 2024-03-19T06:05:29.276 INFO:tasks.workunit.client.1.smithi172.stdout:4/433: unlink df/d2b/c87 0 2024-03-19T06:05:29.277 INFO:tasks.workunit.client.1.smithi172.stdout:9/386: truncate d1/d7/dc/d47/f61 1026937 0 2024-03-19T06:05:29.281 INFO:tasks.workunit.client.1.smithi172.stdout:3/405: truncate d0/d5/d9/d34/d4d/f49 3359349 0 2024-03-19T06:05:29.284 INFO:tasks.workunit.client.1.smithi172.stdout:9/387: rename d1/d7/l43 to d1/d7/dc/d47/d78/d57/l8b 0 2024-03-19T06:05:29.284 INFO:tasks.workunit.client.1.smithi172.stdout:2/358: creat d7/de/d58/d55/d66/f72 x:0 0 0 2024-03-19T06:05:29.285 INFO:tasks.workunit.client.1.smithi172.stdout:0/406: mkdir d11/d18/d38/d3f/d43/d89 0 2024-03-19T06:05:29.286 INFO:tasks.workunit.client.1.smithi172.stdout:4/434: mknod df/d2b/c90 0 2024-03-19T06:05:29.290 INFO:tasks.workunit.client.1.smithi172.stdout:5/366: creat d5/d14/f83 x:0 0 0 2024-03-19T06:05:29.292 INFO:tasks.workunit.client.1.smithi172.stdout:4/435: truncate df/d2b/d44/d67/f5d 391902 0 2024-03-19T06:05:29.295 INFO:tasks.workunit.client.1.smithi172.stdout:2/359: rename d7/de/d61/f63 to d7/db/f73 0 2024-03-19T06:05:29.300 INFO:tasks.workunit.client.1.smithi172.stdout:7/364: dwrite d0/d22/f6d [0,4194304] 0 2024-03-19T06:05:29.301 INFO:tasks.workunit.client.1.smithi172.stdout:5/367: write d5/f16 [984419,44781] 0 2024-03-19T06:05:29.307 INFO:tasks.workunit.client.1.smithi172.stdout:0/407: write d11/d14/d2c/d36/f53 [1755838,67709] 0 2024-03-19T06:05:29.308 INFO:tasks.workunit.client.1.smithi172.stdout:1/470: sync 2024-03-19T06:05:29.308 INFO:tasks.workunit.client.1.smithi172.stdout:6/511: sync 2024-03-19T06:05:29.310 INFO:tasks.workunit.client.1.smithi172.stdout:7/365: creat d0/d22/d4b/f80 x:0 0 0 2024-03-19T06:05:29.311 INFO:tasks.workunit.client.1.smithi172.stdout:9/388: dwrite d1/d7/dc/f5d [0,4194304] 0 2024-03-19T06:05:29.312 INFO:tasks.workunit.client.1.smithi172.stdout:2/360: creat d7/db/d45/f74 x:0 0 0 2024-03-19T06:05:29.317 INFO:tasks.workunit.client.1.smithi172.stdout:1/471: creat da/d33/d4e/f9f x:0 0 0 2024-03-19T06:05:29.318 INFO:tasks.workunit.client.1.smithi172.stdout:3/406: dwrite d0/d5/d6b/f8f [0,4194304] 0 2024-03-19T06:05:29.324 INFO:tasks.workunit.client.1.smithi172.stdout:2/361: read d7/db/d2c/f38 [2133938,97213] 0 2024-03-19T06:05:29.325 INFO:tasks.workunit.client.1.smithi172.stdout:1/472: chown da/dd/d31/c54 80 1 2024-03-19T06:05:29.327 INFO:tasks.workunit.client.1.smithi172.stdout:3/407: write d0/d5/d9/d60/d67/f73 [1757207,9327] 0 2024-03-19T06:05:29.333 INFO:tasks.workunit.client.1.smithi172.stdout:3/408: creat d0/d5/d9/d25/f93 x:0 0 0 2024-03-19T06:05:29.334 INFO:tasks.workunit.client.1.smithi172.stdout:2/362: write d7/f15 [4520529,46300] 0 2024-03-19T06:05:29.338 INFO:tasks.workunit.client.1.smithi172.stdout:1/473: rename da/d7a/c8d to da/ca0 0 2024-03-19T06:05:29.339 INFO:tasks.workunit.client.1.smithi172.stdout:0/408: truncate d11/f13 3161454 0 2024-03-19T06:05:29.342 INFO:tasks.workunit.client.1.smithi172.stdout:9/389: fdatasync d1/d7/dc/d47/f61 0 2024-03-19T06:05:29.344 INFO:tasks.workunit.client.1.smithi172.stdout:3/409: dread d0/d5/d14/f30 [0,4194304] 0 2024-03-19T06:05:29.345 INFO:tasks.workunit.client.1.smithi172.stdout:1/474: creat da/dd/d31/d97/fa1 x:0 0 0 2024-03-19T06:05:29.347 INFO:tasks.workunit.client.1.smithi172.stdout:0/409: write d11/d18/d38/d3f/f5e [301081,88077] 0 2024-03-19T06:05:29.349 INFO:tasks.workunit.client.1.smithi172.stdout:9/390: chown d1/d7/dc/d47/d78/f79 7107 1 2024-03-19T06:05:29.351 INFO:tasks.workunit.client.1.smithi172.stdout:7/366: dwrite d0/d22/d1d/d36/d56/f79 [0,4194304] 0 2024-03-19T06:05:29.351 INFO:tasks.workunit.client.1.smithi172.stdout:2/363: rename d7/de/d58/d56/f50 to d7/de/d58/d55/d5f/d6a/f75 0 2024-03-19T06:05:29.362 INFO:tasks.workunit.client.1.smithi172.stdout:8/364: dread d0/d10/d27/d29/d28/f30 [0,4194304] 0 2024-03-19T06:05:29.365 INFO:tasks.workunit.client.1.smithi172.stdout:4/436: dread df/d11/d12/d34/f4e [0,4194304] 0 2024-03-19T06:05:29.367 INFO:tasks.workunit.client.1.smithi172.stdout:3/410: rmdir d0/d5/d9/d34/d4d/d6c/d8c 0 2024-03-19T06:05:29.368 INFO:tasks.workunit.client.1.smithi172.stdout:7/367: mknod d0/d22/d3d/d41/d42/d5c/c81 0 2024-03-19T06:05:29.374 INFO:tasks.workunit.client.1.smithi172.stdout:4/437: write df/d11/d12/d21/d50/f54 [761933,17] 0 2024-03-19T06:05:29.374 INFO:tasks.workunit.client.1.smithi172.stdout:0/410: write d11/d14/f1f [342547,15121] 0 2024-03-19T06:05:29.378 INFO:tasks.workunit.client.1.smithi172.stdout:3/411: getdents d0/d5/d9/d34/d4d/d6c/d88 0 2024-03-19T06:05:29.379 INFO:tasks.workunit.client.1.smithi172.stdout:9/391: dread d1/d7/dc/d23/f3c [0,4194304] 0 2024-03-19T06:05:29.380 INFO:tasks.workunit.client.1.smithi172.stdout:6/512: dread d5/d11/d43/f4c [0,4194304] 0 2024-03-19T06:05:29.381 INFO:tasks.workunit.client.1.smithi172.stdout:0/411: fdatasync d11/d22/d46/f6b 0 2024-03-19T06:05:29.384 INFO:tasks.workunit.client.1.smithi172.stdout:1/475: dwrite da/dd/d10/f1d [0,4194304] 0 2024-03-19T06:05:29.393 INFO:tasks.workunit.client.1.smithi172.stdout:8/365: dread d0/f3 [0,4194304] 0 2024-03-19T06:05:29.393 INFO:tasks.workunit.client.1.smithi172.stdout:2/364: dwrite d7/db/d2c/f38 [0,4194304] 0 2024-03-19T06:05:29.393 INFO:tasks.workunit.client.1.smithi172.stdout:0/412: readlink d11/d14/d2c/d4e/l76 0 2024-03-19T06:05:29.393 INFO:tasks.workunit.client.1.smithi172.stdout:5/368: sync 2024-03-19T06:05:29.397 INFO:tasks.workunit.client.1.smithi172.stdout:9/392: chown d1/d7/dc/de/f50 11300537 1 2024-03-19T06:05:29.397 INFO:tasks.workunit.client.1.smithi172.stdout:0/413: readlink d11/d22/d32/l4c 0 2024-03-19T06:05:29.397 INFO:tasks.workunit.client.1.smithi172.stdout:4/438: getdents df/d2b/d44/d67 0 2024-03-19T06:05:29.399 INFO:tasks.workunit.client.1.smithi172.stdout:8/366: chown d0/d44/d46/d49/d3a 2282 1 2024-03-19T06:05:29.400 INFO:tasks.workunit.client.1.smithi172.stdout:0/414: chown f7 0 1 2024-03-19T06:05:29.400 INFO:tasks.workunit.client.1.smithi172.stdout:2/365: write d7/de/f29 [4651035,93554] 0 2024-03-19T06:05:29.402 INFO:tasks.workunit.client.1.smithi172.stdout:5/369: write d5/f1d [788294,12164] 0 2024-03-19T06:05:29.402 INFO:tasks.workunit.client.1.smithi172.stdout:0/415: dread - d11/f83 zero size 2024-03-19T06:05:29.406 INFO:tasks.workunit.client.1.smithi172.stdout:1/476: mkdir da/dd/d10/d14/d27/da2 0 2024-03-19T06:05:29.409 INFO:tasks.workunit.client.1.smithi172.stdout:3/412: dwrite d0/d5/d6b/f8f [0,4194304] 0 2024-03-19T06:05:29.410 INFO:tasks.workunit.client.1.smithi172.stdout:5/370: write d5/d55/f5f [856541,63936] 0 2024-03-19T06:05:29.414 INFO:tasks.workunit.client.1.smithi172.stdout:0/416: chown d11/d18/d38/d3f/d43/f7f 2502 1 2024-03-19T06:05:29.414 INFO:tasks.workunit.client.1.smithi172.stdout:4/439: dread - df/d11/d12/d34/f8d zero size 2024-03-19T06:05:29.414 INFO:tasks.workunit.client.1.smithi172.stdout:5/371: chown d5/d3c/d6c 80662005 1 2024-03-19T06:05:29.415 INFO:tasks.workunit.client.1.smithi172.stdout:8/367: dread - d0/d10/d27/d29/d59/f4b zero size 2024-03-19T06:05:29.417 INFO:tasks.workunit.client.1.smithi172.stdout:1/477: mknod da/dd/d10/d14/d84/ca3 0 2024-03-19T06:05:29.419 INFO:tasks.workunit.client.1.smithi172.stdout:6/513: dwrite d5/d11/d43/d45/f5c [0,4194304] 0 2024-03-19T06:05:29.423 INFO:tasks.workunit.client.1.smithi172.stdout:5/372: mknod d5/d14/d56/c84 0 2024-03-19T06:05:29.426 INFO:tasks.workunit.client.1.smithi172.stdout:8/368: truncate d0/d44/d46/f60 988237 0 2024-03-19T06:05:29.426 INFO:tasks.workunit.client.1.smithi172.stdout:9/393: write d1/d7/dc/d47/f61 [25505,90566] 0 2024-03-19T06:05:29.426 INFO:tasks.workunit.client.1.smithi172.stdout:5/373: readlink d5/d14/d34/l81 0 2024-03-19T06:05:29.428 INFO:tasks.workunit.client.1.smithi172.stdout:6/514: creat d5/d11/d17/d1b/d74/fa2 x:0 0 0 2024-03-19T06:05:29.433 INFO:tasks.workunit.client.1.smithi172.stdout:0/417: symlink d11/d14/d2c/d36/l8a 0 2024-03-19T06:05:29.433 INFO:tasks.workunit.client.1.smithi172.stdout:4/440: creat df/d11/d12/d26/d84/f91 x:0 0 0 2024-03-19T06:05:29.437 INFO:tasks.workunit.client.1.smithi172.stdout:6/515: fsync d5/d11/d17/d1b/f69 0 2024-03-19T06:05:29.441 INFO:tasks.workunit.client.1.smithi172.stdout:9/394: stat d1/d7/dc/d47/d78/f79 0 2024-03-19T06:05:29.442 INFO:tasks.workunit.client.1.smithi172.stdout:0/418: mkdir d11/d18/d38/d3f/d8b 0 2024-03-19T06:05:29.444 INFO:tasks.workunit.client.1.smithi172.stdout:4/441: write df/d11/d12/f29 [1047947,63125] 0 2024-03-19T06:05:29.447 INFO:tasks.workunit.client.1.smithi172.stdout:2/366: dwrite d7/d1b/f69 [0,4194304] 0 2024-03-19T06:05:29.447 INFO:tasks.workunit.client.1.smithi172.stdout:8/369: mkdir d0/d44/d46/d49/d4f/d5c/d75 0 2024-03-19T06:05:29.447 INFO:tasks.workunit.client.1.smithi172.stdout:6/516: fsync d5/f8 0 2024-03-19T06:05:29.450 INFO:tasks.workunit.client.1.smithi172.stdout:7/368: dread d0/d22/d1d/d36/f23 [0,4194304] 0 2024-03-19T06:05:29.452 INFO:tasks.workunit.client.1.smithi172.stdout:0/419: fdatasync d11/d14/d2c/d36/f53 0 2024-03-19T06:05:29.455 INFO:tasks.workunit.client.1.smithi172.stdout:2/367: mknod d7/d4c/c76 0 2024-03-19T06:05:29.457 INFO:tasks.workunit.client.1.smithi172.stdout:3/413: dwrite d0/d5/d9/d34/f64 [0,4194304] 0 2024-03-19T06:05:29.457 INFO:tasks.workunit.client.1.smithi172.stdout:4/442: unlink df/d11/f25 0 2024-03-19T06:05:29.458 INFO:tasks.workunit.client.1.smithi172.stdout:0/420: chown d11/d18/d38/c70 1 1 2024-03-19T06:05:29.459 INFO:tasks.workunit.client.1.smithi172.stdout:3/414: chown d0/fe 1 1 2024-03-19T06:05:29.462 INFO:tasks.workunit.client.1.smithi172.stdout:6/517: mknod d5/d8f/d31/ca3 0 2024-03-19T06:05:29.463 INFO:tasks.workunit.client.1.smithi172.stdout:0/421: write d11/d22/d68/f63 [191427,23913] 0 2024-03-19T06:05:29.464 INFO:tasks.workunit.client.1.smithi172.stdout:5/374: dwrite d5/d14/d34/f75 [0,4194304] 0 2024-03-19T06:05:29.467 INFO:tasks.workunit.client.1.smithi172.stdout:9/395: rename d1/d7/dc/l39 to d1/d7/l8c 0 2024-03-19T06:05:29.468 INFO:tasks.workunit.client.1.smithi172.stdout:2/368: mknod d7/de/d58/d55/d5f/d6a/c77 0 2024-03-19T06:05:29.469 INFO:tasks.workunit.client.1.smithi172.stdout:3/415: creat d0/d5/d9/d34/d82/f94 x:0 0 0 2024-03-19T06:05:29.470 INFO:tasks.workunit.client.1.smithi172.stdout:6/518: mkdir d5/d11/d17/da4 0 2024-03-19T06:05:29.473 INFO:tasks.workunit.client.1.smithi172.stdout:8/370: getdents d0/d10/d27/d65 0 2024-03-19T06:05:29.473 INFO:tasks.workunit.client.1.smithi172.stdout:0/422: dread d11/d18/d38/d3f/f5e [0,4194304] 0 2024-03-19T06:05:29.474 INFO:tasks.workunit.client.1.smithi172.stdout:2/369: mknod d7/db/c78 0 2024-03-19T06:05:29.475 INFO:tasks.workunit.client.1.smithi172.stdout:9/396: chown d1/d7/dc/d47/d78/d57/f74 876 1 2024-03-19T06:05:29.479 INFO:tasks.workunit.client.1.smithi172.stdout:6/519: write d5/d11/d2f/f6d [3676288,23160] 0 2024-03-19T06:05:29.483 INFO:tasks.workunit.client.1.smithi172.stdout:3/416: rename d0/d5/d9/d54/f8e to d0/d5/d9/d34/d4d/d6c/f95 0 2024-03-19T06:05:29.488 INFO:tasks.workunit.client.1.smithi172.stdout:2/370: symlink d7/d4c/d70/l79 0 2024-03-19T06:05:29.488 INFO:tasks.workunit.client.1.smithi172.stdout:5/375: getdents d5/d14/d15/d40/d5c 0 2024-03-19T06:05:29.490 INFO:tasks.workunit.client.1.smithi172.stdout:7/369: write d0/d22/d1d/f32 [286797,43933] 0 2024-03-19T06:05:29.492 INFO:tasks.workunit.client.1.smithi172.stdout:2/371: readlink d7/db/d2c/d35/l36 0 2024-03-19T06:05:29.495 INFO:tasks.workunit.client.1.smithi172.stdout:4/443: truncate df/d11/f37 1291541 0 2024-03-19T06:05:29.497 INFO:tasks.workunit.client.1.smithi172.stdout:9/397: dread d1/d7/dc/d23/f33 [0,4194304] 0 2024-03-19T06:05:29.501 INFO:tasks.workunit.client.1.smithi172.stdout:7/370: mkdir d0/d22/d3d/d41/d42/d5c/d67/d82 0 2024-03-19T06:05:29.501 INFO:tasks.workunit.client.1.smithi172.stdout:4/444: mknod df/d2b/d44/c92 0 2024-03-19T06:05:29.501 INFO:tasks.workunit.client.1.smithi172.stdout:0/423: dwrite d11/d22/d68/f63 [0,4194304] 0 2024-03-19T06:05:29.504 INFO:tasks.workunit.client.1.smithi172.stdout:2/372: creat d7/de/d58/d55/d6e/f7a x:0 0 0 2024-03-19T06:05:29.511 INFO:tasks.workunit.client.1.smithi172.stdout:4/445: mkdir df/d2b/d44/d93 0 2024-03-19T06:05:29.513 INFO:tasks.workunit.client.1.smithi172.stdout:2/373: chown d7/db/f16 13121 1 2024-03-19T06:05:29.513 INFO:tasks.workunit.client.1.smithi172.stdout:4/446: stat df/d11/c71 0 2024-03-19T06:05:29.515 INFO:tasks.workunit.client.1.smithi172.stdout:7/371: mknod d0/d2c/c83 0 2024-03-19T06:05:29.519 INFO:tasks.workunit.client.1.smithi172.stdout:0/424: getdents d11/d22/d32 0 2024-03-19T06:05:29.520 INFO:tasks.workunit.client.1.smithi172.stdout:8/371: dread d0/fd [0,4194304] 0 2024-03-19T06:05:29.520 INFO:tasks.workunit.client.1.smithi172.stdout:9/398: truncate d1/fa 1853603 0 2024-03-19T06:05:29.524 INFO:tasks.workunit.client.1.smithi172.stdout:4/447: creat df/d11/d12/d21/d50/f94 x:0 0 0 2024-03-19T06:05:29.524 INFO:tasks.workunit.client.1.smithi172.stdout:2/374: truncate d7/d1b/f3f 3922749 0 2024-03-19T06:05:29.526 INFO:tasks.workunit.client.1.smithi172.stdout:9/399: symlink d1/d7/l8d 0 2024-03-19T06:05:29.527 INFO:tasks.workunit.client.1.smithi172.stdout:0/425: creat d11/d14/d2c/d36/f8c x:0 0 0 2024-03-19T06:05:29.527 INFO:tasks.workunit.client.1.smithi172.stdout:7/372: getdents d0/d22/d3d/d41 0 2024-03-19T06:05:29.528 INFO:tasks.workunit.client.1.smithi172.stdout:2/375: symlink d7/de/d58/d57/l7b 0 2024-03-19T06:05:29.530 INFO:tasks.workunit.client.1.smithi172.stdout:9/400: mkdir d1/d7/dc/d23/d8e 0 2024-03-19T06:05:29.530 INFO:tasks.workunit.client.1.smithi172.stdout:3/417: dread d0/d5/d9/d60/d67/f73 [0,4194304] 0 2024-03-19T06:05:29.530 INFO:tasks.workunit.client.1.smithi172.stdout:4/448: creat df/d11/f95 x:0 0 0 2024-03-19T06:05:29.532 INFO:tasks.workunit.client.1.smithi172.stdout:7/373: chown d0/d22/d1d/d3a/d46/c51 3842515 1 2024-03-19T06:05:29.534 INFO:tasks.workunit.client.1.smithi172.stdout:4/449: rename df/f62 to df/d45/f96 0 2024-03-19T06:05:29.536 INFO:tasks.workunit.client.1.smithi172.stdout:9/401: creat d1/d7/dc/de/d34/d48/d82/f8f x:0 0 0 2024-03-19T06:05:29.536 INFO:tasks.workunit.client.1.smithi172.stdout:4/450: dread - df/d2b/d2d/f73 zero size 2024-03-19T06:05:29.538 INFO:tasks.workunit.client.1.smithi172.stdout:5/376: dread d5/d14/f19 [0,4194304] 0 2024-03-19T06:05:29.541 INFO:tasks.workunit.client.1.smithi172.stdout:7/374: fdatasync d0/d22/d1d/d36/f1f 0 2024-03-19T06:05:29.541 INFO:tasks.workunit.client.1.smithi172.stdout:2/376: link d7/d1b/c5e d7/c7c 0 2024-03-19T06:05:29.542 INFO:tasks.workunit.client.1.smithi172.stdout:3/418: link d0/d5/d14/c46 d0/d5/d9/d34/d4d/d6c/c96 0 2024-03-19T06:05:29.542 INFO:tasks.workunit.client.1.smithi172.stdout:4/451: creat df/f97 x:0 0 0 2024-03-19T06:05:29.545 INFO:tasks.workunit.client.1.smithi172.stdout:5/377: write d5/d3d/f5b [2016808,123184] 0 2024-03-19T06:05:29.548 INFO:tasks.workunit.client.1.smithi172.stdout:2/377: creat d7/de/d58/d57/f7d x:0 0 0 2024-03-19T06:05:29.550 INFO:tasks.workunit.client.1.smithi172.stdout:9/402: truncate d1/d7/dc/de/d34/d48/f5f 1239875 0 2024-03-19T06:05:29.552 INFO:tasks.workunit.client.1.smithi172.stdout:9/403: chown d1/d7/dc/d31 3922 1 2024-03-19T06:05:29.552 INFO:tasks.workunit.client.1.smithi172.stdout:4/452: mknod df/d45/c98 0 2024-03-19T06:05:29.557 INFO:tasks.workunit.client.1.smithi172.stdout:2/378: unlink d7/de/d58/d55/d66/f52 0 2024-03-19T06:05:29.559 INFO:tasks.workunit.client.1.smithi172.stdout:0/426: dwrite d11/d18/d38/d3f/d43/d62/f74 [0,4194304] 0 2024-03-19T06:05:29.559 INFO:tasks.workunit.client.1.smithi172.stdout:1/478: sync 2024-03-19T06:05:29.559 INFO:tasks.workunit.client.1.smithi172.stdout:3/419: creat d0/d5/d9/d54/d90/f97 x:0 0 0 2024-03-19T06:05:29.561 INFO:tasks.workunit.client.1.smithi172.stdout:2/379: readlink d7/d1b/l2f 0 2024-03-19T06:05:29.563 INFO:tasks.workunit.client.1.smithi172.stdout:0/427: dread f6 [0,4194304] 0 2024-03-19T06:05:29.564 INFO:tasks.workunit.client.1.smithi172.stdout:1/479: readlink da/dd/d10/d36/l6a 0 2024-03-19T06:05:29.565 INFO:tasks.workunit.client.1.smithi172.stdout:8/372: dread d0/d10/d27/d29/f32 [4194304,4194304] 0 2024-03-19T06:05:29.566 INFO:tasks.workunit.client.1.smithi172.stdout:2/380: creat d7/d4c/f7e x:0 0 0 2024-03-19T06:05:29.568 INFO:tasks.workunit.client.1.smithi172.stdout:1/480: dread - da/dd/d10/f96 zero size 2024-03-19T06:05:29.572 INFO:tasks.workunit.client.1.smithi172.stdout:3/420: truncate d0/d5/d9/d25/d21/f50 5207246 0 2024-03-19T06:05:29.573 INFO:tasks.workunit.client.1.smithi172.stdout:9/404: truncate d1/d7/dc/d47/f53 1309119 0 2024-03-19T06:05:29.574 INFO:tasks.workunit.client.1.smithi172.stdout:5/378: dwrite d5/d14/f69 [0,4194304] 0 2024-03-19T06:05:29.575 INFO:tasks.workunit.client.1.smithi172.stdout:2/381: rmdir d7/de/d58/d56 39 2024-03-19T06:05:29.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:29 smithi072 ceph-mon[28706]: pgmap v11: 65 pgs: 65 active+clean; 595 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 5.4 MiB/s rd, 64 MiB/s wr, 208 op/s 2024-03-19T06:05:29.577 INFO:tasks.workunit.client.1.smithi172.stdout:0/428: mkdir d11/d14/d2c/d8d 0 2024-03-19T06:05:29.578 INFO:tasks.workunit.client.1.smithi172.stdout:3/421: unlink d0/d5/l8d 0 2024-03-19T06:05:29.579 INFO:tasks.workunit.client.1.smithi172.stdout:9/405: chown d1/d7/dc/de 0 1 2024-03-19T06:05:29.579 INFO:tasks.workunit.client.1.smithi172.stdout:1/481: symlink da/dd/d10/d14/la4 0 2024-03-19T06:05:29.587 INFO:tasks.workunit.client.1.smithi172.stdout:8/373: rename d0/d44/d46/d49/d4f/d5c/d75 to d0/d44/d46/d49/d3a/d76 0 2024-03-19T06:05:29.587 INFO:tasks.workunit.client.1.smithi172.stdout:4/453: dwrite df/d11/d12/d6e/f89 [0,4194304] 0 2024-03-19T06:05:29.587 INFO:tasks.workunit.client.1.smithi172.stdout:5/379: mknod d5/d14/d15/d40/d5c/c85 0 2024-03-19T06:05:29.587 INFO:tasks.workunit.client.1.smithi172.stdout:3/422: chown d0/d5/d6b/l6d 3 1 2024-03-19T06:05:29.587 INFO:tasks.workunit.client.1.smithi172.stdout:0/429: symlink d11/d4d/l8e 0 2024-03-19T06:05:29.588 INFO:tasks.workunit.client.1.smithi172.stdout:9/406: chown d1/f56 20017 1 2024-03-19T06:05:29.589 INFO:tasks.workunit.client.1.smithi172.stdout:7/375: dread d0/d22/d3d/f64 [0,4194304] 0 2024-03-19T06:05:29.592 INFO:tasks.workunit.client.1.smithi172.stdout:7/376: fdatasync d0/d22/d1d/d3a/f3f 0 2024-03-19T06:05:29.594 INFO:tasks.workunit.client.1.smithi172.stdout:0/430: chown d11/d18/d38/d3f/f6e 68 1 2024-03-19T06:05:29.594 INFO:tasks.workunit.client.1.smithi172.stdout:3/423: write d0/d5/d9/d34/d82/f94 [912381,55021] 0 2024-03-19T06:05:29.596 INFO:tasks.workunit.client.1.smithi172.stdout:4/454: truncate df/d11/d12/d69/f7e 367565 0 2024-03-19T06:05:29.599 INFO:tasks.workunit.client.1.smithi172.stdout:1/482: mknod da/dd/d10/d14/d27/d53/ca5 0 2024-03-19T06:05:29.599 INFO:tasks.workunit.client.1.smithi172.stdout:6/520: sync 2024-03-19T06:05:29.605 INFO:tasks.workunit.client.1.smithi172.stdout:5/380: symlink d5/d14/d15/d40/d5c/l86 0 2024-03-19T06:05:29.606 INFO:tasks.workunit.client.1.smithi172.stdout:2/382: dread d7/de/d58/d56/f6b [0,4194304] 0 2024-03-19T06:05:29.607 INFO:tasks.workunit.client.1.smithi172.stdout:5/381: chown d5/fb 191 1 2024-03-19T06:05:29.608 INFO:tasks.workunit.client.1.smithi172.stdout:6/521: dread d5/f37 [0,4194304] 0 2024-03-19T06:05:29.608 INFO:tasks.workunit.client.1.smithi172.stdout:3/424: stat d0/d5/d9/d34/d4d/f49 0 2024-03-19T06:05:29.609 INFO:tasks.workunit.client.1.smithi172.stdout:1/483: symlink da/d33/d78/la6 0 2024-03-19T06:05:29.611 INFO:tasks.workunit.client.1.smithi172.stdout:7/377: mknod d0/d22/d3d/d41/d42/d7d/c84 0 2024-03-19T06:05:29.611 INFO:tasks.workunit.client.1.smithi172.stdout:8/374: getdents d0/d10/d27/d29/d28 0 2024-03-19T06:05:29.613 INFO:tasks.workunit.client.1.smithi172.stdout:0/431: rename d11/d22/f49 to d11/d18/d38/f8f 0 2024-03-19T06:05:29.615 INFO:tasks.workunit.client.1.smithi172.stdout:2/383: creat d7/de/d58/d55/d5f/d6a/f7f x:0 0 0 2024-03-19T06:05:29.618 INFO:tasks.workunit.client.1.smithi172.stdout:7/378: mkdir d0/d22/d1d/d85 0 2024-03-19T06:05:29.618 INFO:tasks.workunit.client.1.smithi172.stdout:0/432: write d11/d14/f2e [285958,59939] 0 2024-03-19T06:05:29.619 INFO:tasks.workunit.client.1.smithi172.stdout:5/382: mknod d5/d3c/d6c/c87 0 2024-03-19T06:05:29.620 INFO:tasks.workunit.client.1.smithi172.stdout:4/455: dwrite df/d11/d12/d21/f4b [0,4194304] 0 2024-03-19T06:05:29.620 INFO:tasks.workunit.client.1.smithi172.stdout:7/379: fdatasync d0/d22/d3d/f6e 0 2024-03-19T06:05:29.625 INFO:tasks.workunit.client.1.smithi172.stdout:0/433: readlink d11/d14/l19 0 2024-03-19T06:05:29.625 INFO:tasks.workunit.client.1.smithi172.stdout:8/375: symlink d0/d44/d46/d49/d26/l77 0 2024-03-19T06:05:29.625 INFO:tasks.workunit.client.1.smithi172.stdout:2/384: fdatasync d7/de/d58/d55/d5f/d6a/f75 0 2024-03-19T06:05:29.627 INFO:tasks.workunit.client.1.smithi172.stdout:9/407: dwrite d1/d7/f2e [0,4194304] 0 2024-03-19T06:05:29.628 INFO:tasks.workunit.client.1.smithi172.stdout:7/380: mkdir d0/d22/d27/d86 0 2024-03-19T06:05:29.631 INFO:tasks.workunit.client.1.smithi172.stdout:3/425: write d0/d5/d9/d34/d4d/f49 [2953902,51344] 0 2024-03-19T06:05:29.633 INFO:tasks.workunit.client.1.smithi172.stdout:9/408: read - d1/d7/dc/de/d34/d48/d82/f8f zero size 2024-03-19T06:05:29.636 INFO:tasks.workunit.client.1.smithi172.stdout:8/376: rmdir d0/d44/d46/d49/d4f 39 2024-03-19T06:05:29.639 INFO:tasks.workunit.client.1.smithi172.stdout:2/385: symlink d7/de/d58/d57/l80 0 2024-03-19T06:05:29.639 INFO:tasks.workunit.client.1.smithi172.stdout:7/381: rmdir d0/d22 39 2024-03-19T06:05:29.639 INFO:tasks.workunit.client.1.smithi172.stdout:0/434: dread d11/d18/d38/f55 [0,4194304] 0 2024-03-19T06:05:29.640 INFO:tasks.workunit.client.1.smithi172.stdout:4/456: mkdir df/d2b/d99 0 2024-03-19T06:05:29.642 INFO:tasks.workunit.client.1.smithi172.stdout:5/383: dread d5/f27 [0,4194304] 0 2024-03-19T06:05:29.642 INFO:tasks.workunit.client.1.smithi172.stdout:9/409: mkdir d1/d7/dc/de/d34/d48/d82/d90 0 2024-03-19T06:05:29.643 INFO:tasks.workunit.client.1.smithi172.stdout:7/382: dread - d0/f7c zero size 2024-03-19T06:05:29.644 INFO:tasks.workunit.client.1.smithi172.stdout:8/377: mknod d0/d10/d27/d29/d59/c78 0 2024-03-19T06:05:29.645 INFO:tasks.workunit.client.1.smithi172.stdout:2/386: read d7/db/d2c/f4a [242504,73796] 0 2024-03-19T06:05:29.646 INFO:tasks.workunit.client.1.smithi172.stdout:6/522: dwrite d5/d11/d17/f3e [0,4194304] 0 2024-03-19T06:05:29.649 INFO:tasks.workunit.client.1.smithi172.stdout:4/457: read df/d11/d12/d21/f2f [113294,41600] 0 2024-03-19T06:05:29.649 INFO:tasks.workunit.client.1.smithi172.stdout:5/384: mknod d5/d3c/c88 0 2024-03-19T06:05:29.650 INFO:tasks.workunit.client.1.smithi172.stdout:3/426: link d0/d5/d9/d25/d21/l91 d0/d5/d14/l98 0 2024-03-19T06:05:29.650 INFO:tasks.workunit.client.1.smithi172.stdout:8/378: write d0/d44/d46/d49/d3a/f41 [26851,113832] 0 2024-03-19T06:05:29.651 INFO:tasks.workunit.client.1.smithi172.stdout:9/410: rename d1/d7/dc/d31 to d1/d7/dc/d47/d78/d54/d91 0 2024-03-19T06:05:29.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:29 smithi172 ceph-mon[35716]: pgmap v11: 65 pgs: 65 active+clean; 595 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 5.4 MiB/s rd, 64 MiB/s wr, 208 op/s 2024-03-19T06:05:29.654 INFO:tasks.workunit.client.1.smithi172.stdout:7/383: creat d0/d22/d3d/d41/f87 x:0 0 0 2024-03-19T06:05:29.654 INFO:tasks.workunit.client.1.smithi172.stdout:4/458: write df/d11/d12/d26/f35 [580480,123391] 0 2024-03-19T06:05:29.654 INFO:tasks.workunit.client.1.smithi172.stdout:8/379: chown d0/d10/d27/d29/d59/c78 0 1 2024-03-19T06:05:29.655 INFO:tasks.workunit.client.1.smithi172.stdout:2/387: mkdir d7/de/d58/d56/d81 0 2024-03-19T06:05:29.656 INFO:tasks.workunit.client.1.smithi172.stdout:3/427: chown d0/d5/d9/d34/d4d/d6c/f95 14 1 2024-03-19T06:05:29.657 INFO:tasks.workunit.client.1.smithi172.stdout:6/523: creat d5/d8f/d31/d7b/fa5 x:0 0 0 2024-03-19T06:05:29.657 INFO:tasks.workunit.client.1.smithi172.stdout:4/459: fsync df/d2b/f53 0 2024-03-19T06:05:29.659 INFO:tasks.workunit.client.1.smithi172.stdout:0/435: creat d11/d14/f90 x:0 0 0 2024-03-19T06:05:29.659 INFO:tasks.workunit.client.1.smithi172.stdout:3/428: write d0/d5/d9/fd [4110761,31836] 0 2024-03-19T06:05:29.665 INFO:tasks.workunit.client.1.smithi172.stdout:8/380: creat d0/d44/f79 x:0 0 0 2024-03-19T06:05:29.666 INFO:tasks.workunit.client.1.smithi172.stdout:9/411: mkdir d1/d7/dc/de/d34/d48/d82/d92 0 2024-03-19T06:05:29.667 INFO:tasks.workunit.client.1.smithi172.stdout:7/384: mknod d0/d22/d3d/d41/c88 0 2024-03-19T06:05:29.678 INFO:tasks.workunit.client.1.smithi172.stdout:8/381: write d0/f1f [4514434,19309] 0 2024-03-19T06:05:29.680 INFO:tasks.workunit.client.1.smithi172.stdout:3/429: dwrite d0/d5/d6b/f8f [0,4194304] 0 2024-03-19T06:05:29.684 INFO:tasks.workunit.client.1.smithi172.stdout:9/412: link d1/f75 d1/f93 0 2024-03-19T06:05:29.685 INFO:tasks.workunit.client.1.smithi172.stdout:8/382: write d0/d10/d27/f1e [1801120,85551] 0 2024-03-19T06:05:29.695 INFO:tasks.workunit.client.1.smithi172.stdout:5/385: dread d5/d14/d15/d40/f54 [0,4194304] 0 2024-03-19T06:05:29.697 INFO:tasks.workunit.client.1.smithi172.stdout:9/413: rmdir d1/d7/dc/de/d34/d48/d82/d90 0 2024-03-19T06:05:29.705 INFO:tasks.workunit.client.1.smithi172.stdout:6/524: dread d5/f8 [0,4194304] 0 2024-03-19T06:05:29.708 INFO:tasks.workunit.client.1.smithi172.stdout:9/414: unlink d1/d7/l8c 0 2024-03-19T06:05:29.708 INFO:tasks.workunit.client.1.smithi172.stdout:7/385: dwrite d0/d22/d1d/d36/f23 [4194304,4194304] 0 2024-03-19T06:05:29.716 INFO:tasks.workunit.client.1.smithi172.stdout:6/525: mkdir d5/d11/d43/da6 0 2024-03-19T06:05:29.716 INFO:tasks.workunit.client.1.smithi172.stdout:9/415: fsync d1/d7/dc/f5d 0 2024-03-19T06:05:29.716 INFO:tasks.workunit.client.1.smithi172.stdout:1/484: sync 2024-03-19T06:05:29.722 INFO:tasks.workunit.client.1.smithi172.stdout:9/416: chown d1/l38 40076197 1 2024-03-19T06:05:29.723 INFO:tasks.workunit.client.1.smithi172.stdout:0/436: dread d11/f29 [4194304,4194304] 0 2024-03-19T06:05:29.723 INFO:tasks.workunit.client.1.smithi172.stdout:2/388: dread d7/db/f73 [0,4194304] 0 2024-03-19T06:05:29.725 INFO:tasks.workunit.client.1.smithi172.stdout:6/526: mknod d5/d11/d17/ca7 0 2024-03-19T06:05:29.727 INFO:tasks.workunit.client.1.smithi172.stdout:7/386: mknod d0/d22/d35/c89 0 2024-03-19T06:05:29.728 INFO:tasks.workunit.client.1.smithi172.stdout:4/460: dread fb [4194304,4194304] 0 2024-03-19T06:05:29.728 INFO:tasks.workunit.client.1.smithi172.stdout:0/437: rmdir d11/d4d 39 2024-03-19T06:05:29.729 INFO:tasks.workunit.client.1.smithi172.stdout:3/430: dwrite d0/d5/d9/d3a/f7b [0,4194304] 0 2024-03-19T06:05:29.730 INFO:tasks.workunit.client.1.smithi172.stdout:2/389: creat d7/de/d58/d55/f82 x:0 0 0 2024-03-19T06:05:29.733 INFO:tasks.workunit.client.1.smithi172.stdout:4/461: write df/d11/d12/d21/d50/f5f [151000,18374] 0 2024-03-19T06:05:29.734 INFO:tasks.workunit.client.1.smithi172.stdout:2/390: fdatasync d7/d1b/f20 0 2024-03-19T06:05:29.736 INFO:tasks.workunit.client.1.smithi172.stdout:5/386: dread d5/d14/d15/d40/f54 [0,4194304] 0 2024-03-19T06:05:29.736 INFO:tasks.workunit.client.1.smithi172.stdout:9/417: mknod d1/d7/dc/de/d34/d48/d82/c94 0 2024-03-19T06:05:29.737 INFO:tasks.workunit.client.1.smithi172.stdout:8/383: dread d0/d10/d27/f1e [0,4194304] 0 2024-03-19T06:05:29.738 INFO:tasks.workunit.client.1.smithi172.stdout:0/438: creat d11/f91 x:0 0 0 2024-03-19T06:05:29.740 INFO:tasks.workunit.client.1.smithi172.stdout:6/527: rename d5/d11/f4b to d5/d11/d17/d36/d48/fa8 0 2024-03-19T06:05:29.740 INFO:tasks.workunit.client.1.smithi172.stdout:8/384: readlink d0/l5 0 2024-03-19T06:05:29.748 INFO:tasks.workunit.client.1.smithi172.stdout:0/439: write d11/d4d/f5a [1926069,27252] 0 2024-03-19T06:05:29.755 INFO:tasks.workunit.client.1.smithi172.stdout:4/462: rename df/d11/d12/d21/d50/l7d to df/d11/d12/l9a 0 2024-03-19T06:05:29.759 INFO:tasks.workunit.client.1.smithi172.stdout:4/463: chown df/f3d 43 1 2024-03-19T06:05:29.759 INFO:tasks.workunit.client.1.smithi172.stdout:9/418: mkdir d1/d7/dc/de/d34/d48/d82/d92/d95 0 2024-03-19T06:05:29.760 INFO:tasks.workunit.client.1.smithi172.stdout:0/440: creat d11/d18/d38/f92 x:0 0 0 2024-03-19T06:05:29.762 INFO:tasks.workunit.client.1.smithi172.stdout:7/387: dwrite d0/d22/d1d/d36/d56/f79 [0,4194304] 0 2024-03-19T06:05:29.765 INFO:tasks.workunit.client.1.smithi172.stdout:4/464: dread - df/d11/d12/d34/f8d zero size 2024-03-19T06:05:29.773 INFO:tasks.workunit.client.1.smithi172.stdout:5/387: rename d5/d14/d34/d66/l79 to d5/l89 0 2024-03-19T06:05:29.777 INFO:tasks.workunit.client.1.smithi172.stdout:4/465: mknod df/d11/d12/c9b 0 2024-03-19T06:05:29.777 INFO:tasks.workunit.client.1.smithi172.stdout:0/441: getdents d11/d14/d2c/d8d 0 2024-03-19T06:05:29.777 INFO:tasks.workunit.client.1.smithi172.stdout:6/528: dwrite d5/f37 [0,4194304] 0 2024-03-19T06:05:29.786 INFO:tasks.workunit.client.1.smithi172.stdout:4/466: mkdir df/d2b/d2d/d9c 0 2024-03-19T06:05:29.791 INFO:tasks.workunit.client.1.smithi172.stdout:2/391: dwrite d7/f4e [0,4194304] 0 2024-03-19T06:05:29.791 INFO:tasks.workunit.client.1.smithi172.stdout:0/442: dread d11/d18/d38/d3f/d43/f7f [0,4194304] 0 2024-03-19T06:05:29.793 INFO:tasks.workunit.client.1.smithi172.stdout:4/467: creat df/d2b/d2d/f9d x:0 0 0 2024-03-19T06:05:29.795 INFO:tasks.workunit.client.1.smithi172.stdout:0/443: dread - d11/d14/f90 zero size 2024-03-19T06:05:29.801 INFO:tasks.workunit.client.1.smithi172.stdout:0/444: fsync d11/f83 0 2024-03-19T06:05:29.806 INFO:tasks.workunit.client.1.smithi172.stdout:2/392: creat d7/f83 x:0 0 0 2024-03-19T06:05:29.808 INFO:tasks.workunit.client.1.smithi172.stdout:1/485: dread da/dd/d10/d14/d27/d3f/d5e/f7e [0,4194304] 0 2024-03-19T06:05:29.810 INFO:tasks.workunit.client.1.smithi172.stdout:4/468: symlink df/d11/d12/d69/l9e 0 2024-03-19T06:05:29.814 INFO:tasks.workunit.client.1.smithi172.stdout:7/388: dwrite d0/d22/d1d/f4c [0,4194304] 0 2024-03-19T06:05:29.814 INFO:tasks.workunit.client.1.smithi172.stdout:2/393: creat d7/de/d58/d55/d5f/d6a/f84 x:0 0 0 2024-03-19T06:05:29.817 INFO:tasks.workunit.client.0.smithi072.stderr:++ readlink -f fsstress 2024-03-19T06:05:29.817 INFO:tasks.workunit.client.1.smithi172.stdout:9/419: dwrite d1/d7/dc/d47/d78/d57/f74 [0,4194304] 0 2024-03-19T06:05:29.819 INFO:tasks.workunit.client.1.smithi172.stdout:5/388: dread d5/d14/d15/f24 [0,4194304] 0 2024-03-19T06:05:29.820 INFO:tasks.workunit.client.0.smithi072.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-03-19T06:05:29.821 INFO:tasks.workunit.client.0.smithi072.stderr:+ popd 2024-03-19T06:05:29.822 INFO:tasks.workunit.client.1.smithi172.stdout:7/389: write d0/d22/d4b/f80 [680159,104527] 0 2024-03-19T06:05:29.824 INFO:tasks.workunit.client.0.smithi072.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-19T06:05:29.824 INFO:tasks.workunit.client.1.smithi172.stdout:0/445: creat d11/d22/d46/d84/f93 x:0 0 0 2024-03-19T06:05:29.824 INFO:tasks.workunit.client.0.smithi072.stderr:+ popd 2024-03-19T06:05:29.825 INFO:tasks.workunit.client.1.smithi172.stdout:1/486: write da/dd/d10/f2c [6656602,377] 0 2024-03-19T06:05:29.825 INFO:tasks.workunit.client.1.smithi172.stdout:8/385: dread d0/d44/d46/d49/f5d [0,4194304] 0 2024-03-19T06:05:29.825 INFO:tasks.workunit.client.1.smithi172.stdout:5/389: chown d5/d14/d48/f7d 101250 1 2024-03-19T06:05:29.825 INFO:tasks.workunit.client.1.smithi172.stdout:2/394: chown d7/de/d61/f65 257775 1 2024-03-19T06:05:29.826 INFO:tasks.workunit.client.0.smithi072.stdout:~/cephtest/mnt.0/client.0/tmp 2024-03-19T06:05:29.826 INFO:tasks.workunit.client.1.smithi172.stdout:9/420: chown d1/d7/dc/f14 50 1 2024-03-19T06:05:29.827 INFO:tasks.workunit.client.0.smithi072.stderr:++ mktemp -d -p . 2024-03-19T06:05:29.827 INFO:tasks.workunit.client.1.smithi172.stdout:6/529: dwrite d5/d11/d17/f3a [0,4194304] 0 2024-03-19T06:05:29.829 INFO:tasks.workunit.client.1.smithi172.stdout:0/446: stat d11/d18/f21 0 2024-03-19T06:05:29.830 INFO:tasks.workunit.client.1.smithi172.stdout:4/469: readlink df/d11/d12/l9a 0 2024-03-19T06:05:29.831 INFO:tasks.workunit.client.1.smithi172.stdout:5/390: stat d5/d1f/d2f 0 2024-03-19T06:05:29.832 INFO:tasks.workunit.client.1.smithi172.stdout:1/487: chown da/d33/l88 24 1 2024-03-19T06:05:29.834 INFO:tasks.workunit.client.1.smithi172.stdout:4/470: stat df 0 2024-03-19T06:05:29.835 INFO:tasks.workunit.client.1.smithi172.stdout:7/390: link d0/d22/d4b/f80 d0/d22/d1d/d36/d40/f8a 0 2024-03-19T06:05:29.837 INFO:tasks.workunit.client.1.smithi172.stdout:2/395: fdatasync d7/de/d58/d56/f46 0 2024-03-19T06:05:29.838 INFO:tasks.workunit.client.1.smithi172.stdout:9/421: rename d1/d7/dc/d47/c55 to d1/d7/dc/d47/c96 0 2024-03-19T06:05:29.838 INFO:tasks.workunit.client.1.smithi172.stdout:8/386: read d0/d10/d27/d29/d28/f40 [3436251,75993] 0 2024-03-19T06:05:29.841 INFO:tasks.workunit.client.1.smithi172.stdout:4/471: read df/d2b/d2d/f46 [2426735,36640] 0 2024-03-19T06:05:29.842 INFO:tasks.workunit.client.1.smithi172.stdout:1/488: truncate da/dd/f1f 910662 0 2024-03-19T06:05:29.842 INFO:tasks.workunit.client.1.smithi172.stdout:3/431: sync 2024-03-19T06:05:29.843 INFO:tasks.workunit.client.1.smithi172.stdout:7/391: rename d0 to d0/d8b 22 2024-03-19T06:05:29.845 INFO:tasks.workunit.client.1.smithi172.stdout:8/387: write d0/d10/f6d [1016854,31961] 0 2024-03-19T06:05:29.845 INFO:tasks.workunit.client.1.smithi172.stdout:5/391: creat d5/d14/d15/d40/d6a/d7a/f8a x:0 0 0 2024-03-19T06:05:29.848 INFO:tasks.workunit.client.1.smithi172.stdout:0/447: write d11/d14/d2c/d4e/f87 [176912,12938] 0 2024-03-19T06:05:29.849 INFO:tasks.workunit.client.1.smithi172.stdout:2/396: creat d7/de/d58/d56/f85 x:0 0 0 2024-03-19T06:05:29.851 INFO:tasks.workunit.client.1.smithi172.stdout:2/397: readlink d7/db/l3e 0 2024-03-19T06:05:29.853 INFO:tasks.workunit.client.0.smithi072.stderr:+ T=./tmp.UJvKau8PLh 2024-03-19T06:05:29.853 INFO:tasks.workunit.client.0.smithi072.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.UJvKau8PLh -l 1 -n 1000 -p 10 -v 2024-03-19T06:05:29.857 INFO:tasks.workunit.client.1.smithi172.stdout:3/432: write d0/d5/d9/d25/d21/f50 [6228449,94519] 0 2024-03-19T06:05:29.857 INFO:tasks.workunit.client.1.smithi172.stdout:8/388: write d0/d44/f62 [5021480,108436] 0 2024-03-19T06:05:29.858 INFO:tasks.workunit.client.1.smithi172.stdout:7/392: read - d0/d22/d1d/d36/d40/f5f zero size 2024-03-19T06:05:29.858 INFO:tasks.workunit.client.1.smithi172.stdout:3/433: fsync d0/f7c 0 2024-03-19T06:05:29.858 INFO:tasks.workunit.client.1.smithi172.stdout:6/530: getdents d5/d8f/d31/d7b 0 2024-03-19T06:05:29.859 INFO:tasks.workunit.client.1.smithi172.stdout:1/489: mkdir da/dd/d10/d14/d27/da7 0 2024-03-19T06:05:29.861 INFO:tasks.workunit.client.1.smithi172.stdout:5/392: chown d5/d55/l7f 1665834205 1 2024-03-19T06:05:29.861 INFO:tasks.workunit.client.1.smithi172.stdout:2/398: mkdir d7/de/d58/d56/d86 0 2024-03-19T06:05:29.866 INFO:tasks.workunit.client.0.smithi072.stdout:seed = 1710519952 2024-03-19T06:05:29.869 INFO:tasks.workunit.client.1.smithi172.stdout:2/399: fdatasync d7/de/d58/d56/f34 0 2024-03-19T06:05:29.871 INFO:tasks.workunit.client.1.smithi172.stdout:9/422: write d1/d7/dc/d47/d78/d54/d91/f6f [3326690,19870] 0 2024-03-19T06:05:29.873 INFO:tasks.workunit.client.0.smithi072.stdout:0/0: chown . 10219826 1 2024-03-19T06:05:29.874 INFO:tasks.workunit.client.0.smithi072.stdout:0/1: dwrite - no filename 2024-03-19T06:05:29.875 INFO:tasks.workunit.client.1.smithi172.stdout:5/393: symlink d5/d14/d15/d40/d5c/l8b 0 2024-03-19T06:05:29.875 INFO:tasks.workunit.client.1.smithi172.stdout:2/400: write d7/db/f18 [3632855,48372] 0 2024-03-19T06:05:29.878 INFO:tasks.workunit.client.1.smithi172.stdout:8/389: rename d0/d44/d46/d49/d3a/f41 to d0/d44/f7a 0 2024-03-19T06:05:29.879 INFO:tasks.workunit.client.0.smithi072.stdout:0/2: symlink l0 0 2024-03-19T06:05:29.880 INFO:tasks.workunit.client.0.smithi072.stdout:0/3: dwrite - no filename 2024-03-19T06:05:29.881 INFO:tasks.workunit.client.1.smithi172.stdout:5/394: rmdir d5/d55 39 2024-03-19T06:05:29.883 INFO:tasks.workunit.client.1.smithi172.stdout:6/531: dread d5/d11/d17/d36/d48/fa8 [0,4194304] 0 2024-03-19T06:05:29.883 INFO:tasks.workunit.client.1.smithi172.stdout:9/423: write d1/d7/dc/de/d34/d48/f5f [1369723,7620] 0 2024-03-19T06:05:29.884 INFO:tasks.workunit.client.0.smithi072.stdout:1/0: symlink l0 0 2024-03-19T06:05:29.884 INFO:tasks.workunit.client.1.smithi172.stdout:0/448: dread d11/d22/d68/f63 [0,4194304] 0 2024-03-19T06:05:29.886 INFO:tasks.workunit.client.0.smithi072.stdout:0/4: mkdir d1 0 2024-03-19T06:05:29.886 INFO:tasks.workunit.client.0.smithi072.stdout:0/5: dread - no filename 2024-03-19T06:05:29.887 INFO:tasks.workunit.client.1.smithi172.stdout:3/434: dread d0/d5/d9/d54/d77/f78 [0,4194304] 0 2024-03-19T06:05:29.887 INFO:tasks.workunit.client.0.smithi072.stdout:2/0: symlink l0 0 2024-03-19T06:05:29.888 INFO:tasks.workunit.client.0.smithi072.stdout:0/6: rename d1 to d1/d2 22 2024-03-19T06:05:29.889 INFO:tasks.workunit.client.1.smithi172.stdout:5/395: write d5/d14/d15/f4c [940102,98389] 0 2024-03-19T06:05:29.889 INFO:tasks.workunit.client.1.smithi172.stdout:0/449: write d11/f83 [983402,98172] 0 2024-03-19T06:05:29.892 INFO:tasks.workunit.client.0.smithi072.stdout:1/1: mkdir d1 0 2024-03-19T06:05:29.892 INFO:tasks.workunit.client.1.smithi172.stdout:8/390: truncate d0/d44/d46/d49/d26/f48 4660741 0 2024-03-19T06:05:29.893 INFO:tasks.workunit.client.1.smithi172.stdout:9/424: truncate d1/f93 423992 0 2024-03-19T06:05:29.893 INFO:tasks.workunit.client.0.smithi072.stdout:1/2: rename d1 to d1/d2 22 2024-03-19T06:05:29.893 INFO:tasks.workunit.client.0.smithi072.stdout:2/1: creat f1 x:0 0 0 2024-03-19T06:05:29.894 INFO:tasks.workunit.client.0.smithi072.stdout:1/3: stat d1 0 2024-03-19T06:05:29.894 INFO:tasks.workunit.client.0.smithi072.stdout:1/4: dwrite - no filename 2024-03-19T06:05:29.895 INFO:tasks.workunit.client.0.smithi072.stdout:2/2: dread - f1 zero size 2024-03-19T06:05:29.895 INFO:tasks.workunit.client.0.smithi072.stdout:3/0: creat f0 x:0 0 0 2024-03-19T06:05:29.896 INFO:tasks.workunit.client.1.smithi172.stdout:9/425: chown d1/d7/dc/d23/f33 68126 1 2024-03-19T06:05:29.896 INFO:tasks.workunit.client.0.smithi072.stdout:4/0: symlink l0 0 2024-03-19T06:05:29.897 INFO:tasks.workunit.client.0.smithi072.stdout:4/1: truncate - no filename 2024-03-19T06:05:29.899 INFO:tasks.workunit.client.0.smithi072.stdout:6/0: read - no filename 2024-03-19T06:05:29.899 INFO:tasks.workunit.client.0.smithi072.stdout:6/1: dwrite - no filename 2024-03-19T06:05:29.899 INFO:tasks.workunit.client.0.smithi072.stdout:6/2: readlink - no filename 2024-03-19T06:05:29.899 INFO:tasks.workunit.client.0.smithi072.stdout:6/3: write - no filename 2024-03-19T06:05:29.899 INFO:tasks.workunit.client.0.smithi072.stdout:1/5: unlink l0 0 2024-03-19T06:05:29.899 INFO:tasks.workunit.client.0.smithi072.stdout:1/6: readlink - no filename 2024-03-19T06:05:29.899 INFO:tasks.workunit.client.0.smithi072.stdout:1/7: truncate - no filename 2024-03-19T06:05:29.900 INFO:tasks.workunit.client.0.smithi072.stdout:1/8: write - no filename 2024-03-19T06:05:29.900 INFO:tasks.workunit.client.0.smithi072.stdout:6/4: chown . 9 1 2024-03-19T06:05:29.900 INFO:tasks.workunit.client.0.smithi072.stdout:2/3: chown f1 1 1 2024-03-19T06:05:29.901 INFO:tasks.workunit.client.0.smithi072.stdout:1/9: rename d1 to d1/d3 22 2024-03-19T06:05:29.902 INFO:tasks.workunit.client.0.smithi072.stdout:4/2: symlink l1 0 2024-03-19T06:05:29.902 INFO:tasks.workunit.client.1.smithi172.stdout:4/472: dread df/d11/d12/f29 [0,4194304] 0 2024-03-19T06:05:29.903 INFO:tasks.workunit.client.1.smithi172.stdout:0/450: mknod d11/c94 0 2024-03-19T06:05:29.903 INFO:tasks.workunit.client.0.smithi072.stdout:2/4: write f1 [906251,34261] 0 2024-03-19T06:05:29.904 INFO:tasks.workunit.client.1.smithi172.stdout:1/490: dwrite da/dd/d10/f24 [0,4194304] 0 2024-03-19T06:05:29.916 INFO:tasks.workunit.client.1.smithi172.stdout:2/401: dread d7/d1b/f1f [0,4194304] 0 2024-03-19T06:05:29.917 INFO:tasks.workunit.client.1.smithi172.stdout:6/532: dwrite d5/d11/d17/d1b/f25 [0,4194304] 0 2024-03-19T06:05:29.917 INFO:tasks.workunit.client.1.smithi172.stdout:5/396: dwrite d5/d55/f5f [0,4194304] 0 2024-03-19T06:05:29.934 INFO:tasks.workunit.client.1.smithi172.stdout:2/402: dwrite d7/de/d58/d56/f39 [0,4194304] 0 2024-03-19T06:05:30.028 INFO:tasks.workunit.client.1.smithi172.stdout:9/426: creat d1/d7/dc/d23/d65/f97 x:0 0 0 2024-03-19T06:05:30.028 INFO:tasks.workunit.client.1.smithi172.stdout:7/393: sync 2024-03-19T06:05:30.032 INFO:tasks.workunit.client.0.smithi072.stdout:4/3: rename l0 to l2 0 2024-03-19T06:05:30.032 INFO:tasks.workunit.client.0.smithi072.stdout:7/0: rename - no filename 2024-03-19T06:05:30.032 INFO:tasks.workunit.client.0.smithi072.stdout:7/1: write - no filename 2024-03-19T06:05:30.032 INFO:tasks.workunit.client.0.smithi072.stdout:7/2: write - no filename 2024-03-19T06:05:30.032 INFO:tasks.workunit.client.0.smithi072.stdout:7/3: dwrite - no filename 2024-03-19T06:05:30.032 INFO:tasks.workunit.client.0.smithi072.stdout:7/4: rmdir - no directory 2024-03-19T06:05:30.032 INFO:tasks.workunit.client.0.smithi072.stdout:7/5: dread - no filename 2024-03-19T06:05:30.032 INFO:tasks.workunit.client.0.smithi072.stdout:7/6: truncate - no filename 2024-03-19T06:05:30.032 INFO:tasks.workunit.client.0.smithi072.stdout:7/7: rename - no filename 2024-03-19T06:05:30.033 INFO:tasks.workunit.client.1.smithi172.stdout:1/491: symlink da/d33/d59/la8 0 2024-03-19T06:05:30.033 INFO:tasks.workunit.client.1.smithi172.stdout:0/451: creat d11/d18/d38/d3f/d43/d62/f95 x:0 0 0 2024-03-19T06:05:30.035 INFO:tasks.workunit.client.0.smithi072.stdout:5/0: creat f0 x:0 0 0 2024-03-19T06:05:30.036 INFO:tasks.workunit.client.0.smithi072.stdout:6/5: getdents . 0 2024-03-19T06:05:30.036 INFO:tasks.workunit.client.0.smithi072.stdout:6/6: unlink - no file 2024-03-19T06:05:30.036 INFO:tasks.workunit.client.0.smithi072.stdout:6/7: dwrite - no filename 2024-03-19T06:05:30.037 INFO:tasks.workunit.client.0.smithi072.stdout:1/10: symlink d1/l4 0 2024-03-19T06:05:30.037 INFO:tasks.workunit.client.0.smithi072.stdout:1/11: dread - no filename 2024-03-19T06:05:30.037 INFO:tasks.workunit.client.0.smithi072.stdout:1/12: read - no filename 2024-03-19T06:05:30.037 INFO:tasks.workunit.client.0.smithi072.stdout:5/1: chown f0 177234 1 2024-03-19T06:05:30.037 INFO:tasks.workunit.client.1.smithi172.stdout:5/397: creat d5/d14/d56/f8c x:0 0 0 2024-03-19T06:05:30.037 INFO:tasks.workunit.client.1.smithi172.stdout:3/435: dread d0/d5/d9/d34/d4d/f4a [0,4194304] 0 2024-03-19T06:05:30.037 INFO:tasks.workunit.client.1.smithi172.stdout:2/403: rename d7/db/c6c to d7/de/d61/c87 0 2024-03-19T06:05:30.038 INFO:tasks.workunit.client.0.smithi072.stdout:1/13: chown d1/l4 180415 1 2024-03-19T06:05:30.038 INFO:tasks.workunit.client.0.smithi072.stdout:1/14: read - no filename 2024-03-19T06:05:30.040 INFO:tasks.workunit.client.1.smithi172.stdout:2/404: write d7/d1b/f69 [1373496,11443] 0 2024-03-19T06:05:30.041 INFO:tasks.workunit.client.0.smithi072.stdout:5/2: mknod c1 0 2024-03-19T06:05:30.041 INFO:tasks.workunit.client.0.smithi072.stdout:4/4: creat f3 x:0 0 0 2024-03-19T06:05:30.043 INFO:tasks.workunit.client.1.smithi172.stdout:4/473: rmdir df/d11/d12/d26/d76 0 2024-03-19T06:05:30.045 INFO:tasks.workunit.client.0.smithi072.stdout:7/8: mkdir d0 0 2024-03-19T06:05:30.047 INFO:tasks.workunit.client.1.smithi172.stdout:5/398: rename d5/d14/d48/f7d to d5/d3d/f8d 0 2024-03-19T06:05:30.048 INFO:tasks.workunit.client.1.smithi172.stdout:1/492: symlink da/dd/la9 0 2024-03-19T06:05:30.048 INFO:tasks.workunit.client.1.smithi172.stdout:4/474: chown df/d11/d12/d26/f43 457 1 2024-03-19T06:05:30.048 INFO:tasks.workunit.client.1.smithi172.stdout:3/436: fdatasync d0/d5/d9/d34/d4d/f31 0 2024-03-19T06:05:30.049 INFO:tasks.workunit.client.0.smithi072.stdout:4/5: mknod c4 0 2024-03-19T06:05:30.053 INFO:tasks.workunit.client.1.smithi172.stdout:0/452: link d11/d14/d2c/d36/c6d d11/d14/d2c/c96 0 2024-03-19T06:05:30.053 INFO:tasks.workunit.client.0.smithi072.stdout:6/8: creat f0 x:0 0 0 2024-03-19T06:05:30.053 INFO:tasks.workunit.client.1.smithi172.stdout:7/394: dwrite d0/d22/d1d/d36/f5e [0,4194304] 0 2024-03-19T06:05:30.055 INFO:tasks.workunit.client.0.smithi072.stdout:1/15: rename d1/l4 to d1/l5 0 2024-03-19T06:05:30.056 INFO:tasks.workunit.client.1.smithi172.stdout:5/399: creat d5/d14/d34/d66/f8e x:0 0 0 2024-03-19T06:05:30.058 INFO:tasks.workunit.client.1.smithi172.stdout:7/395: read - d0/d22/d1d/d3a/d46/f7a zero size 2024-03-19T06:05:30.059 INFO:tasks.workunit.client.0.smithi072.stdout:8/0: symlink l0 0 2024-03-19T06:05:30.059 INFO:tasks.workunit.client.0.smithi072.stdout:4/6: write f3 [949964,55887] 0 2024-03-19T06:05:30.061 INFO:tasks.workunit.client.1.smithi172.stdout:0/453: creat d11/d22/d46/f97 x:0 0 0 2024-03-19T06:05:30.061 INFO:tasks.workunit.client.1.smithi172.stdout:2/405: dread d7/de/d58/d56/f6b [0,4194304] 0 2024-03-19T06:05:30.062 INFO:tasks.workunit.client.0.smithi072.stdout:6/9: mknod c1 0 2024-03-19T06:05:30.062 INFO:tasks.workunit.client.0.smithi072.stdout:6/10: rmdir - no directory 2024-03-19T06:05:30.062 INFO:tasks.workunit.client.1.smithi172.stdout:9/427: dwrite d1/d7/dc/d47/d78/f79 [0,4194304] 0 2024-03-19T06:05:30.065 INFO:tasks.workunit.client.0.smithi072.stdout:7/9: rmdir d0 0 2024-03-19T06:05:30.066 INFO:tasks.workunit.client.0.smithi072.stdout:7/10: chown . 1883 1 2024-03-19T06:05:30.066 INFO:tasks.workunit.client.0.smithi072.stdout:7/11: rename - no filename 2024-03-19T06:05:30.066 INFO:tasks.workunit.client.0.smithi072.stdout:7/12: dwrite - no filename 2024-03-19T06:05:30.067 INFO:tasks.workunit.client.1.smithi172.stdout:1/493: rmdir da/d33/d8f 0 2024-03-19T06:05:30.069 INFO:tasks.workunit.client.0.smithi072.stdout:4/7: mkdir d5 0 2024-03-19T06:05:30.069 INFO:tasks.workunit.client.0.smithi072.stdout:1/16: creat d1/f6 x:0 0 0 2024-03-19T06:05:30.073 INFO:tasks.workunit.client.1.smithi172.stdout:6/533: truncate d5/d8f/d31/d3d/f54 2372458 0 2024-03-19T06:05:30.074 INFO:tasks.workunit.client.0.smithi072.stdout:8/1: creat f1 x:0 0 0 2024-03-19T06:05:30.075 INFO:tasks.workunit.client.1.smithi172.stdout:6/534: chown d5/d11/d43 123887767 1 2024-03-19T06:05:30.075 INFO:tasks.workunit.client.1.smithi172.stdout:7/396: symlink d0/d22/d3d/d41/d42/d5c/d67/l8c 0 2024-03-19T06:05:30.076 INFO:tasks.workunit.client.0.smithi072.stdout:6/11: creat f2 x:0 0 0 2024-03-19T06:05:30.077 INFO:tasks.workunit.client.0.smithi072.stdout:6/12: readlink - no filename 2024-03-19T06:05:30.077 INFO:tasks.workunit.client.0.smithi072.stdout:9/0: symlink l0 0 2024-03-19T06:05:30.077 INFO:tasks.workunit.client.0.smithi072.stdout:8/2: stat l0 0 2024-03-19T06:05:30.078 INFO:tasks.workunit.client.1.smithi172.stdout:4/475: dwrite df/f3d [0,4194304] 0 2024-03-19T06:05:30.078 INFO:tasks.workunit.client.0.smithi072.stdout:7/13: creat f1 x:0 0 0 2024-03-19T06:05:30.078 INFO:tasks.workunit.client.1.smithi172.stdout:7/397: write d0/d22/f1e [6787983,98370] 0 2024-03-19T06:05:30.080 INFO:tasks.workunit.client.1.smithi172.stdout:4/476: chown df/d11/d12/d26/f35 1 1 2024-03-19T06:05:30.082 INFO:tasks.workunit.client.1.smithi172.stdout:0/454: rename d11/d18/f21 to d11/d22/d46/f98 0 2024-03-19T06:05:30.083 INFO:tasks.workunit.client.0.smithi072.stdout:6/13: chown f0 20 1 2024-03-19T06:05:30.084 INFO:tasks.workunit.client.0.smithi072.stdout:3/1: dwrite f0 [0,4194304] 0 2024-03-19T06:05:30.084 INFO:tasks.workunit.client.0.smithi072.stdout:4/8: creat d5/f6 x:0 0 0 2024-03-19T06:05:30.085 INFO:tasks.workunit.client.0.smithi072.stdout:9/1: chown l0 194572948 1 2024-03-19T06:05:30.085 INFO:tasks.workunit.client.0.smithi072.stdout:9/2: fdatasync - no filename 2024-03-19T06:05:30.085 INFO:tasks.workunit.client.0.smithi072.stdout:9/3: dwrite - no filename 2024-03-19T06:05:30.085 INFO:tasks.workunit.client.1.smithi172.stdout:9/428: unlink d1/d7/dc/d23/f62 0 2024-03-19T06:05:30.086 INFO:tasks.workunit.client.0.smithi072.stdout:8/3: read - f1 zero size 2024-03-19T06:05:30.087 INFO:tasks.workunit.client.1.smithi172.stdout:3/437: getdents d0/d5/d9/d54 0 2024-03-19T06:05:30.087 INFO:tasks.workunit.client.0.smithi072.stdout:2/5: dwrite f1 [0,4194304] 0 2024-03-19T06:05:30.088 INFO:tasks.workunit.client.0.smithi072.stdout:2/6: rmdir - no directory 2024-03-19T06:05:30.089 INFO:tasks.workunit.client.0.smithi072.stdout:3/2: stat f0 0 2024-03-19T06:05:30.090 INFO:tasks.workunit.client.1.smithi172.stdout:3/438: write d0/d5/d9/d60/d67/f84 [649482,108873] 0 2024-03-19T06:05:30.093 INFO:tasks.workunit.client.1.smithi172.stdout:5/400: write d5/f18 [3212066,22023] 0 2024-03-19T06:05:30.094 INFO:tasks.workunit.client.0.smithi072.stdout:4/9: mknod d5/c7 0 2024-03-19T06:05:30.094 INFO:tasks.workunit.client.0.smithi072.stdout:7/14: write f1 [558730,116233] 0 2024-03-19T06:05:30.094 INFO:tasks.workunit.client.0.smithi072.stdout:8/4: dread - f1 zero size 2024-03-19T06:05:30.096 INFO:tasks.workunit.client.1.smithi172.stdout:6/535: symlink d5/d11/d43/la9 0 2024-03-19T06:05:30.096 INFO:tasks.workunit.client.0.smithi072.stdout:6/14: truncate f0 452294 0 2024-03-19T06:05:30.097 INFO:tasks.workunit.client.1.smithi172.stdout:5/401: write d5/d14/d15/f4c [642485,4423] 0 2024-03-19T06:05:30.098 INFO:tasks.workunit.client.0.smithi072.stdout:2/7: symlink l2 0 2024-03-19T06:05:30.099 INFO:tasks.workunit.client.1.smithi172.stdout:6/536: write d5/f8 [5086383,28748] 0 2024-03-19T06:05:30.099 INFO:tasks.workunit.client.1.smithi172.stdout:4/477: rmdir df/d45 39 2024-03-19T06:05:30.101 INFO:tasks.workunit.client.0.smithi072.stdout:9/4: creat f1 x:0 0 0 2024-03-19T06:05:30.103 INFO:tasks.workunit.client.1.smithi172.stdout:2/406: creat d7/db/d45/f88 x:0 0 0 2024-03-19T06:05:30.103 INFO:tasks.workunit.client.0.smithi072.stdout:7/15: mkdir d2 0 2024-03-19T06:05:30.104 INFO:tasks.workunit.client.0.smithi072.stdout:8/5: rename l0 to l2 0 2024-03-19T06:05:30.105 INFO:tasks.workunit.client.0.smithi072.stdout:6/15: rename f2 to f3 0 2024-03-19T06:05:30.106 INFO:tasks.workunit.client.0.smithi072.stdout:7/16: write f1 [883071,107026] 0 2024-03-19T06:05:30.111 INFO:tasks.workunit.client.0.smithi072.stdout:6/16: rename f0 to f4 0 2024-03-19T06:05:30.115 INFO:tasks.workunit.client.0.smithi072.stdout:3/3: dread f0 [0,4194304] 0 2024-03-19T06:05:30.115 INFO:tasks.workunit.client.0.smithi072.stdout:3/4: rmdir - no directory 2024-03-19T06:05:30.116 INFO:tasks.workunit.client.1.smithi172.stdout:5/402: unlink d5/f67 0 2024-03-19T06:05:30.117 INFO:tasks.workunit.client.1.smithi172.stdout:1/494: dread da/dd/d10/d14/d27/f32 [0,4194304] 0 2024-03-19T06:05:30.118 INFO:tasks.workunit.client.0.smithi072.stdout:6/17: write f4 [612861,36097] 0 2024-03-19T06:05:30.119 INFO:tasks.workunit.client.0.smithi072.stdout:7/17: mkdir d2/d3 0 2024-03-19T06:05:30.122 INFO:tasks.workunit.client.0.smithi072.stdout:3/5: creat f1 x:0 0 0 2024-03-19T06:05:30.123 INFO:tasks.workunit.client.0.smithi072.stdout:6/18: symlink l5 0 2024-03-19T06:05:30.124 INFO:tasks.workunit.client.1.smithi172.stdout:4/478: unlink df/d2b/d44/d67/f72 0 2024-03-19T06:05:30.124 INFO:tasks.workunit.client.1.smithi172.stdout:1/495: readlink da/d33/d4e/l56 0 2024-03-19T06:05:30.125 INFO:tasks.workunit.client.0.smithi072.stdout:7/18: creat d2/f4 x:0 0 0 2024-03-19T06:05:30.126 INFO:tasks.workunit.client.0.smithi072.stdout:7/19: dread - d2/f4 zero size 2024-03-19T06:05:30.127 INFO:tasks.workunit.client.0.smithi072.stdout:3/6: mkdir d2 0 2024-03-19T06:05:30.128 INFO:tasks.workunit.client.0.smithi072.stdout:3/7: stat f0 0 2024-03-19T06:05:30.129 INFO:tasks.workunit.client.0.smithi072.stdout:6/19: creat f6 x:0 0 0 2024-03-19T06:05:30.130 INFO:tasks.workunit.client.1.smithi172.stdout:9/429: creat d1/d7/dc/de/d34/d48/d89/f98 x:0 0 0 2024-03-19T06:05:30.130 INFO:tasks.workunit.client.1.smithi172.stdout:3/439: dwrite d0/d5/f26 [0,4194304] 0 2024-03-19T06:05:30.133 INFO:tasks.workunit.client.1.smithi172.stdout:6/537: dread d5/f19 [0,4194304] 0 2024-03-19T06:05:30.136 INFO:tasks.workunit.client.1.smithi172.stdout:0/455: truncate d11/d14/f4b 438556 0 2024-03-19T06:05:30.136 INFO:tasks.workunit.client.0.smithi072.stdout:6/20: mkdir d7 0 2024-03-19T06:05:30.138 INFO:tasks.workunit.client.0.smithi072.stdout:7/20: dread f1 [0,4194304] 0 2024-03-19T06:05:30.139 INFO:tasks.workunit.client.0.smithi072.stdout:3/8: mkdir d2/d3 0 2024-03-19T06:05:30.141 INFO:tasks.workunit.client.0.smithi072.stdout:3/9: chown f1 40 1 2024-03-19T06:05:30.141 INFO:tasks.workunit.client.0.smithi072.stdout:6/21: creat d7/f8 x:0 0 0 2024-03-19T06:05:30.143 INFO:tasks.workunit.client.1.smithi172.stdout:5/403: mknod d5/d1f/d2f/c8f 0 2024-03-19T06:05:30.144 INFO:tasks.workunit.client.1.smithi172.stdout:1/496: getdents da/d3b/d95 0 2024-03-19T06:05:30.145 INFO:tasks.workunit.client.0.smithi072.stdout:3/10: mknod d2/c4 0 2024-03-19T06:05:30.146 INFO:tasks.workunit.client.1.smithi172.stdout:6/538: creat d5/d11/d17/d1b/d74/faa x:0 0 0 2024-03-19T06:05:30.150 INFO:tasks.workunit.client.1.smithi172.stdout:4/479: unlink df/d45/c7f 0 2024-03-19T06:05:30.153 INFO:tasks.workunit.client.1.smithi172.stdout:6/539: write d5/d11/d17/d1b/d74/fa2 [721266,44572] 0 2024-03-19T06:05:30.157 INFO:tasks.workunit.client.1.smithi172.stdout:6/540: chown d5/d11/d35/d40/d53/l58 1075165 1 2024-03-19T06:05:30.158 INFO:tasks.workunit.client.1.smithi172.stdout:4/480: unlink df/d45/c5a 0 2024-03-19T06:05:30.158 INFO:tasks.workunit.client.1.smithi172.stdout:3/440: dwrite d0/d5/d9/d3a/f86 [0,4194304] 0 2024-03-19T06:05:30.160 INFO:tasks.workunit.client.1.smithi172.stdout:8/391: sync 2024-03-19T06:05:30.160 INFO:tasks.workunit.client.1.smithi172.stdout:2/407: write d7/db/f13 [3063402,129344] 0 2024-03-19T06:05:30.161 INFO:tasks.workunit.client.1.smithi172.stdout:5/404: link c3 d5/d14/d15/d40/d5c/c90 0 2024-03-19T06:05:30.162 INFO:tasks.workunit.client.1.smithi172.stdout:9/430: truncate d1/f9 2478043 0 2024-03-19T06:05:30.163 INFO:tasks.workunit.client.1.smithi172.stdout:5/405: readlink d5/d55/l7f 0 2024-03-19T06:05:30.164 INFO:tasks.workunit.client.1.smithi172.stdout:0/456: write d11/d18/d38/d3f/d43/f7f [382043,71658] 0 2024-03-19T06:05:30.165 INFO:tasks.workunit.client.1.smithi172.stdout:4/481: creat df/d11/d12/d21/d58/d65/f9f x:0 0 0 2024-03-19T06:05:30.166 INFO:tasks.workunit.client.1.smithi172.stdout:9/431: chown d1/d7/dc/d47/f61 1400 1 2024-03-19T06:05:30.169 INFO:tasks.workunit.client.1.smithi172.stdout:8/392: creat d0/d44/d46/d49/d26/f7b x:0 0 0 2024-03-19T06:05:30.172 INFO:tasks.workunit.client.1.smithi172.stdout:2/408: rmdir d7/de/d58 39 2024-03-19T06:05:30.173 INFO:tasks.workunit.client.1.smithi172.stdout:6/541: creat d5/d11/fab x:0 0 0 2024-03-19T06:05:30.177 INFO:tasks.workunit.client.1.smithi172.stdout:4/482: unlink df/d11/d12/d21/d58/d65/f9f 0 2024-03-19T06:05:30.179 INFO:tasks.workunit.client.0.smithi072.stdout:7/21: dwrite f1 [0,4194304] 0 2024-03-19T06:05:30.180 INFO:tasks.workunit.client.0.smithi072.stdout:7/22: stat d2/f4 0 2024-03-19T06:05:30.183 INFO:tasks.workunit.client.1.smithi172.stdout:7/398: sync 2024-03-19T06:05:30.184 INFO:tasks.workunit.client.0.smithi072.stdout:3/11: dwrite f1 [0,4194304] 0 2024-03-19T06:05:30.185 INFO:tasks.workunit.client.1.smithi172.stdout:0/457: creat d11/d14/d2c/d8d/f99 x:0 0 0 2024-03-19T06:05:30.187 INFO:tasks.workunit.client.0.smithi072.stdout:7/23: unlink f1 0 2024-03-19T06:05:30.187 INFO:tasks.workunit.client.1.smithi172.stdout:8/393: creat d0/d44/d46/d49/d4f/d5c/f7c x:0 0 0 2024-03-19T06:05:30.188 INFO:tasks.workunit.client.1.smithi172.stdout:2/409: mkdir d7/de/d58/d56/d89 0 2024-03-19T06:05:30.189 INFO:tasks.workunit.client.1.smithi172.stdout:4/483: chown df/d11/d12/d21/d50/f5f 0 1 2024-03-19T06:05:30.193 INFO:tasks.workunit.client.0.smithi072.stdout:3/12: creat d2/f5 x:0 0 0 2024-03-19T06:05:30.195 INFO:tasks.workunit.client.1.smithi172.stdout:4/484: read - df/d2b/d2d/f6b zero size 2024-03-19T06:05:30.195 INFO:tasks.workunit.client.1.smithi172.stdout:7/399: truncate d0/d22/d1d/f32 1465024 0 2024-03-19T06:05:30.196 INFO:tasks.workunit.client.0.smithi072.stdout:7/24: mkdir d2/d5 0 2024-03-19T06:05:30.198 INFO:tasks.workunit.client.1.smithi172.stdout:3/441: dwrite d0/d5/d9/d54/f70 [4194304,4194304] 0 2024-03-19T06:05:30.200 INFO:tasks.workunit.client.1.smithi172.stdout:7/400: fdatasync d0/d22/d1d/d36/d40/f4e 0 2024-03-19T06:05:30.201 INFO:tasks.workunit.client.1.smithi172.stdout:8/394: chown d0/d44/d46/d49/d26/d2f/f45 206698 1 2024-03-19T06:05:30.201 INFO:tasks.workunit.client.1.smithi172.stdout:0/458: readlink d11/d14/d2c/l54 0 2024-03-19T06:05:30.203 INFO:tasks.workunit.client.1.smithi172.stdout:4/485: stat df/d11/d12/d69 0 2024-03-19T06:05:30.205 INFO:tasks.workunit.client.1.smithi172.stdout:5/406: getdents d5/d14/d15 0 2024-03-19T06:05:30.209 INFO:tasks.workunit.client.1.smithi172.stdout:1/497: dread da/dd/d10/f1d [0,4194304] 0 2024-03-19T06:05:30.209 INFO:tasks.workunit.client.1.smithi172.stdout:2/410: mknod d7/de/d58/d57/c8a 0 2024-03-19T06:05:30.211 INFO:tasks.workunit.client.1.smithi172.stdout:8/395: truncate d0/d10/f56 1078918 0 2024-03-19T06:05:30.215 INFO:tasks.workunit.client.1.smithi172.stdout:7/401: write d0/d22/d1d/d36/d40/f4e [4605432,114201] 0 2024-03-19T06:05:30.217 INFO:tasks.workunit.client.1.smithi172.stdout:5/407: mkdir d5/d55/d91 0 2024-03-19T06:05:30.220 INFO:tasks.workunit.client.1.smithi172.stdout:6/542: dread d5/d11/d17/f3e [0,4194304] 0 2024-03-19T06:05:30.222 INFO:tasks.workunit.client.1.smithi172.stdout:3/442: creat d0/d5/d9/d54/d77/f99 x:0 0 0 2024-03-19T06:05:30.222 INFO:tasks.workunit.client.1.smithi172.stdout:0/459: mkdir d11/d14/d9a 0 2024-03-19T06:05:30.225 INFO:tasks.workunit.client.1.smithi172.stdout:5/408: truncate d5/f16 1601769 0 2024-03-19T06:05:30.227 INFO:tasks.workunit.client.0.smithi072.stdout:3/13: dwrite f1 [0,4194304] 0 2024-03-19T06:05:30.228 INFO:tasks.workunit.client.0.smithi072.stdout:7/25: dwrite d2/f4 [0,4194304] 0 2024-03-19T06:05:30.228 INFO:tasks.workunit.client.1.smithi172.stdout:4/486: dread df/d11/d12/d21/d50/f54 [0,4194304] 0 2024-03-19T06:05:30.230 INFO:tasks.workunit.client.0.smithi072.stdout:3/14: truncate d2/f5 825383 0 2024-03-19T06:05:30.235 INFO:tasks.workunit.client.1.smithi172.stdout:9/432: dwrite d1/d7/dc/d47/f53 [0,4194304] 0 2024-03-19T06:05:30.239 INFO:tasks.workunit.client.1.smithi172.stdout:4/487: mknod df/d11/d12/d21/d50/ca0 0 2024-03-19T06:05:30.240 INFO:tasks.workunit.client.1.smithi172.stdout:9/433: readlink d1/d7/dc/d47/d78/d54/d91/l44 0 2024-03-19T06:05:30.242 INFO:tasks.workunit.client.1.smithi172.stdout:6/543: mkdir d5/d8f/d31/d3d/d98/dac 0 2024-03-19T06:05:30.245 INFO:tasks.workunit.client.0.smithi072.stdout:7/26: creat d2/d5/f6 x:0 0 0 2024-03-19T06:05:30.246 INFO:tasks.workunit.client.0.smithi072.stdout:3/15: creat d2/d3/f6 x:0 0 0 2024-03-19T06:05:30.249 INFO:tasks.workunit.client.1.smithi172.stdout:7/402: rename d0/d22/d3d/d41/d42 to d0/d22/d1d/d36/d8d 0 2024-03-19T06:05:30.251 INFO:tasks.workunit.client.1.smithi172.stdout:4/488: readlink df/d11/d12/l9a 0 2024-03-19T06:05:30.254 INFO:tasks.workunit.client.1.smithi172.stdout:6/544: chown d5/d11/d17/d1b/d74/c80 114315 1 2024-03-19T06:05:30.254 INFO:tasks.workunit.client.1.smithi172.stdout:5/409: link d5/d14/d15/d40/d5c/l71 d5/d14/d15/l92 0 2024-03-19T06:05:30.259 INFO:tasks.workunit.client.1.smithi172.stdout:8/396: dwrite d0/f2d [0,4194304] 0 2024-03-19T06:05:30.260 INFO:tasks.workunit.client.1.smithi172.stdout:7/403: chown d0/d22/d1d/f4c 37 1 2024-03-19T06:05:30.261 INFO:tasks.workunit.client.0.smithi072.stdout:3/16: dread f1 [0,4194304] 0 2024-03-19T06:05:30.261 INFO:tasks.workunit.client.0.smithi072.stdout:7/27: dread d2/f4 [0,4194304] 0 2024-03-19T06:05:30.264 INFO:tasks.workunit.client.1.smithi172.stdout:2/411: dwrite d7/de/d58/d55/d5f/d6a/f7f [0,4194304] 0 2024-03-19T06:05:30.264 INFO:tasks.workunit.client.1.smithi172.stdout:5/410: write d5/f58 [128134,96957] 0 2024-03-19T06:05:30.265 INFO:tasks.workunit.client.1.smithi172.stdout:8/397: chown d0/ca 11666910 1 2024-03-19T06:05:30.265 INFO:tasks.workunit.client.1.smithi172.stdout:3/443: truncate d0/d5/d14/f17 3374979 0 2024-03-19T06:05:30.266 INFO:tasks.workunit.client.0.smithi072.stdout:7/28: creat d2/d5/f7 x:0 0 0 2024-03-19T06:05:30.267 INFO:tasks.workunit.client.0.smithi072.stdout:7/29: stat d2/d3 0 2024-03-19T06:05:30.270 INFO:tasks.workunit.client.1.smithi172.stdout:4/489: mknod df/d11/d12/d21/d58/d60/ca1 0 2024-03-19T06:05:30.270 INFO:tasks.workunit.client.1.smithi172.stdout:6/545: mkdir d5/d8f/d31/d3d/d98/dad 0 2024-03-19T06:05:30.271 INFO:tasks.workunit.client.1.smithi172.stdout:0/460: dwrite d11/d18/d38/f8f [0,4194304] 0 2024-03-19T06:05:30.275 INFO:tasks.workunit.client.1.smithi172.stdout:8/398: mknod d0/d44/c7d 0 2024-03-19T06:05:30.277 INFO:tasks.workunit.client.0.smithi072.stdout:7/30: mknod d2/d3/c8 0 2024-03-19T06:05:30.279 INFO:tasks.workunit.client.1.smithi172.stdout:7/404: fsync d0/d22/d3d/f64 0 2024-03-19T06:05:30.280 INFO:tasks.workunit.client.1.smithi172.stdout:5/411: unlink d5/c11 0 2024-03-19T06:05:30.283 INFO:tasks.workunit.client.0.smithi072.stdout:7/31: chown d2/d3/c8 12168677 1 2024-03-19T06:05:30.283 INFO:tasks.workunit.client.1.smithi172.stdout:8/399: write d0/d10/d27/d29/d59/f4b [603661,102876] 0 2024-03-19T06:05:30.286 INFO:tasks.workunit.client.1.smithi172.stdout:4/490: mkdir df/d11/d12/d26/d84/da2 0 2024-03-19T06:05:30.286 INFO:tasks.workunit.client.0.smithi072.stdout:3/17: dwrite d2/f5 [0,4194304] 0 2024-03-19T06:05:30.287 INFO:tasks.workunit.client.1.smithi172.stdout:8/400: write d0/f2d [4565387,121015] 0 2024-03-19T06:05:30.288 INFO:tasks.workunit.client.0.smithi072.stdout:7/32: write d2/d5/f6 [295444,26485] 0 2024-03-19T06:05:30.290 INFO:tasks.workunit.client.1.smithi172.stdout:2/412: getdents d7/db 0 2024-03-19T06:05:30.292 INFO:tasks.workunit.client.0.smithi072.stdout:7/33: dread - d2/d5/f7 zero size 2024-03-19T06:05:30.294 INFO:tasks.workunit.client.0.smithi072.stdout:7/34: write d2/d5/f7 [195588,19839] 0 2024-03-19T06:05:30.294 INFO:tasks.workunit.client.0.smithi072.stdout:7/35: chown d2 28116605 1 2024-03-19T06:05:30.295 INFO:tasks.workunit.client.1.smithi172.stdout:4/491: chown f8 0 1 2024-03-19T06:05:30.295 INFO:tasks.workunit.client.1.smithi172.stdout:8/401: read d0/d10/d27/d29/f32 [5392027,30149] 0 2024-03-19T06:05:30.299 INFO:tasks.workunit.client.0.smithi072.stdout:7/36: rmdir d2/d3 39 2024-03-19T06:05:30.301 INFO:tasks.workunit.client.1.smithi172.stdout:4/492: fsync df/d2b/d2d/f73 0 2024-03-19T06:05:30.305 INFO:tasks.workunit.client.1.smithi172.stdout:3/444: dwrite d0/d5/d9/d3a/f7b [0,4194304] 0 2024-03-19T06:05:30.306 INFO:tasks.workunit.client.1.smithi172.stdout:9/434: write d1/d7/dc/d47/d78/d54/d91/f35 [159120,54817] 0 2024-03-19T06:05:30.307 INFO:tasks.workunit.client.0.smithi072.stdout:7/37: dread d2/d5/f7 [0,4194304] 0 2024-03-19T06:05:30.307 INFO:tasks.workunit.client.1.smithi172.stdout:8/402: read d0/d10/d27/d29/f33 [739107,18349] 0 2024-03-19T06:05:30.309 INFO:tasks.workunit.client.0.smithi072.stdout:7/38: chown d2/d5/f7 3141 1 2024-03-19T06:05:30.313 INFO:tasks.workunit.client.1.smithi172.stdout:5/412: getdents d5/d3c 0 2024-03-19T06:05:30.313 INFO:tasks.workunit.client.1.smithi172.stdout:3/445: creat d0/d5/d9/d25/f9a x:0 0 0 2024-03-19T06:05:30.318 INFO:tasks.workunit.client.0.smithi072.stdout:7/39: creat d2/d5/f9 x:0 0 0 2024-03-19T06:05:30.322 INFO:tasks.workunit.client.1.smithi172.stdout:6/546: dwrite d5/d8f/d31/f57 [0,4194304] 0 2024-03-19T06:05:30.324 INFO:tasks.workunit.client.1.smithi172.stdout:8/403: mkdir d0/d61/d6a/d7e 0 2024-03-19T06:05:30.327 INFO:tasks.workunit.client.1.smithi172.stdout:3/446: symlink d0/d5/d9/d60/l9b 0 2024-03-19T06:05:30.327 INFO:tasks.workunit.client.1.smithi172.stdout:7/405: write d0/d2c/f30 [86810,68282] 0 2024-03-19T06:05:30.338 INFO:tasks.workunit.client.1.smithi172.stdout:7/406: mkdir d0/d22/d35/d8e 0 2024-03-19T06:05:30.338 INFO:tasks.workunit.client.1.smithi172.stdout:8/404: creat d0/d61/d6a/d7e/f7f x:0 0 0 2024-03-19T06:05:30.342 INFO:tasks.workunit.client.1.smithi172.stdout:3/447: creat d0/d5/d9/d54/d90/f9c x:0 0 0 2024-03-19T06:05:30.353 INFO:tasks.workunit.client.0.smithi072.stdout:4/10: chown l2 6 1 2024-03-19T06:05:30.354 INFO:tasks.workunit.client.0.smithi072.stdout:5/3: getdents . 0 2024-03-19T06:05:30.354 INFO:tasks.workunit.client.1.smithi172.stdout:2/413: dwrite d7/f8 [8388608,4194304] 0 2024-03-19T06:05:30.355 INFO:tasks.workunit.client.0.smithi072.stdout:5/4: read - f0 zero size 2024-03-19T06:05:30.355 INFO:tasks.workunit.client.0.smithi072.stdout:4/11: creat d5/f8 x:0 0 0 2024-03-19T06:05:30.356 INFO:tasks.workunit.client.0.smithi072.stdout:5/5: write f0 [929056,27083] 0 2024-03-19T06:05:30.357 INFO:tasks.workunit.client.0.smithi072.stdout:4/12: write f3 [1678593,55079] 0 2024-03-19T06:05:30.357 INFO:tasks.workunit.client.1.smithi172.stdout:3/448: fsync d0/d5/d9/d60/d67/f84 0 2024-03-19T06:05:30.358 INFO:tasks.workunit.client.1.smithi172.stdout:2/414: write d7/f26 [64691,78783] 0 2024-03-19T06:05:30.361 INFO:tasks.workunit.client.1.smithi172.stdout:4/493: dwrite df/d11/d12/d26/f30 [0,4194304] 0 2024-03-19T06:05:30.362 INFO:tasks.workunit.client.1.smithi172.stdout:5/413: write d5/d14/d56/f8c [198257,49980] 0 2024-03-19T06:05:30.362 INFO:tasks.workunit.client.0.smithi072.stdout:5/6: symlink l2 0 2024-03-19T06:05:30.363 INFO:tasks.workunit.client.1.smithi172.stdout:8/405: rename d0/d44/d46/d49/d26/d2f to d0/d64/d80 0 2024-03-19T06:05:30.365 INFO:tasks.workunit.client.1.smithi172.stdout:7/407: unlink d0/d22/d1d/d36/d56/l61 0 2024-03-19T06:05:30.367 INFO:tasks.workunit.client.0.smithi072.stdout:4/13: creat d5/f9 x:0 0 0 2024-03-19T06:05:30.368 INFO:tasks.workunit.client.0.smithi072.stdout:1/17: rmdir d1 39 2024-03-19T06:05:30.369 INFO:tasks.workunit.client.1.smithi172.stdout:9/435: dwrite d1/d7/dc/d47/d78/d57/f74 [4194304,4194304] 0 2024-03-19T06:05:30.370 INFO:tasks.workunit.client.0.smithi072.stdout:4/14: write d5/f8 [953954,130478] 0 2024-03-19T06:05:30.370 INFO:tasks.workunit.client.1.smithi172.stdout:7/408: dread - d0/f7c zero size 2024-03-19T06:05:30.371 INFO:tasks.workunit.client.1.smithi172.stdout:2/415: chown d7/de/d58/d56/f34 1403 1 2024-03-19T06:05:30.374 INFO:tasks.workunit.client.1.smithi172.stdout:8/406: truncate d0/d44/f79 385705 0 2024-03-19T06:05:30.377 INFO:tasks.workunit.client.0.smithi072.stdout:5/7: dread f0 [0,4194304] 0 2024-03-19T06:05:30.378 INFO:tasks.workunit.client.0.smithi072.stdout:1/18: write d1/f6 [814401,55855] 0 2024-03-19T06:05:30.379 INFO:tasks.workunit.client.1.smithi172.stdout:5/414: creat d5/d3c/d6c/f93 x:0 0 0 2024-03-19T06:05:30.379 INFO:tasks.workunit.client.1.smithi172.stdout:4/494: dread df/d2b/d44/d67/f5d [0,4194304] 0 2024-03-19T06:05:30.381 INFO:tasks.workunit.client.0.smithi072.stdout:9/5: fsync f1 0 2024-03-19T06:05:30.382 INFO:tasks.workunit.client.0.smithi072.stdout:9/6: stat f1 0 2024-03-19T06:05:30.384 INFO:tasks.workunit.client.1.smithi172.stdout:8/407: write d0/d10/d27/d29/d28/d55/f5a [2965721,105492] 0 2024-03-19T06:05:30.384 INFO:tasks.workunit.client.1.smithi172.stdout:7/409: mknod d0/d22/d1d/d3a/c8f 0 2024-03-19T06:05:30.386 INFO:tasks.workunit.client.0.smithi072.stdout:8/6: unlink l2 0 2024-03-19T06:05:30.386 INFO:tasks.workunit.client.1.smithi172.stdout:2/416: chown d7/de/c2e 16 1 2024-03-19T06:05:30.387 INFO:tasks.workunit.client.0.smithi072.stdout:8/7: write f1 [365062,47180] 0 2024-03-19T06:05:30.388 INFO:tasks.workunit.client.1.smithi172.stdout:7/410: chown d0/d22/f1e 873 1 2024-03-19T06:05:30.388 INFO:tasks.workunit.client.1.smithi172.stdout:5/415: creat d5/d14/d34/f94 x:0 0 0 2024-03-19T06:05:30.390 INFO:tasks.workunit.client.0.smithi072.stdout:6/22: fsync d7/f8 0 2024-03-19T06:05:30.391 INFO:tasks.workunit.client.1.smithi172.stdout:1/498: sync 2024-03-19T06:05:30.392 INFO:tasks.workunit.client.1.smithi172.stdout:6/547: dread d5/d8f/d31/f67 [0,4194304] 0 2024-03-19T06:05:30.395 INFO:tasks.workunit.client.0.smithi072.stdout:1/19: rename d1/l5 to d1/l7 0 2024-03-19T06:05:30.396 INFO:tasks.workunit.client.0.smithi072.stdout:6/23: read f4 [69101,81405] 0 2024-03-19T06:05:30.397 INFO:tasks.workunit.client.1.smithi172.stdout:2/417: mknod d7/de/d58/d56/d86/c8b 0 2024-03-19T06:05:30.399 INFO:tasks.workunit.client.1.smithi172.stdout:9/436: rename d1/d7/dc/de/d34/d48/f7b to d1/d7/dc/f99 0 2024-03-19T06:05:30.400 INFO:tasks.workunit.client.1.smithi172.stdout:6/548: mknod d5/d11/d2f/cae 0 2024-03-19T06:05:30.405 INFO:tasks.workunit.client.1.smithi172.stdout:3/449: dwrite d0/d5/d9/d60/d67/f73 [0,4194304] 0 2024-03-19T06:05:30.405 INFO:tasks.workunit.client.1.smithi172.stdout:2/418: creat d7/d4c/f8c x:0 0 0 2024-03-19T06:05:30.405 INFO:tasks.workunit.client.1.smithi172.stdout:1/499: creat da/d3b/d95/faa x:0 0 0 2024-03-19T06:05:30.406 INFO:tasks.workunit.client.0.smithi072.stdout:3/18: rmdir d2 39 2024-03-19T06:05:30.406 INFO:tasks.workunit.client.0.smithi072.stdout:6/24: truncate f4 656328 0 2024-03-19T06:05:30.410 INFO:tasks.workunit.client.1.smithi172.stdout:2/419: fdatasync d7/de/d58/d56/f46 0 2024-03-19T06:05:30.411 INFO:tasks.workunit.client.1.smithi172.stdout:5/416: link d5/d14/f83 d5/d3d/d60/f95 0 2024-03-19T06:05:30.412 INFO:tasks.workunit.client.1.smithi172.stdout:4/495: dwrite df/f2e [0,4194304] 0 2024-03-19T06:05:30.414 INFO:tasks.workunit.client.1.smithi172.stdout:1/500: chown da/dd/d10/d36/l6a 129378 1 2024-03-19T06:05:30.417 INFO:tasks.workunit.client.1.smithi172.stdout:2/420: write d7/de/d58/d56/f85 [107071,126504] 0 2024-03-19T06:05:30.419 INFO:tasks.workunit.client.1.smithi172.stdout:6/549: rename d5/d11/d35/d40/f8b to d5/d11/d43/faf 0 2024-03-19T06:05:30.421 INFO:tasks.workunit.client.0.smithi072.stdout:4/15: rmdir d5 39 2024-03-19T06:05:30.429 INFO:tasks.workunit.client.0.smithi072.stdout:3/19: symlink d2/l7 0 2024-03-19T06:05:30.429 INFO:tasks.workunit.client.1.smithi172.stdout:1/501: unlink da/d33/d78/la6 0 2024-03-19T06:05:30.429 INFO:tasks.workunit.client.1.smithi172.stdout:4/496: mkdir df/d2b/da3 0 2024-03-19T06:05:30.435 INFO:tasks.workunit.client.0.smithi072.stdout:5/8: dwrite f0 [0,4194304] 0 2024-03-19T06:05:30.435 INFO:tasks.workunit.client.1.smithi172.stdout:0/461: sync 2024-03-19T06:05:30.437 INFO:tasks.workunit.client.1.smithi172.stdout:7/411: truncate d0/d22/d1d/d36/f54 1515278 0 2024-03-19T06:05:30.439 INFO:tasks.workunit.client.0.smithi072.stdout:5/9: readlink l2 0 2024-03-19T06:05:30.439 INFO:tasks.workunit.client.0.smithi072.stdout:3/20: chown d2/f5 11686823 1 2024-03-19T06:05:30.439 INFO:tasks.workunit.client.1.smithi172.stdout:4/497: unlink df/d2b/f53 0 2024-03-19T06:05:30.440 INFO:tasks.workunit.client.1.smithi172.stdout:8/408: dread d0/f1f [0,4194304] 0 2024-03-19T06:05:30.441 INFO:tasks.workunit.client.0.smithi072.stdout:1/20: chown d1/l7 3 1 2024-03-19T06:05:30.441 INFO:tasks.workunit.client.0.smithi072.stdout:9/7: dwrite f1 [0,4194304] 0 2024-03-19T06:05:30.442 INFO:tasks.workunit.client.0.smithi072.stdout:3/21: readlink d2/l7 0 2024-03-19T06:05:30.442 INFO:tasks.workunit.client.0.smithi072.stdout:1/21: readlink d1/l7 0 2024-03-19T06:05:30.443 INFO:tasks.workunit.client.1.smithi172.stdout:1/502: mkdir da/dd/d10/d14/d27/d3f/d5e/dab 0 2024-03-19T06:05:30.444 INFO:tasks.workunit.client.0.smithi072.stdout:5/10: write f0 [2336485,49458] 0 2024-03-19T06:05:30.444 INFO:tasks.workunit.client.0.smithi072.stdout:8/8: dwrite f1 [0,4194304] 0 2024-03-19T06:05:30.446 INFO:tasks.workunit.client.0.smithi072.stdout:4/16: getdents d5 0 2024-03-19T06:05:30.448 INFO:tasks.workunit.client.0.smithi072.stdout:9/8: write f1 [3704327,78245] 0 2024-03-19T06:05:30.450 INFO:tasks.workunit.client.0.smithi072.stdout:1/22: symlink d1/l8 0 2024-03-19T06:05:30.451 INFO:tasks.workunit.client.0.smithi072.stdout:9/9: write f1 [703238,129617] 0 2024-03-19T06:05:30.453 INFO:tasks.workunit.client.0.smithi072.stdout:1/23: write d1/f6 [1775479,36618] 0 2024-03-19T06:05:30.453 INFO:tasks.workunit.client.1.smithi172.stdout:9/437: dwrite d1/d7/dc/de/f50 [0,4194304] 0 2024-03-19T06:05:30.455 INFO:tasks.workunit.client.0.smithi072.stdout:4/17: creat d5/fa x:0 0 0 2024-03-19T06:05:30.455 INFO:tasks.workunit.client.0.smithi072.stdout:1/24: write d1/f6 [349910,45578] 0 2024-03-19T06:05:30.458 INFO:tasks.workunit.client.0.smithi072.stdout:4/18: fdatasync f3 0 2024-03-19T06:05:30.458 INFO:tasks.workunit.client.1.smithi172.stdout:4/498: dread - df/d11/d12/d21/d50/f94 zero size 2024-03-19T06:05:30.459 INFO:tasks.workunit.client.0.smithi072.stdout:1/25: chown d1/l8 394951 1 2024-03-19T06:05:30.460 INFO:tasks.workunit.client.1.smithi172.stdout:7/412: fsync d0/d22/d3d/d41/f87 0 2024-03-19T06:05:30.466 INFO:tasks.workunit.client.1.smithi172.stdout:8/409: truncate d0/d64/d80/f45 9065227 0 2024-03-19T06:05:30.466 INFO:tasks.workunit.client.1.smithi172.stdout:1/503: read da/dd/d10/d14/d27/d3f/d5e/f7e [2090229,88857] 0 2024-03-19T06:05:30.467 INFO:tasks.workunit.client.1.smithi172.stdout:4/499: fdatasync df/f97 0 2024-03-19T06:05:30.468 INFO:tasks.workunit.client.0.smithi072.stdout:1/26: write d1/f6 [547806,20276] 0 2024-03-19T06:05:30.472 INFO:tasks.workunit.client.1.smithi172.stdout:5/417: dwrite d5/d14/f19 [0,4194304] 0 2024-03-19T06:05:30.475 INFO:tasks.workunit.client.1.smithi172.stdout:6/550: dwrite d5/d11/d17/d36/d48/f7d [0,4194304] 0 2024-03-19T06:05:30.475 INFO:tasks.workunit.client.1.smithi172.stdout:7/413: rmdir d0/d22/d1d/d36/d8d 39 2024-03-19T06:05:30.476 INFO:tasks.workunit.client.0.smithi072.stdout:1/27: mknod d1/c9 0 2024-03-19T06:05:30.476 INFO:tasks.workunit.client.1.smithi172.stdout:9/438: mknod d1/d7/dc/de/d34/d48/d82/c9a 0 2024-03-19T06:05:30.481 INFO:tasks.workunit.client.1.smithi172.stdout:3/450: dread d0/d5/f3d [0,4194304] 0 2024-03-19T06:05:30.482 INFO:tasks.workunit.client.0.smithi072.stdout:8/9: dread f1 [0,4194304] 0 2024-03-19T06:05:30.484 INFO:tasks.workunit.client.1.smithi172.stdout:3/451: chown d0/fe 690 1 2024-03-19T06:05:30.485 INFO:tasks.workunit.client.1.smithi172.stdout:1/504: creat da/dd/d10/d14/d73/d8b/fac x:0 0 0 2024-03-19T06:05:30.486 INFO:tasks.workunit.client.1.smithi172.stdout:4/500: write df/d11/d12/d26/d84/f91 [532415,108469] 0 2024-03-19T06:05:30.488 INFO:tasks.workunit.client.0.smithi072.stdout:3/22: dwrite f1 [0,4194304] 0 2024-03-19T06:05:30.488 INFO:tasks.workunit.client.1.smithi172.stdout:2/421: dwrite d7/de/d58/d55/f59 [0,4194304] 0 2024-03-19T06:05:30.489 INFO:tasks.workunit.client.0.smithi072.stdout:4/19: dread f3 [0,4194304] 0 2024-03-19T06:05:30.490 INFO:tasks.workunit.client.1.smithi172.stdout:5/418: fdatasync d5/d14/f3b 0 2024-03-19T06:05:30.491 INFO:tasks.workunit.client.1.smithi172.stdout:7/414: chown d0/d22/d1d/d36/d8d/d5c 15342639 1 2024-03-19T06:05:30.491 INFO:tasks.workunit.client.0.smithi072.stdout:1/28: mknod d1/ca 0 2024-03-19T06:05:30.493 INFO:tasks.workunit.client.1.smithi172.stdout:6/551: unlink d5/c9 0 2024-03-19T06:05:30.496 INFO:tasks.workunit.client.1.smithi172.stdout:2/422: dread - d7/de/d58/d57/f67 zero size 2024-03-19T06:05:30.498 INFO:tasks.workunit.client.1.smithi172.stdout:4/501: fdatasync df/d11/d12/d34/f8d 0 2024-03-19T06:05:30.498 INFO:tasks.workunit.client.0.smithi072.stdout:9/10: dwrite f1 [0,4194304] 0 2024-03-19T06:05:30.498 INFO:tasks.workunit.client.0.smithi072.stdout:5/11: dwrite f0 [0,4194304] 0 2024-03-19T06:05:30.504 INFO:tasks.workunit.client.1.smithi172.stdout:7/415: read d0/d22/d1d/d36/f23 [5587320,119591] 0 2024-03-19T06:05:30.504 INFO:tasks.workunit.client.1.smithi172.stdout:0/462: dwrite d11/d18/d38/d3f/f6e [0,4194304] 0 2024-03-19T06:05:30.504 INFO:tasks.workunit.client.0.smithi072.stdout:4/20: rename c4 to d5/cb 0 2024-03-19T06:05:30.505 INFO:tasks.workunit.client.0.smithi072.stdout:1/29: symlink d1/lb 0 2024-03-19T06:05:30.507 INFO:tasks.workunit.client.0.smithi072.stdout:8/10: link f1 f3 0 2024-03-19T06:05:30.509 INFO:tasks.workunit.client.1.smithi172.stdout:9/439: truncate d1/fa 874564 0 2024-03-19T06:05:30.514 INFO:tasks.workunit.client.0.smithi072.stdout:4/21: mknod d5/cc 0 2024-03-19T06:05:30.518 INFO:tasks.workunit.client.1.smithi172.stdout:0/463: dread - d11/f91 zero size 2024-03-19T06:05:30.519 INFO:tasks.workunit.client.1.smithi172.stdout:3/452: rename d0/d5/f26 to d0/d5/d9/d54/d77/f9d 0 2024-03-19T06:05:30.521 INFO:tasks.workunit.client.1.smithi172.stdout:2/423: creat d7/de/d58/d57/f8d x:0 0 0 2024-03-19T06:05:30.523 INFO:tasks.workunit.client.1.smithi172.stdout:4/502: mknod df/d2b/d2d/ca4 0 2024-03-19T06:05:30.524 INFO:tasks.workunit.client.0.smithi072.stdout:4/22: write d5/f9 [422404,93849] 0 2024-03-19T06:05:30.527 INFO:tasks.workunit.client.1.smithi172.stdout:4/503: stat df/d11/d12/d21/f2a 0 2024-03-19T06:05:30.528 INFO:tasks.workunit.client.1.smithi172.stdout:8/410: dread d0/d10/d27/d29/f32 [4194304,4194304] 0 2024-03-19T06:05:30.529 INFO:tasks.workunit.client.1.smithi172.stdout:2/424: fdatasync d7/de/d58/d56/f46 0 2024-03-19T06:05:30.532 INFO:tasks.workunit.client.0.smithi072.stdout:4/23: mknod d5/cd 0 2024-03-19T06:05:30.532 INFO:tasks.workunit.client.1.smithi172.stdout:7/416: mknod d0/d22/d1d/d36/d8d/d7d/c90 0 2024-03-19T06:05:30.532 INFO:tasks.workunit.client.1.smithi172.stdout:9/440: write d1/d7/dc/de/d34/d48/d82/f8f [337346,47300] 0 2024-03-19T06:05:30.533 INFO:tasks.workunit.client.1.smithi172.stdout:0/464: rmdir d11/d14/d2c/d8d 39 2024-03-19T06:05:30.534 INFO:tasks.workunit.client.1.smithi172.stdout:4/504: chown df/d11/d12/c28 297 1 2024-03-19T06:05:30.535 INFO:tasks.workunit.client.1.smithi172.stdout:3/453: symlink d0/d5/d9/d34/d4d/d6c/d88/l9e 0 2024-03-19T06:05:30.536 INFO:tasks.workunit.client.1.smithi172.stdout:2/425: dread - d7/d1b/f22 zero size 2024-03-19T06:05:30.536 INFO:tasks.workunit.client.0.smithi072.stdout:9/11: dread f1 [0,4194304] 0 2024-03-19T06:05:30.543 INFO:tasks.workunit.client.0.smithi072.stdout:4/24: symlink d5/le 0 2024-03-19T06:05:30.543 INFO:tasks.workunit.client.1.smithi172.stdout:5/419: getdents d5/d14/d48 0 2024-03-19T06:05:30.544 INFO:tasks.workunit.client.1.smithi172.stdout:6/552: dwrite d5/d8f/f70 [0,4194304] 0 2024-03-19T06:05:30.546 INFO:tasks.workunit.client.1.smithi172.stdout:5/420: fdatasync d5/d14/d34/f75 0 2024-03-19T06:05:30.554 INFO:tasks.workunit.client.1.smithi172.stdout:9/441: symlink d1/d7/dc/de/d34/l9b 0 2024-03-19T06:05:30.555 INFO:tasks.workunit.client.0.smithi072.stdout:5/12: dwrite f0 [0,4194304] 0 2024-03-19T06:05:30.556 INFO:tasks.workunit.client.1.smithi172.stdout:7/417: stat d0/d22/d1d/d36/l24 0 2024-03-19T06:05:30.558 INFO:tasks.workunit.client.1.smithi172.stdout:0/465: truncate d11/f13 2909115 0 2024-03-19T06:05:30.559 INFO:tasks.workunit.client.1.smithi172.stdout:7/418: dread - d0/f7c zero size 2024-03-19T06:05:30.563 INFO:tasks.workunit.client.0.smithi072.stdout:9/12: unlink f1 0 2024-03-19T06:05:30.563 INFO:tasks.workunit.client.0.smithi072.stdout:9/13: truncate - no filename 2024-03-19T06:05:30.565 INFO:tasks.workunit.client.0.smithi072.stdout:4/25: write d5/fa [44329,90645] 0 2024-03-19T06:05:30.566 INFO:tasks.workunit.client.1.smithi172.stdout:9/442: creat d1/d7/dc/d23/f9c x:0 0 0 2024-03-19T06:05:30.566 INFO:tasks.workunit.client.1.smithi172.stdout:5/421: write d5/f16 [2077111,69076] 0 2024-03-19T06:05:30.567 INFO:tasks.workunit.client.0.smithi072.stdout:5/13: mknod c3 0 2024-03-19T06:05:30.567 INFO:tasks.workunit.client.0.smithi072.stdout:3/23: dwrite d2/f5 [0,4194304] 0 2024-03-19T06:05:30.567 INFO:tasks.workunit.client.0.smithi072.stdout:1/30: dwrite d1/f6 [0,4194304] 0 2024-03-19T06:05:30.568 INFO:tasks.workunit.client.0.smithi072.stdout:9/14: chown l0 2767 1 2024-03-19T06:05:30.568 INFO:tasks.workunit.client.1.smithi172.stdout:0/466: read - d11/d22/d32/f77 zero size 2024-03-19T06:05:30.572 INFO:tasks.workunit.client.1.smithi172.stdout:4/505: dwrite df/f2e [0,4194304] 0 2024-03-19T06:05:30.573 INFO:tasks.workunit.client.0.smithi072.stdout:3/24: truncate d2/d3/f6 264008 0 2024-03-19T06:05:30.576 INFO:tasks.workunit.client.0.smithi072.stdout:9/15: readlink l0 0 2024-03-19T06:05:30.576 INFO:tasks.workunit.client.0.smithi072.stdout:4/26: write d5/f9 [24890,117041] 0 2024-03-19T06:05:30.578 INFO:tasks.workunit.client.0.smithi072.stdout:8/11: dwrite f1 [0,4194304] 0 2024-03-19T06:05:30.579 INFO:tasks.workunit.client.1.smithi172.stdout:9/443: symlink d1/d7/dc/d47/l9d 0 2024-03-19T06:05:30.582 INFO:tasks.workunit.client.1.smithi172.stdout:3/454: dread d0/d5/d9/d34/d4d/f4a [0,4194304] 0 2024-03-19T06:05:30.582 INFO:tasks.workunit.client.1.smithi172.stdout:9/444: readlink d1/l38 0 2024-03-19T06:05:30.582 INFO:tasks.workunit.client.1.smithi172.stdout:8/411: dwrite d0/f9 [0,4194304] 0 2024-03-19T06:05:30.585 INFO:tasks.workunit.client.1.smithi172.stdout:7/419: creat d0/d22/d1d/d36/f91 x:0 0 0 2024-03-19T06:05:30.591 INFO:tasks.workunit.client.1.smithi172.stdout:2/426: dwrite d7/db/d45/f74 [0,4194304] 0 2024-03-19T06:05:30.591 INFO:tasks.workunit.client.0.smithi072.stdout:4/27: unlink d5/c7 0 2024-03-19T06:05:30.594 INFO:tasks.workunit.client.0.smithi072.stdout:5/14: dwrite f0 [0,4194304] 0 2024-03-19T06:05:30.596 INFO:tasks.workunit.client.1.smithi172.stdout:2/427: stat d7/de/d58/d57/l80 0 2024-03-19T06:05:30.596 INFO:tasks.workunit.client.0.smithi072.stdout:5/15: stat c1 0 2024-03-19T06:05:30.598 INFO:tasks.workunit.client.1.smithi172.stdout:4/506: symlink df/d2b/da3/la5 0 2024-03-19T06:05:30.602 INFO:tasks.workunit.client.1.smithi172.stdout:5/422: symlink d5/d1f/d2f/l96 0 2024-03-19T06:05:30.603 INFO:tasks.workunit.client.1.smithi172.stdout:7/420: rmdir d0/d22/d27 39 2024-03-19T06:05:30.604 INFO:tasks.workunit.client.0.smithi072.stdout:1/31: dread d1/f6 [0,4194304] 0 2024-03-19T06:05:30.604 INFO:tasks.workunit.client.0.smithi072.stdout:5/16: mknod c4 0 2024-03-19T06:05:30.605 INFO:tasks.workunit.client.1.smithi172.stdout:5/423: fsync d5/d1f/d2f/d62/f7e 0 2024-03-19T06:05:30.612 INFO:tasks.workunit.client.1.smithi172.stdout:0/467: dwrite d11/d4d/f5a [4194304,4194304] 0 2024-03-19T06:05:30.617 INFO:tasks.workunit.client.0.smithi072.stdout:3/25: dwrite d2/d3/f6 [0,4194304] 0 2024-03-19T06:05:30.618 INFO:tasks.workunit.client.1.smithi172.stdout:7/421: dread d0/d22/d1d/d3a/d46/f78 [0,4194304] 0 2024-03-19T06:05:30.622 INFO:tasks.workunit.client.0.smithi072.stdout:3/26: stat d2/l7 0 2024-03-19T06:05:30.623 INFO:tasks.workunit.client.1.smithi172.stdout:4/507: chown df/d2b/d44/d67/c82 1444648 1 2024-03-19T06:05:30.626 INFO:tasks.workunit.client.1.smithi172.stdout:4/508: readlink df/d11/d12/l42 0 2024-03-19T06:05:30.630 INFO:tasks.workunit.client.0.smithi072.stdout:4/28: dwrite d5/f8 [0,4194304] 0 2024-03-19T06:05:30.631 INFO:tasks.workunit.client.1.smithi172.stdout:8/412: dread d0/f11 [0,4194304] 0 2024-03-19T06:05:30.632 INFO:tasks.workunit.client.1.smithi172.stdout:2/428: symlink d7/db/d2c/l8e 0 2024-03-19T06:05:30.632 INFO:tasks.workunit.client.1.smithi172.stdout:2/429: chown d7 249 1 2024-03-19T06:05:30.636 INFO:tasks.workunit.client.0.smithi072.stdout:3/27: creat d2/f8 x:0 0 0 2024-03-19T06:05:30.637 INFO:tasks.workunit.client.1.smithi172.stdout:2/430: write d7/d1b/f3f [4258188,6577] 0 2024-03-19T06:05:30.641 INFO:tasks.workunit.client.1.smithi172.stdout:7/422: mkdir d0/d2c/d92 0 2024-03-19T06:05:30.642 INFO:tasks.workunit.client.0.smithi072.stdout:9/16: getdents . 0 2024-03-19T06:05:30.642 INFO:tasks.workunit.client.1.smithi172.stdout:5/424: creat d5/d3d/d60/f97 x:0 0 0 2024-03-19T06:05:30.643 INFO:tasks.workunit.client.0.smithi072.stdout:3/28: chown d2/f8 9 1 2024-03-19T06:05:30.644 INFO:tasks.workunit.client.1.smithi172.stdout:5/425: fdatasync d5/f16 0 2024-03-19T06:05:30.645 INFO:tasks.workunit.client.0.smithi072.stdout:3/29: readlink d2/l7 0 2024-03-19T06:05:30.646 INFO:tasks.workunit.client.1.smithi172.stdout:1/505: dread da/d3b/f80 [0,4194304] 0 2024-03-19T06:05:30.648 INFO:tasks.workunit.client.1.smithi172.stdout:5/426: fdatasync d5/d1f/d2f/f46 0 2024-03-19T06:05:30.649 INFO:tasks.workunit.client.0.smithi072.stdout:5/17: dwrite f0 [0,4194304] 0 2024-03-19T06:05:30.650 INFO:tasks.workunit.client.0.smithi072.stdout:9/17: rename l0 to l2 0 2024-03-19T06:05:30.650 INFO:tasks.workunit.client.0.smithi072.stdout:9/18: write - no filename 2024-03-19T06:05:30.650 INFO:tasks.workunit.client.1.smithi172.stdout:4/509: write df/d11/d12/d21/d50/f54 [395692,128805] 0 2024-03-19T06:05:30.651 INFO:tasks.workunit.client.1.smithi172.stdout:8/413: rename d0/d10 to d0/d44/d46/d49/d26/d71/d81 0 2024-03-19T06:05:30.651 INFO:tasks.workunit.client.0.smithi072.stdout:3/30: symlink d2/l9 0 2024-03-19T06:05:30.656 INFO:tasks.workunit.client.0.smithi072.stdout:9/19: creat f3 x:0 0 0 2024-03-19T06:05:30.658 INFO:tasks.workunit.client.0.smithi072.stdout:5/18: write f0 [2348978,64288] 0 2024-03-19T06:05:30.663 INFO:tasks.workunit.client.0.smithi072.stdout:5/19: stat c3 0 2024-03-19T06:05:30.666 INFO:tasks.workunit.client.0.smithi072.stdout:9/20: mknod c4 0 2024-03-19T06:05:30.667 INFO:tasks.workunit.client.1.smithi172.stdout:7/423: chown d0/d22/d1d/d36/cd 17 1 2024-03-19T06:05:30.667 INFO:tasks.workunit.client.1.smithi172.stdout:6/553: truncate d5/fe 3272627 0 2024-03-19T06:05:30.669 INFO:tasks.workunit.client.1.smithi172.stdout:5/427: dwrite d5/d3d/d60/f97 [0,4194304] 0 2024-03-19T06:05:30.673 INFO:tasks.workunit.client.1.smithi172.stdout:0/468: creat d11/d14/d2c/d36/f9b x:0 0 0 2024-03-19T06:05:30.674 INFO:tasks.workunit.client.1.smithi172.stdout:0/469: stat d11/d14/d2c/d36/f8c 0 2024-03-19T06:05:30.676 INFO:tasks.workunit.client.0.smithi072.stdout:4/29: dwrite d5/f6 [0,4194304] 0 2024-03-19T06:05:30.677 INFO:tasks.workunit.client.1.smithi172.stdout:8/414: symlink d0/d44/d46/d49/d26/l82 0 2024-03-19T06:05:30.679 INFO:tasks.workunit.client.1.smithi172.stdout:3/455: truncate d0/d5/d9/d25/d21/f50 1642061 0 2024-03-19T06:05:30.681 INFO:tasks.workunit.client.1.smithi172.stdout:2/431: mknod d7/de/c8f 0 2024-03-19T06:05:30.681 INFO:tasks.workunit.client.0.smithi072.stdout:8/12: fdatasync f3 0 2024-03-19T06:05:30.683 INFO:tasks.workunit.client.0.smithi072.stdout:4/30: creat d5/ff x:0 0 0 2024-03-19T06:05:30.684 INFO:tasks.workunit.client.0.smithi072.stdout:1/32: truncate d1/f6 101409 0 2024-03-19T06:05:30.688 INFO:tasks.workunit.client.0.smithi072.stdout:5/20: fdatasync f0 0 2024-03-19T06:05:30.690 INFO:tasks.workunit.client.0.smithi072.stdout:4/31: dread - d5/ff zero size 2024-03-19T06:05:30.690 INFO:tasks.workunit.client.0.smithi072.stdout:1/33: rmdir d1 39 2024-03-19T06:05:30.690 INFO:tasks.workunit.client.1.smithi172.stdout:7/424: creat d0/d22/d1d/d36/d40/f93 x:0 0 0 2024-03-19T06:05:30.691 INFO:tasks.workunit.client.0.smithi072.stdout:3/31: dwrite f1 [0,4194304] 0 2024-03-19T06:05:30.692 INFO:tasks.workunit.client.0.smithi072.stdout:3/32: chown f0 261602111 1 2024-03-19T06:05:30.693 INFO:tasks.workunit.client.0.smithi072.stdout:3/33: chown f0 3617155 1 2024-03-19T06:05:30.694 INFO:tasks.workunit.client.1.smithi172.stdout:0/470: dwrite ff [4194304,4194304] 0 2024-03-19T06:05:30.695 INFO:tasks.workunit.client.0.smithi072.stdout:5/21: rename c3 to c5 0 2024-03-19T06:05:30.698 INFO:tasks.workunit.client.1.smithi172.stdout:0/471: write d11/d4d/f5a [1295358,56486] 0 2024-03-19T06:05:30.698 INFO:tasks.workunit.client.1.smithi172.stdout:0/472: chown d11/d14/d9a 10 1 2024-03-19T06:05:30.698 INFO:tasks.workunit.client.0.smithi072.stdout:9/21: link l2 l5 0 2024-03-19T06:05:30.699 INFO:tasks.workunit.client.1.smithi172.stdout:0/473: dread - d11/d22/d32/f77 zero size 2024-03-19T06:05:30.701 INFO:tasks.workunit.client.0.smithi072.stdout:1/34: symlink d1/lc 0 2024-03-19T06:05:30.701 INFO:tasks.workunit.client.1.smithi172.stdout:0/474: readlink d11/d14/d2c/d4e/l6f 0 2024-03-19T06:05:30.703 INFO:tasks.workunit.client.1.smithi172.stdout:4/510: fdatasync df/d11/f32 0 2024-03-19T06:05:30.705 INFO:tasks.workunit.client.1.smithi172.stdout:4/511: chown df/d11/d12/d26/d84/da2 12221 1 2024-03-19T06:05:30.707 INFO:tasks.workunit.client.1.smithi172.stdout:4/512: fdatasync df/d11/d12/d26/f30 0 2024-03-19T06:05:30.707 INFO:tasks.workunit.client.1.smithi172.stdout:4/513: stat fb 0 2024-03-19T06:05:30.708 INFO:tasks.workunit.client.0.smithi072.stdout:4/32: dread d5/f6 [0,4194304] 0 2024-03-19T06:05:30.713 INFO:tasks.workunit.client.0.smithi072.stdout:4/33: fdatasync d5/f8 0 2024-03-19T06:05:30.717 INFO:tasks.workunit.client.0.smithi072.stdout:4/34: creat d5/f10 x:0 0 0 2024-03-19T06:05:30.719 INFO:tasks.workunit.client.1.smithi172.stdout:8/415: mkdir d0/d44/d46/d49/d3a/d3d/d83 0 2024-03-19T06:05:30.721 INFO:tasks.workunit.client.0.smithi072.stdout:5/22: getdents . 0 2024-03-19T06:05:30.721 INFO:tasks.workunit.client.1.smithi172.stdout:1/506: creat da/dd/d10/fad x:0 0 0 2024-03-19T06:05:30.722 INFO:tasks.workunit.client.0.smithi072.stdout:1/35: fsync d1/f6 0 2024-03-19T06:05:30.722 INFO:tasks.workunit.client.0.smithi072.stdout:4/35: mkdir d5/d11 0 2024-03-19T06:05:30.724 INFO:tasks.workunit.client.0.smithi072.stdout:8/13: dwrite f3 [0,4194304] 0 2024-03-19T06:05:30.725 INFO:tasks.workunit.client.1.smithi172.stdout:1/507: write da/dd/d10/d14/d73/d8b/f94 [449132,13435] 0 2024-03-19T06:05:30.729 INFO:tasks.workunit.client.1.smithi172.stdout:3/456: rename d0/d37/c68 to d0/d5/d9/d3a/c9f 0 2024-03-19T06:05:30.731 INFO:tasks.workunit.client.1.smithi172.stdout:3/457: fsync d0/d5/d9/d25/f1a 0 2024-03-19T06:05:30.732 INFO:tasks.workunit.client.1.smithi172.stdout:2/432: dread d7/db/f18 [0,4194304] 0 2024-03-19T06:05:30.733 INFO:tasks.workunit.client.1.smithi172.stdout:6/554: link d5/d8f/f6b d5/d8f/fb0 0 2024-03-19T06:05:30.734 INFO:tasks.workunit.client.1.smithi172.stdout:2/433: write d7/d4c/f7e [243141,52627] 0 2024-03-19T06:05:30.738 INFO:tasks.workunit.client.1.smithi172.stdout:9/445: mkdir d1/d7/dc/de/d34/d48/d82/d92/d95/d9e 0 2024-03-19T06:05:30.738 INFO:tasks.workunit.client.0.smithi072.stdout:1/36: chown d1/l8 1328664 1 2024-03-19T06:05:30.742 INFO:tasks.workunit.client.0.smithi072.stdout:4/36: fsync d5/f8 0 2024-03-19T06:05:30.742 INFO:tasks.workunit.client.0.smithi072.stdout:3/34: dwrite d2/f5 [0,4194304] 0 2024-03-19T06:05:30.742 INFO:tasks.workunit.client.0.smithi072.stdout:5/23: chown f0 1 1 2024-03-19T06:05:30.743 INFO:tasks.workunit.client.1.smithi172.stdout:9/446: stat d1/d7/dc/d47/d78/d54 0 2024-03-19T06:05:30.744 INFO:tasks.workunit.client.1.smithi172.stdout:4/514: mkdir df/d11/d12/d21/d58/da6 0 2024-03-19T06:05:30.744 INFO:tasks.workunit.client.0.smithi072.stdout:5/24: stat c4 0 2024-03-19T06:05:30.745 INFO:tasks.workunit.client.0.smithi072.stdout:4/37: read - d5/f10 zero size 2024-03-19T06:05:30.746 INFO:tasks.workunit.client.1.smithi172.stdout:4/515: chown df/d11/c71 433 1 2024-03-19T06:05:30.748 INFO:tasks.workunit.client.1.smithi172.stdout:8/416: fsync d0/d44/d46/d49/d26/d71/d81/d27/d29/f33 0 2024-03-19T06:05:30.749 INFO:tasks.workunit.client.1.smithi172.stdout:4/516: dread - df/d11/d12/d26/f61 zero size 2024-03-19T06:05:30.753 INFO:tasks.workunit.client.1.smithi172.stdout:1/508: dwrite da/dd/d10/d14/d27/f93 [0,4194304] 0 2024-03-19T06:05:30.753 INFO:tasks.workunit.client.1.smithi172.stdout:1/509: dread - da/d3b/f83 zero size 2024-03-19T06:05:30.753 INFO:tasks.workunit.client.1.smithi172.stdout:7/425: rename d0/d22/d3d/f6e to d0/d22/d35/f94 0 2024-03-19T06:05:30.755 INFO:tasks.workunit.client.1.smithi172.stdout:7/426: write d0/f7c [799714,19803] 0 2024-03-19T06:05:30.756 INFO:tasks.workunit.client.1.smithi172.stdout:3/458: symlink d0/d5/d9/d54/la0 0 2024-03-19T06:05:30.759 INFO:tasks.workunit.client.1.smithi172.stdout:2/434: creat d7/d4c/d70/f90 x:0 0 0 2024-03-19T06:05:30.763 INFO:tasks.workunit.client.1.smithi172.stdout:2/435: chown d7/de/d58/d55/d5f/d6a/f84 47693634 1 2024-03-19T06:05:30.767 INFO:tasks.workunit.client.1.smithi172.stdout:8/417: symlink d0/d44/d46/d49/d26/d71/d81/d27/d65/l84 0 2024-03-19T06:05:30.767 INFO:tasks.workunit.client.1.smithi172.stdout:2/436: read d7/de/d58/d56/f39 [3849612,74171] 0 2024-03-19T06:05:30.767 INFO:tasks.workunit.client.1.smithi172.stdout:7/427: symlink d0/d22/d1d/d3a/d46/l95 0 2024-03-19T06:05:30.770 INFO:tasks.workunit.client.0.smithi072.stdout:5/25: dread f0 [0,4194304] 0 2024-03-19T06:05:30.770 INFO:tasks.workunit.client.0.smithi072.stdout:5/26: readlink l2 0 2024-03-19T06:05:30.773 INFO:tasks.workunit.client.1.smithi172.stdout:3/459: fdatasync d0/d5/d9/d25/f74 0 2024-03-19T06:05:30.774 INFO:tasks.workunit.client.1.smithi172.stdout:9/447: link d1/d7/dc/de/f1d d1/d7/dc/d47/d78/f9f 0 2024-03-19T06:05:30.776 INFO:tasks.workunit.client.1.smithi172.stdout:1/510: mknod da/dd/d10/d14/d27/d3f/d5e/dab/cae 0 2024-03-19T06:05:30.777 INFO:tasks.workunit.client.1.smithi172.stdout:7/428: rmdir d0/d2c 39 2024-03-19T06:05:30.781 INFO:tasks.workunit.client.1.smithi172.stdout:4/517: link df/f3d df/fa7 0 2024-03-19T06:05:30.781 INFO:tasks.workunit.client.1.smithi172.stdout:2/437: write d7/de/d58/d56/f6b [1434823,50748] 0 2024-03-19T06:05:30.785 INFO:tasks.workunit.client.1.smithi172.stdout:6/555: creat d5/d11/d35/d40/d53/d75/fb1 x:0 0 0 2024-03-19T06:05:30.787 INFO:tasks.workunit.client.1.smithi172.stdout:7/429: symlink d0/d22/d1d/d3a/d46/l96 0 2024-03-19T06:05:30.787 INFO:tasks.workunit.client.1.smithi172.stdout:1/511: write da/dd/d10/d14/d27/d3f/d5e/f72 [3012015,76351] 0 2024-03-19T06:05:30.788 INFO:tasks.workunit.client.1.smithi172.stdout:8/418: dwrite d0/f58 [0,4194304] 0 2024-03-19T06:05:30.788 INFO:tasks.workunit.client.1.smithi172.stdout:9/448: creat d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/fa0 x:0 0 0 2024-03-19T06:05:30.791 INFO:tasks.workunit.client.1.smithi172.stdout:1/512: readlink da/d33/d4e/l56 0 2024-03-19T06:05:30.791 INFO:tasks.workunit.client.1.smithi172.stdout:4/518: creat df/d2b/da3/fa8 x:0 0 0 2024-03-19T06:05:30.791 INFO:tasks.workunit.client.1.smithi172.stdout:8/419: fsync d0/d61/d6a/d7e/f7f 0 2024-03-19T06:05:30.793 INFO:tasks.workunit.client.1.smithi172.stdout:2/438: creat d7/db/d2c/d35/f91 x:0 0 0 2024-03-19T06:05:30.794 INFO:tasks.workunit.client.1.smithi172.stdout:1/513: chown da/dd/d10/d14/d73/d8b/fac 26 1 2024-03-19T06:05:30.802 INFO:tasks.workunit.client.0.smithi072.stdout:8/14: rename f3 to f4 0 2024-03-19T06:05:30.803 INFO:tasks.workunit.client.0.smithi072.stdout:3/35: mknod d2/ca 0 2024-03-19T06:05:30.803 INFO:tasks.workunit.client.0.smithi072.stdout:3/36: stat d2/l7 0 2024-03-19T06:05:30.804 INFO:tasks.workunit.client.0.smithi072.stdout:1/37: rename d1/lb to d1/ld 0 2024-03-19T06:05:30.805 INFO:tasks.workunit.client.1.smithi172.stdout:4/519: mknod df/ca9 0 2024-03-19T06:05:30.805 INFO:tasks.workunit.client.0.smithi072.stdout:4/38: creat d5/f12 x:0 0 0 2024-03-19T06:05:30.806 INFO:tasks.workunit.client.1.smithi172.stdout:6/556: read d5/d11/d43/d45/f97 [2150608,60029] 0 2024-03-19T06:05:30.807 INFO:tasks.workunit.client.0.smithi072.stdout:5/27: creat f6 x:0 0 0 2024-03-19T06:05:30.807 INFO:tasks.workunit.client.0.smithi072.stdout:4/39: read d5/f8 [998836,126374] 0 2024-03-19T06:05:30.809 INFO:tasks.workunit.client.1.smithi172.stdout:6/557: chown d5/f5f 3521508 1 2024-03-19T06:05:30.810 INFO:tasks.workunit.client.1.smithi172.stdout:2/439: unlink d7/de/d58/d55/d6e/f7a 0 2024-03-19T06:05:30.810 INFO:tasks.workunit.client.0.smithi072.stdout:8/15: creat f5 x:0 0 0 2024-03-19T06:05:30.810 INFO:tasks.workunit.client.0.smithi072.stdout:5/28: write f6 [522240,255] 0 2024-03-19T06:05:30.810 INFO:tasks.workunit.client.0.smithi072.stdout:1/38: creat d1/fe x:0 0 0 2024-03-19T06:05:30.811 INFO:tasks.workunit.client.0.smithi072.stdout:3/37: rename d2/d3/f6 to d2/d3/fb 0 2024-03-19T06:05:30.812 INFO:tasks.workunit.client.1.smithi172.stdout:3/460: truncate d0/d5/d9/d54/d77/f78 263443 0 2024-03-19T06:05:30.815 INFO:tasks.workunit.client.0.smithi072.stdout:3/38: creat d2/d3/fc x:0 0 0 2024-03-19T06:05:30.815 INFO:tasks.workunit.client.0.smithi072.stdout:8/16: dread - f5 zero size 2024-03-19T06:05:30.816 INFO:tasks.workunit.client.1.smithi172.stdout:7/430: link d0/d22/d1d/d36/cd d0/d22/d1d/d36/d8d/d5c/d67/c97 0 2024-03-19T06:05:30.816 INFO:tasks.workunit.client.1.smithi172.stdout:0/475: dwrite d11/d22/d46/f98 [0,4194304] 0 2024-03-19T06:05:30.816 INFO:tasks.workunit.client.1.smithi172.stdout:2/440: write d7/de/d58/d56/f85 [62743,101601] 0 2024-03-19T06:05:30.818 INFO:tasks.workunit.client.1.smithi172.stdout:9/449: write d1/f75 [500322,92589] 0 2024-03-19T06:05:30.820 INFO:tasks.workunit.client.0.smithi072.stdout:8/17: rename f5 to f6 0 2024-03-19T06:05:30.825 INFO:tasks.workunit.client.1.smithi172.stdout:3/461: dread d0/d5/d9/d25/f74 [0,4194304] 0 2024-03-19T06:05:30.827 INFO:tasks.workunit.client.1.smithi172.stdout:6/558: symlink d5/d11/d17/lb2 0 2024-03-19T06:05:30.828 INFO:tasks.workunit.client.0.smithi072.stdout:4/40: dwrite f3 [0,4194304] 0 2024-03-19T06:05:30.828 INFO:tasks.workunit.client.0.smithi072.stdout:8/18: write f1 [3405959,28678] 0 2024-03-19T06:05:30.835 INFO:tasks.workunit.client.0.smithi072.stdout:8/19: write f4 [912371,12747] 0 2024-03-19T06:05:30.836 INFO:tasks.workunit.client.0.smithi072.stdout:4/41: truncate d5/f10 562164 0 2024-03-19T06:05:30.837 INFO:tasks.workunit.client.0.smithi072.stdout:3/39: dread f1 [0,4194304] 0 2024-03-19T06:05:30.838 INFO:tasks.workunit.client.0.smithi072.stdout:8/20: stat f4 0 2024-03-19T06:05:30.838 INFO:tasks.workunit.client.0.smithi072.stdout:5/29: dwrite f6 [0,4194304] 0 2024-03-19T06:05:30.840 INFO:tasks.workunit.client.0.smithi072.stdout:3/40: chown d2/f5 1334558 1 2024-03-19T06:05:30.841 INFO:tasks.workunit.client.0.smithi072.stdout:4/42: fdatasync d5/f9 0 2024-03-19T06:05:30.841 INFO:tasks.workunit.client.0.smithi072.stdout:5/30: stat c4 0 2024-03-19T06:05:30.841 INFO:tasks.workunit.client.1.smithi172.stdout:4/520: dread df/d11/d12/f1e [4194304,4194304] 0 2024-03-19T06:05:30.842 INFO:tasks.workunit.client.1.smithi172.stdout:8/420: dwrite d0/d44/d46/d49/d26/d71/d81/d27/f38 [0,4194304] 0 2024-03-19T06:05:30.842 INFO:tasks.workunit.client.1.smithi172.stdout:0/476: dwrite d11/d22/d32/f35 [4194304,4194304] 0 2024-03-19T06:05:30.843 INFO:tasks.workunit.client.0.smithi072.stdout:8/21: unlink f1 0 2024-03-19T06:05:30.843 INFO:tasks.workunit.client.1.smithi172.stdout:6/559: truncate d5/d11/d43/f4c 3582731 0 2024-03-19T06:05:30.844 INFO:tasks.workunit.client.0.smithi072.stdout:8/22: dread - f6 zero size 2024-03-19T06:05:30.845 INFO:tasks.workunit.client.1.smithi172.stdout:6/560: stat d5/d11/d43/d45/f97 0 2024-03-19T06:05:30.846 INFO:tasks.workunit.client.1.smithi172.stdout:3/462: getdents d0/d5/d9/d54/d90 0 2024-03-19T06:05:30.848 INFO:tasks.workunit.client.1.smithi172.stdout:8/421: chown d0/f11 1 1 2024-03-19T06:05:30.849 INFO:tasks.workunit.client.0.smithi072.stdout:4/43: dread d5/fa [0,4194304] 0 2024-03-19T06:05:30.850 INFO:tasks.workunit.client.0.smithi072.stdout:4/44: readlink l1 0 2024-03-19T06:05:30.850 INFO:tasks.workunit.client.0.smithi072.stdout:3/41: mknod d2/cd 0 2024-03-19T06:05:30.850 INFO:tasks.workunit.client.1.smithi172.stdout:8/422: stat d0/d44/d46/d49/f25 0 2024-03-19T06:05:30.851 INFO:tasks.workunit.client.1.smithi172.stdout:0/477: truncate d11/d22/d46/f6b 5138464 0 2024-03-19T06:05:30.853 INFO:tasks.workunit.client.1.smithi172.stdout:6/561: creat d5/d8f/fb3 x:0 0 0 2024-03-19T06:05:30.855 INFO:tasks.workunit.client.1.smithi172.stdout:0/478: truncate d11/d22/f4a 817311 0 2024-03-19T06:05:30.855 INFO:tasks.workunit.client.0.smithi072.stdout:4/45: creat d5/f13 x:0 0 0 2024-03-19T06:05:30.856 INFO:tasks.workunit.client.1.smithi172.stdout:6/562: dread - d5/d11/d35/d40/d53/d75/fb1 zero size 2024-03-19T06:05:30.856 INFO:tasks.workunit.client.1.smithi172.stdout:4/521: creat df/d2b/d99/faa x:0 0 0 2024-03-19T06:05:30.860 INFO:tasks.workunit.client.1.smithi172.stdout:9/450: write d1/d7/dc/d47/d78/f79 [4213847,90396] 0 2024-03-19T06:05:30.863 INFO:tasks.workunit.client.1.smithi172.stdout:6/563: write d5/d11/d17/d1b/d74/faa [611288,24589] 0 2024-03-19T06:05:30.863 INFO:tasks.workunit.client.1.smithi172.stdout:4/522: fsync df/d11/d12/d21/d58/d60/f70 0 2024-03-19T06:05:30.865 INFO:tasks.workunit.client.0.smithi072.stdout:4/46: mkdir d5/d14 0 2024-03-19T06:05:30.866 INFO:tasks.workunit.client.1.smithi172.stdout:4/523: write f6 [9113670,45136] 0 2024-03-19T06:05:30.869 INFO:tasks.workunit.client.0.smithi072.stdout:4/47: write d5/f9 [653555,129866] 0 2024-03-19T06:05:30.872 INFO:tasks.workunit.client.1.smithi172.stdout:8/423: getdents d0/d61/d6a 0 2024-03-19T06:05:30.873 INFO:tasks.workunit.client.0.smithi072.stdout:4/48: stat d5/cb 0 2024-03-19T06:05:30.874 INFO:tasks.workunit.client.1.smithi172.stdout:0/479: mkdir d11/d18/d38/d3f/d43/d9c 0 2024-03-19T06:05:30.874 INFO:tasks.workunit.client.1.smithi172.stdout:3/463: link d0/d37/l7a d0/d5/d14/la1 0 2024-03-19T06:05:30.876 INFO:tasks.workunit.client.1.smithi172.stdout:6/564: creat d5/d11/d17/d1b/d74/fb4 x:0 0 0 2024-03-19T06:05:30.876 INFO:tasks.workunit.client.1.smithi172.stdout:4/524: creat df/d11/d12/d21/d58/d65/fab x:0 0 0 2024-03-19T06:05:30.877 INFO:tasks.workunit.client.0.smithi072.stdout:4/49: mkdir d5/d15 0 2024-03-19T06:05:30.877 INFO:tasks.workunit.client.0.smithi072.stdout:4/50: chown d5/ff 21400 1 2024-03-19T06:05:30.881 INFO:tasks.workunit.client.1.smithi172.stdout:3/464: dread d0/d5/d14/f30 [0,4194304] 0 2024-03-19T06:05:30.881 INFO:tasks.workunit.client.1.smithi172.stdout:4/525: chown df/d11/d12/d26/d84 942150528 1 2024-03-19T06:05:30.882 INFO:tasks.workunit.client.1.smithi172.stdout:8/424: rename d0/d44/d46/d49/d26/d71/d81/d27/f38 to d0/f85 0 2024-03-19T06:05:30.887 INFO:tasks.workunit.client.0.smithi072.stdout:4/51: rmdir d5/d14 0 2024-03-19T06:05:30.888 INFO:tasks.workunit.client.1.smithi172.stdout:0/480: rename d11/d14/d2c/d4e/l6f to d11/d18/d38/d3f/l9d 0 2024-03-19T06:05:30.889 INFO:tasks.workunit.client.1.smithi172.stdout:6/565: getdents d5/d8f/d31/d3d/d98/dac 0 2024-03-19T06:05:30.890 INFO:tasks.workunit.client.1.smithi172.stdout:3/465: write d0/d5/d9/d34/f8b [570715,128786] 0 2024-03-19T06:05:30.890 INFO:tasks.workunit.client.1.smithi172.stdout:4/526: creat df/d11/d12/d21/d50/fac x:0 0 0 2024-03-19T06:05:30.891 INFO:tasks.workunit.client.0.smithi072.stdout:4/52: creat d5/d11/f16 x:0 0 0 2024-03-19T06:05:30.891 INFO:tasks.workunit.client.0.smithi072.stdout:4/53: stat d5/f10 0 2024-03-19T06:05:30.895 INFO:tasks.workunit.client.1.smithi172.stdout:9/451: dwrite d1/d7/dc/de/d34/d48/d89/f98 [0,4194304] 0 2024-03-19T06:05:30.896 INFO:tasks.workunit.client.1.smithi172.stdout:3/466: stat d0/d5/d9/d25/l87 0 2024-03-19T06:05:30.898 INFO:tasks.workunit.client.1.smithi172.stdout:6/566: symlink d5/d11/d17/da4/lb5 0 2024-03-19T06:05:30.898 INFO:tasks.workunit.client.0.smithi072.stdout:4/54: dread d5/f9 [0,4194304] 0 2024-03-19T06:05:30.898 INFO:tasks.workunit.client.1.smithi172.stdout:4/527: write df/d2b/d2d/f9d [797789,46994] 0 2024-03-19T06:05:30.901 INFO:tasks.workunit.client.0.smithi072.stdout:4/55: write f3 [2131570,87301] 0 2024-03-19T06:05:30.901 INFO:tasks.workunit.client.1.smithi172.stdout:0/481: fsync d11/d14/f4b 0 2024-03-19T06:05:30.902 INFO:tasks.workunit.client.1.smithi172.stdout:6/567: fsync d5/d8f/fb3 0 2024-03-19T06:05:30.902 INFO:tasks.workunit.client.0.smithi072.stdout:4/56: stat d5/d11/f16 0 2024-03-19T06:05:30.903 INFO:tasks.workunit.client.1.smithi172.stdout:4/528: read fb [1015336,63445] 0 2024-03-19T06:05:30.903 INFO:tasks.workunit.client.1.smithi172.stdout:8/425: creat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/f86 x:0 0 0 2024-03-19T06:05:30.904 INFO:tasks.workunit.client.1.smithi172.stdout:6/568: readlink d5/d11/d43/l5d 0 2024-03-19T06:05:30.907 INFO:tasks.workunit.client.1.smithi172.stdout:6/569: write d5/d11/d17/f3a [5152847,124012] 0 2024-03-19T06:05:30.909 INFO:tasks.workunit.client.0.smithi072.stdout:8/23: chown f4 1 1 2024-03-19T06:05:30.910 INFO:tasks.workunit.client.1.smithi172.stdout:3/467: creat d0/d5/d9/d34/d4d/d6c/d88/fa2 x:0 0 0 2024-03-19T06:05:30.911 INFO:tasks.workunit.client.0.smithi072.stdout:8/24: chown f6 2952 1 2024-03-19T06:05:30.911 INFO:tasks.workunit.client.1.smithi172.stdout:3/468: readlink d0/d5/d9/d25/d21/l2f 0 2024-03-19T06:05:30.912 INFO:tasks.workunit.client.1.smithi172.stdout:3/469: chown d0/d5/d14 412 1 2024-03-19T06:05:30.913 INFO:tasks.workunit.client.1.smithi172.stdout:3/470: dread - d0/f7c zero size 2024-03-19T06:05:30.914 INFO:tasks.workunit.client.1.smithi172.stdout:4/529: creat df/d2b/d44/d67/fad x:0 0 0 2024-03-19T06:05:30.914 INFO:tasks.workunit.client.1.smithi172.stdout:8/426: fsync d0/d44/d46/d49/d26/f3e 0 2024-03-19T06:05:30.914 INFO:tasks.workunit.client.1.smithi172.stdout:6/570: rmdir d5/d8f/d31 39 2024-03-19T06:05:30.915 INFO:tasks.workunit.client.1.smithi172.stdout:0/482: truncate f2 2287548 0 2024-03-19T06:05:30.917 INFO:tasks.workunit.client.1.smithi172.stdout:4/530: mkdir df/d2b/d2d/dae 0 2024-03-19T06:05:30.918 INFO:tasks.workunit.client.1.smithi172.stdout:3/471: write d0/d5/d9/d25/f9a [605353,15341] 0 2024-03-19T06:05:30.919 INFO:tasks.workunit.client.0.smithi072.stdout:3/42: getdents d2/d3 0 2024-03-19T06:05:30.919 INFO:tasks.workunit.client.1.smithi172.stdout:9/452: link d1/d7/dc/de/d34/d48/d82/c94 d1/ca1 0 2024-03-19T06:05:30.921 INFO:tasks.workunit.client.1.smithi172.stdout:0/483: creat d11/d22/d46/f9e x:0 0 0 2024-03-19T06:05:30.923 INFO:tasks.workunit.client.0.smithi072.stdout:3/43: symlink d2/d3/le 0 2024-03-19T06:05:30.923 INFO:tasks.workunit.client.1.smithi172.stdout:4/531: mkdir df/d11/d12/d26/daf 0 2024-03-19T06:05:30.924 INFO:tasks.workunit.client.1.smithi172.stdout:3/472: creat d0/d5/d9/d3a/fa3 x:0 0 0 2024-03-19T06:05:30.924 INFO:tasks.workunit.client.0.smithi072.stdout:3/44: chown d2/c4 319082918 1 2024-03-19T06:05:30.927 INFO:tasks.workunit.client.1.smithi172.stdout:9/453: write d1/d7/dc/d47/d78/d57/f74 [7437939,96764] 0 2024-03-19T06:05:30.927 INFO:tasks.workunit.client.1.smithi172.stdout:4/532: read - df/d11/d12/d26/f61 zero size 2024-03-19T06:05:30.928 INFO:tasks.workunit.client.1.smithi172.stdout:6/571: rename d5/d11/d35 to d5/d8f/d31/d3d/d98/db6 0 2024-03-19T06:05:30.929 INFO:tasks.workunit.client.0.smithi072.stdout:5/31: truncate f6 2365493 0 2024-03-19T06:05:30.929 INFO:tasks.workunit.client.1.smithi172.stdout:0/484: stat f2 0 2024-03-19T06:05:30.932 INFO:tasks.workunit.client.1.smithi172.stdout:8/427: dread d0/d44/d46/d49/d26/d71/d81/f56 [0,4194304] 0 2024-03-19T06:05:30.933 INFO:tasks.workunit.client.1.smithi172.stdout:6/572: mknod d5/d11/d17/cb7 0 2024-03-19T06:05:30.934 INFO:tasks.workunit.client.1.smithi172.stdout:0/485: mkdir d11/d18/d38/d3f/d9f 0 2024-03-19T06:05:30.935 INFO:tasks.workunit.client.0.smithi072.stdout:3/45: getdents d2 0 2024-03-19T06:05:30.936 INFO:tasks.workunit.client.1.smithi172.stdout:8/428: write d0/f2d [1174419,33945] 0 2024-03-19T06:05:30.936 INFO:tasks.workunit.client.0.smithi072.stdout:3/46: fsync d2/f8 0 2024-03-19T06:05:30.937 INFO:tasks.workunit.client.1.smithi172.stdout:6/573: read d5/d8f/f70 [923089,108223] 0 2024-03-19T06:05:30.938 INFO:tasks.workunit.client.0.smithi072.stdout:8/25: truncate f4 709645 0 2024-03-19T06:05:30.939 INFO:tasks.workunit.client.1.smithi172.stdout:4/533: rename df/d2b/d2d/d9c to df/d2b/d2d/db0 0 2024-03-19T06:05:30.939 INFO:tasks.workunit.client.1.smithi172.stdout:9/454: dread d1/f28 [0,4194304] 0 2024-03-19T06:05:30.939 INFO:tasks.workunit.client.0.smithi072.stdout:3/47: write d2/d3/fc [891689,35161] 0 2024-03-19T06:05:30.943 INFO:tasks.workunit.client.0.smithi072.stdout:3/48: mknod d2/cf 0 2024-03-19T06:05:30.947 INFO:tasks.workunit.client.0.smithi072.stdout:5/32: dwrite f0 [4194304,4194304] 0 2024-03-19T06:05:30.948 INFO:tasks.workunit.client.1.smithi172.stdout:0/486: rename d11/d18/d38/d3f/d43/d62/f69 to d11/d4d/fa0 0 2024-03-19T06:05:30.949 INFO:tasks.workunit.client.0.smithi072.stdout:5/33: write f0 [2170329,105587] 0 2024-03-19T06:05:30.949 INFO:tasks.workunit.client.1.smithi172.stdout:3/473: dread d0/d5/d9/d60/d67/f73 [0,4194304] 0 2024-03-19T06:05:30.951 INFO:tasks.workunit.client.1.smithi172.stdout:4/534: rmdir df/d11/d12 39 2024-03-19T06:05:30.951 INFO:tasks.workunit.client.0.smithi072.stdout:3/49: rename d2/f8 to d2/d3/f10 0 2024-03-19T06:05:30.952 INFO:tasks.workunit.client.0.smithi072.stdout:5/34: read f6 [459868,103301] 0 2024-03-19T06:05:30.953 INFO:tasks.workunit.client.0.smithi072.stdout:5/35: read f0 [4149895,25273] 0 2024-03-19T06:05:30.953 INFO:tasks.workunit.client.0.smithi072.stdout:3/50: write d2/f5 [3052798,6465] 0 2024-03-19T06:05:30.955 INFO:tasks.workunit.client.1.smithi172.stdout:0/487: dread - d11/d18/d38/d3f/d43/f7b zero size 2024-03-19T06:05:30.955 INFO:tasks.workunit.client.1.smithi172.stdout:3/474: chown d0/d5/d9/f5b 93086 1 2024-03-19T06:05:30.956 INFO:tasks.workunit.client.0.smithi072.stdout:3/51: write d2/d3/fc [801631,88971] 0 2024-03-19T06:05:30.958 INFO:tasks.workunit.client.0.smithi072.stdout:5/36: creat f7 x:0 0 0 2024-03-19T06:05:30.958 INFO:tasks.workunit.client.1.smithi172.stdout:3/475: read - d0/d5/d9/d34/d4d/f5c zero size 2024-03-19T06:05:30.959 INFO:tasks.workunit.client.0.smithi072.stdout:3/52: write d2/f5 [2273608,16546] 0 2024-03-19T06:05:30.963 INFO:tasks.workunit.client.1.smithi172.stdout:8/429: getdents d0/d61 0 2024-03-19T06:05:30.965 INFO:tasks.workunit.client.0.smithi072.stdout:3/53: write d2/d3/fb [4998751,16559] 0 2024-03-19T06:05:30.967 INFO:tasks.workunit.client.0.smithi072.stdout:5/37: dread f6 [0,4194304] 0 2024-03-19T06:05:30.968 INFO:tasks.workunit.client.1.smithi172.stdout:0/488: rename d11/d18/l5b to d11/d14/la1 0 2024-03-19T06:05:30.970 INFO:tasks.workunit.client.0.smithi072.stdout:5/38: symlink l8 0 2024-03-19T06:05:30.971 INFO:tasks.workunit.client.1.smithi172.stdout:9/455: dwrite d1/d7/dc/de/d34/d48/f5f [0,4194304] 0 2024-03-19T06:05:30.973 INFO:tasks.workunit.client.0.smithi072.stdout:3/54: dread d2/d3/fc [0,4194304] 0 2024-03-19T06:05:30.974 INFO:tasks.workunit.client.0.smithi072.stdout:5/39: unlink l2 0 2024-03-19T06:05:30.974 INFO:tasks.workunit.client.1.smithi172.stdout:9/456: chown d1/d7/dc/l3f 1010 1 2024-03-19T06:05:30.975 INFO:tasks.workunit.client.1.smithi172.stdout:0/489: creat d11/d22/d68/fa2 x:0 0 0 2024-03-19T06:05:30.977 INFO:tasks.workunit.client.0.smithi072.stdout:5/40: write f0 [4833432,63312] 0 2024-03-19T06:05:30.981 INFO:tasks.workunit.client.1.smithi172.stdout:9/457: write d1/f75 [955837,7767] 0 2024-03-19T06:05:30.981 INFO:tasks.workunit.client.1.smithi172.stdout:0/490: stat d11/d22/d32/l4c 0 2024-03-19T06:05:30.986 INFO:tasks.workunit.client.1.smithi172.stdout:5/428: sync 2024-03-19T06:05:30.987 INFO:tasks.workunit.client.0.smithi072.stdout:8/26: mknod c7 0 2024-03-19T06:05:30.989 INFO:tasks.workunit.client.0.smithi072.stdout:3/55: dwrite f0 [0,4194304] 0 2024-03-19T06:05:30.989 INFO:tasks.workunit.client.1.smithi172.stdout:9/458: write d1/d7/dc/d47/d78/f79 [574940,11785] 0 2024-03-19T06:05:30.989 INFO:tasks.workunit.client.1.smithi172.stdout:3/476: dwrite d0/d5/d9/d25/f93 [0,4194304] 0 2024-03-19T06:05:30.992 INFO:tasks.workunit.client.1.smithi172.stdout:0/491: truncate d11/d22/d46/f9e 105568 0 2024-03-19T06:05:30.992 INFO:tasks.workunit.client.1.smithi172.stdout:3/477: fsync d0/d5/d9/fd 0 2024-03-19T06:05:30.993 INFO:tasks.workunit.client.0.smithi072.stdout:3/56: write d2/d3/f10 [970462,79282] 0 2024-03-19T06:05:30.994 INFO:tasks.workunit.client.1.smithi172.stdout:6/574: dread d5/d11/d2f/f6d [0,4194304] 0 2024-03-19T06:05:30.997 INFO:tasks.workunit.client.0.smithi072.stdout:3/57: symlink d2/d3/l11 0 2024-03-19T06:05:30.998 INFO:tasks.workunit.client.0.smithi072.stdout:3/58: write f0 [5110,36998] 0 2024-03-19T06:05:31.000 INFO:tasks.workunit.client.1.smithi172.stdout:8/430: dwrite d0/d61/d6a/d7e/f7f [0,4194304] 0 2024-03-19T06:05:31.002 INFO:tasks.workunit.client.1.smithi172.stdout:9/459: mknod d1/d7/dc/d23/ca2 0 2024-03-19T06:05:31.003 INFO:tasks.workunit.client.1.smithi172.stdout:8/431: fdatasync d0/d44/f62 0 2024-03-19T06:05:31.007 INFO:tasks.workunit.client.1.smithi172.stdout:6/575: rmdir d5/d8f/d31/d7b 39 2024-03-19T06:05:31.010 INFO:tasks.workunit.client.1.smithi172.stdout:8/432: readlink d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/l70 0 2024-03-19T06:05:31.011 INFO:tasks.workunit.client.1.smithi172.stdout:0/492: creat d11/d18/d38/d3f/d8b/fa3 x:0 0 0 2024-03-19T06:05:31.013 INFO:tasks.workunit.client.1.smithi172.stdout:9/460: rename d1/d7/dc/d47/d78/d57 to d1/d7/dc/d47/da3 0 2024-03-19T06:05:31.015 INFO:tasks.workunit.client.1.smithi172.stdout:0/493: dread - d11/d18/d38/d3f/d8b/fa3 zero size 2024-03-19T06:05:31.016 INFO:tasks.workunit.client.1.smithi172.stdout:3/478: getdents d0/d5/d9/d34/d4d 0 2024-03-19T06:05:31.017 INFO:tasks.workunit.client.1.smithi172.stdout:8/433: creat d0/d44/d46/f87 x:0 0 0 2024-03-19T06:05:31.017 INFO:tasks.workunit.client.1.smithi172.stdout:6/576: mkdir d5/d8f/d31/db8 0 2024-03-19T06:05:31.019 INFO:tasks.workunit.client.1.smithi172.stdout:0/494: truncate d11/d22/d68/fa2 496636 0 2024-03-19T06:05:31.020 INFO:tasks.workunit.client.0.smithi072.stdout:3/59: dwrite d2/d3/f10 [0,4194304] 0 2024-03-19T06:05:31.020 INFO:tasks.workunit.client.1.smithi172.stdout:6/577: chown d5/d11/d43 15 1 2024-03-19T06:05:31.020 INFO:tasks.workunit.client.0.smithi072.stdout:8/27: creat f8 x:0 0 0 2024-03-19T06:05:31.022 INFO:tasks.workunit.client.0.smithi072.stdout:5/41: getdents . 0 2024-03-19T06:05:31.024 INFO:tasks.workunit.client.0.smithi072.stdout:5/42: write f7 [446137,88973] 0 2024-03-19T06:05:31.026 INFO:tasks.workunit.client.0.smithi072.stdout:8/28: creat f9 x:0 0 0 2024-03-19T06:05:31.027 INFO:tasks.workunit.client.0.smithi072.stdout:5/43: write f6 [1105863,65667] 0 2024-03-19T06:05:31.029 INFO:tasks.workunit.client.0.smithi072.stdout:8/29: write f9 [559969,63758] 0 2024-03-19T06:05:31.034 INFO:tasks.workunit.client.0.smithi072.stdout:8/30: unlink c7 0 2024-03-19T06:05:31.038 INFO:tasks.workunit.client.0.smithi072.stdout:8/31: mkdir da 0 2024-03-19T06:05:31.039 INFO:tasks.workunit.client.0.smithi072.stdout:3/60: dwrite d2/d3/f10 [0,4194304] 0 2024-03-19T06:05:31.041 INFO:tasks.workunit.client.0.smithi072.stdout:8/32: chown f6 130609130 1 2024-03-19T06:05:31.047 INFO:tasks.workunit.client.0.smithi072.stdout:3/61: dread d2/d3/fc [0,4194304] 0 2024-03-19T06:05:31.047 INFO:tasks.workunit.client.0.smithi072.stdout:5/44: dwrite f7 [0,4194304] 0 2024-03-19T06:05:31.048 INFO:tasks.workunit.client.0.smithi072.stdout:3/62: chown d2/c4 218 1 2024-03-19T06:05:31.051 INFO:tasks.workunit.client.0.smithi072.stdout:5/45: creat f9 x:0 0 0 2024-03-19T06:05:31.052 INFO:tasks.workunit.client.0.smithi072.stdout:3/63: fsync f1 0 2024-03-19T06:05:31.052 INFO:tasks.workunit.client.0.smithi072.stdout:3/64: readlink d2/l7 0 2024-03-19T06:05:31.053 INFO:tasks.workunit.client.0.smithi072.stdout:5/46: creat fa x:0 0 0 2024-03-19T06:05:31.054 INFO:tasks.workunit.client.0.smithi072.stdout:3/65: readlink d2/d3/le 0 2024-03-19T06:05:31.055 INFO:tasks.workunit.client.0.smithi072.stdout:5/47: chown l8 99 1 2024-03-19T06:05:31.055 INFO:tasks.workunit.client.0.smithi072.stdout:5/48: readlink l8 0 2024-03-19T06:05:31.056 INFO:tasks.workunit.client.0.smithi072.stdout:5/49: read f7 [1685459,13491] 0 2024-03-19T06:05:31.057 INFO:tasks.workunit.client.0.smithi072.stdout:3/66: symlink d2/l12 0 2024-03-19T06:05:31.060 INFO:tasks.workunit.client.0.smithi072.stdout:5/50: chown fa 9 1 2024-03-19T06:05:31.064 INFO:tasks.workunit.client.0.smithi072.stdout:5/51: rename f0 to fb 0 2024-03-19T06:05:31.065 INFO:tasks.workunit.client.0.smithi072.stdout:5/52: chown f6 911084 1 2024-03-19T06:05:31.066 INFO:tasks.workunit.client.0.smithi072.stdout:5/53: fdatasync f9 0 2024-03-19T06:05:31.067 INFO:tasks.workunit.client.0.smithi072.stdout:8/33: dwrite f4 [0,4194304] 0 2024-03-19T06:05:31.069 INFO:tasks.workunit.client.0.smithi072.stdout:5/54: symlink lc 0 2024-03-19T06:05:31.070 INFO:tasks.workunit.client.0.smithi072.stdout:5/55: truncate f9 530228 0 2024-03-19T06:05:31.070 INFO:tasks.workunit.client.0.smithi072.stdout:8/34: mknod da/cb 0 2024-03-19T06:05:31.074 INFO:tasks.workunit.client.0.smithi072.stdout:8/35: creat da/fc x:0 0 0 2024-03-19T06:05:31.075 INFO:tasks.workunit.client.0.smithi072.stdout:8/36: chown f8 1938652 1 2024-03-19T06:05:31.078 INFO:tasks.workunit.client.0.smithi072.stdout:3/67: truncate d2/d3/fc 541285 0 2024-03-19T06:05:31.079 INFO:tasks.workunit.client.0.smithi072.stdout:3/68: truncate f0 4324839 0 2024-03-19T06:05:31.081 INFO:tasks.workunit.client.0.smithi072.stdout:5/56: dread f7 [0,4194304] 0 2024-03-19T06:05:31.101 INFO:tasks.workunit.client.1.smithi172.stdout:9/461: rmdir d1/d7/dc/d47/da3 39 2024-03-19T06:05:31.101 INFO:tasks.workunit.client.1.smithi172.stdout:8/434: chown d0/d44/d46/d49/d26/d71/d81/d27 53043 1 2024-03-19T06:05:31.101 INFO:tasks.workunit.client.1.smithi172.stdout:6/578: chown d5/d11/d17/da4 7 1 2024-03-19T06:05:31.103 INFO:tasks.workunit.client.1.smithi172.stdout:3/479: write d0/d5/d9/d34/f8b [1158456,123130] 0 2024-03-19T06:05:31.104 INFO:tasks.workunit.client.1.smithi172.stdout:0/495: symlink d11/d18/d38/d3f/d9f/la4 0 2024-03-19T06:05:31.105 INFO:tasks.workunit.client.1.smithi172.stdout:8/435: write d0/d44/f62 [1728740,102647] 0 2024-03-19T06:05:31.105 INFO:tasks.workunit.client.0.smithi072.stdout:3/69: dwrite f1 [4194304,4194304] 0 2024-03-19T06:05:31.106 INFO:tasks.workunit.client.0.smithi072.stdout:8/37: dwrite f6 [0,4194304] 0 2024-03-19T06:05:31.107 INFO:tasks.workunit.client.1.smithi172.stdout:9/462: chown d1/d7/dc/d23/d65/c66 7582070 1 2024-03-19T06:05:31.110 INFO:tasks.workunit.client.0.smithi072.stdout:8/38: dread - da/fc zero size 2024-03-19T06:05:31.110 INFO:tasks.workunit.client.0.smithi072.stdout:5/57: dwrite f7 [4194304,4194304] 0 2024-03-19T06:05:31.111 INFO:tasks.workunit.client.1.smithi172.stdout:0/496: mkdir d11/d18/da5 0 2024-03-19T06:05:31.112 INFO:tasks.workunit.client.1.smithi172.stdout:3/480: write d0/d5/d9/d60/d67/f73 [4174220,58380] 0 2024-03-19T06:05:31.115 INFO:tasks.workunit.client.0.smithi072.stdout:8/39: write f8 [827551,110277] 0 2024-03-19T06:05:31.116 INFO:tasks.workunit.client.1.smithi172.stdout:8/436: rename d0/d44/f79 to d0/d44/f88 0 2024-03-19T06:05:31.118 INFO:tasks.workunit.client.1.smithi172.stdout:0/497: creat d11/d22/d68/fa6 x:0 0 0 2024-03-19T06:05:31.121 INFO:tasks.workunit.client.0.smithi072.stdout:8/40: unlink f6 0 2024-03-19T06:05:31.121 INFO:tasks.workunit.client.1.smithi172.stdout:3/481: rmdir d0/d5/d9/d54/d77 39 2024-03-19T06:05:31.123 INFO:tasks.workunit.client.0.smithi072.stdout:8/41: rename da to da/dd 22 2024-03-19T06:05:31.123 INFO:tasks.workunit.client.1.smithi172.stdout:8/437: mknod d0/d44/d46/d49/c89 0 2024-03-19T06:05:31.123 INFO:tasks.workunit.client.1.smithi172.stdout:0/498: truncate d11/d14/d2c/d4e/f64 1907789 0 2024-03-19T06:05:31.127 INFO:tasks.workunit.client.1.smithi172.stdout:6/579: write d5/d11/d43/f4c [4600849,652] 0 2024-03-19T06:05:31.129 INFO:tasks.workunit.client.0.smithi072.stdout:8/42: mknod da/ce 0 2024-03-19T06:05:31.131 INFO:tasks.workunit.client.1.smithi172.stdout:3/482: symlink d0/d5/d9/d54/d77/la4 0 2024-03-19T06:05:31.134 INFO:tasks.workunit.client.1.smithi172.stdout:0/499: rename d11/d14/d2c/c72 to d11/d14/d9a/ca7 0 2024-03-19T06:05:31.135 INFO:tasks.workunit.client.1.smithi172.stdout:9/463: dwrite d1/d7/dc/de/d34/d48/f70 [0,4194304] 0 2024-03-19T06:05:31.136 INFO:tasks.workunit.client.0.smithi072.stdout:8/43: write da/fc [623726,81421] 0 2024-03-19T06:05:31.138 INFO:tasks.workunit.client.1.smithi172.stdout:6/580: creat d5/d11/d43/fb9 x:0 0 0 2024-03-19T06:05:31.140 INFO:tasks.workunit.client.1.smithi172.stdout:3/483: mknod d0/d37/ca5 0 2024-03-19T06:05:31.140 INFO:tasks.workunit.client.1.smithi172.stdout:8/438: link d0/d44/d46/f60 d0/d44/d46/d49/d4f/d5c/f8a 0 2024-03-19T06:05:31.141 INFO:tasks.workunit.client.0.smithi072.stdout:8/44: write da/fc [1112434,83938] 0 2024-03-19T06:05:31.143 INFO:tasks.workunit.client.0.smithi072.stdout:5/58: dwrite f9 [0,4194304] 0 2024-03-19T06:05:31.143 INFO:tasks.workunit.client.0.smithi072.stdout:3/70: dwrite f0 [0,4194304] 0 2024-03-19T06:05:31.145 INFO:tasks.workunit.client.1.smithi172.stdout:0/500: mkdir d11/d18/da5/da8 0 2024-03-19T06:05:31.147 INFO:tasks.workunit.client.0.smithi072.stdout:5/59: chown c5 333 1 2024-03-19T06:05:31.148 INFO:tasks.workunit.client.1.smithi172.stdout:6/581: creat d5/d8f/d31/d7b/fba x:0 0 0 2024-03-19T06:05:31.148 INFO:tasks.workunit.client.0.smithi072.stdout:5/60: stat fb 0 2024-03-19T06:05:31.149 INFO:tasks.workunit.client.1.smithi172.stdout:8/439: fdatasync d0/d44/d46/d49/d26/d71/d81/d27/d29/d59/f47 0 2024-03-19T06:05:31.154 INFO:tasks.workunit.client.0.smithi072.stdout:5/61: rename fa to fd 0 2024-03-19T06:05:31.156 INFO:tasks.workunit.client.0.smithi072.stdout:3/71: dread d2/d3/fc [0,4194304] 0 2024-03-19T06:05:31.156 INFO:tasks.workunit.client.0.smithi072.stdout:5/62: fsync f7 0 2024-03-19T06:05:31.156 INFO:tasks.workunit.client.1.smithi172.stdout:6/582: creat d5/d11/d2f/fbb x:0 0 0 2024-03-19T06:05:31.157 INFO:tasks.workunit.client.0.smithi072.stdout:5/63: chown c4 290915616 1 2024-03-19T06:05:31.159 INFO:tasks.workunit.client.1.smithi172.stdout:9/464: dread d1/d7/dc/de/d34/d48/f70 [0,4194304] 0 2024-03-19T06:05:31.160 INFO:tasks.workunit.client.1.smithi172.stdout:0/501: getdents d11/d18/da5 0 2024-03-19T06:05:31.162 INFO:tasks.workunit.client.1.smithi172.stdout:8/440: mkdir d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b 0 2024-03-19T06:05:31.163 INFO:tasks.workunit.client.0.smithi072.stdout:8/45: truncate f4 1536829 0 2024-03-19T06:05:31.169 INFO:tasks.workunit.client.1.smithi172.stdout:3/484: dwrite d0/d5/d9/d60/d67/f84 [0,4194304] 0 2024-03-19T06:05:31.169 INFO:tasks.workunit.client.0.smithi072.stdout:5/64: dread f7 [4194304,4194304] 0 2024-03-19T06:05:31.171 INFO:tasks.workunit.client.1.smithi172.stdout:8/441: readlink d0/d44/d46/d49/d26/d71/d81/d27/d29/l42 0 2024-03-19T06:05:31.171 INFO:tasks.workunit.client.1.smithi172.stdout:6/583: dread d5/d11/d17/d1b/d74/faa [0,4194304] 0 2024-03-19T06:05:31.172 INFO:tasks.workunit.client.1.smithi172.stdout:6/584: dread - d5/d11/d17/f93 zero size 2024-03-19T06:05:31.173 INFO:tasks.workunit.client.0.smithi072.stdout:5/65: rename f9 to fe 0 2024-03-19T06:05:31.173 INFO:tasks.workunit.client.1.smithi172.stdout:3/485: chown d0/d5/d9/d34/d4d/d6c/c75 375582 1 2024-03-19T06:05:31.175 INFO:tasks.workunit.client.1.smithi172.stdout:0/502: getdents d11/d22 0 2024-03-19T06:05:31.175 INFO:tasks.workunit.client.1.smithi172.stdout:6/585: dread - d5/d8f/d31/f60 zero size 2024-03-19T06:05:31.175 INFO:tasks.workunit.client.0.smithi072.stdout:5/66: mkdir df 0 2024-03-19T06:05:31.177 INFO:tasks.workunit.client.0.smithi072.stdout:8/46: dwrite da/fc [0,4194304] 0 2024-03-19T06:05:31.178 INFO:tasks.workunit.client.0.smithi072.stdout:5/67: write f7 [5685094,117263] 0 2024-03-19T06:05:31.181 INFO:tasks.workunit.client.1.smithi172.stdout:6/586: write d5/d11/d17/d1b/f25 [3468065,66336] 0 2024-03-19T06:05:31.181 INFO:tasks.workunit.client.1.smithi172.stdout:3/486: creat d0/d5/d9/d3a/fa6 x:0 0 0 2024-03-19T06:05:31.185 INFO:tasks.workunit.client.1.smithi172.stdout:6/587: chown d5/d11/d43/d45/c7a 8880310 1 2024-03-19T06:05:31.187 INFO:tasks.workunit.client.0.smithi072.stdout:5/68: dread f6 [0,4194304] 0 2024-03-19T06:05:31.192 INFO:tasks.workunit.client.1.smithi172.stdout:1/514: sync 2024-03-19T06:05:31.193 INFO:tasks.workunit.client.1.smithi172.stdout:0/503: rename d11/d14/d2c/d36/c6d to d11/d22/ca9 0 2024-03-19T06:05:31.194 INFO:tasks.workunit.client.0.smithi072.stdout:5/69: symlink df/l10 0 2024-03-19T06:05:31.195 INFO:tasks.workunit.client.1.smithi172.stdout:6/588: mkdir d5/d11/d17/d1b/d74/dbc 0 2024-03-19T06:05:31.198 INFO:tasks.workunit.client.1.smithi172.stdout:9/465: dwrite d1/d7/dc/d47/da3/f74 [0,4194304] 0 2024-03-19T06:05:31.200 INFO:tasks.workunit.client.1.smithi172.stdout:3/487: truncate d0/d5/f3d 1335865 0 2024-03-19T06:05:31.200 INFO:tasks.workunit.client.1.smithi172.stdout:1/515: dread - da/dd/d10/d14/d27/d53/f71 zero size 2024-03-19T06:05:31.203 INFO:tasks.workunit.client.1.smithi172.stdout:0/504: symlink d11/d18/d38/d3f/d43/laa 0 2024-03-19T06:05:31.203 INFO:tasks.workunit.client.1.smithi172.stdout:6/589: chown d5/d11/c39 783904032 1 2024-03-19T06:05:31.205 INFO:tasks.workunit.client.1.smithi172.stdout:8/442: dwrite d0/d44/d46/d49/d26/d71/d81/d27/f1e [0,4194304] 0 2024-03-19T06:05:31.205 INFO:tasks.workunit.client.1.smithi172.stdout:3/488: readlink d0/d5/d14/la1 0 2024-03-19T06:05:31.208 INFO:tasks.workunit.client.1.smithi172.stdout:0/505: chown d11/d14/d2c/d36/f8c 203 1 2024-03-19T06:05:31.208 INFO:tasks.workunit.client.1.smithi172.stdout:3/489: chown d0/d5/d14/f30 8110916 1 2024-03-19T06:05:31.208 INFO:tasks.workunit.client.1.smithi172.stdout:9/466: creat d1/d7/dc/de/d34/d48/fa4 x:0 0 0 2024-03-19T06:05:31.210 INFO:tasks.workunit.client.0.smithi072.stdout:8/47: fsync da/fc 0 2024-03-19T06:05:31.210 INFO:tasks.workunit.client.1.smithi172.stdout:8/443: write d0/d44/d46/d49/d26/d71/d81/f6d [408372,45244] 0 2024-03-19T06:05:31.210 INFO:tasks.workunit.client.1.smithi172.stdout:9/467: chown d1/cb 0 1 2024-03-19T06:05:31.211 INFO:tasks.workunit.client.0.smithi072.stdout:8/48: rename da to da/df 22 2024-03-19T06:05:31.212 INFO:tasks.workunit.client.0.smithi072.stdout:5/70: dwrite fb [8388608,4194304] 0 2024-03-19T06:05:31.212 INFO:tasks.workunit.client.0.smithi072.stdout:5/71: readlink df/l10 0 2024-03-19T06:05:31.214 INFO:tasks.workunit.client.1.smithi172.stdout:0/506: mkdir d11/d4d/dab 0 2024-03-19T06:05:31.214 INFO:tasks.workunit.client.0.smithi072.stdout:8/49: mknod da/c10 0 2024-03-19T06:05:31.215 INFO:tasks.workunit.client.0.smithi072.stdout:8/50: fdatasync da/fc 0 2024-03-19T06:05:31.216 INFO:tasks.workunit.client.0.smithi072.stdout:5/72: mkdir df/d11 0 2024-03-19T06:05:31.216 INFO:tasks.workunit.client.0.smithi072.stdout:8/51: fdatasync f8 0 2024-03-19T06:05:31.216 INFO:tasks.workunit.client.0.smithi072.stdout:8/52: readlink - no filename 2024-03-19T06:05:31.217 INFO:tasks.workunit.client.1.smithi172.stdout:8/444: chown d0/d61/d6a/d7e 6 1 2024-03-19T06:05:31.221 INFO:tasks.workunit.client.1.smithi172.stdout:1/516: mknod da/dd/d10/d14/d27/da7/caf 0 2024-03-19T06:05:31.221 INFO:tasks.workunit.client.1.smithi172.stdout:3/490: rename d0/d5/d9/d34/d82 to d0/d37/da7 0 2024-03-19T06:05:31.221 INFO:tasks.workunit.client.0.smithi072.stdout:5/73: rename f6 to df/d11/f12 0 2024-03-19T06:05:31.222 INFO:tasks.workunit.client.1.smithi172.stdout:9/468: mkdir d1/d7/dc/d47/da5 0 2024-03-19T06:05:31.225 INFO:tasks.workunit.client.0.smithi072.stdout:5/74: mkdir df/d13 0 2024-03-19T06:05:31.227 INFO:tasks.workunit.client.0.smithi072.stdout:5/75: fdatasync fe 0 2024-03-19T06:05:31.228 INFO:tasks.workunit.client.1.smithi172.stdout:9/469: mknod d1/d7/dc/d23/d65/ca6 0 2024-03-19T06:05:31.230 INFO:tasks.workunit.client.0.smithi072.stdout:5/76: read fe [3627549,112936] 0 2024-03-19T06:05:31.234 INFO:tasks.workunit.client.0.smithi072.stdout:5/77: mkdir df/d14 0 2024-03-19T06:05:31.235 INFO:tasks.workunit.client.0.smithi072.stdout:5/78: readlink lc 0 2024-03-19T06:05:31.236 INFO:tasks.workunit.client.0.smithi072.stdout:8/53: dwrite f9 [0,4194304] 0 2024-03-19T06:05:31.236 INFO:tasks.workunit.client.0.smithi072.stdout:5/79: read f7 [6434270,11801] 0 2024-03-19T06:05:31.240 INFO:tasks.workunit.client.0.smithi072.stdout:8/54: creat da/f11 x:0 0 0 2024-03-19T06:05:31.246 INFO:tasks.workunit.client.0.smithi072.stdout:5/80: creat df/d14/f15 x:0 0 0 2024-03-19T06:05:31.252 INFO:tasks.workunit.client.1.smithi172.stdout:7/431: sync 2024-03-19T06:05:31.253 INFO:tasks.workunit.client.1.smithi172.stdout:1/517: dwrite da/dd/d10/f2f [0,4194304] 0 2024-03-19T06:05:31.260 INFO:tasks.workunit.client.1.smithi172.stdout:6/590: dread d5/fb [4194304,4194304] 0 2024-03-19T06:05:31.269 INFO:tasks.workunit.client.1.smithi172.stdout:9/470: dwrite d1/d7/dc/de/d34/f41 [0,4194304] 0 2024-03-19T06:05:31.271 INFO:tasks.workunit.client.0.smithi072.stdout:8/55: rmdir da 39 2024-03-19T06:05:31.271 INFO:tasks.workunit.client.1.smithi172.stdout:8/445: truncate d0/d44/d46/d49/f5d 1569545 0 2024-03-19T06:05:31.272 INFO:tasks.workunit.client.1.smithi172.stdout:0/507: dread d11/d18/d38/d3f/d43/d62/f74 [0,4194304] 0 2024-03-19T06:05:31.274 INFO:tasks.workunit.client.1.smithi172.stdout:6/591: truncate d5/d8f/d31/d7b/fba 1030758 0 2024-03-19T06:05:31.276 INFO:tasks.workunit.client.0.smithi072.stdout:5/81: getdents df/d14 0 2024-03-19T06:05:31.279 INFO:tasks.workunit.client.1.smithi172.stdout:7/432: link d0/d22/d1d/l49 d0/d22/d1d/d36/d8d/d5c/l98 0 2024-03-19T06:05:31.282 INFO:tasks.workunit.client.1.smithi172.stdout:1/518: dwrite da/dd/f1f [0,4194304] 0 2024-03-19T06:05:31.282 INFO:tasks.workunit.client.1.smithi172.stdout:0/508: write d11/d22/d46/d84/f93 [93418,71500] 0 2024-03-19T06:05:31.284 INFO:tasks.workunit.client.1.smithi172.stdout:3/491: dwrite d0/d5/f11 [0,4194304] 0 2024-03-19T06:05:31.290 INFO:tasks.workunit.client.1.smithi172.stdout:6/592: rename d5/d11/d2f/l4e to d5/d11/d17/d36/d48/lbd 0 2024-03-19T06:05:31.291 INFO:tasks.workunit.client.0.smithi072.stdout:8/56: dwrite da/fc [0,4194304] 0 2024-03-19T06:05:31.295 INFO:tasks.workunit.client.1.smithi172.stdout:6/593: readlink d5/l59 0 2024-03-19T06:05:31.295 INFO:tasks.workunit.client.1.smithi172.stdout:9/471: getdents d1/d7/dc/d47 0 2024-03-19T06:05:31.296 INFO:tasks.workunit.client.1.smithi172.stdout:9/472: fdatasync d1/f75 0 2024-03-19T06:05:31.297 INFO:tasks.workunit.client.1.smithi172.stdout:7/433: creat d0/d22/d1d/d3a/d46/f99 x:0 0 0 2024-03-19T06:05:31.303 INFO:tasks.workunit.client.1.smithi172.stdout:4/535: sync 2024-03-19T06:05:31.303 INFO:tasks.workunit.client.1.smithi172.stdout:5/429: sync 2024-03-19T06:05:31.303 INFO:tasks.workunit.client.1.smithi172.stdout:0/509: creat d11/d18/da5/da8/fac x:0 0 0 2024-03-19T06:05:31.303 INFO:tasks.workunit.client.1.smithi172.stdout:2/441: sync 2024-03-19T06:05:31.305 INFO:tasks.workunit.client.0.smithi072.stdout:5/82: dwrite df/d11/f12 [0,4194304] 0 2024-03-19T06:05:31.307 INFO:tasks.workunit.client.1.smithi172.stdout:7/434: chown d0/d22/d1d/f7b 35002 1 2024-03-19T06:05:31.307 INFO:tasks.workunit.client.0.smithi072.stdout:5/83: stat fb 0 2024-03-19T06:05:31.308 INFO:tasks.workunit.client.1.smithi172.stdout:1/519: rename da/dd/d10/d14/f2e to da/fb0 0 2024-03-19T06:05:31.309 INFO:tasks.workunit.client.0.smithi072.stdout:8/57: dread f9 [0,4194304] 0 2024-03-19T06:05:31.312 INFO:tasks.workunit.client.1.smithi172.stdout:5/430: write d5/d1f/d2f/f46 [740187,118962] 0 2024-03-19T06:05:31.315 INFO:tasks.workunit.client.0.smithi072.stdout:5/84: mkdir df/d16 0 2024-03-19T06:05:31.316 INFO:tasks.workunit.client.1.smithi172.stdout:9/473: dread d1/f75 [0,4194304] 0 2024-03-19T06:05:31.317 INFO:tasks.workunit.client.0.smithi072.stdout:5/85: read fb [7916023,116266] 0 2024-03-19T06:05:31.320 INFO:tasks.workunit.client.1.smithi172.stdout:2/442: creat d7/de/d58/d56/d86/f92 x:0 0 0 2024-03-19T06:05:31.320 INFO:tasks.workunit.client.1.smithi172.stdout:0/510: read d11/d22/d32/f35 [1650127,113459] 0 2024-03-19T06:05:31.321 INFO:tasks.workunit.client.0.smithi072.stdout:8/58: dread da/fc [0,4194304] 0 2024-03-19T06:05:31.325 INFO:tasks.workunit.client.1.smithi172.stdout:4/536: link df/d45/c52 df/d45/cb1 0 2024-03-19T06:05:31.325 INFO:tasks.workunit.client.0.smithi072.stdout:8/59: mknod da/c12 0 2024-03-19T06:05:31.327 INFO:tasks.workunit.client.0.smithi072.stdout:5/86: dread fe [0,4194304] 0 2024-03-19T06:05:31.327 INFO:tasks.workunit.client.1.smithi172.stdout:7/435: creat d0/f9a x:0 0 0 2024-03-19T06:05:31.337 INFO:tasks.workunit.client.1.smithi172.stdout:8/446: dwrite d0/d44/d46/d49/d26/d71/d81/d27/d29/d59/f47 [0,4194304] 0 2024-03-19T06:05:31.338 INFO:tasks.workunit.client.1.smithi172.stdout:4/537: write df/d11/f1d [4425322,110062] 0 2024-03-19T06:05:31.339 INFO:tasks.workunit.client.1.smithi172.stdout:7/436: write d0/d22/d1d/d36/d40/f93 [748541,112861] 0 2024-03-19T06:05:31.340 INFO:tasks.workunit.client.1.smithi172.stdout:1/520: truncate da/dd/d10/d14/d84/d9b/f9d 234972 0 2024-03-19T06:05:31.342 INFO:tasks.workunit.client.0.smithi072.stdout:5/87: creat df/f17 x:0 0 0 2024-03-19T06:05:31.342 INFO:tasks.workunit.client.1.smithi172.stdout:1/521: chown da/d33/f86 115437862 1 2024-03-19T06:05:31.344 INFO:tasks.workunit.client.0.smithi072.stdout:5/88: rename df/d14 to df/d14/d18 22 2024-03-19T06:05:31.344 INFO:tasks.workunit.client.1.smithi172.stdout:2/443: link d7/d1b/f69 d7/f93 0 2024-03-19T06:05:31.345 INFO:tasks.workunit.client.1.smithi172.stdout:7/437: stat d0/d2c 0 2024-03-19T06:05:31.348 INFO:tasks.workunit.client.1.smithi172.stdout:3/492: dread d0/d5/d9/d54/f70 [4194304,4194304] 0 2024-03-19T06:05:31.348 INFO:tasks.workunit.client.1.smithi172.stdout:2/444: fdatasync d7/db/d2c/d35/f44 0 2024-03-19T06:05:31.355 INFO:tasks.workunit.client.1.smithi172.stdout:5/431: dwrite d5/d14/d15/d40/d6a/f6d [4194304,4194304] 0 2024-03-19T06:05:31.360 INFO:tasks.workunit.client.1.smithi172.stdout:4/538: symlink df/d11/d12/d34/lb2 0 2024-03-19T06:05:31.360 INFO:tasks.workunit.client.1.smithi172.stdout:5/432: chown d5/d3c/d6c 21854 1 2024-03-19T06:05:31.364 INFO:tasks.workunit.client.1.smithi172.stdout:9/474: dread d1/d7/dc/d47/f61 [0,4194304] 0 2024-03-19T06:05:31.365 INFO:tasks.workunit.client.1.smithi172.stdout:4/539: chown df/d11/d12/d26/c6f 22032 1 2024-03-19T06:05:31.365 INFO:tasks.workunit.client.1.smithi172.stdout:5/433: chown d5/d1f/f82 274833 1 2024-03-19T06:05:31.368 INFO:tasks.workunit.client.0.smithi072.stdout:8/60: dwrite f4 [0,4194304] 0 2024-03-19T06:05:31.368 INFO:tasks.workunit.client.0.smithi072.stdout:5/89: dwrite f7 [0,4194304] 0 2024-03-19T06:05:31.371 INFO:tasks.workunit.client.0.smithi072.stdout:8/61: mkdir da/d13 0 2024-03-19T06:05:31.373 INFO:tasks.workunit.client.0.smithi072.stdout:5/90: mknod df/d14/c19 0 2024-03-19T06:05:31.374 INFO:tasks.workunit.client.0.smithi072.stdout:8/62: mkdir da/d13/d14 0 2024-03-19T06:05:31.377 INFO:tasks.workunit.client.0.smithi072.stdout:5/91: rename fd to df/d11/f1a 0 2024-03-19T06:05:31.378 INFO:tasks.workunit.client.0.smithi072.stdout:8/63: symlink da/l15 0 2024-03-19T06:05:31.380 INFO:tasks.workunit.client.1.smithi172.stdout:9/475: read d1/f6 [3034836,103762] 0 2024-03-19T06:05:31.382 INFO:tasks.workunit.client.1.smithi172.stdout:7/438: dwrite d0/f7c [0,4194304] 0 2024-03-19T06:05:31.387 INFO:tasks.workunit.client.1.smithi172.stdout:5/434: mknod d5/d14/c98 0 2024-03-19T06:05:31.392 INFO:tasks.workunit.client.1.smithi172.stdout:3/493: dwrite d0/d5/d9/d60/d67/f73 [0,4194304] 0 2024-03-19T06:05:31.392 INFO:tasks.workunit.client.0.smithi072.stdout:8/64: dread f9 [0,4194304] 0 2024-03-19T06:05:31.393 INFO:tasks.workunit.client.1.smithi172.stdout:2/445: dwrite d7/db/f62 [0,4194304] 0 2024-03-19T06:05:31.398 INFO:tasks.workunit.client.1.smithi172.stdout:7/439: write d0/d2c/f2f [138342,43640] 0 2024-03-19T06:05:31.400 INFO:tasks.workunit.client.1.smithi172.stdout:1/522: dread da/dd/d10/f2c [4194304,4194304] 0 2024-03-19T06:05:31.400 INFO:tasks.workunit.client.1.smithi172.stdout:0/511: dread f10 [0,4194304] 0 2024-03-19T06:05:31.406 INFO:tasks.workunit.client.1.smithi172.stdout:3/494: rmdir d0/d5/d9/d54 39 2024-03-19T06:05:31.407 INFO:tasks.workunit.client.1.smithi172.stdout:0/512: symlink d11/d22/d46/d84/lad 0 2024-03-19T06:05:31.409 INFO:tasks.workunit.client.1.smithi172.stdout:2/446: symlink d7/de/d58/d56/d86/l94 0 2024-03-19T06:05:31.413 INFO:tasks.workunit.client.1.smithi172.stdout:0/513: symlink d11/d18/da5/da8/lae 0 2024-03-19T06:05:31.415 INFO:tasks.workunit.client.1.smithi172.stdout:2/447: rmdir d7/db/d45 39 2024-03-19T06:05:31.424 INFO:tasks.workunit.client.0.smithi072.stdout:8/65: truncate f9 3179237 0 2024-03-19T06:05:31.424 INFO:tasks.workunit.client.1.smithi172.stdout:5/435: dread d5/d14/d15/d40/d6a/f6d [4194304,4194304] 0 2024-03-19T06:05:31.424 INFO:tasks.workunit.client.1.smithi172.stdout:3/495: rename d0/d5/d9 to d0/da8 0 2024-03-19T06:05:31.427 INFO:tasks.workunit.client.1.smithi172.stdout:9/476: dwrite d1/d7/dc/de/d34/d48/d89/f98 [0,4194304] 0 2024-03-19T06:05:31.427 INFO:tasks.workunit.client.0.smithi072.stdout:8/66: creat da/d13/f16 x:0 0 0 2024-03-19T06:05:31.428 INFO:tasks.workunit.client.1.smithi172.stdout:0/514: mkdir d11/d22/d32/daf 0 2024-03-19T06:05:31.430 INFO:tasks.workunit.client.1.smithi172.stdout:7/440: write d0/d22/d1d/d3a/d46/f78 [928361,104293] 0 2024-03-19T06:05:31.431 INFO:tasks.workunit.client.0.smithi072.stdout:8/67: creat da/d13/d14/f17 x:0 0 0 2024-03-19T06:05:31.432 INFO:tasks.workunit.client.1.smithi172.stdout:1/523: dwrite da/dd/d10/f24 [0,4194304] 0 2024-03-19T06:05:31.437 INFO:tasks.workunit.client.1.smithi172.stdout:7/441: read d0/d22/f6d [2849969,85637] 0 2024-03-19T06:05:31.441 INFO:tasks.workunit.client.1.smithi172.stdout:9/477: write d1/d7/dc/d23/f33 [736477,57509] 0 2024-03-19T06:05:31.443 INFO:tasks.workunit.client.1.smithi172.stdout:0/515: write d11/d18/d38/d3f/f5e [900069,77069] 0 2024-03-19T06:05:31.444 INFO:tasks.workunit.client.1.smithi172.stdout:2/448: link d7/de/d58/d55/d5f/d6a/f75 d7/de/d58/d55/d6e/f95 0 2024-03-19T06:05:31.445 INFO:tasks.workunit.client.1.smithi172.stdout:4/540: dwrite df/d11/d12/d21/d58/d60/f7a [0,4194304] 0 2024-03-19T06:05:31.448 INFO:tasks.workunit.client.0.smithi072.stdout:5/92: fdatasync f7 0 2024-03-19T06:05:31.450 INFO:tasks.workunit.client.1.smithi172.stdout:5/436: getdents d5/d1f/d2f/d62 0 2024-03-19T06:05:31.450 INFO:tasks.workunit.client.1.smithi172.stdout:9/478: rmdir d1/d7/dc/de/d34/d48 39 2024-03-19T06:05:31.451 INFO:tasks.workunit.client.0.smithi072.stdout:5/93: write df/d14/f15 [680071,2715] 0 2024-03-19T06:05:31.453 INFO:tasks.workunit.client.0.smithi072.stdout:5/94: fdatasync fe 0 2024-03-19T06:05:31.454 INFO:tasks.workunit.client.1.smithi172.stdout:3/496: link d0/da8/d34/d4d/d6c/d88/l8a d0/da8/d60/d67/la9 0 2024-03-19T06:05:31.454 INFO:tasks.workunit.client.1.smithi172.stdout:0/516: mknod d11/d14/d9a/cb0 0 2024-03-19T06:05:31.458 INFO:tasks.workunit.client.1.smithi172.stdout:4/541: rename df/d11/d12/d21/d50/f54 to df/d11/d12/d21/d50/d63/fb3 0 2024-03-19T06:05:31.459 INFO:tasks.workunit.client.0.smithi072.stdout:5/95: link df/d14/c19 df/d16/c1b 0 2024-03-19T06:05:31.460 INFO:tasks.workunit.client.1.smithi172.stdout:1/524: getdents da/dd/d10/d14/d27/da7 0 2024-03-19T06:05:31.461 INFO:tasks.workunit.client.0.smithi072.stdout:5/96: symlink df/d14/l1c 0 2024-03-19T06:05:31.462 INFO:tasks.workunit.client.1.smithi172.stdout:4/542: chown df/d11/d12/d26/c6f 2 1 2024-03-19T06:05:31.464 INFO:tasks.workunit.client.0.smithi072.stdout:5/97: mknod df/d13/c1d 0 2024-03-19T06:05:31.466 INFO:tasks.workunit.client.1.smithi172.stdout:6/594: sync 2024-03-19T06:05:31.468 INFO:tasks.workunit.client.1.smithi172.stdout:2/449: mknod d7/de/c96 0 2024-03-19T06:05:31.469 INFO:tasks.workunit.client.0.smithi072.stdout:5/98: dread df/d14/f15 [0,4194304] 0 2024-03-19T06:05:31.470 INFO:tasks.workunit.client.0.smithi072.stdout:5/99: dread - df/d11/f1a zero size 2024-03-19T06:05:31.471 INFO:tasks.workunit.client.1.smithi172.stdout:7/442: dwrite d0/d22/d35/f94 [0,4194304] 0 2024-03-19T06:05:31.472 INFO:tasks.workunit.client.1.smithi172.stdout:0/517: link d11/d18/d38/f8f d11/d18/da5/da8/fb1 0 2024-03-19T06:05:31.473 INFO:tasks.workunit.client.0.smithi072.stdout:5/100: mknod df/d14/c1e 0 2024-03-19T06:05:31.473 INFO:tasks.workunit.client.0.smithi072.stdout:5/101: read - df/f17 zero size 2024-03-19T06:05:31.477 INFO:tasks.workunit.client.0.smithi072.stdout:5/102: mknod df/c1f 0 2024-03-19T06:05:31.478 INFO:tasks.workunit.client.1.smithi172.stdout:5/437: dread d5/d14/d15/f24 [0,4194304] 0 2024-03-19T06:05:31.479 INFO:tasks.workunit.client.1.smithi172.stdout:9/479: dwrite d1/f1c [0,4194304] 0 2024-03-19T06:05:31.482 INFO:tasks.workunit.client.0.smithi072.stdout:5/103: symlink df/d13/l20 0 2024-03-19T06:05:31.483 INFO:tasks.workunit.client.1.smithi172.stdout:1/525: rename da/dd/d10/f2c to da/dd/d10/d14/d27/d3f/d5e/fb1 0 2024-03-19T06:05:31.484 INFO:tasks.workunit.client.1.smithi172.stdout:0/518: unlink d11/d22/d46/f98 0 2024-03-19T06:05:31.487 INFO:tasks.workunit.client.1.smithi172.stdout:1/526: chown da/dd/d10/d14/d27/d3f/d5e/dab/cae 7692 1 2024-03-19T06:05:31.487 INFO:tasks.workunit.client.1.smithi172.stdout:4/543: link df/d2b/d2d/f8c df/d2b/da3/fb4 0 2024-03-19T06:05:31.490 INFO:tasks.workunit.client.0.smithi072.stdout:5/104: rmdir df/d13 39 2024-03-19T06:05:31.492 INFO:tasks.workunit.client.1.smithi172.stdout:5/438: creat d5/d14/d15/d40/f99 x:0 0 0 2024-03-19T06:05:31.493 INFO:tasks.workunit.client.1.smithi172.stdout:1/527: read da/f77 [1346311,57562] 0 2024-03-19T06:05:31.493 INFO:tasks.workunit.client.0.smithi072.stdout:5/105: symlink df/d16/l21 0 2024-03-19T06:05:31.496 INFO:tasks.workunit.client.0.smithi072.stdout:5/106: unlink c4 0 2024-03-19T06:05:31.497 INFO:tasks.workunit.client.1.smithi172.stdout:9/480: mknod d1/d7/dc/d47/da3/d7d/ca7 0 2024-03-19T06:05:31.498 INFO:tasks.workunit.client.1.smithi172.stdout:6/595: rmdir d5/d11/d17/d1b/d74/dbc 0 2024-03-19T06:05:31.499 INFO:tasks.workunit.client.1.smithi172.stdout:5/439: creat d5/d14/d15/d40/d5c/f9a x:0 0 0 2024-03-19T06:05:31.500 INFO:tasks.workunit.client.0.smithi072.stdout:5/107: chown df/d16/c1b 0 1 2024-03-19T06:05:31.501 INFO:tasks.workunit.client.1.smithi172.stdout:1/528: unlink da/d33/d81/c89 0 2024-03-19T06:05:31.503 INFO:tasks.workunit.client.1.smithi172.stdout:0/519: dwrite d11/d22/f3d [0,4194304] 0 2024-03-19T06:05:31.503 INFO:tasks.workunit.client.1.smithi172.stdout:5/440: write d5/d14/d34/f75 [2002542,92677] 0 2024-03-19T06:05:31.503 INFO:tasks.workunit.client.0.smithi072.stdout:5/108: dread df/d14/f15 [0,4194304] 0 2024-03-19T06:05:31.504 INFO:tasks.workunit.client.1.smithi172.stdout:2/450: getdents d7/db/d45 0 2024-03-19T06:05:31.504 INFO:tasks.workunit.client.0.smithi072.stdout:5/109: chown df/d14/f15 1819629333 1 2024-03-19T06:05:31.505 INFO:tasks.workunit.client.1.smithi172.stdout:5/441: read d5/d3d/f8d [518480,13241] 0 2024-03-19T06:05:31.506 INFO:tasks.workunit.client.0.smithi072.stdout:5/110: write fe [2685769,120671] 0 2024-03-19T06:05:31.506 INFO:tasks.workunit.client.1.smithi172.stdout:9/481: creat d1/d7/dc/d47/da3/fa8 x:0 0 0 2024-03-19T06:05:31.507 INFO:tasks.workunit.client.0.smithi072.stdout:5/111: dread - df/d11/f1a zero size 2024-03-19T06:05:31.508 INFO:tasks.workunit.client.1.smithi172.stdout:1/529: readlink da/d7a/l99 0 2024-03-19T06:05:31.509 INFO:tasks.workunit.client.0.smithi072.stdout:5/112: dread - df/d11/f1a zero size 2024-03-19T06:05:31.509 INFO:tasks.workunit.client.1.smithi172.stdout:2/451: creat d7/d1b/f97 x:0 0 0 2024-03-19T06:05:31.510 INFO:tasks.workunit.client.1.smithi172.stdout:0/520: creat d11/d22/d68/fb2 x:0 0 0 2024-03-19T06:05:31.511 INFO:tasks.workunit.client.1.smithi172.stdout:4/544: write df/d2b/d2d/f46 [5040790,48770] 0 2024-03-19T06:05:31.512 INFO:tasks.workunit.client.1.smithi172.stdout:5/442: stat d5/ff 0 2024-03-19T06:05:31.512 INFO:tasks.workunit.client.1.smithi172.stdout:6/596: mkdir d5/d8f/d31/d3d/d98/db6/d40/d53/d75/dbe 0 2024-03-19T06:05:31.513 INFO:tasks.workunit.client.1.smithi172.stdout:2/452: dread - d7/d4c/d70/f90 zero size 2024-03-19T06:05:31.514 INFO:tasks.workunit.client.0.smithi072.stdout:5/113: creat df/d13/f22 x:0 0 0 2024-03-19T06:05:31.515 INFO:tasks.workunit.client.1.smithi172.stdout:6/597: fsync d5/d8f/d31/d7b/fba 0 2024-03-19T06:05:31.515 INFO:tasks.workunit.client.1.smithi172.stdout:0/521: fsync d11/d14/f16 0 2024-03-19T06:05:31.516 INFO:tasks.workunit.client.1.smithi172.stdout:4/545: symlink df/d2b/d44/d67/lb5 0 2024-03-19T06:05:31.519 INFO:tasks.workunit.client.0.smithi072.stdout:5/114: getdents df/d11 0 2024-03-19T06:05:31.519 INFO:tasks.workunit.client.0.smithi072.stdout:5/115: fsync f7 0 2024-03-19T06:05:31.521 INFO:tasks.workunit.client.1.smithi172.stdout:5/443: mkdir d5/d3c/d6c/d9b 0 2024-03-19T06:05:31.522 INFO:tasks.workunit.client.1.smithi172.stdout:1/530: getdents da/dd/d10/d14/d27/da7 0 2024-03-19T06:05:31.522 INFO:tasks.workunit.client.0.smithi072.stdout:5/116: creat df/d13/f23 x:0 0 0 2024-03-19T06:05:31.523 INFO:tasks.workunit.client.0.smithi072.stdout:5/117: fdatasync fe 0 2024-03-19T06:05:31.525 INFO:tasks.workunit.client.0.smithi072.stdout:5/118: write df/d14/f15 [1048413,93746] 0 2024-03-19T06:05:31.526 INFO:tasks.workunit.client.1.smithi172.stdout:1/531: write da/dd/d10/d14/d27/d3f/d5e/f76 [1677504,17399] 0 2024-03-19T06:05:31.527 INFO:tasks.workunit.client.0.smithi072.stdout:5/119: dread - df/f17 zero size 2024-03-19T06:05:31.529 INFO:tasks.workunit.client.1.smithi172.stdout:5/444: dread d5/d3d/f8d [0,4194304] 0 2024-03-19T06:05:31.530 INFO:tasks.workunit.client.0.smithi072.stdout:5/120: mkdir df/d13/d24 0 2024-03-19T06:05:31.532 INFO:tasks.workunit.client.0.smithi072.stdout:5/121: mknod df/d14/c25 0 2024-03-19T06:05:31.533 INFO:tasks.workunit.client.1.smithi172.stdout:6/598: symlink d5/lbf 0 2024-03-19T06:05:31.534 INFO:tasks.workunit.client.1.smithi172.stdout:2/453: dread d7/de/d61/f65 [0,4194304] 0 2024-03-19T06:05:31.535 INFO:tasks.workunit.client.1.smithi172.stdout:4/546: creat df/d11/d12/d21/d58/fb6 x:0 0 0 2024-03-19T06:05:31.537 INFO:tasks.workunit.client.1.smithi172.stdout:5/445: dread d5/d14/f4d [0,4194304] 0 2024-03-19T06:05:31.537 INFO:tasks.workunit.client.1.smithi172.stdout:4/547: chown df/d2b/d2d/db0 11128441 1 2024-03-19T06:05:31.538 INFO:tasks.workunit.client.1.smithi172.stdout:1/532: fdatasync da/dd/d10/d36/f38 0 2024-03-19T06:05:31.539 INFO:tasks.workunit.client.1.smithi172.stdout:9/482: link d1/d7/dc/de/l1a d1/d7/dc/de/d34/d48/d89/la9 0 2024-03-19T06:05:31.540 INFO:tasks.workunit.client.1.smithi172.stdout:5/446: stat d5/d3c/d6c/c87 0 2024-03-19T06:05:31.540 INFO:tasks.workunit.client.1.smithi172.stdout:6/599: write d5/d8f/d31/d7b/d7e/f88 [38947,105627] 0 2024-03-19T06:05:31.541 INFO:tasks.workunit.client.1.smithi172.stdout:2/454: creat d7/de/d58/d55/f98 x:0 0 0 2024-03-19T06:05:31.545 INFO:tasks.workunit.client.1.smithi172.stdout:9/483: write d1/f56 [728466,98477] 0 2024-03-19T06:05:31.546 INFO:tasks.workunit.client.1.smithi172.stdout:2/455: fsync d7/db/f16 0 2024-03-19T06:05:31.547 INFO:tasks.workunit.client.1.smithi172.stdout:1/533: dread da/dd/d10/d14/f46 [0,4194304] 0 2024-03-19T06:05:31.548 INFO:tasks.workunit.client.1.smithi172.stdout:5/447: write d5/d14/d15/d40/f73 [1402653,119346] 0 2024-03-19T06:05:31.550 INFO:tasks.workunit.client.1.smithi172.stdout:2/456: readlink d7/d4c/d70/l79 0 2024-03-19T06:05:31.551 INFO:tasks.workunit.client.1.smithi172.stdout:8/447: sync 2024-03-19T06:05:31.551 INFO:tasks.workunit.client.1.smithi172.stdout:9/484: symlink d1/d7/dc/d23/laa 0 2024-03-19T06:05:31.552 INFO:tasks.workunit.client.1.smithi172.stdout:1/534: symlink da/dd/lb2 0 2024-03-19T06:05:31.553 INFO:tasks.workunit.client.1.smithi172.stdout:2/457: stat d7/de/d58/d56/f2b 0 2024-03-19T06:05:31.558 INFO:tasks.workunit.client.1.smithi172.stdout:6/600: link d5/d11/d17/d1b/f69 d5/d8f/d31/d3d/d98/db6/d40/d53/fc0 0 2024-03-19T06:05:31.558 INFO:tasks.workunit.client.0.smithi072.stdout:5/122: dwrite fb [12582912,4194304] 0 2024-03-19T06:05:31.559 INFO:tasks.workunit.client.1.smithi172.stdout:9/485: creat d1/d7/dc/de/d34/d48/d89/fab x:0 0 0 2024-03-19T06:05:31.560 INFO:tasks.workunit.client.1.smithi172.stdout:1/535: mknod da/dd/cb3 0 2024-03-19T06:05:31.562 INFO:tasks.workunit.client.1.smithi172.stdout:8/448: mkdir d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c 0 2024-03-19T06:05:31.563 INFO:tasks.workunit.client.0.smithi072.stdout:5/123: dread df/d14/f15 [0,4194304] 0 2024-03-19T06:05:31.564 INFO:tasks.workunit.client.1.smithi172.stdout:6/601: getdents d5/d8f/d31/d3d/d95 0 2024-03-19T06:05:31.564 INFO:tasks.workunit.client.1.smithi172.stdout:1/536: chown da/dd/d31/d47/c82 2645475 1 2024-03-19T06:05:31.564 INFO:tasks.workunit.client.1.smithi172.stdout:8/449: chown d0/c6c 2930 1 2024-03-19T06:05:31.565 INFO:tasks.workunit.client.1.smithi172.stdout:9/486: write d1/d7/dc/d47/f61 [1175505,27179] 0 2024-03-19T06:05:31.568 INFO:tasks.workunit.client.0.smithi072.stdout:5/124: rename df/d13/f22 to df/f26 0 2024-03-19T06:05:31.569 INFO:tasks.workunit.client.0.smithi072.stdout:5/125: dread - df/d11/f1a zero size 2024-03-19T06:05:31.573 INFO:tasks.workunit.client.0.smithi072.stdout:5/126: mknod df/d13/d24/c27 0 2024-03-19T06:05:31.574 INFO:tasks.workunit.client.0.smithi072.stdout:5/127: truncate df/f26 534763 0 2024-03-19T06:05:31.578 INFO:tasks.workunit.client.0.smithi072.stdout:5/128: truncate f7 7652091 0 2024-03-19T06:05:31.592 INFO:tasks.workunit.client.0.smithi072.stdout:5/129: dread f7 [4194304,4194304] 0 2024-03-19T06:05:31.593 INFO:tasks.workunit.client.1.smithi172.stdout:8/450: write d0/d44/d46/d49/d26/f7b [481584,61714] 0 2024-03-19T06:05:31.595 INFO:tasks.workunit.client.1.smithi172.stdout:9/487: dread d1/f93 [0,4194304] 0 2024-03-19T06:05:31.603 INFO:tasks.workunit.client.1.smithi172.stdout:5/448: dwrite d5/d14/d15/f24 [0,4194304] 0 2024-03-19T06:05:31.605 INFO:tasks.workunit.client.1.smithi172.stdout:2/458: dwrite d7/db/f13 [0,4194304] 0 2024-03-19T06:05:31.606 INFO:tasks.workunit.client.0.smithi072.stdout:5/130: dwrite fe [0,4194304] 0 2024-03-19T06:05:31.608 INFO:tasks.workunit.client.1.smithi172.stdout:5/449: write d5/d1f/f82 [1027523,79167] 0 2024-03-19T06:05:31.608 INFO:tasks.workunit.client.0.smithi072.stdout:5/131: write df/f17 [187404,105604] 0 2024-03-19T06:05:31.609 INFO:tasks.workunit.client.0.smithi072.stdout:5/132: chown df/d13 64638582 1 2024-03-19T06:05:31.610 INFO:tasks.workunit.client.1.smithi172.stdout:8/451: creat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/f8d x:0 0 0 2024-03-19T06:05:31.612 INFO:tasks.workunit.client.1.smithi172.stdout:6/602: dwrite d5/f19 [0,4194304] 0 2024-03-19T06:05:31.615 INFO:tasks.workunit.client.1.smithi172.stdout:5/450: readlink d5/l89 0 2024-03-19T06:05:31.615 INFO:tasks.workunit.client.1.smithi172.stdout:8/452: stat d0/d61/f6b 0 2024-03-19T06:05:31.615 INFO:tasks.workunit.client.1.smithi172.stdout:1/537: dwrite da/dd/d10/d36/f38 [0,4194304] 0 2024-03-19T06:05:31.616 INFO:tasks.workunit.client.0.smithi072.stdout:5/133: getdents df/d16 0 2024-03-19T06:05:31.619 INFO:tasks.workunit.client.1.smithi172.stdout:5/451: fsync d5/d14/d34/f3f 0 2024-03-19T06:05:31.627 INFO:tasks.workunit.client.1.smithi172.stdout:1/538: symlink da/d33/d4e/lb4 0 2024-03-19T06:05:31.628 INFO:tasks.workunit.client.1.smithi172.stdout:8/453: rename d0/d44/d46/d49/d26/d71/d81/d27/d29/d59 to d0/d44/d46/d49/d26/d71/d81/d8e 0 2024-03-19T06:05:31.630 INFO:tasks.workunit.client.1.smithi172.stdout:5/452: mknod d5/d3c/c9c 0 2024-03-19T06:05:31.632 INFO:tasks.workunit.client.1.smithi172.stdout:8/454: symlink d0/d44/l8f 0 2024-03-19T06:05:31.633 INFO:tasks.workunit.client.1.smithi172.stdout:1/539: write da/dd/d10/d14/d27/f37 [112109,93002] 0 2024-03-19T06:05:31.634 INFO:tasks.workunit.client.1.smithi172.stdout:8/455: chown d0/f58 20 1 2024-03-19T06:05:31.636 INFO:tasks.workunit.client.1.smithi172.stdout:5/453: creat d5/d3c/d6c/f9d x:0 0 0 2024-03-19T06:05:31.640 INFO:tasks.workunit.client.1.smithi172.stdout:1/540: write da/dd/d10/f23 [776477,17064] 0 2024-03-19T06:05:31.642 INFO:tasks.workunit.client.1.smithi172.stdout:6/603: dwrite d5/d11/fab [0,4194304] 0 2024-03-19T06:05:31.643 INFO:tasks.workunit.client.1.smithi172.stdout:5/454: mknod d5/d14/d34/d66/c9e 0 2024-03-19T06:05:31.644 INFO:tasks.workunit.client.1.smithi172.stdout:8/456: creat d0/d61/d6a/d7e/f90 x:0 0 0 2024-03-19T06:05:31.645 INFO:tasks.workunit.client.1.smithi172.stdout:1/541: unlink da/dd/d10/d14/f5d 0 2024-03-19T06:05:31.646 INFO:tasks.workunit.client.0.smithi072.stdout:5/134: fdatasync fe 0 2024-03-19T06:05:31.647 INFO:tasks.workunit.client.1.smithi172.stdout:5/455: write d5/d55/f63 [1531927,75490] 0 2024-03-19T06:05:31.648 INFO:tasks.workunit.client.1.smithi172.stdout:6/604: symlink d5/d8f/d31/lc1 0 2024-03-19T06:05:31.651 INFO:tasks.workunit.client.1.smithi172.stdout:6/605: chown d5/c2e 68224957 1 2024-03-19T06:05:31.653 INFO:tasks.workunit.client.1.smithi172.stdout:1/542: symlink da/dd/d10/d14/d73/d8b/lb5 0 2024-03-19T06:05:31.653 INFO:tasks.workunit.client.0.smithi072.stdout:5/135: dread df/d14/f15 [0,4194304] 0 2024-03-19T06:05:31.654 INFO:tasks.workunit.client.1.smithi172.stdout:8/457: dread d0/f37 [0,4194304] 0 2024-03-19T06:05:31.657 INFO:tasks.workunit.client.1.smithi172.stdout:5/456: mkdir d5/d14/d9f 0 2024-03-19T06:05:31.658 INFO:tasks.workunit.client.1.smithi172.stdout:2/459: dread d7/db/d2c/f6f [0,4194304] 0 2024-03-19T06:05:31.658 INFO:tasks.workunit.client.0.smithi072.stdout:5/136: mkdir df/d11/d28 0 2024-03-19T06:05:31.659 INFO:tasks.workunit.client.1.smithi172.stdout:6/606: mkdir d5/d8f/d31/d3d/d98/db6/d40/d53/dc2 0 2024-03-19T06:05:31.660 INFO:tasks.workunit.client.1.smithi172.stdout:2/460: chown d7/d4c/d70/f90 876100 1 2024-03-19T06:05:31.660 INFO:tasks.workunit.client.1.smithi172.stdout:8/458: write d0/d44/d46/d49/d26/d71/d81/d27/d29/f32 [3209841,14127] 0 2024-03-19T06:05:31.661 INFO:tasks.workunit.client.1.smithi172.stdout:6/607: stat d5/d11/d17/lb2 0 2024-03-19T06:05:31.663 INFO:tasks.workunit.client.1.smithi172.stdout:8/459: rmdir d0 39 2024-03-19T06:05:31.667 INFO:tasks.workunit.client.1.smithi172.stdout:6/608: symlink d5/d8f/d31/d3d/d98/db6/d40/d53/lc3 0 2024-03-19T06:05:31.669 INFO:tasks.workunit.client.1.smithi172.stdout:8/460: mknod d0/d61/d6a/c91 0 2024-03-19T06:05:31.670 INFO:tasks.workunit.client.1.smithi172.stdout:2/461: link d7/db/d2c/d35/c60 d7/c99 0 2024-03-19T06:05:31.671 INFO:tasks.workunit.client.0.smithi072.stdout:5/137: truncate df/f26 306585 0 2024-03-19T06:05:31.675 INFO:tasks.workunit.client.0.smithi072.stdout:5/138: rename c5 to df/d13/c29 0 2024-03-19T06:05:31.678 INFO:tasks.workunit.client.0.smithi072.stdout:5/139: creat df/d14/f2a x:0 0 0 2024-03-19T06:05:31.679 INFO:tasks.workunit.client.1.smithi172.stdout:5/457: dwrite d5/d14/d15/d40/d6a/f6d [0,4194304] 0 2024-03-19T06:05:31.684 INFO:tasks.workunit.client.1.smithi172.stdout:2/462: dread d7/db/f62 [0,4194304] 0 2024-03-19T06:05:31.684 INFO:tasks.workunit.client.1.smithi172.stdout:8/461: dread d0/d44/d46/d49/d26/d71/d81/d8e/f4b [0,4194304] 0 2024-03-19T06:05:31.684 INFO:tasks.workunit.client.1.smithi172.stdout:1/543: dread da/dd/d10/d14/d27/d3f/d5e/f7e [0,4194304] 0 2024-03-19T06:05:31.686 INFO:tasks.workunit.client.1.smithi172.stdout:2/463: stat d7/db/f27 0 2024-03-19T06:05:31.687 INFO:tasks.workunit.client.0.smithi072.stdout:5/140: link df/d14/c19 df/c2b 0 2024-03-19T06:05:31.687 INFO:tasks.workunit.client.1.smithi172.stdout:8/462: chown d0/d61/d6a/d7e/f7f 114 1 2024-03-19T06:05:31.688 INFO:tasks.workunit.client.0.smithi072.stdout:5/141: read - df/d11/f1a zero size 2024-03-19T06:05:31.689 INFO:tasks.workunit.client.0.smithi072.stdout:5/142: chown df/d13/f23 96 1 2024-03-19T06:05:31.711 INFO:tasks.workunit.client.0.smithi072.stdout:5/143: rmdir df/d14 39 2024-03-19T06:05:31.711 INFO:tasks.workunit.client.1.smithi172.stdout:5/458: creat d5/d14/d15/d40/d6a/d7a/fa0 x:0 0 0 2024-03-19T06:05:31.712 INFO:tasks.workunit.client.0.smithi072.stdout:5/144: chown fb 32803 1 2024-03-19T06:05:31.714 INFO:tasks.workunit.client.0.smithi072.stdout:5/145: write df/d13/f23 [731943,4982] 0 2024-03-19T06:05:31.716 INFO:tasks.workunit.client.0.smithi072.stdout:5/146: write fe [1562639,112899] 0 2024-03-19T06:05:31.719 INFO:tasks.workunit.client.0.smithi072.stdout:5/147: mknod df/d14/c2c 0 2024-03-19T06:05:31.721 INFO:tasks.workunit.client.0.smithi072.stdout:5/148: creat df/d16/f2d x:0 0 0 2024-03-19T06:05:31.727 INFO:tasks.workunit.client.0.smithi072.stdout:5/149: truncate df/f26 1010208 0 2024-03-19T06:05:31.748 INFO:tasks.workunit.client.1.smithi172.stdout:3/497: sync 2024-03-19T06:05:31.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:31 smithi072 ceph-mon[28706]: pgmap v12: 65 pgs: 65 active+clean; 857 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 118 MiB/s wr, 320 op/s 2024-03-19T06:05:31.865 INFO:tasks.workunit.client.1.smithi172.stdout:7/443: sync 2024-03-19T06:05:31.865 INFO:tasks.workunit.client.1.smithi172.stdout:0/522: sync 2024-03-19T06:05:31.868 INFO:tasks.workunit.client.1.smithi172.stdout:7/444: write d0/d2c/f30 [1974847,43679] 0 2024-03-19T06:05:31.871 INFO:tasks.workunit.client.1.smithi172.stdout:7/445: write d0/d22/d3d/f64 [1540687,9376] 0 2024-03-19T06:05:31.888 INFO:tasks.workunit.client.1.smithi172.stdout:3/498: sync 2024-03-19T06:05:31.888 INFO:tasks.workunit.client.1.smithi172.stdout:4/548: sync 2024-03-19T06:05:31.888 INFO:tasks.workunit.client.1.smithi172.stdout:9/488: sync 2024-03-19T06:05:31.893 INFO:tasks.workunit.client.1.smithi172.stdout:4/549: chown df/d11/d12/d34/f74 1889 1 2024-03-19T06:05:31.895 INFO:tasks.workunit.client.1.smithi172.stdout:4/550: stat df/d2b/d2d/ca4 0 2024-03-19T06:05:31.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:31 smithi172 ceph-mon[35716]: pgmap v12: 65 pgs: 65 active+clean; 857 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 118 MiB/s wr, 320 op/s 2024-03-19T06:05:32.264 INFO:tasks.workunit.client.1.smithi172.stdout:6/609: truncate d5/f19 2863537 0 2024-03-19T06:05:32.267 INFO:tasks.workunit.client.1.smithi172.stdout:1/544: write da/dd/f1f [4722127,99952] 0 2024-03-19T06:05:32.268 INFO:tasks.workunit.client.1.smithi172.stdout:2/464: creat d7/de/d58/d56/d81/f9a x:0 0 0 2024-03-19T06:05:32.269 INFO:tasks.workunit.client.1.smithi172.stdout:8/463: symlink d0/d44/d46/d49/d3a/d3d/d83/l92 0 2024-03-19T06:05:32.272 INFO:tasks.workunit.client.1.smithi172.stdout:7/446: rmdir d0/d22/d1d/d36/d8d/d5c/d67 39 2024-03-19T06:05:32.277 INFO:tasks.workunit.client.1.smithi172.stdout:6/610: truncate d5/d8f/d31/d3d/d98/db6/f42 316202 0 2024-03-19T06:05:32.277 INFO:tasks.workunit.client.1.smithi172.stdout:1/545: write da/dd/d10/d14/d27/f5a [813408,67266] 0 2024-03-19T06:05:32.277 INFO:tasks.workunit.client.1.smithi172.stdout:3/499: creat d0/da8/d3a/faa x:0 0 0 2024-03-19T06:05:32.282 INFO:tasks.workunit.client.1.smithi172.stdout:9/489: rename d1/d7/dc/de/f50 to d1/d7/dc/de/d34/d48/d89/fac 0 2024-03-19T06:05:32.284 INFO:tasks.workunit.client.1.smithi172.stdout:3/500: symlink d0/da8/d3a/lab 0 2024-03-19T06:05:32.290 INFO:tasks.workunit.client.0.smithi072.stdout:5/150: dread fb [12582912,4194304] 0 2024-03-19T06:05:32.290 INFO:tasks.workunit.client.1.smithi172.stdout:7/447: mknod d0/d22/d1d/d36/d8d/d5c/c9b 0 2024-03-19T06:05:32.291 INFO:tasks.workunit.client.1.smithi172.stdout:3/501: truncate d0/d5/d14/f30 891792 0 2024-03-19T06:05:32.292 INFO:tasks.workunit.client.1.smithi172.stdout:9/490: write d1/d7/dc/de/d34/d48/f5f [4070249,36445] 0 2024-03-19T06:05:32.297 INFO:tasks.workunit.client.1.smithi172.stdout:8/464: rename d0/fd to d0/d61/d6a/f93 0 2024-03-19T06:05:32.297 INFO:tasks.workunit.client.1.smithi172.stdout:6/611: mknod d5/d8f/d31/d3d/d95/cc4 0 2024-03-19T06:05:32.299 INFO:tasks.workunit.client.1.smithi172.stdout:0/523: truncate d11/d14/f2e 224183 0 2024-03-19T06:05:32.303 INFO:tasks.workunit.client.1.smithi172.stdout:9/491: read d1/d7/dc/d47/d78/d54/d91/f35 [3504025,4469] 0 2024-03-19T06:05:32.304 INFO:tasks.workunit.client.1.smithi172.stdout:6/612: write d5/d11/d17/d1b/d74/fa2 [1549102,24962] 0 2024-03-19T06:05:32.305 INFO:tasks.workunit.client.1.smithi172.stdout:5/459: getdents d5/d3c/d6c 0 2024-03-19T06:05:32.310 INFO:tasks.workunit.client.1.smithi172.stdout:1/546: rename da/dd/d10/d14/d27/d3f/d5e/f72 to da/d33/d52/fb6 0 2024-03-19T06:05:32.311 INFO:tasks.workunit.client.1.smithi172.stdout:0/524: truncate d11/d22/d46/d84/f93 258977 0 2024-03-19T06:05:32.313 INFO:tasks.workunit.client.1.smithi172.stdout:0/525: readlink d11/l78 0 2024-03-19T06:05:32.314 INFO:tasks.workunit.client.1.smithi172.stdout:1/547: chown da/dd/la9 4537 1 2024-03-19T06:05:32.317 INFO:tasks.workunit.client.1.smithi172.stdout:4/551: dwrite df/d2b/d2d/f38 [0,4194304] 0 2024-03-19T06:05:32.317 INFO:tasks.workunit.client.1.smithi172.stdout:5/460: mknod d5/d1f/ca1 0 2024-03-19T06:05:32.317 INFO:tasks.workunit.client.1.smithi172.stdout:2/465: getdents d7/db 0 2024-03-19T06:05:32.318 INFO:tasks.workunit.client.1.smithi172.stdout:9/492: rmdir d1/d7/dc 39 2024-03-19T06:05:32.318 INFO:tasks.workunit.client.1.smithi172.stdout:3/502: creat d0/da8/d54/d77/fac x:0 0 0 2024-03-19T06:05:32.321 INFO:tasks.workunit.client.1.smithi172.stdout:5/461: read d5/d14/f69 [248579,17194] 0 2024-03-19T06:05:32.331 INFO:tasks.workunit.client.1.smithi172.stdout:2/466: mknod d7/de/d58/d56/d86/c9b 0 2024-03-19T06:05:32.334 INFO:tasks.workunit.client.1.smithi172.stdout:9/493: fdatasync d1/d7/dc/de/d34/f45 0 2024-03-19T06:05:32.338 INFO:tasks.workunit.client.1.smithi172.stdout:7/448: rename d0/d22/d1d/d36/d40/f8a to d0/d22/f9c 0 2024-03-19T06:05:32.342 INFO:tasks.workunit.client.1.smithi172.stdout:7/449: stat d0/d22/d1d/d36/d8d 0 2024-03-19T06:05:32.344 INFO:tasks.workunit.client.1.smithi172.stdout:2/467: unlink d7/de/d58/d56/f85 0 2024-03-19T06:05:32.347 INFO:tasks.workunit.client.1.smithi172.stdout:7/450: write d0/d2c/f2f [652035,99700] 0 2024-03-19T06:05:32.349 INFO:tasks.workunit.client.1.smithi172.stdout:1/548: getdents da 0 2024-03-19T06:05:32.352 INFO:tasks.workunit.client.1.smithi172.stdout:6/613: dread d5/f8 [0,4194304] 0 2024-03-19T06:05:32.352 INFO:tasks.workunit.client.1.smithi172.stdout:4/552: getdents df/d11/d12/d34 0 2024-03-19T06:05:32.353 INFO:tasks.workunit.client.1.smithi172.stdout:0/526: link d11/l66 d11/d14/d2c/lb3 0 2024-03-19T06:05:32.357 INFO:tasks.workunit.client.1.smithi172.stdout:1/549: mkdir da/dd/d10/d14/d27/da7/db7 0 2024-03-19T06:05:32.357 INFO:tasks.workunit.client.1.smithi172.stdout:6/614: chown d5/d11/d43/d45/c96 14568901 1 2024-03-19T06:05:32.360 INFO:tasks.workunit.client.1.smithi172.stdout:2/468: getdents d7/de/d58/d57 0 2024-03-19T06:05:32.361 INFO:tasks.workunit.client.1.smithi172.stdout:4/553: creat df/d11/d12/d69/fb7 x:0 0 0 2024-03-19T06:05:32.363 INFO:tasks.workunit.client.1.smithi172.stdout:0/527: chown d11/d18/da5/da8/fb1 33501812 1 2024-03-19T06:05:32.363 INFO:tasks.workunit.client.1.smithi172.stdout:3/503: dwrite d0/da8/d34/d4d/f4a [0,4194304] 0 2024-03-19T06:05:32.368 INFO:tasks.workunit.client.1.smithi172.stdout:2/469: write d7/d1b/f2a [2461894,59883] 0 2024-03-19T06:05:32.369 INFO:tasks.workunit.client.1.smithi172.stdout:7/451: truncate d0/d22/d1d/d36/f54 1963643 0 2024-03-19T06:05:32.370 INFO:tasks.workunit.client.1.smithi172.stdout:3/504: chown d0/da8/d54/d90/f97 124 1 2024-03-19T06:05:32.373 INFO:tasks.workunit.client.1.smithi172.stdout:3/505: chown d0/da8/d25/l57 15 1 2024-03-19T06:05:32.376 INFO:tasks.workunit.client.1.smithi172.stdout:6/615: rename d5/c77 to d5/d11/d17/d36/d48/cc5 0 2024-03-19T06:05:32.377 INFO:tasks.workunit.client.1.smithi172.stdout:1/550: creat da/dd/d10/fb8 x:0 0 0 2024-03-19T06:05:32.378 INFO:tasks.workunit.client.1.smithi172.stdout:0/528: fdatasync d11/d14/f2e 0 2024-03-19T06:05:32.381 INFO:tasks.workunit.client.1.smithi172.stdout:4/554: link df/d11/c71 df/d2b/d2d/dae/cb8 0 2024-03-19T06:05:32.382 INFO:tasks.workunit.client.1.smithi172.stdout:0/529: readlink d11/d14/l19 0 2024-03-19T06:05:32.384 INFO:tasks.workunit.client.1.smithi172.stdout:3/506: creat d0/da8/d34/d4d/d6c/fad x:0 0 0 2024-03-19T06:05:32.385 INFO:tasks.workunit.client.1.smithi172.stdout:1/551: creat da/d33/d59/fb9 x:0 0 0 2024-03-19T06:05:32.387 INFO:tasks.workunit.client.1.smithi172.stdout:5/462: dread d5/d14/d15/f4c [0,4194304] 0 2024-03-19T06:05:32.387 INFO:tasks.workunit.client.1.smithi172.stdout:2/470: dread d7/db/d2c/f6f [0,4194304] 0 2024-03-19T06:05:32.388 INFO:tasks.workunit.client.1.smithi172.stdout:4/555: symlink df/d11/d12/d69/lb9 0 2024-03-19T06:05:32.389 INFO:tasks.workunit.client.1.smithi172.stdout:5/463: write d5/d1f/d2f/d53/f78 [1553306,31613] 0 2024-03-19T06:05:32.391 INFO:tasks.workunit.client.1.smithi172.stdout:7/452: truncate d0/d22/d1d/d3a/d46/f4d 6495547 0 2024-03-19T06:05:32.392 INFO:tasks.workunit.client.1.smithi172.stdout:6/616: mknod d5/d8f/d31/d3d/d98/dac/cc6 0 2024-03-19T06:05:32.393 INFO:tasks.workunit.client.1.smithi172.stdout:6/617: chown d5/d11/d2f/fbb 529530818 1 2024-03-19T06:05:32.394 INFO:tasks.workunit.client.1.smithi172.stdout:1/552: symlink da/dd/d10/d14/d27/lba 0 2024-03-19T06:05:32.395 INFO:tasks.workunit.client.0.smithi072.stdout:5/151: dwrite fb [0,4194304] 0 2024-03-19T06:05:32.397 INFO:tasks.workunit.client.0.smithi072.stdout:5/152: read df/d11/f12 [3499928,72658] 0 2024-03-19T06:05:32.398 INFO:tasks.workunit.client.1.smithi172.stdout:0/530: symlink d11/d14/d2c/d8d/lb4 0 2024-03-19T06:05:32.399 INFO:tasks.workunit.client.0.smithi072.stdout:5/153: readlink df/d13/l20 0 2024-03-19T06:05:32.399 INFO:tasks.workunit.client.1.smithi172.stdout:5/464: mkdir d5/d3c/d6c/da2 0 2024-03-19T06:05:32.400 INFO:tasks.workunit.client.0.smithi072.stdout:5/154: read fe [784837,86528] 0 2024-03-19T06:05:32.402 INFO:tasks.workunit.client.1.smithi172.stdout:1/553: unlink da/d33/d78/f9e 0 2024-03-19T06:05:32.405 INFO:tasks.workunit.client.1.smithi172.stdout:4/556: creat df/d2b/d2d/dae/fba x:0 0 0 2024-03-19T06:05:32.406 INFO:tasks.workunit.client.0.smithi072.stdout:5/155: link df/d14/l1c df/d14/l2e 0 2024-03-19T06:05:32.409 INFO:tasks.workunit.client.1.smithi172.stdout:5/465: read - d5/d14/d15/d40/d6a/d7a/f8a zero size 2024-03-19T06:05:32.409 INFO:tasks.workunit.client.1.smithi172.stdout:0/531: rmdir d11/d22/d46/d84 39 2024-03-19T06:05:32.411 INFO:tasks.workunit.client.1.smithi172.stdout:3/507: dread d0/da8/d25/d21/f50 [0,4194304] 0 2024-03-19T06:05:32.413 INFO:tasks.workunit.client.1.smithi172.stdout:2/471: dwrite d7/db/f13 [0,4194304] 0 2024-03-19T06:05:32.418 INFO:tasks.workunit.client.1.smithi172.stdout:0/532: symlink d11/d18/lb5 0 2024-03-19T06:05:32.418 INFO:tasks.workunit.client.1.smithi172.stdout:1/554: fdatasync da/d3b/f3d 0 2024-03-19T06:05:32.422 INFO:tasks.workunit.client.1.smithi172.stdout:4/557: rename df/d11/d12/d21/d58/d65 to df/d11/d12/d21/d50/d63/dbb 0 2024-03-19T06:05:32.422 INFO:tasks.workunit.client.1.smithi172.stdout:7/453: dwrite d0/d22/d1d/d3a/d46/f99 [0,4194304] 0 2024-03-19T06:05:32.423 INFO:tasks.workunit.client.1.smithi172.stdout:1/555: symlink da/d33/lbb 0 2024-03-19T06:05:32.424 INFO:tasks.workunit.client.0.smithi072.stdout:5/156: dwrite df/d13/f23 [0,4194304] 0 2024-03-19T06:05:32.425 INFO:tasks.workunit.client.1.smithi172.stdout:4/558: chown df/d11/d12/d21/f2f 15293 1 2024-03-19T06:05:32.426 INFO:tasks.workunit.client.0.smithi072.stdout:5/157: chown c1 0 1 2024-03-19T06:05:32.427 INFO:tasks.workunit.client.1.smithi172.stdout:1/556: write da/fb0 [125971,113999] 0 2024-03-19T06:05:32.429 INFO:tasks.workunit.client.1.smithi172.stdout:2/472: rename d7/db/d2c/d35/f44 to d7/d1b/f9c 0 2024-03-19T06:05:32.429 INFO:tasks.workunit.client.0.smithi072.stdout:5/158: rmdir df/d14 39 2024-03-19T06:05:32.431 INFO:tasks.workunit.client.1.smithi172.stdout:5/466: getdents d5 0 2024-03-19T06:05:32.432 INFO:tasks.workunit.client.1.smithi172.stdout:0/533: mknod d11/d18/d38/cb6 0 2024-03-19T06:05:32.437 INFO:tasks.workunit.client.1.smithi172.stdout:4/559: stat df/d11/d12/d26/d84/da2 0 2024-03-19T06:05:32.437 INFO:tasks.workunit.client.1.smithi172.stdout:7/454: symlink d0/d22/d1d/d36/d8d/d7d/l9d 0 2024-03-19T06:05:32.439 INFO:tasks.workunit.client.0.smithi072.stdout:5/159: rename df/d11/f1a to df/d14/f2f 0 2024-03-19T06:05:32.442 INFO:tasks.workunit.client.1.smithi172.stdout:6/618: truncate d5/fb 6503271 0 2024-03-19T06:05:32.445 INFO:tasks.workunit.client.1.smithi172.stdout:1/557: mknod da/dd/d31/cbc 0 2024-03-19T06:05:32.445 INFO:tasks.workunit.client.1.smithi172.stdout:2/473: mkdir d7/de/d58/d56/d86/d9d 0 2024-03-19T06:05:32.445 INFO:tasks.workunit.client.1.smithi172.stdout:5/467: stat d5/d14/d34/c35 0 2024-03-19T06:05:32.446 INFO:tasks.workunit.client.0.smithi072.stdout:5/160: write fe [4740157,19931] 0 2024-03-19T06:05:32.446 INFO:tasks.workunit.client.1.smithi172.stdout:3/508: write d0/da8/d25/d21/f50 [2608103,95366] 0 2024-03-19T06:05:32.448 INFO:tasks.workunit.client.0.smithi072.stdout:5/161: write df/d16/f2d [86948,40790] 0 2024-03-19T06:05:32.450 INFO:tasks.workunit.client.0.smithi072.stdout:5/162: dread - df/d14/f2a zero size 2024-03-19T06:05:32.452 INFO:tasks.workunit.client.1.smithi172.stdout:0/534: mkdir d11/d14/db7 0 2024-03-19T06:05:32.452 INFO:tasks.workunit.client.1.smithi172.stdout:1/558: fsync da/d3b/f3d 0 2024-03-19T06:05:32.452 INFO:tasks.workunit.client.1.smithi172.stdout:4/560: unlink df/d11/d12/d69/lb9 0 2024-03-19T06:05:32.452 INFO:tasks.workunit.client.1.smithi172.stdout:2/474: read d7/d4c/f7e [247017,3469] 0 2024-03-19T06:05:32.453 INFO:tasks.workunit.client.1.smithi172.stdout:3/509: rmdir d0/d37/da7 39 2024-03-19T06:05:32.454 INFO:tasks.workunit.client.1.smithi172.stdout:8/465: sync 2024-03-19T06:05:32.455 INFO:tasks.workunit.client.1.smithi172.stdout:1/559: fdatasync da/dd/f39 0 2024-03-19T06:05:32.458 INFO:tasks.workunit.client.1.smithi172.stdout:8/466: readlink d0/l5 0 2024-03-19T06:05:32.462 INFO:tasks.workunit.client.1.smithi172.stdout:3/510: fsync d0/da8/d25/f1a 0 2024-03-19T06:05:32.463 INFO:tasks.workunit.client.1.smithi172.stdout:0/535: getdents d11/d22/d68 0 2024-03-19T06:05:32.465 INFO:tasks.workunit.client.1.smithi172.stdout:3/511: readlink d0/da8/d54/d77/la4 0 2024-03-19T06:05:32.466 INFO:tasks.workunit.client.0.smithi072.stdout:5/163: dwrite fe [0,4194304] 0 2024-03-19T06:05:32.470 INFO:tasks.workunit.client.0.smithi072.stdout:5/164: creat df/d11/f30 x:0 0 0 2024-03-19T06:05:32.471 INFO:tasks.workunit.client.0.smithi072.stdout:5/165: stat c1 0 2024-03-19T06:05:32.474 INFO:tasks.workunit.client.1.smithi172.stdout:3/512: chown d0/da8/d34/d4d 2046802 1 2024-03-19T06:05:32.478 INFO:tasks.workunit.client.0.smithi072.stdout:5/166: mkdir df/d11/d28/d31 0 2024-03-19T06:05:32.481 INFO:tasks.workunit.client.1.smithi172.stdout:2/475: dread d7/de/d58/d56/f46 [0,4194304] 0 2024-03-19T06:05:32.481 INFO:tasks.workunit.client.1.smithi172.stdout:3/513: rename d0/da8/d34/d4d/d6c to d0/d5/d6b/dae 0 2024-03-19T06:05:32.485 INFO:tasks.workunit.client.1.smithi172.stdout:5/468: write d5/d14/d34/f52 [782659,39474] 0 2024-03-19T06:05:32.486 INFO:tasks.workunit.client.0.smithi072.stdout:5/167: write f7 [655951,9818] 0 2024-03-19T06:05:32.490 INFO:tasks.workunit.client.1.smithi172.stdout:9/494: sync 2024-03-19T06:05:32.490 INFO:tasks.workunit.client.1.smithi172.stdout:6/619: dwrite d5/d8f/d31/d3d/d98/db6/d40/d53/d75/fb1 [0,4194304] 0 2024-03-19T06:05:32.497 INFO:tasks.workunit.client.1.smithi172.stdout:4/561: dwrite df/d11/d12/d21/d58/f83 [0,4194304] 0 2024-03-19T06:05:32.497 INFO:tasks.workunit.client.1.smithi172.stdout:5/469: symlink d5/la3 0 2024-03-19T06:05:32.503 INFO:tasks.workunit.client.0.smithi072.stdout:5/168: dwrite f7 [4194304,4194304] 0 2024-03-19T06:05:32.504 INFO:tasks.workunit.client.1.smithi172.stdout:2/476: mkdir d7/de/d58/d56/d86/d9e 0 2024-03-19T06:05:32.504 INFO:tasks.workunit.client.1.smithi172.stdout:4/562: fsync df/d2b/d44/f8e 0 2024-03-19T06:05:32.506 INFO:tasks.workunit.client.0.smithi072.stdout:5/169: write fe [4036840,29729] 0 2024-03-19T06:05:32.510 INFO:tasks.workunit.client.1.smithi172.stdout:1/560: dwrite da/d33/d4e/d60/f87 [0,4194304] 0 2024-03-19T06:05:32.514 INFO:tasks.workunit.client.1.smithi172.stdout:3/514: rename d0/da8/c4c to d0/da8/d3a/caf 0 2024-03-19T06:05:32.514 INFO:tasks.workunit.client.1.smithi172.stdout:8/467: dwrite d0/d44/f5b [0,4194304] 0 2024-03-19T06:05:32.515 INFO:tasks.workunit.client.1.smithi172.stdout:7/455: dread d0/d22/d1d/d36/d8d/f63 [0,4194304] 0 2024-03-19T06:05:32.518 INFO:tasks.workunit.client.1.smithi172.stdout:0/536: dwrite d11/d22/d46/f97 [0,4194304] 0 2024-03-19T06:05:32.518 INFO:tasks.workunit.client.1.smithi172.stdout:9/495: mknod d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/cad 0 2024-03-19T06:05:32.520 INFO:tasks.workunit.client.1.smithi172.stdout:3/515: dread - d0/da8/d34/d4d/f5c zero size 2024-03-19T06:05:32.536 INFO:tasks.workunit.client.1.smithi172.stdout:1/561: rename da/c42 to da/d33/d52/cbd 0 2024-03-19T06:05:32.541 INFO:tasks.workunit.client.1.smithi172.stdout:0/537: dread - d11/f91 zero size 2024-03-19T06:05:32.543 INFO:tasks.workunit.client.1.smithi172.stdout:0/538: fsync d11/d14/d2c/d4e/f64 0 2024-03-19T06:05:32.550 INFO:tasks.workunit.client.1.smithi172.stdout:0/539: write d11/d14/d2c/d8d/f99 [71814,121424] 0 2024-03-19T06:05:32.554 INFO:tasks.workunit.client.1.smithi172.stdout:2/477: dread d7/db/f13 [0,4194304] 0 2024-03-19T06:05:32.554 INFO:tasks.workunit.client.1.smithi172.stdout:7/456: getdents d0/d22/d35 0 2024-03-19T06:05:32.555 INFO:tasks.workunit.client.1.smithi172.stdout:7/457: read - d0/f9a zero size 2024-03-19T06:05:32.561 INFO:tasks.workunit.client.1.smithi172.stdout:9/496: rename d1/d7/dc/d47/f76 to d1/fae 0 2024-03-19T06:05:32.564 INFO:tasks.workunit.client.1.smithi172.stdout:2/478: write d7/de/d58/d57/f8d [518465,108596] 0 2024-03-19T06:05:32.564 INFO:tasks.workunit.client.1.smithi172.stdout:7/458: creat d0/d22/d1d/f9e x:0 0 0 2024-03-19T06:05:32.569 INFO:tasks.workunit.client.0.smithi072.stdout:5/170: truncate fb 5995520 0 2024-03-19T06:05:32.569 INFO:tasks.workunit.client.1.smithi172.stdout:7/459: mknod d0/d22/d4b/c9f 0 2024-03-19T06:05:32.574 INFO:tasks.workunit.client.1.smithi172.stdout:9/497: rename d1/f93 to d1/d7/dc/faf 0 2024-03-19T06:05:32.575 INFO:tasks.workunit.client.1.smithi172.stdout:2/479: fsync d7/de/f29 0 2024-03-19T06:05:32.580 INFO:tasks.workunit.client.1.smithi172.stdout:8/468: dwrite d0/d44/d46/d49/d26/d71/d81/d27/d29/f33 [0,4194304] 0 2024-03-19T06:05:32.581 INFO:tasks.workunit.client.1.smithi172.stdout:3/516: truncate d0/d5/f23 3602020 0 2024-03-19T06:05:32.582 INFO:tasks.workunit.client.1.smithi172.stdout:0/540: write d11/d18/d38/f8f [2748932,82371] 0 2024-03-19T06:05:32.582 INFO:tasks.workunit.client.1.smithi172.stdout:5/470: dwrite d5/d3d/f5b [0,4194304] 0 2024-03-19T06:05:32.591 INFO:tasks.workunit.client.1.smithi172.stdout:8/469: write d0/d44/d46/d49/d3a/d3d/f73 [725654,5909] 0 2024-03-19T06:05:32.592 INFO:tasks.workunit.client.1.smithi172.stdout:6/620: dread d5/d8f/f6b [0,4194304] 0 2024-03-19T06:05:32.597 INFO:tasks.workunit.client.1.smithi172.stdout:5/471: creat d5/d3d/fa4 x:0 0 0 2024-03-19T06:05:32.604 INFO:tasks.workunit.client.1.smithi172.stdout:6/621: rmdir d5/d8f/d31/d3d/d98/dac 39 2024-03-19T06:05:32.605 INFO:tasks.workunit.client.1.smithi172.stdout:9/498: symlink d1/d7/dc/d47/d78/lb0 0 2024-03-19T06:05:32.609 INFO:tasks.workunit.client.1.smithi172.stdout:2/480: dwrite d7/f93 [4194304,4194304] 0 2024-03-19T06:05:32.609 INFO:tasks.workunit.client.1.smithi172.stdout:0/541: creat d11/fb8 x:0 0 0 2024-03-19T06:05:32.610 INFO:tasks.workunit.client.0.smithi072.stdout:5/171: truncate fb 3967713 0 2024-03-19T06:05:32.611 INFO:tasks.workunit.client.0.smithi072.stdout:5/172: dread - df/d11/f30 zero size 2024-03-19T06:05:32.617 INFO:tasks.workunit.client.1.smithi172.stdout:5/472: rename d5/d14/f4d to d5/d14/fa5 0 2024-03-19T06:05:32.617 INFO:tasks.workunit.client.1.smithi172.stdout:6/622: mkdir d5/d8f/d31/d3d/d98/db6/dc7 0 2024-03-19T06:05:32.618 INFO:tasks.workunit.client.1.smithi172.stdout:9/499: creat d1/d7/dc/fb1 x:0 0 0 2024-03-19T06:05:32.619 INFO:tasks.workunit.client.1.smithi172.stdout:8/470: dwrite d0/d44/d46/d49/d26/d71/d81/f6d [0,4194304] 0 2024-03-19T06:05:32.626 INFO:tasks.workunit.client.0.smithi072.stdout:5/173: truncate fe 2411585 0 2024-03-19T06:05:32.628 INFO:tasks.workunit.client.1.smithi172.stdout:6/623: truncate d5/fb 2994460 0 2024-03-19T06:05:32.629 INFO:tasks.workunit.client.1.smithi172.stdout:3/517: write d0/d5/d14/f17 [2186830,114930] 0 2024-03-19T06:05:32.632 INFO:tasks.workunit.client.1.smithi172.stdout:9/500: unlink d1/d7/dc/f99 0 2024-03-19T06:05:32.638 INFO:tasks.workunit.client.0.smithi072.stdout:5/174: dread f7 [4194304,4194304] 0 2024-03-19T06:05:32.639 INFO:tasks.workunit.client.1.smithi172.stdout:8/471: link d0/d64/d80/f45 d0/f94 0 2024-03-19T06:05:32.640 INFO:tasks.workunit.client.0.smithi072.stdout:5/175: chown df/d14/c1e 0 1 2024-03-19T06:05:32.640 INFO:tasks.workunit.client.1.smithi172.stdout:3/518: mkdir d0/db0 0 2024-03-19T06:05:32.643 INFO:tasks.workunit.client.1.smithi172.stdout:9/501: unlink d1/d7/dc/l46 0 2024-03-19T06:05:32.644 INFO:tasks.workunit.client.0.smithi072.stdout:5/176: truncate df/d16/f2d 351404 0 2024-03-19T06:05:32.648 INFO:tasks.workunit.client.1.smithi172.stdout:2/481: dwrite d7/f83 [0,4194304] 0 2024-03-19T06:05:32.651 INFO:tasks.workunit.client.1.smithi172.stdout:8/472: symlink d0/d44/d46/d49/d3a/l95 0 2024-03-19T06:05:32.654 INFO:tasks.workunit.client.1.smithi172.stdout:3/519: read d0/da8/d25/f1a [1199391,14219] 0 2024-03-19T06:05:32.654 INFO:tasks.workunit.client.1.smithi172.stdout:5/473: dwrite d5/d14/d15/d40/f99 [0,4194304] 0 2024-03-19T06:05:32.656 INFO:tasks.workunit.client.1.smithi172.stdout:8/473: creat d0/d64/d80/f96 x:0 0 0 2024-03-19T06:05:32.660 INFO:tasks.workunit.client.0.smithi072.stdout:5/177: dwrite df/f17 [0,4194304] 0 2024-03-19T06:05:32.663 INFO:tasks.workunit.client.0.smithi072.stdout:5/178: write df/d14/f2a [446666,125318] 0 2024-03-19T06:05:32.663 INFO:tasks.workunit.client.1.smithi172.stdout:2/482: rename d7/de/c40 to d7/de/d58/d56/c9f 0 2024-03-19T06:05:32.664 INFO:tasks.workunit.client.1.smithi172.stdout:5/474: truncate d5/d14/d15/d40/d6a/d7a/fa0 897295 0 2024-03-19T06:05:32.668 INFO:tasks.workunit.client.1.smithi172.stdout:2/483: symlink d7/d4c/la0 0 2024-03-19T06:05:32.673 INFO:tasks.workunit.client.0.smithi072.stdout:5/179: rename df/d11 to df/d13/d32 0 2024-03-19T06:05:32.675 INFO:tasks.workunit.client.1.smithi172.stdout:0/542: dread d11/d18/d38/d3f/f6e [0,4194304] 0 2024-03-19T06:05:32.675 INFO:tasks.workunit.client.1.smithi172.stdout:5/475: mknod d5/d3c/d6c/da2/ca6 0 2024-03-19T06:05:32.677 INFO:tasks.workunit.client.1.smithi172.stdout:2/484: mknod d7/de/d58/d56/d89/ca1 0 2024-03-19T06:05:32.680 INFO:tasks.workunit.client.1.smithi172.stdout:8/474: write d0/d64/d80/f45 [4135037,112670] 0 2024-03-19T06:05:32.680 INFO:tasks.workunit.client.1.smithi172.stdout:9/502: dwrite d1/d7/dc/d47/d78/f9f [0,4194304] 0 2024-03-19T06:05:32.683 INFO:tasks.workunit.client.1.smithi172.stdout:0/543: dread - d11/d22/d32/f44 zero size 2024-03-19T06:05:32.684 INFO:tasks.workunit.client.1.smithi172.stdout:5/476: chown d5/d1f/d2f/d53 844 1 2024-03-19T06:05:32.686 INFO:tasks.workunit.client.1.smithi172.stdout:3/520: dwrite d0/da8/d54/f70 [4194304,4194304] 0 2024-03-19T06:05:32.687 INFO:tasks.workunit.client.1.smithi172.stdout:5/477: write d5/d14/f7b [743135,19569] 0 2024-03-19T06:05:32.689 INFO:tasks.workunit.client.1.smithi172.stdout:8/475: symlink d0/d44/d46/d49/d3a/d3d/d83/l97 0 2024-03-19T06:05:32.689 INFO:tasks.workunit.client.1.smithi172.stdout:0/544: chown d11/l82 118357979 1 2024-03-19T06:05:32.690 INFO:tasks.workunit.client.0.smithi072.stdout:5/180: dwrite df/d14/f2a [0,4194304] 0 2024-03-19T06:05:32.692 INFO:tasks.workunit.client.1.smithi172.stdout:3/521: write d0/da8/d3a/f7b [4376331,56276] 0 2024-03-19T06:05:32.698 INFO:tasks.workunit.client.1.smithi172.stdout:3/522: creat d0/d5/fb1 x:0 0 0 2024-03-19T06:05:32.700 INFO:tasks.workunit.client.1.smithi172.stdout:2/485: dwrite d7/de/d58/d55/f82 [0,4194304] 0 2024-03-19T06:05:32.702 INFO:tasks.workunit.client.1.smithi172.stdout:9/503: dread d1/d7/dc/de/f1d [0,4194304] 0 2024-03-19T06:05:32.705 INFO:tasks.workunit.client.0.smithi072.stdout:5/181: unlink df/d14/l1c 0 2024-03-19T06:05:32.709 INFO:tasks.workunit.client.1.smithi172.stdout:3/523: symlink d0/da8/d60/d67/lb2 0 2024-03-19T06:05:32.714 INFO:tasks.workunit.client.1.smithi172.stdout:9/504: truncate d1/f1c 2823419 0 2024-03-19T06:05:32.715 INFO:tasks.workunit.client.1.smithi172.stdout:0/545: link d11/l82 d11/d14/d2c/d36/lb9 0 2024-03-19T06:05:32.716 INFO:tasks.workunit.client.1.smithi172.stdout:3/524: readlink d0/da8/d34/d4d/l65 0 2024-03-19T06:05:32.720 INFO:tasks.workunit.client.1.smithi172.stdout:0/546: unlink d11/d4d/c51 0 2024-03-19T06:05:32.721 INFO:tasks.workunit.client.1.smithi172.stdout:2/486: dwrite d7/f4e [0,4194304] 0 2024-03-19T06:05:32.723 INFO:tasks.workunit.client.1.smithi172.stdout:9/505: creat d1/d7/dc/de/d34/d48/fb2 x:0 0 0 2024-03-19T06:05:32.724 INFO:tasks.workunit.client.1.smithi172.stdout:1/562: sync 2024-03-19T06:05:32.724 INFO:tasks.workunit.client.1.smithi172.stdout:4/563: sync 2024-03-19T06:05:32.724 INFO:tasks.workunit.client.0.smithi072.stdout:5/182: dwrite df/d14/f15 [0,4194304] 0 2024-03-19T06:05:32.726 INFO:tasks.workunit.client.0.smithi072.stdout:5/183: chown df/d14/f2a 103387 1 2024-03-19T06:05:32.727 INFO:tasks.workunit.client.1.smithi172.stdout:4/564: truncate df/d11/d12/d26/f61 85697 0 2024-03-19T06:05:32.730 INFO:tasks.workunit.client.1.smithi172.stdout:2/487: mkdir d7/de/d58/d55/d5f/da2 0 2024-03-19T06:05:32.732 INFO:tasks.workunit.client.1.smithi172.stdout:2/488: write d7/d1b/f2a [8766697,58576] 0 2024-03-19T06:05:32.734 INFO:tasks.workunit.client.1.smithi172.stdout:0/547: symlink d11/d14/d2c/lba 0 2024-03-19T06:05:32.736 INFO:tasks.workunit.client.0.smithi072.stdout:5/184: dread fe [0,4194304] 0 2024-03-19T06:05:32.739 INFO:tasks.workunit.client.1.smithi172.stdout:3/525: rename d0/d5/d14/f30 to d0/d37/fb3 0 2024-03-19T06:05:32.742 INFO:tasks.workunit.client.1.smithi172.stdout:4/565: chown df/d11/f77 4784188 1 2024-03-19T06:05:32.743 INFO:tasks.workunit.client.1.smithi172.stdout:3/526: readlink d0/da8/d54/la0 0 2024-03-19T06:05:32.744 INFO:tasks.workunit.client.1.smithi172.stdout:4/566: dread - df/d2b/d2d/f6b zero size 2024-03-19T06:05:32.750 INFO:tasks.workunit.client.1.smithi172.stdout:1/563: rename da/dd/d10/f58 to da/dd/d10/d14/d27/d3f/d5e/dab/fbe 0 2024-03-19T06:05:32.750 INFO:tasks.workunit.client.1.smithi172.stdout:4/567: dread df/d2b/d2d/f8a [0,4194304] 0 2024-03-19T06:05:32.752 INFO:tasks.workunit.client.1.smithi172.stdout:4/568: dread - df/d11/d12/d6e/f7b zero size 2024-03-19T06:05:32.753 INFO:tasks.workunit.client.1.smithi172.stdout:2/489: truncate d7/db/d2c/f6f 1002635 0 2024-03-19T06:05:32.755 INFO:tasks.workunit.client.0.smithi072.stdout:5/185: chown df/d14/f15 21 1 2024-03-19T06:05:32.757 INFO:tasks.workunit.client.1.smithi172.stdout:4/569: rmdir df/d11/d12/d21/d50 39 2024-03-19T06:05:32.759 INFO:tasks.workunit.client.1.smithi172.stdout:2/490: mknod d7/de/d58/d57/ca3 0 2024-03-19T06:05:32.761 INFO:tasks.workunit.client.1.smithi172.stdout:0/548: getdents d11/d18/d38/d3f/d43/d62 0 2024-03-19T06:05:32.761 INFO:tasks.workunit.client.1.smithi172.stdout:3/527: dread d0/da8/d34/f8b [0,4194304] 0 2024-03-19T06:05:32.765 INFO:tasks.workunit.client.1.smithi172.stdout:4/570: truncate df/d2b/da3/fb4 311251 0 2024-03-19T06:05:32.766 INFO:tasks.workunit.client.1.smithi172.stdout:0/549: mkdir d11/d18/d38/d3f/d9f/dbb 0 2024-03-19T06:05:32.766 INFO:tasks.workunit.client.1.smithi172.stdout:3/528: truncate d0/da8/d60/f7e 1158308 0 2024-03-19T06:05:32.766 INFO:tasks.workunit.client.1.smithi172.stdout:2/491: creat d7/de/d58/d57/fa4 x:0 0 0 2024-03-19T06:05:32.766 INFO:tasks.workunit.client.0.smithi072.stdout:5/186: dread fb [0,4194304] 0 2024-03-19T06:05:32.767 INFO:tasks.workunit.client.1.smithi172.stdout:0/550: stat d11/d22/f34 0 2024-03-19T06:05:32.770 INFO:tasks.workunit.client.0.smithi072.stdout:5/187: mknod df/d14/c33 0 2024-03-19T06:05:32.770 INFO:tasks.workunit.client.1.smithi172.stdout:4/571: write df/d2b/f40 [3324637,5979] 0 2024-03-19T06:05:32.771 INFO:tasks.workunit.client.1.smithi172.stdout:1/564: dread da/dd/d10/d14/d27/d3f/d5e/f7e [0,4194304] 0 2024-03-19T06:05:32.774 INFO:tasks.workunit.client.1.smithi172.stdout:3/529: symlink d0/d37/lb4 0 2024-03-19T06:05:32.774 INFO:tasks.workunit.client.0.smithi072.stdout:5/188: mknod df/d16/c34 0 2024-03-19T06:05:32.775 INFO:tasks.workunit.client.1.smithi172.stdout:4/572: symlink df/d2b/d2d/db0/lbc 0 2024-03-19T06:05:32.778 INFO:tasks.workunit.client.1.smithi172.stdout:1/565: unlink da/d33/l88 0 2024-03-19T06:05:32.779 INFO:tasks.workunit.client.1.smithi172.stdout:9/506: dread d1/d7/dc/d47/da3/f74 [0,4194304] 0 2024-03-19T06:05:32.780 INFO:tasks.workunit.client.1.smithi172.stdout:0/551: rename d11/d22/d32/d7c to d11/d14/d2c/dbc 0 2024-03-19T06:05:32.784 INFO:tasks.workunit.client.1.smithi172.stdout:3/530: symlink d0/da8/d34/d4d/lb5 0 2024-03-19T06:05:32.785 INFO:tasks.workunit.client.0.smithi072.stdout:5/189: truncate df/d16/f2d 207416 0 2024-03-19T06:05:32.786 INFO:tasks.workunit.client.1.smithi172.stdout:4/573: read - df/d45/f6d zero size 2024-03-19T06:05:32.786 INFO:tasks.workunit.client.1.smithi172.stdout:9/507: write d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/fa0 [591741,59228] 0 2024-03-19T06:05:32.790 INFO:tasks.workunit.client.0.smithi072.stdout:5/190: creat df/d13/d32/d28/d31/f35 x:0 0 0 2024-03-19T06:05:32.790 INFO:tasks.workunit.client.1.smithi172.stdout:2/492: dread d7/f15 [0,4194304] 0 2024-03-19T06:05:32.796 INFO:tasks.workunit.client.1.smithi172.stdout:0/552: dread d11/d18/d38/d3f/f5e [0,4194304] 0 2024-03-19T06:05:32.796 INFO:tasks.workunit.client.1.smithi172.stdout:2/493: mkdir d7/de/d58/d55/d6e/da5 0 2024-03-19T06:05:32.798 INFO:tasks.workunit.client.1.smithi172.stdout:4/574: rename df/d11/d12/d21/d58/fb6 to df/d2b/d44/d67/fbd 0 2024-03-19T06:05:32.799 INFO:tasks.workunit.client.1.smithi172.stdout:3/531: dread d0/d37/da7/f94 [0,4194304] 0 2024-03-19T06:05:32.799 INFO:tasks.workunit.client.1.smithi172.stdout:1/566: dwrite da/dd/f1f [0,4194304] 0 2024-03-19T06:05:32.800 INFO:tasks.workunit.client.1.smithi172.stdout:9/508: link d1/d7/dc/d23/f9c d1/d7/fb3 0 2024-03-19T06:05:32.801 INFO:tasks.workunit.client.1.smithi172.stdout:0/553: chown d11/l66 509953238 1 2024-03-19T06:05:32.803 INFO:tasks.workunit.client.1.smithi172.stdout:1/567: mkdir da/dd/d31/d47/dbf 0 2024-03-19T06:05:32.803 INFO:tasks.workunit.client.1.smithi172.stdout:9/509: chown d1/d7/dc/d23/laa 1717984187 1 2024-03-19T06:05:32.805 INFO:tasks.workunit.client.0.smithi072.stdout:5/191: dwrite df/d13/f23 [0,4194304] 0 2024-03-19T06:05:32.807 INFO:tasks.workunit.client.1.smithi172.stdout:1/568: stat da/dd/d10/d14/d27/d53/f6b 0 2024-03-19T06:05:32.807 INFO:tasks.workunit.client.1.smithi172.stdout:0/554: creat d11/d14/d9a/fbd x:0 0 0 2024-03-19T06:05:32.812 INFO:tasks.workunit.client.1.smithi172.stdout:3/532: getdents d0/d5/d6b/dae 0 2024-03-19T06:05:32.813 INFO:tasks.workunit.client.1.smithi172.stdout:9/510: mkdir d1/d7/dc/de/d34/d48/d82/d92/d95/db4 0 2024-03-19T06:05:32.814 INFO:tasks.workunit.client.1.smithi172.stdout:1/569: creat da/dd/d31/d47/dbf/fc0 x:0 0 0 2024-03-19T06:05:32.816 INFO:tasks.workunit.client.1.smithi172.stdout:3/533: mkdir d0/db0/db6 0 2024-03-19T06:05:32.818 INFO:tasks.workunit.client.0.smithi072.stdout:5/192: write df/d13/d32/f12 [4272765,88350] 0 2024-03-19T06:05:32.821 INFO:tasks.workunit.client.1.smithi172.stdout:1/570: rmdir da/d33/d59 39 2024-03-19T06:05:32.823 INFO:tasks.workunit.client.0.smithi072.stdout:5/193: creat df/d16/f36 x:0 0 0 2024-03-19T06:05:32.824 INFO:tasks.workunit.client.1.smithi172.stdout:3/534: creat d0/da8/d54/d77/fb7 x:0 0 0 2024-03-19T06:05:32.825 INFO:tasks.workunit.client.0.smithi072.stdout:5/194: write df/d14/f15 [4225651,88435] 0 2024-03-19T06:05:32.826 INFO:tasks.workunit.client.1.smithi172.stdout:4/575: dwrite df/d11/f1d [0,4194304] 0 2024-03-19T06:05:32.827 INFO:tasks.workunit.client.1.smithi172.stdout:6/624: sync 2024-03-19T06:05:32.827 INFO:tasks.workunit.client.1.smithi172.stdout:7/460: sync 2024-03-19T06:05:32.830 INFO:tasks.workunit.client.0.smithi072.stdout:5/195: creat df/d13/d32/d28/f37 x:0 0 0 2024-03-19T06:05:32.831 INFO:tasks.workunit.client.0.smithi072.stdout:5/196: stat df/d13/d32/f30 0 2024-03-19T06:05:32.831 INFO:tasks.workunit.client.0.smithi072.stdout:5/197: readlink df/d16/l21 0 2024-03-19T06:05:32.833 INFO:tasks.workunit.client.1.smithi172.stdout:1/571: mkdir da/d33/d59/dc1 0 2024-03-19T06:05:32.836 INFO:tasks.workunit.client.1.smithi172.stdout:2/494: write d7/de/d58/d56/f46 [1795799,86240] 0 2024-03-19T06:05:32.840 INFO:tasks.workunit.client.1.smithi172.stdout:3/535: write d0/da8/d34/d4d/f4a [5219430,128070] 0 2024-03-19T06:05:32.842 INFO:tasks.workunit.client.1.smithi172.stdout:7/461: write d0/f7c [1693056,109895] 0 2024-03-19T06:05:32.843 INFO:tasks.workunit.client.0.smithi072.stdout:5/198: dread fb [0,4194304] 0 2024-03-19T06:05:32.845 INFO:tasks.workunit.client.1.smithi172.stdout:2/495: read d7/d4c/f51 [1012585,20638] 0 2024-03-19T06:05:32.848 INFO:tasks.workunit.client.1.smithi172.stdout:6/625: rename d5/d11/d43/c44 to d5/d8f/d31/d7b/cc8 0 2024-03-19T06:05:32.851 INFO:tasks.workunit.client.1.smithi172.stdout:1/572: mkdir da/dd/d10/d14/d27/d53/dc2 0 2024-03-19T06:05:32.852 INFO:tasks.workunit.client.1.smithi172.stdout:9/511: dwrite d1/d7/dc/de/d34/d48/d89/f98 [0,4194304] 0 2024-03-19T06:05:32.853 INFO:tasks.workunit.client.1.smithi172.stdout:0/555: dwrite d11/d18/d38/f80 [0,4194304] 0 2024-03-19T06:05:32.855 INFO:tasks.workunit.client.1.smithi172.stdout:7/462: truncate d0/d22/d1d/f45 194175 0 2024-03-19T06:05:32.856 INFO:tasks.workunit.client.0.smithi072.stdout:5/199: dread df/d14/f15 [0,4194304] 0 2024-03-19T06:05:32.859 INFO:tasks.workunit.client.1.smithi172.stdout:6/626: fdatasync d5/d11/d43/f4c 0 2024-03-19T06:05:32.859 INFO:tasks.workunit.client.1.smithi172.stdout:2/496: write d7/f83 [4342438,32357] 0 2024-03-19T06:05:32.860 INFO:tasks.workunit.client.1.smithi172.stdout:3/536: truncate d0/da8/d34/d4d/f2d 872558 0 2024-03-19T06:05:32.862 INFO:tasks.workunit.client.1.smithi172.stdout:9/512: chown d1/f6 3115 1 2024-03-19T06:05:32.865 INFO:tasks.workunit.client.1.smithi172.stdout:6/627: chown d5/d8f/l3b 115 1 2024-03-19T06:05:32.868 INFO:tasks.workunit.client.1.smithi172.stdout:2/497: chown d7/db/f73 213 1 2024-03-19T06:05:32.872 INFO:tasks.workunit.client.1.smithi172.stdout:2/498: dread - d7/de/f5d zero size 2024-03-19T06:05:32.872 INFO:tasks.workunit.client.1.smithi172.stdout:6/628: write d5/d11/d17/d1b/f21 [1626310,55935] 0 2024-03-19T06:05:32.873 INFO:tasks.workunit.client.0.smithi072.stdout:5/200: rmdir df 39 2024-03-19T06:05:32.873 INFO:tasks.workunit.client.1.smithi172.stdout:0/556: write d11/d22/d46/f97 [902954,45599] 0 2024-03-19T06:05:32.873 INFO:tasks.workunit.client.1.smithi172.stdout:8/476: sync 2024-03-19T06:05:32.873 INFO:tasks.workunit.client.1.smithi172.stdout:5/478: sync 2024-03-19T06:05:32.876 INFO:tasks.workunit.client.1.smithi172.stdout:8/477: readlink d0/l4 0 2024-03-19T06:05:32.878 INFO:tasks.workunit.client.1.smithi172.stdout:5/479: rmdir d5/d14/d56 39 2024-03-19T06:05:32.878 INFO:tasks.workunit.client.0.smithi072.stdout:5/201: symlink df/d13/d32/d28/d31/l38 0 2024-03-19T06:05:32.882 INFO:tasks.workunit.client.1.smithi172.stdout:2/499: rmdir d7/de/d58/d55/d66 39 2024-03-19T06:05:32.883 INFO:tasks.workunit.client.1.smithi172.stdout:0/557: mkdir d11/d18/d38/d3f/dbe 0 2024-03-19T06:05:32.886 INFO:tasks.workunit.client.1.smithi172.stdout:8/478: mkdir d0/d61/d6a/d98 0 2024-03-19T06:05:32.887 INFO:tasks.workunit.client.1.smithi172.stdout:5/480: stat d5/d1f/l2e 0 2024-03-19T06:05:32.889 INFO:tasks.workunit.client.1.smithi172.stdout:1/573: dread da/f3c [0,4194304] 0 2024-03-19T06:05:32.892 INFO:tasks.workunit.client.1.smithi172.stdout:4/576: dread df/f2e [0,4194304] 0 2024-03-19T06:05:32.893 INFO:tasks.workunit.client.1.smithi172.stdout:7/463: dwrite d0/d22/d1d/d36/d40/f93 [0,4194304] 0 2024-03-19T06:05:32.894 INFO:tasks.workunit.client.1.smithi172.stdout:0/558: mkdir d11/d14/d2c/dbf 0 2024-03-19T06:05:32.896 INFO:tasks.workunit.client.1.smithi172.stdout:2/500: write d7/db/f13 [4686583,54938] 0 2024-03-19T06:05:32.897 INFO:tasks.workunit.client.1.smithi172.stdout:6/629: chown d5/d8f/d31/d3d/d98/db6/d40/d53/c9d 898503035 1 2024-03-19T06:05:32.897 INFO:tasks.workunit.client.0.smithi072.stdout:5/202: dwrite df/d13/d32/d28/f37 [0,4194304] 0 2024-03-19T06:05:32.900 INFO:tasks.workunit.client.0.smithi072.stdout:5/203: rmdir df/d16 39 2024-03-19T06:05:32.901 INFO:tasks.workunit.client.1.smithi172.stdout:4/577: read - df/d2b/d2d/f73 zero size 2024-03-19T06:05:32.905 INFO:tasks.workunit.client.0.smithi072.stdout:5/204: creat df/d16/f39 x:0 0 0 2024-03-19T06:05:32.906 INFO:tasks.workunit.client.0.smithi072.stdout:5/205: dread - df/d16/f39 zero size 2024-03-19T06:05:32.906 INFO:tasks.workunit.client.1.smithi172.stdout:1/574: write da/dd/d10/d14/d84/d9b/f9d [827698,31052] 0 2024-03-19T06:05:32.910 INFO:tasks.workunit.client.0.smithi072.stdout:5/206: creat df/d13/d32/f3a x:0 0 0 2024-03-19T06:05:32.911 INFO:tasks.workunit.client.1.smithi172.stdout:8/479: creat d0/d44/d46/d49/d26/d71/d81/f99 x:0 0 0 2024-03-19T06:05:32.913 INFO:tasks.workunit.client.1.smithi172.stdout:3/537: dwrite d0/da8/d34/d4d/f4a [4194304,4194304] 0 2024-03-19T06:05:32.914 INFO:tasks.workunit.client.1.smithi172.stdout:2/501: write d7/db/d2c/d35/f41 [983879,75740] 0 2024-03-19T06:05:32.917 INFO:tasks.workunit.client.1.smithi172.stdout:1/575: chown da/dd/d10/d14/f62 1 1 2024-03-19T06:05:32.918 INFO:tasks.workunit.client.0.smithi072.stdout:5/207: rename df/d16/c1b to df/d13/c3b 0 2024-03-19T06:05:32.919 INFO:tasks.workunit.client.1.smithi172.stdout:8/480: readlink d0/d44/d46/d49/l31 0 2024-03-19T06:05:32.919 INFO:tasks.workunit.client.1.smithi172.stdout:7/464: write d0/d22/f26 [1589872,128011] 0 2024-03-19T06:05:32.924 INFO:tasks.workunit.client.0.smithi072.stdout:5/208: unlink df/d14/c19 0 2024-03-19T06:05:32.927 INFO:tasks.workunit.client.0.smithi072.stdout:5/209: fsync df/d14/f2f 0 2024-03-19T06:05:32.929 INFO:tasks.workunit.client.1.smithi172.stdout:9/513: dread d1/d7/dc/de/d34/d48/f5f [0,4194304] 0 2024-03-19T06:05:32.935 INFO:tasks.workunit.client.1.smithi172.stdout:2/502: truncate d7/de/d58/d56/f34 1102644 0 2024-03-19T06:05:32.939 INFO:tasks.workunit.client.1.smithi172.stdout:7/465: chown d0/d22/d1d/d36/l69 169306329 1 2024-03-19T06:05:32.940 INFO:tasks.workunit.client.1.smithi172.stdout:8/481: write d0/d44/d46/d49/d26/d71/d81/d27/f1e [513713,88765] 0 2024-03-19T06:05:32.940 INFO:tasks.workunit.client.1.smithi172.stdout:1/576: fsync da/dd/d10/d14/d27/d3f/d5e/fb1 0 2024-03-19T06:05:32.943 INFO:tasks.workunit.client.1.smithi172.stdout:7/466: read - d0/d22/d3d/d41/f87 zero size 2024-03-19T06:05:32.944 INFO:tasks.workunit.client.1.smithi172.stdout:9/514: creat d1/fb5 x:0 0 0 2024-03-19T06:05:32.944 INFO:tasks.workunit.client.1.smithi172.stdout:5/481: dwrite d5/d14/d56/f6f [0,4194304] 0 2024-03-19T06:05:32.948 INFO:tasks.workunit.client.1.smithi172.stdout:0/559: truncate d11/d18/d38/d3f/d43/d62/f74 3132361 0 2024-03-19T06:05:32.951 INFO:tasks.workunit.client.1.smithi172.stdout:3/538: write d0/d5/f23 [1901466,66177] 0 2024-03-19T06:05:32.956 INFO:tasks.workunit.client.1.smithi172.stdout:9/515: fdatasync d1/f5e 0 2024-03-19T06:05:32.956 INFO:tasks.workunit.client.1.smithi172.stdout:8/482: creat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c/f9a x:0 0 0 2024-03-19T06:05:32.956 INFO:tasks.workunit.client.1.smithi172.stdout:0/560: stat d11/d18/da5/da8 0 2024-03-19T06:05:32.957 INFO:tasks.workunit.client.0.smithi072.stdout:5/210: truncate df/f17 173056 0 2024-03-19T06:05:32.957 INFO:tasks.workunit.client.1.smithi172.stdout:6/630: dwrite d5/d11/d2f/f6d [0,4194304] 0 2024-03-19T06:05:32.957 INFO:tasks.workunit.client.1.smithi172.stdout:3/539: fsync d0/da8/d34/d4d/f5c 0 2024-03-19T06:05:32.958 INFO:tasks.workunit.client.1.smithi172.stdout:1/577: dread - da/dd/d10/d36/f9a zero size 2024-03-19T06:05:32.962 INFO:tasks.workunit.client.1.smithi172.stdout:7/467: unlink d0/d22/d1d/d36/d8d/d7d/c90 0 2024-03-19T06:05:32.970 INFO:tasks.workunit.client.1.smithi172.stdout:8/483: rmdir d0/d61/d6a/d7e 39 2024-03-19T06:05:32.972 INFO:tasks.workunit.client.0.smithi072.stdout:5/211: rmdir df/d13 39 2024-03-19T06:05:32.973 INFO:tasks.workunit.client.1.smithi172.stdout:4/578: dwrite df/d11/d12/f1e [4194304,4194304] 0 2024-03-19T06:05:32.973 INFO:tasks.workunit.client.1.smithi172.stdout:0/561: mkdir d11/d18/d38/d3f/d43/d62/dc0 0 2024-03-19T06:05:32.974 INFO:tasks.workunit.client.1.smithi172.stdout:3/540: fdatasync d0/da8/d54/d77/f99 0 2024-03-19T06:05:32.975 INFO:tasks.workunit.client.1.smithi172.stdout:7/468: fdatasync d0/d22/d1d/d3a/d46/f99 0 2024-03-19T06:05:32.977 INFO:tasks.workunit.client.0.smithi072.stdout:5/212: read - df/d13/d32/f30 zero size 2024-03-19T06:05:32.979 INFO:tasks.workunit.client.1.smithi172.stdout:2/503: dwrite d7/d1b/f3f [0,4194304] 0 2024-03-19T06:05:32.979 INFO:tasks.workunit.client.1.smithi172.stdout:4/579: readlink df/d11/d12/l42 0 2024-03-19T06:05:32.984 INFO:tasks.workunit.client.1.smithi172.stdout:7/469: readlink d0/d22/d1d/l65 0 2024-03-19T06:05:32.985 INFO:tasks.workunit.client.0.smithi072.stdout:5/213: rename df/d13/d32/d28/d31 to df/d3c 0 2024-03-19T06:05:32.986 INFO:tasks.workunit.client.1.smithi172.stdout:4/580: write df/d2b/f57 [3654528,106754] 0 2024-03-19T06:05:32.988 INFO:tasks.workunit.client.0.smithi072.stdout:5/214: write df/d13/d32/d28/f37 [4021895,121260] 0 2024-03-19T06:05:32.988 INFO:tasks.workunit.client.1.smithi172.stdout:9/516: creat d1/d7/fb6 x:0 0 0 2024-03-19T06:05:32.989 INFO:tasks.workunit.client.1.smithi172.stdout:4/581: chown df/f2e 0 1 2024-03-19T06:05:32.990 INFO:tasks.workunit.client.1.smithi172.stdout:3/541: fdatasync d0/d37/da7/f94 0 2024-03-19T06:05:32.992 INFO:tasks.workunit.client.1.smithi172.stdout:5/482: rename d5/d14/d15/l92 to d5/d14/d15/la7 0 2024-03-19T06:05:32.996 INFO:tasks.workunit.client.1.smithi172.stdout:8/484: creat d0/d44/d46/d49/d26/d71/d81/d27/f9b x:0 0 0 2024-03-19T06:05:32.997 INFO:tasks.workunit.client.1.smithi172.stdout:1/578: link da/dd/d10/d14/d27/f5a da/dd/d31/d47/fc3 0 2024-03-19T06:05:32.998 INFO:tasks.workunit.client.1.smithi172.stdout:0/562: mkdir d11/d4d/dab/dc1 0 2024-03-19T06:05:32.999 INFO:tasks.workunit.client.1.smithi172.stdout:2/504: write d7/d1b/f9c [174039,115815] 0 2024-03-19T06:05:33.002 INFO:tasks.workunit.client.1.smithi172.stdout:5/483: rmdir d5/d3d 39 2024-03-19T06:05:33.004 INFO:tasks.workunit.client.1.smithi172.stdout:1/579: write da/dd/d10/f24 [2184265,8994] 0 2024-03-19T06:05:33.005 INFO:tasks.workunit.client.1.smithi172.stdout:8/485: mkdir d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d9c 0 2024-03-19T06:05:33.009 INFO:tasks.workunit.client.1.smithi172.stdout:0/563: mkdir d11/d14/d2c/dc2 0 2024-03-19T06:05:33.010 INFO:tasks.workunit.client.1.smithi172.stdout:8/486: fsync d0/d44/d46/d49/d26/d71/d81/d8e/f47 0 2024-03-19T06:05:33.012 INFO:tasks.workunit.client.1.smithi172.stdout:0/564: stat d11/d22/d32/f44 0 2024-03-19T06:05:33.016 INFO:tasks.workunit.client.1.smithi172.stdout:5/484: dread d5/d3c/f5a [0,4194304] 0 2024-03-19T06:05:33.016 INFO:tasks.workunit.client.1.smithi172.stdout:6/631: truncate d5/d8f/d31/d7b/f7f 621135 0 2024-03-19T06:05:33.017 INFO:tasks.workunit.client.1.smithi172.stdout:4/582: write df/d11/f32 [994750,79186] 0 2024-03-19T06:05:33.019 INFO:tasks.workunit.client.1.smithi172.stdout:6/632: write d5/f13 [2492425,91120] 0 2024-03-19T06:05:33.020 INFO:tasks.workunit.client.1.smithi172.stdout:7/470: truncate d0/d22/d1d/d36/d56/f79 1735496 0 2024-03-19T06:05:33.022 INFO:tasks.workunit.client.1.smithi172.stdout:3/542: truncate d0/d5/f1c 1237914 0 2024-03-19T06:05:33.023 INFO:tasks.workunit.client.0.smithi072.stdout:5/215: dwrite df/d16/f2d [0,4194304] 0 2024-03-19T06:05:33.027 INFO:tasks.workunit.client.1.smithi172.stdout:2/505: dwrite d7/f93 [4194304,4194304] 0 2024-03-19T06:05:33.027 INFO:tasks.workunit.client.1.smithi172.stdout:5/485: write d5/d14/d56/f8c [889810,85348] 0 2024-03-19T06:05:33.027 INFO:tasks.workunit.client.1.smithi172.stdout:1/580: write da/dd/d10/d14/f62 [768917,50207] 0 2024-03-19T06:05:33.028 INFO:tasks.workunit.client.0.smithi072.stdout:5/216: rmdir df/d13/d32 39 2024-03-19T06:05:33.030 INFO:tasks.workunit.client.0.smithi072.stdout:5/217: truncate df/d3c/f35 985043 0 2024-03-19T06:05:33.031 INFO:tasks.workunit.client.1.smithi172.stdout:3/543: rmdir d0/da8/d54/d90 39 2024-03-19T06:05:33.034 INFO:tasks.workunit.client.1.smithi172.stdout:5/486: read - d5/d14/d34/d66/f8e zero size 2024-03-19T06:05:33.037 INFO:tasks.workunit.client.1.smithi172.stdout:2/506: mkdir d7/da6 0 2024-03-19T06:05:33.043 INFO:tasks.workunit.client.1.smithi172.stdout:7/471: getdents d0/d22 0 2024-03-19T06:05:33.044 INFO:tasks.workunit.client.1.smithi172.stdout:8/487: truncate d0/f2 3953068 0 2024-03-19T06:05:33.047 INFO:tasks.workunit.client.1.smithi172.stdout:4/583: rename df/d11/d12/d26/d84/f91 to df/d11/d12/d21/d50/d63/fbe 0 2024-03-19T06:05:33.049 INFO:tasks.workunit.client.0.smithi072.stdout:5/218: write df/f26 [428529,70902] 0 2024-03-19T06:05:33.050 INFO:tasks.workunit.client.1.smithi172.stdout:9/517: dread d1/d7/dc/de/d34/f45 [0,4194304] 0 2024-03-19T06:05:33.052 INFO:tasks.workunit.client.1.smithi172.stdout:1/581: truncate da/dd/f39 1216716 0 2024-03-19T06:05:33.053 INFO:tasks.workunit.client.1.smithi172.stdout:9/518: write d1/d7/dc/d47/d78/d54/f6d [403775,120869] 0 2024-03-19T06:05:33.053 INFO:tasks.workunit.client.1.smithi172.stdout:7/472: symlink d0/d22/d1d/d36/d56/la0 0 2024-03-19T06:05:33.055 INFO:tasks.workunit.client.1.smithi172.stdout:5/487: mknod d5/d14/d15/ca8 0 2024-03-19T06:05:33.058 INFO:tasks.workunit.client.1.smithi172.stdout:8/488: rename d0/d44/d46/d49/d4f/d5c to d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d 0 2024-03-19T06:05:33.059 INFO:tasks.workunit.client.1.smithi172.stdout:3/544: creat d0/d37/fb8 x:0 0 0 2024-03-19T06:05:33.059 INFO:tasks.workunit.client.1.smithi172.stdout:1/582: mknod da/dd/d31/cc4 0 2024-03-19T06:05:33.060 INFO:tasks.workunit.client.1.smithi172.stdout:2/507: link d7/de/d58/d57/c71 d7/de/d58/d55/d6e/ca7 0 2024-03-19T06:05:33.060 INFO:tasks.workunit.client.1.smithi172.stdout:4/584: mknod df/d11/cbf 0 2024-03-19T06:05:33.063 INFO:tasks.workunit.client.0.smithi072.stdout:5/219: dread df/d13/f23 [0,4194304] 0 2024-03-19T06:05:33.063 INFO:tasks.workunit.client.1.smithi172.stdout:3/545: dread - d0/d5/d6b/dae/fad zero size 2024-03-19T06:05:33.064 INFO:tasks.workunit.client.1.smithi172.stdout:4/585: chown df/d11/d12/d26/f30 0 1 2024-03-19T06:05:33.065 INFO:tasks.workunit.client.1.smithi172.stdout:9/519: write d1/d7/dc/de/d34/f41 [2480843,92343] 0 2024-03-19T06:05:33.065 INFO:tasks.workunit.client.1.smithi172.stdout:5/488: mknod d5/d3c/d6c/ca9 0 2024-03-19T06:05:33.067 INFO:tasks.workunit.client.0.smithi072.stdout:5/220: mkdir df/d13/d24/d3d 0 2024-03-19T06:05:33.069 INFO:tasks.workunit.client.0.smithi072.stdout:5/221: write df/d16/f2d [3394316,20792] 0 2024-03-19T06:05:33.070 INFO:tasks.workunit.client.1.smithi172.stdout:3/546: mkdir d0/d5/d6b/dae/db9 0 2024-03-19T06:05:33.070 INFO:tasks.workunit.client.1.smithi172.stdout:4/586: write df/d11/d12/d26/f35 [2863968,13550] 0 2024-03-19T06:05:33.071 INFO:tasks.workunit.client.1.smithi172.stdout:0/565: dread f2 [0,4194304] 0 2024-03-19T06:05:33.075 INFO:tasks.workunit.client.0.smithi072.stdout:5/222: creat df/d13/f3e x:0 0 0 2024-03-19T06:05:33.076 INFO:tasks.workunit.client.1.smithi172.stdout:9/520: mkdir d1/d7/dc/db7 0 2024-03-19T06:05:33.078 INFO:tasks.workunit.client.0.smithi072.stdout:5/223: mknod df/d13/c3f 0 2024-03-19T06:05:33.078 INFO:tasks.workunit.client.1.smithi172.stdout:9/521: dread - d1/d7/dc/fb1 zero size 2024-03-19T06:05:33.080 INFO:tasks.workunit.client.1.smithi172.stdout:8/489: link d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/f8d d0/d44/d46/d49/d26/d71/f9e 0 2024-03-19T06:05:33.081 INFO:tasks.workunit.client.1.smithi172.stdout:4/587: mknod df/d2b/cc0 0 2024-03-19T06:05:33.085 INFO:tasks.workunit.client.1.smithi172.stdout:0/566: dread d11/d18/d38/d3f/f6e [0,4194304] 0 2024-03-19T06:05:33.087 INFO:tasks.workunit.client.1.smithi172.stdout:2/508: rename d7/de/d58/d55/d5f/d6a to d7/de/d58/d55/da8 0 2024-03-19T06:05:33.089 INFO:tasks.workunit.client.1.smithi172.stdout:1/583: truncate da/dd/d10/d14/d27/d3f/d5e/f7e 2699722 0 2024-03-19T06:05:33.089 INFO:tasks.workunit.client.1.smithi172.stdout:8/490: rmdir d0/d44/d46/d49/d4f 39 2024-03-19T06:05:33.093 INFO:tasks.workunit.client.1.smithi172.stdout:5/489: getdents d5/d14/d15/d40/d6a/d7a 0 2024-03-19T06:05:33.095 INFO:tasks.workunit.client.0.smithi072.stdout:5/224: dwrite df/d13/d32/f12 [0,4194304] 0 2024-03-19T06:05:33.099 INFO:tasks.workunit.client.1.smithi172.stdout:5/490: mknod d5/d14/d56/caa 0 2024-03-19T06:05:33.101 INFO:tasks.workunit.client.1.smithi172.stdout:3/547: rename d0/da8/d3a/c47 to d0/cba 0 2024-03-19T06:05:33.102 INFO:tasks.workunit.client.1.smithi172.stdout:8/491: mkdir d0/d61/d6a/d9f 0 2024-03-19T06:05:33.103 INFO:tasks.workunit.client.1.smithi172.stdout:5/491: readlink d5/d14/d15/l47 0 2024-03-19T06:05:33.104 INFO:tasks.workunit.client.1.smithi172.stdout:4/588: rename df/d11/d12/d6e/f7b to df/d2b/d44/d93/fc1 0 2024-03-19T06:05:33.106 INFO:tasks.workunit.client.1.smithi172.stdout:9/522: dread d1/d7/dc/de/f1f [0,4194304] 0 2024-03-19T06:05:33.108 INFO:tasks.workunit.client.1.smithi172.stdout:2/509: dwrite d7/d1b/f2a [0,4194304] 0 2024-03-19T06:05:33.109 INFO:tasks.workunit.client.1.smithi172.stdout:3/548: chown d0/d5/d14/la1 0 1 2024-03-19T06:05:33.112 INFO:tasks.workunit.client.0.smithi072.stdout:5/225: truncate df/d14/f2a 1120872 0 2024-03-19T06:05:33.113 INFO:tasks.workunit.client.0.smithi072.stdout:5/226: stat df/d13/d24/d3d 0 2024-03-19T06:05:33.117 INFO:tasks.workunit.client.1.smithi172.stdout:2/510: chown d7/de/d58/d57/f7d 10 1 2024-03-19T06:05:33.117 INFO:tasks.workunit.client.1.smithi172.stdout:3/549: write d0/da8/f2c [5584115,125184] 0 2024-03-19T06:05:33.117 INFO:tasks.workunit.client.1.smithi172.stdout:2/511: truncate d7/d1b/f9c 317637 0 2024-03-19T06:05:33.118 INFO:tasks.workunit.client.0.smithi072.stdout:5/227: symlink df/d14/l40 0 2024-03-19T06:05:33.119 INFO:tasks.workunit.client.1.smithi172.stdout:4/589: mknod df/d2b/da3/cc2 0 2024-03-19T06:05:33.119 INFO:tasks.workunit.client.1.smithi172.stdout:2/512: dread - d7/d1b/f97 zero size 2024-03-19T06:05:33.120 INFO:tasks.workunit.client.0.smithi072.stdout:5/228: chown fb 15 1 2024-03-19T06:05:33.120 INFO:tasks.workunit.client.1.smithi172.stdout:0/567: rename d11/d18/d38/d3f/d43/d9c to d11/dc3 0 2024-03-19T06:05:33.121 INFO:tasks.workunit.client.0.smithi072.stdout:5/229: stat df/d13/f23 0 2024-03-19T06:05:33.123 INFO:tasks.workunit.client.1.smithi172.stdout:5/492: link d5/d3c/d6c/ca9 d5/d14/d9f/cab 0 2024-03-19T06:05:33.123 INFO:tasks.workunit.client.1.smithi172.stdout:0/568: dread - d11/d14/d2c/d36/f8c zero size 2024-03-19T06:05:33.126 INFO:tasks.workunit.client.1.smithi172.stdout:3/550: creat d0/d5/d14/fbb x:0 0 0 2024-03-19T06:05:33.127 INFO:tasks.workunit.client.1.smithi172.stdout:1/584: rename da/d3b/c3e to da/dd/d10/d14/d27/d3f/d5e/cc5 0 2024-03-19T06:05:33.129 INFO:tasks.workunit.client.0.smithi072.stdout:5/230: dread fe [0,4194304] 0 2024-03-19T06:05:33.130 INFO:tasks.workunit.client.1.smithi172.stdout:1/585: write da/dd/d10/d36/f38 [3365832,81394] 0 2024-03-19T06:05:33.133 INFO:tasks.workunit.client.1.smithi172.stdout:5/493: mknod d5/d14/d15/cac 0 2024-03-19T06:05:33.134 INFO:tasks.workunit.client.1.smithi172.stdout:1/586: read da/d33/f86 [654981,115459] 0 2024-03-19T06:05:33.136 INFO:tasks.workunit.client.1.smithi172.stdout:0/569: rename d11/d22/f3d to d11/d22/d46/d84/fc4 0 2024-03-19T06:05:33.138 INFO:tasks.workunit.client.1.smithi172.stdout:1/587: readlink da/d33/lbb 0 2024-03-19T06:05:33.143 INFO:tasks.workunit.client.1.smithi172.stdout:3/551: creat d0/fbc x:0 0 0 2024-03-19T06:05:33.144 INFO:tasks.workunit.client.0.smithi072.stdout:5/231: dwrite df/d13/d32/f30 [0,4194304] 0 2024-03-19T06:05:33.146 INFO:tasks.workunit.client.1.smithi172.stdout:9/523: dwrite d1/f75 [0,4194304] 0 2024-03-19T06:05:33.146 INFO:tasks.workunit.client.1.smithi172.stdout:2/513: write d7/db/f24 [1218832,1961] 0 2024-03-19T06:05:33.146 INFO:tasks.workunit.client.0.smithi072.stdout:5/232: write df/f26 [1700028,84364] 0 2024-03-19T06:05:33.152 INFO:tasks.workunit.client.0.smithi072.stdout:5/233: rename df/d16/f2d to df/d16/f41 0 2024-03-19T06:05:33.153 INFO:tasks.workunit.client.1.smithi172.stdout:8/492: dwrite d0/d44/d46/d49/d26/d71/f9e [0,4194304] 0 2024-03-19T06:05:33.153 INFO:tasks.workunit.client.0.smithi072.stdout:5/234: fsync df/d16/f39 0 2024-03-19T06:05:33.154 INFO:tasks.workunit.client.1.smithi172.stdout:1/588: mknod da/d33/d59/d90/cc6 0 2024-03-19T06:05:33.155 INFO:tasks.workunit.client.1.smithi172.stdout:4/590: dwrite df/f4d [0,4194304] 0 2024-03-19T06:05:33.158 INFO:tasks.workunit.client.0.smithi072.stdout:5/235: mkdir df/d13/d32/d28/d42 0 2024-03-19T06:05:33.178 INFO:tasks.workunit.client.1.smithi172.stdout:3/552: dwrite d0/da8/d54/d77/f9d [0,4194304] 0 2024-03-19T06:05:33.179 INFO:tasks.workunit.client.0.smithi072.stdout:5/236: dwrite f7 [0,4194304] 0 2024-03-19T06:05:33.179 INFO:tasks.workunit.client.1.smithi172.stdout:0/570: dwrite d11/d22/d32/f77 [0,4194304] 0 2024-03-19T06:05:33.182 INFO:tasks.workunit.client.1.smithi172.stdout:3/553: chown d0/d5/d6b/dae/d88/l9e 49786632 1 2024-03-19T06:05:33.182 INFO:tasks.workunit.client.1.smithi172.stdout:1/589: dwrite da/dd/d31/f4d [0,4194304] 0 2024-03-19T06:05:33.184 INFO:tasks.workunit.client.1.smithi172.stdout:0/571: truncate d11/d18/da5/da8/fac 1002334 0 2024-03-19T06:05:33.221 INFO:tasks.workunit.client.1.smithi172.stdout:5/494: rename d5/f18 to d5/d3d/d60/fad 0 2024-03-19T06:05:33.221 INFO:tasks.workunit.client.1.smithi172.stdout:9/524: mknod d1/d7/dc/d47/cb8 0 2024-03-19T06:05:33.223 INFO:tasks.workunit.client.1.smithi172.stdout:5/495: chown d5/d14/d15/ca8 111610 1 2024-03-19T06:05:33.237 INFO:tasks.workunit.client.0.smithi072.stdout:5/237: dread df/d13/f23 [0,4194304] 0 2024-03-19T06:05:33.238 INFO:tasks.workunit.client.1.smithi172.stdout:8/493: dwrite d0/f85 [0,4194304] 0 2024-03-19T06:05:33.239 INFO:tasks.workunit.client.1.smithi172.stdout:9/525: dwrite d1/d7/dc/d23/f33 [0,4194304] 0 2024-03-19T06:05:33.239 INFO:tasks.workunit.client.0.smithi072.stdout:5/238: fsync df/d16/f36 0 2024-03-19T06:05:33.240 INFO:tasks.workunit.client.1.smithi172.stdout:6/633: sync 2024-03-19T06:05:33.241 INFO:tasks.workunit.client.0.smithi072.stdout:5/239: chown df/d13/d32/f30 93 1 2024-03-19T06:05:33.248 INFO:tasks.workunit.client.0.smithi072.stdout:5/240: mkdir df/d13/d24/d3d/d43 0 2024-03-19T06:05:33.252 INFO:tasks.workunit.client.0.smithi072.stdout:5/241: write df/d14/f15 [686219,58874] 0 2024-03-19T06:05:33.257 INFO:tasks.workunit.client.0.smithi072.stdout:5/242: creat df/d13/d32/d28/f44 x:0 0 0 2024-03-19T06:05:33.257 INFO:tasks.workunit.client.0.smithi072.stdout:5/243: read fb [3879805,14514] 0 2024-03-19T06:05:33.261 INFO:tasks.workunit.client.0.smithi072.stdout:5/244: truncate df/d13/d32/f12 4510989 0 2024-03-19T06:05:33.305 INFO:tasks.workunit.client.1.smithi172.stdout:7/473: sync 2024-03-19T06:05:33.762 INFO:tasks.workunit.client.1.smithi172.stdout:3/554: creat d0/d5/d6b/dae/d88/fbd x:0 0 0 2024-03-19T06:05:33.766 INFO:tasks.workunit.client.0.smithi072.stdout:5/245: write df/d16/f36 [314658,62324] 0 2024-03-19T06:05:33.814 INFO:tasks.workunit.client.0.smithi072.stdout:5/246: mkdir df/d13/d32/d45 0 2024-03-19T06:05:33.821 INFO:tasks.workunit.client.0.smithi072.stdout:5/247: dread fe [0,4194304] 0 2024-03-19T06:05:33.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:33 smithi072 ceph-mon[28706]: pgmap v13: 65 pgs: 65 active+clean; 857 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 108 MiB/s wr, 229 op/s 2024-03-19T06:05:33.836 INFO:tasks.workunit.client.1.smithi172.stdout:0/572: truncate d11/d14/f2e 808035 0 2024-03-19T06:05:33.837 INFO:tasks.workunit.client.0.smithi072.stdout:5/248: dread df/f26 [0,4194304] 0 2024-03-19T06:05:33.843 INFO:tasks.workunit.client.0.smithi072.stdout:5/249: unlink df/d14/c1e 0 2024-03-19T06:05:33.843 INFO:tasks.workunit.client.1.smithi172.stdout:2/514: dwrite d7/de/d61/f65 [0,4194304] 0 2024-03-19T06:05:33.844 INFO:tasks.workunit.client.0.smithi072.stdout:5/250: chown df/d13/d24 14338 1 2024-03-19T06:05:33.844 INFO:tasks.workunit.client.1.smithi172.stdout:4/591: rename df/d2b/d2d/f73 to df/d11/d12/d21/d50/fc3 0 2024-03-19T06:05:33.846 INFO:tasks.workunit.client.0.smithi072.stdout:5/251: write df/d16/f39 [244112,110264] 0 2024-03-19T06:05:33.847 INFO:tasks.workunit.client.1.smithi172.stdout:4/592: readlink df/d11/d12/d69/l6a 0 2024-03-19T06:05:33.850 INFO:tasks.workunit.client.0.smithi072.stdout:5/252: truncate df/d14/f2f 571008 0 2024-03-19T06:05:33.852 INFO:tasks.workunit.client.0.smithi072.stdout:5/253: fsync df/d13/d32/f30 0 2024-03-19T06:05:33.864 INFO:tasks.workunit.client.1.smithi172.stdout:8/494: rmdir d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c 39 2024-03-19T06:05:33.876 INFO:tasks.workunit.client.1.smithi172.stdout:9/526: dread d1/d7/dc/d47/da3/f74 [4194304,4194304] 0 2024-03-19T06:05:33.878 INFO:tasks.workunit.client.1.smithi172.stdout:1/590: creat da/dd/d10/d14/d27/d3f/fc7 x:0 0 0 2024-03-19T06:05:33.883 INFO:tasks.workunit.client.1.smithi172.stdout:9/527: read d1/d7/dc/de/d34/d48/d89/fac [1024658,49370] 0 2024-03-19T06:05:33.888 INFO:tasks.workunit.client.0.smithi072.stdout:5/254: truncate df/f26 1232954 0 2024-03-19T06:05:33.891 INFO:tasks.workunit.client.0.smithi072.stdout:5/255: symlink df/d13/d24/l46 0 2024-03-19T06:05:33.893 INFO:tasks.workunit.client.0.smithi072.stdout:5/256: truncate df/d14/f15 5093492 0 2024-03-19T06:05:33.897 INFO:tasks.workunit.client.0.smithi072.stdout:5/257: mknod df/d13/d24/d3d/d43/c47 0 2024-03-19T06:05:33.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:33 smithi172 ceph-mon[35716]: pgmap v13: 65 pgs: 65 active+clean; 857 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 108 MiB/s wr, 229 op/s 2024-03-19T06:05:33.905 INFO:tasks.workunit.client.1.smithi172.stdout:2/515: truncate d7/d1b/f20 119813 0 2024-03-19T06:05:33.911 INFO:tasks.workunit.client.1.smithi172.stdout:7/474: creat d0/d22/d27/d86/fa1 x:0 0 0 2024-03-19T06:05:33.913 INFO:tasks.workunit.client.1.smithi172.stdout:0/573: mkdir d11/d18/d38/d3f/d43/dc5 0 2024-03-19T06:05:33.916 INFO:tasks.workunit.client.1.smithi172.stdout:8/495: rename d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/l4d to d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/la0 0 2024-03-19T06:05:33.921 INFO:tasks.workunit.client.1.smithi172.stdout:2/516: mknod d7/de/d58/d56/d86/d9e/ca9 0 2024-03-19T06:05:33.925 INFO:tasks.workunit.client.1.smithi172.stdout:3/555: dwrite d0/da8/d25/f74 [0,4194304] 0 2024-03-19T06:05:33.928 INFO:tasks.workunit.client.1.smithi172.stdout:2/517: mkdir d7/d4c/d70/daa 0 2024-03-19T06:05:33.928 INFO:tasks.workunit.client.1.smithi172.stdout:0/574: link d11/d14/d2c/d36/f4f d11/dc3/fc6 0 2024-03-19T06:05:33.930 INFO:tasks.workunit.client.1.smithi172.stdout:2/518: write d7/d4c/f51 [4404876,1577] 0 2024-03-19T06:05:33.931 INFO:tasks.workunit.client.1.smithi172.stdout:4/593: dwrite df/d11/d12/d21/d50/d63/fbe [0,4194304] 0 2024-03-19T06:05:33.932 INFO:tasks.workunit.client.1.smithi172.stdout:7/475: getdents d0/d22/d27 0 2024-03-19T06:05:33.944 INFO:tasks.workunit.client.1.smithi172.stdout:2/519: truncate d7/de/d58/d55/d66/f72 674109 0 2024-03-19T06:05:33.950 INFO:tasks.workunit.client.1.smithi172.stdout:4/594: mkdir df/d11/d12/d21/d50/d63/dbb/dc4 0 2024-03-19T06:05:33.950 INFO:tasks.workunit.client.1.smithi172.stdout:1/591: dread da/dd/d10/d14/d27/d3f/d5e/dab/fbe [0,4194304] 0 2024-03-19T06:05:33.952 INFO:tasks.workunit.client.1.smithi172.stdout:2/520: mkdir d7/de/d58/d56/d86/d9d/dab 0 2024-03-19T06:05:33.955 INFO:tasks.workunit.client.1.smithi172.stdout:7/476: dread d0/d22/d1d/d36/d8d/f63 [0,4194304] 0 2024-03-19T06:05:33.957 INFO:tasks.workunit.client.1.smithi172.stdout:4/595: symlink df/d11/d12/d26/d84/lc5 0 2024-03-19T06:05:33.961 INFO:tasks.workunit.client.1.smithi172.stdout:1/592: dread da/dd/d10/f64 [0,4194304] 0 2024-03-19T06:05:33.964 INFO:tasks.workunit.client.1.smithi172.stdout:1/593: readlink da/d33/d4e/l56 0 2024-03-19T06:05:33.964 INFO:tasks.workunit.client.1.smithi172.stdout:4/596: unlink df/d2b/d44/d67/c82 0 2024-03-19T06:05:33.965 INFO:tasks.workunit.client.1.smithi172.stdout:6/634: write d5/d11/d17/d1b/f69 [1190686,94598] 0 2024-03-19T06:05:33.970 INFO:tasks.workunit.client.1.smithi172.stdout:1/594: rmdir da/dd/d10/d14/d73/d8b 39 2024-03-19T06:05:33.972 INFO:tasks.workunit.client.1.smithi172.stdout:6/635: chown d5/d8f/d31/d3d/f54 0 1 2024-03-19T06:05:33.992 INFO:tasks.workunit.client.1.smithi172.stdout:7/477: dread d0/d22/d1d/f4c [0,4194304] 0 2024-03-19T06:05:33.998 INFO:tasks.workunit.client.1.smithi172.stdout:7/478: mkdir d0/d22/d1d/d36/d40/da2 0 2024-03-19T06:05:34.001 INFO:tasks.workunit.client.1.smithi172.stdout:1/595: dread da/dd/d10/d36/f38 [0,4194304] 0 2024-03-19T06:05:34.001 INFO:tasks.workunit.client.1.smithi172.stdout:6/636: dread d5/fe [0,4194304] 0 2024-03-19T06:05:34.002 INFO:tasks.workunit.client.1.smithi172.stdout:1/596: stat da/dd/d10/d36 0 2024-03-19T06:05:34.004 INFO:tasks.workunit.client.1.smithi172.stdout:1/597: write da/d3b/f83 [949840,92835] 0 2024-03-19T06:05:34.006 INFO:tasks.workunit.client.1.smithi172.stdout:9/528: mkdir d1/db9 0 2024-03-19T06:05:34.007 INFO:tasks.workunit.client.1.smithi172.stdout:0/575: rmdir d11/d14/d2c/d36 39 2024-03-19T06:05:34.012 INFO:tasks.workunit.client.1.smithi172.stdout:0/576: mknod d11/d22/d46/cc7 0 2024-03-19T06:05:34.013 INFO:tasks.workunit.client.1.smithi172.stdout:1/598: creat da/dd/d10/fc8 x:0 0 0 2024-03-19T06:05:34.018 INFO:tasks.workunit.client.1.smithi172.stdout:0/577: mkdir d11/d18/d38/d3f/d9f/dbb/dc8 0 2024-03-19T06:05:34.020 INFO:tasks.workunit.client.1.smithi172.stdout:6/637: dwrite d5/d11/d17/f3a [0,4194304] 0 2024-03-19T06:05:34.023 INFO:tasks.workunit.client.1.smithi172.stdout:0/578: chown d11/d14/l19 1435 1 2024-03-19T06:05:34.023 INFO:tasks.workunit.client.1.smithi172.stdout:6/638: chown d5/d11/d43/fb9 45560366 1 2024-03-19T06:05:34.026 INFO:tasks.workunit.client.1.smithi172.stdout:3/556: dwrite d0/d5/f3d [0,4194304] 0 2024-03-19T06:05:34.030 INFO:tasks.workunit.client.1.smithi172.stdout:6/639: unlink d5/d8f/d31/c86 0 2024-03-19T06:05:34.033 INFO:tasks.workunit.client.1.smithi172.stdout:2/521: truncate d7/de/d58/d55/f59 82270 0 2024-03-19T06:05:34.034 INFO:tasks.workunit.client.1.smithi172.stdout:6/640: fsync d5/d8f/d31/d7b/d7e/f90 0 2024-03-19T06:05:34.037 INFO:tasks.workunit.client.1.smithi172.stdout:5/496: rmdir d5/d14/d56 39 2024-03-19T06:05:34.042 INFO:tasks.workunit.client.1.smithi172.stdout:5/497: truncate d5/d14/d34/d66/f8e 978728 0 2024-03-19T06:05:34.043 INFO:tasks.workunit.client.1.smithi172.stdout:0/579: dwrite d11/d14/d2c/d36/f53 [0,4194304] 0 2024-03-19T06:05:34.052 INFO:tasks.workunit.client.1.smithi172.stdout:5/498: readlink d5/d1f/d2f/l96 0 2024-03-19T06:05:34.052 INFO:tasks.workunit.client.1.smithi172.stdout:4/597: dwrite df/d2b/d2d/f8c [0,4194304] 0 2024-03-19T06:05:34.054 INFO:tasks.workunit.client.1.smithi172.stdout:4/598: chown df/d11/d12/d21/d50/d63/dbb 191 1 2024-03-19T06:05:34.055 INFO:tasks.workunit.client.1.smithi172.stdout:2/522: dwrite d7/db/d2c/f4a [0,4194304] 0 2024-03-19T06:05:34.055 INFO:tasks.workunit.client.1.smithi172.stdout:4/599: dread - df/d2b/d2d/f6b zero size 2024-03-19T06:05:34.068 INFO:tasks.workunit.client.1.smithi172.stdout:5/499: readlink d5/d3c/l4a 0 2024-03-19T06:05:34.070 INFO:tasks.workunit.client.1.smithi172.stdout:2/523: dread d7/db/f13 [0,4194304] 0 2024-03-19T06:05:34.075 INFO:tasks.workunit.client.1.smithi172.stdout:7/479: write d0/d22/d1d/d36/fc [1126773,4889] 0 2024-03-19T06:05:34.076 INFO:tasks.workunit.client.1.smithi172.stdout:4/600: creat df/d11/d12/d26/fc6 x:0 0 0 2024-03-19T06:05:34.078 INFO:tasks.workunit.client.1.smithi172.stdout:0/580: creat d11/d18/d38/d3f/d43/d89/fc9 x:0 0 0 2024-03-19T06:05:34.080 INFO:tasks.workunit.client.1.smithi172.stdout:9/529: truncate d1/d7/dc/d47/d78/f79 3514862 0 2024-03-19T06:05:34.083 INFO:tasks.workunit.client.1.smithi172.stdout:1/599: truncate da/dd/d10/d14/d27/f37 504968 0 2024-03-19T06:05:34.084 INFO:tasks.workunit.client.1.smithi172.stdout:4/601: read df/d11/d12/d21/d58/f83 [2292313,11188] 0 2024-03-19T06:05:34.085 INFO:tasks.workunit.client.1.smithi172.stdout:1/600: stat da/d3b/f83 0 2024-03-19T06:05:34.085 INFO:tasks.workunit.client.1.smithi172.stdout:2/524: creat d7/db/d2c/d35/fac x:0 0 0 2024-03-19T06:05:34.086 INFO:tasks.workunit.client.1.smithi172.stdout:3/557: write d0/da8/d60/d67/f7d [2197646,32376] 0 2024-03-19T06:05:34.088 INFO:tasks.workunit.client.1.smithi172.stdout:8/496: sync 2024-03-19T06:05:34.094 INFO:tasks.workunit.client.1.smithi172.stdout:3/558: truncate d0/d5/d14/fbb 510803 0 2024-03-19T06:05:34.098 INFO:tasks.workunit.client.1.smithi172.stdout:5/500: dwrite d5/d14/d15/d40/f54 [0,4194304] 0 2024-03-19T06:05:34.132 INFO:tasks.workunit.client.1.smithi172.stdout:6/641: truncate d5/d11/d17/d1b/f21 4135002 0 2024-03-19T06:05:34.133 INFO:tasks.workunit.client.1.smithi172.stdout:2/525: creat d7/de/d58/d55/d6e/fad x:0 0 0 2024-03-19T06:05:34.134 INFO:tasks.workunit.client.1.smithi172.stdout:9/530: creat d1/db9/fba x:0 0 0 2024-03-19T06:05:34.135 INFO:tasks.workunit.client.1.smithi172.stdout:2/526: write d7/d1b/f33 [4912972,19372] 0 2024-03-19T06:05:34.135 INFO:tasks.workunit.client.1.smithi172.stdout:9/531: readlink d1/d7/l58 0 2024-03-19T06:05:34.137 INFO:tasks.workunit.client.1.smithi172.stdout:3/559: fdatasync d0/da8/d25/f58 0 2024-03-19T06:05:34.138 INFO:tasks.workunit.client.1.smithi172.stdout:5/501: mknod d5/d1f/d2f/d53/cae 0 2024-03-19T06:05:34.151 INFO:tasks.workunit.client.1.smithi172.stdout:3/560: creat d0/da8/d34/d4d/fbe x:0 0 0 2024-03-19T06:05:34.152 INFO:tasks.workunit.client.1.smithi172.stdout:2/527: fsync d7/de/d58/d55/d6e/fad 0 2024-03-19T06:05:34.155 INFO:tasks.workunit.client.1.smithi172.stdout:0/581: truncate d11/d22/d46/d84/fc4 3429343 0 2024-03-19T06:05:34.155 INFO:tasks.workunit.client.1.smithi172.stdout:7/480: link d0/d22/d1d/d36/c48 d0/d22/d1d/d3a/d46/ca3 0 2024-03-19T06:05:34.157 INFO:tasks.workunit.client.1.smithi172.stdout:7/481: readlink d0/d22/d1d/d3a/d46/l95 0 2024-03-19T06:05:34.157 INFO:tasks.workunit.client.1.smithi172.stdout:6/642: write d5/d8f/d31/f5a [1126099,37148] 0 2024-03-19T06:05:34.159 INFO:tasks.workunit.client.1.smithi172.stdout:9/532: write d1/d7/dc/f14 [3962313,16380] 0 2024-03-19T06:05:34.159 INFO:tasks.workunit.client.1.smithi172.stdout:1/601: link da/dd/d10/d14/d73/d8b/lb5 da/dd/d10/d14/d27/d53/dc2/lc9 0 2024-03-19T06:05:34.160 INFO:tasks.workunit.client.1.smithi172.stdout:8/497: getdents d0/d44/d46 0 2024-03-19T06:05:34.161 INFO:tasks.workunit.client.1.smithi172.stdout:3/561: symlink d0/d5/d6b/dae/d88/lbf 0 2024-03-19T06:05:34.165 INFO:tasks.workunit.client.1.smithi172.stdout:2/528: creat d7/fae x:0 0 0 2024-03-19T06:05:34.167 INFO:tasks.workunit.client.1.smithi172.stdout:6/643: symlink d5/d11/d17/da4/lc9 0 2024-03-19T06:05:34.168 INFO:tasks.workunit.client.1.smithi172.stdout:7/482: mknod d0/d22/d1d/d3a/d6b/ca4 0 2024-03-19T06:05:34.169 INFO:tasks.workunit.client.1.smithi172.stdout:2/529: dread - d7/db/d45/f88 zero size 2024-03-19T06:05:34.173 INFO:tasks.workunit.client.1.smithi172.stdout:8/498: creat d0/d44/d46/d49/d3a/d3d/fa1 x:0 0 0 2024-03-19T06:05:34.173 INFO:tasks.workunit.client.1.smithi172.stdout:5/502: dread d5/d14/f19 [0,4194304] 0 2024-03-19T06:05:34.174 INFO:tasks.workunit.client.1.smithi172.stdout:3/562: symlink d0/d5/d6b/dae/d88/lc0 0 2024-03-19T06:05:34.175 INFO:tasks.workunit.client.1.smithi172.stdout:5/503: readlink d5/d14/d15/d40/l5d 0 2024-03-19T06:05:34.178 INFO:tasks.workunit.client.1.smithi172.stdout:8/499: truncate d0/f37 1297597 0 2024-03-19T06:05:34.178 INFO:tasks.workunit.client.1.smithi172.stdout:1/602: mkdir da/dd/d10/d14/d27/da7/db7/dca 0 2024-03-19T06:05:34.178 INFO:tasks.workunit.client.1.smithi172.stdout:5/504: fdatasync d5/d3c/d6c/f93 0 2024-03-19T06:05:34.178 INFO:tasks.workunit.client.1.smithi172.stdout:3/563: read d0/da8/f2c [1354653,79562] 0 2024-03-19T06:05:34.186 INFO:tasks.workunit.client.1.smithi172.stdout:1/603: mknod da/dd/ccb 0 2024-03-19T06:05:34.187 INFO:tasks.workunit.client.1.smithi172.stdout:8/500: mkdir d0/d44/d46/d49/d26/d71/d81/d8e/da2 0 2024-03-19T06:05:34.188 INFO:tasks.workunit.client.1.smithi172.stdout:9/533: dwrite d1/d7/dc/de/d34/f41 [4194304,4194304] 0 2024-03-19T06:05:34.189 INFO:tasks.workunit.client.1.smithi172.stdout:0/582: dread f10 [0,4194304] 0 2024-03-19T06:05:34.189 INFO:tasks.workunit.client.1.smithi172.stdout:3/564: rename d0/da8/d25/c15 to d0/da8/d25/cc1 0 2024-03-19T06:05:34.193 INFO:tasks.workunit.client.1.smithi172.stdout:7/483: truncate d0/d22/f26 2007765 0 2024-03-19T06:05:34.196 INFO:tasks.workunit.client.1.smithi172.stdout:2/530: dwrite d7/db/d2c/f38 [0,4194304] 0 2024-03-19T06:05:34.204 INFO:tasks.workunit.client.1.smithi172.stdout:1/604: creat da/dd/d10/d14/d73/fcc x:0 0 0 2024-03-19T06:05:34.204 INFO:tasks.workunit.client.1.smithi172.stdout:3/565: mknod d0/da8/d54/d77/cc2 0 2024-03-19T06:05:34.208 INFO:tasks.workunit.client.1.smithi172.stdout:6/644: dwrite d5/f19 [0,4194304] 0 2024-03-19T06:05:34.210 INFO:tasks.workunit.client.1.smithi172.stdout:5/505: dwrite d5/d3c/d6c/f9d [0,4194304] 0 2024-03-19T06:05:34.213 INFO:tasks.workunit.client.1.smithi172.stdout:3/566: chown d0/d5/d6b/f8f 54 1 2024-03-19T06:05:34.223 INFO:tasks.workunit.client.1.smithi172.stdout:7/484: dwrite d0/d22/d1d/d3a/d46/f99 [0,4194304] 0 2024-03-19T06:05:34.225 INFO:tasks.workunit.client.1.smithi172.stdout:2/531: dwrite d7/de/d58/d55/da8/f7f [0,4194304] 0 2024-03-19T06:05:34.226 INFO:tasks.workunit.client.1.smithi172.stdout:7/485: chown d0/d22/d1d/d36/d8d/d5c/c9b 3594 1 2024-03-19T06:05:34.330 INFO:tasks.workunit.client.1.smithi172.stdout:4/602: sync 2024-03-19T06:05:34.335 INFO:tasks.workunit.client.1.smithi172.stdout:4/603: write df/d11/d12/d21/d50/f94 [145550,45875] 0 2024-03-19T06:05:34.358 INFO:tasks.workunit.client.1.smithi172.stdout:3/567: sync 2024-03-19T06:05:34.388 INFO:tasks.workunit.client.1.smithi172.stdout:3/568: dwrite d0/fbc [0,4194304] 0 2024-03-19T06:05:34.410 INFO:tasks.workunit.client.1.smithi172.stdout:0/583: creat d11/d14/d2c/dc2/fca x:0 0 0 2024-03-19T06:05:34.412 INFO:tasks.workunit.client.1.smithi172.stdout:9/534: symlink d1/d7/dc/d47/da5/lbb 0 2024-03-19T06:05:34.416 INFO:tasks.workunit.client.1.smithi172.stdout:5/506: creat d5/d3c/d6c/da2/faf x:0 0 0 2024-03-19T06:05:34.416 INFO:tasks.workunit.client.1.smithi172.stdout:2/532: fdatasync d7/d1b/f3f 0 2024-03-19T06:05:34.420 INFO:tasks.workunit.client.1.smithi172.stdout:1/605: mkdir da/d3b/dcd 0 2024-03-19T06:05:34.421 INFO:tasks.workunit.client.1.smithi172.stdout:4/604: chown df/d11/f64 33664249 1 2024-03-19T06:05:34.424 INFO:tasks.workunit.client.1.smithi172.stdout:1/606: read - da/d3b/d95/faa zero size 2024-03-19T06:05:34.425 INFO:tasks.workunit.client.1.smithi172.stdout:8/501: getdents d0/d61/d6a/d7e 0 2024-03-19T06:05:34.425 INFO:tasks.workunit.client.1.smithi172.stdout:7/486: sync 2024-03-19T06:05:34.429 INFO:tasks.workunit.client.1.smithi172.stdout:8/502: chown d0/d44/d46/d49/d26/d71/d81/d27/f9b 4778338 1 2024-03-19T06:05:34.436 INFO:tasks.workunit.client.1.smithi172.stdout:2/533: rename d7/de/d58/c54 to d7/de/d58/d56/d86/caf 0 2024-03-19T06:05:34.440 INFO:tasks.workunit.client.1.smithi172.stdout:3/569: link d0/da8/d25/d21/l91 d0/da8/d60/lc3 0 2024-03-19T06:05:34.442 INFO:tasks.workunit.client.1.smithi172.stdout:0/584: getdents d11/d18/d38/d3f 0 2024-03-19T06:05:34.442 INFO:tasks.workunit.client.1.smithi172.stdout:2/534: mknod d7/de/d58/d56/d81/cb0 0 2024-03-19T06:05:34.443 INFO:tasks.workunit.client.1.smithi172.stdout:9/535: link d1/d7/dc/de/d34/l9b d1/d7/dc/de/d34/lbc 0 2024-03-19T06:05:34.443 INFO:tasks.workunit.client.1.smithi172.stdout:7/487: truncate d0/d22/d1d/d36/f60 628873 0 2024-03-19T06:05:34.446 INFO:tasks.workunit.client.1.smithi172.stdout:0/585: write d11/f91 [677493,35303] 0 2024-03-19T06:05:34.448 INFO:tasks.workunit.client.1.smithi172.stdout:2/535: chown d7/db/d2c/d35/f91 18546550 1 2024-03-19T06:05:34.450 INFO:tasks.workunit.client.1.smithi172.stdout:9/536: creat d1/d7/dc/d47/d78/d54/d91/fbd x:0 0 0 2024-03-19T06:05:34.453 INFO:tasks.workunit.client.1.smithi172.stdout:0/586: dread d11/d14/f4b [0,4194304] 0 2024-03-19T06:05:34.453 INFO:tasks.workunit.client.1.smithi172.stdout:9/537: chown d1/d7/dc/de/d34/d48/f70 28806554 1 2024-03-19T06:05:34.455 INFO:tasks.workunit.client.1.smithi172.stdout:2/536: getdents d7/de/d58/d56/d86/d9d 0 2024-03-19T06:05:34.456 INFO:tasks.workunit.client.1.smithi172.stdout:0/587: mkdir d11/d18/da5/dcb 0 2024-03-19T06:05:34.459 INFO:tasks.workunit.client.1.smithi172.stdout:2/537: symlink d7/db/d2c/lb1 0 2024-03-19T06:05:34.459 INFO:tasks.workunit.client.1.smithi172.stdout:0/588: rmdir d11/d22/d32 39 2024-03-19T06:05:34.462 INFO:tasks.workunit.client.1.smithi172.stdout:2/538: fdatasync d7/db/d45/f88 0 2024-03-19T06:05:34.466 INFO:tasks.workunit.client.1.smithi172.stdout:0/589: getdents d11/d4d 0 2024-03-19T06:05:34.470 INFO:tasks.workunit.client.1.smithi172.stdout:3/570: dwrite d0/da8/d60/f7e [0,4194304] 0 2024-03-19T06:05:34.471 INFO:tasks.workunit.client.1.smithi172.stdout:2/539: rename d7/db/d2c/lb1 to d7/de/lb2 0 2024-03-19T06:05:34.471 INFO:tasks.workunit.client.1.smithi172.stdout:0/590: truncate d11/d14/d2c/d8d/f99 1148583 0 2024-03-19T06:05:34.473 INFO:tasks.workunit.client.1.smithi172.stdout:3/571: creat d0/d5/fc4 x:0 0 0 2024-03-19T06:05:34.474 INFO:tasks.workunit.client.1.smithi172.stdout:2/540: write d7/de/d58/d56/f28 [839083,34320] 0 2024-03-19T06:05:34.475 INFO:tasks.workunit.client.1.smithi172.stdout:0/591: symlink d11/d14/d2c/d36/lcc 0 2024-03-19T06:05:34.477 INFO:tasks.workunit.client.1.smithi172.stdout:3/572: write d0/da8/d25/f9a [222027,48362] 0 2024-03-19T06:05:34.479 INFO:tasks.workunit.client.1.smithi172.stdout:0/592: mknod d11/d18/da5/ccd 0 2024-03-19T06:05:34.480 INFO:tasks.workunit.client.1.smithi172.stdout:9/538: dread d1/d7/dc/de/d34/d48/d89/fac [0,4194304] 0 2024-03-19T06:05:34.482 INFO:tasks.workunit.client.1.smithi172.stdout:0/593: creat d11/d18/d38/d3f/d43/d62/fce x:0 0 0 2024-03-19T06:05:34.482 INFO:tasks.workunit.client.1.smithi172.stdout:9/539: read d1/d7/dc/f5d [3645412,32098] 0 2024-03-19T06:05:34.483 INFO:tasks.workunit.client.1.smithi172.stdout:0/594: chown f2 197 1 2024-03-19T06:05:34.484 INFO:tasks.workunit.client.1.smithi172.stdout:3/573: dread d0/f4 [0,4194304] 0 2024-03-19T06:05:34.486 INFO:tasks.workunit.client.1.smithi172.stdout:0/595: mkdir d11/d14/d2c/dc2/dcf 0 2024-03-19T06:05:34.487 INFO:tasks.workunit.client.1.smithi172.stdout:3/574: mkdir d0/da8/d34/d4d/dc5 0 2024-03-19T06:05:34.488 INFO:tasks.workunit.client.1.smithi172.stdout:0/596: read - d11/d18/d38/d3f/d43/d62/fce zero size 2024-03-19T06:05:34.489 INFO:tasks.workunit.client.1.smithi172.stdout:3/575: chown d0/d37/da7/c92 155 1 2024-03-19T06:05:34.489 INFO:tasks.workunit.client.1.smithi172.stdout:9/540: rename d1/d7/dc/d23 to d1/d7/dc/dbe 0 2024-03-19T06:05:34.493 INFO:tasks.workunit.client.1.smithi172.stdout:3/576: mknod d0/d5/d6b/dae/d88/cc6 0 2024-03-19T06:05:34.494 INFO:tasks.workunit.client.1.smithi172.stdout:0/597: getdents d11/d18 0 2024-03-19T06:05:34.495 INFO:tasks.workunit.client.1.smithi172.stdout:3/577: readlink d0/d5/d6b/dae/d88/lbf 0 2024-03-19T06:05:34.497 INFO:tasks.workunit.client.1.smithi172.stdout:0/598: mknod d11/d14/db7/cd0 0 2024-03-19T06:05:34.499 INFO:tasks.workunit.client.1.smithi172.stdout:0/599: readlink d11/d18/d38/l39 0 2024-03-19T06:05:34.502 INFO:tasks.workunit.client.1.smithi172.stdout:0/600: read d11/d22/d32/f77 [3108900,110655] 0 2024-03-19T06:05:34.504 INFO:tasks.workunit.client.1.smithi172.stdout:0/601: mknod d11/d18/da5/da8/cd1 0 2024-03-19T06:05:34.505 INFO:tasks.workunit.client.1.smithi172.stdout:0/602: fsync d11/d18/d38/f8f 0 2024-03-19T06:05:34.508 INFO:tasks.workunit.client.1.smithi172.stdout:0/603: write d11/d22/d68/fa6 [246551,82015] 0 2024-03-19T06:05:34.513 INFO:tasks.workunit.client.1.smithi172.stdout:0/604: mkdir d11/d22/d46/dd2 0 2024-03-19T06:05:34.516 INFO:tasks.workunit.client.1.smithi172.stdout:0/605: stat d11/d18/lb5 0 2024-03-19T06:05:34.519 INFO:tasks.workunit.client.1.smithi172.stdout:0/606: chown d11/d18/d38/d3f/d43/d62/fce 21 1 2024-03-19T06:05:34.521 INFO:tasks.workunit.client.1.smithi172.stdout:5/507: sync 2024-03-19T06:05:34.524 INFO:tasks.workunit.client.1.smithi172.stdout:0/607: creat d11/d18/d38/d3f/dbe/fd3 x:0 0 0 2024-03-19T06:05:34.553 INFO:tasks.workunit.client.1.smithi172.stdout:5/508: dwrite d5/d14/d15/d40/d6a/f6d [4194304,4194304] 0 2024-03-19T06:05:34.556 INFO:tasks.workunit.client.1.smithi172.stdout:5/509: fdatasync d5/d3d/fa4 0 2024-03-19T06:05:34.557 INFO:tasks.workunit.client.1.smithi172.stdout:0/608: dwrite d11/d18/da5/da8/fb1 [0,4194304] 0 2024-03-19T06:05:34.563 INFO:tasks.workunit.client.1.smithi172.stdout:5/510: rmdir d5/d14/d15/d40/d6a/d7a 39 2024-03-19T06:05:34.567 INFO:tasks.workunit.client.1.smithi172.stdout:0/609: unlink d11/d14/d2c/d4e/c86 0 2024-03-19T06:05:34.570 INFO:tasks.workunit.client.1.smithi172.stdout:5/511: fdatasync d5/d14/d56/f8c 0 2024-03-19T06:05:34.571 INFO:tasks.workunit.client.1.smithi172.stdout:0/610: dread - d11/d18/d38/f92 zero size 2024-03-19T06:05:34.573 INFO:tasks.workunit.client.1.smithi172.stdout:0/611: fdatasync d11/f83 0 2024-03-19T06:05:34.575 INFO:tasks.workunit.client.1.smithi172.stdout:1/607: sync 2024-03-19T06:05:34.578 INFO:tasks.workunit.client.1.smithi172.stdout:0/612: chown d11/d14/d2c/d36/f53 477 1 2024-03-19T06:05:34.581 INFO:tasks.workunit.client.1.smithi172.stdout:1/608: creat da/dd/d10/d14/d84/fce x:0 0 0 2024-03-19T06:05:34.584 INFO:tasks.workunit.client.1.smithi172.stdout:5/512: rename d5/d1f/d2f/c8f to d5/d14/d15/d40/d6a/d7a/cb0 0 2024-03-19T06:05:34.586 INFO:tasks.workunit.client.1.smithi172.stdout:0/613: creat d11/d18/d38/d3f/d9f/fd4 x:0 0 0 2024-03-19T06:05:34.587 INFO:tasks.workunit.client.1.smithi172.stdout:1/609: fdatasync da/dd/d31/d47/fc3 0 2024-03-19T06:05:34.588 INFO:tasks.workunit.client.1.smithi172.stdout:0/614: chown d11/d14/d2c/dc2 348911 1 2024-03-19T06:05:34.594 INFO:tasks.workunit.client.1.smithi172.stdout:1/610: mkdir da/dd/d10/d14/d27/da2/dcf 0 2024-03-19T06:05:34.602 INFO:tasks.workunit.client.1.smithi172.stdout:1/611: symlink da/dd/d10/d14/d73/ld0 0 2024-03-19T06:05:34.608 INFO:tasks.workunit.client.1.smithi172.stdout:1/612: symlink da/dd/d10/d14/d27/da7/db7/ld1 0 2024-03-19T06:05:34.617 INFO:tasks.workunit.client.1.smithi172.stdout:1/613: chown da/dd/d10/d14/d27/d3f/d5e/f7e 56367513 1 2024-03-19T06:05:34.623 INFO:tasks.workunit.client.1.smithi172.stdout:0/615: dwrite d11/d18/da5/da8/fac [0,4194304] 0 2024-03-19T06:05:34.624 INFO:tasks.workunit.client.1.smithi172.stdout:2/541: sync 2024-03-19T06:05:34.629 INFO:tasks.workunit.client.1.smithi172.stdout:1/614: creat da/dd/d10/d14/d27/d53/fd2 x:0 0 0 2024-03-19T06:05:34.631 INFO:tasks.workunit.client.1.smithi172.stdout:0/616: symlink d11/d14/d2c/dbc/ld5 0 2024-03-19T06:05:34.638 INFO:tasks.workunit.client.1.smithi172.stdout:2/542: getdents d7/de/d58/d56 0 2024-03-19T06:05:34.640 INFO:tasks.workunit.client.1.smithi172.stdout:0/617: unlink d11/d14/f4b 0 2024-03-19T06:05:34.643 INFO:tasks.workunit.client.1.smithi172.stdout:2/543: fsync d7/db/f18 0 2024-03-19T06:05:34.644 INFO:tasks.workunit.client.1.smithi172.stdout:0/618: chown d11/d14/d2c/d36/f9b 489 1 2024-03-19T06:05:34.646 INFO:tasks.workunit.client.1.smithi172.stdout:1/615: getdents da/dd/d10/d14 0 2024-03-19T06:05:34.651 INFO:tasks.workunit.client.1.smithi172.stdout:1/616: creat da/dd/d31/d47/fd3 x:0 0 0 2024-03-19T06:05:34.659 INFO:tasks.workunit.client.1.smithi172.stdout:1/617: symlink da/dd/d10/d14/d84/ld4 0 2024-03-19T06:05:34.659 INFO:tasks.workunit.client.1.smithi172.stdout:0/619: link d11/d14/l3b d11/d14/d2c/d36/ld6 0 2024-03-19T06:05:34.664 INFO:tasks.workunit.client.1.smithi172.stdout:1/618: chown da/dd/d10/d14/d84/ca3 19535071 1 2024-03-19T06:05:34.667 INFO:tasks.workunit.client.1.smithi172.stdout:2/544: dwrite d7/f15 [0,4194304] 0 2024-03-19T06:05:34.675 INFO:tasks.workunit.client.1.smithi172.stdout:2/545: creat d7/d4c/d70/fb3 x:0 0 0 2024-03-19T06:05:34.681 INFO:tasks.workunit.client.1.smithi172.stdout:2/546: symlink d7/de/d58/d55/d5f/lb4 0 2024-03-19T06:05:34.719 INFO:tasks.workunit.client.1.smithi172.stdout:6/645: truncate d5/d8f/d31/f57 861960 0 2024-03-19T06:05:34.730 INFO:tasks.workunit.client.1.smithi172.stdout:6/646: stat d5/d11/d17/d36/d48/lbd 0 2024-03-19T06:05:34.730 INFO:tasks.workunit.client.1.smithi172.stdout:4/605: dread df/d11/f1d [4194304,4194304] 0 2024-03-19T06:05:34.734 INFO:tasks.workunit.client.1.smithi172.stdout:4/606: chown df/d2b/da3/la5 29 1 2024-03-19T06:05:34.737 INFO:tasks.workunit.client.1.smithi172.stdout:6/647: mkdir d5/d11/d17/d36/dca 0 2024-03-19T06:05:34.741 INFO:tasks.workunit.client.1.smithi172.stdout:4/607: mknod df/d11/d12/d21/d50/d63/cc7 0 2024-03-19T06:05:34.744 INFO:tasks.workunit.client.1.smithi172.stdout:4/608: readlink df/d2b/d44/d67/lb5 0 2024-03-19T06:05:34.749 INFO:tasks.workunit.client.1.smithi172.stdout:7/488: dread d0/f71 [0,4194304] 0 2024-03-19T06:05:34.751 INFO:tasks.workunit.client.1.smithi172.stdout:9/541: write d1/fa [684019,89451] 0 2024-03-19T06:05:34.754 INFO:tasks.workunit.client.1.smithi172.stdout:4/609: rename df/d11/d12/c9b to df/d11/d12/d34/cc8 0 2024-03-19T06:05:34.754 INFO:tasks.workunit.client.1.smithi172.stdout:9/542: truncate d1/f56 1363703 0 2024-03-19T06:05:34.759 INFO:tasks.workunit.client.1.smithi172.stdout:7/489: unlink d0/d22/d1d/d3a/d46/l95 0 2024-03-19T06:05:34.765 INFO:tasks.workunit.client.1.smithi172.stdout:9/543: rename d1/d7/l10 to d1/d7/dc/db7/lbf 0 2024-03-19T06:05:34.770 INFO:tasks.workunit.client.1.smithi172.stdout:7/490: write d0/d22/d27/d86/fa1 [322625,62639] 0 2024-03-19T06:05:34.772 INFO:tasks.workunit.client.1.smithi172.stdout:3/578: dwrite d0/da8/f5b [0,4194304] 0 2024-03-19T06:05:34.775 INFO:tasks.workunit.client.1.smithi172.stdout:4/610: dread df/d11/d12/d21/d58/d60/f70 [0,4194304] 0 2024-03-19T06:05:34.775 INFO:tasks.workunit.client.1.smithi172.stdout:5/513: truncate d5/d1f/f2a 35448 0 2024-03-19T06:05:34.775 INFO:tasks.workunit.client.1.smithi172.stdout:6/648: dwrite d5/d8f/fb3 [0,4194304] 0 2024-03-19T06:05:34.776 INFO:tasks.workunit.client.1.smithi172.stdout:9/544: symlink d1/d7/dc/dbe/lc0 0 2024-03-19T06:05:34.781 INFO:tasks.workunit.client.1.smithi172.stdout:5/514: fdatasync d5/f58 0 2024-03-19T06:05:34.782 INFO:tasks.workunit.client.1.smithi172.stdout:7/491: write d0/d22/d1d/f4c [403797,110721] 0 2024-03-19T06:05:34.783 INFO:tasks.workunit.client.1.smithi172.stdout:5/515: write d5/d1f/f82 [418318,62060] 0 2024-03-19T06:05:34.786 INFO:tasks.workunit.client.1.smithi172.stdout:7/492: write d0/d22/d1d/f32 [2006867,73245] 0 2024-03-19T06:05:34.787 INFO:tasks.workunit.client.1.smithi172.stdout:5/516: fsync d5/d3d/f5b 0 2024-03-19T06:05:34.791 INFO:tasks.workunit.client.1.smithi172.stdout:3/579: mkdir d0/db0/db6/dc7 0 2024-03-19T06:05:34.792 INFO:tasks.workunit.client.1.smithi172.stdout:4/611: mkdir df/d11/d12/d21/d58/da6/dc9 0 2024-03-19T06:05:34.804 INFO:tasks.workunit.client.1.smithi172.stdout:9/545: dwrite d1/fae [0,4194304] 0 2024-03-19T06:05:34.804 INFO:tasks.workunit.client.1.smithi172.stdout:3/580: rename d0/d5/fb1 to d0/d5/d6b/dae/fc8 0 2024-03-19T06:05:34.806 INFO:tasks.workunit.client.1.smithi172.stdout:3/581: truncate d0/f7c 248863 0 2024-03-19T06:05:34.807 INFO:tasks.workunit.client.1.smithi172.stdout:3/582: fdatasync d0/d5/d14/f17 0 2024-03-19T06:05:34.810 INFO:tasks.workunit.client.1.smithi172.stdout:4/612: mkdir df/d11/d12/d21/d58/da6/dc9/dca 0 2024-03-19T06:05:34.812 INFO:tasks.workunit.client.1.smithi172.stdout:7/493: creat d0/d22/d1d/d36/d8d/d5c/d67/d82/fa5 x:0 0 0 2024-03-19T06:05:34.813 INFO:tasks.workunit.client.1.smithi172.stdout:4/613: write df/d11/d12/d26/f30 [4712390,115347] 0 2024-03-19T06:05:34.814 INFO:tasks.workunit.client.1.smithi172.stdout:3/583: mknod d0/da8/d54/d77/cc9 0 2024-03-19T06:05:34.819 INFO:tasks.workunit.client.1.smithi172.stdout:3/584: creat d0/d5/d6b/fca x:0 0 0 2024-03-19T06:05:34.826 INFO:tasks.workunit.client.1.smithi172.stdout:2/547: write d7/de/d58/d55/f59 [789204,82441] 0 2024-03-19T06:05:34.826 INFO:tasks.workunit.client.1.smithi172.stdout:9/546: dwrite d1/d7/dc/de/d34/d48/fb2 [0,4194304] 0 2024-03-19T06:05:34.830 INFO:tasks.workunit.client.1.smithi172.stdout:2/548: write d7/d1b/f2a [2712063,4714] 0 2024-03-19T06:05:34.834 INFO:tasks.workunit.client.1.smithi172.stdout:5/517: dread d5/fb [0,4194304] 0 2024-03-19T06:05:34.834 INFO:tasks.workunit.client.1.smithi172.stdout:0/620: dwrite d11/d22/d32/f58 [0,4194304] 0 2024-03-19T06:05:34.836 INFO:tasks.workunit.client.1.smithi172.stdout:1/619: dwrite da/dd/d10/f2f [4194304,4194304] 0 2024-03-19T06:05:34.837 INFO:tasks.workunit.client.1.smithi172.stdout:9/547: write d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/fa0 [755424,93733] 0 2024-03-19T06:05:34.844 INFO:tasks.workunit.client.1.smithi172.stdout:3/585: dwrite d0/da8/d34/d4d/f31 [0,4194304] 0 2024-03-19T06:05:34.918 INFO:tasks.workunit.client.1.smithi172.stdout:4/614: sync 2024-03-19T06:05:34.935 INFO:tasks.workunit.client.1.smithi172.stdout:8/503: dread d0/d44/d46/d49/d26/f7b [0,4194304] 0 2024-03-19T06:05:35.111 INFO:tasks.workunit.client.1.smithi172.stdout:7/494: getdents d0/d22/d1d/d36/d8d/d5c/d67 0 2024-03-19T06:05:35.126 INFO:tasks.workunit.client.1.smithi172.stdout:5/518: stat d5/c44 0 2024-03-19T06:05:35.132 INFO:tasks.workunit.client.1.smithi172.stdout:9/548: mknod d1/d7/dc/d47/d78/d54/d91/cc1 0 2024-03-19T06:05:35.135 INFO:tasks.workunit.client.1.smithi172.stdout:4/615: creat df/d11/d12/d21/d58/fcb x:0 0 0 2024-03-19T06:05:35.135 INFO:tasks.workunit.client.1.smithi172.stdout:8/504: read - d0/d44/d46/d49/d26/d71/f72 zero size 2024-03-19T06:05:35.136 INFO:tasks.workunit.client.1.smithi172.stdout:3/586: dread - d0/da8/d54/d90/f9c zero size 2024-03-19T06:05:35.142 INFO:tasks.workunit.client.1.smithi172.stdout:6/649: truncate d5/d11/d17/f3e 3663243 0 2024-03-19T06:05:35.144 INFO:tasks.workunit.client.1.smithi172.stdout:3/587: write d0/da8/f5b [429795,79074] 0 2024-03-19T06:05:35.146 INFO:tasks.workunit.client.1.smithi172.stdout:5/519: creat d5/d1f/fb1 x:0 0 0 2024-03-19T06:05:35.147 INFO:tasks.workunit.client.1.smithi172.stdout:9/549: symlink d1/d7/dc/db7/lc2 0 2024-03-19T06:05:35.151 INFO:tasks.workunit.client.1.smithi172.stdout:3/588: fsync d0/da8/d34/d4d/f31 0 2024-03-19T06:05:35.159 INFO:tasks.workunit.client.1.smithi172.stdout:8/505: truncate d0/d61/f6b 737135 0 2024-03-19T06:05:35.167 INFO:tasks.workunit.client.1.smithi172.stdout:3/589: rename d0/da8/d34/d4d/l61 to d0/da8/d34/d4d/lcb 0 2024-03-19T06:05:35.175 INFO:tasks.workunit.client.1.smithi172.stdout:3/590: rmdir d0/da8/d34 39 2024-03-19T06:05:35.176 INFO:tasks.workunit.client.1.smithi172.stdout:9/550: getdents d1/d7 0 2024-03-19T06:05:35.177 INFO:tasks.workunit.client.1.smithi172.stdout:0/621: write d11/d14/f1f [843295,95076] 0 2024-03-19T06:05:35.179 INFO:tasks.workunit.client.1.smithi172.stdout:2/549: write d7/d1b/f20 [1086571,52628] 0 2024-03-19T06:05:35.184 INFO:tasks.workunit.client.1.smithi172.stdout:7/495: truncate d0/d22/d35/f94 2378691 0 2024-03-19T06:05:35.188 INFO:tasks.workunit.client.1.smithi172.stdout:8/506: write d0/d44/d46/d49/f25 [772617,47265] 0 2024-03-19T06:05:35.188 INFO:tasks.workunit.client.1.smithi172.stdout:2/550: chown d7/d4c/d70/f90 28138749 1 2024-03-19T06:05:35.190 INFO:tasks.workunit.client.1.smithi172.stdout:6/650: write d5/d8f/d31/d3d/d98/db6/d40/d53/d75/f81 [3926430,6057] 0 2024-03-19T06:05:35.192 INFO:tasks.workunit.client.1.smithi172.stdout:9/551: write d1/d7/dc/d47/d78/d54/f6d [1011420,107469] 0 2024-03-19T06:05:35.192 INFO:tasks.workunit.client.1.smithi172.stdout:5/520: dwrite d5/f16 [0,4194304] 0 2024-03-19T06:05:35.197 INFO:tasks.workunit.client.1.smithi172.stdout:2/551: unlink d7/d1b/l2f 0 2024-03-19T06:05:35.197 INFO:tasks.workunit.client.1.smithi172.stdout:7/496: write d0/d22/d1d/d3a/d46/f78 [1498316,39529] 0 2024-03-19T06:05:35.204 INFO:tasks.workunit.client.1.smithi172.stdout:9/552: rmdir d1/d7/dc/d47/d78 39 2024-03-19T06:05:35.206 INFO:tasks.workunit.client.1.smithi172.stdout:4/616: dwrite df/d11/d12/d21/d58/f5b [0,4194304] 0 2024-03-19T06:05:35.210 INFO:tasks.workunit.client.1.smithi172.stdout:7/497: creat d0/d22/d3d/d41/fa6 x:0 0 0 2024-03-19T06:05:35.210 INFO:tasks.workunit.client.1.smithi172.stdout:0/622: dwrite d11/d22/f34 [0,4194304] 0 2024-03-19T06:05:35.212 INFO:tasks.workunit.client.1.smithi172.stdout:2/552: mkdir d7/de/d58/d56/d89/db5 0 2024-03-19T06:05:35.214 INFO:tasks.workunit.client.1.smithi172.stdout:6/651: creat d5/d11/d17/d36/dca/fcb x:0 0 0 2024-03-19T06:05:35.216 INFO:tasks.workunit.client.1.smithi172.stdout:7/498: write d0/f7c [2800185,27624] 0 2024-03-19T06:05:35.216 INFO:tasks.workunit.client.1.smithi172.stdout:9/553: symlink d1/d7/lc3 0 2024-03-19T06:05:35.216 INFO:tasks.workunit.client.1.smithi172.stdout:8/507: dread d0/f85 [0,4194304] 0 2024-03-19T06:05:35.224 INFO:tasks.workunit.client.1.smithi172.stdout:0/623: unlink d11/d14/l3b 0 2024-03-19T06:05:35.239 INFO:tasks.workunit.client.1.smithi172.stdout:8/508: dread d0/f37 [0,4194304] 0 2024-03-19T06:05:35.244 INFO:tasks.workunit.client.1.smithi172.stdout:4/617: write df/f3d [3132582,2603] 0 2024-03-19T06:05:35.245 INFO:tasks.workunit.client.1.smithi172.stdout:3/591: sync 2024-03-19T06:05:35.248 INFO:tasks.workunit.client.1.smithi172.stdout:5/521: write d5/d1f/f2a [21807,47476] 0 2024-03-19T06:05:35.251 INFO:tasks.workunit.client.1.smithi172.stdout:8/509: chown d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d9c 100 1 2024-03-19T06:05:35.252 INFO:tasks.workunit.client.1.smithi172.stdout:9/554: fsync d1/d7/dc/de/f7c 0 2024-03-19T06:05:35.254 INFO:tasks.workunit.client.1.smithi172.stdout:3/592: symlink d0/da8/lcc 0 2024-03-19T06:05:35.256 INFO:tasks.workunit.client.1.smithi172.stdout:4/618: symlink df/d2b/da3/lcc 0 2024-03-19T06:05:35.257 INFO:tasks.workunit.client.1.smithi172.stdout:7/499: dread d0/d22/d3d/f64 [0,4194304] 0 2024-03-19T06:05:35.261 INFO:tasks.workunit.client.1.smithi172.stdout:8/510: creat d0/d44/d46/d49/d3a/d3d/fa3 x:0 0 0 2024-03-19T06:05:35.263 INFO:tasks.workunit.client.1.smithi172.stdout:3/593: creat d0/da8/d54/d90/fcd x:0 0 0 2024-03-19T06:05:35.264 INFO:tasks.workunit.client.1.smithi172.stdout:4/619: write df/d2b/d44/d67/fad [494949,105163] 0 2024-03-19T06:05:35.265 INFO:tasks.workunit.client.1.smithi172.stdout:5/522: rename d5/d14/d15/f4c to d5/d55/d91/fb2 0 2024-03-19T06:05:35.267 INFO:tasks.workunit.client.1.smithi172.stdout:8/511: symlink d0/d44/d46/la4 0 2024-03-19T06:05:35.270 INFO:tasks.workunit.client.1.smithi172.stdout:9/555: write d1/f28 [842912,114389] 0 2024-03-19T06:05:35.272 INFO:tasks.workunit.client.1.smithi172.stdout:4/620: write df/d11/d12/d26/f61 [636111,115084] 0 2024-03-19T06:05:35.272 INFO:tasks.workunit.client.1.smithi172.stdout:7/500: symlink d0/d22/d1d/d36/d40/da2/la7 0 2024-03-19T06:05:35.273 INFO:tasks.workunit.client.1.smithi172.stdout:3/594: stat d0/d5/d14/d52/l56 0 2024-03-19T06:05:35.276 INFO:tasks.workunit.client.1.smithi172.stdout:0/624: dread d11/d18/d38/d3f/f6e [0,4194304] 0 2024-03-19T06:05:35.276 INFO:tasks.workunit.client.1.smithi172.stdout:8/512: fsync d0/d44/d46/d49/d3a/d3d/fa3 0 2024-03-19T06:05:35.277 INFO:tasks.workunit.client.1.smithi172.stdout:5/523: symlink d5/d3c/d6c/lb3 0 2024-03-19T06:05:35.277 INFO:tasks.workunit.client.1.smithi172.stdout:6/652: dread d5/d11/d43/d45/f5c [0,4194304] 0 2024-03-19T06:05:35.278 INFO:tasks.workunit.client.1.smithi172.stdout:3/595: readlink d0/da8/d25/d21/l4b 0 2024-03-19T06:05:35.279 INFO:tasks.workunit.client.1.smithi172.stdout:2/553: dread d7/db/f18 [0,4194304] 0 2024-03-19T06:05:35.281 INFO:tasks.workunit.client.1.smithi172.stdout:4/621: readlink df/d11/d12/d26/d84/lc5 0 2024-03-19T06:05:35.283 INFO:tasks.workunit.client.1.smithi172.stdout:7/501: mkdir d0/d22/d1d/d85/da8 0 2024-03-19T06:05:35.285 INFO:tasks.workunit.client.1.smithi172.stdout:4/622: chown df/d11/c71 108 1 2024-03-19T06:05:35.286 INFO:tasks.workunit.client.1.smithi172.stdout:0/625: mknod d11/d18/d38/d3f/d43/dc5/cd7 0 2024-03-19T06:05:35.319 INFO:tasks.workunit.client.1.smithi172.stdout:6/653: creat d5/d11/d43/d45/da1/fcc x:0 0 0 2024-03-19T06:05:35.321 INFO:tasks.workunit.client.1.smithi172.stdout:0/626: truncate d11/d14/f1f 1360452 0 2024-03-19T06:05:35.321 INFO:tasks.workunit.client.1.smithi172.stdout:8/513: rename d0/d44/d46/d49/d26/d71/d81/d27/f9b to d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/fa5 0 2024-03-19T06:05:35.321 INFO:tasks.workunit.client.1.smithi172.stdout:9/556: truncate d1/d7/dc/faf 871969 0 2024-03-19T06:05:35.323 INFO:tasks.workunit.client.1.smithi172.stdout:5/524: getdents d5/d14/d15 0 2024-03-19T06:05:35.325 INFO:tasks.workunit.client.1.smithi172.stdout:6/654: dread d5/d8f/d31/d7b/fba [0,4194304] 0 2024-03-19T06:05:35.326 INFO:tasks.workunit.client.1.smithi172.stdout:8/514: write d0/f1f [1294234,110205] 0 2024-03-19T06:05:35.326 INFO:tasks.workunit.client.1.smithi172.stdout:0/627: read d11/d22/d32/f58 [3983634,83765] 0 2024-03-19T06:05:35.328 INFO:tasks.workunit.client.1.smithi172.stdout:5/525: chown d5/d14/d15/d40/f99 7621374 1 2024-03-19T06:05:35.332 INFO:tasks.workunit.client.1.smithi172.stdout:6/655: symlink d5/d11/d17/d36/d48/lcd 0 2024-03-19T06:05:35.334 INFO:tasks.workunit.client.1.smithi172.stdout:0/628: unlink d11/d22/d46/cc7 0 2024-03-19T06:05:35.336 INFO:tasks.workunit.client.1.smithi172.stdout:6/656: chown d5/d11/d17/d1b/d74/l8c 187 1 2024-03-19T06:05:35.338 INFO:tasks.workunit.client.1.smithi172.stdout:5/526: fdatasync d5/d14/f3b 0 2024-03-19T06:05:35.341 INFO:tasks.workunit.client.1.smithi172.stdout:4/623: dwrite df/d11/d12/d21/d50/d63/dbb/fab [0,4194304] 0 2024-03-19T06:05:35.342 INFO:tasks.workunit.client.1.smithi172.stdout:0/629: mknod d11/d14/d9a/cd8 0 2024-03-19T06:05:35.344 INFO:tasks.workunit.client.1.smithi172.stdout:7/502: dread d0/d22/f1e [0,4194304] 0 2024-03-19T06:05:35.347 INFO:tasks.workunit.client.1.smithi172.stdout:7/503: chown d0/d22/d1d/f45 53438 1 2024-03-19T06:05:35.358 INFO:tasks.workunit.client.1.smithi172.stdout:5/527: dwrite d5/d3d/d60/f97 [0,4194304] 0 2024-03-19T06:05:35.358 INFO:tasks.workunit.client.1.smithi172.stdout:6/657: dread d5/d11/d17/d1b/f69 [0,4194304] 0 2024-03-19T06:05:35.361 INFO:tasks.workunit.client.1.smithi172.stdout:5/528: write d5/d14/d15/d40/f73 [713976,88529] 0 2024-03-19T06:05:35.362 INFO:tasks.workunit.client.1.smithi172.stdout:7/504: symlink d0/d22/d1d/d3a/d6b/la9 0 2024-03-19T06:05:35.363 INFO:tasks.workunit.client.1.smithi172.stdout:8/515: write d0/d44/d46/d49/d26/d71/d81/d27/d29/f32 [930702,25445] 0 2024-03-19T06:05:35.365 INFO:tasks.workunit.client.1.smithi172.stdout:4/624: symlink df/d11/d12/d21/lcd 0 2024-03-19T06:05:35.367 INFO:tasks.workunit.client.1.smithi172.stdout:0/630: mkdir d11/d4d/dab/dc1/dd9 0 2024-03-19T06:05:35.367 INFO:tasks.workunit.client.1.smithi172.stdout:4/625: fdatasync df/d2b/da3/fb4 0 2024-03-19T06:05:35.369 INFO:tasks.workunit.client.1.smithi172.stdout:6/658: creat d5/d8f/d31/d3d/d95/fce x:0 0 0 2024-03-19T06:05:35.369 INFO:tasks.workunit.client.1.smithi172.stdout:7/505: creat d0/d22/d4b/faa x:0 0 0 2024-03-19T06:05:35.371 INFO:tasks.workunit.client.1.smithi172.stdout:8/516: dread d0/d44/d46/f60 [0,4194304] 0 2024-03-19T06:05:35.373 INFO:tasks.workunit.client.1.smithi172.stdout:5/529: mkdir d5/d1f/db4 0 2024-03-19T06:05:35.373 INFO:tasks.workunit.client.1.smithi172.stdout:7/506: chown d0/d22/c1a 122 1 2024-03-19T06:05:35.374 INFO:tasks.workunit.client.1.smithi172.stdout:4/626: write df/fa7 [1091600,123586] 0 2024-03-19T06:05:35.384 INFO:tasks.workunit.client.1.smithi172.stdout:4/627: mknod df/d2b/d2d/cce 0 2024-03-19T06:05:35.385 INFO:tasks.workunit.client.1.smithi172.stdout:8/517: rename d0/d64/d80/f96 to d0/d44/d46/d49/d3a/fa6 0 2024-03-19T06:05:35.391 INFO:tasks.workunit.client.1.smithi172.stdout:4/628: mknod df/d11/d12/d26/daf/ccf 0 2024-03-19T06:05:35.396 INFO:tasks.workunit.client.1.smithi172.stdout:0/631: dwrite d11/d22/d46/d84/f93 [0,4194304] 0 2024-03-19T06:05:35.396 INFO:tasks.workunit.client.1.smithi172.stdout:6/659: write d5/d11/d17/f3e [1669996,38041] 0 2024-03-19T06:05:35.398 INFO:tasks.workunit.client.1.smithi172.stdout:4/629: chown df/d11/d12/d21/f4b 44756351 1 2024-03-19T06:05:35.399 INFO:tasks.workunit.client.1.smithi172.stdout:8/518: dread d0/d44/d46/f60 [0,4194304] 0 2024-03-19T06:05:35.401 INFO:tasks.workunit.client.1.smithi172.stdout:4/630: dread - df/f24 zero size 2024-03-19T06:05:35.403 INFO:tasks.workunit.client.1.smithi172.stdout:0/632: creat d11/d14/db7/fda x:0 0 0 2024-03-19T06:05:35.405 INFO:tasks.workunit.client.1.smithi172.stdout:8/519: chown d0/d44/d46/d49/d3a/d76 58 1 2024-03-19T06:05:35.405 INFO:tasks.workunit.client.1.smithi172.stdout:5/530: dwrite d5/d14/d15/d40/f73 [0,4194304] 0 2024-03-19T06:05:35.410 INFO:tasks.workunit.client.1.smithi172.stdout:6/660: creat d5/d8f/d31/d3d/d98/db6/dc7/fcf x:0 0 0 2024-03-19T06:05:35.412 INFO:tasks.workunit.client.1.smithi172.stdout:5/531: mknod d5/d14/d48/cb5 0 2024-03-19T06:05:35.416 INFO:tasks.workunit.client.1.smithi172.stdout:8/520: symlink d0/d44/d46/d49/la7 0 2024-03-19T06:05:35.418 INFO:tasks.workunit.client.1.smithi172.stdout:3/596: sync 2024-03-19T06:05:35.419 INFO:tasks.workunit.client.1.smithi172.stdout:6/661: fdatasync d5/d11/d43/d45/da1/fcc 0 2024-03-19T06:05:35.421 INFO:tasks.workunit.client.1.smithi172.stdout:7/507: dread d0/d22/d35/f94 [0,4194304] 0 2024-03-19T06:05:35.421 INFO:tasks.workunit.client.1.smithi172.stdout:5/532: link d5/c10 d5/d1f/d2f/d62/cb6 0 2024-03-19T06:05:35.425 INFO:tasks.workunit.client.1.smithi172.stdout:5/533: fsync d5/d14/d34/f3f 0 2024-03-19T06:05:35.428 INFO:tasks.workunit.client.1.smithi172.stdout:3/597: rename d0/d37 to d0/da8/dce 0 2024-03-19T06:05:35.429 INFO:tasks.workunit.client.1.smithi172.stdout:8/521: symlink d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/la8 0 2024-03-19T06:05:35.430 INFO:tasks.workunit.client.1.smithi172.stdout:4/631: dwrite df/d2b/d2d/f6b [0,4194304] 0 2024-03-19T06:05:35.433 INFO:tasks.workunit.client.1.smithi172.stdout:6/662: creat d5/d8f/d31/d3d/d98/db6/d40/d53/fd0 x:0 0 0 2024-03-19T06:05:35.433 INFO:tasks.workunit.client.1.smithi172.stdout:7/508: mknod d0/d22/d1d/d36/d8d/d5c/cab 0 2024-03-19T06:05:35.441 INFO:tasks.workunit.client.1.smithi172.stdout:0/633: truncate d11/d14/d2c/d8d/f99 523985 0 2024-03-19T06:05:35.447 INFO:tasks.workunit.client.1.smithi172.stdout:0/634: write d11/d18/da5/da8/fb1 [2277432,37751] 0 2024-03-19T06:05:35.449 INFO:tasks.workunit.client.1.smithi172.stdout:5/534: link d5/d14/f83 d5/d14/d15/d40/d5c/fb7 0 2024-03-19T06:05:35.453 INFO:tasks.workunit.client.1.smithi172.stdout:0/635: dread - d11/d18/d38/d3f/d8b/fa3 zero size 2024-03-19T06:05:35.453 INFO:tasks.workunit.client.1.smithi172.stdout:8/522: creat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d9c/fa9 x:0 0 0 2024-03-19T06:05:35.462 INFO:tasks.workunit.client.1.smithi172.stdout:5/535: write d5/d1f/f2c [467661,113509] 0 2024-03-19T06:05:35.465 INFO:tasks.workunit.client.1.smithi172.stdout:0/636: mkdir d11/d18/da5/dcb/ddb 0 2024-03-19T06:05:35.467 INFO:tasks.workunit.client.1.smithi172.stdout:2/554: sync 2024-03-19T06:05:35.467 INFO:tasks.workunit.client.1.smithi172.stdout:9/557: sync 2024-03-19T06:05:35.469 INFO:tasks.workunit.client.1.smithi172.stdout:3/598: dwrite d0/da8/dce/da7/f94 [0,4194304] 0 2024-03-19T06:05:35.473 INFO:tasks.workunit.client.1.smithi172.stdout:5/536: mknod d5/d1f/cb8 0 2024-03-19T06:05:35.476 INFO:tasks.workunit.client.1.smithi172.stdout:9/558: chown d1/l40 11016957 1 2024-03-19T06:05:35.479 INFO:tasks.workunit.client.1.smithi172.stdout:0/637: rmdir d11/d14/d2c/dc2 39 2024-03-19T06:05:35.482 INFO:tasks.workunit.client.1.smithi172.stdout:7/509: dwrite d0/d22/d1d/d36/f23 [4194304,4194304] 0 2024-03-19T06:05:35.484 INFO:tasks.workunit.client.1.smithi172.stdout:6/663: dwrite d5/d11/d17/d36/d48/f9e [0,4194304] 0 2024-03-19T06:05:35.484 INFO:tasks.workunit.client.1.smithi172.stdout:9/559: dread - d1/d7/dc/de/f7c zero size 2024-03-19T06:05:35.486 INFO:tasks.workunit.client.1.smithi172.stdout:0/638: stat f2 0 2024-03-19T06:05:35.486 INFO:tasks.workunit.client.1.smithi172.stdout:4/632: dwrite df/d45/f6d [0,4194304] 0 2024-03-19T06:05:35.487 INFO:tasks.workunit.client.1.smithi172.stdout:5/537: unlink d5/d14/f19 0 2024-03-19T06:05:35.495 INFO:tasks.workunit.client.1.smithi172.stdout:6/664: fdatasync d5/d8f/d31/d3d/d95/fce 0 2024-03-19T06:05:35.496 INFO:tasks.workunit.client.1.smithi172.stdout:9/560: stat d1/d7/dc/d47/d78/d54/d91/f2b 0 2024-03-19T06:05:35.505 INFO:tasks.workunit.client.1.smithi172.stdout:4/633: mkdir df/d11/d12/d34/dd0 0 2024-03-19T06:05:35.507 INFO:tasks.workunit.client.1.smithi172.stdout:7/510: creat d0/d22/d1d/d85/da8/fac x:0 0 0 2024-03-19T06:05:35.508 INFO:tasks.workunit.client.1.smithi172.stdout:8/523: dread d0/d44/f62 [0,4194304] 0 2024-03-19T06:05:35.509 INFO:tasks.workunit.client.1.smithi172.stdout:4/634: fdatasync df/d11/d12/d6e/f89 0 2024-03-19T06:05:35.510 INFO:tasks.workunit.client.1.smithi172.stdout:3/599: getdents d0/da8/dce/da7 0 2024-03-19T06:05:35.515 INFO:tasks.workunit.client.1.smithi172.stdout:7/511: truncate d0/f7c 5123936 0 2024-03-19T06:05:35.515 INFO:tasks.workunit.client.1.smithi172.stdout:9/561: symlink d1/lc4 0 2024-03-19T06:05:35.524 INFO:tasks.workunit.client.1.smithi172.stdout:8/524: chown d0/d44/d46/d49/d3a/d3d/fa3 25 1 2024-03-19T06:05:35.530 INFO:tasks.workunit.client.1.smithi172.stdout:9/562: creat d1/d7/dc/de/d34/d48/d82/fc5 x:0 0 0 2024-03-19T06:05:35.536 INFO:tasks.workunit.client.1.smithi172.stdout:2/555: truncate d7/de/f42 3502762 0 2024-03-19T06:05:35.538 INFO:tasks.workunit.client.1.smithi172.stdout:6/665: dwrite d5/d11/d2f/fbb [0,4194304] 0 2024-03-19T06:05:35.540 INFO:tasks.workunit.client.1.smithi172.stdout:7/512: dread d0/d22/d27/d86/fa1 [0,4194304] 0 2024-03-19T06:05:35.543 INFO:tasks.workunit.client.1.smithi172.stdout:7/513: chown d0/d22/d4b 39 1 2024-03-19T06:05:35.561 INFO:tasks.workunit.client.1.smithi172.stdout:4/635: dwrite df/d11/d12/d21/d58/d60/f70 [0,4194304] 0 2024-03-19T06:05:35.561 INFO:tasks.workunit.client.1.smithi172.stdout:0/639: dwrite d11/d4d/fa0 [4194304,4194304] 0 2024-03-19T06:05:35.562 INFO:tasks.workunit.client.1.smithi172.stdout:3/600: dwrite d0/da8/d54/d77/f99 [0,4194304] 0 2024-03-19T06:05:35.564 INFO:tasks.workunit.client.1.smithi172.stdout:0/640: readlink d11/d14/l47 0 2024-03-19T06:05:35.571 INFO:tasks.workunit.client.1.smithi172.stdout:9/563: write d1/d7/dc/d47/d78/d54/d91/f80 [212343,42249] 0 2024-03-19T06:05:35.583 INFO:tasks.workunit.client.1.smithi172.stdout:5/538: dread d5/d14/d34/f3f [0,4194304] 0 2024-03-19T06:05:35.585 INFO:tasks.workunit.client.1.smithi172.stdout:7/514: creat d0/d2c/fad x:0 0 0 2024-03-19T06:05:35.587 INFO:tasks.workunit.client.1.smithi172.stdout:2/556: creat d7/de/d61/fb6 x:0 0 0 2024-03-19T06:05:35.589 INFO:tasks.workunit.client.1.smithi172.stdout:6/666: mkdir d5/d8f/d31/d3d/d98/db6/dc7/dd1 0 2024-03-19T06:05:35.591 INFO:tasks.workunit.client.1.smithi172.stdout:8/525: truncate d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/f40 5164849 0 2024-03-19T06:05:35.592 INFO:tasks.workunit.client.1.smithi172.stdout:5/539: dread d5/d14/d15/d40/d6a/d7a/fa0 [0,4194304] 0 2024-03-19T06:05:35.595 INFO:tasks.workunit.client.1.smithi172.stdout:4/636: rename df/d11/f77 to df/d11/d12/d21/d58/da6/dc9/dca/fd1 0 2024-03-19T06:05:35.595 INFO:tasks.workunit.client.1.smithi172.stdout:5/540: write d5/d1f/d2f/d62/f7e [891063,13168] 0 2024-03-19T06:05:35.596 INFO:tasks.workunit.client.1.smithi172.stdout:9/564: creat d1/db9/fc6 x:0 0 0 2024-03-19T06:05:35.597 INFO:tasks.workunit.client.1.smithi172.stdout:4/637: chown df/d45/f96 233264907 1 2024-03-19T06:05:35.601 INFO:tasks.workunit.client.1.smithi172.stdout:3/601: symlink d0/lcf 0 2024-03-19T06:05:35.602 INFO:tasks.workunit.client.1.smithi172.stdout:0/641: mknod d11/d18/d38/d3f/d43/d62/dc0/cdc 0 2024-03-19T06:05:35.602 INFO:tasks.workunit.client.1.smithi172.stdout:6/667: dread d5/d11/d17/f8e [0,4194304] 0 2024-03-19T06:05:35.607 INFO:tasks.workunit.client.1.smithi172.stdout:2/557: creat d7/de/d58/d56/d86/d9d/dab/fb7 x:0 0 0 2024-03-19T06:05:35.608 INFO:tasks.workunit.client.1.smithi172.stdout:9/565: creat d1/d7/dc/de/d34/d48/d82/d92/fc7 x:0 0 0 2024-03-19T06:05:35.610 INFO:tasks.workunit.client.1.smithi172.stdout:4/638: mkdir df/d11/d12/d21/d58/da6/dc9/dd2 0 2024-03-19T06:05:35.611 INFO:tasks.workunit.client.1.smithi172.stdout:9/566: chown d1/d7/dc/d47/da3/fa8 18 1 2024-03-19T06:05:35.613 INFO:tasks.workunit.client.1.smithi172.stdout:5/541: mkdir d5/d1f/db4/db9 0 2024-03-19T06:05:35.614 INFO:tasks.workunit.client.1.smithi172.stdout:9/567: fsync d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/fa0 0 2024-03-19T06:05:35.615 INFO:tasks.workunit.client.1.smithi172.stdout:9/568: dread - d1/d7/dc/de/f7c zero size 2024-03-19T06:05:35.623 INFO:tasks.workunit.client.1.smithi172.stdout:5/542: fdatasync d5/d3d/d60/fad 0 2024-03-19T06:05:35.627 INFO:tasks.workunit.client.1.smithi172.stdout:7/515: getdents d0/d22/d1d/d36/d40 0 2024-03-19T06:05:35.629 INFO:tasks.workunit.client.1.smithi172.stdout:4/639: mkdir df/d11/d12/d21/d50/d63/dbb/dc4/dd3 0 2024-03-19T06:05:35.630 INFO:tasks.workunit.client.1.smithi172.stdout:0/642: dread d11/d18/d38/d3f/d43/d62/f74 [0,4194304] 0 2024-03-19T06:05:35.632 INFO:tasks.workunit.client.1.smithi172.stdout:2/558: link d7/de/d58/d57/c8a d7/d4c/cb8 0 2024-03-19T06:05:35.634 INFO:tasks.workunit.client.1.smithi172.stdout:6/668: getdents d5/d8f/d31 0 2024-03-19T06:05:35.635 INFO:tasks.workunit.client.1.smithi172.stdout:7/516: stat d0/d22/d1d/d36/cd 0 2024-03-19T06:05:35.640 INFO:tasks.workunit.client.1.smithi172.stdout:7/517: chown d0/d22/d27/l37 1463 1 2024-03-19T06:05:35.641 INFO:tasks.workunit.client.1.smithi172.stdout:0/643: creat d11/d14/d2c/dbf/fdd x:0 0 0 2024-03-19T06:05:35.643 INFO:tasks.workunit.client.1.smithi172.stdout:4/640: mknod df/d11/d12/d21/d50/d63/dbb/dc4/cd4 0 2024-03-19T06:05:35.644 INFO:tasks.workunit.client.1.smithi172.stdout:7/518: readlink d0/d22/d1d/d3a/d6b/la9 0 2024-03-19T06:05:35.645 INFO:tasks.workunit.client.1.smithi172.stdout:2/559: creat d7/de/d58/d55/d5f/fb9 x:0 0 0 2024-03-19T06:05:35.647 INFO:tasks.workunit.client.1.smithi172.stdout:2/560: fdatasync d7/db/d2c/f4a 0 2024-03-19T06:05:35.648 INFO:tasks.workunit.client.1.smithi172.stdout:0/644: fdatasync d11/d18/d38/f55 0 2024-03-19T06:05:35.649 INFO:tasks.workunit.client.1.smithi172.stdout:6/669: creat d5/d8f/d31/d3d/d98/db6/d9f/fd2 x:0 0 0 2024-03-19T06:05:35.650 INFO:tasks.workunit.client.1.smithi172.stdout:7/519: read d0/d22/d1d/d3a/d46/f99 [1776248,118352] 0 2024-03-19T06:05:35.654 INFO:tasks.workunit.client.1.smithi172.stdout:5/543: dread d5/d55/d91/fb2 [0,4194304] 0 2024-03-19T06:05:35.655 INFO:tasks.workunit.client.1.smithi172.stdout:2/561: dread - d7/de/d58/d55/d5f/fb9 zero size 2024-03-19T06:05:35.656 INFO:tasks.workunit.client.1.smithi172.stdout:4/641: mkdir df/d11/d12/d21/d50/d63/dbb/dc4/dd5 0 2024-03-19T06:05:35.658 INFO:tasks.workunit.client.1.smithi172.stdout:9/569: dread d1/d7/f2e [0,4194304] 0 2024-03-19T06:05:35.659 INFO:tasks.workunit.client.1.smithi172.stdout:7/520: mknod d0/d22/d4b/cae 0 2024-03-19T06:05:35.665 INFO:tasks.workunit.client.1.smithi172.stdout:8/526: dwrite d0/d44/d46/f60 [0,4194304] 0 2024-03-19T06:05:35.674 INFO:tasks.workunit.client.1.smithi172.stdout:2/562: creat d7/de/d58/d56/fba x:0 0 0 2024-03-19T06:05:35.674 INFO:tasks.workunit.client.1.smithi172.stdout:0/645: write d11/f60 [745469,61454] 0 2024-03-19T06:05:35.674 INFO:tasks.workunit.client.1.smithi172.stdout:6/670: write d5/d8f/d31/f78 [387174,112356] 0 2024-03-19T06:05:35.680 INFO:tasks.workunit.client.1.smithi172.stdout:4/642: write df/d11/d12/d34/f4e [5172914,121704] 0 2024-03-19T06:05:35.681 INFO:tasks.workunit.client.1.smithi172.stdout:3/602: dwrite d0/d5/f11 [0,4194304] 0 2024-03-19T06:05:35.681 INFO:tasks.workunit.client.1.smithi172.stdout:2/563: readlink d7/l31 0 2024-03-19T06:05:35.686 INFO:tasks.workunit.client.1.smithi172.stdout:6/671: write d5/d8f/d31/d7b/fba [139300,116758] 0 2024-03-19T06:05:35.687 INFO:tasks.workunit.client.1.smithi172.stdout:5/544: creat d5/d14/d15/d40/d6a/fba x:0 0 0 2024-03-19T06:05:35.688 INFO:tasks.workunit.client.1.smithi172.stdout:4/643: write df/f8f [746060,64420] 0 2024-03-19T06:05:35.693 INFO:tasks.workunit.client.1.smithi172.stdout:5/545: chown d5/d14/d56/f64 627478 1 2024-03-19T06:05:35.695 INFO:tasks.workunit.client.1.smithi172.stdout:3/603: rename d0/cba to d0/da8/dce/d72/cd0 0 2024-03-19T06:05:35.701 INFO:tasks.workunit.client.1.smithi172.stdout:6/672: mkdir d5/d8f/d31/d3d/d98/db6/d40/d53/d75/dd3 0 2024-03-19T06:05:35.702 INFO:tasks.workunit.client.1.smithi172.stdout:5/546: rmdir d5/d14/d15 39 2024-03-19T06:05:35.703 INFO:tasks.workunit.client.1.smithi172.stdout:2/564: rename d7/de/d58/d55/da8/f7f to d7/de/d58/d56/d86/d9e/fbb 0 2024-03-19T06:05:35.704 INFO:tasks.workunit.client.1.smithi172.stdout:4/644: write df/d45/f96 [890862,5751] 0 2024-03-19T06:05:35.705 INFO:tasks.workunit.client.1.smithi172.stdout:7/521: dwrite d0/d22/d1d/d36/f1f [0,4194304] 0 2024-03-19T06:05:35.706 INFO:tasks.workunit.client.1.smithi172.stdout:3/604: symlink d0/da8/d25/d21/ld1 0 2024-03-19T06:05:35.711 INFO:tasks.workunit.client.1.smithi172.stdout:5/547: read - d5/d14/d34/f94 zero size 2024-03-19T06:05:35.711 INFO:tasks.workunit.client.1.smithi172.stdout:2/565: write d7/f4e [3809885,127410] 0 2024-03-19T06:05:35.712 INFO:tasks.workunit.client.1.smithi172.stdout:9/570: dwrite d1/d7/dc/dbe/d65/f97 [0,4194304] 0 2024-03-19T06:05:35.715 INFO:tasks.workunit.client.1.smithi172.stdout:4/645: write df/d2b/d44/d93/fc1 [20271,82746] 0 2024-03-19T06:05:35.719 INFO:tasks.workunit.client.1.smithi172.stdout:3/605: mknod d0/da8/d54/d77/cd2 0 2024-03-19T06:05:35.722 INFO:tasks.workunit.client.1.smithi172.stdout:6/673: dread d5/d8f/d31/d7b/d7e/f88 [0,4194304] 0 2024-03-19T06:05:35.722 INFO:tasks.workunit.client.1.smithi172.stdout:9/571: creat d1/d7/dc/d47/d78/d54/fc8 x:0 0 0 2024-03-19T06:05:35.725 INFO:tasks.workunit.client.1.smithi172.stdout:5/548: fsync d5/d3d/d60/f95 0 2024-03-19T06:05:35.727 INFO:tasks.workunit.client.1.smithi172.stdout:3/606: chown d0/da8/d25/d21/l3b 0 1 2024-03-19T06:05:35.727 INFO:tasks.workunit.client.1.smithi172.stdout:7/522: rename d0/d22/f26 to d0/d22/d1d/d36/d40/da2/faf 0 2024-03-19T06:05:35.730 INFO:tasks.workunit.client.1.smithi172.stdout:6/674: mknod d5/d11/d43/d45/da1/cd4 0 2024-03-19T06:05:35.731 INFO:tasks.workunit.client.1.smithi172.stdout:7/523: stat d0/d2c/f30 0 2024-03-19T06:05:35.733 INFO:tasks.workunit.client.1.smithi172.stdout:2/566: getdents d7/de/d58/d56/d89/db5 0 2024-03-19T06:05:35.733 INFO:tasks.workunit.client.1.smithi172.stdout:9/572: mkdir d1/d7/dc/dbe/dc9 0 2024-03-19T06:05:35.736 INFO:tasks.workunit.client.1.smithi172.stdout:3/607: unlink d0/d5/f1c 0 2024-03-19T06:05:35.738 INFO:tasks.workunit.client.1.smithi172.stdout:4/646: truncate df/d11/f49 4747106 0 2024-03-19T06:05:35.740 INFO:tasks.workunit.client.1.smithi172.stdout:3/608: stat d0/da8/d60/d67/f7d 0 2024-03-19T06:05:35.740 INFO:tasks.workunit.client.1.smithi172.stdout:6/675: creat d5/d8f/d31/d3d/d98/db6/d40/fd5 x:0 0 0 2024-03-19T06:05:35.740 INFO:tasks.workunit.client.1.smithi172.stdout:2/567: read d7/de/d58/d56/f6b [3164547,10036] 0 2024-03-19T06:05:35.741 INFO:tasks.workunit.client.1.smithi172.stdout:5/549: rename d5/d55/l76 to d5/d14/d15/lbb 0 2024-03-19T06:05:35.744 INFO:tasks.workunit.client.1.smithi172.stdout:6/676: write d5/f19 [3567628,55858] 0 2024-03-19T06:05:35.746 INFO:tasks.workunit.client.1.smithi172.stdout:7/524: rename d0/d2c to d0/d22/d27/db0 0 2024-03-19T06:05:35.751 INFO:tasks.workunit.client.1.smithi172.stdout:6/677: write d5/d11/d43/f4d [5616187,92701] 0 2024-03-19T06:05:35.751 INFO:tasks.workunit.client.1.smithi172.stdout:4/647: creat df/d11/d12/d26/d84/da2/fd6 x:0 0 0 2024-03-19T06:05:35.753 INFO:tasks.workunit.client.1.smithi172.stdout:2/568: read d7/d1b/f1f [3608767,129808] 0 2024-03-19T06:05:35.757 INFO:tasks.workunit.client.1.smithi172.stdout:3/609: unlink d0/da8/d34/d4d/lcb 0 2024-03-19T06:05:35.759 INFO:tasks.workunit.client.1.smithi172.stdout:4/648: mkdir df/dd7 0 2024-03-19T06:05:35.764 INFO:tasks.workunit.client.1.smithi172.stdout:2/569: mkdir d7/de/d61/dbc 0 2024-03-19T06:05:35.764 INFO:tasks.workunit.client.1.smithi172.stdout:4/649: truncate df/d11/f95 1027082 0 2024-03-19T06:05:35.765 INFO:tasks.workunit.client.1.smithi172.stdout:6/678: symlink d5/d8f/d31/d3d/d98/db6/d40/d53/d75/dd3/ld6 0 2024-03-19T06:05:35.766 INFO:tasks.workunit.client.1.smithi172.stdout:0/646: dread d11/d22/d32/f35 [0,4194304] 0 2024-03-19T06:05:35.768 INFO:tasks.workunit.client.1.smithi172.stdout:4/650: chown df/d11/c71 189 1 2024-03-19T06:05:35.782 INFO:tasks.workunit.client.1.smithi172.stdout:3/610: dwrite d0/da8/d3a/fa3 [0,4194304] 0 2024-03-19T06:05:35.784 INFO:tasks.workunit.client.1.smithi172.stdout:9/573: dread d1/d7/dc/de/d34/d48/d89/f98 [0,4194304] 0 2024-03-19T06:05:35.790 INFO:tasks.workunit.client.1.smithi172.stdout:7/525: dread d0/d22/d1d/f7b [0,4194304] 0 2024-03-19T06:05:35.792 INFO:tasks.workunit.client.1.smithi172.stdout:0/647: truncate d11/d22/f4a 680531 0 2024-03-19T06:05:35.796 INFO:tasks.workunit.client.1.smithi172.stdout:6/679: creat d5/d8f/d31/d3d/d98/db6/d40/d53/d75/fd7 x:0 0 0 2024-03-19T06:05:35.798 INFO:tasks.workunit.client.1.smithi172.stdout:6/680: write d5/f13 [1771433,5348] 0 2024-03-19T06:05:35.798 INFO:tasks.workunit.client.1.smithi172.stdout:5/550: write d5/d14/d15/d40/d6a/d7a/fa0 [803942,24328] 0 2024-03-19T06:05:35.800 INFO:tasks.workunit.client.1.smithi172.stdout:3/611: symlink d0/da8/d25/d21/ld3 0 2024-03-19T06:05:35.800 INFO:tasks.workunit.client.1.smithi172.stdout:9/574: chown d1/d7/dc/de/d34/lbc 14 1 2024-03-19T06:05:35.802 INFO:tasks.workunit.client.1.smithi172.stdout:5/551: chown d5/d14/d15/d40 1231450 1 2024-03-19T06:05:35.802 INFO:tasks.workunit.client.1.smithi172.stdout:0/648: truncate f2 2946612 0 2024-03-19T06:05:35.803 INFO:tasks.workunit.client.1.smithi172.stdout:2/570: dwrite d7/d1b/f2d [4194304,4194304] 0 2024-03-19T06:05:35.804 INFO:tasks.workunit.client.1.smithi172.stdout:4/651: getdents df/d11/d12/d21 0 2024-03-19T06:05:35.807 INFO:tasks.workunit.client.1.smithi172.stdout:4/652: chown df/d2b/d44/d93 6 1 2024-03-19T06:05:35.807 INFO:tasks.workunit.client.1.smithi172.stdout:3/612: symlink d0/da8/dce/d72/ld4 0 2024-03-19T06:05:35.812 INFO:tasks.workunit.client.1.smithi172.stdout:5/552: unlink d5/d14/d56/c84 0 2024-03-19T06:05:35.822 INFO:tasks.workunit.client.1.smithi172.stdout:6/681: creat d5/d8f/d31/d3d/d98/db6/dc7/dd1/fd8 x:0 0 0 2024-03-19T06:05:35.823 INFO:tasks.workunit.client.1.smithi172.stdout:5/553: symlink d5/d14/d15/d40/d6a/d7a/lbc 0 2024-03-19T06:05:35.824 INFO:tasks.workunit.client.1.smithi172.stdout:9/575: creat d1/d7/dc/de/d34/fca x:0 0 0 2024-03-19T06:05:35.825 INFO:tasks.workunit.client.1.smithi172.stdout:7/526: link d0/d22/d1d/d36/d40/da2/faf d0/d22/d1d/d36/d40/fb1 0 2024-03-19T06:05:35.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:35 smithi072 ceph-mon[28706]: pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 41 MiB/s rd, 190 MiB/s wr, 371 op/s 2024-03-19T06:05:35.830 INFO:tasks.workunit.client.1.smithi172.stdout:7/527: chown d0/d22/d1d/f9e 1903 1 2024-03-19T06:05:35.831 INFO:tasks.workunit.client.1.smithi172.stdout:9/576: unlink d1/d7/dc/dbe/l59 0 2024-03-19T06:05:35.833 INFO:tasks.workunit.client.1.smithi172.stdout:6/682: unlink d5/d11/d17/c9c 0 2024-03-19T06:05:35.833 INFO:tasks.workunit.client.1.smithi172.stdout:3/613: creat d0/da8/d25/d21/fd5 x:0 0 0 2024-03-19T06:05:35.837 INFO:tasks.workunit.client.1.smithi172.stdout:5/554: write d5/d14/f3b [315310,50810] 0 2024-03-19T06:05:35.839 INFO:tasks.workunit.client.1.smithi172.stdout:4/653: dwrite df/d11/d12/d26/d84/da2/fd6 [0,4194304] 0 2024-03-19T06:05:35.841 INFO:tasks.workunit.client.1.smithi172.stdout:7/528: creat d0/d22/d27/db0/d92/fb2 x:0 0 0 2024-03-19T06:05:35.841 INFO:tasks.workunit.client.1.smithi172.stdout:6/683: truncate d5/d11/d17/f3e 3673780 0 2024-03-19T06:05:35.842 INFO:tasks.workunit.client.1.smithi172.stdout:3/614: unlink d0/d5/d6b/dae/c96 0 2024-03-19T06:05:35.843 INFO:tasks.workunit.client.1.smithi172.stdout:5/555: stat d5/d14/d34/d66/c9e 0 2024-03-19T06:05:35.846 INFO:tasks.workunit.client.1.smithi172.stdout:9/577: creat d1/d7/dc/de/d34/d48/d82/d92/d95/fcb x:0 0 0 2024-03-19T06:05:35.847 INFO:tasks.workunit.client.1.smithi172.stdout:2/571: dwrite d7/de/f42 [0,4194304] 0 2024-03-19T06:05:35.847 INFO:tasks.workunit.client.1.smithi172.stdout:7/529: creat d0/d22/d4b/fb3 x:0 0 0 2024-03-19T06:05:35.849 INFO:tasks.workunit.client.1.smithi172.stdout:4/654: creat df/d11/d12/d26/d84/fd8 x:0 0 0 2024-03-19T06:05:35.850 INFO:tasks.workunit.client.1.smithi172.stdout:5/556: mkdir d5/d3c/d6c/dbd 0 2024-03-19T06:05:35.854 INFO:tasks.workunit.client.1.smithi172.stdout:2/572: mkdir d7/db/d2c/d35/dbd 0 2024-03-19T06:05:35.854 INFO:tasks.workunit.client.1.smithi172.stdout:9/578: stat d1/d7/dc/de/d34/d48 0 2024-03-19T06:05:35.863 INFO:tasks.workunit.client.1.smithi172.stdout:5/557: creat d5/d14/d15/d40/d6a/fbe x:0 0 0 2024-03-19T06:05:35.865 INFO:tasks.workunit.client.1.smithi172.stdout:6/684: dread d5/d11/d17/d36/d48/f9e [0,4194304] 0 2024-03-19T06:05:35.866 INFO:tasks.workunit.client.1.smithi172.stdout:2/573: mknod d7/de/cbe 0 2024-03-19T06:05:35.868 INFO:tasks.workunit.client.1.smithi172.stdout:3/615: write d0/da8/d54/d90/f97 [50782,120603] 0 2024-03-19T06:05:35.869 INFO:tasks.workunit.client.1.smithi172.stdout:5/558: mknod d5/d14/d56/cbf 0 2024-03-19T06:05:35.870 INFO:tasks.workunit.client.1.smithi172.stdout:4/655: getdents df/d11 0 2024-03-19T06:05:35.870 INFO:tasks.workunit.client.1.smithi172.stdout:7/530: link d0/d22/c1a d0/d22/d27/d86/cb4 0 2024-03-19T06:05:35.874 INFO:tasks.workunit.client.1.smithi172.stdout:2/574: chown d7/d1b/c5e 272 1 2024-03-19T06:05:35.874 INFO:tasks.workunit.client.1.smithi172.stdout:6/685: mkdir d5/d11/d43/da6/dd9 0 2024-03-19T06:05:35.877 INFO:tasks.workunit.client.1.smithi172.stdout:7/531: creat d0/d22/d27/db0/d92/fb5 x:0 0 0 2024-03-19T06:05:35.877 INFO:tasks.workunit.client.1.smithi172.stdout:2/575: chown d7/db/d45/f88 412817 1 2024-03-19T06:05:35.880 INFO:tasks.workunit.client.1.smithi172.stdout:4/656: creat df/d11/d12/d21/d50/d63/fd9 x:0 0 0 2024-03-19T06:05:35.881 INFO:tasks.workunit.client.1.smithi172.stdout:9/579: dread d1/d7/dc/de/d34/d48/d89/f98 [0,4194304] 0 2024-03-19T06:05:35.882 INFO:tasks.workunit.client.1.smithi172.stdout:3/616: rename d0/da8/dce/ca5 to d0/da8/d34/cd6 0 2024-03-19T06:05:35.887 INFO:tasks.workunit.client.1.smithi172.stdout:7/532: symlink d0/d22/d1d/d36/lb6 0 2024-03-19T06:05:35.887 INFO:tasks.workunit.client.1.smithi172.stdout:6/686: getdents d5/d11/d43/d45/da1 0 2024-03-19T06:05:35.892 INFO:tasks.workunit.client.1.smithi172.stdout:6/687: fdatasync d5/d11/d17/d36/d48/fa8 0 2024-03-19T06:05:35.897 INFO:tasks.workunit.client.1.smithi172.stdout:6/688: dread - d5/d8f/d31/d3d/d95/fce zero size 2024-03-19T06:05:35.899 INFO:tasks.workunit.client.1.smithi172.stdout:4/657: dwrite df/d2b/f40 [0,4194304] 0 2024-03-19T06:05:35.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:35 smithi172 ceph-mon[35716]: pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 41 MiB/s rd, 190 MiB/s wr, 371 op/s 2024-03-19T06:05:35.904 INFO:tasks.workunit.client.1.smithi172.stdout:2/576: dwrite d7/de/d58/d55/f82 [0,4194304] 0 2024-03-19T06:05:35.914 INFO:tasks.workunit.client.1.smithi172.stdout:3/617: dwrite d0/da8/d54/d77/fac [0,4194304] 0 2024-03-19T06:05:35.921 INFO:tasks.workunit.client.1.smithi172.stdout:7/533: dwrite d0/f9a [0,4194304] 0 2024-03-19T06:05:35.928 INFO:tasks.workunit.client.1.smithi172.stdout:3/618: mkdir d0/d5/d6b/dae/db9/dd7 0 2024-03-19T06:05:35.931 INFO:tasks.workunit.client.1.smithi172.stdout:3/619: chown d0/d5/d6b/f81 12 1 2024-03-19T06:05:35.933 INFO:tasks.workunit.client.1.smithi172.stdout:7/534: dread - d0/d22/d1d/d36/d8d/d5c/d67/d82/fa5 zero size 2024-03-19T06:05:35.944 INFO:tasks.workunit.client.1.smithi172.stdout:7/535: symlink d0/d22/d1d/d36/d8d/lb7 0 2024-03-19T06:05:35.952 INFO:tasks.workunit.client.1.smithi172.stdout:8/527: sync 2024-03-19T06:05:35.954 INFO:tasks.workunit.client.1.smithi172.stdout:3/620: dwrite d0/da8/d3a/fa3 [0,4194304] 0 2024-03-19T06:05:35.954 INFO:tasks.workunit.client.1.smithi172.stdout:7/536: rename d0/d22/d27/l3b to d0/d22/d1d/d36/lb8 0 2024-03-19T06:05:35.956 INFO:tasks.workunit.client.1.smithi172.stdout:4/658: write df/d11/d12/d21/d58/da6/dc9/dca/fd1 [1409884,6860] 0 2024-03-19T06:05:35.959 INFO:tasks.workunit.client.1.smithi172.stdout:2/577: dread d7/de/d58/d56/f39 [0,4194304] 0 2024-03-19T06:05:35.960 INFO:tasks.workunit.client.1.smithi172.stdout:4/659: dread - df/d11/d12/d69/fb7 zero size 2024-03-19T06:05:35.960 INFO:tasks.workunit.client.1.smithi172.stdout:7/537: creat d0/d22/fb9 x:0 0 0 2024-03-19T06:05:35.965 INFO:tasks.workunit.client.1.smithi172.stdout:6/689: dread d5/fb [0,4194304] 0 2024-03-19T06:05:35.968 INFO:tasks.workunit.client.1.smithi172.stdout:6/690: chown d5/d11/d17/ca7 130889982 1 2024-03-19T06:05:35.972 INFO:tasks.workunit.client.1.smithi172.stdout:7/538: mknod d0/d22/d4b/cba 0 2024-03-19T06:05:35.974 INFO:tasks.workunit.client.1.smithi172.stdout:8/528: dwrite d0/d44/f88 [0,4194304] 0 2024-03-19T06:05:35.978 INFO:tasks.workunit.client.1.smithi172.stdout:3/621: dwrite d0/fbc [0,4194304] 0 2024-03-19T06:05:35.978 INFO:tasks.workunit.client.1.smithi172.stdout:8/529: chown d0/c6c 1330928 1 2024-03-19T06:05:35.980 INFO:tasks.workunit.client.1.smithi172.stdout:2/578: creat d7/de/d58/d56/d86/d9d/fbf x:0 0 0 2024-03-19T06:05:35.980 INFO:tasks.workunit.client.1.smithi172.stdout:8/530: stat d0/d44/d46/d49/d26/l77 0 2024-03-19T06:05:35.981 INFO:tasks.workunit.client.1.smithi172.stdout:7/539: symlink d0/d22/d35/d8e/lbb 0 2024-03-19T06:05:35.981 INFO:tasks.workunit.client.1.smithi172.stdout:2/579: dread - d7/fae zero size 2024-03-19T06:05:35.988 INFO:tasks.workunit.client.1.smithi172.stdout:7/540: rmdir d0/d22/d1d/d3a/d6b 39 2024-03-19T06:05:35.993 INFO:tasks.workunit.client.1.smithi172.stdout:8/531: rename d0/d44/d46/d49/d26/l77 to d0/d44/d46/d49/d26/d71/d81/laa 0 2024-03-19T06:05:35.996 INFO:tasks.workunit.client.1.smithi172.stdout:6/691: dwrite d5/d8f/f6b [0,4194304] 0 2024-03-19T06:05:36.003 INFO:tasks.workunit.client.1.smithi172.stdout:2/580: link d7/db/d2c/l8e d7/db/d2c/lc0 0 2024-03-19T06:05:36.009 INFO:tasks.workunit.client.1.smithi172.stdout:2/581: mkdir d7/de/d58/d55/d66/dc1 0 2024-03-19T06:05:36.012 INFO:tasks.workunit.client.1.smithi172.stdout:6/692: rename d5/c73 to d5/d11/d2f/cda 0 2024-03-19T06:05:36.014 INFO:tasks.workunit.client.1.smithi172.stdout:2/582: fdatasync d7/de/d58/d56/d81/f9a 0 2024-03-19T06:05:36.017 INFO:tasks.workunit.client.1.smithi172.stdout:7/541: truncate d0/d22/d27/db0/f2f 131454 0 2024-03-19T06:05:36.021 INFO:tasks.workunit.client.1.smithi172.stdout:8/532: dwrite d0/d44/d46/d49/d26/d71/d81/f99 [0,4194304] 0 2024-03-19T06:05:36.022 INFO:tasks.workunit.client.1.smithi172.stdout:4/660: dwrite df/d11/f95 [0,4194304] 0 2024-03-19T06:05:36.023 INFO:tasks.workunit.client.1.smithi172.stdout:6/693: creat d5/d11/d43/da6/dd9/fdb x:0 0 0 2024-03-19T06:05:36.025 INFO:tasks.workunit.client.1.smithi172.stdout:2/583: symlink d7/d4c/d70/daa/lc2 0 2024-03-19T06:05:36.033 INFO:tasks.workunit.client.1.smithi172.stdout:6/694: truncate d5/d8f/d31/d3d/d98/db6/d40/d53/d75/f81 4715043 0 2024-03-19T06:05:36.034 INFO:tasks.workunit.client.1.smithi172.stdout:8/533: creat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d9c/fab x:0 0 0 2024-03-19T06:05:36.035 INFO:tasks.workunit.client.1.smithi172.stdout:2/584: creat d7/de/d58/d55/d5f/fc3 x:0 0 0 2024-03-19T06:05:36.038 INFO:tasks.workunit.client.1.smithi172.stdout:4/661: creat df/d11/d12/d21/d58/da6/dc9/dd2/fda x:0 0 0 2024-03-19T06:05:36.045 INFO:tasks.workunit.client.1.smithi172.stdout:8/534: dread - d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/f7c zero size 2024-03-19T06:05:36.046 INFO:tasks.workunit.client.1.smithi172.stdout:4/662: creat df/d11/d12/d21/d58/da6/dc9/dd2/fdb x:0 0 0 2024-03-19T06:05:36.049 INFO:tasks.workunit.client.1.smithi172.stdout:4/663: write df/d2b/d2d/f9d [1858053,126653] 0 2024-03-19T06:05:36.051 INFO:tasks.workunit.client.1.smithi172.stdout:6/695: link d5/d11/d43/f64 d5/d8f/fdc 0 2024-03-19T06:05:36.051 INFO:tasks.workunit.client.1.smithi172.stdout:4/664: dread - df/d2b/d44/f8e zero size 2024-03-19T06:05:36.052 INFO:tasks.workunit.client.1.smithi172.stdout:4/665: stat df/d11/d12/d21/l5e 0 2024-03-19T06:05:36.052 INFO:tasks.workunit.client.1.smithi172.stdout:6/696: write d5/d8f/d31/f60 [154423,6575] 0 2024-03-19T06:05:36.057 INFO:tasks.workunit.client.1.smithi172.stdout:4/666: truncate df/d11/d12/d26/d84/fd8 11201 0 2024-03-19T06:05:36.058 INFO:tasks.workunit.client.1.smithi172.stdout:7/542: write d0/d22/d27/db0/f2f [502483,120559] 0 2024-03-19T06:05:36.060 INFO:tasks.workunit.client.1.smithi172.stdout:4/667: dread - df/f24 zero size 2024-03-19T06:05:36.064 INFO:tasks.workunit.client.1.smithi172.stdout:8/535: link d0/d44/d46/d49/d26/c50 d0/d44/d46/d49/d3a/d3d/cac 0 2024-03-19T06:05:36.064 INFO:tasks.workunit.client.1.smithi172.stdout:6/697: creat d5/d11/d17/d36/d48/fdd x:0 0 0 2024-03-19T06:05:36.065 INFO:tasks.workunit.client.1.smithi172.stdout:7/543: rmdir d0/d22/d1d/d3a/d46 39 2024-03-19T06:05:36.067 INFO:tasks.workunit.client.1.smithi172.stdout:4/668: creat df/d11/d12/d21/d58/fdc x:0 0 0 2024-03-19T06:05:36.072 INFO:tasks.workunit.client.1.smithi172.stdout:8/536: unlink d0/d44/d46/d49/d26/d71/d81/f99 0 2024-03-19T06:05:36.073 INFO:tasks.workunit.client.1.smithi172.stdout:6/698: symlink d5/d8f/d31/db8/lde 0 2024-03-19T06:05:36.078 INFO:tasks.workunit.client.1.smithi172.stdout:8/537: chown d0/d44/d46/d49/d26/d71/d81/d27/d29/f33 60319343 1 2024-03-19T06:05:36.084 INFO:tasks.workunit.client.1.smithi172.stdout:8/538: mknod d0/d44/d46/d49/cad 0 2024-03-19T06:05:36.084 INFO:tasks.workunit.client.1.smithi172.stdout:7/544: dwrite d0/d22/d1d/f45 [0,4194304] 0 2024-03-19T06:05:36.087 INFO:tasks.workunit.client.1.smithi172.stdout:4/669: dread df/d11/d12/d21/d50/d63/dbb/fab [0,4194304] 0 2024-03-19T06:05:36.088 INFO:tasks.workunit.client.1.smithi172.stdout:7/545: readlink d0/d22/d1d/d36/d40/da2/la7 0 2024-03-19T06:05:36.089 INFO:tasks.workunit.client.1.smithi172.stdout:7/546: fsync d0/f9a 0 2024-03-19T06:05:36.090 INFO:tasks.workunit.client.1.smithi172.stdout:4/670: rmdir df/d2b/d2d/db0 39 2024-03-19T06:05:36.092 INFO:tasks.workunit.client.1.smithi172.stdout:8/539: fsync d0/d44/d46/d49/d26/d71/d81/d27/d29/f4c 0 2024-03-19T06:05:36.093 INFO:tasks.workunit.client.1.smithi172.stdout:4/671: chown df/d11/d12/d21/d58/fdc 107706 1 2024-03-19T06:05:36.096 INFO:tasks.workunit.client.1.smithi172.stdout:7/547: rename d0/d22/d1d/f9e to d0/d22/d1d/d85/da8/fbc 0 2024-03-19T06:05:36.099 INFO:tasks.workunit.client.1.smithi172.stdout:8/540: write d0/f85 [3924600,28310] 0 2024-03-19T06:05:36.099 INFO:tasks.workunit.client.1.smithi172.stdout:4/672: symlink df/d2b/d99/ldd 0 2024-03-19T06:05:36.102 INFO:tasks.workunit.client.1.smithi172.stdout:4/673: fsync df/d11/d12/d21/d50/d63/fbe 0 2024-03-19T06:05:36.103 INFO:tasks.workunit.client.1.smithi172.stdout:8/541: fdatasync d0/d44/d46/d49/d26/d71/d81/d27/d29/f33 0 2024-03-19T06:05:36.106 INFO:tasks.workunit.client.1.smithi172.stdout:4/674: mknod df/d2b/cde 0 2024-03-19T06:05:36.107 INFO:tasks.workunit.client.1.smithi172.stdout:7/548: link d0/d22/d1d/d36/f60 d0/d22/d1d/d85/fbd 0 2024-03-19T06:05:36.110 INFO:tasks.workunit.client.1.smithi172.stdout:8/542: symlink d0/d61/d6a/d9f/lae 0 2024-03-19T06:05:36.114 INFO:tasks.workunit.client.1.smithi172.stdout:4/675: dread df/d11/d12/d21/d50/d63/fb3 [0,4194304] 0 2024-03-19T06:05:36.169 INFO:tasks.workunit.client.1.smithi172.stdout:4/676: getdents df/d2b/d2d 0 2024-03-19T06:05:36.169 INFO:tasks.workunit.client.1.smithi172.stdout:8/543: write d0/d61/f6b [583751,43697] 0 2024-03-19T06:05:36.170 INFO:tasks.workunit.client.1.smithi172.stdout:7/549: dread d0/d22/d1d/d36/d40/da2/faf [0,4194304] 0 2024-03-19T06:05:36.172 INFO:tasks.workunit.client.1.smithi172.stdout:8/544: chown d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b 30675 1 2024-03-19T06:05:36.174 INFO:tasks.workunit.client.1.smithi172.stdout:4/677: creat df/d2b/d44/d67/fdf x:0 0 0 2024-03-19T06:05:36.176 INFO:tasks.workunit.client.1.smithi172.stdout:4/678: chown df/d2b/da3/fb4 325724114 1 2024-03-19T06:05:36.178 INFO:tasks.workunit.client.1.smithi172.stdout:8/545: mknod d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/caf 0 2024-03-19T06:05:36.183 INFO:tasks.workunit.client.1.smithi172.stdout:8/546: creat d0/d61/d6a/d9f/fb0 x:0 0 0 2024-03-19T06:05:36.185 INFO:tasks.workunit.client.1.smithi172.stdout:8/547: chown d0/d44/d46/d49/d26/f48 1014769038 1 2024-03-19T06:05:36.189 INFO:tasks.workunit.client.1.smithi172.stdout:7/550: dwrite d0/d22/d1d/d3a/d46/f78 [0,4194304] 0 2024-03-19T06:05:36.200 INFO:tasks.workunit.client.1.smithi172.stdout:4/679: truncate df/d11/d12/d26/f30 2585187 0 2024-03-19T06:05:36.209 INFO:tasks.workunit.client.1.smithi172.stdout:8/548: symlink d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/lb1 0 2024-03-19T06:05:36.211 INFO:tasks.workunit.client.1.smithi172.stdout:7/551: mknod d0/d22/d1d/d3a/d6b/cbe 0 2024-03-19T06:05:36.213 INFO:tasks.workunit.client.1.smithi172.stdout:8/549: fsync d0/d44/d46/d49/d3a/fa6 0 2024-03-19T06:05:36.218 INFO:tasks.workunit.client.1.smithi172.stdout:4/680: dwrite fb [0,4194304] 0 2024-03-19T06:05:36.219 INFO:tasks.workunit.client.1.smithi172.stdout:8/550: write d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/f8a [4452699,50223] 0 2024-03-19T06:05:36.226 INFO:tasks.workunit.client.1.smithi172.stdout:8/551: write d0/d44/f88 [2481517,57580] 0 2024-03-19T06:05:36.312 INFO:tasks.workunit.client.1.smithi172.stdout:5/559: sync 2024-03-19T06:05:36.312 INFO:tasks.workunit.client.1.smithi172.stdout:0/649: sync 2024-03-19T06:05:36.316 INFO:tasks.workunit.client.1.smithi172.stdout:5/560: chown d5/d14/d15/d40/d6a/fbe 3670695 1 2024-03-19T06:05:36.361 INFO:tasks.workunit.client.1.smithi172.stdout:3/622: sync 2024-03-19T06:05:36.361 INFO:tasks.workunit.client.1.smithi172.stdout:9/580: sync 2024-03-19T06:05:36.394 INFO:tasks.workunit.client.1.smithi172.stdout:6/699: sync 2024-03-19T06:05:36.394 INFO:tasks.workunit.client.1.smithi172.stdout:2/585: sync 2024-03-19T06:05:36.397 INFO:tasks.workunit.client.1.smithi172.stdout:2/586: write d7/db/d2c/f4a [4154273,90498] 0 2024-03-19T06:05:37.141 INFO:tasks.workunit.client.1.smithi172.stdout:7/552: fdatasync d0/d22/d1d/d85/fbd 0 2024-03-19T06:05:37.184 INFO:tasks.workunit.client.1.smithi172.stdout:5/561: unlink d5/d3d/fa4 0 2024-03-19T06:05:37.186 INFO:tasks.workunit.client.1.smithi172.stdout:0/650: rename d11/d14/d2c/c7a to d11/d14/d2c/d4e/cde 0 2024-03-19T06:05:37.188 INFO:tasks.workunit.client.1.smithi172.stdout:3/623: creat d0/da8/d60/fd8 x:0 0 0 2024-03-19T06:05:37.189 INFO:tasks.workunit.client.1.smithi172.stdout:3/624: stat d0/da8/d60/f7e 0 2024-03-19T06:05:37.192 INFO:tasks.workunit.client.1.smithi172.stdout:9/581: mknod d1/d7/dc/de/d34/d48/d82/d92/ccc 0 2024-03-19T06:05:37.193 INFO:tasks.workunit.client.1.smithi172.stdout:2/587: creat d7/de/d58/d57/fc4 x:0 0 0 2024-03-19T06:05:37.194 INFO:tasks.workunit.client.1.smithi172.stdout:9/582: chown d1/d7/dc/l3f 113 1 2024-03-19T06:05:37.196 INFO:tasks.workunit.client.1.smithi172.stdout:2/588: truncate d7/de/d58/d56/f46 2727192 0 2024-03-19T06:05:37.240 INFO:tasks.workunit.client.1.smithi172.stdout:4/681: creat df/dd7/fe0 x:0 0 0 2024-03-19T06:05:37.242 INFO:tasks.workunit.client.1.smithi172.stdout:8/552: creat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c/fb2 x:0 0 0 2024-03-19T06:05:37.244 INFO:tasks.workunit.client.1.smithi172.stdout:0/651: mknod d11/d4d/cdf 0 2024-03-19T06:05:37.245 INFO:tasks.workunit.client.1.smithi172.stdout:6/700: mkdir d5/d8f/ddf 0 2024-03-19T06:05:37.247 INFO:tasks.workunit.client.1.smithi172.stdout:2/589: unlink d7/de/d58/d55/d6e/f95 0 2024-03-19T06:05:37.247 INFO:tasks.workunit.client.1.smithi172.stdout:6/701: chown d5/d11/fab 31157 1 2024-03-19T06:05:37.248 INFO:tasks.workunit.client.1.smithi172.stdout:8/553: truncate d0/d44/d46/d49/f25 4705976 0 2024-03-19T06:05:37.251 INFO:tasks.workunit.client.1.smithi172.stdout:3/625: getdents d0/db0/db6/dc7 0 2024-03-19T06:05:37.251 INFO:tasks.workunit.client.1.smithi172.stdout:2/590: chown d7/db/f24 181803084 1 2024-03-19T06:05:37.253 INFO:tasks.workunit.client.1.smithi172.stdout:9/583: mknod d1/d7/dc/d47/ccd 0 2024-03-19T06:05:37.255 INFO:tasks.workunit.client.1.smithi172.stdout:3/626: dread - d0/da8/d54/d90/fcd zero size 2024-03-19T06:05:37.256 INFO:tasks.workunit.client.1.smithi172.stdout:8/554: write d0/d44/d46/d49/f25 [2162169,46979] 0 2024-03-19T06:05:37.257 INFO:tasks.workunit.client.1.smithi172.stdout:9/584: mknod d1/cce 0 2024-03-19T06:05:37.270 INFO:tasks.workunit.client.1.smithi172.stdout:4/682: dwrite df/d2b/da3/fa8 [0,4194304] 0 2024-03-19T06:05:37.276 INFO:tasks.workunit.client.1.smithi172.stdout:9/585: dread d1/d7/dc/d47/d78/d54/f6d [0,4194304] 0 2024-03-19T06:05:37.280 INFO:tasks.workunit.client.1.smithi172.stdout:7/553: dread d0/d22/f6d [0,4194304] 0 2024-03-19T06:05:37.283 INFO:tasks.workunit.client.1.smithi172.stdout:0/652: stat d11/d14/d2c/d4e/cde 0 2024-03-19T06:05:37.287 INFO:tasks.workunit.client.1.smithi172.stdout:8/555: mkdir d0/d44/d46/d49/d26/d71/d81/d27/d29/db3 0 2024-03-19T06:05:37.295 INFO:tasks.workunit.client.1.smithi172.stdout:6/702: link d5/d8f/d31/d3d/d98/db6/d40/d53/fd0 d5/d11/d2f/fe0 0 2024-03-19T06:05:37.297 INFO:tasks.workunit.client.1.smithi172.stdout:4/683: unlink df/d11/d12/l42 0 2024-03-19T06:05:37.302 INFO:tasks.workunit.client.1.smithi172.stdout:2/591: getdents d7/d4c/d70/daa 0 2024-03-19T06:05:37.307 INFO:tasks.workunit.client.1.smithi172.stdout:7/554: mkdir d0/d22/d1d/d36/d8d/d7d/dbf 0 2024-03-19T06:05:37.312 INFO:tasks.workunit.client.1.smithi172.stdout:3/627: creat d0/d5/d14/fd9 x:0 0 0 2024-03-19T06:05:37.312 INFO:tasks.workunit.client.1.smithi172.stdout:8/556: dread d0/d44/d46/d49/d26/d71/d81/d27/f1e [0,4194304] 0 2024-03-19T06:05:37.313 INFO:tasks.workunit.client.1.smithi172.stdout:9/586: dread d1/d7/dc/faf [0,4194304] 0 2024-03-19T06:05:37.315 INFO:tasks.workunit.client.1.smithi172.stdout:6/703: mkdir d5/d11/d43/d45/da1/de1 0 2024-03-19T06:05:37.320 INFO:tasks.workunit.client.1.smithi172.stdout:4/684: dwrite df/dd7/fe0 [0,4194304] 0 2024-03-19T06:05:37.322 INFO:tasks.workunit.client.1.smithi172.stdout:3/628: mkdir d0/da8/d34/dda 0 2024-03-19T06:05:37.323 INFO:tasks.workunit.client.1.smithi172.stdout:8/557: truncate d0/d44/d46/f87 737838 0 2024-03-19T06:05:37.324 INFO:tasks.workunit.client.1.smithi172.stdout:9/587: chown d1/d7/dc/d47/d78/d54/d91/l44 1013 1 2024-03-19T06:05:37.329 INFO:tasks.workunit.client.1.smithi172.stdout:4/685: unlink df/d11/d12/d34/lb2 0 2024-03-19T06:05:37.330 INFO:tasks.workunit.client.1.smithi172.stdout:6/704: dread d5/d8f/d31/f57 [0,4194304] 0 2024-03-19T06:05:37.332 INFO:tasks.workunit.client.1.smithi172.stdout:6/705: write d5/d11/d17/d1b/f25 [2549335,62047] 0 2024-03-19T06:05:37.332 INFO:tasks.workunit.client.1.smithi172.stdout:3/629: rmdir d0/da8/d3a 39 2024-03-19T06:05:37.335 INFO:tasks.workunit.client.1.smithi172.stdout:8/558: symlink d0/d44/d46/d49/d26/d71/lb4 0 2024-03-19T06:05:37.338 INFO:tasks.workunit.client.1.smithi172.stdout:9/588: symlink d1/d7/dc/d47/d78/d54/d91/lcf 0 2024-03-19T06:05:37.339 INFO:tasks.workunit.client.1.smithi172.stdout:7/555: write d0/d22/d1d/d3a/f3f [4431073,115820] 0 2024-03-19T06:05:37.339 INFO:tasks.workunit.client.1.smithi172.stdout:6/706: chown d5/d8f/d31/d7b/d7e/f88 184355852 1 2024-03-19T06:05:37.342 INFO:tasks.workunit.client.1.smithi172.stdout:3/630: fsync d0/fe 0 2024-03-19T06:05:37.343 INFO:tasks.workunit.client.1.smithi172.stdout:9/589: stat d1/d7/dc/d47/d78/l5c 0 2024-03-19T06:05:37.348 INFO:tasks.workunit.client.1.smithi172.stdout:0/653: dwrite d11/d18/d38/d3f/d43/f79 [0,4194304] 0 2024-03-19T06:05:37.352 INFO:tasks.workunit.client.1.smithi172.stdout:9/590: fsync d1/d7/dc/de/d34/d48/fa4 0 2024-03-19T06:05:37.353 INFO:tasks.workunit.client.1.smithi172.stdout:8/559: getdents d0/d44/d46/d49/d3a/d3d 0 2024-03-19T06:05:37.356 INFO:tasks.workunit.client.1.smithi172.stdout:0/654: creat d11/d18/d38/d3f/d43/d62/dc0/fe0 x:0 0 0 2024-03-19T06:05:37.360 INFO:tasks.workunit.client.1.smithi172.stdout:0/655: readlink d11/d14/d2c/l54 0 2024-03-19T06:05:37.374 INFO:tasks.workunit.client.1.smithi172.stdout:6/707: dwrite d5/d11/d17/d36/dca/fcb [0,4194304] 0 2024-03-19T06:05:37.376 INFO:tasks.workunit.client.1.smithi172.stdout:3/631: dread d0/da8/d34/d4d/f49 [0,4194304] 0 2024-03-19T06:05:37.401 INFO:tasks.workunit.client.1.smithi172.stdout:3/632: dwrite d0/da8/d25/f74 [0,4194304] 0 2024-03-19T06:05:37.403 INFO:tasks.workunit.client.1.smithi172.stdout:9/591: dread d1/d7/dc/de/d34/d48/f70 [0,4194304] 0 2024-03-19T06:05:37.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:37 smithi072 ceph-mon[28706]: pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 39 MiB/s rd, 149 MiB/s wr, 288 op/s 2024-03-19T06:05:37.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:37 smithi172 ceph-mon[35716]: pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 39 MiB/s rd, 149 MiB/s wr, 288 op/s 2024-03-19T06:05:37.844 INFO:tasks.workunit.client.1.smithi172.stdout:0/656: creat d11/d22/d68/fe1 x:0 0 0 2024-03-19T06:05:37.849 INFO:tasks.workunit.client.1.smithi172.stdout:0/657: read d11/d4d/f5a [2642459,115307] 0 2024-03-19T06:05:37.850 INFO:tasks.workunit.client.1.smithi172.stdout:7/556: truncate d0/d22/d1d/d3a/f3f 1701733 0 2024-03-19T06:05:37.852 INFO:tasks.workunit.client.1.smithi172.stdout:8/560: dread d0/d44/d46/d49/d26/d71/d81/f56 [0,4194304] 0 2024-03-19T06:05:37.855 INFO:tasks.workunit.client.1.smithi172.stdout:9/592: dread - d1/d7/fb6 zero size 2024-03-19T06:05:37.859 INFO:tasks.workunit.client.1.smithi172.stdout:6/708: write d5/d11/d17/d1b/d74/fb4 [378952,122985] 0 2024-03-19T06:05:37.865 INFO:tasks.workunit.client.1.smithi172.stdout:9/593: chown d1/d7/dc/d47/d78/d54/d91/cc1 3 1 2024-03-19T06:05:37.866 INFO:tasks.workunit.client.1.smithi172.stdout:6/709: fdatasync d5/d8f/d31/d3d/d98/db6/dc7/dd1/fd8 0 2024-03-19T06:05:37.869 INFO:tasks.workunit.client.1.smithi172.stdout:9/594: chown d1/d7/dc/de/d34/d48 61 1 2024-03-19T06:05:37.871 INFO:tasks.workunit.client.1.smithi172.stdout:3/633: getdents d0/db0/db6/dc7 0 2024-03-19T06:05:37.880 INFO:tasks.workunit.client.1.smithi172.stdout:3/634: creat d0/da8/dce/da7/fdb x:0 0 0 2024-03-19T06:05:37.881 INFO:tasks.workunit.client.1.smithi172.stdout:9/595: unlink d1/d7/dc/d47/d78/d54/d91/l3e 0 2024-03-19T06:05:37.883 INFO:tasks.workunit.client.1.smithi172.stdout:6/710: unlink d5/d8f/d31/d3d/d98/dac/cc6 0 2024-03-19T06:05:37.887 INFO:tasks.workunit.client.1.smithi172.stdout:9/596: read d1/fa [639647,77209] 0 2024-03-19T06:05:37.889 INFO:tasks.workunit.client.1.smithi172.stdout:6/711: fdatasync d5/d11/d17/d36/d48/f7d 0 2024-03-19T06:05:37.893 INFO:tasks.workunit.client.1.smithi172.stdout:9/597: read - d1/d7/dc/d47/d78/d54/fc8 zero size 2024-03-19T06:05:37.896 INFO:tasks.workunit.client.1.smithi172.stdout:0/658: truncate d11/d14/d2c/d4e/f64 1887312 0 2024-03-19T06:05:37.899 INFO:tasks.workunit.client.1.smithi172.stdout:7/557: write d0/d22/d1d/d85/fbd [1408645,670] 0 2024-03-19T06:05:37.900 INFO:tasks.workunit.client.1.smithi172.stdout:8/561: dwrite d0/d44/d46/d49/d26/d71/d81/d27/f1e [0,4194304] 0 2024-03-19T06:05:37.903 INFO:tasks.workunit.client.1.smithi172.stdout:9/598: chown d1/d7/dc/d47/d78/d54/d91/c87 13 1 2024-03-19T06:05:37.904 INFO:tasks.workunit.client.1.smithi172.stdout:0/659: fdatasync d11/d18/d38/d3f/d43/d62/dc0/fe0 0 2024-03-19T06:05:37.912 INFO:tasks.workunit.client.1.smithi172.stdout:7/558: creat d0/d22/d4b/fc0 x:0 0 0 2024-03-19T06:05:37.913 INFO:tasks.workunit.client.1.smithi172.stdout:3/635: dwrite d0/da8/d34/d4d/f2e [0,4194304] 0 2024-03-19T06:05:37.917 INFO:tasks.workunit.client.1.smithi172.stdout:3/636: read d0/da8/d54/d77/fac [2549829,56674] 0 2024-03-19T06:05:37.918 INFO:tasks.workunit.client.1.smithi172.stdout:8/562: rename d0/d44/d46/d49/d26/c53 to d0/cb5 0 2024-03-19T06:05:37.920 INFO:tasks.workunit.client.1.smithi172.stdout:9/599: creat d1/d7/dc/d47/fd0 x:0 0 0 2024-03-19T06:05:37.925 INFO:tasks.workunit.client.1.smithi172.stdout:9/600: symlink d1/d7/dc/dbe/d65/ld1 0 2024-03-19T06:05:37.928 INFO:tasks.workunit.client.1.smithi172.stdout:3/637: creat d0/da8/d54/fdc x:0 0 0 2024-03-19T06:05:37.929 INFO:tasks.workunit.client.1.smithi172.stdout:9/601: creat d1/d7/dc/de/d34/d48/fd2 x:0 0 0 2024-03-19T06:05:37.932 INFO:tasks.workunit.client.1.smithi172.stdout:3/638: mknod d0/da8/d54/d90/cdd 0 2024-03-19T06:05:37.933 INFO:tasks.workunit.client.1.smithi172.stdout:7/559: dread d0/d22/d1d/d36/d40/f4e [4194304,4194304] 0 2024-03-19T06:05:37.936 INFO:tasks.workunit.client.1.smithi172.stdout:9/602: mknod d1/d7/dc/dbe/dc9/cd3 0 2024-03-19T06:05:37.939 INFO:tasks.workunit.client.1.smithi172.stdout:9/603: fsync d1/d7/dc/dbe/f33 0 2024-03-19T06:05:37.939 INFO:tasks.workunit.client.1.smithi172.stdout:3/639: mkdir d0/da8/d34/dde 0 2024-03-19T06:05:37.941 INFO:tasks.workunit.client.1.smithi172.stdout:6/712: dread d5/d11/fab [0,4194304] 0 2024-03-19T06:05:37.942 INFO:tasks.workunit.client.1.smithi172.stdout:9/604: unlink d1/d7/dc/de/c17 0 2024-03-19T06:05:37.947 INFO:tasks.workunit.client.1.smithi172.stdout:9/605: mkdir d1/d7/dd4 0 2024-03-19T06:05:37.953 INFO:tasks.workunit.client.1.smithi172.stdout:8/563: dwrite d0/f58 [0,4194304] 0 2024-03-19T06:05:37.958 INFO:tasks.workunit.client.1.smithi172.stdout:7/560: dwrite d0/d22/d3d/d41/f87 [0,4194304] 0 2024-03-19T06:05:37.962 INFO:tasks.workunit.client.1.smithi172.stdout:8/564: write d0/d44/f7a [1109337,53346] 0 2024-03-19T06:05:37.963 INFO:tasks.workunit.client.1.smithi172.stdout:9/606: getdents d1/d7/dc/de/d34/d48/d82/d92/d95 0 2024-03-19T06:05:37.964 INFO:tasks.workunit.client.1.smithi172.stdout:3/640: dwrite d0/da8/dce/fb8 [0,4194304] 0 2024-03-19T06:05:37.975 INFO:tasks.workunit.client.1.smithi172.stdout:3/641: rename d0/d5/d6b/fca to d0/fdf 0 2024-03-19T06:05:37.977 INFO:tasks.workunit.client.1.smithi172.stdout:6/713: dwrite d5/d8f/d31/d3d/d98/db6/f42 [0,4194304] 0 2024-03-19T06:05:37.982 INFO:tasks.workunit.client.1.smithi172.stdout:3/642: unlink d0/da8/d54/d77/fb7 0 2024-03-19T06:05:37.983 INFO:tasks.workunit.client.1.smithi172.stdout:3/643: chown d0/da8/d60 30898 1 2024-03-19T06:05:37.984 INFO:tasks.workunit.client.1.smithi172.stdout:3/644: dread - d0/fdf zero size 2024-03-19T06:05:37.985 INFO:tasks.workunit.client.1.smithi172.stdout:9/607: dwrite d1/f28 [0,4194304] 0 2024-03-19T06:05:37.987 INFO:tasks.workunit.client.1.smithi172.stdout:6/714: fsync d5/d8f/d31/d3d/d98/db6/d40/d53/d75/fb1 0 2024-03-19T06:05:37.991 INFO:tasks.workunit.client.1.smithi172.stdout:9/608: creat d1/d7/dc/d47/d78/d54/fd5 x:0 0 0 2024-03-19T06:05:37.991 INFO:tasks.workunit.client.1.smithi172.stdout:3/645: truncate d0/da8/d60/d67/f73 1914810 0 2024-03-19T06:05:37.993 INFO:tasks.workunit.client.1.smithi172.stdout:6/715: fsync d5/d11/d17/d36/d48/fa8 0 2024-03-19T06:05:38.003 INFO:tasks.workunit.client.1.smithi172.stdout:9/609: symlink d1/d7/dc/de/d34/d48/d89/ld6 0 2024-03-19T06:05:38.010 INFO:tasks.workunit.client.1.smithi172.stdout:9/610: mkdir d1/d7/dc/de/d34/dd7 0 2024-03-19T06:05:38.013 INFO:tasks.workunit.client.1.smithi172.stdout:9/611: write d1/d7/dc/f14 [3779700,86478] 0 2024-03-19T06:05:38.015 INFO:tasks.workunit.client.1.smithi172.stdout:3/646: dwrite d0/d5/d6b/dae/d88/fbd [0,4194304] 0 2024-03-19T06:05:38.019 INFO:tasks.workunit.client.1.smithi172.stdout:7/561: dread d0/d22/d1d/d36/d56/f6c [0,4194304] 0 2024-03-19T06:05:38.023 INFO:tasks.workunit.client.1.smithi172.stdout:3/647: mkdir d0/db0/db6/dc7/de0 0 2024-03-19T06:05:38.023 INFO:tasks.workunit.client.1.smithi172.stdout:8/565: dread d0/d44/d46/d49/f25 [0,4194304] 0 2024-03-19T06:05:38.026 INFO:tasks.workunit.client.1.smithi172.stdout:7/562: mknod d0/d22/d1d/d36/d56/cc1 0 2024-03-19T06:05:38.026 INFO:tasks.workunit.client.1.smithi172.stdout:6/716: dwrite d5/d8f/d31/f89 [0,4194304] 0 2024-03-19T06:05:38.026 INFO:tasks.workunit.client.1.smithi172.stdout:8/566: chown d0/d44/d46/d49/la7 6 1 2024-03-19T06:05:38.031 INFO:tasks.workunit.client.1.smithi172.stdout:6/717: fdatasync d5/d11/d43/fb9 0 2024-03-19T06:05:38.035 INFO:tasks.workunit.client.1.smithi172.stdout:7/563: rmdir d0/d22/d1d/d36/d8d/d7d 39 2024-03-19T06:05:38.036 INFO:tasks.workunit.client.1.smithi172.stdout:9/612: dwrite d1/d7/dc/de/d34/d48/fd2 [0,4194304] 0 2024-03-19T06:05:38.037 INFO:tasks.workunit.client.1.smithi172.stdout:7/564: chown d0/d22/d1d/d36/d56/c76 358272 1 2024-03-19T06:05:38.039 INFO:tasks.workunit.client.1.smithi172.stdout:7/565: fdatasync d0/d22/d1d/d36/f1f 0 2024-03-19T06:05:38.041 INFO:tasks.workunit.client.1.smithi172.stdout:8/567: creat d0/fb6 x:0 0 0 2024-03-19T06:05:38.042 INFO:tasks.workunit.client.1.smithi172.stdout:6/718: creat d5/d8f/d31/d3d/d98/db6/d40/d53/d75/dd3/fe2 x:0 0 0 2024-03-19T06:05:38.044 INFO:tasks.workunit.client.1.smithi172.stdout:9/613: rename d1/f67 to d1/d7/dc/dbe/fd8 0 2024-03-19T06:05:38.045 INFO:tasks.workunit.client.1.smithi172.stdout:6/719: read d5/d8f/d31/d3d/d98/db6/d40/d53/d75/f81 [4277279,24920] 0 2024-03-19T06:05:38.049 INFO:tasks.workunit.client.1.smithi172.stdout:8/568: mknod d0/d61/d6a/d9f/cb7 0 2024-03-19T06:05:38.052 INFO:tasks.workunit.client.1.smithi172.stdout:6/720: rmdir d5/d11/d43/da6/dd9 39 2024-03-19T06:05:38.053 INFO:tasks.workunit.client.1.smithi172.stdout:7/566: dread d0/d22/d1d/d36/d56/f6c [0,4194304] 0 2024-03-19T06:05:38.054 INFO:tasks.workunit.client.1.smithi172.stdout:6/721: stat d5/d8f/d31/d3d/f54 0 2024-03-19T06:05:38.059 INFO:tasks.workunit.client.1.smithi172.stdout:8/569: symlink d0/d6f/lb8 0 2024-03-19T06:05:38.067 INFO:tasks.workunit.client.1.smithi172.stdout:1/620: fsync da/dd/d31/d47/fd3 0 2024-03-19T06:05:38.069 INFO:tasks.workunit.client.1.smithi172.stdout:7/567: write d0/d22/f6d [3977981,48056] 0 2024-03-19T06:05:38.072 INFO:tasks.workunit.client.1.smithi172.stdout:8/570: getdents d0/d44 0 2024-03-19T06:05:38.074 INFO:tasks.workunit.client.1.smithi172.stdout:7/568: creat d0/d22/d3d/d41/fc2 x:0 0 0 2024-03-19T06:05:38.075 INFO:tasks.workunit.client.1.smithi172.stdout:1/621: write da/dd/d10/f2f [5324271,100333] 0 2024-03-19T06:05:38.080 INFO:tasks.workunit.client.1.smithi172.stdout:9/614: dread d1/d7/dc/d47/d78/d54/d91/f35 [0,4194304] 0 2024-03-19T06:05:38.080 INFO:tasks.workunit.client.1.smithi172.stdout:1/622: chown da/dd/d10/d14/d27/d53/l6c 84 1 2024-03-19T06:05:38.082 INFO:tasks.workunit.client.1.smithi172.stdout:6/722: dwrite d5/d8f/d31/d3d/d98/db6/d40/d53/d75/f81 [0,4194304] 0 2024-03-19T06:05:38.082 INFO:tasks.workunit.client.1.smithi172.stdout:7/569: write d0/d22/d1d/d36/f39 [8944165,76985] 0 2024-03-19T06:05:38.084 INFO:tasks.workunit.client.1.smithi172.stdout:1/623: unlink da/d33/d4e/lb4 0 2024-03-19T06:05:38.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.096+0000 7fa993600700 1 -- 172.21.15.72:0/3718879187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa98c0ff130 msgr2=0x7fa98c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:38.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.096+0000 7fa993600700 1 --2- 172.21.15.72:0/3718879187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa98c0ff130 0x7fa98c0ff540 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa980009910 tx=0x7fa980009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:38.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.096+0000 7fa993600700 1 -- 172.21.15.72:0/3718879187 shutdown_connections 2024-03-19T06:05:38.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.096+0000 7fa993600700 1 --2- 172.21.15.72:0/3718879187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98c1003d0 0x7fa98c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:38.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.096+0000 7fa993600700 1 --2- 172.21.15.72:0/3718879187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa98c0ff130 0x7fa98c0ff540 secure :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa980009910 tx=0x7fa980009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:38.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.096+0000 7fa993600700 1 -- 172.21.15.72:0/3718879187 >> 172.21.15.72:0/3718879187 conn(0x7fa98c0fa780 msgr2=0x7fa98c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:38.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.098+0000 7fa993600700 1 -- 172.21.15.72:0/3718879187 shutdown_connections 2024-03-19T06:05:38.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.098+0000 7fa993600700 1 -- 172.21.15.72:0/3718879187 wait complete. 2024-03-19T06:05:38.091 INFO:tasks.workunit.client.1.smithi172.stdout:1/624: dread da/d33/f75 [0,4194304] 0 2024-03-19T06:05:38.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.100+0000 7fa993600700 1 Processor -- start 2024-03-19T06:05:38.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.100+0000 7fa993600700 1 -- start start 2024-03-19T06:05:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.101+0000 7fa993600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98c1003d0 0x7fa98c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.101+0000 7fa993600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa98c198410 0x7fa98c19d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.101+0000 7fa993600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c198910 con 0x7fa98c198410 2024-03-19T06:05:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.101+0000 7fa993600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c198a80 con 0x7fa98c1003d0 2024-03-19T06:05:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.101+0000 7fa98be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa98c198410 0x7fa98c19d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.101+0000 7fa990c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98c1003d0 0x7fa98c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.102+0000 7fa990c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98c1003d0 0x7fa98c197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:36646/0 (socket says 172.21.15.72:36646) 2024-03-19T06:05:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.102+0000 7fa98be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa98c198410 0x7fa98c19d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54398/0 (socket says 172.21.15.72:54398) 2024-03-19T06:05:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.102+0000 7fa990c00700 1 -- 172.21.15.72:0/2069011149 learned_addr learned my addr 172.21.15.72:0/2069011149 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:38.093 INFO:tasks.workunit.client.1.smithi172.stdout:6/723: link d5/d8f/c4f d5/d8f/d31/d3d/d98/dad/ce3 0 2024-03-19T06:05:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.103+0000 7fa990c00700 1 -- 172.21.15.72:0/2069011149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa98c198410 msgr2=0x7fa98c19d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:38.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.103+0000 7fa990c00700 1 --2- 172.21.15.72:0/2069011149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa98c198410 0x7fa98c19d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:38.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.103+0000 7fa990c00700 1 -- 172.21.15.72:0/2069011149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9800095f0 con 0x7fa98c1003d0 2024-03-19T06:05:38.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.104+0000 7fa990c00700 1 --2- 172.21.15.72:0/2069011149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98c1003d0 0x7fa98c197ed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa980015000 tx=0x7fa98000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.104+0000 7fa989600700 1 -- 172.21.15.72:0/2069011149 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa98001d070 con 0x7fa98c1003d0 2024-03-19T06:05:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.104+0000 7fa989600700 1 -- 172.21.15.72:0/2069011149 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa980005dc0 con 0x7fa98c1003d0 2024-03-19T06:05:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.104+0000 7fa989600700 1 -- 172.21.15.72:0/2069011149 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa980017400 con 0x7fa98c1003d0 2024-03-19T06:05:38.095 INFO:tasks.workunit.client.1.smithi172.stdout:1/625: write da/dd/d10/d14/d27/d53/f71 [919622,112040] 0 2024-03-19T06:05:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.106+0000 7fa993600700 1 -- 172.21.15.72:0/2069011149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c19d9c0 con 0x7fa98c1003d0 2024-03-19T06:05:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.106+0000 7fa993600700 1 -- 172.21.15.72:0/2069011149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c19de80 con 0x7fa98c1003d0 2024-03-19T06:05:38.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.108+0000 7fa993600700 1 -- 172.21.15.72:0/2069011149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c106ae0 con 0x7fa98c1003d0 2024-03-19T06:05:38.100 INFO:tasks.workunit.client.1.smithi172.stdout:6/724: dread - d5/d11/d17/d36/d48/fdd zero size 2024-03-19T06:05:38.102 INFO:tasks.workunit.client.1.smithi172.stdout:6/725: fdatasync d5/d8f/f6b 0 2024-03-19T06:05:38.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.112+0000 7fa989600700 1 -- 172.21.15.72:0/2069011149 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7fa980003810 con 0x7fa98c1003d0 2024-03-19T06:05:38.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.113+0000 7fa989600700 1 --2- 172.21.15.72:0/2069011149 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fa97406dd50 0x7fa974070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.113+0000 7fa989600700 1 -- 172.21.15.72:0/2069011149 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa98008ee60 con 0x7fa98c1003d0 2024-03-19T06:05:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.113+0000 7fa98be00700 1 --2- 172.21.15.72:0/2069011149 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fa97406dd50 0x7fa974070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:38.105 INFO:tasks.workunit.client.1.smithi172.stdout:6/726: write d5/d8f/d31/d3d/d98/db6/f42 [4678650,73819] 0 2024-03-19T06:05:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.115+0000 7fa98be00700 1 --2- 172.21.15.72:0/2069011149 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fa97406dd50 0x7fa974070200 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa978009c60 tx=0x7fa978009260 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:38.107 INFO:tasks.workunit.client.1.smithi172.stdout:7/570: dwrite d0/d22/d3d/d41/f87 [4194304,4194304] 0 2024-03-19T06:05:38.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.120+0000 7fa989600700 1 -- 172.21.15.72:0/2069011149 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fa9800bcf10 con 0x7fa98c1003d0 2024-03-19T06:05:38.113 INFO:tasks.workunit.client.1.smithi172.stdout:8/571: dread d0/d61/d6a/d7e/f7f [0,4194304] 0 2024-03-19T06:05:38.117 INFO:tasks.workunit.client.1.smithi172.stdout:8/572: rmdir d0/d64 39 2024-03-19T06:05:38.120 INFO:tasks.workunit.client.1.smithi172.stdout:8/573: fdatasync d0/d64/d80/f45 0 2024-03-19T06:05:38.121 INFO:tasks.workunit.client.1.smithi172.stdout:8/574: chown d0/d44/l8f 470255683 1 2024-03-19T06:05:38.134 INFO:tasks.workunit.client.1.smithi172.stdout:8/575: dwrite d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c/fb2 [0,4194304] 0 2024-03-19T06:05:38.137 INFO:tasks.workunit.client.1.smithi172.stdout:8/576: readlink d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/la8 0 2024-03-19T06:05:38.247 INFO:tasks.workunit.client.1.smithi172.stdout:1/626: creat da/d33/d59/d90/fd5 x:0 0 0 2024-03-19T06:05:38.248 INFO:tasks.workunit.client.1.smithi172.stdout:9/615: write d1/d7/dc/d47/d78/f7e [48761,52984] 0 2024-03-19T06:05:38.250 INFO:tasks.workunit.client.1.smithi172.stdout:6/727: rmdir d5/d8f 39 2024-03-19T06:05:38.254 INFO:tasks.workunit.client.1.smithi172.stdout:7/571: write d0/d22/d1d/d3a/d46/f7a [23877,37195] 0 2024-03-19T06:05:38.258 INFO:tasks.workunit.client.1.smithi172.stdout:9/616: fdatasync d1/d7/dc/de/d34/d48/d89/f98 0 2024-03-19T06:05:38.260 INFO:tasks.workunit.client.1.smithi172.stdout:8/577: write d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/f69 [780801,101251] 0 2024-03-19T06:05:38.261 INFO:tasks.workunit.client.1.smithi172.stdout:9/617: chown d1/d7/dc/d47/cb8 3 1 2024-03-19T06:05:38.262 INFO:tasks.workunit.client.1.smithi172.stdout:7/572: creat d0/d22/d1d/d36/d8d/d5c/d67/fc3 x:0 0 0 2024-03-19T06:05:38.263 INFO:tasks.workunit.client.1.smithi172.stdout:6/728: write d5/f5f [783320,38848] 0 2024-03-19T06:05:38.265 INFO:tasks.workunit.client.1.smithi172.stdout:8/578: rmdir d0/d44/d46/d49/d3a/d3d 39 2024-03-19T06:05:38.265 INFO:tasks.workunit.client.1.smithi172.stdout:1/627: rename da/dd/d10/fb8 to da/fd6 0 2024-03-19T06:05:38.267 INFO:tasks.workunit.client.1.smithi172.stdout:9/618: creat d1/db9/fd9 x:0 0 0 2024-03-19T06:05:38.270 INFO:tasks.workunit.client.1.smithi172.stdout:7/573: symlink d0/d22/d27/db0/lc4 0 2024-03-19T06:05:38.276 INFO:tasks.workunit.client.1.smithi172.stdout:9/619: creat d1/d7/dc/dbe/dc9/fda x:0 0 0 2024-03-19T06:05:38.278 INFO:tasks.workunit.client.1.smithi172.stdout:1/628: chown da/dd/d10/c18 3888 1 2024-03-19T06:05:38.283 INFO:tasks.workunit.client.1.smithi172.stdout:6/729: write d5/d11/d17/f93 [249484,1705] 0 2024-03-19T06:05:38.286 INFO:tasks.workunit.client.1.smithi172.stdout:9/620: symlink d1/d7/dc/d47/d78/d54/d91/ldb 0 2024-03-19T06:05:38.288 INFO:tasks.workunit.client.1.smithi172.stdout:7/574: creat d0/fc5 x:0 0 0 2024-03-19T06:05:38.290 INFO:tasks.workunit.client.1.smithi172.stdout:1/629: truncate da/f5f 484325 0 2024-03-19T06:05:38.297 INFO:tasks.workunit.client.1.smithi172.stdout:8/579: dwrite d0/f1f [0,4194304] 0 2024-03-19T06:05:38.301 INFO:tasks.workunit.client.1.smithi172.stdout:8/580: chown d0/d61/d6a/c91 157302 1 2024-03-19T06:05:38.306 INFO:tasks.workunit.client.1.smithi172.stdout:8/581: dread - d0/fb6 zero size 2024-03-19T06:05:38.306 INFO:tasks.workunit.client.1.smithi172.stdout:5/562: sync 2024-03-19T06:05:38.313 INFO:tasks.workunit.client.1.smithi172.stdout:1/630: link da/dd/d10/d14/d27/f37 da/dd/d10/d14/d27/d3f/d5e/fd7 0 2024-03-19T06:05:38.316 INFO:tasks.workunit.client.1.smithi172.stdout:7/575: dread d0/d22/d1d/f7b [0,4194304] 0 2024-03-19T06:05:38.319 INFO:tasks.workunit.client.1.smithi172.stdout:7/576: fdatasync d0/d22/f6d 0 2024-03-19T06:05:38.319 INFO:tasks.workunit.client.1.smithi172.stdout:5/563: truncate d5/f27 1646063 0 2024-03-19T06:05:38.321 INFO:tasks.workunit.client.1.smithi172.stdout:6/730: dwrite d5/d8f/d31/d3d/d98/db6/f42 [0,4194304] 0 2024-03-19T06:05:38.330 INFO:tasks.workunit.client.1.smithi172.stdout:7/577: mkdir d0/d22/d1d/d36/d56/dc6 0 2024-03-19T06:05:38.331 INFO:tasks.workunit.client.1.smithi172.stdout:5/564: symlink d5/d14/lc0 0 2024-03-19T06:05:38.332 INFO:tasks.workunit.client.1.smithi172.stdout:7/578: chown d0/d22/d4b 409 1 2024-03-19T06:05:38.333 INFO:tasks.workunit.client.1.smithi172.stdout:6/731: symlink d5/d8f/ddf/le4 0 2024-03-19T06:05:38.336 INFO:tasks.workunit.client.1.smithi172.stdout:7/579: dread - d0/d22/d27/db0/fad zero size 2024-03-19T06:05:38.336 INFO:tasks.workunit.client.1.smithi172.stdout:1/631: dread da/dd/d10/d36/f38 [0,4194304] 0 2024-03-19T06:05:38.337 INFO:tasks.workunit.client.1.smithi172.stdout:6/732: creat d5/d11/d2f/fe5 x:0 0 0 2024-03-19T06:05:38.340 INFO:tasks.workunit.client.1.smithi172.stdout:6/733: chown d5/lbf 2 1 2024-03-19T06:05:38.341 INFO:tasks.workunit.client.1.smithi172.stdout:7/580: truncate d0/d22/fb9 915765 0 2024-03-19T06:05:38.342 INFO:tasks.workunit.client.1.smithi172.stdout:1/632: fdatasync da/dd/d10/d14/d27/f93 0 2024-03-19T06:05:38.343 INFO:tasks.workunit.client.1.smithi172.stdout:7/581: dread - d0/d22/d4b/fb3 zero size 2024-03-19T06:05:38.351 INFO:tasks.workunit.client.1.smithi172.stdout:1/633: write da/d33/d59/fb9 [914524,101299] 0 2024-03-19T06:05:38.353 INFO:tasks.workunit.client.1.smithi172.stdout:7/582: getdents d0/d22/d27 0 2024-03-19T06:05:38.355 INFO:tasks.workunit.client.1.smithi172.stdout:8/582: dread d0/d44/d46/d49/d26/d71/d81/d8e/f47 [0,4194304] 0 2024-03-19T06:05:38.357 INFO:tasks.workunit.client.1.smithi172.stdout:1/634: fdatasync da/dd/d10/f64 0 2024-03-19T06:05:38.358 INFO:tasks.workunit.client.1.smithi172.stdout:7/583: chown d0/d22/d1d/f7b 69482 1 2024-03-19T06:05:38.365 INFO:tasks.workunit.client.1.smithi172.stdout:8/583: write d0/d44/d46/d49/d26/f48 [1683791,108768] 0 2024-03-19T06:05:38.366 INFO:tasks.workunit.client.1.smithi172.stdout:1/635: unlink da/d3b/f80 0 2024-03-19T06:05:38.370 INFO:tasks.workunit.client.1.smithi172.stdout:1/636: unlink da/dd/d10/c18 0 2024-03-19T06:05:38.375 INFO:tasks.workunit.client.1.smithi172.stdout:8/584: fdatasync d0/d44/d46/d49/d26/d71/d81/f4a 0 2024-03-19T06:05:38.376 INFO:tasks.workunit.client.1.smithi172.stdout:5/565: dread d5/f27 [0,4194304] 0 2024-03-19T06:05:38.377 INFO:tasks.workunit.client.1.smithi172.stdout:1/637: creat da/d33/d59/dc1/fd8 x:0 0 0 2024-03-19T06:05:38.378 INFO:tasks.workunit.client.1.smithi172.stdout:8/585: write d0/d61/d6a/f93 [3530640,92102] 0 2024-03-19T06:05:38.379 INFO:tasks.workunit.client.1.smithi172.stdout:5/566: read - d5/d14/d15/d40/d5c/fb7 zero size 2024-03-19T06:05:38.381 INFO:tasks.workunit.client.1.smithi172.stdout:6/734: dread d5/d8f/fdc [0,4194304] 0 2024-03-19T06:05:38.385 INFO:tasks.workunit.client.1.smithi172.stdout:7/584: dwrite d0/d22/d27/d86/fa1 [0,4194304] 0 2024-03-19T06:05:38.385 INFO:tasks.workunit.client.1.smithi172.stdout:5/567: creat d5/d14/d34/fc1 x:0 0 0 2024-03-19T06:05:38.391 INFO:tasks.workunit.client.1.smithi172.stdout:7/585: readlink d0/d22/d1d/d36/l12 0 2024-03-19T06:05:38.392 INFO:tasks.workunit.client.1.smithi172.stdout:5/568: symlink d5/d14/d34/lc2 0 2024-03-19T06:05:38.395 INFO:tasks.workunit.client.1.smithi172.stdout:7/586: read d0/d22/d1d/d36/d40/da2/faf [1832364,36224] 0 2024-03-19T06:05:38.396 INFO:tasks.workunit.client.1.smithi172.stdout:5/569: chown d5/d14/d34/f52 1836216181 1 2024-03-19T06:05:38.396 INFO:tasks.workunit.client.1.smithi172.stdout:6/735: rename d5/d11/d43/d45/da1/cd4 to d5/d11/d17/d36/dca/ce6 0 2024-03-19T06:05:38.402 INFO:tasks.workunit.client.1.smithi172.stdout:5/570: unlink d5/c70 0 2024-03-19T06:05:38.404 INFO:tasks.workunit.client.1.smithi172.stdout:7/587: dread d0/d22/d27/db0/f2f [0,4194304] 0 2024-03-19T06:05:38.404 INFO:tasks.workunit.client.1.smithi172.stdout:1/638: dwrite da/d3b/f83 [0,4194304] 0 2024-03-19T06:05:38.405 INFO:tasks.workunit.client.1.smithi172.stdout:5/571: mknod d5/d55/cc3 0 2024-03-19T06:05:38.406 INFO:tasks.workunit.client.1.smithi172.stdout:1/639: chown da/dd/f1f 289 1 2024-03-19T06:05:38.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.416+0000 7fa993600700 1 -- 172.21.15.72:0/2069011149 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa98c104ea0 con 0x7fa97406dd50 2024-03-19T06:05:38.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.419+0000 7fa989600700 1 -- 172.21.15.72:0/2069011149 <== mgr.14702 v2:172.21.15.72:6800/2640845307 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fa98c104ea0 con 0x7fa97406dd50 2024-03-19T06:05:38.412 INFO:tasks.workunit.client.1.smithi172.stdout:5/572: chown d5/l89 51 1 2024-03-19T06:05:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.423+0000 7fa993600700 1 -- 172.21.15.72:0/2069011149 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fa97406dd50 msgr2=0x7fa974070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.423+0000 7fa993600700 1 --2- 172.21.15.72:0/2069011149 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fa97406dd50 0x7fa974070200 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa978009c60 tx=0x7fa978009260 comp rx=0 tx=0).stop 2024-03-19T06:05:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.423+0000 7fa993600700 1 -- 172.21.15.72:0/2069011149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98c1003d0 msgr2=0x7fa98c197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.423+0000 7fa993600700 1 --2- 172.21.15.72:0/2069011149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98c1003d0 0x7fa98c197ed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa980015000 tx=0x7fa98000f690 comp rx=0 tx=0).stop 2024-03-19T06:05:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.424+0000 7fa993600700 1 -- 172.21.15.72:0/2069011149 shutdown_connections 2024-03-19T06:05:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.424+0000 7fa993600700 1 --2- 172.21.15.72:0/2069011149 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fa97406dd50 0x7fa974070200 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.424+0000 7fa993600700 1 --2- 172.21.15.72:0/2069011149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa98c1003d0 0x7fa98c197ed0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.424+0000 7fa993600700 1 --2- 172.21.15.72:0/2069011149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa98c198410 0x7fa98c19d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.424+0000 7fa993600700 1 -- 172.21.15.72:0/2069011149 >> 172.21.15.72:0/2069011149 conn(0x7fa98c0fa780 msgr2=0x7fa98c0fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.424+0000 7fa993600700 1 -- 172.21.15.72:0/2069011149 shutdown_connections 2024-03-19T06:05:38.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.424+0000 7fa993600700 1 -- 172.21.15.72:0/2069011149 wait complete. 2024-03-19T06:05:38.417 INFO:tasks.workunit.client.1.smithi172.stdout:1/640: rename da/dd/ccb to da/dd/d10/d14/d84/d9b/cd9 0 2024-03-19T06:05:38.417 INFO:tasks.workunit.client.1.smithi172.stdout:5/573: creat d5/d3c/d6c/dbd/fc4 x:0 0 0 2024-03-19T06:05:38.418 INFO:tasks.workunit.client.1.smithi172.stdout:8/586: dread d0/d44/d46/d49/d26/d71/f9e [0,4194304] 0 2024-03-19T06:05:38.424 INFO:tasks.workunit.client.1.smithi172.stdout:7/588: dwrite d0/d22/d1d/d36/f1f [4194304,4194304] 0 2024-03-19T06:05:38.428 INFO:tasks.workunit.client.1.smithi172.stdout:8/587: truncate d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d9c/fa9 756540 0 2024-03-19T06:05:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:05:38.436 INFO:tasks.workunit.client.1.smithi172.stdout:8/588: truncate d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c/f9a 536553 0 2024-03-19T06:05:38.440 INFO:tasks.workunit.client.1.smithi172.stdout:6/736: dread d5/d11/d17/d36/d48/f7d [0,4194304] 0 2024-03-19T06:05:38.444 INFO:tasks.workunit.client.1.smithi172.stdout:8/589: getdents d0/d61 0 2024-03-19T06:05:38.448 INFO:tasks.workunit.client.1.smithi172.stdout:7/589: dwrite d0/d22/d1d/d36/d40/f93 [0,4194304] 0 2024-03-19T06:05:38.450 INFO:tasks.workunit.client.1.smithi172.stdout:0/660: sync 2024-03-19T06:05:38.450 INFO:tasks.workunit.client.1.smithi172.stdout:2/592: sync 2024-03-19T06:05:38.450 INFO:tasks.workunit.client.1.smithi172.stdout:4/686: sync 2024-03-19T06:05:38.451 INFO:tasks.workunit.client.1.smithi172.stdout:8/590: creat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/fb9 x:0 0 0 2024-03-19T06:05:38.452 INFO:tasks.workunit.client.1.smithi172.stdout:7/590: mkdir d0/d22/d35/dc7 0 2024-03-19T06:05:38.453 INFO:tasks.workunit.client.1.smithi172.stdout:6/737: getdents d5/d11/d43/da6/dd9 0 2024-03-19T06:05:38.455 INFO:tasks.workunit.client.1.smithi172.stdout:6/738: write d5/d8f/d31/f60 [391144,49737] 0 2024-03-19T06:05:38.464 INFO:tasks.workunit.client.1.smithi172.stdout:7/591: mkdir d0/d22/d1d/dc8 0 2024-03-19T06:05:38.465 INFO:tasks.workunit.client.1.smithi172.stdout:6/739: mknod d5/d11/d43/d45/da1/ce7 0 2024-03-19T06:05:38.466 INFO:tasks.workunit.client.1.smithi172.stdout:1/641: link da/dd/d10/d14/d73/d8b/lb5 da/d3b/lda 0 2024-03-19T06:05:38.467 INFO:tasks.workunit.client.1.smithi172.stdout:7/592: chown d0/l53 192801039 1 2024-03-19T06:05:38.468 INFO:tasks.workunit.client.1.smithi172.stdout:0/661: rename d11/d22/d46/d84/fc4 to d11/d22/d32/daf/fe2 0 2024-03-19T06:05:38.471 INFO:tasks.workunit.client.1.smithi172.stdout:8/591: getdents d0/d44/d46/d49/d26/d71 0 2024-03-19T06:05:38.473 INFO:tasks.workunit.client.1.smithi172.stdout:1/642: fsync da/dd/d10/f1d 0 2024-03-19T06:05:38.474 INFO:tasks.workunit.client.1.smithi172.stdout:2/593: dwrite d7/db/f73 [0,4194304] 0 2024-03-19T06:05:38.477 INFO:tasks.workunit.client.1.smithi172.stdout:7/593: creat d0/d22/d1d/dc8/fc9 x:0 0 0 2024-03-19T06:05:38.477 INFO:tasks.workunit.client.1.smithi172.stdout:0/662: dread - d11/d18/d38/d3f/d43/d62/dc0/fe0 zero size 2024-03-19T06:05:38.480 INFO:tasks.workunit.client.1.smithi172.stdout:8/592: write d0/d44/d46/d49/d26/d71/d81/d8e/f47 [5391167,5151] 0 2024-03-19T06:05:38.483 INFO:tasks.workunit.client.1.smithi172.stdout:1/643: mkdir da/d3b/dcd/ddb 0 2024-03-19T06:05:38.483 INFO:tasks.workunit.client.1.smithi172.stdout:2/594: dread - d7/de/d58/d55/da8/f75 zero size 2024-03-19T06:05:38.486 INFO:tasks.workunit.client.1.smithi172.stdout:4/687: dread df/d11/d12/d34/f4e [0,4194304] 0 2024-03-19T06:05:38.491 INFO:tasks.workunit.client.1.smithi172.stdout:1/644: symlink da/d3b/dcd/ddb/ldc 0 2024-03-19T06:05:38.497 INFO:tasks.workunit.client.1.smithi172.stdout:8/593: write d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/fa5 [831518,8976] 0 2024-03-19T06:05:38.498 INFO:tasks.workunit.client.1.smithi172.stdout:4/688: mknod df/d45/ce1 0 2024-03-19T06:05:38.498 INFO:tasks.workunit.client.1.smithi172.stdout:2/595: read d7/de/d58/d56/f2b [1913662,122399] 0 2024-03-19T06:05:38.505 INFO:tasks.workunit.client.1.smithi172.stdout:1/645: mknod da/dd/d10/d14/d27/da7/cdd 0 2024-03-19T06:05:38.506 INFO:tasks.workunit.client.1.smithi172.stdout:2/596: rmdir d7/de/d58/d55/d66 39 2024-03-19T06:05:38.509 INFO:tasks.workunit.client.1.smithi172.stdout:8/594: dread - d0/d44/d46/d49/d26/f51 zero size 2024-03-19T06:05:38.509 INFO:tasks.workunit.client.1.smithi172.stdout:2/597: chown d7/de/f42 22 1 2024-03-19T06:05:38.514 INFO:tasks.workunit.client.1.smithi172.stdout:0/663: dwrite d11/d18/da5/da8/fac [0,4194304] 0 2024-03-19T06:05:38.514 INFO:tasks.workunit.client.1.smithi172.stdout:4/689: rename df/d45/c52 to df/d11/d12/d21/d50/d63/dbb/dc4/dd3/ce2 0 2024-03-19T06:05:38.516 INFO:tasks.workunit.client.1.smithi172.stdout:7/594: dwrite d0/d22/d1d/f7b [0,4194304] 0 2024-03-19T06:05:38.517 INFO:tasks.workunit.client.1.smithi172.stdout:2/598: read - d7/de/d58/d56/d86/d9d/dab/fb7 zero size 2024-03-19T06:05:38.520 INFO:tasks.workunit.client.1.smithi172.stdout:8/595: creat d0/d44/d46/d49/d26/d71/d81/fba x:0 0 0 2024-03-19T06:05:38.520 INFO:tasks.workunit.client.1.smithi172.stdout:1/646: rename da/d33/d59/d90 to da/dd/d10/d14/d27/d3f/d5e/dab/dde 0 2024-03-19T06:05:38.524 INFO:tasks.workunit.client.1.smithi172.stdout:6/740: dread d5/f37 [0,4194304] 0 2024-03-19T06:05:38.524 INFO:tasks.workunit.client.1.smithi172.stdout:8/596: stat d0/d44/d46/d49/d26/d71 0 2024-03-19T06:05:38.525 INFO:tasks.workunit.client.1.smithi172.stdout:1/647: mkdir da/d3b/ddf 0 2024-03-19T06:05:38.528 INFO:tasks.workunit.client.1.smithi172.stdout:0/664: rename d11/d18/d38/c70 to d11/d14/d2c/dc2/dcf/ce3 0 2024-03-19T06:05:38.532 INFO:tasks.workunit.client.1.smithi172.stdout:2/599: symlink d7/de/d58/d55/d66/dc1/lc5 0 2024-03-19T06:05:38.533 INFO:tasks.workunit.client.1.smithi172.stdout:7/595: getdents d0/d22/d1d/d3a/d6b 0 2024-03-19T06:05:38.536 INFO:tasks.workunit.client.1.smithi172.stdout:7/596: chown d0/d22/d1d/d36/d8d/d5c 0 1 2024-03-19T06:05:38.539 INFO:tasks.workunit.client.1.smithi172.stdout:9/621: sync 2024-03-19T06:05:38.540 INFO:tasks.workunit.client.1.smithi172.stdout:3/648: sync 2024-03-19T06:05:38.540 INFO:tasks.workunit.client.1.smithi172.stdout:0/665: mkdir d11/d4d/dab/dc1/dd9/de4 0 2024-03-19T06:05:38.540 INFO:tasks.workunit.client.1.smithi172.stdout:7/597: readlink d0/d22/d35/d8e/lbb 0 2024-03-19T06:05:38.541 INFO:tasks.workunit.client.1.smithi172.stdout:2/600: mkdir d7/de/d61/dbc/dc6 0 2024-03-19T06:05:38.541 INFO:tasks.workunit.client.1.smithi172.stdout:8/597: link d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/lb1 d0/d44/d46/d49/d3a/d76/lbb 0 2024-03-19T06:05:38.548 INFO:tasks.workunit.client.1.smithi172.stdout:1/648: getdents da/dd/d10/d14/d27/da7 0 2024-03-19T06:05:38.549 INFO:tasks.workunit.client.1.smithi172.stdout:9/622: truncate d1/d7/dc/dbe/dc9/fda 814092 0 2024-03-19T06:05:38.550 INFO:tasks.workunit.client.1.smithi172.stdout:3/649: rename d0/da8/d34/d4d/f49 to d0/da8/d34/d4d/fe1 0 2024-03-19T06:05:38.551 INFO:tasks.workunit.client.1.smithi172.stdout:8/598: mkdir d0/d44/d46/d49/d26/dbc 0 2024-03-19T06:05:38.553 INFO:tasks.workunit.client.1.smithi172.stdout:1/649: chown da/dd/d10/d14/d27/d53/f6b 0 1 2024-03-19T06:05:38.554 INFO:tasks.workunit.client.1.smithi172.stdout:3/650: dread - d0/da8/dce/da7/fdb zero size 2024-03-19T06:05:38.557 INFO:tasks.workunit.client.1.smithi172.stdout:0/666: getdents d11/d18/d38/d3f/d43/d62 0 2024-03-19T06:05:38.557 INFO:tasks.workunit.client.1.smithi172.stdout:6/741: write d5/d8f/d31/f67 [5235147,96954] 0 2024-03-19T06:05:38.558 INFO:tasks.workunit.client.1.smithi172.stdout:9/623: creat d1/d7/dc/de/d34/d48/d89/fdc x:0 0 0 2024-03-19T06:05:38.569 INFO:tasks.workunit.client.1.smithi172.stdout:2/601: write d7/db/d45/f74 [4264452,58264] 0 2024-03-19T06:05:38.576 INFO:tasks.workunit.client.1.smithi172.stdout:8/599: write d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/f8a [2832353,30431] 0 2024-03-19T06:05:38.576 INFO:tasks.workunit.client.1.smithi172.stdout:7/598: dwrite d0/f71 [4194304,4194304] 0 2024-03-19T06:05:38.577 INFO:tasks.workunit.client.1.smithi172.stdout:4/690: dwrite df/d2b/d99/faa [0,4194304] 0 2024-03-19T06:05:38.580 INFO:tasks.workunit.client.1.smithi172.stdout:5/574: sync 2024-03-19T06:05:38.584 INFO:tasks.workunit.client.1.smithi172.stdout:7/599: write d0/d22/d1d/f4c [1758006,87553] 0 2024-03-19T06:05:38.585 INFO:tasks.workunit.client.1.smithi172.stdout:1/650: write da/dd/d10/d14/d27/f32 [837537,68337] 0 2024-03-19T06:05:38.602 INFO:tasks.workunit.client.1.smithi172.stdout:5/575: dwrite d5/f58 [0,4194304] 0 2024-03-19T06:05:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.613+0000 7f2b98e00700 1 -- 172.21.15.72:0/2715269620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b94100240 msgr2=0x7f2b94100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.613+0000 7f2b98e00700 1 --2- 172.21.15.72:0/2715269620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b94100240 0x7f2b94100650 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009910 tx=0x7f2b84009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.613+0000 7f2b98e00700 1 -- 172.21.15.72:0/2715269620 shutdown_connections 2024-03-19T06:05:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.613+0000 7f2b98e00700 1 --2- 172.21.15.72:0/2715269620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b94101440 0x7f2b94101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.613+0000 7f2b98e00700 1 --2- 172.21.15.72:0/2715269620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b94100240 0x7f2b94100650 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.613+0000 7f2b98e00700 1 -- 172.21.15.72:0/2715269620 >> 172.21.15.72:0/2715269620 conn(0x7f2b940fb7f0 msgr2=0x7f2b940fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.613+0000 7f2b98e00700 1 -- 172.21.15.72:0/2715269620 shutdown_connections 2024-03-19T06:05:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.614+0000 7f2b98e00700 1 -- 172.21.15.72:0/2715269620 wait complete. 2024-03-19T06:05:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.615+0000 7f2b98e00700 1 Processor -- start 2024-03-19T06:05:38.606 INFO:tasks.workunit.client.1.smithi172.stdout:6/742: rename d5/d8f/d31/d3d/d98/db6/f42 to d5/d11/d17/d36/fe8 0 2024-03-19T06:05:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.615+0000 7f2b98e00700 1 -- start start 2024-03-19T06:05:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.616+0000 7f2b98e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b94100240 0x7f2b94197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.616+0000 7f2b98e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b94101440 0x7f2b94198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.616+0000 7f2b98e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b94198950 con 0x7f2b94100240 2024-03-19T06:05:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.616+0000 7f2b98e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b94198a90 con 0x7f2b94101440 2024-03-19T06:05:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.616+0000 7f2b91e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b94100240 0x7f2b94197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.616+0000 7f2b91e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b94100240 0x7f2b94197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54412/0 (socket says 172.21.15.72:54412) 2024-03-19T06:05:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.616+0000 7f2b91e00700 1 -- 172.21.15.72:0/3243628488 learned_addr learned my addr 172.21.15.72:0/3243628488 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:38.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.617+0000 7f2b91400700 1 --2- 172.21.15.72:0/3243628488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b94101440 0x7f2b94198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:38.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.617+0000 7f2b91400700 1 -- 172.21.15.72:0/3243628488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b94100240 msgr2=0x7f2b94197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:38.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.617+0000 7f2b91400700 1 --2- 172.21.15.72:0/3243628488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b94100240 0x7f2b94197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:38.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.617+0000 7f2b91400700 1 -- 172.21.15.72:0/3243628488 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b840095f0 con 0x7f2b94101440 2024-03-19T06:05:38.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.618+0000 7f2b91400700 1 --2- 172.21.15.72:0/3243628488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b94101440 0x7f2b94198330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000b3d0 tx=0x7f2b8000b6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:38.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.618+0000 7f2b8aa00700 1 -- 172.21.15.72:0/3243628488 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b80011800 con 0x7f2b94101440 2024-03-19T06:05:38.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.619+0000 7f2b8aa00700 1 -- 172.21.15.72:0/3243628488 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2b8000be90 con 0x7f2b94101440 2024-03-19T06:05:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.619+0000 7f2b8aa00700 1 -- 172.21.15.72:0/3243628488 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b80010e70 con 0x7f2b94101440 2024-03-19T06:05:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.619+0000 7f2b98e00700 1 -- 172.21.15.72:0/3243628488 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9419d540 con 0x7f2b94101440 2024-03-19T06:05:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.619+0000 7f2b98e00700 1 -- 172.21.15.72:0/3243628488 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9419da40 con 0x7f2b94101440 2024-03-19T06:05:38.610 INFO:tasks.workunit.client.1.smithi172.stdout:2/602: mknod d7/da6/cc7 0 2024-03-19T06:05:38.611 INFO:tasks.workunit.client.1.smithi172.stdout:5/576: unlink d5/d14/f3b 0 2024-03-19T06:05:38.612 INFO:tasks.workunit.client.1.smithi172.stdout:4/691: read df/d11/d12/d21/d58/f83 [523578,56024] 0 2024-03-19T06:05:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.621+0000 7f2b98e00700 1 -- 172.21.15.72:0/3243628488 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b94105520 con 0x7f2b94101440 2024-03-19T06:05:38.614 INFO:tasks.workunit.client.1.smithi172.stdout:1/651: mkdir da/d7a/de0 0 2024-03-19T06:05:38.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.624+0000 7f2b8aa00700 1 -- 172.21.15.72:0/3243628488 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7f2b80011960 con 0x7f2b94101440 2024-03-19T06:05:38.615 INFO:tasks.workunit.client.1.smithi172.stdout:1/652: chown da/dd/d10 3535 1 2024-03-19T06:05:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.625+0000 7f2b8aa00700 1 --2- 172.21.15.72:0/3243628488 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f2b7806dda0 0x7f2b78070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.625+0000 7f2b8aa00700 1 -- 172.21.15.72:0/3243628488 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2b8008d3b0 con 0x7f2b94101440 2024-03-19T06:05:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.626+0000 7f2b91e00700 1 --2- 172.21.15.72:0/3243628488 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f2b7806dda0 0x7f2b78070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.627+0000 7f2b91e00700 1 --2- 172.21.15.72:0/3243628488 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f2b7806dda0 0x7f2b78070250 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2b84006010 tx=0x7f2b8400b540 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:38.617 INFO:tasks.workunit.client.1.smithi172.stdout:0/667: getdents d11/d22/d46 0 2024-03-19T06:05:38.618 INFO:tasks.workunit.client.1.smithi172.stdout:3/651: truncate d0/da8/d25/f1a 881919 0 2024-03-19T06:05:38.619 INFO:tasks.workunit.client.1.smithi172.stdout:4/692: creat df/d11/fe3 x:0 0 0 2024-03-19T06:05:38.619 INFO:tasks.workunit.client.1.smithi172.stdout:2/603: truncate d7/d4c/f7e 332506 0 2024-03-19T06:05:38.620 INFO:tasks.workunit.client.1.smithi172.stdout:1/653: creat da/dd/d10/d14/d27/d3f/fe1 x:0 0 0 2024-03-19T06:05:38.621 INFO:tasks.workunit.client.1.smithi172.stdout:9/624: getdents d1/d7/dc/de/d34/d48/d82/d92/d95/d9e 0 2024-03-19T06:05:38.623 INFO:tasks.workunit.client.1.smithi172.stdout:8/600: rename d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/f69 to d0/fbd 0 2024-03-19T06:05:38.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.632+0000 7f2b8aa00700 1 -- 172.21.15.72:0/3243628488 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f2b8005a750 con 0x7f2b94101440 2024-03-19T06:05:38.623 INFO:tasks.workunit.client.1.smithi172.stdout:4/693: stat df/d2b/d2d/db0 0 2024-03-19T06:05:38.628 INFO:tasks.workunit.client.1.smithi172.stdout:9/625: read d1/f56 [246184,56264] 0 2024-03-19T06:05:38.628 INFO:tasks.workunit.client.1.smithi172.stdout:3/652: creat d0/da8/d60/fe2 x:0 0 0 2024-03-19T06:05:38.628 INFO:tasks.workunit.client.1.smithi172.stdout:7/600: rename d0/d22/d1d/d36/d8d/d5c/l98 to d0/d22/d1d/d3a/d6b/lca 0 2024-03-19T06:05:38.632 INFO:tasks.workunit.client.1.smithi172.stdout:6/743: rename d5/d8f/d31/d3d/d98/db6/d40/d53/d75/l63 to d5/d11/d2f/le9 0 2024-03-19T06:05:38.633 INFO:tasks.workunit.client.1.smithi172.stdout:9/626: rmdir d1/d7/dc/db7 39 2024-03-19T06:05:38.634 INFO:tasks.workunit.client.1.smithi172.stdout:3/653: creat d0/da8/d54/d90/fe3 x:0 0 0 2024-03-19T06:05:38.638 INFO:tasks.workunit.client.1.smithi172.stdout:5/577: dwrite d5/d1f/f82 [0,4194304] 0 2024-03-19T06:05:38.639 INFO:tasks.workunit.client.1.smithi172.stdout:4/694: dread df/d2b/d44/d67/f3f [0,4194304] 0 2024-03-19T06:05:38.640 INFO:tasks.workunit.client.1.smithi172.stdout:9/627: fdatasync d1/d7/dc/d47/d78/f7e 0 2024-03-19T06:05:38.643 INFO:tasks.workunit.client.1.smithi172.stdout:7/601: truncate d0/d22/d1d/d3a/d46/f78 4468143 0 2024-03-19T06:05:38.643 INFO:tasks.workunit.client.1.smithi172.stdout:1/654: dread da/d33/d52/f55 [0,4194304] 0 2024-03-19T06:05:38.644 INFO:tasks.workunit.client.1.smithi172.stdout:6/744: rename d5/d8f/fb0 to d5/d11/d43/da6/dd9/fea 0 2024-03-19T06:05:38.645 INFO:tasks.workunit.client.1.smithi172.stdout:8/601: truncate d0/d44/d46/d49/d3a/d3d/fa1 394236 0 2024-03-19T06:05:38.646 INFO:tasks.workunit.client.1.smithi172.stdout:0/668: link d11/d18/d38/d3f/d43/dc5/cd7 d11/d18/d38/d3f/d43/d62/dc0/ce5 0 2024-03-19T06:05:38.647 INFO:tasks.workunit.client.1.smithi172.stdout:4/695: write df/f8f [1161530,14287] 0 2024-03-19T06:05:38.650 INFO:tasks.workunit.client.1.smithi172.stdout:2/604: dwrite d7/f15 [0,4194304] 0 2024-03-19T06:05:38.650 INFO:tasks.workunit.client.1.smithi172.stdout:5/578: creat d5/d1f/fc5 x:0 0 0 2024-03-19T06:05:38.651 INFO:tasks.workunit.client.1.smithi172.stdout:3/654: mknod d0/da8/dce/ce4 0 2024-03-19T06:05:38.652 INFO:tasks.workunit.client.1.smithi172.stdout:1/655: chown da/d33/d4e/d60/c67 0 1 2024-03-19T06:05:38.653 INFO:tasks.workunit.client.1.smithi172.stdout:0/669: creat d11/d4d/fe6 x:0 0 0 2024-03-19T06:05:38.655 INFO:tasks.workunit.client.1.smithi172.stdout:4/696: rmdir df/d2b/d44 39 2024-03-19T06:05:38.660 INFO:tasks.workunit.client.1.smithi172.stdout:9/628: write d1/d7/dc/de/d34/d48/d89/fdc [78893,1250] 0 2024-03-19T06:05:38.662 INFO:tasks.workunit.client.1.smithi172.stdout:6/745: rename d5/d11/d17/da4/lb5 to d5/d8f/d31/d3d/d98/db6/dc7/leb 0 2024-03-19T06:05:38.665 INFO:tasks.workunit.client.1.smithi172.stdout:5/579: creat d5/d14/d9f/fc6 x:0 0 0 2024-03-19T06:05:38.666 INFO:tasks.workunit.client.1.smithi172.stdout:9/629: symlink d1/d7/dd4/ldd 0 2024-03-19T06:05:38.667 INFO:tasks.workunit.client.1.smithi172.stdout:7/602: link d0/d22/d1d/d36/d56/la0 d0/d22/d1d/d3a/d6b/lcb 0 2024-03-19T06:05:38.670 INFO:tasks.workunit.client.1.smithi172.stdout:6/746: creat d5/d11/d43/d45/da1/de1/fec x:0 0 0 2024-03-19T06:05:38.671 INFO:tasks.workunit.client.1.smithi172.stdout:5/580: readlink d5/d14/d15/d40/d5c/l71 0 2024-03-19T06:05:38.672 INFO:tasks.workunit.client.1.smithi172.stdout:1/656: symlink da/dd/d31/d47/dbf/le2 0 2024-03-19T06:05:38.673 INFO:tasks.workunit.client.1.smithi172.stdout:3/655: getdents d0/da8/d3a 0 2024-03-19T06:05:38.674 INFO:tasks.workunit.client.1.smithi172.stdout:7/603: fdatasync d0/d22/d1d/d36/d56/f6c 0 2024-03-19T06:05:38.675 INFO:tasks.workunit.client.1.smithi172.stdout:8/602: rename d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/c5e to d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/cbe 0 2024-03-19T06:05:38.675 INFO:tasks.workunit.client.1.smithi172.stdout:5/581: chown d5/d1f/l57 6291116 1 2024-03-19T06:05:38.677 INFO:tasks.workunit.client.1.smithi172.stdout:9/630: mknod d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/cde 0 2024-03-19T06:05:38.677 INFO:tasks.workunit.client.1.smithi172.stdout:6/747: write d5/d8f/d31/d3d/d98/db6/dc7/dd1/fd8 [942919,77256] 0 2024-03-19T06:05:38.677 INFO:tasks.workunit.client.1.smithi172.stdout:8/603: readlink d0/d44/d46/d49/l31 0 2024-03-19T06:05:38.678 INFO:tasks.workunit.client.1.smithi172.stdout:7/604: read d0/d22/fb9 [493198,11524] 0 2024-03-19T06:05:38.685 INFO:tasks.workunit.client.1.smithi172.stdout:9/631: rmdir d1/d7/dc/dbe/dc9 39 2024-03-19T06:05:38.689 INFO:tasks.workunit.client.1.smithi172.stdout:5/582: truncate d5/d1f/d2f/d53/f78 1736873 0 2024-03-19T06:05:38.690 INFO:tasks.workunit.client.1.smithi172.stdout:7/605: rmdir d0/d22/d3d 39 2024-03-19T06:05:38.690 INFO:tasks.workunit.client.1.smithi172.stdout:1/657: write da/dd/f1f [3038255,115322] 0 2024-03-19T06:05:38.691 INFO:tasks.workunit.client.1.smithi172.stdout:9/632: fdatasync d1/d7/dc/de/d34/f41 0 2024-03-19T06:05:38.694 INFO:tasks.workunit.client.1.smithi172.stdout:3/656: link d0/da8/dce/fb8 d0/da8/d34/d4d/dc5/fe5 0 2024-03-19T06:05:38.696 INFO:tasks.workunit.client.1.smithi172.stdout:5/583: read - d5/d14/d34/f94 zero size 2024-03-19T06:05:38.696 INFO:tasks.workunit.client.1.smithi172.stdout:7/606: fsync d0/d22/d27/db0/f2f 0 2024-03-19T06:05:38.700 INFO:tasks.workunit.client.1.smithi172.stdout:2/605: write d7/d4c/d70/f90 [743840,51962] 0 2024-03-19T06:05:38.701 INFO:tasks.workunit.client.1.smithi172.stdout:0/670: write d11/d22/d68/f63 [4430399,104344] 0 2024-03-19T06:05:38.705 INFO:tasks.workunit.client.1.smithi172.stdout:9/633: rmdir d1/d7/dc/dbe/d8e 0 2024-03-19T06:05:38.706 INFO:tasks.workunit.client.1.smithi172.stdout:7/607: mknod d0/d22/d1d/d85/ccc 0 2024-03-19T06:05:38.707 INFO:tasks.workunit.client.1.smithi172.stdout:9/634: readlink d1/d7/dc/db7/lc2 0 2024-03-19T06:05:38.710 INFO:tasks.workunit.client.1.smithi172.stdout:0/671: mkdir d11/d14/d2c/de7 0 2024-03-19T06:05:38.715 INFO:tasks.workunit.client.1.smithi172.stdout:5/584: link d5/d14/f7b d5/d3c/d6c/d9b/fc7 0 2024-03-19T06:05:38.717 INFO:tasks.workunit.client.1.smithi172.stdout:2/606: getdents d7/de/d58/d55/d6e/da5 0 2024-03-19T06:05:38.718 INFO:tasks.workunit.client.1.smithi172.stdout:9/635: symlink d1/d7/dc/d47/da3/ldf 0 2024-03-19T06:05:38.719 INFO:tasks.workunit.client.1.smithi172.stdout:6/748: dwrite d5/d8f/f70 [0,4194304] 0 2024-03-19T06:05:38.725 INFO:tasks.workunit.client.1.smithi172.stdout:6/749: dread - d5/d8f/f6a zero size 2024-03-19T06:05:38.725 INFO:tasks.workunit.client.1.smithi172.stdout:9/636: dread - d1/d7/dc/d47/d78/d54/fc8 zero size 2024-03-19T06:05:38.727 INFO:tasks.workunit.client.1.smithi172.stdout:7/608: write d0/d22/d1d/d36/f13 [688010,105057] 0 2024-03-19T06:05:38.728 INFO:tasks.workunit.client.1.smithi172.stdout:0/672: dread d11/d14/d2c/d8d/f99 [0,4194304] 0 2024-03-19T06:05:38.729 INFO:tasks.workunit.client.1.smithi172.stdout:8/604: dwrite d0/d44/d46/d49/d26/d71/d81/f6d [0,4194304] 0 2024-03-19T06:05:38.733 INFO:tasks.workunit.client.1.smithi172.stdout:2/607: getdents d7/d1b 0 2024-03-19T06:05:38.737 INFO:tasks.workunit.client.1.smithi172.stdout:7/609: dread - d0/d22/d3d/d41/fa6 zero size 2024-03-19T06:05:38.737 INFO:tasks.workunit.client.1.smithi172.stdout:3/657: dwrite d0/d5/d6b/f8f [0,4194304] 0 2024-03-19T06:05:38.741 INFO:tasks.workunit.client.1.smithi172.stdout:3/658: dread - d0/da8/d54/fdc zero size 2024-03-19T06:05:38.741 INFO:tasks.workunit.client.1.smithi172.stdout:0/673: creat d11/d14/d2c/d8d/fe8 x:0 0 0 2024-03-19T06:05:38.741 INFO:tasks.workunit.client.1.smithi172.stdout:7/610: read - d0/d22/d1d/d36/d8d/d5c/d67/fc3 zero size 2024-03-19T06:05:38.742 INFO:tasks.workunit.client.1.smithi172.stdout:9/637: creat d1/d7/dc/fe0 x:0 0 0 2024-03-19T06:05:38.743 INFO:tasks.workunit.client.1.smithi172.stdout:0/674: fsync d11/d18/d38/d3f/d9f/fd4 0 2024-03-19T06:05:38.743 INFO:tasks.workunit.client.1.smithi172.stdout:2/608: unlink d7/de/d58/d56/d86/l94 0 2024-03-19T06:05:38.744 INFO:tasks.workunit.client.1.smithi172.stdout:7/611: chown d0/d22/d27/c75 436 1 2024-03-19T06:05:38.744 INFO:tasks.workunit.client.1.smithi172.stdout:8/605: mkdir d0/d44/d46/d49/d3a/dbf 0 2024-03-19T06:05:38.748 INFO:tasks.workunit.client.1.smithi172.stdout:2/609: dread d7/db/f32 [0,4194304] 0 2024-03-19T06:05:38.750 INFO:tasks.workunit.client.1.smithi172.stdout:8/606: chown d0/d44/d46/d49/d26/d71/d81/f6d 4070664 1 2024-03-19T06:05:38.753 INFO:tasks.workunit.client.1.smithi172.stdout:2/610: truncate d7/de/d58/d57/fc4 418632 0 2024-03-19T06:05:38.760 INFO:tasks.workunit.client.1.smithi172.stdout:2/611: unlink d7/c99 0 2024-03-19T06:05:38.760 INFO:tasks.workunit.client.1.smithi172.stdout:6/750: write d5/d11/d43/f64 [5199684,62108] 0 2024-03-19T06:05:38.764 INFO:tasks.workunit.client.1.smithi172.stdout:8/607: rename d0/d44/d46/d49/d3a to d0/d44/d46/d49/d26/dc0 0 2024-03-19T06:05:38.765 INFO:tasks.workunit.client.1.smithi172.stdout:2/612: write d7/de/d61/fb6 [374590,7915] 0 2024-03-19T06:05:38.773 INFO:tasks.workunit.client.1.smithi172.stdout:9/638: dwrite d1/fa [0,4194304] 0 2024-03-19T06:05:38.780 INFO:tasks.workunit.client.1.smithi172.stdout:3/659: write d0/da8/d25/f1a [42819,107642] 0 2024-03-19T06:05:38.790 INFO:tasks.workunit.client.1.smithi172.stdout:7/612: dread d0/d22/d1d/d36/f54 [0,4194304] 0 2024-03-19T06:05:38.791 INFO:tasks.workunit.client.1.smithi172.stdout:0/675: dread d11/d22/d32/f77 [0,4194304] 0 2024-03-19T06:05:38.792 INFO:tasks.workunit.client.1.smithi172.stdout:9/639: mknod d1/d7/dc/d47/da3/d7d/ce1 0 2024-03-19T06:05:38.798 INFO:tasks.workunit.client.1.smithi172.stdout:8/608: dwrite d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d9c/fa9 [0,4194304] 0 2024-03-19T06:05:38.798 INFO:tasks.workunit.client.1.smithi172.stdout:3/660: fdatasync d0/da8/d34/d4d/fe1 0 2024-03-19T06:05:38.798 INFO:tasks.workunit.client.1.smithi172.stdout:9/640: dread - d1/d7/dc/fe0 zero size 2024-03-19T06:05:38.799 INFO:tasks.workunit.client.1.smithi172.stdout:7/613: link d0/f71 d0/d22/d1d/fcd 0 2024-03-19T06:05:38.802 INFO:tasks.workunit.client.1.smithi172.stdout:7/614: chown d0/d22/d1d/d36/d8d/d5c 62276 1 2024-03-19T06:05:38.807 INFO:tasks.workunit.client.1.smithi172.stdout:7/615: creat d0/d22/d1d/fce x:0 0 0 2024-03-19T06:05:38.812 INFO:tasks.workunit.client.1.smithi172.stdout:6/751: dread d5/d11/d17/d1b/d74/faa [0,4194304] 0 2024-03-19T06:05:38.813 INFO:tasks.workunit.client.1.smithi172.stdout:8/609: link d0/d44/f88 d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d9c/fc1 0 2024-03-19T06:05:38.814 INFO:tasks.workunit.client.1.smithi172.stdout:4/697: sync 2024-03-19T06:05:38.814 INFO:tasks.workunit.client.1.smithi172.stdout:5/585: sync 2024-03-19T06:05:38.814 INFO:tasks.workunit.client.1.smithi172.stdout:1/658: sync 2024-03-19T06:05:38.815 INFO:tasks.workunit.client.1.smithi172.stdout:8/610: chown d0/d6f 7 1 2024-03-19T06:05:38.823 INFO:tasks.workunit.client.1.smithi172.stdout:6/752: truncate d5/d8f/d31/d3d/f54 1893000 0 2024-03-19T06:05:38.828 INFO:tasks.workunit.client.1.smithi172.stdout:6/753: unlink d5/f5f 0 2024-03-19T06:05:38.829 INFO:tasks.workunit.client.1.smithi172.stdout:5/586: truncate d5/d14/d15/f42 576182 0 2024-03-19T06:05:38.830 INFO:tasks.workunit.client.1.smithi172.stdout:9/641: dwrite d1/d7/dc/de/d34/d48/fd2 [0,4194304] 0 2024-03-19T06:05:38.830 INFO:tasks.workunit.client.1.smithi172.stdout:8/611: mknod d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d9c/cc2 0 2024-03-19T06:05:38.831 INFO:tasks.workunit.client.1.smithi172.stdout:0/676: dread d11/f13 [0,4194304] 0 2024-03-19T06:05:38.835 INFO:tasks.workunit.client.1.smithi172.stdout:2/613: rename d7/d4c/f8c to d7/de/d58/d55/d6e/da5/fc8 0 2024-03-19T06:05:38.835 INFO:tasks.workunit.client.1.smithi172.stdout:1/659: getdents da/d33/d4e/d60 0 2024-03-19T06:05:38.835 INFO:tasks.workunit.client.1.smithi172.stdout:6/754: symlink d5/d11/d17/d1b/led 0 2024-03-19T06:05:38.836 INFO:tasks.workunit.client.1.smithi172.stdout:5/587: rmdir d5/d14/d15/d40/d5c 39 2024-03-19T06:05:38.839 INFO:tasks.workunit.client.1.smithi172.stdout:6/755: fsync d5/fb 0 2024-03-19T06:05:38.839 INFO:tasks.workunit.client.1.smithi172.stdout:5/588: readlink d5/d14/d56/l5e 0 2024-03-19T06:05:38.842 INFO:tasks.workunit.client.1.smithi172.stdout:9/642: symlink d1/d7/dc/de/d34/dd7/le2 0 2024-03-19T06:05:38.843 INFO:tasks.workunit.client.1.smithi172.stdout:9/643: readlink d1/l12 0 2024-03-19T06:05:38.843 INFO:tasks.workunit.client.1.smithi172.stdout:6/756: chown d5/d8f/d31/d3d/d98/db6/dc7 8420958 1 2024-03-19T06:05:38.844 INFO:tasks.workunit.client.1.smithi172.stdout:4/698: rename df/d11/d12/f1e to df/fe4 0 2024-03-19T06:05:38.846 INFO:tasks.workunit.client.1.smithi172.stdout:9/644: write d1/fae [2605569,73780] 0 2024-03-19T06:05:38.848 INFO:tasks.workunit.client.1.smithi172.stdout:2/614: creat d7/de/d58/d56/d86/d9d/fc9 x:0 0 0 2024-03-19T06:05:38.851 INFO:tasks.workunit.client.1.smithi172.stdout:8/612: read d0/d44/d46/d49/f5d [971156,78316] 0 2024-03-19T06:05:38.851 INFO:tasks.workunit.client.1.smithi172.stdout:1/660: link da/dd/d10/f96 da/d33/d78/fe3 0 2024-03-19T06:05:38.863 INFO:tasks.workunit.client.1.smithi172.stdout:7/616: dread d0/f15 [0,4194304] 0 2024-03-19T06:05:38.864 INFO:tasks.workunit.client.1.smithi172.stdout:2/615: mkdir d7/de/d58/d56/d89/db5/dca 0 2024-03-19T06:05:38.868 INFO:tasks.workunit.client.1.smithi172.stdout:8/613: mkdir d0/d44/d46/d49/d26/dc0/d76/dc3 0 2024-03-19T06:05:38.873 INFO:tasks.workunit.client.1.smithi172.stdout:0/677: dwrite d11/d18/d38/d3f/d43/d89/fc9 [0,4194304] 0 2024-03-19T06:05:38.875 INFO:tasks.workunit.client.1.smithi172.stdout:7/617: truncate d0/d22/d1d/fce 887932 0 2024-03-19T06:05:38.880 INFO:tasks.workunit.client.1.smithi172.stdout:5/589: dwrite d5/d3d/d60/f97 [0,4194304] 0 2024-03-19T06:05:38.883 INFO:tasks.workunit.client.1.smithi172.stdout:3/661: dread d0/da8/d34/f64 [0,4194304] 0 2024-03-19T06:05:38.883 INFO:tasks.workunit.client.1.smithi172.stdout:7/618: rmdir d0/d22/d1d/d36/d56 39 2024-03-19T06:05:38.887 INFO:tasks.workunit.client.1.smithi172.stdout:5/590: readlink d5/d14/d15/lbb 0 2024-03-19T06:05:38.889 INFO:tasks.workunit.client.1.smithi172.stdout:2/616: creat d7/de/d58/d55/fcb x:0 0 0 2024-03-19T06:05:38.893 INFO:tasks.workunit.client.1.smithi172.stdout:5/591: mkdir d5/d3c/d6c/dc8 0 2024-03-19T06:05:38.899 INFO:tasks.workunit.client.1.smithi172.stdout:1/661: write da/dd/d31/d97/fa1 [681117,71250] 0 2024-03-19T06:05:38.903 INFO:tasks.workunit.client.1.smithi172.stdout:2/617: link d7/f4e d7/de/fcc 0 2024-03-19T06:05:38.906 INFO:tasks.workunit.client.1.smithi172.stdout:4/699: write df/d11/d12/d21/f88 [109343,59353] 0 2024-03-19T06:05:38.907 INFO:tasks.workunit.client.1.smithi172.stdout:5/592: getdents d5/d55 0 2024-03-19T06:05:38.910 INFO:tasks.workunit.client.1.smithi172.stdout:2/618: mkdir d7/de/d58/d55/d5f/dcd 0 2024-03-19T06:05:38.910 INFO:tasks.workunit.client.1.smithi172.stdout:5/593: chown l1 1 1 2024-03-19T06:05:38.912 INFO:tasks.workunit.client.1.smithi172.stdout:9/645: dread d1/d7/dc/de/d34/d48/d89/fac [0,4194304] 0 2024-03-19T06:05:38.912 INFO:tasks.workunit.client.1.smithi172.stdout:2/619: fdatasync d7/f8 0 2024-03-19T06:05:38.919 INFO:tasks.workunit.client.1.smithi172.stdout:2/620: fsync d7/de/d58/d56/d86/d9d/dab/fb7 0 2024-03-19T06:05:38.921 INFO:tasks.workunit.client.1.smithi172.stdout:9/646: creat d1/d7/dc/dbe/dc9/fe3 x:0 0 0 2024-03-19T06:05:38.922 INFO:tasks.workunit.client.1.smithi172.stdout:5/594: write d5/d14/d15/f24 [1959672,6060] 0 2024-03-19T06:05:38.924 INFO:tasks.workunit.client.1.smithi172.stdout:6/757: dwrite d5/d8f/d31/d3d/d98/db6/d40/d53/d75/fb1 [0,4194304] 0 2024-03-19T06:05:38.925 INFO:tasks.workunit.client.1.smithi172.stdout:9/647: stat d1/db9/fd9 0 2024-03-19T06:05:38.927 INFO:tasks.workunit.client.1.smithi172.stdout:7/619: dread d0/d22/d1d/d3a/d46/f78 [0,4194304] 0 2024-03-19T06:05:38.934 INFO:tasks.workunit.client.1.smithi172.stdout:6/758: stat d5/d8f/d31/d7b/f7f 0 2024-03-19T06:05:38.937 INFO:tasks.workunit.client.1.smithi172.stdout:2/621: creat d7/de/d58/d55/fce x:0 0 0 2024-03-19T06:05:38.938 INFO:tasks.workunit.client.1.smithi172.stdout:1/662: dwrite da/d3b/f3d [0,4194304] 0 2024-03-19T06:05:38.939 INFO:tasks.workunit.client.1.smithi172.stdout:9/648: chown d1/d7/dc/de/f1f 42 1 2024-03-19T06:05:38.939 INFO:tasks.workunit.client.1.smithi172.stdout:3/662: dwrite d0/da8/d3a/faa [0,4194304] 0 2024-03-19T06:05:38.939 INFO:tasks.workunit.client.1.smithi172.stdout:7/620: chown d0/d22/d3d/d41/fc2 14 1 2024-03-19T06:05:38.943 INFO:tasks.workunit.client.1.smithi172.stdout:2/622: read - d7/de/d58/d55/d5f/fb9 zero size 2024-03-19T06:05:38.947 INFO:tasks.workunit.client.1.smithi172.stdout:1/663: chown da/dd/d10/d14/d84/d9b/f9d 4 1 2024-03-19T06:05:38.949 INFO:tasks.workunit.client.1.smithi172.stdout:6/759: chown d5/d11/d2f/cda 2333473 1 2024-03-19T06:05:38.952 INFO:tasks.workunit.client.1.smithi172.stdout:7/621: creat d0/d22/d4b/fcf x:0 0 0 2024-03-19T06:05:38.952 INFO:tasks.workunit.client.1.smithi172.stdout:2/623: symlink d7/de/d58/d55/d5f/lcf 0 2024-03-19T06:05:38.958 INFO:tasks.workunit.client.1.smithi172.stdout:7/622: dread - d0/d22/d3d/d41/fa6 zero size 2024-03-19T06:05:38.958 INFO:tasks.workunit.client.1.smithi172.stdout:4/700: dread df/d2b/f3b [0,4194304] 0 2024-03-19T06:05:38.959 INFO:tasks.workunit.client.1.smithi172.stdout:2/624: unlink d7/f4e 0 2024-03-19T06:05:38.960 INFO:tasks.workunit.client.1.smithi172.stdout:9/649: truncate d1/d7/dc/d47/d78/f79 4534111 0 2024-03-19T06:05:38.960 INFO:tasks.workunit.client.1.smithi172.stdout:3/663: write d0/d5/d6b/f81 [984757,126541] 0 2024-03-19T06:05:38.966 INFO:tasks.workunit.client.1.smithi172.stdout:7/623: readlink d0/d22/d27/db0/l66 0 2024-03-19T06:05:38.966 INFO:tasks.workunit.client.1.smithi172.stdout:2/625: chown d7/f15 102665 1 2024-03-19T06:05:38.968 INFO:tasks.workunit.client.1.smithi172.stdout:3/664: symlink d0/d5/le6 0 2024-03-19T06:05:38.968 INFO:tasks.workunit.client.1.smithi172.stdout:6/760: getdents d5/d11/d17/d1b/d74 0 2024-03-19T06:05:38.970 INFO:tasks.workunit.client.1.smithi172.stdout:9/650: chown d1/d7/dc/d47/d78/d54/d91 861 1 2024-03-19T06:05:38.970 INFO:tasks.workunit.client.1.smithi172.stdout:5/595: dread d5/fe [0,4194304] 0 2024-03-19T06:05:38.971 INFO:tasks.workunit.client.1.smithi172.stdout:4/701: creat df/d2b/d44/fe5 x:0 0 0 2024-03-19T06:05:38.972 INFO:tasks.workunit.client.1.smithi172.stdout:2/626: truncate d7/d1b/f9c 182857 0 2024-03-19T06:05:38.974 INFO:tasks.workunit.client.1.smithi172.stdout:6/761: chown d5/d11/d17/d36/dca/fcb 885459263 1 2024-03-19T06:05:38.975 INFO:tasks.workunit.client.1.smithi172.stdout:9/651: chown d1/d7/dc/d47/da3/l8b 57 1 2024-03-19T06:05:38.976 INFO:tasks.workunit.client.1.smithi172.stdout:3/665: creat d0/da8/d34/dda/fe7 x:0 0 0 2024-03-19T06:05:38.977 INFO:tasks.workunit.client.1.smithi172.stdout:7/624: getdents d0/d22/d3d/d41 0 2024-03-19T06:05:38.979 INFO:tasks.workunit.client.1.smithi172.stdout:6/762: dread - d5/d11/d43/d45/da1/fcc zero size 2024-03-19T06:05:38.980 INFO:tasks.workunit.client.1.smithi172.stdout:6/763: readlink d5/lbf 0 2024-03-19T06:05:38.984 INFO:tasks.workunit.client.1.smithi172.stdout:6/764: read d5/d8f/d31/f67 [4276914,68682] 0 2024-03-19T06:05:38.987 INFO:tasks.workunit.client.1.smithi172.stdout:2/627: creat d7/de/d58/d56/d89/db5/dca/fd0 x:0 0 0 2024-03-19T06:05:38.988 INFO:tasks.workunit.client.1.smithi172.stdout:7/625: symlink d0/d22/ld0 0 2024-03-19T06:05:38.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.998+0000 7f2b98e00700 1 -- 172.21.15.72:0/3243628488 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b94061190 con 0x7f2b7806dda0 2024-03-19T06:05:38.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:38.999+0000 7f2b8aa00700 1 -- 172.21.15.72:0/3243628488 <== mgr.14702 v2:172.21.15.72:6800/2640845307 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f2b94061190 con 0x7f2b7806dda0 2024-03-19T06:05:38.991 INFO:tasks.workunit.client.1.smithi172.stdout:3/666: link d0/l4e d0/d5/d6b/le8 0 2024-03-19T06:05:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.002+0000 7f2b98e00700 1 -- 172.21.15.72:0/3243628488 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f2b7806dda0 msgr2=0x7f2b78070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.002+0000 7f2b98e00700 1 --2- 172.21.15.72:0/3243628488 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f2b7806dda0 0x7f2b78070250 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2b84006010 tx=0x7f2b8400b540 comp rx=0 tx=0).stop 2024-03-19T06:05:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.002+0000 7f2b98e00700 1 -- 172.21.15.72:0/3243628488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b94101440 msgr2=0x7f2b94198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.002+0000 7f2b98e00700 1 --2- 172.21.15.72:0/3243628488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b94101440 0x7f2b94198330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000b3d0 tx=0x7f2b8000b6e0 comp rx=0 tx=0).stop 2024-03-19T06:05:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.002+0000 7f2b98e00700 1 -- 172.21.15.72:0/3243628488 shutdown_connections 2024-03-19T06:05:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.002+0000 7f2b98e00700 1 --2- 172.21.15.72:0/3243628488 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f2b7806dda0 0x7f2b78070250 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.002+0000 7f2b98e00700 1 --2- 172.21.15.72:0/3243628488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b94100240 0x7f2b94197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.002+0000 7f2b98e00700 1 --2- 172.21.15.72:0/3243628488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b94101440 0x7f2b94198330 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.002+0000 7f2b98e00700 1 -- 172.21.15.72:0/3243628488 >> 172.21.15.72:0/3243628488 conn(0x7f2b940fb7f0 msgr2=0x7f2b94102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:38.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.002+0000 7f2b98e00700 1 -- 172.21.15.72:0/3243628488 shutdown_connections 2024-03-19T06:05:38.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.002+0000 7f2b98e00700 1 -- 172.21.15.72:0/3243628488 wait complete. 2024-03-19T06:05:38.994 INFO:tasks.workunit.client.1.smithi172.stdout:9/652: write d1/d7/dc/de/d34/d48/d82/f8f [150850,107643] 0 2024-03-19T06:05:38.994 INFO:tasks.workunit.client.1.smithi172.stdout:7/626: chown d0/d22/d4b/faa 1507 1 2024-03-19T06:05:39.001 INFO:tasks.workunit.client.1.smithi172.stdout:2/628: write d7/de/d58/d56/f28 [1898678,28604] 0 2024-03-19T06:05:39.002 INFO:tasks.workunit.client.1.smithi172.stdout:5/596: dwrite d5/d14/d15/d40/d6a/fbe [0,4194304] 0 2024-03-19T06:05:39.003 INFO:tasks.workunit.client.1.smithi172.stdout:3/667: mknod d0/da8/d34/ce9 0 2024-03-19T06:05:39.004 INFO:tasks.workunit.client.1.smithi172.stdout:9/653: mknod d1/d7/dc/d47/da3/d7d/ce4 0 2024-03-19T06:05:39.012 INFO:tasks.workunit.client.1.smithi172.stdout:3/668: write d0/d5/d6b/dae/fc8 [1020079,72712] 0 2024-03-19T06:05:39.013 INFO:tasks.workunit.client.1.smithi172.stdout:4/702: dread df/d11/d12/d21/d58/d60/f70 [0,4194304] 0 2024-03-19T06:05:39.018 INFO:tasks.workunit.client.1.smithi172.stdout:9/654: mkdir d1/d7/dc/de/d34/d48/d82/d92/d95/db4/de5 0 2024-03-19T06:05:39.020 INFO:tasks.workunit.client.1.smithi172.stdout:4/703: readlink df/d11/l15 0 2024-03-19T06:05:39.028 INFO:tasks.workunit.client.1.smithi172.stdout:6/765: dwrite d5/d11/d43/d45/da1/de1/fec [0,4194304] 0 2024-03-19T06:05:39.028 INFO:tasks.workunit.client.1.smithi172.stdout:9/655: mknod d1/d7/dc/d47/da3/d7d/ce6 0 2024-03-19T06:05:39.030 INFO:tasks.workunit.client.1.smithi172.stdout:4/704: dread - df/d11/d12/d34/f8d zero size 2024-03-19T06:05:39.032 INFO:tasks.workunit.client.1.smithi172.stdout:7/627: dwrite d0/d22/d27/db0/fad [0,4194304] 0 2024-03-19T06:05:39.040 INFO:tasks.workunit.client.1.smithi172.stdout:9/656: readlink d1/d7/dc/d47/l86 0 2024-03-19T06:05:39.040 INFO:tasks.workunit.client.1.smithi172.stdout:5/597: dwrite d5/f27 [0,4194304] 0 2024-03-19T06:05:39.043 INFO:tasks.workunit.client.1.smithi172.stdout:2/629: dwrite d7/de/fcc [0,4194304] 0 2024-03-19T06:05:39.044 INFO:tasks.workunit.client.1.smithi172.stdout:9/657: readlink d1/l38 0 2024-03-19T06:05:39.045 INFO:tasks.workunit.client.1.smithi172.stdout:4/705: truncate df/d11/d12/d21/d58/fdc 854117 0 2024-03-19T06:05:39.046 INFO:tasks.workunit.client.1.smithi172.stdout:2/630: chown d7/de 58652 1 2024-03-19T06:05:39.048 INFO:tasks.workunit.client.1.smithi172.stdout:7/628: creat d0/d22/d1d/d36/d40/da2/fd1 x:0 0 0 2024-03-19T06:05:39.051 INFO:tasks.workunit.client.1.smithi172.stdout:5/598: creat d5/d3c/d6c/dbd/fc9 x:0 0 0 2024-03-19T06:05:39.054 INFO:tasks.workunit.client.1.smithi172.stdout:4/706: mknod df/ce6 0 2024-03-19T06:05:39.054 INFO:tasks.workunit.client.1.smithi172.stdout:3/669: dwrite d0/da8/d34/d4d/fbe [0,4194304] 0 2024-03-19T06:05:39.056 INFO:tasks.workunit.client.1.smithi172.stdout:9/658: write d1/d7/dc/d47/d78/d54/fc8 [306415,128688] 0 2024-03-19T06:05:39.059 INFO:tasks.workunit.client.1.smithi172.stdout:3/670: truncate d0/f4 1027621 0 2024-03-19T06:05:39.060 INFO:tasks.workunit.client.1.smithi172.stdout:4/707: chown df/d11/d12/d21/d58 714394871 1 2024-03-19T06:05:39.060 INFO:tasks.workunit.client.1.smithi172.stdout:5/599: rmdir d5/d1f/db4 39 2024-03-19T06:05:39.063 INFO:tasks.workunit.client.1.smithi172.stdout:2/631: symlink d7/de/d58/d56/d86/d9e/ld1 0 2024-03-19T06:05:39.063 INFO:tasks.workunit.client.1.smithi172.stdout:7/629: mkdir d0/d22/d1d/d3a/dd2 0 2024-03-19T06:05:39.063 INFO:tasks.workunit.client.1.smithi172.stdout:8/614: sync 2024-03-19T06:05:39.069 INFO:tasks.workunit.client.1.smithi172.stdout:6/766: link d5/d8f/d31/d3d/d98/db6/dc7/dd1/fd8 d5/d8f/d31/d3d/d98/db6/d40/d53/d75/fee 0 2024-03-19T06:05:39.072 INFO:tasks.workunit.client.1.smithi172.stdout:7/630: stat d0/d22/d1d/l49 0 2024-03-19T06:05:39.074 INFO:tasks.workunit.client.1.smithi172.stdout:4/708: rename df/d2b/da3/lcc to df/d11/d12/d21/d58/da6/dc9/dca/le7 0 2024-03-19T06:05:39.074 INFO:tasks.workunit.client.1.smithi172.stdout:7/631: dread - d0/d22/d27/db0/d92/fb5 zero size 2024-03-19T06:05:39.076 INFO:tasks.workunit.client.1.smithi172.stdout:7/632: fdatasync d0/d22/d1d/d36/d40/f93 0 2024-03-19T06:05:39.076 INFO:tasks.workunit.client.1.smithi172.stdout:6/767: creat d5/d8f/d31/d7b/fef x:0 0 0 2024-03-19T06:05:39.077 INFO:tasks.workunit.client.1.smithi172.stdout:2/632: creat d7/de/d58/d55/d5f/dcd/fd2 x:0 0 0 2024-03-19T06:05:39.078 INFO:tasks.workunit.client.1.smithi172.stdout:4/709: truncate df/d11/d12/d26/d84/fd8 688314 0 2024-03-19T06:05:39.078 INFO:tasks.workunit.client.1.smithi172.stdout:8/615: creat d0/d44/d46/d49/d4f/fc4 x:0 0 0 2024-03-19T06:05:39.083 INFO:tasks.workunit.client.1.smithi172.stdout:5/600: creat d5/d1f/d2f/fca x:0 0 0 2024-03-19T06:05:39.083 INFO:tasks.workunit.client.1.smithi172.stdout:6/768: mkdir d5/d8f/d31/d3d/d95/df0 0 2024-03-19T06:05:39.087 INFO:tasks.workunit.client.1.smithi172.stdout:5/601: stat d5/d1f/f2a 0 2024-03-19T06:05:39.088 INFO:tasks.workunit.client.1.smithi172.stdout:2/633: creat d7/de/fd3 x:0 0 0 2024-03-19T06:05:39.089 INFO:tasks.workunit.client.1.smithi172.stdout:3/671: write d0/da8/dce/fb3 [1535503,66745] 0 2024-03-19T06:05:39.091 INFO:tasks.workunit.client.1.smithi172.stdout:2/634: chown d7/db/c3c 20865 1 2024-03-19T06:05:39.094 INFO:tasks.workunit.client.1.smithi172.stdout:5/602: creat d5/d1f/d2f/d62/fcb x:0 0 0 2024-03-19T06:05:39.099 INFO:tasks.workunit.client.1.smithi172.stdout:6/769: mknod d5/d8f/d31/d3d/d98/db6/d40/d53/d75/dbe/cf1 0 2024-03-19T06:05:39.101 INFO:tasks.workunit.client.1.smithi172.stdout:7/633: dread d0/d22/d1d/d36/d40/f93 [0,4194304] 0 2024-03-19T06:05:39.101 INFO:tasks.workunit.client.1.smithi172.stdout:2/635: creat d7/de/d58/d57/fd4 x:0 0 0 2024-03-19T06:05:39.105 INFO:tasks.workunit.client.1.smithi172.stdout:6/770: write d5/d11/d17/f3e [87321,62264] 0 2024-03-19T06:05:39.106 INFO:tasks.workunit.client.1.smithi172.stdout:7/634: symlink d0/d22/d27/db0/ld3 0 2024-03-19T06:05:39.107 INFO:tasks.workunit.client.1.smithi172.stdout:3/672: write d0/da8/d25/f58 [1575125,30419] 0 2024-03-19T06:05:39.110 INFO:tasks.workunit.client.1.smithi172.stdout:0/678: sync 2024-03-19T06:05:39.110 INFO:tasks.workunit.client.1.smithi172.stdout:1/664: sync 2024-03-19T06:05:39.116 INFO:tasks.workunit.client.1.smithi172.stdout:9/659: dread d1/d7/dc/d47/d78/d54/d91/f6f [0,4194304] 0 2024-03-19T06:05:39.117 INFO:tasks.workunit.client.1.smithi172.stdout:0/679: mkdir d11/d4d/de9 0 2024-03-19T06:05:39.117 INFO:tasks.workunit.client.1.smithi172.stdout:8/616: dwrite d0/d44/f7a [0,4194304] 0 2024-03-19T06:05:39.120 INFO:tasks.workunit.client.1.smithi172.stdout:1/665: readlink da/dd/d10/d14/d73/ld0 0 2024-03-19T06:05:39.123 INFO:tasks.workunit.client.1.smithi172.stdout:8/617: write d0/f85 [2128450,31161] 0 2024-03-19T06:05:39.125 INFO:tasks.workunit.client.1.smithi172.stdout:6/771: rename d5/f8 to d5/d8f/d31/d3d/d98/db6/dc7/ff2 0 2024-03-19T06:05:39.128 INFO:tasks.workunit.client.1.smithi172.stdout:5/603: dwrite d5/d3c/d6c/dbd/fc4 [0,4194304] 0 2024-03-19T06:05:39.129 INFO:tasks.workunit.client.1.smithi172.stdout:2/636: truncate d7/db/d2c/f6f 67238 0 2024-03-19T06:05:39.132 INFO:tasks.workunit.client.1.smithi172.stdout:4/710: dread df/fe4 [4194304,4194304] 0 2024-03-19T06:05:39.134 INFO:tasks.workunit.client.1.smithi172.stdout:7/635: mknod d0/d22/d1d/d36/d8d/d7d/dbf/cd4 0 2024-03-19T06:05:39.135 INFO:tasks.workunit.client.1.smithi172.stdout:9/660: truncate d1/d7/dc/d47/d78/f7e 350104 0 2024-03-19T06:05:39.139 INFO:tasks.workunit.client.1.smithi172.stdout:8/618: creat d0/d61/d6e/fc5 x:0 0 0 2024-03-19T06:05:39.145 INFO:tasks.workunit.client.1.smithi172.stdout:7/636: write d0/d22/d1d/d36/f23 [3475391,97945] 0 2024-03-19T06:05:39.147 INFO:tasks.workunit.client.1.smithi172.stdout:6/772: rename d5/d8f/d31/d3d/d98/dad to d5/d8f/d31/d84/df3 0 2024-03-19T06:05:39.151 INFO:tasks.workunit.client.1.smithi172.stdout:2/637: symlink d7/de/d58/d55/d5f/da2/ld5 0 2024-03-19T06:05:39.155 INFO:tasks.workunit.client.1.smithi172.stdout:6/773: mkdir d5/d11/d17/d36/df4 0 2024-03-19T06:05:39.158 INFO:tasks.workunit.client.1.smithi172.stdout:1/666: rename da/d3b/d95/faa to da/dd/d31/d47/fe4 0 2024-03-19T06:05:39.159 INFO:tasks.workunit.client.1.smithi172.stdout:2/638: write d7/de/d58/d56/f6b [2041335,59591] 0 2024-03-19T06:05:39.160 INFO:tasks.workunit.client.1.smithi172.stdout:4/711: write df/f2e [3879905,107514] 0 2024-03-19T06:05:39.160 INFO:tasks.workunit.client.1.smithi172.stdout:8/619: write d0/d44/d46/d49/d26/f51 [413544,29164] 0 2024-03-19T06:05:39.165 INFO:tasks.workunit.client.1.smithi172.stdout:3/673: dread d0/d5/d14/f17 [0,4194304] 0 2024-03-19T06:05:39.165 INFO:tasks.workunit.client.1.smithi172.stdout:6/774: mkdir d5/df5 0 2024-03-19T06:05:39.168 INFO:tasks.workunit.client.1.smithi172.stdout:4/712: mknod df/dd7/ce8 0 2024-03-19T06:05:39.172 INFO:tasks.workunit.client.1.smithi172.stdout:3/674: chown d0/d5/le6 35314754 1 2024-03-19T06:05:39.176 INFO:tasks.workunit.client.1.smithi172.stdout:3/675: fdatasync d0/da8/dce/da7/fdb 0 2024-03-19T06:05:39.176 INFO:tasks.workunit.client.1.smithi172.stdout:9/661: dwrite d1/d7/dc/f14 [0,4194304] 0 2024-03-19T06:05:39.177 INFO:tasks.workunit.client.1.smithi172.stdout:6/775: creat d5/d8f/d31/d3d/ff6 x:0 0 0 2024-03-19T06:05:39.185 INFO:tasks.workunit.client.1.smithi172.stdout:6/776: stat d5/d11/d2f/l4a 0 2024-03-19T06:05:39.185 INFO:tasks.workunit.client.1.smithi172.stdout:4/713: mknod df/d11/d12/d34/ce9 0 2024-03-19T06:05:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.194+0000 7f72ce200700 1 -- 172.21.15.72:0/1154839514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c8100240 msgr2=0x7f72c8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.194+0000 7f72ce200700 1 --2- 172.21.15.72:0/1154839514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c8100240 0x7f72c8100650 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009910 tx=0x7f72b8009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.194+0000 7f72ce200700 1 -- 172.21.15.72:0/1154839514 shutdown_connections 2024-03-19T06:05:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.194+0000 7f72ce200700 1 --2- 172.21.15.72:0/1154839514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c8101440 0x7f72c8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.194+0000 7f72ce200700 1 --2- 172.21.15.72:0/1154839514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c8100240 0x7f72c8100650 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.194+0000 7f72ce200700 1 -- 172.21.15.72:0/1154839514 >> 172.21.15.72:0/1154839514 conn(0x7f72c80fb7f0 msgr2=0x7f72c80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.195+0000 7f72ce200700 1 -- 172.21.15.72:0/1154839514 shutdown_connections 2024-03-19T06:05:39.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.195+0000 7f72ce200700 1 -- 172.21.15.72:0/1154839514 wait complete. 2024-03-19T06:05:39.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.196+0000 7f72ce200700 1 Processor -- start 2024-03-19T06:05:39.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.196+0000 7f72ce200700 1 -- start start 2024-03-19T06:05:39.187 INFO:tasks.workunit.client.1.smithi172.stdout:5/604: dwrite d5/d3c/d6c/d9b/fc7 [0,4194304] 0 2024-03-19T06:05:39.187 INFO:tasks.workunit.client.1.smithi172.stdout:8/620: truncate d0/d44/d46/d49/d26/f7b 980973 0 2024-03-19T06:05:39.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.197+0000 7f72ce200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c8100240 0x7f72c8197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:39.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.197+0000 7f72ce200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c8101440 0x7f72c81981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:39.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.197+0000 7f72ce200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c81987f0 con 0x7f72c8101440 2024-03-19T06:05:39.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.197+0000 7f72ce200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c8198960 con 0x7f72c8100240 2024-03-19T06:05:39.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.198+0000 7f72c6a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c8101440 0x7f72c81981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:39.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.198+0000 7f72c6a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c8101440 0x7f72c81981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54426/0 (socket says 172.21.15.72:54426) 2024-03-19T06:05:39.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.198+0000 7f72c6a00700 1 -- 172.21.15.72:0/3099218306 learned_addr learned my addr 172.21.15.72:0/3099218306 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:39.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.198+0000 7f72c6a00700 1 -- 172.21.15.72:0/3099218306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c8100240 msgr2=0x7f72c8197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:39.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.198+0000 7f72c6a00700 1 --2- 172.21.15.72:0/3099218306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c8100240 0x7f72c8197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:39.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.198+0000 7f72c6a00700 1 -- 172.21.15.72:0/3099218306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b80095f0 con 0x7f72c8101440 2024-03-19T06:05:39.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.198+0000 7f72c6a00700 1 --2- 172.21.15.72:0/3099218306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c8101440 0x7f72c81981f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f72b400c8a0 tx=0x7f72b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:39.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.199+0000 7f72bfe00700 1 -- 172.21.15.72:0/3099218306 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b400cea0 con 0x7f72c8101440 2024-03-19T06:05:39.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.199+0000 7f72ce200700 1 -- 172.21.15.72:0/3099218306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c819d3f0 con 0x7f72c8101440 2024-03-19T06:05:39.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.199+0000 7f72bfe00700 1 -- 172.21.15.72:0/3099218306 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f72b4004830 con 0x7f72c8101440 2024-03-19T06:05:39.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.199+0000 7f72bfe00700 1 -- 172.21.15.72:0/3099218306 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b40055b0 con 0x7f72c8101440 2024-03-19T06:05:39.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.199+0000 7f72ce200700 1 -- 172.21.15.72:0/3099218306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c819d940 con 0x7f72c8101440 2024-03-19T06:05:39.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.200+0000 7f72ce200700 1 -- 172.21.15.72:0/3099218306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c8105520 con 0x7f72c8101440 2024-03-19T06:05:39.191 INFO:tasks.workunit.client.1.smithi172.stdout:5/605: chown d5/d14/d15/d40/d6a/f6d 14656 1 2024-03-19T06:05:39.192 INFO:tasks.workunit.client.1.smithi172.stdout:5/606: chown d5/d14/l41 34664115 1 2024-03-19T06:05:39.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.202+0000 7f72bfe00700 1 -- 172.21.15.72:0/3099218306 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7f72b4007ad0 con 0x7f72c8101440 2024-03-19T06:05:39.192 INFO:tasks.workunit.client.1.smithi172.stdout:8/621: write d0/d61/d6a/d9f/fb0 [380481,66190] 0 2024-03-19T06:05:39.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.203+0000 7f72bfe00700 1 --2- 172.21.15.72:0/3099218306 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f72ac06dd50 0x7f72ac070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:39.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.203+0000 7f72bfe00700 1 -- 172.21.15.72:0/3099218306 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f72b408d7b0 con 0x7f72c8101440 2024-03-19T06:05:39.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.204+0000 7f72c7400700 1 --2- 172.21.15.72:0/3099218306 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f72ac06dd50 0x7f72ac070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:39.195 INFO:tasks.workunit.client.1.smithi172.stdout:6/777: write d5/d11/d17/d36/dca/fcb [685371,72966] 0 2024-03-19T06:05:39.196 INFO:tasks.workunit.client.1.smithi172.stdout:4/714: creat df/d2b/d2d/db0/fea x:0 0 0 2024-03-19T06:05:39.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.206+0000 7f72c7400700 1 --2- 172.21.15.72:0/3099218306 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f72ac06dd50 0x7f72ac070200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f72b8005090 tx=0x7f72b8005fb0 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:39.198 INFO:tasks.workunit.client.1.smithi172.stdout:5/607: creat d5/d1f/d2f/d62/fcc x:0 0 0 2024-03-19T06:05:39.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.209+0000 7f72bfe00700 1 -- 172.21.15.72:0/3099218306 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f72b4056f10 con 0x7f72c8101440 2024-03-19T06:05:39.207 INFO:tasks.workunit.client.1.smithi172.stdout:8/622: getdents d0/d44/d46/d49 0 2024-03-19T06:05:39.207 INFO:tasks.workunit.client.1.smithi172.stdout:2/639: truncate d7/de/d61/f65 2990054 0 2024-03-19T06:05:39.212 INFO:tasks.workunit.client.1.smithi172.stdout:7/637: dread d0/d22/d27/db0/f30 [0,4194304] 0 2024-03-19T06:05:39.215 INFO:tasks.workunit.client.1.smithi172.stdout:5/608: creat d5/d1f/fcd x:0 0 0 2024-03-19T06:05:39.219 INFO:tasks.workunit.client.1.smithi172.stdout:3/676: dread d0/d5/d6b/f8f [0,4194304] 0 2024-03-19T06:05:39.219 INFO:tasks.workunit.client.1.smithi172.stdout:1/667: dread da/dd/d10/f1d [0,4194304] 0 2024-03-19T06:05:39.224 INFO:tasks.workunit.client.1.smithi172.stdout:8/623: rmdir d0/d44/d46/d49/d26/d71/d81/d27/d29/db3 0 2024-03-19T06:05:39.224 INFO:tasks.workunit.client.1.smithi172.stdout:7/638: creat d0/d22/d35/dc7/fd5 x:0 0 0 2024-03-19T06:05:39.226 INFO:tasks.workunit.client.1.smithi172.stdout:5/609: dread - d5/d3d/d60/f95 zero size 2024-03-19T06:05:39.228 INFO:tasks.workunit.client.1.smithi172.stdout:9/662: dwrite d1/f75 [0,4194304] 0 2024-03-19T06:05:39.236 INFO:tasks.workunit.client.1.smithi172.stdout:7/639: stat d0/d22/d1d/d36/d40/f4e 0 2024-03-19T06:05:39.236 INFO:tasks.workunit.client.1.smithi172.stdout:1/668: unlink da/d33/d4e/f9f 0 2024-03-19T06:05:39.238 INFO:tasks.workunit.client.1.smithi172.stdout:8/624: mkdir d0/d44/d46/d49/d26/dbc/dc6 0 2024-03-19T06:05:39.240 INFO:tasks.workunit.client.1.smithi172.stdout:0/680: sync 2024-03-19T06:05:39.241 INFO:tasks.workunit.client.1.smithi172.stdout:2/640: dread d7/db/f24 [0,4194304] 0 2024-03-19T06:05:39.241 INFO:tasks.workunit.client.1.smithi172.stdout:6/778: dwrite d5/d8f/d31/d3d/ff6 [0,4194304] 0 2024-03-19T06:05:39.242 INFO:tasks.workunit.client.1.smithi172.stdout:3/677: getdents d0/da8/d34/d4d 0 2024-03-19T06:05:39.244 INFO:tasks.workunit.client.1.smithi172.stdout:1/669: fdatasync da/dd/d31/d97/fa1 0 2024-03-19T06:05:39.245 INFO:tasks.workunit.client.1.smithi172.stdout:0/681: chown d11/f60 43 1 2024-03-19T06:05:39.251 INFO:tasks.workunit.client.1.smithi172.stdout:9/663: symlink d1/d7/dc/d47/da3/d7d/le7 0 2024-03-19T06:05:39.251 INFO:tasks.workunit.client.1.smithi172.stdout:3/678: write d0/da8/d60/d67/f7d [680950,21864] 0 2024-03-19T06:05:39.251 INFO:tasks.workunit.client.1.smithi172.stdout:0/682: write d11/d4d/fe6 [932509,35467] 0 2024-03-19T06:05:39.255 INFO:tasks.workunit.client.1.smithi172.stdout:3/679: readlink d0/da8/d25/l57 0 2024-03-19T06:05:39.256 INFO:tasks.workunit.client.1.smithi172.stdout:0/683: stat d11/d14/d2c/lba 0 2024-03-19T06:05:39.259 INFO:tasks.workunit.client.1.smithi172.stdout:4/715: dread df/d11/d12/f1a [0,4194304] 0 2024-03-19T06:05:39.259 INFO:tasks.workunit.client.1.smithi172.stdout:3/680: chown d0/d5/d6b 91232 1 2024-03-19T06:05:39.261 INFO:tasks.workunit.client.1.smithi172.stdout:5/610: dread d5/d14/d56/f8c [0,4194304] 0 2024-03-19T06:05:39.261 INFO:tasks.workunit.client.1.smithi172.stdout:1/670: truncate da/dd/d10/d14/d27/d53/fd2 640583 0 2024-03-19T06:05:39.261 INFO:tasks.workunit.client.1.smithi172.stdout:3/681: chown d0/da8/d54/d90 690272926 1 2024-03-19T06:05:39.269 INFO:tasks.workunit.client.1.smithi172.stdout:1/671: dread da/dd/d10/d14/d27/d3f/d5e/fd7 [0,4194304] 0 2024-03-19T06:05:39.274 INFO:tasks.workunit.client.1.smithi172.stdout:1/672: link da/dd/d10/d14/d84/ca3 da/dd/d10/d14/d27/d3f/d5e/dab/ce5 0 2024-03-19T06:05:39.278 INFO:tasks.workunit.client.1.smithi172.stdout:1/673: symlink da/dd/d10/d14/d73/le6 0 2024-03-19T06:05:39.358 INFO:tasks.workunit.client.1.smithi172.stdout:5/611: sync 2024-03-19T06:05:39.359 INFO:tasks.workunit.client.1.smithi172.stdout:5/612: chown d5/d14/d34/f94 6 1 2024-03-19T06:05:39.361 INFO:tasks.workunit.client.1.smithi172.stdout:5/613: dread - d5/d14/d9f/fc6 zero size 2024-03-19T06:05:39.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.453+0000 7f72ce200700 1 -- 172.21.15.72:0/3099218306 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f72c8061190 con 0x7f72ac06dd50 2024-03-19T06:05:39.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.479+0000 7f72bfe00700 1 -- 172.21.15.72:0/3099218306 <== mgr.14702 v2:172.21.15.72:6800/2640845307 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f72c8061190 con 0x7f72ac06dd50 2024-03-19T06:05:39.471 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:05:39.471 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (10m) 16s ago 12m 14.0M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:05:39.471 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (12m) 16s ago 12m 7847k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:05:39.471 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (10m) 15s ago 10m 7704k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:05:39.471 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (12m) 16s ago 12m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:05:39.471 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (10m) 15s ago 10m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:05:39.472 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (9m) 16s ago 11m 71.8M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:05:39.472 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (4m) 16s ago 4m 14.1M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:05:39.472 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (4m) 16s ago 4m 123M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:05:39.472 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (4m) 15s ago 4m 14.1M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:05:39.472 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (4m) 15s ago 4m 114M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:05:39.472 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (49s) 16s ago 13m 475M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:05:39.472 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (107s) 15s ago 10m 72.0M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 1aabb23d2304 2024-03-19T06:05:39.473 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (14m) 16s ago 14m 52.9M 2048M 18.2.0 dc2bc1663786 77289e9e2b33 2024-03-19T06:05:39.473 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (10m) 15s ago 10m 42.1M 2048M 18.2.0 dc2bc1663786 31fba31e7d8a 2024-03-19T06:05:39.473 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (12m) 16s ago 12m 8208k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:05:39.473 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (10m) 15s ago 10m 7792k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:05:39.474 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (9m) 16s ago 9m 86.8M 1216M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:05:39.474 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (8m) 16s ago 8m 97.8M 1216M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:05:39.474 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (8m) 16s ago 8m 81.8M 1216M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:05:39.474 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (7m) 15s ago 7m 100M 2241M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:05:39.474 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (7m) 15s ago 7m 91.2M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:05:39.474 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (6m) 15s ago 6m 87.5M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:05:39.475 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (59s) 16s ago 11m 52.8M - 2.43.0 a07b618ecd1d 6f898c87718b 2024-03-19T06:05:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.482+0000 7f72ce200700 1 -- 172.21.15.72:0/3099218306 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f72ac06dd50 msgr2=0x7f72ac070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.482+0000 7f72ce200700 1 --2- 172.21.15.72:0/3099218306 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f72ac06dd50 0x7f72ac070200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f72b8005090 tx=0x7f72b8005fb0 comp rx=0 tx=0).stop 2024-03-19T06:05:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.482+0000 7f72ce200700 1 -- 172.21.15.72:0/3099218306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c8101440 msgr2=0x7f72c81981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.482+0000 7f72ce200700 1 --2- 172.21.15.72:0/3099218306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c8101440 0x7f72c81981f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f72b400c8a0 tx=0x7f72b400cc60 comp rx=0 tx=0).stop 2024-03-19T06:05:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.482+0000 7f72ce200700 1 -- 172.21.15.72:0/3099218306 shutdown_connections 2024-03-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.482+0000 7f72ce200700 1 --2- 172.21.15.72:0/3099218306 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f72ac06dd50 0x7f72ac070200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.482+0000 7f72ce200700 1 --2- 172.21.15.72:0/3099218306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c8100240 0x7f72c8197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.482+0000 7f72ce200700 1 --2- 172.21.15.72:0/3099218306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c8101440 0x7f72c81981f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.482+0000 7f72ce200700 1 -- 172.21.15.72:0/3099218306 >> 172.21.15.72:0/3099218306 conn(0x7f72c80fb7f0 msgr2=0x7f72c8102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.482+0000 7f72ce200700 1 -- 172.21.15.72:0/3099218306 shutdown_connections 2024-03-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.482+0000 7f72ce200700 1 -- 172.21.15.72:0/3099218306 wait complete. 2024-03-19T06:05:39.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:39 smithi172 ceph-mon[35716]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:39.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:39 smithi172 ceph-mon[35716]: pgmap v16: 65 pgs: 65 active+clean; 1.4 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 42 MiB/s rd, 157 MiB/s wr, 297 op/s 2024-03-19T06:05:39.673 INFO:tasks.workunit.client.0.smithi072.stdout:0/7: sync 2024-03-19T06:05:39.673 INFO:tasks.workunit.client.0.smithi072.stdout:0/8: dwrite - no filename 2024-03-19T06:05:39.673 INFO:tasks.workunit.client.0.smithi072.stdout:0/9: fsync - no filename 2024-03-19T06:05:39.676 INFO:tasks.workunit.client.1.smithi172.stdout:7/640: symlink d0/d22/d1d/d36/d8d/ld6 0 2024-03-19T06:05:39.677 INFO:tasks.workunit.client.1.smithi172.stdout:6/779: dread d5/d11/d17/d1b/d74/fb4 [0,4194304] 0 2024-03-19T06:05:39.678 INFO:tasks.workunit.client.0.smithi072.stdout:0/10: rename d1 to d1/d3 22 2024-03-19T06:05:39.678 INFO:tasks.workunit.client.0.smithi072.stdout:0/11: dread - no filename 2024-03-19T06:05:39.678 INFO:tasks.workunit.client.0.smithi072.stdout:0/12: truncate - no filename 2024-03-19T06:05:39.682 INFO:tasks.workunit.client.1.smithi172.stdout:2/641: rename d7/d1b/f1f to d7/de/d58/d57/fd6 0 2024-03-19T06:05:39.684 INFO:tasks.workunit.client.1.smithi172.stdout:3/682: creat d0/da8/dce/da7/fea x:0 0 0 2024-03-19T06:05:39.685 INFO:tasks.workunit.client.1.smithi172.stdout:6/780: truncate d5/d8f/d31/d7b/fba 1408161 0 2024-03-19T06:05:39.686 INFO:tasks.workunit.client.1.smithi172.stdout:4/716: creat df/d11/d12/d21/d50/d63/dbb/dc4/dd3/feb x:0 0 0 2024-03-19T06:05:39.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.693+0000 7f6568a00700 1 -- 172.21.15.72:0/3423566827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65641012d0 msgr2=0x7f6564101740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:39.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.693+0000 7f6568a00700 1 --2- 172.21.15.72:0/3423566827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65641012d0 0x7f6564101740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6550009910 tx=0x7f6550009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:39.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.694+0000 7f6568a00700 1 -- 172.21.15.72:0/3423566827 shutdown_connections 2024-03-19T06:05:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.694+0000 7f6568a00700 1 --2- 172.21.15.72:0/3423566827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65641012d0 0x7f6564101740 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.694+0000 7f6568a00700 1 --2- 172.21.15.72:0/3423566827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6564100030 0x7f6564100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.694+0000 7f6568a00700 1 -- 172.21.15.72:0/3423566827 >> 172.21.15.72:0/3423566827 conn(0x7f65640fb680 msgr2=0x7f65640fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.694+0000 7f6568a00700 1 -- 172.21.15.72:0/3423566827 shutdown_connections 2024-03-19T06:05:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.694+0000 7f6568a00700 1 -- 172.21.15.72:0/3423566827 wait complete. 2024-03-19T06:05:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.696+0000 7f6568a00700 1 Processor -- start 2024-03-19T06:05:39.687 INFO:tasks.workunit.client.1.smithi172.stdout:5/614: symlink d5/d1f/d2f/d62/lce 0 2024-03-19T06:05:39.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.696+0000 7f6568a00700 1 -- start start 2024-03-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.696+0000 7f6568a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6564100030 0x7f6564197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.696+0000 7f6568a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65641012d0 0x7f6564197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.696+0000 7f6568a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6564198570 con 0x7f6564100030 2024-03-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.696+0000 7f6568a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65641986b0 con 0x7f65641012d0 2024-03-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.697+0000 7f6562a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65641012d0 0x7f6564197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.697+0000 7f6563400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6564100030 0x7f6564197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.697+0000 7f6562a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65641012d0 0x7f6564197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:36706/0 (socket says 172.21.15.72:36706) 2024-03-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.697+0000 7f6562a00700 1 -- 172.21.15.72:0/701625870 learned_addr learned my addr 172.21.15.72:0/701625870 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.698+0000 7f6563400700 1 -- 172.21.15.72:0/701625870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65641012d0 msgr2=0x7f6564197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.698+0000 7f6563400700 1 --2- 172.21.15.72:0/701625870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65641012d0 0x7f6564197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.698+0000 7f6563400700 1 -- 172.21.15.72:0/701625870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500095f0 con 0x7f6564100030 2024-03-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.698+0000 7f6563400700 1 --2- 172.21.15.72:0/701625870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6564100030 0x7f6564197a10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f655400c8f0 tx=0x7f655400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:39.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.698+0000 7f655be00700 1 -- 172.21.15.72:0/701625870 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f655400e850 con 0x7f6564100030 2024-03-19T06:05:39.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.698+0000 7f655be00700 1 -- 172.21.15.72:0/701625870 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f655400ee60 con 0x7f6564100030 2024-03-19T06:05:39.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.699+0000 7f6568a00700 1 -- 172.21.15.72:0/701625870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656406a910 con 0x7f6564100030 2024-03-19T06:05:39.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.699+0000 7f655be00700 1 -- 172.21.15.72:0/701625870 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6554018630 con 0x7f6564100030 2024-03-19T06:05:39.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.699+0000 7f6568a00700 1 -- 172.21.15.72:0/701625870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656406ae60 con 0x7f6564100030 2024-03-19T06:05:39.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.700+0000 7f6568a00700 1 -- 172.21.15.72:0/701625870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65641053b0 con 0x7f6564100030 2024-03-19T06:05:39.691 INFO:tasks.workunit.client.1.smithi172.stdout:1/674: mknod da/dd/d31/ce7 0 2024-03-19T06:05:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.703+0000 7f655be00700 1 -- 172.21.15.72:0/701625870 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7f655400f8a0 con 0x7f6564100030 2024-03-19T06:05:39.694 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:39 smithi072 ceph-mon[28706]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:39.694 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:39 smithi072 ceph-mon[28706]: pgmap v16: 65 pgs: 65 active+clean; 1.4 GiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 42 MiB/s rd, 157 MiB/s wr, 297 op/s 2024-03-19T06:05:39.694 INFO:tasks.workunit.client.1.smithi172.stdout:1/675: creat da/d33/d78/fe8 x:0 0 0 2024-03-19T06:05:39.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.704+0000 7f655be00700 1 --2- 172.21.15.72:0/701625870 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f654806dd50 0x7f6548070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:39.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.704+0000 7f655be00700 1 -- 172.21.15.72:0/701625870 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f655408d870 con 0x7f6564100030 2024-03-19T06:05:39.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.704+0000 7f6562a00700 1 --2- 172.21.15.72:0/701625870 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f654806dd50 0x7f6548070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:39.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.705+0000 7f6562a00700 1 --2- 172.21.15.72:0/701625870 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f654806dd50 0x7f6548070200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6550006010 tx=0x7f6550005ab0 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:39.699 INFO:tasks.workunit.client.1.smithi172.stdout:1/676: unlink da/dd/d31/f4d 0 2024-03-19T06:05:39.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:39.709+0000 7f655be00700 1 -- 172.21.15.72:0/701625870 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f655405a890 con 0x7f6564100030 2024-03-19T06:05:39.703 INFO:tasks.workunit.client.1.smithi172.stdout:1/677: fdatasync da/dd/d10/d14/d27/f5a 0 2024-03-19T06:05:39.708 INFO:tasks.workunit.client.1.smithi172.stdout:7/641: symlink d0/d22/d35/ld7 0 2024-03-19T06:05:39.712 INFO:tasks.workunit.client.1.smithi172.stdout:0/684: rename d11/d4d to d11/d14/d9a/dea 0 2024-03-19T06:05:39.713 INFO:tasks.workunit.client.1.smithi172.stdout:3/683: mknod d0/da8/dce/da7/ceb 0 2024-03-19T06:05:39.713 INFO:tasks.workunit.client.1.smithi172.stdout:2/642: truncate d7/d1b/f69 2846884 0 2024-03-19T06:05:39.715 INFO:tasks.workunit.client.1.smithi172.stdout:4/717: creat df/d11/d12/d21/d58/da6/fec x:0 0 0 2024-03-19T06:05:39.721 INFO:tasks.workunit.client.1.smithi172.stdout:4/718: chown df/d11 67720 1 2024-03-19T06:05:39.721 INFO:tasks.workunit.client.1.smithi172.stdout:9/664: creat d1/d7/dc/fe8 x:0 0 0 2024-03-19T06:05:39.721 INFO:tasks.workunit.client.1.smithi172.stdout:8/625: link d0/d44/d46/d49/d26/dc0/d76/lbb d0/d61/d6a/d7e/lc7 0 2024-03-19T06:05:39.722 INFO:tasks.workunit.client.1.smithi172.stdout:6/781: rename d5/d8f/d31/d3d/d95/fce to d5/d8f/d31/d3d/d98/db6/d40/ff7 0 2024-03-19T06:05:39.725 INFO:tasks.workunit.client.1.smithi172.stdout:1/678: getdents da/d3b 0 2024-03-19T06:05:39.733 INFO:tasks.workunit.client.1.smithi172.stdout:7/642: rename d0/d22/d27/db0/d92/fb2 to d0/d22/d1d/dc8/fd8 0 2024-03-19T06:05:39.735 INFO:tasks.workunit.client.1.smithi172.stdout:1/679: mkdir da/d3b/dcd/de9 0 2024-03-19T06:05:39.738 INFO:tasks.workunit.client.1.smithi172.stdout:3/684: getdents d0/da8/d25/d21 0 2024-03-19T06:05:39.739 INFO:tasks.workunit.client.1.smithi172.stdout:7/643: chown d0/d22/d1d/d85/fbd 2673377 1 2024-03-19T06:05:39.740 INFO:tasks.workunit.client.1.smithi172.stdout:4/719: dread df/d11/d12/d21/d58/fdc [0,4194304] 0 2024-03-19T06:05:39.743 INFO:tasks.workunit.client.1.smithi172.stdout:9/665: creat d1/d7/fe9 x:0 0 0 2024-03-19T06:05:39.745 INFO:tasks.workunit.client.1.smithi172.stdout:1/680: getdents da/d33/d59/dc1 0 2024-03-19T06:05:39.746 INFO:tasks.workunit.client.1.smithi172.stdout:8/626: creat d0/d44/d46/d49/d26/d71/d81/d27/d65/fc8 x:0 0 0 2024-03-19T06:05:39.748 INFO:tasks.workunit.client.1.smithi172.stdout:1/681: chown da/dd/d10/d14/d84 216860 1 2024-03-19T06:05:39.748 INFO:tasks.workunit.client.1.smithi172.stdout:7/644: rmdir d0/d22/d1d/d36/d40 39 2024-03-19T06:05:39.749 INFO:tasks.workunit.client.1.smithi172.stdout:8/627: chown d0/d44/d46/d49 5717548 1 2024-03-19T06:05:39.751 INFO:tasks.workunit.client.1.smithi172.stdout:5/615: dread d5/d14/d15/d40/d6a/f6d [0,4194304] 0 2024-03-19T06:05:39.751 INFO:tasks.workunit.client.1.smithi172.stdout:6/782: mkdir d5/d8f/d31/d3d/d98/db6/d40/d53/d75/df8 0 2024-03-19T06:05:39.753 INFO:tasks.workunit.client.1.smithi172.stdout:7/645: chown d0/d22/d27/d86 7928 1 2024-03-19T06:05:39.753 INFO:tasks.workunit.client.1.smithi172.stdout:9/666: symlink d1/d7/dc/de/lea 0 2024-03-19T06:05:39.754 INFO:tasks.workunit.client.1.smithi172.stdout:5/616: fsync d5/d3d/f8d 0 2024-03-19T06:05:39.755 INFO:tasks.workunit.client.1.smithi172.stdout:2/643: dwrite d7/de/fcc [0,4194304] 0 2024-03-19T06:05:39.763 INFO:tasks.workunit.client.1.smithi172.stdout:2/644: read - d7/de/d58/d56/d86/d9d/dab/fb7 zero size 2024-03-19T06:05:39.763 INFO:tasks.workunit.client.1.smithi172.stdout:1/682: creat da/dd/d10/fea x:0 0 0 2024-03-19T06:05:39.764 INFO:tasks.workunit.client.1.smithi172.stdout:2/645: fdatasync d7/de/d58/d55/f82 0 2024-03-19T06:05:39.764 INFO:tasks.workunit.client.1.smithi172.stdout:9/667: symlink d1/d7/dc/d47/da3/d7d/leb 0 2024-03-19T06:05:39.767 INFO:tasks.workunit.client.1.smithi172.stdout:7/646: symlink d0/d22/d1d/d85/da8/ld9 0 2024-03-19T06:05:39.772 INFO:tasks.workunit.client.1.smithi172.stdout:8/628: mkdir d0/d44/d46/d49/d26/dc0/d76/dc3/dc9 0 2024-03-19T06:05:39.773 INFO:tasks.workunit.client.1.smithi172.stdout:8/629: chown d0/f1f 1163 1 2024-03-19T06:05:39.775 INFO:tasks.workunit.client.1.smithi172.stdout:2/646: mknod d7/de/d58/d56/d89/db5/dca/cd7 0 2024-03-19T06:05:39.778 INFO:tasks.workunit.client.1.smithi172.stdout:4/720: dread df/d11/f32 [0,4194304] 0 2024-03-19T06:05:39.778 INFO:tasks.workunit.client.1.smithi172.stdout:6/783: rename d5/d11/d2f to d5/d8f/d31/d3d/d98/df9 0 2024-03-19T06:05:39.784 INFO:tasks.workunit.client.1.smithi172.stdout:7/647: rename d0/d22/d1d/d36/d56/cc1 to d0/d22/d3d/d41/cda 0 2024-03-19T06:05:39.785 INFO:tasks.workunit.client.1.smithi172.stdout:4/721: read df/d11/f37 [1119117,35592] 0 2024-03-19T06:05:39.787 INFO:tasks.workunit.client.1.smithi172.stdout:6/784: mkdir d5/d11/d43/d45/da1/de1/dfa 0 2024-03-19T06:05:39.789 INFO:tasks.workunit.client.1.smithi172.stdout:9/668: link d1/d7/dc/de/d34/d48/d82/c9a d1/cec 0 2024-03-19T06:05:39.791 INFO:tasks.workunit.client.1.smithi172.stdout:4/722: symlink df/d11/d12/d26/daf/led 0 2024-03-19T06:05:39.796 INFO:tasks.workunit.client.1.smithi172.stdout:0/685: write d11/d14/d2c/d4e/f64 [1728449,21938] 0 2024-03-19T06:05:39.796 INFO:tasks.workunit.client.1.smithi172.stdout:1/683: dwrite da/dd/d31/d47/dbf/fc0 [0,4194304] 0 2024-03-19T06:05:39.800 INFO:tasks.workunit.client.1.smithi172.stdout:4/723: chown df/d11/d12/d21/d50/d63/dbb/dc4/cd4 203176564 1 2024-03-19T06:05:39.802 INFO:tasks.workunit.client.1.smithi172.stdout:1/684: mkdir da/d3b/dcd/deb 0 2024-03-19T06:05:39.803 INFO:tasks.workunit.client.1.smithi172.stdout:0/686: mknod d11/d22/d32/daf/ceb 0 2024-03-19T06:05:39.808 INFO:tasks.workunit.client.1.smithi172.stdout:5/617: write d5/d14/d15/d40/f99 [1594595,87086] 0 2024-03-19T06:05:39.808 INFO:tasks.workunit.client.1.smithi172.stdout:9/669: getdents d1/d7/dd4 0 2024-03-19T06:05:39.809 INFO:tasks.workunit.client.1.smithi172.stdout:7/648: dread d0/d22/d1d/d3a/d46/f78 [0,4194304] 0 2024-03-19T06:05:39.810 INFO:tasks.workunit.client.1.smithi172.stdout:5/618: chown d5/d55/d91 3236 1 2024-03-19T06:05:39.810 INFO:tasks.workunit.client.1.smithi172.stdout:0/687: truncate d11/fb8 862118 0 2024-03-19T06:05:39.820 INFO:tasks.workunit.client.1.smithi172.stdout:9/670: mknod d1/d7/dc/de/d34/d48/d82/ced 0 2024-03-19T06:05:39.828 INFO:tasks.workunit.client.1.smithi172.stdout:5/619: write d5/d14/d15/f42 [311496,95451] 0 2024-03-19T06:05:39.831 INFO:tasks.workunit.client.1.smithi172.stdout:0/688: write d11/d18/d38/d3f/d43/d62/f95 [861905,28087] 0 2024-03-19T06:05:39.832 INFO:tasks.workunit.client.1.smithi172.stdout:2/647: dread d7/d1b/f69 [0,4194304] 0 2024-03-19T06:05:39.833 INFO:tasks.workunit.client.1.smithi172.stdout:9/671: write d1/d7/dc/dbe/dc9/fe3 [347455,76159] 0 2024-03-19T06:05:39.833 INFO:tasks.workunit.client.1.smithi172.stdout:8/630: dwrite d0/d61/d6a/d7e/f7f [0,4194304] 0 2024-03-19T06:05:39.838 INFO:tasks.workunit.client.1.smithi172.stdout:0/689: read d11/f13 [1878259,102926] 0 2024-03-19T06:05:39.838 INFO:tasks.workunit.client.1.smithi172.stdout:6/785: dwrite d5/d8f/d31/f67 [0,4194304] 0 2024-03-19T06:05:39.844 INFO:tasks.workunit.client.1.smithi172.stdout:1/685: write da/dd/d10/f2f [7901242,51114] 0 2024-03-19T06:05:39.851 INFO:tasks.workunit.client.1.smithi172.stdout:1/686: write da/dd/d31/d47/fd3 [121977,94099] 0 2024-03-19T06:05:39.856 INFO:tasks.workunit.client.1.smithi172.stdout:6/786: unlink d5/d8f/d31/d3d/d98/db6/d40/ff7 0 2024-03-19T06:05:39.858 INFO:tasks.workunit.client.1.smithi172.stdout:5/620: dread d5/f27 [0,4194304] 0 2024-03-19T06:05:39.860 INFO:tasks.workunit.client.1.smithi172.stdout:9/672: dwrite d1/d7/dc/dbe/dc9/fda [0,4194304] 0 2024-03-19T06:05:39.869 INFO:tasks.workunit.client.1.smithi172.stdout:9/673: stat d1/d7/dc/de/d34/d48/d82/c9a 0 2024-03-19T06:05:39.870 INFO:tasks.workunit.client.1.smithi172.stdout:5/621: creat d5/d55/d91/fcf x:0 0 0 2024-03-19T06:05:39.870 INFO:tasks.workunit.client.1.smithi172.stdout:7/649: dread d0/d22/d1d/d36/f39 [0,4194304] 0 2024-03-19T06:05:39.873 INFO:tasks.workunit.client.1.smithi172.stdout:6/787: rename d5/d8f/d31/d3d/d98/db6/d40/d53/fc0 to d5/d11/d17/d36/ffb 0 2024-03-19T06:05:39.878 INFO:tasks.workunit.client.1.smithi172.stdout:0/690: write d11/d18/d38/d3f/dbe/fd3 [780369,17788] 0 2024-03-19T06:05:39.880 INFO:tasks.workunit.client.1.smithi172.stdout:7/650: fdatasync d0/d22/d1d/f7b 0 2024-03-19T06:05:39.881 INFO:tasks.workunit.client.1.smithi172.stdout:5/622: chown d5/d55/c59 74 1 2024-03-19T06:05:39.887 INFO:tasks.workunit.client.1.smithi172.stdout:2/648: dwrite d7/de/d58/d56/f1c [0,4194304] 0 2024-03-19T06:05:39.893 INFO:tasks.workunit.client.1.smithi172.stdout:7/651: mkdir d0/d22/d1d/d36/d40/ddb 0 2024-03-19T06:05:39.894 INFO:tasks.workunit.client.1.smithi172.stdout:5/623: creat d5/d1f/db4/db9/fd0 x:0 0 0 2024-03-19T06:05:39.894 INFO:tasks.workunit.client.1.smithi172.stdout:3/685: sync 2024-03-19T06:05:39.898 INFO:tasks.workunit.client.1.smithi172.stdout:5/624: symlink d5/d3c/d6c/dbd/ld1 0 2024-03-19T06:05:39.900 INFO:tasks.workunit.client.1.smithi172.stdout:6/788: dread d5/d8f/d31/d7b/fba [0,4194304] 0 2024-03-19T06:05:39.900 INFO:tasks.workunit.client.1.smithi172.stdout:9/674: dread d1/d7/dc/d47/f61 [0,4194304] 0 2024-03-19T06:05:39.902 INFO:tasks.workunit.client.1.smithi172.stdout:7/652: write d0/d22/d1d/f45 [601480,80540] 0 2024-03-19T06:05:39.902 INFO:tasks.workunit.client.1.smithi172.stdout:1/687: dread da/dd/d10/d14/d27/d3f/d5e/dab/fbe [0,4194304] 0 2024-03-19T06:05:39.904 INFO:tasks.workunit.client.1.smithi172.stdout:5/625: symlink d5/d3c/d6c/ld2 0 2024-03-19T06:05:39.916 INFO:tasks.workunit.client.1.smithi172.stdout:2/649: dwrite d7/f15 [0,4194304] 0 2024-03-19T06:05:39.916 INFO:tasks.workunit.client.1.smithi172.stdout:0/691: dwrite d11/d18/d38/d3f/d8b/fa3 [0,4194304] 0 2024-03-19T06:05:39.917 INFO:tasks.workunit.client.1.smithi172.stdout:8/631: dread d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/f57 [0,4194304] 0 2024-03-19T06:05:39.918 INFO:tasks.workunit.client.1.smithi172.stdout:9/675: truncate d1/d7/dc/d47/da3/fa8 676960 0 2024-03-19T06:05:39.919 INFO:tasks.workunit.client.1.smithi172.stdout:5/626: truncate d5/d1f/d2f/f46 589604 0 2024-03-19T06:05:39.919 INFO:tasks.workunit.client.1.smithi172.stdout:1/688: symlink da/dd/d10/d14/d27/d3f/d5e/lec 0 2024-03-19T06:05:39.921 INFO:tasks.workunit.client.1.smithi172.stdout:2/650: mknod d7/de/d58/d55/d6e/da5/cd8 0 2024-03-19T06:05:39.922 INFO:tasks.workunit.client.1.smithi172.stdout:6/789: mkdir d5/d11/d43/d45/da1/de1/dfa/dfc 0 2024-03-19T06:05:39.922 INFO:tasks.workunit.client.1.smithi172.stdout:5/627: chown d5/d55/c59 316 1 2024-03-19T06:05:39.927 INFO:tasks.workunit.client.1.smithi172.stdout:2/651: creat d7/da6/fd9 x:0 0 0 2024-03-19T06:05:39.927 INFO:tasks.workunit.client.1.smithi172.stdout:0/692: truncate d11/d18/d38/d3f/d43/d62/f95 1645978 0 2024-03-19T06:05:39.928 INFO:tasks.workunit.client.1.smithi172.stdout:1/689: mkdir da/d3b/d95/ded 0 2024-03-19T06:05:39.931 INFO:tasks.workunit.client.1.smithi172.stdout:2/652: stat d7/de/d58/d56/c3d 0 2024-03-19T06:05:39.931 INFO:tasks.workunit.client.1.smithi172.stdout:5/628: unlink d5/d14/d15/d40/f54 0 2024-03-19T06:05:39.934 INFO:tasks.workunit.client.1.smithi172.stdout:1/690: mkdir da/d33/d52/dee 0 2024-03-19T06:05:39.935 INFO:tasks.workunit.client.1.smithi172.stdout:7/653: dwrite d0/d22/fb9 [0,4194304] 0 2024-03-19T06:05:39.937 INFO:tasks.workunit.client.1.smithi172.stdout:6/790: dread - d5/d8f/d31/d3d/d98/db6/dc7/fcf zero size 2024-03-19T06:05:39.940 INFO:tasks.workunit.client.1.smithi172.stdout:0/693: creat d11/d22/d46/fec x:0 0 0 2024-03-19T06:05:39.942 INFO:tasks.workunit.client.1.smithi172.stdout:2/653: dread - d7/de/d58/d56/d89/db5/dca/fd0 zero size 2024-03-19T06:05:39.944 INFO:tasks.workunit.client.1.smithi172.stdout:8/632: link d0/c18 d0/d44/d46/d49/d4f/cca 0 2024-03-19T06:05:39.944 INFO:tasks.workunit.client.1.smithi172.stdout:5/629: creat d5/d55/d91/fd3 x:0 0 0 2024-03-19T06:05:39.957 INFO:tasks.workunit.client.1.smithi172.stdout:1/691: creat da/dd/d10/d14/d27/d3f/d5e/dab/fef x:0 0 0 2024-03-19T06:05:39.960 INFO:tasks.workunit.client.1.smithi172.stdout:9/676: dwrite d1/d7/dc/de/d34/d48/d89/fdc [0,4194304] 0 2024-03-19T06:05:39.962 INFO:tasks.workunit.client.1.smithi172.stdout:2/654: mkdir d7/de/d58/d56/d81/dda 0 2024-03-19T06:05:39.964 INFO:tasks.workunit.client.1.smithi172.stdout:2/655: stat d7/f83 0 2024-03-19T06:05:39.965 INFO:tasks.workunit.client.1.smithi172.stdout:8/633: symlink d0/d44/d46/d49/d26/dc0/d76/lcb 0 2024-03-19T06:05:39.967 INFO:tasks.workunit.client.1.smithi172.stdout:5/630: creat d5/d14/d15/d40/fd4 x:0 0 0 2024-03-19T06:05:39.967 INFO:tasks.workunit.client.1.smithi172.stdout:1/692: symlink da/d3b/ddf/lf0 0 2024-03-19T06:05:39.972 INFO:tasks.workunit.client.1.smithi172.stdout:1/693: read da/dd/d10/d14/d27/d3f/d5e/dab/fbe [3276854,101141] 0 2024-03-19T06:05:39.977 INFO:tasks.workunit.client.1.smithi172.stdout:6/791: write d5/d8f/d31/d3d/d98/df9/fe0 [208297,126695] 0 2024-03-19T06:05:39.983 INFO:tasks.workunit.client.1.smithi172.stdout:1/694: unlink da/d33/f86 0 2024-03-19T06:05:39.984 INFO:tasks.workunit.client.1.smithi172.stdout:8/634: dread d0/d44/f7a [0,4194304] 0 2024-03-19T06:05:39.985 INFO:tasks.workunit.client.1.smithi172.stdout:2/656: write d7/db/f32 [825390,46867] 0 2024-03-19T06:05:39.989 INFO:tasks.workunit.client.1.smithi172.stdout:1/695: chown da/dd/c1c 425 1 2024-03-19T06:05:39.989 INFO:tasks.workunit.client.1.smithi172.stdout:6/792: dread d5/d8f/d31/d7b/d7e/f88 [0,4194304] 0 2024-03-19T06:05:39.992 INFO:tasks.workunit.client.1.smithi172.stdout:7/654: dwrite d0/d22/d1d/d36/d56/f79 [0,4194304] 0 2024-03-19T06:05:39.996 INFO:tasks.workunit.client.1.smithi172.stdout:7/655: write d0/d22/d4b/fb3 [339359,46739] 0 2024-03-19T06:05:39.998 INFO:tasks.workunit.client.1.smithi172.stdout:6/793: creat d5/d8f/d31/d3d/d98/db6/d9f/ffd x:0 0 0 2024-03-19T06:05:40.010 INFO:tasks.workunit.client.1.smithi172.stdout:5/631: dread d5/d55/d91/fb2 [0,4194304] 0 2024-03-19T06:05:40.021 INFO:tasks.workunit.client.1.smithi172.stdout:1/696: write da/d33/d4e/d60/f87 [69567,84791] 0 2024-03-19T06:05:40.021 INFO:tasks.workunit.client.1.smithi172.stdout:5/632: mknod d5/d14/d15/d40/d6a/d7a/cd5 0 2024-03-19T06:05:40.023 INFO:tasks.workunit.client.1.smithi172.stdout:0/694: dread d11/d22/f34 [4194304,4194304] 0 2024-03-19T06:05:40.024 INFO:tasks.workunit.client.1.smithi172.stdout:5/633: fsync d5/d3d/f5b 0 2024-03-19T06:05:40.026 INFO:tasks.workunit.client.1.smithi172.stdout:4/724: sync 2024-03-19T06:05:40.027 INFO:tasks.workunit.client.1.smithi172.stdout:6/794: dwrite d5/d11/d43/f4d [4194304,4194304] 0 2024-03-19T06:05:40.030 INFO:tasks.workunit.client.1.smithi172.stdout:8/635: dwrite d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c/fb2 [4194304,4194304] 0 2024-03-19T06:05:40.031 INFO:tasks.workunit.client.1.smithi172.stdout:0/695: chown d11/d22/d32/c85 90197907 1 2024-03-19T06:05:40.036 INFO:tasks.workunit.client.1.smithi172.stdout:5/634: chown d5/d3d/d60/f97 29470 1 2024-03-19T06:05:40.041 INFO:tasks.workunit.client.1.smithi172.stdout:6/795: symlink d5/d8f/d31/lfe 0 2024-03-19T06:05:40.041 INFO:tasks.workunit.client.1.smithi172.stdout:2/657: dread d7/de/d58/d55/f82 [0,4194304] 0 2024-03-19T06:05:40.041 INFO:tasks.workunit.client.1.smithi172.stdout:7/656: dread d0/d22/d1d/d3a/d46/f99 [0,4194304] 0 2024-03-19T06:05:40.043 INFO:tasks.workunit.client.1.smithi172.stdout:0/696: mkdir d11/d14/ded 0 2024-03-19T06:05:40.043 INFO:tasks.workunit.client.1.smithi172.stdout:5/635: write d5/f27 [4724180,107439] 0 2024-03-19T06:05:40.046 INFO:tasks.workunit.client.1.smithi172.stdout:2/658: chown d7/db/f27 76 1 2024-03-19T06:05:40.047 INFO:tasks.workunit.client.1.smithi172.stdout:4/725: read df/d2b/da3/fa8 [936407,20139] 0 2024-03-19T06:05:40.047 INFO:tasks.workunit.client.1.smithi172.stdout:5/636: mkdir d5/d3d/dd6 0 2024-03-19T06:05:40.052 INFO:tasks.workunit.client.1.smithi172.stdout:2/659: creat d7/de/d61/dbc/dc6/fdb x:0 0 0 2024-03-19T06:05:40.061 INFO:tasks.workunit.client.1.smithi172.stdout:5/637: link d5/fd d5/d14/d9f/fd7 0 2024-03-19T06:05:40.067 INFO:tasks.workunit.client.1.smithi172.stdout:6/796: read - d5/d8f/d31/d3d/d98/db6/d40/d53/d75/fd7 zero size 2024-03-19T06:05:40.072 INFO:tasks.workunit.client.1.smithi172.stdout:7/657: dread d0/f15 [0,4194304] 0 2024-03-19T06:05:40.073 INFO:tasks.workunit.client.1.smithi172.stdout:4/726: dwrite df/d11/d12/d26/d84/da2/fd6 [0,4194304] 0 2024-03-19T06:05:40.074 INFO:tasks.workunit.client.1.smithi172.stdout:6/797: write d5/d11/d43/d45/f97 [4658712,115870] 0 2024-03-19T06:05:40.076 INFO:tasks.workunit.client.1.smithi172.stdout:8/636: dread d0/d61/d6a/f93 [0,4194304] 0 2024-03-19T06:05:40.076 INFO:tasks.workunit.client.1.smithi172.stdout:2/660: dread d7/de/d58/d56/f28 [0,4194304] 0 2024-03-19T06:05:40.078 INFO:tasks.workunit.client.1.smithi172.stdout:8/637: chown d0/d64/d80 23481836 1 2024-03-19T06:05:40.079 INFO:tasks.workunit.client.1.smithi172.stdout:1/697: dread da/dd/d10/f2f [4194304,4194304] 0 2024-03-19T06:05:40.080 INFO:tasks.workunit.client.1.smithi172.stdout:4/727: write df/d2b/d44/d67/fad [1304751,37748] 0 2024-03-19T06:05:40.089 INFO:tasks.workunit.client.1.smithi172.stdout:1/698: chown da/d3b/l6f 66865506 1 2024-03-19T06:05:40.094 INFO:tasks.workunit.client.1.smithi172.stdout:2/661: truncate d7/db/f18 3572750 0 2024-03-19T06:05:40.095 INFO:tasks.workunit.client.1.smithi172.stdout:5/638: dwrite d5/d14/fa5 [4194304,4194304] 0 2024-03-19T06:05:40.098 INFO:tasks.workunit.client.1.smithi172.stdout:7/658: dread d0/d22/d1d/d3a/d46/f7a [0,4194304] 0 2024-03-19T06:05:40.100 INFO:tasks.workunit.client.1.smithi172.stdout:4/728: link df/d2b/d44/d93/fc1 df/d11/d12/d21/d50/d63/dbb/dc4/fee 0 2024-03-19T06:05:40.103 INFO:tasks.workunit.client.1.smithi172.stdout:5/639: rmdir d5/d3c 39 2024-03-19T06:05:40.109 INFO:tasks.workunit.client.1.smithi172.stdout:7/659: chown d0/d22/d1d/d36/d8d/d7d/l7e 0 1 2024-03-19T06:05:40.111 INFO:tasks.workunit.client.1.smithi172.stdout:2/662: link d7/d1b/f33 d7/de/d58/d55/d6e/fdc 0 2024-03-19T06:05:40.113 INFO:tasks.workunit.client.1.smithi172.stdout:6/798: dwrite d5/d8f/d31/d3d/d98/df9/fe0 [0,4194304] 0 2024-03-19T06:05:40.115 INFO:tasks.workunit.client.1.smithi172.stdout:8/638: dread d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c/fb2 [4194304,4194304] 0 2024-03-19T06:05:40.116 INFO:tasks.workunit.client.1.smithi172.stdout:1/699: rename da/dd/d10/d14/d27/d3f/d5e/dab/ce5 to da/dd/d10/d14/d27/d3f/d5e/dab/dde/cf1 0 2024-03-19T06:05:40.117 INFO:tasks.workunit.client.1.smithi172.stdout:4/729: write df/d11/f64 [894341,125829] 0 2024-03-19T06:05:40.122 INFO:tasks.workunit.client.1.smithi172.stdout:7/660: getdents d0/d22/d1d/d36/d8d/d7d 0 2024-03-19T06:05:40.126 INFO:tasks.workunit.client.1.smithi172.stdout:8/639: mkdir d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/dcc 0 2024-03-19T06:05:40.126 INFO:tasks.workunit.client.1.smithi172.stdout:5/640: dread d5/d14/d15/f24 [4194304,4194304] 0 2024-03-19T06:05:40.128 INFO:tasks.workunit.client.1.smithi172.stdout:1/700: creat da/dd/d10/d14/d27/d3f/d5e/dab/dde/ff2 x:0 0 0 2024-03-19T06:05:40.131 INFO:tasks.workunit.client.1.smithi172.stdout:8/640: symlink d0/d61/d6a/d98/lcd 0 2024-03-19T06:05:40.132 INFO:tasks.workunit.client.1.smithi172.stdout:6/799: read d5/d8f/d31/f78 [374272,11066] 0 2024-03-19T06:05:40.136 INFO:tasks.workunit.client.1.smithi172.stdout:4/730: symlink df/d11/d12/lef 0 2024-03-19T06:05:40.137 INFO:tasks.workunit.client.1.smithi172.stdout:2/663: dwrite d7/de/d58/d55/d5f/fb9 [0,4194304] 0 2024-03-19T06:05:40.141 INFO:tasks.workunit.client.1.smithi172.stdout:2/664: chown d7/de/d58/d56/d86/d9d/dab 106147416 1 2024-03-19T06:05:40.144 INFO:tasks.workunit.client.1.smithi172.stdout:8/641: symlink d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/lce 0 2024-03-19T06:05:40.144 INFO:tasks.workunit.client.1.smithi172.stdout:6/800: mknod d5/d8f/d31/d3d/d98/db6/d40/d53/d75/dd3/cff 0 2024-03-19T06:05:40.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.157+0000 7f6568a00700 1 -- 172.21.15.72:0/701625870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f656402ce70 con 0x7f6564100030 2024-03-19T06:05:40.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.158+0000 7f655be00700 1 -- 172.21.15.72:0/701625870 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f655405a6b0 con 0x7f6564100030 2024-03-19T06:05:40.149 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:05:40.149 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:05:40.149 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:05:40.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:05:40.149 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:05:40.149 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:05:40.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:05:40.149 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:05:40.149 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:05:40.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:05:40.150 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:05:40.150 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:05:40.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:05:40.150 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:05:40.150 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-03-19T06:05:40.150 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:05:40.150 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:05:40.150 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:05:40.150 INFO:tasks.workunit.client.1.smithi172.stdout:4/731: link df/d11/c71 df/d11/d12/d21/d50/d63/dbb/dc4/cf0 0 2024-03-19T06:05:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.161+0000 7f6568a00700 1 -- 172.21.15.72:0/701625870 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f654806dd50 msgr2=0x7f6548070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.161+0000 7f6568a00700 1 --2- 172.21.15.72:0/701625870 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f654806dd50 0x7f6548070200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6550006010 tx=0x7f6550005ab0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.161+0000 7f6568a00700 1 -- 172.21.15.72:0/701625870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6564100030 msgr2=0x7f6564197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.161+0000 7f6568a00700 1 --2- 172.21.15.72:0/701625870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6564100030 0x7f6564197a10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f655400c8f0 tx=0x7f655400cc00 comp rx=0 tx=0).stop 2024-03-19T06:05:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.161+0000 7f6568a00700 1 -- 172.21.15.72:0/701625870 shutdown_connections 2024-03-19T06:05:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.161+0000 7f6568a00700 1 --2- 172.21.15.72:0/701625870 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f654806dd50 0x7f6548070200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.161+0000 7f6568a00700 1 --2- 172.21.15.72:0/701625870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6564100030 0x7f6564197a10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.161+0000 7f6568a00700 1 --2- 172.21.15.72:0/701625870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65641012d0 0x7f6564197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.161+0000 7f6568a00700 1 -- 172.21.15.72:0/701625870 >> 172.21.15.72:0/701625870 conn(0x7f65640fb680 msgr2=0x7f65641024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.162+0000 7f6568a00700 1 -- 172.21.15.72:0/701625870 shutdown_connections 2024-03-19T06:05:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.162+0000 7f6568a00700 1 -- 172.21.15.72:0/701625870 wait complete. 2024-03-19T06:05:40.154 INFO:tasks.workunit.client.1.smithi172.stdout:2/665: truncate d7/de/d58/d57/f8d 916833 0 2024-03-19T06:05:40.154 INFO:tasks.workunit.client.1.smithi172.stdout:5/641: dwrite d5/d3d/d60/f95 [0,4194304] 0 2024-03-19T06:05:40.158 INFO:tasks.workunit.client.1.smithi172.stdout:5/642: readlink d5/d14/l28 0 2024-03-19T06:05:40.160 INFO:tasks.workunit.client.1.smithi172.stdout:8/642: symlink d0/d44/d46/d49/d4f/lcf 0 2024-03-19T06:05:40.167 INFO:tasks.workunit.client.1.smithi172.stdout:2/666: link c2 d7/db/d2c/d35/cdd 0 2024-03-19T06:05:40.170 INFO:tasks.workunit.client.1.smithi172.stdout:3/686: sync 2024-03-19T06:05:40.170 INFO:tasks.workunit.client.1.smithi172.stdout:9/677: sync 2024-03-19T06:05:40.172 INFO:tasks.workunit.client.1.smithi172.stdout:8/643: symlink d0/d44/d46/d49/d26/dbc/dc6/ld0 0 2024-03-19T06:05:40.173 INFO:tasks.workunit.client.1.smithi172.stdout:5/643: creat d5/d1f/fd8 x:0 0 0 2024-03-19T06:05:40.174 INFO:tasks.workunit.client.1.smithi172.stdout:4/732: write df/d11/d12/d21/d58/d60/f7a [2735406,74415] 0 2024-03-19T06:05:40.175 INFO:tasks.workunit.client.1.smithi172.stdout:2/667: write d7/d1b/f20 [1307415,129577] 0 2024-03-19T06:05:40.176 INFO:tasks.workunit.client.1.smithi172.stdout:3/687: dread d0/f7c [0,4194304] 0 2024-03-19T06:05:40.177 INFO:tasks.workunit.client.1.smithi172.stdout:7/661: dread d0/d22/d1d/d36/f5e [0,4194304] 0 2024-03-19T06:05:40.180 INFO:tasks.workunit.client.1.smithi172.stdout:5/644: dread - d5/d1f/db4/db9/fd0 zero size 2024-03-19T06:05:40.185 INFO:tasks.workunit.client.1.smithi172.stdout:3/688: chown d0/d5/d6b/dae/d88/lc0 210169 1 2024-03-19T06:05:40.186 INFO:tasks.workunit.client.1.smithi172.stdout:8/644: dread d0/d61/d6a/d9f/fb0 [0,4194304] 0 2024-03-19T06:05:40.186 INFO:tasks.workunit.client.1.smithi172.stdout:7/662: mkdir d0/d22/d1d/d3a/d46/ddc 0 2024-03-19T06:05:40.189 INFO:tasks.workunit.client.1.smithi172.stdout:6/801: dwrite d5/d8f/d31/d3d/d98/df9/f6d [0,4194304] 0 2024-03-19T06:05:40.195 INFO:tasks.workunit.client.1.smithi172.stdout:5/645: fdatasync d5/d14/d9f/fd7 0 2024-03-19T06:05:40.195 INFO:tasks.workunit.client.1.smithi172.stdout:7/663: creat d0/d22/d35/dc7/fdd x:0 0 0 2024-03-19T06:05:40.195 INFO:tasks.workunit.client.1.smithi172.stdout:1/701: dread da/f3c [0,4194304] 0 2024-03-19T06:05:40.199 INFO:tasks.workunit.client.1.smithi172.stdout:0/697: sync 2024-03-19T06:05:40.200 INFO:tasks.workunit.client.1.smithi172.stdout:9/678: rename d1/d7/dc/de/d34/d48/d89/la9 to d1/d7/dc/de/d34/d48/d82/d92/d95/db4/lee 0 2024-03-19T06:05:40.201 INFO:tasks.workunit.client.1.smithi172.stdout:6/802: mkdir d5/d8f/d31/d3d/d98/db6/d40/d100 0 2024-03-19T06:05:40.205 INFO:tasks.workunit.client.1.smithi172.stdout:2/668: dread d7/de/fcc [0,4194304] 0 2024-03-19T06:05:40.207 INFO:tasks.workunit.client.1.smithi172.stdout:9/679: readlink d1/l4 0 2024-03-19T06:05:40.209 INFO:tasks.workunit.client.1.smithi172.stdout:8/645: write d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/fa5 [999875,13593] 0 2024-03-19T06:05:40.213 INFO:tasks.workunit.client.1.smithi172.stdout:0/698: symlink d11/d14/d2c/lee 0 2024-03-19T06:05:40.215 INFO:tasks.workunit.client.1.smithi172.stdout:5/646: link d5/l89 d5/d3d/dd6/ld9 0 2024-03-19T06:05:40.215 INFO:tasks.workunit.client.1.smithi172.stdout:4/733: dwrite df/d11/fe3 [0,4194304] 0 2024-03-19T06:05:40.216 INFO:tasks.workunit.client.1.smithi172.stdout:1/702: rename da/dd/d31/d47/c8e to da/dd/d31/d97/cf3 0 2024-03-19T06:05:40.218 INFO:tasks.workunit.client.1.smithi172.stdout:2/669: mknod d7/de/d58/d55/d6e/da5/cde 0 2024-03-19T06:05:40.222 INFO:tasks.workunit.client.1.smithi172.stdout:9/680: mkdir d1/d7/dc/def 0 2024-03-19T06:05:40.223 INFO:tasks.workunit.client.1.smithi172.stdout:8/646: creat d0/d44/d46/d49/d26/d71/d81/d27/d29/fd1 x:0 0 0 2024-03-19T06:05:40.226 INFO:tasks.workunit.client.1.smithi172.stdout:4/734: unlink df/d11/f49 0 2024-03-19T06:05:40.228 INFO:tasks.workunit.client.1.smithi172.stdout:3/689: dwrite d0/da8/d25/f93 [0,4194304] 0 2024-03-19T06:05:40.229 INFO:tasks.workunit.client.1.smithi172.stdout:6/803: rename d5/d11/d17/d36/d48/lcd to d5/d8f/d31/d3d/d98/db6/dc7/l101 0 2024-03-19T06:05:40.232 INFO:tasks.workunit.client.1.smithi172.stdout:7/664: dwrite d0/d22/d1d/dc8/fc9 [0,4194304] 0 2024-03-19T06:05:40.238 INFO:tasks.workunit.client.1.smithi172.stdout:3/690: creat d0/da8/d34/dda/fec x:0 0 0 2024-03-19T06:05:40.239 INFO:tasks.workunit.client.1.smithi172.stdout:3/691: readlink d0/l55 0 2024-03-19T06:05:40.240 INFO:tasks.workunit.client.1.smithi172.stdout:5/647: write d5/d55/f63 [1698301,59991] 0 2024-03-19T06:05:40.242 INFO:tasks.workunit.client.1.smithi172.stdout:7/665: mkdir d0/d22/d1d/d36/d40/dde 0 2024-03-19T06:05:40.242 INFO:tasks.workunit.client.1.smithi172.stdout:0/699: link d11/d22/d32/l4c d11/d18/d38/d3f/d9f/dbb/dc8/lef 0 2024-03-19T06:05:40.247 INFO:tasks.workunit.client.1.smithi172.stdout:9/681: link d1/d7/dc/dbe/d65/f97 d1/d7/dc/d47/ff0 0 2024-03-19T06:05:40.249 INFO:tasks.workunit.client.1.smithi172.stdout:0/700: chown d11/d14/d2c/de7 1447 1 2024-03-19T06:05:40.251 INFO:tasks.workunit.client.1.smithi172.stdout:7/666: chown d0/d22/d1d/d3a/d6b/ca4 14694 1 2024-03-19T06:05:40.251 INFO:tasks.workunit.client.1.smithi172.stdout:6/804: getdents d5/d11/d17/d1b 0 2024-03-19T06:05:40.252 INFO:tasks.workunit.client.1.smithi172.stdout:2/670: dwrite d7/db/d2c/f4a [0,4194304] 0 2024-03-19T06:05:40.256 INFO:tasks.workunit.client.1.smithi172.stdout:5/648: creat d5/fda x:0 0 0 2024-03-19T06:05:40.260 INFO:tasks.workunit.client.1.smithi172.stdout:7/667: write d0/d22/d4b/f80 [937996,89161] 0 2024-03-19T06:05:40.261 INFO:tasks.workunit.client.1.smithi172.stdout:1/703: rename da/dd/d10/l2d to da/d7a/de0/lf4 0 2024-03-19T06:05:40.262 INFO:tasks.workunit.client.1.smithi172.stdout:6/805: fdatasync d5/d11/d17/d1b/d74/fa2 0 2024-03-19T06:05:40.268 INFO:tasks.workunit.client.1.smithi172.stdout:4/735: dread df/d11/d12/f1a [0,4194304] 0 2024-03-19T06:05:40.269 INFO:tasks.workunit.client.1.smithi172.stdout:1/704: write da/d3b/f3d [3847924,117427] 0 2024-03-19T06:05:40.273 INFO:tasks.workunit.client.1.smithi172.stdout:4/736: unlink df/d11/d12/d21/d58/d60/ca1 0 2024-03-19T06:05:40.273 INFO:tasks.workunit.client.1.smithi172.stdout:8/647: rename d0/d44/d46/d49/d26/d71/d81/d8e to d0/d44/dd2 0 2024-03-19T06:05:40.281 INFO:tasks.workunit.client.1.smithi172.stdout:8/648: write d0/d44/d46/d49/d26/d71/d81/d27/d29/f33 [61375,86399] 0 2024-03-19T06:05:40.284 INFO:tasks.workunit.client.1.smithi172.stdout:5/649: dwrite d5/d1f/f2c [0,4194304] 0 2024-03-19T06:05:40.285 INFO:tasks.workunit.client.1.smithi172.stdout:1/705: symlink da/dd/d10/d14/d84/lf5 0 2024-03-19T06:05:40.288 INFO:tasks.workunit.client.1.smithi172.stdout:8/649: chown d0/d44/d46/d49/d26/dbc/dc6 409 1 2024-03-19T06:05:40.295 INFO:tasks.workunit.client.1.smithi172.stdout:1/706: symlink da/d3b/ddf/lf6 0 2024-03-19T06:05:40.301 INFO:tasks.workunit.client.1.smithi172.stdout:9/682: dwrite d1/fb5 [0,4194304] 0 2024-03-19T06:05:40.304 INFO:tasks.workunit.client.1.smithi172.stdout:5/650: truncate d5/d1f/f2a 783358 0 2024-03-19T06:05:40.323 INFO:tasks.workunit.client.1.smithi172.stdout:8/650: mkdir d0/d44/d46/d49/d26/dc0/dd3 0 2024-03-19T06:05:40.325 INFO:tasks.workunit.client.1.smithi172.stdout:5/651: write d5/d1f/f2c [2840375,14167] 0 2024-03-19T06:05:40.325 INFO:tasks.workunit.client.1.smithi172.stdout:0/701: dwrite d11/d22/d46/f9e [0,4194304] 0 2024-03-19T06:05:40.326 INFO:tasks.workunit.client.1.smithi172.stdout:6/806: dwrite d5/d11/d17/d36/dca/fcb [4194304,4194304] 0 2024-03-19T06:05:40.333 INFO:tasks.workunit.client.1.smithi172.stdout:4/737: dwrite df/f8f [0,4194304] 0 2024-03-19T06:05:40.336 INFO:tasks.workunit.client.1.smithi172.stdout:7/668: dwrite d0/d22/d1d/d36/d8d/d5c/d67/fc3 [0,4194304] 0 2024-03-19T06:05:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.346+0000 7f5bf9400700 1 -- 172.21.15.72:0/1944169558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf40737b0 msgr2=0x7f5bf4073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.346+0000 7f5bf9400700 1 --2- 172.21.15.72:0/1944169558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf40737b0 0x7f5bf4073c20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009910 tx=0x7f5be0009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.346+0000 7f5bf9400700 1 -- 172.21.15.72:0/1944169558 shutdown_connections 2024-03-19T06:05:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.346+0000 7f5bf9400700 1 --2- 172.21.15.72:0/1944169558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf40737b0 0x7f5bf4073c20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.346+0000 7f5bf9400700 1 --2- 172.21.15.72:0/1944169558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf4074d80 0x7f5bf40731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.346+0000 7f5bf9400700 1 -- 172.21.15.72:0/1944169558 >> 172.21.15.72:0/1944169558 conn(0x7f5bf40fb7f0 msgr2=0x7f5bf40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.347+0000 7f5bf9400700 1 -- 172.21.15.72:0/1944169558 shutdown_connections 2024-03-19T06:05:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.347+0000 7f5bf9400700 1 -- 172.21.15.72:0/1944169558 wait complete. 2024-03-19T06:05:40.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.348+0000 7f5bf9400700 1 Processor -- start 2024-03-19T06:05:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.348+0000 7f5bf9400700 1 -- start start 2024-03-19T06:05:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.348+0000 7f5bf9400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf40737b0 0x7f5bf419c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.348+0000 7f5bf9400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf4074d80 0x7f5bf419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.348+0000 7f5bf9400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf419cc70 con 0x7f5bf40737b0 2024-03-19T06:05:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.348+0000 7f5bf9400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf419cdb0 con 0x7f5bf4074d80 2024-03-19T06:05:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.349+0000 7f5bf2800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf40737b0 0x7f5bf419c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.349+0000 7f5bf2800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf40737b0 0x7f5bf419c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54456/0 (socket says 172.21.15.72:54456) 2024-03-19T06:05:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.349+0000 7f5bf2800700 1 -- 172.21.15.72:0/2115546456 learned_addr learned my addr 172.21.15.72:0/2115546456 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:40.341 INFO:tasks.workunit.client.1.smithi172.stdout:2/671: dread d7/db/d2c/f38 [0,4194304] 0 2024-03-19T06:05:40.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.350+0000 7f5bf2800700 1 -- 172.21.15.72:0/2115546456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf4074d80 msgr2=0x7f5bf419c650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-19T06:05:40.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.350+0000 7f5bf2800700 1 --2- 172.21.15.72:0/2115546456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf4074d80 0x7f5bf419c650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.350+0000 7f5bf2800700 1 -- 172.21.15.72:0/2115546456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00095f0 con 0x7f5bf40737b0 2024-03-19T06:05:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.350+0000 7f5bf2800700 1 --2- 172.21.15.72:0/2115546456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf40737b0 0x7f5bf419c110 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5be400b4b0 tx=0x7f5be400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.350+0000 7f5beb400700 1 -- 172.21.15.72:0/2115546456 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5be4011800 con 0x7f5bf40737b0 2024-03-19T06:05:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.350+0000 7f5bf9400700 1 -- 172.21.15.72:0/2115546456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf41a1860 con 0x7f5bf40737b0 2024-03-19T06:05:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.350+0000 7f5beb400700 1 -- 172.21.15.72:0/2115546456 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5be4011e10 con 0x7f5bf40737b0 2024-03-19T06:05:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.351+0000 7f5beb400700 1 -- 172.21.15.72:0/2115546456 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5be400f2e0 con 0x7f5bf40737b0 2024-03-19T06:05:40.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.351+0000 7f5bf9400700 1 -- 172.21.15.72:0/2115546456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf41a1db0 con 0x7f5bf40737b0 2024-03-19T06:05:40.342 INFO:tasks.workunit.client.1.smithi172.stdout:8/651: chown d0/d61/d6a/d9f/cb7 165 1 2024-03-19T06:05:40.344 INFO:tasks.workunit.client.1.smithi172.stdout:5/652: readlink d5/d14/lc0 0 2024-03-19T06:05:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.354+0000 7f5bf9400700 1 -- 172.21.15.72:0/2115546456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf410f3f0 con 0x7f5bf40737b0 2024-03-19T06:05:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.354+0000 7f5beb400700 1 -- 172.21.15.72:0/2115546456 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7f5be4010380 con 0x7f5bf40737b0 2024-03-19T06:05:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.357+0000 7f5beb400700 1 --2- 172.21.15.72:0/2115546456 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f5bd806dda0 0x7f5bd8070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:40.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.358+0000 7f5beb400700 1 -- 172.21.15.72:0/2115546456 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5be408d530 con 0x7f5bf40737b0 2024-03-19T06:05:40.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.359+0000 7f5bf1e00700 1 --2- 172.21.15.72:0/2115546456 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f5bd806dda0 0x7f5bd8070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:40.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.360+0000 7f5bf1e00700 1 --2- 172.21.15.72:0/2115546456 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f5bd806dda0 0x7f5bd8070250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5be0005090 tx=0x7f5be0005fb0 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:40.351 INFO:tasks.workunit.client.1.smithi172.stdout:7/669: chown d0/d22/d1d/d36/d8d/f63 1 1 2024-03-19T06:05:40.351 INFO:tasks.workunit.client.1.smithi172.stdout:8/652: chown d0/d44/d46/f87 14910161 1 2024-03-19T06:05:40.352 INFO:tasks.workunit.client.1.smithi172.stdout:9/683: dwrite d1/fb5 [0,4194304] 0 2024-03-19T06:05:40.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.366+0000 7f5beb400700 1 -- 172.21.15.72:0/2115546456 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f5be405a8d0 con 0x7f5bf40737b0 2024-03-19T06:05:40.358 INFO:tasks.workunit.client.1.smithi172.stdout:0/702: truncate d11/d18/d38/d3f/f5e 407976 0 2024-03-19T06:05:40.358 INFO:tasks.workunit.client.1.smithi172.stdout:6/807: creat d5/d8f/d31/d3d/d98/db6/f102 x:0 0 0 2024-03-19T06:05:40.358 INFO:tasks.workunit.client.1.smithi172.stdout:2/672: fdatasync d7/d1b/f9c 0 2024-03-19T06:05:40.370 INFO:tasks.workunit.client.1.smithi172.stdout:8/653: truncate d0/d61/d6e/fc5 882914 0 2024-03-19T06:05:40.370 INFO:tasks.workunit.client.1.smithi172.stdout:6/808: chown d5/d11/d43/fb9 437861 1 2024-03-19T06:05:40.372 INFO:tasks.workunit.client.1.smithi172.stdout:9/684: chown d1/d7/dc/de/d34/d48/fb2 53785954 1 2024-03-19T06:05:40.375 INFO:tasks.workunit.client.1.smithi172.stdout:8/654: getdents d0/d44/d46/d49/d26/dc0/dbf 0 2024-03-19T06:05:40.379 INFO:tasks.workunit.client.1.smithi172.stdout:2/673: readlink d7/de/d58/d55/d5f/da2/ld5 0 2024-03-19T06:05:40.379 INFO:tasks.workunit.client.1.smithi172.stdout:3/692: sync 2024-03-19T06:05:40.381 INFO:tasks.workunit.client.1.smithi172.stdout:0/703: write f6 [535588,87495] 0 2024-03-19T06:05:40.387 INFO:tasks.workunit.client.1.smithi172.stdout:7/670: dwrite d0/d22/d1d/d3a/f3f [0,4194304] 0 2024-03-19T06:05:40.387 INFO:tasks.workunit.client.1.smithi172.stdout:6/809: rename d5/d11/d43/da6/dd9/fea to d5/d8f/d31/f103 0 2024-03-19T06:05:40.401 INFO:tasks.workunit.client.1.smithi172.stdout:2/674: symlink d7/de/d61/ldf 0 2024-03-19T06:05:40.403 INFO:tasks.workunit.client.1.smithi172.stdout:5/653: dwrite d5/d14/d15/d40/d6a/d7a/fa0 [0,4194304] 0 2024-03-19T06:05:40.403 INFO:tasks.workunit.client.1.smithi172.stdout:9/685: rename d1/d7/dc/de/d34/d48/d82/ced to d1/d7/dc/d47/da3/cf1 0 2024-03-19T06:05:40.403 INFO:tasks.workunit.client.1.smithi172.stdout:0/704: truncate d11/d14/d2c/d4e/f64 2276295 0 2024-03-19T06:05:40.405 INFO:tasks.workunit.client.1.smithi172.stdout:8/655: link d0/d61/d6a/d7e/lc7 d0/d44/d46/d49/d26/dc0/d3d/ld4 0 2024-03-19T06:05:40.410 INFO:tasks.workunit.client.1.smithi172.stdout:4/738: dread df/d11/f95 [0,4194304] 0 2024-03-19T06:05:40.411 INFO:tasks.workunit.client.1.smithi172.stdout:2/675: read - d7/db/d2c/d35/f91 zero size 2024-03-19T06:05:40.417 INFO:tasks.workunit.client.1.smithi172.stdout:3/693: dwrite d0/da8/d54/d77/f99 [0,4194304] 0 2024-03-19T06:05:40.422 INFO:tasks.workunit.client.1.smithi172.stdout:0/705: creat d11/d22/d46/ff0 x:0 0 0 2024-03-19T06:05:40.423 INFO:tasks.workunit.client.1.smithi172.stdout:8/656: creat d0/d44/d46/d49/d26/d71/d81/d27/fd5 x:0 0 0 2024-03-19T06:05:40.428 INFO:tasks.workunit.client.1.smithi172.stdout:3/694: creat d0/db0/db6/fed x:0 0 0 2024-03-19T06:05:40.428 INFO:tasks.workunit.client.1.smithi172.stdout:6/810: dwrite d5/d8f/d31/d3d/ff6 [0,4194304] 0 2024-03-19T06:05:40.430 INFO:tasks.workunit.client.1.smithi172.stdout:5/654: dread d5/d3c/f4e [0,4194304] 0 2024-03-19T06:05:40.434 INFO:tasks.workunit.client.1.smithi172.stdout:2/676: dread d7/db/d2c/f6f [0,4194304] 0 2024-03-19T06:05:40.437 INFO:tasks.workunit.client.1.smithi172.stdout:8/657: write d0/d44/d46/d49/d26/d71/d81/d27/d29/f33 [4031526,117151] 0 2024-03-19T06:05:40.440 INFO:tasks.workunit.client.1.smithi172.stdout:0/706: unlink d11/d18/d38/d3f/d9f/fd4 0 2024-03-19T06:05:40.443 INFO:tasks.workunit.client.1.smithi172.stdout:5/655: creat d5/d55/fdb x:0 0 0 2024-03-19T06:05:40.448 INFO:tasks.workunit.client.1.smithi172.stdout:6/811: write d5/d11/d17/d36/fe8 [4616971,22521] 0 2024-03-19T06:05:40.448 INFO:tasks.workunit.client.1.smithi172.stdout:3/695: dread d0/d5/d14/fbb [0,4194304] 0 2024-03-19T06:05:40.448 INFO:tasks.workunit.client.1.smithi172.stdout:2/677: creat d7/de/d58/d55/d5f/fe0 x:0 0 0 2024-03-19T06:05:40.451 INFO:tasks.workunit.client.1.smithi172.stdout:2/678: dread - d7/de/d58/d56/d81/f9a zero size 2024-03-19T06:05:40.454 INFO:tasks.workunit.client.1.smithi172.stdout:5/656: unlink d5/d14/d15/lbb 0 2024-03-19T06:05:40.454 INFO:tasks.workunit.client.1.smithi172.stdout:2/679: write d7/de/d58/d55/f82 [4961760,25414] 0 2024-03-19T06:05:40.455 INFO:tasks.workunit.client.1.smithi172.stdout:4/739: dwrite df/d11/d12/d21/d50/fac [0,4194304] 0 2024-03-19T06:05:40.455 INFO:tasks.workunit.client.1.smithi172.stdout:6/812: symlink d5/d8f/d31/d3d/d95/l104 0 2024-03-19T06:05:40.455 INFO:tasks.workunit.client.1.smithi172.stdout:3/696: read d0/d5/d14/fbb [420208,97839] 0 2024-03-19T06:05:40.457 INFO:tasks.workunit.client.1.smithi172.stdout:0/707: mkdir d11/d22/df1 0 2024-03-19T06:05:40.460 INFO:tasks.workunit.client.1.smithi172.stdout:5/657: chown d5/d1f/db4/db9/fd0 54 1 2024-03-19T06:05:40.461 INFO:tasks.workunit.client.1.smithi172.stdout:9/686: dread d1/d7/dc/d47/d78/f9f [0,4194304] 0 2024-03-19T06:05:40.463 INFO:tasks.workunit.client.1.smithi172.stdout:3/697: symlink d0/da8/d60/lee 0 2024-03-19T06:05:40.465 INFO:tasks.workunit.client.1.smithi172.stdout:2/680: mkdir d7/de/d58/d55/d66/dc1/de1 0 2024-03-19T06:05:40.468 INFO:tasks.workunit.client.1.smithi172.stdout:4/740: rmdir df/d2b/d44/d67 39 2024-03-19T06:05:40.470 INFO:tasks.workunit.client.1.smithi172.stdout:0/708: creat d11/d18/da5/ff2 x:0 0 0 2024-03-19T06:05:40.472 INFO:tasks.workunit.client.1.smithi172.stdout:8/658: dwrite d0/d44/f5b [0,4194304] 0 2024-03-19T06:05:40.473 INFO:tasks.workunit.client.1.smithi172.stdout:6/813: write d5/d11/d17/d1b/d74/fa2 [1788824,124342] 0 2024-03-19T06:05:40.473 INFO:tasks.workunit.client.1.smithi172.stdout:3/698: creat d0/d5/d6b/dae/db9/fef x:0 0 0 2024-03-19T06:05:40.474 INFO:tasks.workunit.client.1.smithi172.stdout:4/741: rmdir df/d2b/d2d 39 2024-03-19T06:05:40.476 INFO:tasks.workunit.client.1.smithi172.stdout:3/699: dread - d0/da8/d34/dda/fe7 zero size 2024-03-19T06:05:40.476 INFO:tasks.workunit.client.1.smithi172.stdout:6/814: stat d5/d11/d17/d36/d48/f9e 0 2024-03-19T06:05:40.476 INFO:tasks.workunit.client.1.smithi172.stdout:1/707: sync 2024-03-19T06:05:40.478 INFO:tasks.workunit.client.1.smithi172.stdout:0/709: symlink d11/d18/d38/d3f/d43/d62/dc0/lf3 0 2024-03-19T06:05:40.482 INFO:tasks.workunit.client.1.smithi172.stdout:6/815: write d5/d8f/d31/d3d/d98/db6/d40/fd5 [406244,50216] 0 2024-03-19T06:05:40.483 INFO:tasks.workunit.client.1.smithi172.stdout:5/658: getdents d5/d14/d34/d66 0 2024-03-19T06:05:40.484 INFO:tasks.workunit.client.1.smithi172.stdout:0/710: rmdir d11/d18/d38/d3f/d8b 39 2024-03-19T06:05:40.486 INFO:tasks.workunit.client.1.smithi172.stdout:5/659: chown d5/d1f/fcd 78477939 1 2024-03-19T06:05:40.487 INFO:tasks.workunit.client.1.smithi172.stdout:8/659: getdents d0/d44 0 2024-03-19T06:05:40.488 INFO:tasks.workunit.client.1.smithi172.stdout:1/708: write da/dd/d31/f34 [5128154,28121] 0 2024-03-19T06:05:40.489 INFO:tasks.workunit.client.1.smithi172.stdout:0/711: creat d11/d22/d68/ff4 x:0 0 0 2024-03-19T06:05:40.491 INFO:tasks.workunit.client.1.smithi172.stdout:4/742: write df/d11/d12/d69/f7e [274368,28718] 0 2024-03-19T06:05:40.493 INFO:tasks.workunit.client.1.smithi172.stdout:1/709: creat da/d3b/dcd/ff7 x:0 0 0 2024-03-19T06:05:40.496 INFO:tasks.workunit.client.1.smithi172.stdout:4/743: dread - df/d2b/d44/f4c zero size 2024-03-19T06:05:40.499 INFO:tasks.workunit.client.1.smithi172.stdout:5/660: getdents d5/d1f/db4/db9 0 2024-03-19T06:05:40.502 INFO:tasks.workunit.client.1.smithi172.stdout:0/712: write d11/d22/f34 [4588890,91632] 0 2024-03-19T06:05:40.503 INFO:tasks.workunit.client.1.smithi172.stdout:1/710: write da/dd/d10/d14/d84/fce [780229,128394] 0 2024-03-19T06:05:40.503 INFO:tasks.workunit.client.1.smithi172.stdout:8/660: dread d0/d44/d46/d49/f5d [0,4194304] 0 2024-03-19T06:05:40.503 INFO:tasks.workunit.client.1.smithi172.stdout:4/744: mknod df/d2b/d2d/cf1 0 2024-03-19T06:05:40.504 INFO:tasks.workunit.client.1.smithi172.stdout:5/661: dread - d5/d55/fdb zero size 2024-03-19T06:05:40.506 INFO:tasks.workunit.client.1.smithi172.stdout:3/700: dwrite d0/da8/d34/d4d/f2d [0,4194304] 0 2024-03-19T06:05:40.508 INFO:tasks.workunit.client.1.smithi172.stdout:0/713: symlink d11/d22/d46/d84/lf5 0 2024-03-19T06:05:40.512 INFO:tasks.workunit.client.1.smithi172.stdout:5/662: mknod d5/d3c/d6c/dc8/cdc 0 2024-03-19T06:05:40.513 INFO:tasks.workunit.client.1.smithi172.stdout:4/745: creat df/d2b/d44/d67/ff2 x:0 0 0 2024-03-19T06:05:40.515 INFO:tasks.workunit.client.1.smithi172.stdout:6/816: dwrite d5/d8f/d31/d3d/d98/db6/dc7/dd1/fd8 [0,4194304] 0 2024-03-19T06:05:40.516 INFO:tasks.workunit.client.1.smithi172.stdout:3/701: mkdir d0/da8/d34/d4d/dc5/df0 0 2024-03-19T06:05:40.519 INFO:tasks.workunit.client.1.smithi172.stdout:0/714: creat d11/d18/d38/d3f/ff6 x:0 0 0 2024-03-19T06:05:40.522 INFO:tasks.workunit.client.1.smithi172.stdout:1/711: write da/dd/d10/d14/d27/d3f/f92 [4611418,29483] 0 2024-03-19T06:05:40.523 INFO:tasks.workunit.client.1.smithi172.stdout:8/661: rename d0/d44/d46/d49/f25 to d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d9c/fd6 0 2024-03-19T06:05:40.524 INFO:tasks.workunit.client.1.smithi172.stdout:6/817: fsync d5/d8f/d31/f67 0 2024-03-19T06:05:40.525 INFO:tasks.workunit.client.1.smithi172.stdout:5/663: truncate d5/d1f/d2f/d53/f78 2464446 0 2024-03-19T06:05:40.527 INFO:tasks.workunit.client.1.smithi172.stdout:4/746: symlink df/d11/d12/d21/d50/d63/dbb/dc4/dd5/lf3 0 2024-03-19T06:05:40.530 INFO:tasks.workunit.client.1.smithi172.stdout:5/664: symlink d5/d55/ldd 0 2024-03-19T06:05:40.531 INFO:tasks.workunit.client.1.smithi172.stdout:1/712: fsync da/dd/d10/fad 0 2024-03-19T06:05:40.534 INFO:tasks.workunit.client.1.smithi172.stdout:4/747: write df/d11/d12/d21/d50/d63/fbe [4040893,110251] 0 2024-03-19T06:05:40.536 INFO:tasks.workunit.client.1.smithi172.stdout:5/665: mkdir d5/d1f/d2f/d53/dde 0 2024-03-19T06:05:40.538 INFO:tasks.workunit.client.1.smithi172.stdout:6/818: rename d5/d8f/d31/d3d/d98/df9/l3c to d5/d8f/d31/d3d/d98/db6/d40/d53/d75/df8/l105 0 2024-03-19T06:05:40.543 INFO:tasks.workunit.client.1.smithi172.stdout:4/748: fsync df/d2b/d2d/f6b 0 2024-03-19T06:05:40.543 INFO:tasks.workunit.client.1.smithi172.stdout:6/819: mkdir d5/d11/d17/d36/d106 0 2024-03-19T06:05:40.548 INFO:tasks.workunit.client.1.smithi172.stdout:3/702: dwrite d0/d5/d6b/dae/d88/fbd [4194304,4194304] 0 2024-03-19T06:05:40.551 INFO:tasks.workunit.client.1.smithi172.stdout:6/820: creat d5/d8f/d31/d3d/d98/df9/f107 x:0 0 0 2024-03-19T06:05:40.551 INFO:tasks.workunit.client.1.smithi172.stdout:4/749: write df/d11/f86 [3309745,88416] 0 2024-03-19T06:05:40.552 INFO:tasks.workunit.client.1.smithi172.stdout:8/662: link d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d9c/fc1 d0/d44/d46/d49/d26/dc0/dd3/fd7 0 2024-03-19T06:05:40.553 INFO:tasks.workunit.client.1.smithi172.stdout:1/713: dread da/dd/d10/d14/d27/f5a [0,4194304] 0 2024-03-19T06:05:40.555 INFO:tasks.workunit.client.1.smithi172.stdout:5/666: truncate d5/d1f/f2c 3775655 0 2024-03-19T06:05:40.556 INFO:tasks.workunit.client.1.smithi172.stdout:4/750: readlink df/d2b/d44/d67/lb5 0 2024-03-19T06:05:40.556 INFO:tasks.workunit.client.1.smithi172.stdout:6/821: creat d5/d11/d43/d45/f108 x:0 0 0 2024-03-19T06:05:40.558 INFO:tasks.workunit.client.1.smithi172.stdout:8/663: write d0/d61/d6a/d7e/f7f [4798344,16493] 0 2024-03-19T06:05:40.559 INFO:tasks.workunit.client.1.smithi172.stdout:0/715: dread d11/d18/d38/d3f/d43/f79 [0,4194304] 0 2024-03-19T06:05:40.560 INFO:tasks.workunit.client.1.smithi172.stdout:5/667: symlink d5/d14/d34/d66/ldf 0 2024-03-19T06:05:40.562 INFO:tasks.workunit.client.1.smithi172.stdout:6/822: fdatasync d5/d11/d17/f3e 0 2024-03-19T06:05:40.563 INFO:tasks.workunit.client.1.smithi172.stdout:1/714: write da/dd/d10/d14/d84/fce [171972,105057] 0 2024-03-19T06:05:40.564 INFO:tasks.workunit.client.1.smithi172.stdout:4/751: truncate df/d2b/d44/f8e 377274 0 2024-03-19T06:05:40.566 INFO:tasks.workunit.client.1.smithi172.stdout:5/668: write d5/d3c/d6c/d9b/fc7 [956648,33627] 0 2024-03-19T06:05:40.569 INFO:tasks.workunit.client.1.smithi172.stdout:4/752: fdatasync df/f4d 0 2024-03-19T06:05:40.570 INFO:tasks.workunit.client.1.smithi172.stdout:0/716: chown d11/d14/d2c/d36/ld6 1279 1 2024-03-19T06:05:40.576 INFO:tasks.workunit.client.1.smithi172.stdout:7/671: sync 2024-03-19T06:05:40.579 INFO:tasks.workunit.client.1.smithi172.stdout:6/823: creat d5/d8f/d31/d3d/d98/db6/f109 x:0 0 0 2024-03-19T06:05:40.579 INFO:tasks.workunit.client.1.smithi172.stdout:5/669: mknod d5/d3c/d6c/dc8/ce0 0 2024-03-19T06:05:40.580 INFO:tasks.workunit.client.1.smithi172.stdout:4/753: creat df/d11/d12/d26/ff4 x:0 0 0 2024-03-19T06:05:40.580 INFO:tasks.workunit.client.1.smithi172.stdout:1/715: write da/d33/d52/fb6 [971574,120619] 0 2024-03-19T06:05:40.583 INFO:tasks.workunit.client.1.smithi172.stdout:3/703: dwrite d0/d5/f3d [0,4194304] 0 2024-03-19T06:05:40.585 INFO:tasks.workunit.client.1.smithi172.stdout:6/824: readlink d5/d8f/d31/d3d/d98/db6/d40/d53/l61 0 2024-03-19T06:05:40.585 INFO:tasks.workunit.client.1.smithi172.stdout:7/672: truncate d0/d22/fb9 5038880 0 2024-03-19T06:05:40.586 INFO:tasks.workunit.client.1.smithi172.stdout:4/754: chown df/d11/d12/d21/d50/d63/dbb/fab 22456 1 2024-03-19T06:05:40.588 INFO:tasks.workunit.client.1.smithi172.stdout:6/825: readlink d5/d8f/d31/d3d/d98/db6/d40/d53/lc3 0 2024-03-19T06:05:40.588 INFO:tasks.workunit.client.1.smithi172.stdout:1/716: symlink da/d3b/ddf/lf8 0 2024-03-19T06:05:40.603 INFO:tasks.workunit.client.1.smithi172.stdout:0/717: rename f2 to d11/d18/da5/ff7 0 2024-03-19T06:05:40.603 INFO:tasks.workunit.client.1.smithi172.stdout:8/664: dread d0/d44/d46/d49/d26/d71/f9e [0,4194304] 0 2024-03-19T06:05:40.603 INFO:tasks.workunit.client.1.smithi172.stdout:5/670: rmdir d5/d3c/d6c/dbd 39 2024-03-19T06:05:40.605 INFO:tasks.workunit.client.1.smithi172.stdout:3/704: mkdir d0/da8/d60/df1 0 2024-03-19T06:05:40.606 INFO:tasks.workunit.client.1.smithi172.stdout:5/671: chown d5/d3c/d6c/f93 0 1 2024-03-19T06:05:40.606 INFO:tasks.workunit.client.1.smithi172.stdout:7/673: creat d0/d22/d27/fdf x:0 0 0 2024-03-19T06:05:40.606 INFO:tasks.workunit.client.1.smithi172.stdout:9/687: sync 2024-03-19T06:05:40.606 INFO:tasks.workunit.client.1.smithi172.stdout:2/681: sync 2024-03-19T06:05:40.608 INFO:tasks.workunit.client.1.smithi172.stdout:6/826: creat d5/d8f/ddf/f10a x:0 0 0 2024-03-19T06:05:40.608 INFO:tasks.workunit.client.1.smithi172.stdout:3/705: chown d0/d5/d14/fd9 6787694 1 2024-03-19T06:05:40.609 INFO:tasks.workunit.client.1.smithi172.stdout:0/718: symlink d11/d18/lf8 0 2024-03-19T06:05:40.609 INFO:tasks.workunit.client.1.smithi172.stdout:4/755: rmdir df/d2b/d2d/dae 39 2024-03-19T06:05:40.610 INFO:tasks.workunit.client.1.smithi172.stdout:2/682: chown d7/de/d58/d56/d89 177879061 1 2024-03-19T06:05:40.611 INFO:tasks.workunit.client.1.smithi172.stdout:6/827: fdatasync d5/d8f/ddf/f10a 0 2024-03-19T06:05:40.612 INFO:tasks.workunit.client.1.smithi172.stdout:4/756: readlink df/d11/d12/d21/lcd 0 2024-03-19T06:05:40.612 INFO:tasks.workunit.client.1.smithi172.stdout:1/717: dread da/dd/d31/f34 [0,4194304] 0 2024-03-19T06:05:40.613 INFO:tasks.workunit.client.1.smithi172.stdout:5/672: fdatasync d5/d14/d15/d40/d6a/fbe 0 2024-03-19T06:05:40.614 INFO:tasks.workunit.client.1.smithi172.stdout:9/688: mkdir d1/d7/dc/db7/df2 0 2024-03-19T06:05:40.616 INFO:tasks.workunit.client.1.smithi172.stdout:2/683: chown d7/de 3 1 2024-03-19T06:05:40.617 INFO:tasks.workunit.client.1.smithi172.stdout:3/706: unlink d0/da8/d34/d4d/f31 0 2024-03-19T06:05:40.621 INFO:tasks.workunit.client.1.smithi172.stdout:5/673: symlink d5/d3c/d6c/dc8/le1 0 2024-03-19T06:05:40.625 INFO:tasks.workunit.client.1.smithi172.stdout:9/689: dread d1/d7/dc/d47/d78/d54/fc8 [0,4194304] 0 2024-03-19T06:05:40.626 INFO:tasks.workunit.client.1.smithi172.stdout:6/828: mkdir d5/d8f/d31/d3d/d98/db6/d40/d53/dc2/d10b 0 2024-03-19T06:05:40.627 INFO:tasks.workunit.client.1.smithi172.stdout:4/757: truncate df/d11/d12/d21/d50/f5f 1150408 0 2024-03-19T06:05:40.629 INFO:tasks.workunit.client.1.smithi172.stdout:3/707: dread d0/d5/d6b/f81 [0,4194304] 0 2024-03-19T06:05:40.631 INFO:tasks.workunit.client.1.smithi172.stdout:2/684: truncate d7/de/f42 163478 0 2024-03-19T06:05:40.633 INFO:tasks.workunit.client.1.smithi172.stdout:8/665: dwrite d0/f1f [4194304,4194304] 0 2024-03-19T06:05:40.634 INFO:tasks.workunit.client.1.smithi172.stdout:5/674: symlink d5/d3d/dd6/le2 0 2024-03-19T06:05:40.634 INFO:tasks.workunit.client.1.smithi172.stdout:7/674: dwrite d0/d22/d1d/d36/f39 [0,4194304] 0 2024-03-19T06:05:40.635 INFO:tasks.workunit.client.1.smithi172.stdout:8/666: readlink d0/l52 0 2024-03-19T06:05:40.639 INFO:tasks.workunit.client.1.smithi172.stdout:6/829: mknod d5/d11/d17/d36/dca/c10c 0 2024-03-19T06:05:40.640 INFO:tasks.workunit.client.1.smithi172.stdout:4/758: unlink df/d11/l15 0 2024-03-19T06:05:40.640 INFO:tasks.workunit.client.1.smithi172.stdout:1/718: dwrite da/dd/d31/d47/fc3 [0,4194304] 0 2024-03-19T06:05:40.641 INFO:tasks.workunit.client.1.smithi172.stdout:3/708: fsync d0/da8/d54/f70 0 2024-03-19T06:05:40.642 INFO:tasks.workunit.client.1.smithi172.stdout:5/675: rmdir d5/d1f/d2f/d62 39 2024-03-19T06:05:40.645 INFO:tasks.workunit.client.1.smithi172.stdout:3/709: chown d0/da8/l2b 7108 1 2024-03-19T06:05:40.651 INFO:tasks.workunit.client.1.smithi172.stdout:2/685: truncate d7/de/d58/d57/f7d 649948 0 2024-03-19T06:05:40.654 INFO:tasks.workunit.client.1.smithi172.stdout:4/759: mkdir df/d2b/da3/df5 0 2024-03-19T06:05:40.656 INFO:tasks.workunit.client.1.smithi172.stdout:6/830: unlink d5/d8f/d31/d3d/d98/db6/d40/d53/d75/f81 0 2024-03-19T06:05:40.660 INFO:tasks.workunit.client.1.smithi172.stdout:4/760: readlink df/d11/d12/d21/d58/d60/l75 0 2024-03-19T06:05:40.666 INFO:tasks.workunit.client.1.smithi172.stdout:1/719: fsync da/d33/f57 0 2024-03-19T06:05:40.668 INFO:tasks.workunit.client.1.smithi172.stdout:5/676: dwrite d5/d55/d91/fd3 [0,4194304] 0 2024-03-19T06:05:40.671 INFO:tasks.workunit.client.1.smithi172.stdout:0/719: read d11/d18/d38/d3f/d43/d62/f95 [1038284,22301] 0 2024-03-19T06:05:40.675 INFO:tasks.workunit.client.1.smithi172.stdout:2/686: getdents d7/de/d58/d55/da8 0 2024-03-19T06:05:40.679 INFO:tasks.workunit.client.1.smithi172.stdout:1/720: mkdir da/df9 0 2024-03-19T06:05:40.682 INFO:tasks.workunit.client.1.smithi172.stdout:9/690: write d1/d7/dc/d47/d78/f79 [80604,81433] 0 2024-03-19T06:05:40.682 INFO:tasks.workunit.client.1.smithi172.stdout:2/687: readlink d7/de/lb2 0 2024-03-19T06:05:40.683 INFO:tasks.workunit.client.1.smithi172.stdout:6/831: dwrite d5/d11/d17/d1b/d74/fa2 [0,4194304] 0 2024-03-19T06:05:40.684 INFO:tasks.workunit.client.1.smithi172.stdout:5/677: rename d5/d14/d15/d40/d6a/c7c to d5/d3c/d6c/ce3 0 2024-03-19T06:05:40.685 INFO:tasks.workunit.client.1.smithi172.stdout:1/721: creat da/dd/d31/d97/ffa x:0 0 0 2024-03-19T06:05:40.688 INFO:tasks.workunit.client.1.smithi172.stdout:0/720: creat d11/d14/d9a/dea/dab/dc1/dd9/de4/ff9 x:0 0 0 2024-03-19T06:05:40.692 INFO:tasks.workunit.client.1.smithi172.stdout:8/667: write d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/f7c [62256,106653] 0 2024-03-19T06:05:40.695 INFO:tasks.workunit.client.1.smithi172.stdout:7/675: dread d0/d22/d1d/d36/fc [0,4194304] 0 2024-03-19T06:05:40.695 INFO:tasks.workunit.client.1.smithi172.stdout:0/721: symlink d11/dc3/lfa 0 2024-03-19T06:05:40.696 INFO:tasks.workunit.client.1.smithi172.stdout:2/688: unlink d7/de/d58/d56/f1c 0 2024-03-19T06:05:40.699 INFO:tasks.workunit.client.1.smithi172.stdout:7/676: readlink d0/d22/d1d/d36/l24 0 2024-03-19T06:05:40.701 INFO:tasks.workunit.client.1.smithi172.stdout:2/689: dread - d7/de/d58/d57/fd4 zero size 2024-03-19T06:05:40.703 INFO:tasks.workunit.client.1.smithi172.stdout:8/668: creat d0/d61/d6a/d9f/fd8 x:0 0 0 2024-03-19T06:05:40.705 INFO:tasks.workunit.client.1.smithi172.stdout:3/710: dwrite d0/da8/d54/f70 [0,4194304] 0 2024-03-19T06:05:40.706 INFO:tasks.workunit.client.1.smithi172.stdout:6/832: unlink d5/d8f/d31/d3d/d98/db6/dc7/leb 0 2024-03-19T06:05:40.710 INFO:tasks.workunit.client.1.smithi172.stdout:7/677: rmdir d0/d22/d3d 39 2024-03-19T06:05:40.713 INFO:tasks.workunit.client.1.smithi172.stdout:2/690: creat d7/de/d58/d56/d86/d9d/dab/fe2 x:0 0 0 2024-03-19T06:05:40.717 INFO:tasks.workunit.client.1.smithi172.stdout:9/691: write d1/d7/dc/d47/f53 [526689,111302] 0 2024-03-19T06:05:40.717 INFO:tasks.workunit.client.1.smithi172.stdout:8/669: fsync d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/f7c 0 2024-03-19T06:05:40.718 INFO:tasks.workunit.client.1.smithi172.stdout:7/678: rmdir d0/d22/d27/db0/d92 39 2024-03-19T06:05:40.719 INFO:tasks.workunit.client.1.smithi172.stdout:0/722: write d11/d14/d9a/fbd [581329,113820] 0 2024-03-19T06:05:40.719 INFO:tasks.workunit.client.1.smithi172.stdout:3/711: mkdir d0/da8/d34/d4d/dc5/df2 0 2024-03-19T06:05:40.720 INFO:tasks.workunit.client.1.smithi172.stdout:4/761: dwrite df/d11/d12/d21/d58/fcb [0,4194304] 0 2024-03-19T06:05:40.724 INFO:tasks.workunit.client.1.smithi172.stdout:6/833: symlink d5/d8f/d31/d3d/d98/db6/d40/d100/l10d 0 2024-03-19T06:05:40.727 INFO:tasks.workunit.client.1.smithi172.stdout:8/670: write d0/f85 [236457,58389] 0 2024-03-19T06:05:40.730 INFO:tasks.workunit.client.1.smithi172.stdout:1/722: rename da/dd/d10 to da/dd/d31/dfb 0 2024-03-19T06:05:40.730 INFO:tasks.workunit.client.1.smithi172.stdout:5/678: dwrite d5/d1f/fb1 [0,4194304] 0 2024-03-19T06:05:40.730 INFO:tasks.workunit.client.1.smithi172.stdout:2/691: unlink d7/db/d2c/d35/cdd 0 2024-03-19T06:05:40.733 INFO:tasks.workunit.client.1.smithi172.stdout:8/671: write d0/d61/d6e/fc5 [1187161,123005] 0 2024-03-19T06:05:40.734 INFO:tasks.workunit.client.1.smithi172.stdout:7/679: dread d0/d22/d4b/fb3 [0,4194304] 0 2024-03-19T06:05:40.739 INFO:tasks.workunit.client.1.smithi172.stdout:0/723: dread d11/d22/d46/f6b [4194304,4194304] 0 2024-03-19T06:05:40.743 INFO:tasks.workunit.client.1.smithi172.stdout:5/679: creat d5/d14/d48/fe4 x:0 0 0 2024-03-19T06:05:40.744 INFO:tasks.workunit.client.1.smithi172.stdout:5/680: stat d5/fb 0 2024-03-19T06:05:40.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.755+0000 7f5bf9400700 1 -- 172.21.15.72:0/2115546456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5bf410f5b0 con 0x7f5bf40737b0 2024-03-19T06:05:40.747 INFO:tasks.workunit.client.1.smithi172.stdout:6/834: creat d5/d8f/d31/db8/f10e x:0 0 0 2024-03-19T06:05:40.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.756+0000 7f5beb400700 1 -- 172.21.15.72:0/2115546456 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1865 (secure 0 0 0) 0x7f5be405a460 con 0x7f5bf40737b0 2024-03-19T06:05:40.748 INFO:tasks.workunit.client.1.smithi172.stdout:5/681: write d5/d3d/d60/fad [2594599,61878] 0 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:e15 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 15 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:04:57.207619+0000 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:05:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:05:40.750 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:05:40.751 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:05:40.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.760+0000 7f5bf9400700 1 -- 172.21.15.72:0/2115546456 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f5bd806dda0 msgr2=0x7f5bd8070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:40.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.760+0000 7f5bf9400700 1 --2- 172.21.15.72:0/2115546456 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f5bd806dda0 0x7f5bd8070250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5be0005090 tx=0x7f5be0005fb0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.760+0000 7f5bf9400700 1 -- 172.21.15.72:0/2115546456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf40737b0 msgr2=0x7f5bf419c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:40.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.760+0000 7f5bf9400700 1 --2- 172.21.15.72:0/2115546456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf40737b0 0x7f5bf419c110 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5be400b4b0 tx=0x7f5be400b870 comp rx=0 tx=0).stop 2024-03-19T06:05:40.752 INFO:tasks.workunit.client.1.smithi172.stdout:0/724: rmdir d11/d14/d2c/dbc 39 2024-03-19T06:05:40.752 INFO:tasks.workunit.client.1.smithi172.stdout:3/712: write d0/da8/d34/d4d/dc5/fe5 [5073110,108822] 0 2024-03-19T06:05:40.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.760+0000 7f5bf9400700 1 -- 172.21.15.72:0/2115546456 shutdown_connections 2024-03-19T06:05:40.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.760+0000 7f5bf9400700 1 --2- 172.21.15.72:0/2115546456 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f5bd806dda0 0x7f5bd8070250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.760+0000 7f5bf9400700 1 --2- 172.21.15.72:0/2115546456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bf40737b0 0x7f5bf419c110 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.760+0000 7f5bf9400700 1 --2- 172.21.15.72:0/2115546456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf4074d80 0x7f5bf419c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.760+0000 7f5bf9400700 1 -- 172.21.15.72:0/2115546456 >> 172.21.15.72:0/2115546456 conn(0x7f5bf40fb7f0 msgr2=0x7f5bf4101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:40.754 INFO:tasks.workunit.client.1.smithi172.stdout:2/692: write d7/db/d45/f88 [697132,127617] 0 2024-03-19T06:05:40.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.764+0000 7f5bf9400700 1 -- 172.21.15.72:0/2115546456 shutdown_connections 2024-03-19T06:05:40.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.764+0000 7f5bf9400700 1 -- 172.21.15.72:0/2115546456 wait complete. 2024-03-19T06:05:40.755 INFO:tasks.workunit.client.1.smithi172.stdout:9/692: rename d1/d7/dc/d47/ff0 to d1/d7/dc/de/ff3 0 2024-03-19T06:05:40.757 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2024-03-19T06:05:40.757 INFO:tasks.workunit.client.1.smithi172.stdout:8/672: dwrite d0/d44/f5b [0,4194304] 0 2024-03-19T06:05:40.758 INFO:tasks.workunit.client.1.smithi172.stdout:7/680: write d0/d22/d35/f94 [1314061,5767] 0 2024-03-19T06:05:40.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:40 smithi072 ceph-mon[28706]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:40.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:40 smithi072 ceph-mon[28706]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:40.761 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:40 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/701625870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:05:40.764 INFO:tasks.workunit.client.1.smithi172.stdout:3/713: symlink d0/da8/d25/lf3 0 2024-03-19T06:05:40.766 INFO:tasks.workunit.client.1.smithi172.stdout:2/693: creat d7/de/d58/d56/d81/fe3 x:0 0 0 2024-03-19T06:05:40.772 INFO:tasks.workunit.client.1.smithi172.stdout:6/835: truncate d5/d11/d43/faf 1820768 0 2024-03-19T06:05:40.773 INFO:tasks.workunit.client.1.smithi172.stdout:4/762: dwrite df/d11/d12/d21/d58/f83 [0,4194304] 0 2024-03-19T06:05:40.773 INFO:tasks.workunit.client.1.smithi172.stdout:3/714: symlink d0/d5/d6b/dae/d88/lf4 0 2024-03-19T06:05:40.774 INFO:tasks.workunit.client.1.smithi172.stdout:0/725: truncate d11/d14/d2c/d36/f53 4702423 0 2024-03-19T06:05:40.778 INFO:tasks.workunit.client.1.smithi172.stdout:2/694: chown d7/d4c/f7e 0 1 2024-03-19T06:05:40.782 INFO:tasks.workunit.client.1.smithi172.stdout:1/723: creat da/dd/d31/dfb/d14/d27/d53/ffc x:0 0 0 2024-03-19T06:05:40.784 INFO:tasks.workunit.client.1.smithi172.stdout:6/836: dread - d5/d8f/d31/d3d/d98/db6/d40/d53/d75/dd3/fe2 zero size 2024-03-19T06:05:40.784 INFO:tasks.workunit.client.1.smithi172.stdout:5/682: dwrite d5/d55/f5f [0,4194304] 0 2024-03-19T06:05:40.785 INFO:tasks.workunit.client.1.smithi172.stdout:9/693: rmdir d1/d7/dc/db7/df2 0 2024-03-19T06:05:40.788 INFO:tasks.workunit.client.1.smithi172.stdout:5/683: fsync d5/d1f/fd8 0 2024-03-19T06:05:40.790 INFO:tasks.workunit.client.1.smithi172.stdout:3/715: rename d0/da8/d25/lf3 to d0/d5/d6b/dae/db9/lf5 0 2024-03-19T06:05:40.790 INFO:tasks.workunit.client.1.smithi172.stdout:2/695: chown d7/db/d2c/lc0 790193 1 2024-03-19T06:05:40.794 INFO:tasks.workunit.client.1.smithi172.stdout:7/681: dread d0/d22/d1d/dc8/fc9 [0,4194304] 0 2024-03-19T06:05:40.794 INFO:tasks.workunit.client.1.smithi172.stdout:4/763: creat df/d11/d12/d21/d50/d63/dbb/dc4/ff6 x:0 0 0 2024-03-19T06:05:40.796 INFO:tasks.workunit.client.1.smithi172.stdout:4/764: readlink df/d45/l56 0 2024-03-19T06:05:40.796 INFO:tasks.workunit.client.1.smithi172.stdout:6/837: creat d5/d11/d43/d45/da1/de1/f10f x:0 0 0 2024-03-19T06:05:40.801 INFO:tasks.workunit.client.1.smithi172.stdout:9/694: dread - d1/d7/dc/de/d34/d48/d82/f88 zero size 2024-03-19T06:05:40.803 INFO:tasks.workunit.client.1.smithi172.stdout:4/765: mknod df/d2b/da3/cf7 0 2024-03-19T06:05:40.804 INFO:tasks.workunit.client.1.smithi172.stdout:8/673: dwrite d0/d44/d46/d49/d26/f3e [0,4194304] 0 2024-03-19T06:05:40.812 INFO:tasks.workunit.client.1.smithi172.stdout:5/684: mkdir d5/d14/d15/d40/d6a/de5 0 2024-03-19T06:05:40.815 INFO:tasks.workunit.client.1.smithi172.stdout:7/682: dread - d0/d22/d1d/d36/f91 zero size 2024-03-19T06:05:40.815 INFO:tasks.workunit.client.1.smithi172.stdout:8/674: write d0/d61/d6a/d7e/f7f [2916752,44999] 0 2024-03-19T06:05:40.817 INFO:tasks.workunit.client.1.smithi172.stdout:6/838: creat d5/d8f/ddf/f110 x:0 0 0 2024-03-19T06:05:40.818 INFO:tasks.workunit.client.1.smithi172.stdout:7/683: readlink d0/d22/d27/l37 0 2024-03-19T06:05:40.818 INFO:tasks.workunit.client.1.smithi172.stdout:0/726: dwrite d11/d22/d32/f58 [0,4194304] 0 2024-03-19T06:05:40.821 INFO:tasks.workunit.client.1.smithi172.stdout:2/696: creat d7/db/d2c/fe4 x:0 0 0 2024-03-19T06:05:40.825 INFO:tasks.workunit.client.1.smithi172.stdout:5/685: dread - d5/d1f/d2f/d62/fcb zero size 2024-03-19T06:05:40.830 INFO:tasks.workunit.client.1.smithi172.stdout:8/675: creat d0/d61/fd9 x:0 0 0 2024-03-19T06:05:40.830 INFO:tasks.workunit.client.1.smithi172.stdout:7/684: mknod d0/d22/d27/ce0 0 2024-03-19T06:05:40.833 INFO:tasks.workunit.client.1.smithi172.stdout:6/839: truncate d5/d11/d17/f8e 1032802 0 2024-03-19T06:05:40.834 INFO:tasks.workunit.client.1.smithi172.stdout:2/697: chown d7/de/d58/d56/d89/ca1 1720 1 2024-03-19T06:05:40.837 INFO:tasks.workunit.client.1.smithi172.stdout:7/685: chown d0/f15 1116 1 2024-03-19T06:05:40.839 INFO:tasks.workunit.client.1.smithi172.stdout:3/716: dwrite d0/da8/d54/d90/f9c [0,4194304] 0 2024-03-19T06:05:40.840 INFO:tasks.workunit.client.1.smithi172.stdout:1/724: dwrite da/dd/f1f [0,4194304] 0 2024-03-19T06:05:40.844 INFO:tasks.workunit.client.1.smithi172.stdout:5/686: chown d5/d14/d15/ca8 48918470 1 2024-03-19T06:05:40.851 INFO:tasks.workunit.client.1.smithi172.stdout:8/676: truncate d0/f2 2757599 0 2024-03-19T06:05:40.853 INFO:tasks.workunit.client.1.smithi172.stdout:2/698: mkdir d7/db/d2c/d35/de5 0 2024-03-19T06:05:40.854 INFO:tasks.workunit.client.1.smithi172.stdout:9/695: dwrite d1/d7/dc/de/d34/d48/d89/fab [0,4194304] 0 2024-03-19T06:05:40.855 INFO:tasks.workunit.client.1.smithi172.stdout:5/687: rmdir d5/d1f/d2f/d62 39 2024-03-19T06:05:40.857 INFO:tasks.workunit.client.1.smithi172.stdout:6/840: dread d5/d11/d17/f93 [0,4194304] 0 2024-03-19T06:05:40.863 INFO:tasks.workunit.client.1.smithi172.stdout:8/677: mknod d0/d44/d46/d49/d26/cda 0 2024-03-19T06:05:40.866 INFO:tasks.workunit.client.1.smithi172.stdout:3/717: dread d0/da8/d54/d90/f97 [0,4194304] 0 2024-03-19T06:05:40.866 INFO:tasks.workunit.client.1.smithi172.stdout:6/841: readlink d5/d8f/d31/d3d/d98/df9/le9 0 2024-03-19T06:05:40.871 INFO:tasks.workunit.client.1.smithi172.stdout:5/688: fdatasync d5/d14/d34/f3f 0 2024-03-19T06:05:40.871 INFO:tasks.workunit.client.1.smithi172.stdout:0/727: dwrite ff [0,4194304] 0 2024-03-19T06:05:40.872 INFO:tasks.workunit.client.1.smithi172.stdout:9/696: mknod d1/d7/dc/de/d34/d48/cf4 0 2024-03-19T06:05:40.877 INFO:tasks.workunit.client.1.smithi172.stdout:0/728: fsync d11/f83 0 2024-03-19T06:05:40.877 INFO:tasks.workunit.client.1.smithi172.stdout:7/686: dwrite d0/f9a [0,4194304] 0 2024-03-19T06:05:40.878 INFO:tasks.workunit.client.1.smithi172.stdout:3/718: mkdir d0/db0/db6/dc7/de0/df6 0 2024-03-19T06:05:40.881 INFO:tasks.workunit.client.1.smithi172.stdout:6/842: mknod d5/d8f/d31/d3d/d98/db6/dc7/dd1/c111 0 2024-03-19T06:05:40.884 INFO:tasks.workunit.client.1.smithi172.stdout:7/687: dread - d0/d22/d1d/d85/da8/fbc zero size 2024-03-19T06:05:40.890 INFO:tasks.workunit.client.1.smithi172.stdout:6/843: write d5/d8f/f6a [962828,57245] 0 2024-03-19T06:05:40.890 INFO:tasks.workunit.client.1.smithi172.stdout:7/688: stat d0/d22/d1d/dc8/fc9 0 2024-03-19T06:05:40.895 INFO:tasks.workunit.client.1.smithi172.stdout:7/689: chown d0/d22/d1d/d3a/f3f 244229 1 2024-03-19T06:05:40.895 INFO:tasks.workunit.client.1.smithi172.stdout:2/699: dwrite d7/de/d58/d55/da8/f84 [0,4194304] 0 2024-03-19T06:05:40.896 INFO:tasks.workunit.client.1.smithi172.stdout:0/729: rename d11/d14/d2c/d36/f9b to d11/d18/d38/d3f/dbe/ffb 0 2024-03-19T06:05:40.897 INFO:tasks.workunit.client.1.smithi172.stdout:1/725: write da/dd/d31/dfb/f2f [5360813,24461] 0 2024-03-19T06:05:40.898 INFO:tasks.workunit.client.1.smithi172.stdout:6/844: symlink d5/d11/d43/d45/da1/de1/dfa/dfc/l112 0 2024-03-19T06:05:40.901 INFO:tasks.workunit.client.1.smithi172.stdout:0/730: read d11/d18/d38/d3f/d43/f79 [637133,130663] 0 2024-03-19T06:05:40.901 INFO:tasks.workunit.client.1.smithi172.stdout:3/719: rename d0/da8/d34/d4d/fbe to d0/db0/db6/dc7/de0/df6/ff7 0 2024-03-19T06:05:40.903 INFO:tasks.workunit.client.1.smithi172.stdout:7/690: symlink d0/d22/d35/dc7/le1 0 2024-03-19T06:05:40.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:40 smithi172 ceph-mon[35716]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:40.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:40 smithi172 ceph-mon[35716]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:40.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:40 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/701625870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:05:40.905 INFO:tasks.workunit.client.1.smithi172.stdout:8/678: read d0/d44/d46/d49/d26/d71/d81/d27/d29/f32 [2630093,63184] 0 2024-03-19T06:05:40.906 INFO:tasks.workunit.client.1.smithi172.stdout:5/689: dread d5/d55/d91/fd3 [0,4194304] 0 2024-03-19T06:05:40.906 INFO:tasks.workunit.client.1.smithi172.stdout:2/700: rename d7/de/d61 to d7/de/d58/d56/d89/de6 0 2024-03-19T06:05:40.908 INFO:tasks.workunit.client.1.smithi172.stdout:1/726: fdatasync da/d3b/f48 0 2024-03-19T06:05:40.909 INFO:tasks.workunit.client.1.smithi172.stdout:3/720: unlink d0/da8/d54/f70 0 2024-03-19T06:05:40.913 INFO:tasks.workunit.client.1.smithi172.stdout:7/691: write d0/d22/d4b/fcf [661072,9731] 0 2024-03-19T06:05:40.913 INFO:tasks.workunit.client.1.smithi172.stdout:3/721: chown d0/da8/fd 698 1 2024-03-19T06:05:40.913 INFO:tasks.workunit.client.1.smithi172.stdout:5/690: creat d5/d3d/d60/fe6 x:0 0 0 2024-03-19T06:05:40.915 INFO:tasks.workunit.client.1.smithi172.stdout:2/701: mknod d7/de/d58/d55/d66/ce7 0 2024-03-19T06:05:40.921 INFO:tasks.workunit.client.1.smithi172.stdout:1/727: creat da/d33/d59/dc1/ffd x:0 0 0 2024-03-19T06:05:40.921 INFO:tasks.workunit.client.1.smithi172.stdout:0/731: dread d11/d14/f1f [0,4194304] 0 2024-03-19T06:05:40.923 INFO:tasks.workunit.client.1.smithi172.stdout:0/732: readlink d11/d22/d46/d84/l88 0 2024-03-19T06:05:40.925 INFO:tasks.workunit.client.1.smithi172.stdout:1/728: read da/d33/d52/fb6 [1775970,113686] 0 2024-03-19T06:05:40.929 INFO:tasks.workunit.client.1.smithi172.stdout:8/679: link d0/d44/d46/d49/d26/cda d0/d61/d6a/d7e/cdb 0 2024-03-19T06:05:40.931 INFO:tasks.workunit.client.1.smithi172.stdout:7/692: rename d0/d22/d1d/d36/d56/la0 to d0/d22/d1d/le2 0 2024-03-19T06:05:40.932 INFO:tasks.workunit.client.1.smithi172.stdout:6/845: dwrite d5/d8f/d31/d3d/ff6 [4194304,4194304] 0 2024-03-19T06:05:40.932 INFO:tasks.workunit.client.1.smithi172.stdout:0/733: creat d11/d14/d2c/ffc x:0 0 0 2024-03-19T06:05:40.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.944+0000 7fb8df200700 1 -- 172.21.15.72:0/1879418483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0100020 msgr2=0x7fb8e0100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:40.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.944+0000 7fb8df200700 1 --2- 172.21.15.72:0/1879418483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0100020 0x7fb8e0100430 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0009910 tx=0x7fb8d0009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:40.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.944+0000 7fb8df200700 1 -- 172.21.15.72:0/1879418483 shutdown_connections 2024-03-19T06:05:40.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.944+0000 7fb8df200700 1 --2- 172.21.15.72:0/1879418483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e01012c0 0x7fb8e0101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.944+0000 7fb8df200700 1 --2- 172.21.15.72:0/1879418483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0100020 0x7fb8e0100430 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.944+0000 7fb8df200700 1 -- 172.21.15.72:0/1879418483 >> 172.21.15.72:0/1879418483 conn(0x7fb8e00fb650 msgr2=0x7fb8e00fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:40.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.944+0000 7fb8df200700 1 -- 172.21.15.72:0/1879418483 shutdown_connections 2024-03-19T06:05:40.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.944+0000 7fb8df200700 1 -- 172.21.15.72:0/1879418483 wait complete. 2024-03-19T06:05:40.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.946+0000 7fb8df200700 1 Processor -- start 2024-03-19T06:05:40.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.946+0000 7fb8df200700 1 -- start start 2024-03-19T06:05:40.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.946+0000 7fb8df200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0100020 0x7fb8e0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:40.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.946+0000 7fb8df200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e01012c0 0x7fb8e0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:40.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.946+0000 7fb8df200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e0073680 con 0x7fb8e0100020 2024-03-19T06:05:40.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.946+0000 7fb8df200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e00737c0 con 0x7fb8e01012c0 2024-03-19T06:05:40.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.947+0000 7fb8dde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0100020 0x7fb8e0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:40.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.947+0000 7fb8dde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0100020 0x7fb8e0074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54476/0 (socket says 172.21.15.72:54476) 2024-03-19T06:05:40.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.947+0000 7fb8dde00700 1 -- 172.21.15.72:0/208903621 learned_addr learned my addr 172.21.15.72:0/208903621 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:40.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.947+0000 7fb8dd400700 1 --2- 172.21.15.72:0/208903621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e01012c0 0x7fb8e0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:40.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.947+0000 7fb8dde00700 1 -- 172.21.15.72:0/208903621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e01012c0 msgr2=0x7fb8e0073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.947+0000 7fb8dde00700 1 --2- 172.21.15.72:0/208903621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e01012c0 0x7fb8e0073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.947+0000 7fb8dde00700 1 -- 172.21.15.72:0/208903621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d00095f0 con 0x7fb8e0100020 2024-03-19T06:05:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.948+0000 7fb8dde00700 1 --2- 172.21.15.72:0/208903621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0100020 0x7fb8e0074af0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000bd70 tx=0x7fb8d000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:40.940 INFO:tasks.workunit.client.1.smithi172.stdout:8/680: truncate d0/f2d 4639651 0 2024-03-19T06:05:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.948+0000 7fb8d6a00700 1 -- 172.21.15.72:0/208903621 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8d001d070 con 0x7fb8e0100020 2024-03-19T06:05:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.948+0000 7fb8d6a00700 1 -- 172.21.15.72:0/208903621 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8d0022470 con 0x7fb8e0100020 2024-03-19T06:05:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.948+0000 7fb8d6a00700 1 -- 172.21.15.72:0/208903621 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8d000f670 con 0x7fb8e0100020 2024-03-19T06:05:40.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.949+0000 7fb8df200700 1 -- 172.21.15.72:0/208903621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e0073a40 con 0x7fb8e0100020 2024-03-19T06:05:40.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.949+0000 7fb8df200700 1 -- 172.21.15.72:0/208903621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e0073f00 con 0x7fb8e0100020 2024-03-19T06:05:40.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.951+0000 7fb8df200700 1 -- 172.21.15.72:0/208903621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e0108b00 con 0x7fb8e0100020 2024-03-19T06:05:40.944 INFO:tasks.workunit.client.1.smithi172.stdout:5/691: dwrite d5/d55/f63 [0,4194304] 0 2024-03-19T06:05:40.944 INFO:tasks.workunit.client.1.smithi172.stdout:6/846: fdatasync d5/fb 0 2024-03-19T06:05:40.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.953+0000 7fb8d6a00700 1 -- 172.21.15.72:0/208903621 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7fb8d0022a50 con 0x7fb8e0100020 2024-03-19T06:05:40.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.954+0000 7fb8d6a00700 1 --2- 172.21.15.72:0/208903621 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb8c406dd60 0x7fb8c4070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:40.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.954+0000 7fb8d6a00700 1 -- 172.21.15.72:0/208903621 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb8d008ec00 con 0x7fb8e0100020 2024-03-19T06:05:40.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.955+0000 7fb8dd400700 1 --2- 172.21.15.72:0/208903621 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb8c406dd60 0x7fb8c4070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:40.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.955+0000 7fb8dd400700 1 --2- 172.21.15.72:0/208903621 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb8c406dd60 0x7fb8c4070210 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc005950 tx=0x7fb8cc0058e0 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:40.950 INFO:tasks.workunit.client.1.smithi172.stdout:1/729: creat da/dd/d31/dfb/d14/ffe x:0 0 0 2024-03-19T06:05:40.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:40.960+0000 7fb8d6a00700 1 -- 172.21.15.72:0/208903621 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fb8d0094020 con 0x7fb8e0100020 2024-03-19T06:05:40.954 INFO:tasks.workunit.client.1.smithi172.stdout:0/734: unlink d11/d22/d32/l4c 0 2024-03-19T06:05:40.956 INFO:tasks.workunit.client.1.smithi172.stdout:8/681: dread - d0/d61/d6a/d7e/f90 zero size 2024-03-19T06:05:40.957 INFO:tasks.workunit.client.1.smithi172.stdout:5/692: mkdir d5/d55/de7 0 2024-03-19T06:05:40.960 INFO:tasks.workunit.client.1.smithi172.stdout:3/722: dwrite d0/da8/d60/f7e [4194304,4194304] 0 2024-03-19T06:05:40.967 INFO:tasks.workunit.client.1.smithi172.stdout:2/702: dwrite d7/d1b/f33 [0,4194304] 0 2024-03-19T06:05:40.970 INFO:tasks.workunit.client.1.smithi172.stdout:5/693: symlink d5/le8 0 2024-03-19T06:05:40.970 INFO:tasks.workunit.client.1.smithi172.stdout:1/730: creat da/dd/d31/dfb/d14/d84/d9b/fff x:0 0 0 2024-03-19T06:05:40.972 INFO:tasks.workunit.client.1.smithi172.stdout:3/723: fsync d0/da8/d34/d4d/fe1 0 2024-03-19T06:05:40.974 INFO:tasks.workunit.client.1.smithi172.stdout:7/693: dwrite d0/d22/d1d/d36/d40/f93 [4194304,4194304] 0 2024-03-19T06:05:40.975 INFO:tasks.workunit.client.1.smithi172.stdout:2/703: write d7/db/f32 [1904720,70978] 0 2024-03-19T06:05:40.976 INFO:tasks.workunit.client.1.smithi172.stdout:8/682: mknod d0/d61/d6a/cdc 0 2024-03-19T06:05:40.976 INFO:tasks.workunit.client.1.smithi172.stdout:6/847: getdents d5/d8f/d31/d3d/d98 0 2024-03-19T06:05:40.986 INFO:tasks.workunit.client.1.smithi172.stdout:4/766: sync 2024-03-19T06:05:40.991 INFO:tasks.workunit.client.1.smithi172.stdout:5/694: unlink d5/d14/d34/f52 0 2024-03-19T06:05:40.991 INFO:tasks.workunit.client.1.smithi172.stdout:6/848: stat d5/d8f/c83 0 2024-03-19T06:05:40.992 INFO:tasks.workunit.client.1.smithi172.stdout:2/704: rmdir d7/de/d58/d55/da8 39 2024-03-19T06:05:40.993 INFO:tasks.workunit.client.1.smithi172.stdout:4/767: creat df/d11/d12/d21/d50/ff8 x:0 0 0 2024-03-19T06:05:40.994 INFO:tasks.workunit.client.1.smithi172.stdout:3/724: dread d0/da8/d54/d90/f9c [0,4194304] 0 2024-03-19T06:05:40.998 INFO:tasks.workunit.client.1.smithi172.stdout:7/694: getdents d0/d22/d27/db0/d92 0 2024-03-19T06:05:41.000 INFO:tasks.workunit.client.1.smithi172.stdout:3/725: mkdir d0/d5/df8 0 2024-03-19T06:05:41.003 INFO:tasks.workunit.client.1.smithi172.stdout:6/849: mknod d5/d8f/d31/d3d/d98/db6/dc7/c113 0 2024-03-19T06:05:41.006 INFO:tasks.workunit.client.1.smithi172.stdout:2/705: write d7/de/d58/d56/d89/de6/dbc/dc6/fdb [397250,124489] 0 2024-03-19T06:05:41.006 INFO:tasks.workunit.client.1.smithi172.stdout:7/695: creat d0/d22/d27/d86/fe3 x:0 0 0 2024-03-19T06:05:41.010 INFO:tasks.workunit.client.1.smithi172.stdout:6/850: symlink d5/df5/l114 0 2024-03-19T06:05:41.011 INFO:tasks.workunit.client.1.smithi172.stdout:8/683: dwrite d0/d44/d46/d49/d26/f3e [0,4194304] 0 2024-03-19T06:05:41.013 INFO:tasks.workunit.client.1.smithi172.stdout:3/726: creat d0/d5/d6b/dae/ff9 x:0 0 0 2024-03-19T06:05:41.014 INFO:tasks.workunit.client.1.smithi172.stdout:2/706: fsync d7/de/d58/d55/f82 0 2024-03-19T06:05:41.016 INFO:tasks.workunit.client.1.smithi172.stdout:1/731: dwrite da/dd/d31/d47/fe4 [0,4194304] 0 2024-03-19T06:05:41.016 INFO:tasks.workunit.client.1.smithi172.stdout:4/768: truncate df/d11/d12/d21/d50/d63/dbb/dc4/fee 464709 0 2024-03-19T06:05:41.017 INFO:tasks.workunit.client.1.smithi172.stdout:6/851: creat d5/d8f/d31/f115 x:0 0 0 2024-03-19T06:05:41.018 INFO:tasks.workunit.client.1.smithi172.stdout:3/727: truncate d0/da8/d60/fd8 706703 0 2024-03-19T06:05:41.021 INFO:tasks.workunit.client.1.smithi172.stdout:4/769: symlink df/d11/d12/d26/d84/da2/lf9 0 2024-03-19T06:05:41.023 INFO:tasks.workunit.client.1.smithi172.stdout:1/732: dread da/dd/d31/dfb/f68 [0,4194304] 0 2024-03-19T06:05:41.024 INFO:tasks.workunit.client.1.smithi172.stdout:3/728: mkdir d0/d5/dfa 0 2024-03-19T06:05:41.026 INFO:tasks.workunit.client.1.smithi172.stdout:1/733: fdatasync da/dd/d31/dfb/d14/d27/f5a 0 2024-03-19T06:05:41.026 INFO:tasks.workunit.client.1.smithi172.stdout:0/735: dread d11/d22/d46/d84/f93 [0,4194304] 0 2024-03-19T06:05:41.027 INFO:tasks.workunit.client.1.smithi172.stdout:2/707: rmdir d7/de/d58/d55/da8 39 2024-03-19T06:05:41.027 INFO:tasks.workunit.client.1.smithi172.stdout:7/696: link d0/d22/d27/db0/l66 d0/d22/d27/db0/le4 0 2024-03-19T06:05:41.028 INFO:tasks.workunit.client.1.smithi172.stdout:1/734: chown da/d3b/dcd/ddb/ldc 15575651 1 2024-03-19T06:05:41.029 INFO:tasks.workunit.client.1.smithi172.stdout:4/770: write df/d11/d12/d21/d50/fc3 [186817,79545] 0 2024-03-19T06:05:41.030 INFO:tasks.workunit.client.1.smithi172.stdout:3/729: symlink d0/d5/d6b/dae/lfb 0 2024-03-19T06:05:41.037 INFO:tasks.workunit.client.1.smithi172.stdout:4/771: fsync df/f24 0 2024-03-19T06:05:41.038 INFO:tasks.workunit.client.1.smithi172.stdout:2/708: creat d7/de/d58/d56/d86/d9d/fe8 x:0 0 0 2024-03-19T06:05:41.042 INFO:tasks.workunit.client.1.smithi172.stdout:7/697: rename d0/d22/d1d/d36/d8d/d7d/l7e to d0/d22/d1d/d36/d40/da2/le5 0 2024-03-19T06:05:41.044 INFO:tasks.workunit.client.1.smithi172.stdout:6/852: link d5/d8f/d31/ca0 d5/d11/d43/da6/dd9/c116 0 2024-03-19T06:05:41.044 INFO:tasks.workunit.client.1.smithi172.stdout:5/695: dread d5/d14/d15/f24 [4194304,4194304] 0 2024-03-19T06:05:41.050 INFO:tasks.workunit.client.1.smithi172.stdout:7/698: write d0/d22/d3d/d41/f87 [1662499,10999] 0 2024-03-19T06:05:41.052 INFO:tasks.workunit.client.1.smithi172.stdout:5/696: truncate d5/d3c/d6c/dbd/fc9 648782 0 2024-03-19T06:05:41.057 INFO:tasks.workunit.client.1.smithi172.stdout:1/735: rename da/d3b/f48 to da/dd/d31/dfb/d14/f100 0 2024-03-19T06:05:41.057 INFO:tasks.workunit.client.1.smithi172.stdout:6/853: stat d5/d8f/d31/d7b/cc8 0 2024-03-19T06:05:41.058 INFO:tasks.workunit.client.1.smithi172.stdout:1/736: fdatasync da/dd/f1f 0 2024-03-19T06:05:41.061 INFO:tasks.workunit.client.1.smithi172.stdout:3/730: rename d0/da8/d3a/f3f to d0/da8/d54/d77/ffc 0 2024-03-19T06:05:41.062 INFO:tasks.workunit.client.1.smithi172.stdout:1/737: dread - da/dd/d31/dfb/d14/d27/d3f/d5e/dab/dde/ff2 zero size 2024-03-19T06:05:41.062 INFO:tasks.workunit.client.1.smithi172.stdout:6/854: creat d5/d11/d43/d45/da1/de1/f117 x:0 0 0 2024-03-19T06:05:41.063 INFO:tasks.workunit.client.1.smithi172.stdout:3/731: stat d0/d5/d6b/dae/d88/fbd 0 2024-03-19T06:05:41.065 INFO:tasks.workunit.client.1.smithi172.stdout:5/697: rename d5/d3c/d6c/dc8 to d5/d55/de9 0 2024-03-19T06:05:41.066 INFO:tasks.workunit.client.1.smithi172.stdout:4/772: write df/d11/f32 [1777861,36038] 0 2024-03-19T06:05:41.066 INFO:tasks.workunit.client.1.smithi172.stdout:2/709: write d7/de/d58/d55/f59 [1074998,32636] 0 2024-03-19T06:05:41.066 INFO:tasks.workunit.client.1.smithi172.stdout:7/699: write d0/f15 [4948566,104307] 0 2024-03-19T06:05:41.066 INFO:tasks.workunit.client.1.smithi172.stdout:3/732: dread - d0/da8/d54/fdc zero size 2024-03-19T06:05:41.067 INFO:tasks.workunit.client.1.smithi172.stdout:1/738: chown da/dd/d31/dfb/d14/d27/d53/f71 0 1 2024-03-19T06:05:41.068 INFO:tasks.workunit.client.1.smithi172.stdout:6/855: mknod d5/d11/d43/d45/da1/de1/dfa/c118 0 2024-03-19T06:05:41.072 INFO:tasks.workunit.client.1.smithi172.stdout:5/698: readlink d5/d14/d15/d40/d5c/l8b 0 2024-03-19T06:05:41.072 INFO:tasks.workunit.client.1.smithi172.stdout:2/710: chown d7/d4c/d70/daa 17205 1 2024-03-19T06:05:41.073 INFO:tasks.workunit.client.1.smithi172.stdout:0/736: dwrite d11/d18/d38/d3f/f5e [0,4194304] 0 2024-03-19T06:05:41.081 INFO:tasks.workunit.client.1.smithi172.stdout:2/711: truncate d7/de/d58/d55/d5f/fc3 20635 0 2024-03-19T06:05:41.081 INFO:tasks.workunit.client.1.smithi172.stdout:3/733: truncate d0/da8/d60/d67/f84 1246001 0 2024-03-19T06:05:41.082 INFO:tasks.workunit.client.1.smithi172.stdout:5/699: rename d5/d14/d15/f24 to d5/d14/d9f/fea 0 2024-03-19T06:05:41.088 INFO:tasks.workunit.client.1.smithi172.stdout:2/712: truncate d7/de/d58/d55/d5f/fc3 413491 0 2024-03-19T06:05:41.088 INFO:tasks.workunit.client.1.smithi172.stdout:5/700: getdents d5/d3c 0 2024-03-19T06:05:41.093 INFO:tasks.workunit.client.1.smithi172.stdout:2/713: stat d7/de/d58/d57/f8d 0 2024-03-19T06:05:41.096 INFO:tasks.workunit.client.1.smithi172.stdout:5/701: fdatasync d5/d14/d34/d66/f8e 0 2024-03-19T06:05:41.101 INFO:tasks.workunit.client.1.smithi172.stdout:0/737: dwrite d11/d14/d2c/dbf/fdd [0,4194304] 0 2024-03-19T06:05:41.102 INFO:tasks.workunit.client.1.smithi172.stdout:1/739: dwrite da/dd/d31/dfb/d14/d27/d3f/d5e/dab/dde/ff2 [0,4194304] 0 2024-03-19T06:05:41.104 INFO:tasks.workunit.client.1.smithi172.stdout:2/714: write d7/de/d58/d55/da8/f84 [4953620,109033] 0 2024-03-19T06:05:41.107 INFO:tasks.workunit.client.1.smithi172.stdout:4/773: dread df/fe4 [4194304,4194304] 0 2024-03-19T06:05:41.108 INFO:tasks.workunit.client.1.smithi172.stdout:0/738: read d11/d14/d9a/dea/fe6 [99619,82371] 0 2024-03-19T06:05:41.108 INFO:tasks.workunit.client.1.smithi172.stdout:7/700: dread d0/d22/fb9 [0,4194304] 0 2024-03-19T06:05:41.109 INFO:tasks.workunit.client.1.smithi172.stdout:0/739: readlink d11/l78 0 2024-03-19T06:05:41.110 INFO:tasks.workunit.client.1.smithi172.stdout:4/774: chown df/d2b/d44/d67 42 1 2024-03-19T06:05:41.111 INFO:tasks.workunit.client.1.smithi172.stdout:2/715: chown d7/de/d58/d56/d86/d9d/dab/fb7 865591 1 2024-03-19T06:05:41.112 INFO:tasks.workunit.client.1.smithi172.stdout:4/775: fdatasync df/d2b/d44/d67/ff2 0 2024-03-19T06:05:41.112 INFO:tasks.workunit.client.1.smithi172.stdout:7/701: dread - d0/d22/d3d/d41/fa6 zero size 2024-03-19T06:05:41.117 INFO:tasks.workunit.client.1.smithi172.stdout:1/740: creat da/dd/d31/dfb/d14/f101 x:0 0 0 2024-03-19T06:05:41.118 INFO:tasks.workunit.client.1.smithi172.stdout:7/702: rmdir d0/d22/d1d/d85/da8 39 2024-03-19T06:05:41.119 INFO:tasks.workunit.client.1.smithi172.stdout:4/776: rmdir df/d11/d12/d21/d50/d63/dbb 39 2024-03-19T06:05:41.120 INFO:tasks.workunit.client.1.smithi172.stdout:7/703: write d0/d22/d1d/fce [933322,99821] 0 2024-03-19T06:05:41.130 INFO:tasks.workunit.client.1.smithi172.stdout:7/704: getdents d0/d22/d27/d86 0 2024-03-19T06:05:41.130 INFO:tasks.workunit.client.1.smithi172.stdout:0/740: write d11/f83 [1041618,114395] 0 2024-03-19T06:05:41.132 INFO:tasks.workunit.client.1.smithi172.stdout:0/741: readlink d11/d14/d2c/lba 0 2024-03-19T06:05:41.133 INFO:tasks.workunit.client.1.smithi172.stdout:0/742: stat d11/l78 0 2024-03-19T06:05:41.135 INFO:tasks.workunit.client.1.smithi172.stdout:7/705: unlink d0/d22/d1d/d36/d8d/d5c/d67/l8c 0 2024-03-19T06:05:41.136 INFO:tasks.workunit.client.1.smithi172.stdout:0/743: mknod d11/d14/d9a/dea/dab/cfd 0 2024-03-19T06:05:41.139 INFO:tasks.workunit.client.1.smithi172.stdout:9/697: sync 2024-03-19T06:05:41.140 INFO:tasks.workunit.client.1.smithi172.stdout:1/741: rename da/d33/d78 to da/dd/d31/dfb/d14/d73/d102 0 2024-03-19T06:05:41.140 INFO:tasks.workunit.client.1.smithi172.stdout:7/706: chown d0/d22/d1d/d36/d40/da2/le5 207 1 2024-03-19T06:05:41.141 INFO:tasks.workunit.client.1.smithi172.stdout:4/777: dwrite df/f3d [0,4194304] 0 2024-03-19T06:05:41.142 INFO:tasks.workunit.client.1.smithi172.stdout:0/744: chown d11/d14/f16 784676710 1 2024-03-19T06:05:41.147 INFO:tasks.workunit.client.1.smithi172.stdout:5/702: dread d5/f16 [0,4194304] 0 2024-03-19T06:05:41.147 INFO:tasks.workunit.client.1.smithi172.stdout:4/778: rmdir df/d11/d12/d26/daf 39 2024-03-19T06:05:41.147 INFO:tasks.workunit.client.1.smithi172.stdout:1/742: fsync da/d33/f75 0 2024-03-19T06:05:41.149 INFO:tasks.workunit.client.1.smithi172.stdout:9/698: truncate d1/d7/dc/d47/d78/d54/fd5 860595 0 2024-03-19T06:05:41.150 INFO:tasks.workunit.client.1.smithi172.stdout:5/703: chown d5/d14/l28 5150 1 2024-03-19T06:05:41.153 INFO:tasks.workunit.client.1.smithi172.stdout:2/716: dread d7/f15 [0,4194304] 0 2024-03-19T06:05:41.154 INFO:tasks.workunit.client.1.smithi172.stdout:9/699: rmdir d1/d7/dc/d47/da3/d7d 39 2024-03-19T06:05:41.154 INFO:tasks.workunit.client.1.smithi172.stdout:1/743: rmdir da/d33/d59 39 2024-03-19T06:05:41.156 INFO:tasks.workunit.client.1.smithi172.stdout:1/744: chown da/dd/d31/dfb/d14 767860800 1 2024-03-19T06:05:41.162 INFO:tasks.workunit.client.1.smithi172.stdout:0/745: write d11/d14/d2c/d4e/f87 [2678471,66863] 0 2024-03-19T06:05:41.220 INFO:tasks.workunit.client.1.smithi172.stdout:2/717: link d7/db/d2c/l8e d7/de/d58/d55/d66/dc1/le9 0 2024-03-19T06:05:41.220 INFO:tasks.workunit.client.1.smithi172.stdout:0/746: chown d11/d14/d2c/lba 14288574 1 2024-03-19T06:05:41.222 INFO:tasks.workunit.client.1.smithi172.stdout:9/700: rename d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/cde to d1/d7/dc/dbe/cf5 0 2024-03-19T06:05:41.223 INFO:tasks.workunit.client.1.smithi172.stdout:7/707: dread d0/d22/d1d/f32 [0,4194304] 0 2024-03-19T06:05:41.223 INFO:tasks.workunit.client.1.smithi172.stdout:0/747: readlink d11/d18/d38/d3f/d9f/la4 0 2024-03-19T06:05:41.223 INFO:tasks.workunit.client.1.smithi172.stdout:5/704: dread d5/d1f/fb1 [0,4194304] 0 2024-03-19T06:05:41.225 INFO:tasks.workunit.client.1.smithi172.stdout:2/718: mkdir d7/dea 0 2024-03-19T06:05:41.226 INFO:tasks.workunit.client.1.smithi172.stdout:0/748: stat d11/d14/f2e 0 2024-03-19T06:05:41.227 INFO:tasks.workunit.client.1.smithi172.stdout:1/745: rename da/dd/d31/dfb/d14/d73/le6 to da/dd/d31/d47/l103 0 2024-03-19T06:05:41.227 INFO:tasks.workunit.client.1.smithi172.stdout:9/701: chown d1/d7/dc/de/d34/d48/d89/fab 2002 1 2024-03-19T06:05:41.228 INFO:tasks.workunit.client.1.smithi172.stdout:5/705: creat d5/d1f/d2f/d53/feb x:0 0 0 2024-03-19T06:05:41.230 INFO:tasks.workunit.client.1.smithi172.stdout:2/719: creat d7/de/d58/d55/d6e/da5/feb x:0 0 0 2024-03-19T06:05:41.233 INFO:tasks.workunit.client.1.smithi172.stdout:5/706: rename l1 to d5/d1f/db4/db9/lec 0 2024-03-19T06:05:41.234 INFO:tasks.workunit.client.1.smithi172.stdout:1/746: getdents da/dd/d31/dfb/d14/d73/d8b 0 2024-03-19T06:05:41.234 INFO:tasks.workunit.client.1.smithi172.stdout:2/720: creat d7/d1b/fec x:0 0 0 2024-03-19T06:05:41.235 INFO:tasks.workunit.client.1.smithi172.stdout:1/747: chown da/d7a/l99 786436643 1 2024-03-19T06:05:41.237 INFO:tasks.workunit.client.1.smithi172.stdout:0/749: truncate d11/d14/d2c/dc2/fca 1033498 0 2024-03-19T06:05:41.237 INFO:tasks.workunit.client.1.smithi172.stdout:1/748: chown da/dd/d31/dfb/d14/d27/d53 210 1 2024-03-19T06:05:41.239 INFO:tasks.workunit.client.1.smithi172.stdout:1/749: write da/dd/d31/d47/fd3 [102870,95114] 0 2024-03-19T06:05:41.240 INFO:tasks.workunit.client.1.smithi172.stdout:9/702: rename d1/d7/dc/de/l21 to d1/d7/dc/dbe/d65/lf6 0 2024-03-19T06:05:41.245 INFO:tasks.workunit.client.1.smithi172.stdout:0/750: truncate d11/d22/d32/f35 868668 0 2024-03-19T06:05:41.246 INFO:tasks.workunit.client.1.smithi172.stdout:0/751: fdatasync d11/d22/d32/f58 0 2024-03-19T06:05:41.249 INFO:tasks.workunit.client.1.smithi172.stdout:5/707: dwrite d5/d55/d91/fcf [0,4194304] 0 2024-03-19T06:05:41.251 INFO:tasks.workunit.client.1.smithi172.stdout:5/708: chown d5/d3d/c74 1154 1 2024-03-19T06:05:41.254 INFO:tasks.workunit.client.1.smithi172.stdout:9/703: creat d1/d7/dc/def/ff7 x:0 0 0 2024-03-19T06:05:41.256 INFO:tasks.workunit.client.1.smithi172.stdout:7/708: dwrite d0/d22/d1d/d85/da8/fac [0,4194304] 0 2024-03-19T06:05:41.257 INFO:tasks.workunit.client.1.smithi172.stdout:0/752: creat d11/d22/d46/d84/ffe x:0 0 0 2024-03-19T06:05:41.258 INFO:tasks.workunit.client.1.smithi172.stdout:2/721: write d7/de/f5b [1158583,16340] 0 2024-03-19T06:05:41.260 INFO:tasks.workunit.client.1.smithi172.stdout:2/722: chown d7/de/f5b 0 1 2024-03-19T06:05:41.270 INFO:tasks.workunit.client.1.smithi172.stdout:1/750: creat da/dd/d31/dfb/d14/d73/d102/f104 x:0 0 0 2024-03-19T06:05:41.271 INFO:tasks.workunit.client.1.smithi172.stdout:9/704: dread d1/d7/dc/d47/d78/f9f [0,4194304] 0 2024-03-19T06:05:41.272 INFO:tasks.workunit.client.1.smithi172.stdout:2/723: creat d7/de/d58/d55/d66/dc1/fed x:0 0 0 2024-03-19T06:05:41.273 INFO:tasks.workunit.client.1.smithi172.stdout:1/751: fsync da/d33/d4e/f7d 0 2024-03-19T06:05:41.274 INFO:tasks.workunit.client.1.smithi172.stdout:7/709: dread d0/d22/d1d/fce [0,4194304] 0 2024-03-19T06:05:41.274 INFO:tasks.workunit.client.1.smithi172.stdout:8/684: sync 2024-03-19T06:05:41.276 INFO:tasks.workunit.client.1.smithi172.stdout:5/709: symlink d5/d55/de7/led 0 2024-03-19T06:05:41.278 INFO:tasks.workunit.client.1.smithi172.stdout:2/724: getdents d7/dea 0 2024-03-19T06:05:41.278 INFO:tasks.workunit.client.1.smithi172.stdout:5/710: chown d5/d1f/d2f/d53 61036 1 2024-03-19T06:05:41.278 INFO:tasks.workunit.client.1.smithi172.stdout:7/710: creat d0/d22/d1d/d85/da8/fe6 x:0 0 0 2024-03-19T06:05:41.280 INFO:tasks.workunit.client.1.smithi172.stdout:8/685: write d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c/f9a [1222021,91217] 0 2024-03-19T06:05:41.282 INFO:tasks.workunit.client.1.smithi172.stdout:9/705: link d1/d7/dc/de/l77 d1/d7/lf8 0 2024-03-19T06:05:41.284 INFO:tasks.workunit.client.1.smithi172.stdout:2/725: mknod d7/de/d58/cee 0 2024-03-19T06:05:41.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.294+0000 7fb8df200700 1 -- 172.21.15.72:0/208903621 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8e019dd40 con 0x7fb8c406dd60 2024-03-19T06:05:41.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.296+0000 7fb8d6a00700 1 -- 172.21.15.72:0/208903621 <== mgr.14702 v2:172.21.15.72:6800/2640845307 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fb8e019dd40 con 0x7fb8c406dd60 2024-03-19T06:05:41.288 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:05:41.288 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:05:41.288 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:05:41.288 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:05:41.288 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:05:41.288 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr" 2024-03-19T06:05:41.288 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:05:41.289 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "2/23 daemons upgraded", 2024-03-19T06:05:41.289 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "", 2024-03-19T06:05:41.289 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:05:41.289 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:05:41.290 INFO:tasks.workunit.client.1.smithi172.stdout:7/711: link d0/d22/d1d/d3a/d6b/lcb d0/d22/d35/dc7/le7 0 2024-03-19T06:05:41.290 INFO:tasks.workunit.client.1.smithi172.stdout:0/753: write d11/d22/d46/d84/f93 [1736243,113211] 0 2024-03-19T06:05:41.291 INFO:tasks.workunit.client.1.smithi172.stdout:2/726: write d7/de/d58/d56/fba [596886,41971] 0 2024-03-19T06:05:41.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.300+0000 7fb8df200700 1 -- 172.21.15.72:0/208903621 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb8c406dd60 msgr2=0x7fb8c4070210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:41.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.300+0000 7fb8df200700 1 --2- 172.21.15.72:0/208903621 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb8c406dd60 0x7fb8c4070210 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc005950 tx=0x7fb8cc0058e0 comp rx=0 tx=0).stop 2024-03-19T06:05:41.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.300+0000 7fb8df200700 1 -- 172.21.15.72:0/208903621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0100020 msgr2=0x7fb8e0074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:41.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.300+0000 7fb8df200700 1 --2- 172.21.15.72:0/208903621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0100020 0x7fb8e0074af0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000bd70 tx=0x7fb8d000be50 comp rx=0 tx=0).stop 2024-03-19T06:05:41.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.300+0000 7fb8df200700 1 -- 172.21.15.72:0/208903621 shutdown_connections 2024-03-19T06:05:41.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.300+0000 7fb8df200700 1 --2- 172.21.15.72:0/208903621 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb8c406dd60 0x7fb8c4070210 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:41.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.300+0000 7fb8df200700 1 --2- 172.21.15.72:0/208903621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e0100020 0x7fb8e0074af0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:41.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.300+0000 7fb8df200700 1 --2- 172.21.15.72:0/208903621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e01012c0 0x7fb8e0073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:41.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.300+0000 7fb8df200700 1 -- 172.21.15.72:0/208903621 >> 172.21.15.72:0/208903621 conn(0x7fb8e00fb650 msgr2=0x7fb8e01044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:41.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.301+0000 7fb8df200700 1 -- 172.21.15.72:0/208903621 shutdown_connections 2024-03-19T06:05:41.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.301+0000 7fb8df200700 1 -- 172.21.15.72:0/208903621 wait complete. 2024-03-19T06:05:41.294 INFO:tasks.workunit.client.1.smithi172.stdout:9/706: symlink d1/d7/dc/de/d34/d48/d82/d92/d95/db4/de5/lf9 0 2024-03-19T06:05:41.295 INFO:tasks.workunit.client.1.smithi172.stdout:1/752: dwrite da/dd/d31/dfb/d14/d27/d53/ffc [0,4194304] 0 2024-03-19T06:05:41.298 INFO:tasks.workunit.client.1.smithi172.stdout:0/754: chown d11/d14/d2c/d36/l37 1289169339 1 2024-03-19T06:05:41.298 INFO:tasks.workunit.client.1.smithi172.stdout:1/753: chown da/dd/d31/ce7 4941179 1 2024-03-19T06:05:41.299 INFO:tasks.workunit.client.1.smithi172.stdout:5/711: write d5/ff [5677809,112869] 0 2024-03-19T06:05:41.305 INFO:tasks.workunit.client.1.smithi172.stdout:9/707: mknod d1/d7/dc/dbe/d65/cfa 0 2024-03-19T06:05:41.305 INFO:tasks.workunit.client.1.smithi172.stdout:0/755: symlink d11/d14/d2c/d8d/lff 0 2024-03-19T06:05:41.306 INFO:tasks.workunit.client.1.smithi172.stdout:7/712: creat d0/d22/d27/db0/fe8 x:0 0 0 2024-03-19T06:05:41.308 INFO:tasks.workunit.client.1.smithi172.stdout:8/686: dread d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/f57 [0,4194304] 0 2024-03-19T06:05:41.309 INFO:tasks.workunit.client.1.smithi172.stdout:7/713: read d0/d22/fb9 [1866845,17403] 0 2024-03-19T06:05:41.311 INFO:tasks.workunit.client.1.smithi172.stdout:9/708: mkdir d1/d7/dc/d47/d78/dfb 0 2024-03-19T06:05:41.312 INFO:tasks.workunit.client.1.smithi172.stdout:0/756: chown d11/d18/da5/da8/lae 403 1 2024-03-19T06:05:41.315 INFO:tasks.workunit.client.1.smithi172.stdout:8/687: truncate d0/f2d 1031413 0 2024-03-19T06:05:41.316 INFO:tasks.workunit.client.1.smithi172.stdout:7/714: mkdir d0/d22/d1d/d36/de9 0 2024-03-19T06:05:41.316 INFO:tasks.workunit.client.1.smithi172.stdout:2/727: dwrite d7/d1b/fec [0,4194304] 0 2024-03-19T06:05:41.321 INFO:tasks.workunit.client.1.smithi172.stdout:9/709: creat d1/d7/dc/de/d34/d48/d89/ffc x:0 0 0 2024-03-19T06:05:41.328 INFO:tasks.workunit.client.1.smithi172.stdout:1/754: dwrite da/d33/f57 [0,4194304] 0 2024-03-19T06:05:41.329 INFO:tasks.workunit.client.1.smithi172.stdout:0/757: creat d11/d14/d2c/d36/f100 x:0 0 0 2024-03-19T06:05:41.332 INFO:tasks.workunit.client.1.smithi172.stdout:9/710: truncate d1/f56 950684 0 2024-03-19T06:05:41.333 INFO:tasks.workunit.client.1.smithi172.stdout:2/728: rename d7/de/d58/d56/d86/d9d/dab/fe2 to d7/d4c/d70/fef 0 2024-03-19T06:05:41.335 INFO:tasks.workunit.client.1.smithi172.stdout:5/712: dwrite d5/d3d/d60/f95 [0,4194304] 0 2024-03-19T06:05:41.337 INFO:tasks.workunit.client.1.smithi172.stdout:6/856: sync 2024-03-19T06:05:41.343 INFO:tasks.workunit.client.1.smithi172.stdout:0/758: symlink d11/d14/l101 0 2024-03-19T06:05:41.347 INFO:tasks.workunit.client.1.smithi172.stdout:6/857: mkdir d5/d11/d17/d36/d106/d119 0 2024-03-19T06:05:41.350 INFO:tasks.workunit.client.1.smithi172.stdout:7/715: dwrite d0/d22/d1d/f32 [0,4194304] 0 2024-03-19T06:05:41.353 INFO:tasks.workunit.client.1.smithi172.stdout:5/713: truncate d5/d14/d15/d40/f73 4125388 0 2024-03-19T06:05:41.356 INFO:tasks.workunit.client.1.smithi172.stdout:6/858: chown d5/d8f/d31/d7b 2089380 1 2024-03-19T06:05:41.358 INFO:tasks.workunit.client.1.smithi172.stdout:7/716: creat d0/d22/d1d/d36/d56/fea x:0 0 0 2024-03-19T06:05:41.360 INFO:tasks.workunit.client.1.smithi172.stdout:5/714: chown d5/d1f/ca1 27 1 2024-03-19T06:05:41.360 INFO:tasks.workunit.client.1.smithi172.stdout:8/688: dwrite d0/d44/d46/d49/f5d [0,4194304] 0 2024-03-19T06:05:41.367 INFO:tasks.workunit.client.1.smithi172.stdout:7/717: chown d0/d22/d1d/f45 30974994 1 2024-03-19T06:05:41.369 INFO:tasks.workunit.client.1.smithi172.stdout:1/755: link da/dd/d31/dfb/d14/ffe da/d33/f105 0 2024-03-19T06:05:41.370 INFO:tasks.workunit.client.1.smithi172.stdout:2/729: dwrite d7/d1b/f33 [4194304,4194304] 0 2024-03-19T06:05:41.372 INFO:tasks.workunit.client.1.smithi172.stdout:6/859: mkdir d5/d11/d43/d45/da1/d11a 0 2024-03-19T06:05:41.374 INFO:tasks.workunit.client.1.smithi172.stdout:5/715: symlink d5/d3d/lee 0 2024-03-19T06:05:41.380 INFO:tasks.workunit.client.1.smithi172.stdout:8/689: fdatasync d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/fa5 0 2024-03-19T06:05:41.380 INFO:tasks.workunit.client.1.smithi172.stdout:7/718: chown d0/d22/d27/db0/c83 1075 1 2024-03-19T06:05:41.385 INFO:tasks.workunit.client.1.smithi172.stdout:6/860: read d5/d11/fab [2070680,76461] 0 2024-03-19T06:05:41.388 INFO:tasks.workunit.client.1.smithi172.stdout:5/716: creat d5/d1f/d2f/d53/fef x:0 0 0 2024-03-19T06:05:41.389 INFO:tasks.workunit.client.1.smithi172.stdout:8/690: unlink d0/d44/dd2/c78 0 2024-03-19T06:05:41.390 INFO:tasks.workunit.client.1.smithi172.stdout:9/711: dwrite d1/db9/fd9 [0,4194304] 0 2024-03-19T06:05:41.390 INFO:tasks.workunit.client.1.smithi172.stdout:2/730: write d7/d4c/f7e [211245,119501] 0 2024-03-19T06:05:41.391 INFO:tasks.workunit.client.1.smithi172.stdout:3/734: sync 2024-03-19T06:05:41.391 INFO:tasks.workunit.client.1.smithi172.stdout:4/779: sync 2024-03-19T06:05:41.397 INFO:tasks.workunit.client.1.smithi172.stdout:5/717: write d5/d3d/f5b [4344642,24221] 0 2024-03-19T06:05:41.398 INFO:tasks.workunit.client.1.smithi172.stdout:8/691: dread - d0/d61/d6a/d9f/fd8 zero size 2024-03-19T06:05:41.402 INFO:tasks.workunit.client.1.smithi172.stdout:5/718: write d5/f27 [5260443,82343] 0 2024-03-19T06:05:41.402 INFO:tasks.workunit.client.1.smithi172.stdout:0/759: dwrite d11/d22/d68/f75 [0,4194304] 0 2024-03-19T06:05:41.403 INFO:tasks.workunit.client.1.smithi172.stdout:9/712: mkdir d1/d7/dc/de/d34/dfd 0 2024-03-19T06:05:41.404 INFO:tasks.workunit.client.1.smithi172.stdout:4/780: dread - df/d11/d12/d21/d58/da6/dc9/dd2/fdb zero size 2024-03-19T06:05:41.409 INFO:tasks.workunit.client.1.smithi172.stdout:8/692: mknod d0/d44/cdd 0 2024-03-19T06:05:41.409 INFO:tasks.workunit.client.1.smithi172.stdout:3/735: write d0/d5/f11 [1050340,124270] 0 2024-03-19T06:05:41.414 INFO:tasks.workunit.client.1.smithi172.stdout:9/713: fsync d1/d7/dc/de/d34/d48/d82/d92/d95/fcb 0 2024-03-19T06:05:41.414 INFO:tasks.workunit.client.1.smithi172.stdout:0/760: mkdir d11/d22/d32/daf/d102 0 2024-03-19T06:05:41.415 INFO:tasks.workunit.client.1.smithi172.stdout:1/756: write da/dd/d31/dfb/d14/d27/d3f/fc7 [47049,103106] 0 2024-03-19T06:05:41.418 INFO:tasks.workunit.client.1.smithi172.stdout:5/719: write d5/d3d/d60/fe6 [294588,102387] 0 2024-03-19T06:05:41.419 INFO:tasks.workunit.client.1.smithi172.stdout:3/736: truncate d0/da8/d3a/fa3 5120279 0 2024-03-19T06:05:41.420 INFO:tasks.workunit.client.1.smithi172.stdout:0/761: stat d11/d22/d46/dd2 0 2024-03-19T06:05:41.422 INFO:tasks.workunit.client.1.smithi172.stdout:0/762: chown d11/d14/d9a/dea/dab/dc1 370 1 2024-03-19T06:05:41.425 INFO:tasks.workunit.client.1.smithi172.stdout:2/731: truncate d7/de/d58/d55/d5f/fc3 311619 0 2024-03-19T06:05:41.426 INFO:tasks.workunit.client.1.smithi172.stdout:3/737: read d0/d5/f3d [744428,48185] 0 2024-03-19T06:05:41.429 INFO:tasks.workunit.client.1.smithi172.stdout:5/720: mknod d5/d55/de7/cf0 0 2024-03-19T06:05:41.430 INFO:tasks.workunit.client.1.smithi172.stdout:2/732: mknod d7/de/d58/d55/d5f/cf0 0 2024-03-19T06:05:41.432 INFO:tasks.workunit.client.1.smithi172.stdout:8/693: truncate d0/f85 3752213 0 2024-03-19T06:05:41.434 INFO:tasks.workunit.client.1.smithi172.stdout:9/714: truncate d1/fae 3820363 0 2024-03-19T06:05:41.436 INFO:tasks.workunit.client.1.smithi172.stdout:2/733: rename d7/db/f32 to d7/d4c/ff1 0 2024-03-19T06:05:41.438 INFO:tasks.workunit.client.1.smithi172.stdout:5/721: creat d5/d3c/d6c/d9b/ff1 x:0 0 0 2024-03-19T06:05:41.441 INFO:tasks.workunit.client.1.smithi172.stdout:2/734: rmdir d7/d1b 39 2024-03-19T06:05:41.444 INFO:tasks.workunit.client.1.smithi172.stdout:9/715: chown d1/d7/dc/de/d34/d48/d82/d92/d95/db4/de5/lf9 1753997 1 2024-03-19T06:05:41.448 INFO:tasks.workunit.client.1.smithi172.stdout:3/738: dread d0/d5/d14/f17 [0,4194304] 0 2024-03-19T06:05:41.448 INFO:tasks.workunit.client.1.smithi172.stdout:6/861: dread d5/d8f/d31/d3d/d98/db6/dc7/dd1/fd8 [0,4194304] 0 2024-03-19T06:05:41.449 INFO:tasks.workunit.client.1.smithi172.stdout:5/722: mknod d5/d3c/d6c/d9b/cf2 0 2024-03-19T06:05:41.450 INFO:tasks.workunit.client.1.smithi172.stdout:9/716: readlink d1/d7/dc/d47/l51 0 2024-03-19T06:05:41.453 INFO:tasks.workunit.client.1.smithi172.stdout:2/735: chown d7/de/d58/d55/d5f/fc3 89395528 1 2024-03-19T06:05:41.453 INFO:tasks.workunit.client.1.smithi172.stdout:6/862: read - d5/d8f/d31/d3d/d98/db6/f102 zero size 2024-03-19T06:05:41.453 INFO:tasks.workunit.client.1.smithi172.stdout:5/723: write d5/d1f/d2f/d53/feb [500732,97519] 0 2024-03-19T06:05:41.455 INFO:tasks.workunit.client.1.smithi172.stdout:9/717: rmdir d1/d7/dc/def 39 2024-03-19T06:05:41.455 INFO:tasks.workunit.client.1.smithi172.stdout:8/694: dwrite d0/d44/d46/d49/d26/d71/d81/d27/f1e [0,4194304] 0 2024-03-19T06:05:41.458 INFO:tasks.workunit.client.1.smithi172.stdout:4/781: dread df/d11/d12/d34/f4e [0,4194304] 0 2024-03-19T06:05:41.459 INFO:tasks.workunit.client.1.smithi172.stdout:9/718: fdatasync d1/d7/dc/d47/d78/f79 0 2024-03-19T06:05:41.459 INFO:tasks.workunit.client.1.smithi172.stdout:2/736: truncate d7/d4c/d70/f90 1636988 0 2024-03-19T06:05:41.461 INFO:tasks.workunit.client.1.smithi172.stdout:3/739: creat d0/db0/db6/dc7/de0/ffd x:0 0 0 2024-03-19T06:05:41.465 INFO:tasks.workunit.client.1.smithi172.stdout:2/737: truncate d7/de/d58/d57/f8d 1606197 0 2024-03-19T06:05:41.467 INFO:tasks.workunit.client.1.smithi172.stdout:3/740: mkdir d0/da8/d60/d67/dfe 0 2024-03-19T06:05:41.468 INFO:tasks.workunit.client.1.smithi172.stdout:8/695: dread d0/f39 [0,4194304] 0 2024-03-19T06:05:41.469 INFO:tasks.workunit.client.1.smithi172.stdout:9/719: mknod d1/d7/dc/de/d34/cfe 0 2024-03-19T06:05:41.472 INFO:tasks.workunit.client.1.smithi172.stdout:9/720: unlink d1/l12 0 2024-03-19T06:05:41.476 INFO:tasks.workunit.client.1.smithi172.stdout:2/738: write d7/de/d58/d56/d86/d9e/fbb [4725498,46770] 0 2024-03-19T06:05:41.477 INFO:tasks.workunit.client.1.smithi172.stdout:6/863: dwrite d5/d11/d43/d45/f97 [8388608,4194304] 0 2024-03-19T06:05:41.477 INFO:tasks.workunit.client.1.smithi172.stdout:3/741: unlink d0/da8/d60/fe2 0 2024-03-19T06:05:41.482 INFO:tasks.workunit.client.1.smithi172.stdout:3/742: stat d0/da8/dce/l7a 0 2024-03-19T06:05:41.482 INFO:tasks.workunit.client.1.smithi172.stdout:2/739: fsync d7/de/d58/d57/fd4 0 2024-03-19T06:05:41.483 INFO:tasks.workunit.client.1.smithi172.stdout:8/696: write d0/f2 [912495,43083] 0 2024-03-19T06:05:41.485 INFO:tasks.workunit.client.1.smithi172.stdout:3/743: truncate d0/da8/dce/fb3 2405070 0 2024-03-19T06:05:41.486 INFO:tasks.workunit.client.1.smithi172.stdout:8/697: read - d0/d44/d46/d49/d26/dc0/fa6 zero size 2024-03-19T06:05:41.488 INFO:tasks.workunit.client.1.smithi172.stdout:8/698: chown d0/d44/c7d 23630331 1 2024-03-19T06:05:41.489 INFO:tasks.workunit.client.1.smithi172.stdout:2/740: rename d7/de/d58/d57/c8a to d7/d4c/cf2 0 2024-03-19T06:05:41.490 INFO:tasks.workunit.client.1.smithi172.stdout:3/744: unlink d0/da8/d25/f74 0 2024-03-19T06:05:41.492 INFO:tasks.workunit.client.1.smithi172.stdout:2/741: write d7/de/d58/d56/d86/d9d/fbf [805161,12679] 0 2024-03-19T06:05:41.493 INFO:tasks.workunit.client.1.smithi172.stdout:6/864: rename d5/d8f/d31/lfe to d5/d8f/d31/db8/l11b 0 2024-03-19T06:05:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.503+0000 7f961e600700 1 -- 172.21.15.72:0/843673624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9618100d60 msgr2=0x7f9618103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.503+0000 7f961e600700 1 --2- 172.21.15.72:0/843673624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9618100d60 0x7f9618103140 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9608009910 tx=0x7f9608009c20 comp rx=0 tx=0).stop 2024-03-19T06:05:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.503+0000 7f961e600700 1 -- 172.21.15.72:0/843673624 shutdown_connections 2024-03-19T06:05:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.503+0000 7f961e600700 1 --2- 172.21.15.72:0/843673624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9618103680 0x7f9618105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.503+0000 7f961e600700 1 --2- 172.21.15.72:0/843673624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9618100d60 0x7f9618103140 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.503+0000 7f961e600700 1 -- 172.21.15.72:0/843673624 >> 172.21.15.72:0/843673624 conn(0x7f96180fa780 msgr2=0x7f96180fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.503+0000 7f961e600700 1 -- 172.21.15.72:0/843673624 shutdown_connections 2024-03-19T06:05:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.503+0000 7f961e600700 1 -- 172.21.15.72:0/843673624 wait complete. 2024-03-19T06:05:41.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.505+0000 7f961e600700 1 Processor -- start 2024-03-19T06:05:41.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.505+0000 7f961e600700 1 -- start start 2024-03-19T06:05:41.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.505+0000 7f961e600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9618100d60 0x7f9618197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:41.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.505+0000 7f961e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9618103680 0x7f9618198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:41.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.505+0000 7f961e600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618198860 con 0x7f9618103680 2024-03-19T06:05:41.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.505+0000 7f961e600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961819d270 con 0x7f9618100d60 2024-03-19T06:05:41.497 INFO:tasks.workunit.client.1.smithi172.stdout:3/745: rename d0/da8/d3a/c9f to d0/da8/dce/d72/cff 0 2024-03-19T06:05:41.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.506+0000 7f9617400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9618100d60 0x7f9618197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:41.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.506+0000 7f9617400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9618100d60 0x7f9618197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:36758/0 (socket says 172.21.15.72:36758) 2024-03-19T06:05:41.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.506+0000 7f9617400700 1 -- 172.21.15.72:0/1528889629 learned_addr learned my addr 172.21.15.72:0/1528889629 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:05:41.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.506+0000 7f9616a00700 1 --2- 172.21.15.72:0/1528889629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9618103680 0x7f9618198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:41.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.506+0000 7f9617400700 1 -- 172.21.15.72:0/1528889629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9618103680 msgr2=0x7f9618198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:41.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.506+0000 7f9617400700 1 --2- 172.21.15.72:0/1528889629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9618103680 0x7f9618198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:41.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.506+0000 7f9617400700 1 -- 172.21.15.72:0/1528889629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96080095f0 con 0x7f9618100d60 2024-03-19T06:05:41.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.506+0000 7f9616a00700 1 --2- 172.21.15.72:0/1528889629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9618103680 0x7f9618198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:05:41.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.507+0000 7f9617400700 1 --2- 172.21.15.72:0/1528889629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9618100d60 0x7f9618197d00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f960800f690 tx=0x7f960800f6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:41.499 INFO:tasks.workunit.client.1.smithi172.stdout:2/742: creat d7/de/d58/d55/d5f/dcd/ff3 x:0 0 0 2024-03-19T06:05:41.500 INFO:tasks.workunit.client.1.smithi172.stdout:4/782: dread df/d11/d12/d21/d58/f5b [0,4194304] 0 2024-03-19T06:05:41.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.507+0000 7f960fe00700 1 -- 172.21.15.72:0/1528889629 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960801d070 con 0x7f9618100d60 2024-03-19T06:05:41.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.507+0000 7f960fe00700 1 -- 172.21.15.72:0/1528889629 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9608005dc0 con 0x7f9618100d60 2024-03-19T06:05:41.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.507+0000 7f960fe00700 1 -- 172.21.15.72:0/1528889629 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9608017630 con 0x7f9618100d60 2024-03-19T06:05:41.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.507+0000 7f961e600700 1 -- 172.21.15.72:0/1528889629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961819d410 con 0x7f9618100d60 2024-03-19T06:05:41.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.508+0000 7f961e600700 1 -- 172.21.15.72:0/1528889629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961819d8d0 con 0x7f9618100d60 2024-03-19T06:05:41.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.509+0000 7f961e600700 1 -- 172.21.15.72:0/1528889629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96180fc340 con 0x7f9618100d60 2024-03-19T06:05:41.501 INFO:tasks.workunit.client.1.smithi172.stdout:6/865: rename d5/d8f/d31/d3d/d98/db6/d40/d53/d75/fb1 to d5/d8f/d31/d3d/f11c 0 2024-03-19T06:05:41.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.510+0000 7f960fe00700 1 -- 172.21.15.72:0/1528889629 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7f9608003910 con 0x7f9618100d60 2024-03-19T06:05:41.502 INFO:tasks.workunit.client.1.smithi172.stdout:2/743: fdatasync d7/de/d58/d56/f2b 0 2024-03-19T06:05:41.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.512+0000 7f960fe00700 1 --2- 172.21.15.72:0/1528889629 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f95fc06dd50 0x7f95fc070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:41.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.512+0000 7f960fe00700 1 -- 172.21.15.72:0/1528889629 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f960808ee00 con 0x7f9618100d60 2024-03-19T06:05:41.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.512+0000 7f9616a00700 1 --2- 172.21.15.72:0/1528889629 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f95fc06dd50 0x7f95fc070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:41.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.513+0000 7f9616a00700 1 --2- 172.21.15.72:0/1528889629 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f95fc06dd50 0x7f95fc070200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9604011490 tx=0x7f9604009260 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:41.505 INFO:tasks.workunit.client.1.smithi172.stdout:6/866: creat d5/d8f/d31/d3d/d98/db6/d40/d53/d75/df8/f11d x:0 0 0 2024-03-19T06:05:41.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.518+0000 7f960fe00700 1 -- 172.21.15.72:0/1528889629 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f9608058560 con 0x7f9618100d60 2024-03-19T06:05:41.515 INFO:tasks.workunit.client.1.smithi172.stdout:4/783: write df/d11/d12/d26/f35 [462675,98080] 0 2024-03-19T06:05:41.517 INFO:tasks.workunit.client.1.smithi172.stdout:2/744: write d7/de/d58/d55/d5f/fc3 [1215720,116293] 0 2024-03-19T06:05:41.519 INFO:tasks.workunit.client.1.smithi172.stdout:4/784: chown df/d11/d12/d21/l23 403781 1 2024-03-19T06:05:41.527 INFO:tasks.workunit.client.1.smithi172.stdout:6/867: dwrite d5/d8f/d31/d7b/d7e/f90 [0,4194304] 0 2024-03-19T06:05:41.528 INFO:tasks.workunit.client.1.smithi172.stdout:3/746: dread d0/da8/d34/d4d/f2e [0,4194304] 0 2024-03-19T06:05:41.536 INFO:tasks.workunit.client.1.smithi172.stdout:2/745: dread d7/db/f27 [4194304,4194304] 0 2024-03-19T06:05:41.536 INFO:tasks.workunit.client.1.smithi172.stdout:3/747: link d0/da8/d60/f7e d0/da8/dce/f100 0 2024-03-19T06:05:41.537 INFO:tasks.workunit.client.1.smithi172.stdout:4/785: dwrite df/d11/d12/d34/f74 [0,4194304] 0 2024-03-19T06:05:41.537 INFO:tasks.workunit.client.1.smithi172.stdout:6/868: dread d5/d11/d17/d1b/d74/fb4 [0,4194304] 0 2024-03-19T06:05:41.539 INFO:tasks.workunit.client.1.smithi172.stdout:2/746: stat d7/d1b/c5e 0 2024-03-19T06:05:41.542 INFO:tasks.workunit.client.1.smithi172.stdout:6/869: rmdir d5/d8f/d31/db8 39 2024-03-19T06:05:41.544 INFO:tasks.workunit.client.1.smithi172.stdout:6/870: fsync d5/d8f/f6b 0 2024-03-19T06:05:41.545 INFO:tasks.workunit.client.1.smithi172.stdout:6/871: chown d5/lbf 0 1 2024-03-19T06:05:41.551 INFO:tasks.workunit.client.1.smithi172.stdout:6/872: rmdir d5/d8f/d31/d3d/d98/db6 39 2024-03-19T06:05:41.554 INFO:tasks.workunit.client.1.smithi172.stdout:2/747: dwrite d7/de/d58/d55/d66/dc1/fed [0,4194304] 0 2024-03-19T06:05:41.555 INFO:tasks.workunit.client.1.smithi172.stdout:6/873: write d5/d11/d17/d1b/d74/fa2 [746445,113907] 0 2024-03-19T06:05:41.557 INFO:tasks.workunit.client.1.smithi172.stdout:2/748: dread - d7/de/d58/d55/fce zero size 2024-03-19T06:05:41.562 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:41 smithi072 ceph-mon[28706]: pgmap v17: 65 pgs: 65 active+clean; 1.5 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 51 MiB/s rd, 168 MiB/s wr, 355 op/s 2024-03-19T06:05:41.563 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:41 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2115546456' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:05:41.564 INFO:tasks.workunit.client.1.smithi172.stdout:2/749: symlink d7/db/d2c/d35/lf4 0 2024-03-19T06:05:41.565 INFO:tasks.workunit.client.1.smithi172.stdout:2/750: fsync d7/f8 0 2024-03-19T06:05:41.567 INFO:tasks.workunit.client.1.smithi172.stdout:2/751: write d7/de/d58/d57/fc4 [762778,19390] 0 2024-03-19T06:05:41.569 INFO:tasks.workunit.client.1.smithi172.stdout:2/752: chown d7/de/d58/d57/f67 509298810 1 2024-03-19T06:05:41.570 INFO:tasks.workunit.client.1.smithi172.stdout:4/786: write df/d11/d12/d21/f4b [2247205,1503] 0 2024-03-19T06:05:41.572 INFO:tasks.workunit.client.1.smithi172.stdout:2/753: stat d7/de/d58/d55/d5f/fc3 0 2024-03-19T06:05:41.573 INFO:tasks.workunit.client.1.smithi172.stdout:4/787: chown df/d11/d12/d34/f4e 1834970633 1 2024-03-19T06:05:41.576 INFO:tasks.workunit.client.1.smithi172.stdout:4/788: fdatasync df/d11/d12/d34/f4e 0 2024-03-19T06:05:41.578 INFO:tasks.workunit.client.1.smithi172.stdout:3/748: dwrite d0/da8/d25/d21/f50 [0,4194304] 0 2024-03-19T06:05:41.584 INFO:tasks.workunit.client.1.smithi172.stdout:6/874: dwrite d5/fb [0,4194304] 0 2024-03-19T06:05:41.585 INFO:tasks.workunit.client.1.smithi172.stdout:4/789: chown df/d11/d12/d34/ce9 72449829 1 2024-03-19T06:05:41.585 INFO:tasks.workunit.client.1.smithi172.stdout:7/719: sync 2024-03-19T06:05:41.586 INFO:tasks.workunit.client.1.smithi172.stdout:3/749: dread - d0/da8/d54/d90/fcd zero size 2024-03-19T06:05:41.587 INFO:tasks.workunit.client.1.smithi172.stdout:6/875: write d5/d11/d43/f4d [10465333,121826] 0 2024-03-19T06:05:41.588 INFO:tasks.workunit.client.1.smithi172.stdout:7/720: fdatasync d0/d22/d27/db0/fe8 0 2024-03-19T06:05:41.598 INFO:tasks.workunit.client.1.smithi172.stdout:4/790: creat df/d11/d12/d21/d58/ffa x:0 0 0 2024-03-19T06:05:41.600 INFO:tasks.workunit.client.1.smithi172.stdout:4/791: write df/d11/d12/d21/f4b [3741943,23151] 0 2024-03-19T06:05:41.600 INFO:tasks.workunit.client.1.smithi172.stdout:7/721: link d0/d22/d3d/d41/f87 d0/d22/d35/dc7/feb 0 2024-03-19T06:05:41.601 INFO:tasks.workunit.client.1.smithi172.stdout:4/792: stat df/d11/d12/d34/f74 0 2024-03-19T06:05:41.607 INFO:tasks.workunit.client.1.smithi172.stdout:4/793: read df/d11/d12/d21/d50/fac [2150966,50850] 0 2024-03-19T06:05:41.614 INFO:tasks.workunit.client.1.smithi172.stdout:4/794: truncate df/d11/d12/d21/d58/da6/dc9/dd2/fdb 623289 0 2024-03-19T06:05:41.617 INFO:tasks.workunit.client.1.smithi172.stdout:7/722: dwrite d0/d22/d1d/f32 [0,4194304] 0 2024-03-19T06:05:41.618 INFO:tasks.workunit.client.1.smithi172.stdout:4/795: fsync df/d11/d12/d21/d50/f94 0 2024-03-19T06:05:41.624 INFO:tasks.workunit.client.1.smithi172.stdout:7/723: dread d0/d22/d4b/fcf [0,4194304] 0 2024-03-19T06:05:41.625 INFO:tasks.workunit.client.1.smithi172.stdout:4/796: stat df/d11/d12/d21/d50/d63/dbb/dc4/ff6 0 2024-03-19T06:05:41.626 INFO:tasks.workunit.client.1.smithi172.stdout:6/876: dread d5/d11/d43/d45/f97 [0,4194304] 0 2024-03-19T06:05:41.629 INFO:tasks.workunit.client.1.smithi172.stdout:7/724: symlink d0/d22/d1d/d36/d8d/d7d/dbf/lec 0 2024-03-19T06:05:41.631 INFO:tasks.workunit.client.1.smithi172.stdout:3/750: dread d0/da8/d25/f93 [0,4194304] 0 2024-03-19T06:05:41.635 INFO:tasks.workunit.client.1.smithi172.stdout:7/725: mkdir d0/d22/d27/ded 0 2024-03-19T06:05:41.635 INFO:tasks.workunit.client.1.smithi172.stdout:4/797: getdents df/d11/d12/d21/d58/d60 0 2024-03-19T06:05:41.637 INFO:tasks.workunit.client.1.smithi172.stdout:3/751: read d0/da8/d34/f8b [937919,76794] 0 2024-03-19T06:05:41.639 INFO:tasks.workunit.client.1.smithi172.stdout:3/752: fdatasync d0/da8/d25/f93 0 2024-03-19T06:05:41.640 INFO:tasks.workunit.client.1.smithi172.stdout:4/798: creat df/d11/d12/d21/d58/da6/dc9/ffb x:0 0 0 2024-03-19T06:05:41.647 INFO:tasks.workunit.client.1.smithi172.stdout:4/799: rename df/d2b/d2d/ca4 to df/d11/cfc 0 2024-03-19T06:05:41.647 INFO:tasks.workunit.client.1.smithi172.stdout:3/753: write d0/da8/d60/d67/f84 [502065,94721] 0 2024-03-19T06:05:41.650 INFO:tasks.workunit.client.1.smithi172.stdout:4/800: creat df/d11/d12/d21/d58/ffd x:0 0 0 2024-03-19T06:05:41.656 INFO:tasks.workunit.client.1.smithi172.stdout:4/801: symlink df/d11/d12/d21/d50/d63/dbb/dc4/dd3/lfe 0 2024-03-19T06:05:41.657 INFO:tasks.workunit.client.1.smithi172.stdout:3/754: write d0/da8/dce/da7/f94 [932502,4170] 0 2024-03-19T06:05:41.661 INFO:tasks.workunit.client.1.smithi172.stdout:3/755: truncate d0/da8/d54/d90/f97 661934 0 2024-03-19T06:05:41.662 INFO:tasks.workunit.client.1.smithi172.stdout:4/802: link df/d2b/cde df/d2b/da3/df5/cff 0 2024-03-19T06:05:41.664 INFO:tasks.workunit.client.1.smithi172.stdout:3/756: getdents d0/d5/df8 0 2024-03-19T06:05:41.665 INFO:tasks.workunit.client.1.smithi172.stdout:6/877: dread d5/d8f/d31/f89 [0,4194304] 0 2024-03-19T06:05:41.665 INFO:tasks.workunit.client.1.smithi172.stdout:7/726: dread d0/d22/d1d/f4c [0,4194304] 0 2024-03-19T06:05:41.667 INFO:tasks.workunit.client.1.smithi172.stdout:3/757: symlink d0/da8/d54/d77/l101 0 2024-03-19T06:05:41.667 INFO:tasks.workunit.client.1.smithi172.stdout:6/878: write d5/fb [615262,74242] 0 2024-03-19T06:05:41.669 INFO:tasks.workunit.client.1.smithi172.stdout:3/758: chown d0/da8/d54/d90/fe3 7 1 2024-03-19T06:05:41.670 INFO:tasks.workunit.client.1.smithi172.stdout:7/727: mknod d0/d22/d1d/d36/d56/dc6/cee 0 2024-03-19T06:05:41.696 INFO:tasks.workunit.client.1.smithi172.stdout:1/757: sync 2024-03-19T06:05:41.710 INFO:tasks.workunit.client.1.smithi172.stdout:7/728: symlink d0/lef 0 2024-03-19T06:05:41.713 INFO:tasks.workunit.client.1.smithi172.stdout:3/759: link d0/da8/d54/d90/fcd d0/da8/dce/da7/f102 0 2024-03-19T06:05:41.715 INFO:tasks.workunit.client.1.smithi172.stdout:1/758: stat da/dd/d31/dfb/d14/d27/d53/f6b 0 2024-03-19T06:05:41.716 INFO:tasks.workunit.client.1.smithi172.stdout:7/729: symlink d0/d22/d1d/d36/d8d/d7d/lf0 0 2024-03-19T06:05:41.719 INFO:tasks.workunit.client.1.smithi172.stdout:7/730: dread - d0/d22/d1d/d36/d40/f5f zero size 2024-03-19T06:05:41.721 INFO:tasks.workunit.client.1.smithi172.stdout:6/879: dwrite d5/d11/d17/d36/d48/fa8 [0,4194304] 0 2024-03-19T06:05:41.724 INFO:tasks.workunit.client.1.smithi172.stdout:1/759: write da/f77 [698985,112728] 0 2024-03-19T06:05:41.724 INFO:tasks.workunit.client.1.smithi172.stdout:6/880: symlink d5/d11/d17/da4/l11e 0 2024-03-19T06:05:41.727 INFO:tasks.workunit.client.1.smithi172.stdout:1/760: mkdir da/d7a/d106 0 2024-03-19T06:05:41.736 INFO:tasks.workunit.client.1.smithi172.stdout:1/761: creat da/dd/f107 x:0 0 0 2024-03-19T06:05:41.746 INFO:tasks.workunit.client.1.smithi172.stdout:1/762: link da/d33/d4e/f7d da/dd/d31/dfb/d14/d84/f108 0 2024-03-19T06:05:41.748 INFO:tasks.workunit.client.1.smithi172.stdout:1/763: write da/dd/d31/dfb/fea [527930,98164] 0 2024-03-19T06:05:41.752 INFO:tasks.workunit.client.1.smithi172.stdout:1/764: truncate da/dd/d31/dfb/d14/d84/d9b/fff 131020 0 2024-03-19T06:05:41.754 INFO:tasks.workunit.client.1.smithi172.stdout:6/881: dread d5/f19 [0,4194304] 0 2024-03-19T06:05:41.757 INFO:tasks.workunit.client.1.smithi172.stdout:7/731: dread d0/d22/d1d/d36/d8d/d5c/d67/fc3 [0,4194304] 0 2024-03-19T06:05:41.761 INFO:tasks.workunit.client.1.smithi172.stdout:7/732: fsync d0/d22/d1d/d36/d56/f6c 0 2024-03-19T06:05:41.762 INFO:tasks.workunit.client.1.smithi172.stdout:7/733: readlink d0/d22/d1d/d85/da8/ld9 0 2024-03-19T06:05:41.767 INFO:tasks.workunit.client.1.smithi172.stdout:7/734: creat d0/d22/d27/d86/ff1 x:0 0 0 2024-03-19T06:05:41.772 INFO:tasks.workunit.client.1.smithi172.stdout:7/735: symlink d0/d22/d1d/d36/d8d/d5c/d67/d82/lf2 0 2024-03-19T06:05:41.772 INFO:tasks.workunit.client.1.smithi172.stdout:1/765: write da/dd/d31/dfb/d14/f46 [1284975,103853] 0 2024-03-19T06:05:41.772 INFO:tasks.workunit.client.1.smithi172.stdout:6/882: write d5/d8f/d31/d7b/fa5 [1037704,120325] 0 2024-03-19T06:05:41.774 INFO:tasks.workunit.client.1.smithi172.stdout:7/736: dread - d0/d22/d4b/fc0 zero size 2024-03-19T06:05:41.776 INFO:tasks.workunit.client.1.smithi172.stdout:6/883: creat d5/d11/d17/d1b/f11f x:0 0 0 2024-03-19T06:05:41.777 INFO:tasks.workunit.client.1.smithi172.stdout:1/766: mknod da/d33/d52/dee/c109 0 2024-03-19T06:05:41.778 INFO:tasks.workunit.client.1.smithi172.stdout:6/884: dread - d5/d11/d17/d36/d48/fdd zero size 2024-03-19T06:05:41.780 INFO:tasks.workunit.client.1.smithi172.stdout:7/737: truncate d0/d22/d1d/d36/f54 59710 0 2024-03-19T06:05:41.780 INFO:tasks.workunit.client.1.smithi172.stdout:1/767: mknod da/df9/c10a 0 2024-03-19T06:05:41.790 INFO:tasks.workunit.client.1.smithi172.stdout:0/763: sync 2024-03-19T06:05:41.838 INFO:tasks.workunit.client.1.smithi172.stdout:9/721: sync 2024-03-19T06:05:41.838 INFO:tasks.workunit.client.1.smithi172.stdout:5/724: sync 2024-03-19T06:05:41.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.876+0000 7f961e600700 1 -- 172.21.15.72:0/1528889629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f961802cc30 con 0x7f9618100d60 2024-03-19T06:05:41.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.877+0000 7f960fe00700 1 -- 172.21.15.72:0/1528889629 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f960805bc20 con 0x7f9618100d60 2024-03-19T06:05:41.869 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:05:41.869 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:05:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:05:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.880+0000 7f961e600700 1 -- 172.21.15.72:0/1528889629 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f95fc06dd50 msgr2=0x7f95fc070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.880+0000 7f961e600700 1 --2- 172.21.15.72:0/1528889629 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f95fc06dd50 0x7f95fc070200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9604011490 tx=0x7f9604009260 comp rx=0 tx=0).stop 2024-03-19T06:05:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.880+0000 7f961e600700 1 -- 172.21.15.72:0/1528889629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9618100d60 msgr2=0x7f9618197d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.880+0000 7f961e600700 1 --2- 172.21.15.72:0/1528889629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9618100d60 0x7f9618197d00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f960800f690 tx=0x7f960800f6c0 comp rx=0 tx=0).stop 2024-03-19T06:05:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.880+0000 7f961e600700 1 -- 172.21.15.72:0/1528889629 shutdown_connections 2024-03-19T06:05:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.880+0000 7f961e600700 1 --2- 172.21.15.72:0/1528889629 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f95fc06dd50 0x7f95fc070200 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.880+0000 7f961e600700 1 --2- 172.21.15.72:0/1528889629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9618100d60 0x7f9618197d00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:41.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.880+0000 7f961e600700 1 --2- 172.21.15.72:0/1528889629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9618103680 0x7f9618198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:41.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.880+0000 7f961e600700 1 -- 172.21.15.72:0/1528889629 >> 172.21.15.72:0/1528889629 conn(0x7f96180fa780 msgr2=0x7f9618100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:41.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.880+0000 7f961e600700 1 -- 172.21.15.72:0/1528889629 shutdown_connections 2024-03-19T06:05:41.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:05:41.880+0000 7f961e600700 1 -- 172.21.15.72:0/1528889629 wait complete. 2024-03-19T06:05:41.886 INFO:tasks.workunit.client.1.smithi172.stdout:8/699: sync 2024-03-19T06:05:41.887 INFO:tasks.workunit.client.1.smithi172.stdout:2/754: sync 2024-03-19T06:05:41.887 INFO:tasks.workunit.client.1.smithi172.stdout:4/803: sync 2024-03-19T06:05:41.887 INFO:tasks.workunit.client.1.smithi172.stdout:3/760: sync 2024-03-19T06:05:41.890 INFO:tasks.workunit.client.1.smithi172.stdout:3/761: write d0/d5/d6b/dae/fc8 [657675,90833] 0 2024-03-19T06:05:41.891 INFO:tasks.workunit.client.1.smithi172.stdout:8/700: readlink d0/d44/d46/d49/d26/dbc/dc6/ld0 0 2024-03-19T06:05:41.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:41 smithi172 ceph-mon[35716]: pgmap v17: 65 pgs: 65 active+clean; 1.5 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 51 MiB/s rd, 168 MiB/s wr, 355 op/s 2024-03-19T06:05:41.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:41 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2115546456' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:05:41.919 INFO:tasks.workunit.client.1.smithi172.stdout:2/755: dwrite d7/de/d58/d55/fce [0,4194304] 0 2024-03-19T06:05:41.933 INFO:tasks.workunit.client.1.smithi172.stdout:2/756: dread d7/de/d58/d56/d89/de6/fb6 [0,4194304] 0 2024-03-19T06:05:42.311 INFO:tasks.workunit.client.1.smithi172.stdout:6/885: write d5/d8f/d31/d3d/d98/db6/dc7/dd1/fd8 [4483907,105411] 0 2024-03-19T06:05:42.312 INFO:tasks.workunit.client.1.smithi172.stdout:1/768: rename da/dd/d31/dfb/c85 to da/d7a/de0/c10b 0 2024-03-19T06:05:42.314 INFO:tasks.workunit.client.1.smithi172.stdout:5/725: symlink d5/d3c/d6c/da2/lf3 0 2024-03-19T06:05:42.322 INFO:tasks.workunit.client.1.smithi172.stdout:4/804: fdatasync df/d11/d12/d21/f2a 0 2024-03-19T06:05:42.327 INFO:tasks.workunit.client.1.smithi172.stdout:3/762: mkdir d0/da8/d34/d4d/d103 0 2024-03-19T06:05:42.332 INFO:tasks.workunit.client.1.smithi172.stdout:3/763: readlink d0/da8/d25/l20 0 2024-03-19T06:05:42.332 INFO:tasks.workunit.client.1.smithi172.stdout:8/701: readlink d0/d64/l68 0 2024-03-19T06:05:42.337 INFO:tasks.workunit.client.1.smithi172.stdout:2/757: rename d7/de/cbe to d7/de/d58/d55/d66/dc1/cf5 0 2024-03-19T06:05:42.340 INFO:tasks.workunit.client.1.smithi172.stdout:1/769: write da/d33/f75 [84312,50039] 0 2024-03-19T06:05:42.342 INFO:tasks.workunit.client.1.smithi172.stdout:8/702: mknod d0/d61/d6a/d98/cde 0 2024-03-19T06:05:42.343 INFO:tasks.workunit.client.1.smithi172.stdout:7/738: dread d0/d22/d1d/d36/f54 [0,4194304] 0 2024-03-19T06:05:42.345 INFO:tasks.workunit.client.1.smithi172.stdout:2/758: fdatasync d7/de/d58/d56/d89/db5/dca/fd0 0 2024-03-19T06:05:42.346 INFO:tasks.workunit.client.1.smithi172.stdout:5/726: getdents d5/d3d/dd6 0 2024-03-19T06:05:42.347 INFO:tasks.workunit.client.1.smithi172.stdout:8/703: stat d0/d44/d46/d49/d26/l82 0 2024-03-19T06:05:42.349 INFO:tasks.workunit.client.1.smithi172.stdout:0/764: rename d11/d14/d2c/d36/lcc to d11/d14/d2c/dbc/l103 0 2024-03-19T06:05:42.350 INFO:tasks.workunit.client.1.smithi172.stdout:6/886: write d5/d8f/d31/d3d/d98/db6/d9f/fd2 [733084,128664] 0 2024-03-19T06:05:42.353 INFO:tasks.workunit.client.1.smithi172.stdout:4/805: write df/d2b/f40 [3517542,30896] 0 2024-03-19T06:05:42.353 INFO:tasks.workunit.client.1.smithi172.stdout:2/759: dread d7/de/d58/d56/f46 [0,4194304] 0 2024-03-19T06:05:42.355 INFO:tasks.workunit.client.1.smithi172.stdout:3/764: write d0/d5/fc4 [327540,5814] 0 2024-03-19T06:05:42.357 INFO:tasks.workunit.client.1.smithi172.stdout:5/727: rename d5/d1f/f82 to d5/d1f/db4/ff4 0 2024-03-19T06:05:42.361 INFO:tasks.workunit.client.1.smithi172.stdout:9/722: dwrite d1/d7/dc/de/d34/d48/fb2 [0,4194304] 0 2024-03-19T06:05:42.361 INFO:tasks.workunit.client.1.smithi172.stdout:8/704: chown d0/d44/d46/d49/d26/dc0/d3d/ld4 117 1 2024-03-19T06:05:42.364 INFO:tasks.workunit.client.1.smithi172.stdout:4/806: mknod df/d2b/d44/c100 0 2024-03-19T06:05:42.364 INFO:tasks.workunit.client.1.smithi172.stdout:5/728: read - d5/d14/d9f/fc6 zero size 2024-03-19T06:05:42.364 INFO:tasks.workunit.client.1.smithi172.stdout:6/887: creat d5/d8f/d31/d3d/d98/db6/d9f/f120 x:0 0 0 2024-03-19T06:05:42.368 INFO:tasks.workunit.client.1.smithi172.stdout:3/765: write d0/da8/d54/d90/f97 [1098352,13616] 0 2024-03-19T06:05:42.370 INFO:tasks.workunit.client.1.smithi172.stdout:2/760: rename d7/de/d58/d56/d86/caf to d7/d1b/cf6 0 2024-03-19T06:05:42.373 INFO:tasks.workunit.client.1.smithi172.stdout:5/729: mkdir d5/d55/df5 0 2024-03-19T06:05:42.374 INFO:tasks.workunit.client.1.smithi172.stdout:4/807: fdatasync df/d2b/d44/d93/fc1 0 2024-03-19T06:05:42.377 INFO:tasks.workunit.client.1.smithi172.stdout:9/723: fdatasync d1/d7/dc/d47/d78/d54/d91/f35 0 2024-03-19T06:05:42.378 INFO:tasks.workunit.client.1.smithi172.stdout:3/766: mknod d0/d5/c104 0 2024-03-19T06:05:42.382 INFO:tasks.workunit.client.1.smithi172.stdout:3/767: stat d0/da8/f2c 0 2024-03-19T06:05:42.383 INFO:tasks.workunit.client.1.smithi172.stdout:9/724: chown d1/d7/dc/f5d 438 1 2024-03-19T06:05:42.383 INFO:tasks.workunit.client.1.smithi172.stdout:5/730: creat d5/d14/d15/d40/d6a/ff6 x:0 0 0 2024-03-19T06:05:42.388 INFO:tasks.workunit.client.1.smithi172.stdout:0/765: dread d11/d14/d2c/dbf/fdd [0,4194304] 0 2024-03-19T06:05:42.392 INFO:tasks.workunit.client.1.smithi172.stdout:6/888: dread d5/d8f/d31/f89 [0,4194304] 0 2024-03-19T06:05:42.394 INFO:tasks.workunit.client.1.smithi172.stdout:7/739: dread d0/d22/d1d/d36/fc [0,4194304] 0 2024-03-19T06:05:42.396 INFO:tasks.workunit.client.1.smithi172.stdout:3/768: symlink d0/da8/d54/l105 0 2024-03-19T06:05:42.398 INFO:tasks.workunit.client.1.smithi172.stdout:8/705: dread d0/d44/d46/d49/d26/d71/d81/d27/f1e [0,4194304] 0 2024-03-19T06:05:42.401 INFO:tasks.workunit.client.1.smithi172.stdout:1/770: dwrite da/dd/d31/dfb/d36/f4c [0,4194304] 0 2024-03-19T06:05:42.404 INFO:tasks.workunit.client.1.smithi172.stdout:9/725: write d1/d7/dc/dbe/d65/f97 [3705273,36684] 0 2024-03-19T06:05:42.408 INFO:tasks.workunit.client.1.smithi172.stdout:4/808: rename df/d11/d12/d21/d58/da6 to df/d2b/d2d/d101 0 2024-03-19T06:05:42.408 INFO:tasks.workunit.client.1.smithi172.stdout:3/769: dread - d0/d5/d6b/dae/db9/fef zero size 2024-03-19T06:05:42.410 INFO:tasks.workunit.client.1.smithi172.stdout:7/740: symlink d0/d22/d1d/d36/d8d/d5c/d67/d82/lf3 0 2024-03-19T06:05:42.411 INFO:tasks.workunit.client.1.smithi172.stdout:0/766: dread d11/f91 [0,4194304] 0 2024-03-19T06:05:42.419 INFO:tasks.workunit.client.1.smithi172.stdout:8/706: read d0/d44/dd2/f4b [46430,55428] 0 2024-03-19T06:05:42.422 INFO:tasks.workunit.client.1.smithi172.stdout:9/726: symlink d1/d7/dc/d47/d78/d54/d91/lff 0 2024-03-19T06:05:42.424 INFO:tasks.workunit.client.1.smithi172.stdout:1/771: mknod da/d33/d59/c10c 0 2024-03-19T06:05:42.425 INFO:tasks.workunit.client.1.smithi172.stdout:2/761: dwrite d7/de/d58/d56/f28 [0,4194304] 0 2024-03-19T06:05:42.428 INFO:tasks.workunit.client.1.smithi172.stdout:6/889: dread d5/d8f/d31/f89 [0,4194304] 0 2024-03-19T06:05:42.428 INFO:tasks.workunit.client.1.smithi172.stdout:9/727: fdatasync d1/d7/dc/d47/d78/f7e 0 2024-03-19T06:05:42.430 INFO:tasks.workunit.client.1.smithi172.stdout:5/731: dwrite d5/d1f/f2c [0,4194304] 0 2024-03-19T06:05:42.433 INFO:tasks.workunit.client.1.smithi172.stdout:4/809: truncate df/d2b/da3/fb4 2906635 0 2024-03-19T06:05:42.433 INFO:tasks.workunit.client.1.smithi172.stdout:1/772: chown da/d33/d4e/d60/c67 25937854 1 2024-03-19T06:05:42.435 INFO:tasks.workunit.client.1.smithi172.stdout:7/741: mknod d0/d22/d1d/d36/d8d/d5c/d67/cf4 0 2024-03-19T06:05:42.436 INFO:tasks.workunit.client.1.smithi172.stdout:2/762: creat d7/de/d58/d55/da8/ff7 x:0 0 0 2024-03-19T06:05:42.437 INFO:tasks.workunit.client.1.smithi172.stdout:5/732: mkdir d5/d55/de9/df7 0 2024-03-19T06:05:42.441 INFO:tasks.workunit.client.1.smithi172.stdout:9/728: creat d1/d7/dc/de/d34/d48/d82/f100 x:0 0 0 2024-03-19T06:05:42.442 INFO:tasks.workunit.client.1.smithi172.stdout:6/890: write d5/f19 [1933854,115729] 0 2024-03-19T06:05:42.444 INFO:tasks.workunit.client.1.smithi172.stdout:7/742: write d0/d22/d1d/d36/d40/f93 [4478116,112411] 0 2024-03-19T06:05:42.444 INFO:tasks.workunit.client.1.smithi172.stdout:2/763: write d7/de/d58/d56/f6b [3215363,52293] 0 2024-03-19T06:05:42.445 INFO:tasks.workunit.client.1.smithi172.stdout:3/770: dwrite d0/d5/d6b/f8f [0,4194304] 0 2024-03-19T06:05:42.453 INFO:tasks.workunit.client.1.smithi172.stdout:0/767: rename d11/d22/df1 to d11/d18/d38/d3f/dbe/d104 0 2024-03-19T06:05:42.454 INFO:tasks.workunit.client.1.smithi172.stdout:4/810: rmdir df/d2b/d2d/dae 39 2024-03-19T06:05:42.455 INFO:tasks.workunit.client.1.smithi172.stdout:5/733: chown d5/d1f/d2f/f46 8 1 2024-03-19T06:05:42.458 INFO:tasks.workunit.client.1.smithi172.stdout:3/771: rmdir d0/db0/db6/dc7/de0/df6 39 2024-03-19T06:05:42.461 INFO:tasks.workunit.client.1.smithi172.stdout:1/773: creat da/d3b/dcd/ddb/f10d x:0 0 0 2024-03-19T06:05:42.461 INFO:tasks.workunit.client.1.smithi172.stdout:8/707: rename d0/d44/d46/d49/d26/d71/d81/d27/d29/l42 to d0/d44/dd2/da2/ldf 0 2024-03-19T06:05:42.465 INFO:tasks.workunit.client.1.smithi172.stdout:9/729: creat d1/d7/dc/dbe/f101 x:0 0 0 2024-03-19T06:05:42.466 INFO:tasks.workunit.client.1.smithi172.stdout:7/743: symlink d0/d22/d1d/d3a/lf5 0 2024-03-19T06:05:42.466 INFO:tasks.workunit.client.1.smithi172.stdout:4/811: mkdir df/d2b/d44/d93/d102 0 2024-03-19T06:05:42.467 INFO:tasks.workunit.client.1.smithi172.stdout:2/764: rmdir d7/de/d58/d56/d89/db5/dca 39 2024-03-19T06:05:42.470 INFO:tasks.workunit.client.1.smithi172.stdout:6/891: rename d5/d8f/d31/d3d/d98/db6/f102 to d5/d11/d43/d45/da1/f121 0 2024-03-19T06:05:42.475 INFO:tasks.workunit.client.1.smithi172.stdout:7/744: chown d0/d22/d1d/d36/d8d/d7d/c84 112 1 2024-03-19T06:05:42.477 INFO:tasks.workunit.client.1.smithi172.stdout:4/812: creat df/d2b/d44/d93/d102/f103 x:0 0 0 2024-03-19T06:05:42.481 INFO:tasks.workunit.client.1.smithi172.stdout:2/765: symlink d7/de/d58/d55/d5f/lf8 0 2024-03-19T06:05:42.484 INFO:tasks.workunit.client.1.smithi172.stdout:8/708: getdents d0/d44/d46 0 2024-03-19T06:05:42.485 INFO:tasks.workunit.client.1.smithi172.stdout:6/892: rmdir d5/d8f/d31/d3d/d98/db6/dc7/dd1 39 2024-03-19T06:05:42.487 INFO:tasks.workunit.client.1.smithi172.stdout:1/774: link da/d3b/dcd/ddb/ldc da/dd/d31/dfb/d14/d27/da2/dcf/l10e 0 2024-03-19T06:05:42.487 INFO:tasks.workunit.client.1.smithi172.stdout:0/768: write d11/d22/d46/f6b [998042,88432] 0 2024-03-19T06:05:42.487 INFO:tasks.workunit.client.1.smithi172.stdout:4/813: creat df/dd7/f104 x:0 0 0 2024-03-19T06:05:42.493 INFO:tasks.workunit.client.1.smithi172.stdout:3/772: dwrite d0/da8/d54/d90/f9c [4194304,4194304] 0 2024-03-19T06:05:42.495 INFO:tasks.workunit.client.1.smithi172.stdout:5/734: rename d5/d1f/d2f/d53/f78 to d5/ff8 0 2024-03-19T06:05:42.498 INFO:tasks.workunit.client.1.smithi172.stdout:7/745: creat d0/d22/d3d/ff6 x:0 0 0 2024-03-19T06:05:42.500 INFO:tasks.workunit.client.1.smithi172.stdout:9/730: dwrite d1/d7/dc/de/d34/d48/d82/d92/fc7 [0,4194304] 0 2024-03-19T06:05:42.506 INFO:tasks.workunit.client.1.smithi172.stdout:0/769: mkdir d11/d14/d2c/dc2/dcf/d105 0 2024-03-19T06:05:42.506 INFO:tasks.workunit.client.1.smithi172.stdout:2/766: creat d7/de/d58/d56/d81/dda/ff9 x:0 0 0 2024-03-19T06:05:42.508 INFO:tasks.workunit.client.1.smithi172.stdout:0/770: write d11/d22/d68/ff4 [941274,102123] 0 2024-03-19T06:05:42.509 INFO:tasks.workunit.client.1.smithi172.stdout:6/893: mknod d5/d11/d43/d45/da1/d11a/c122 0 2024-03-19T06:05:42.512 INFO:tasks.workunit.client.1.smithi172.stdout:5/735: rmdir d5/d1f/d2f/d62 39 2024-03-19T06:05:42.512 INFO:tasks.workunit.client.1.smithi172.stdout:7/746: symlink d0/d22/d27/d86/lf7 0 2024-03-19T06:05:42.519 INFO:tasks.workunit.client.1.smithi172.stdout:3/773: dwrite d0/d5/d6b/dae/fc8 [0,4194304] 0 2024-03-19T06:05:42.520 INFO:tasks.workunit.client.1.smithi172.stdout:5/736: chown d5/d14/d48/fe4 151217 1 2024-03-19T06:05:42.520 INFO:tasks.workunit.client.1.smithi172.stdout:1/775: chown da/d33/d81/c8a 151866 1 2024-03-19T06:05:42.521 INFO:tasks.workunit.client.1.smithi172.stdout:4/814: getdents df/d2b/d99 0 2024-03-19T06:05:42.523 INFO:tasks.workunit.client.1.smithi172.stdout:9/731: mknod d1/d7/dc/de/d34/d48/d82/d92/d95/db4/c102 0 2024-03-19T06:05:42.527 INFO:tasks.workunit.client.1.smithi172.stdout:8/709: dread d0/d44/d46/d49/d26/f3e [0,4194304] 0 2024-03-19T06:05:42.530 INFO:tasks.workunit.client.1.smithi172.stdout:3/774: creat d0/db0/f106 x:0 0 0 2024-03-19T06:05:42.531 INFO:tasks.workunit.client.1.smithi172.stdout:0/771: link d11/d22/d46/fec d11/d18/d38/f106 0 2024-03-19T06:05:42.532 INFO:tasks.workunit.client.1.smithi172.stdout:7/747: mkdir d0/d22/d27/db0/df8 0 2024-03-19T06:05:42.535 INFO:tasks.workunit.client.1.smithi172.stdout:1/776: dread - da/dd/d31/dfb/d14/d27/d3f/fe1 zero size 2024-03-19T06:05:42.535 INFO:tasks.workunit.client.1.smithi172.stdout:5/737: rename d5/d14/c98 to d5/d55/de9/cf9 0 2024-03-19T06:05:42.536 INFO:tasks.workunit.client.1.smithi172.stdout:8/710: chown d0/d44/dd2/c3c 30656052 1 2024-03-19T06:05:42.537 INFO:tasks.workunit.client.1.smithi172.stdout:9/732: truncate d1/d7/dc/de/d34/d48/d82/f8f 1222116 0 2024-03-19T06:05:42.537 INFO:tasks.workunit.client.1.smithi172.stdout:4/815: unlink df/d11/c14 0 2024-03-19T06:05:42.538 INFO:tasks.workunit.client.1.smithi172.stdout:3/775: symlink d0/da8/d60/l107 0 2024-03-19T06:05:42.541 INFO:tasks.workunit.client.1.smithi172.stdout:7/748: unlink d0/d22/d1d/d36/d8d/ld6 0 2024-03-19T06:05:42.541 INFO:tasks.workunit.client.1.smithi172.stdout:3/776: chown d0/da8/d34/d4d/c28 0 1 2024-03-19T06:05:42.543 INFO:tasks.workunit.client.1.smithi172.stdout:5/738: rmdir d5/d3c/d6c/d9b 39 2024-03-19T06:05:42.544 INFO:tasks.workunit.client.1.smithi172.stdout:5/739: stat d5/d55 0 2024-03-19T06:05:42.545 INFO:tasks.workunit.client.1.smithi172.stdout:0/772: creat d11/d14/d2c/dbc/f107 x:0 0 0 2024-03-19T06:05:42.550 INFO:tasks.workunit.client.1.smithi172.stdout:4/816: unlink df/d11/d12/d21/d50/d63/dbb/dc4/ff6 0 2024-03-19T06:05:42.551 INFO:tasks.workunit.client.1.smithi172.stdout:0/773: mkdir d11/d14/d2c/dc2/d108 0 2024-03-19T06:05:42.552 INFO:tasks.workunit.client.1.smithi172.stdout:2/767: truncate d7/de/f5b 1842201 0 2024-03-19T06:05:42.554 INFO:tasks.workunit.client.1.smithi172.stdout:5/740: symlink d5/d3c/d6c/da2/lfa 0 2024-03-19T06:05:42.555 INFO:tasks.workunit.client.1.smithi172.stdout:9/733: symlink d1/d7/dc/d47/da3/l103 0 2024-03-19T06:05:42.559 INFO:tasks.workunit.client.1.smithi172.stdout:3/777: link d0/c80 d0/da8/d34/d4d/dc5/df0/c108 0 2024-03-19T06:05:42.560 INFO:tasks.workunit.client.1.smithi172.stdout:4/817: chown df/d2b/d2d/db0/fea 2155 1 2024-03-19T06:05:42.563 INFO:tasks.workunit.client.1.smithi172.stdout:0/774: fsync d11/d18/d38/d3f/d43/d62/f95 0 2024-03-19T06:05:42.570 INFO:tasks.workunit.client.1.smithi172.stdout:3/778: fdatasync d0/da8/d54/d77/f99 0 2024-03-19T06:05:42.575 INFO:tasks.workunit.client.1.smithi172.stdout:6/894: dwrite d5/d11/d17/d1b/d74/faa [0,4194304] 0 2024-03-19T06:05:42.580 INFO:tasks.workunit.client.1.smithi172.stdout:7/749: dwrite d0/d22/d27/d86/ff1 [0,4194304] 0 2024-03-19T06:05:42.582 INFO:tasks.workunit.client.1.smithi172.stdout:1/777: dwrite da/dd/d31/dfb/d14/f100 [0,4194304] 0 2024-03-19T06:05:42.594 INFO:tasks.workunit.client.1.smithi172.stdout:1/778: chown da/d33/d59 21 1 2024-03-19T06:05:42.594 INFO:tasks.workunit.client.1.smithi172.stdout:2/768: truncate d7/de/d58/d57/f7d 1213770 0 2024-03-19T06:05:42.596 INFO:tasks.workunit.client.1.smithi172.stdout:9/734: truncate d1/d7/dc/de/d34/d48/d89/fdc 4570338 0 2024-03-19T06:05:42.597 INFO:tasks.workunit.client.1.smithi172.stdout:8/711: dwrite d0/d44/d46/d49/d26/d71/d81/f4a [0,4194304] 0 2024-03-19T06:05:42.597 INFO:tasks.workunit.client.1.smithi172.stdout:4/818: rename df/d2b/d2d/d101/dc9/dd2/fdb to df/d11/d12/d34/dd0/f105 0 2024-03-19T06:05:42.601 INFO:tasks.workunit.client.1.smithi172.stdout:0/775: getdents d11/d18/d38/d3f 0 2024-03-19T06:05:42.603 INFO:tasks.workunit.client.1.smithi172.stdout:2/769: creat d7/de/d58/d55/d66/ffa x:0 0 0 2024-03-19T06:05:42.606 INFO:tasks.workunit.client.1.smithi172.stdout:0/776: write d11/d14/d9a/fbd [273060,51442] 0 2024-03-19T06:05:42.612 INFO:tasks.workunit.client.1.smithi172.stdout:1/779: rename da/dd/c1c to da/d3b/dcd/deb/c10f 0 2024-03-19T06:05:42.615 INFO:tasks.workunit.client.1.smithi172.stdout:2/770: unlink d7/de/d58/d55/f82 0 2024-03-19T06:05:42.620 INFO:tasks.workunit.client.1.smithi172.stdout:1/780: mknod da/dd/d31/dfb/d14/d27/da7/c110 0 2024-03-19T06:05:42.626 INFO:tasks.workunit.client.1.smithi172.stdout:6/895: link d5/d11/d43/da6/dd9/fdb d5/d8f/d31/d3d/d98/db6/dc7/f123 0 2024-03-19T06:05:42.626 INFO:tasks.workunit.client.1.smithi172.stdout:3/779: dread d0/da8/d34/f64 [0,4194304] 0 2024-03-19T06:05:42.628 INFO:tasks.workunit.client.1.smithi172.stdout:8/712: write d0/d44/d46/d49/d26/dc0/dd3/fd7 [667561,3977] 0 2024-03-19T06:05:42.632 INFO:tasks.workunit.client.1.smithi172.stdout:0/777: dwrite d11/d22/d32/f58 [0,4194304] 0 2024-03-19T06:05:42.632 INFO:tasks.workunit.client.1.smithi172.stdout:4/819: dwrite df/dd7/fe0 [0,4194304] 0 2024-03-19T06:05:42.634 INFO:tasks.workunit.client.1.smithi172.stdout:2/771: getdents d7/db/d45 0 2024-03-19T06:05:42.636 INFO:tasks.workunit.client.1.smithi172.stdout:6/896: chown d5/d11/d17/d36/d48/cc5 20 1 2024-03-19T06:05:42.637 INFO:tasks.workunit.client.1.smithi172.stdout:3/780: write d0/da8/d54/d77/f99 [2050383,117224] 0 2024-03-19T06:05:42.641 INFO:tasks.workunit.client.1.smithi172.stdout:5/741: dread d5/fd [0,4194304] 0 2024-03-19T06:05:42.641 INFO:tasks.workunit.client.1.smithi172.stdout:3/781: stat d0/da8/d3a/l44 0 2024-03-19T06:05:42.643 INFO:tasks.workunit.client.1.smithi172.stdout:4/820: fsync df/d11/d12/d21/d58/d60/f7a 0 2024-03-19T06:05:42.645 INFO:tasks.workunit.client.1.smithi172.stdout:0/778: mknod d11/d14/d2c/dbf/c109 0 2024-03-19T06:05:42.650 INFO:tasks.workunit.client.1.smithi172.stdout:5/742: creat d5/d14/d9f/ffb x:0 0 0 2024-03-19T06:05:42.654 INFO:tasks.workunit.client.1.smithi172.stdout:2/772: rename d7/de/d58/d55/d5f/dcd to d7/de/d58/d56/d86/d9d/dfb 0 2024-03-19T06:05:42.656 INFO:tasks.workunit.client.1.smithi172.stdout:5/743: symlink d5/d14/d15/d40/d5c/lfc 0 2024-03-19T06:05:42.659 INFO:tasks.workunit.client.1.smithi172.stdout:7/750: dread d0/d22/d3d/d41/f87 [4194304,4194304] 0 2024-03-19T06:05:42.660 INFO:tasks.workunit.client.1.smithi172.stdout:4/821: chown df/d11/d12/d21/d58/f83 1680203 1 2024-03-19T06:05:42.661 INFO:tasks.workunit.client.1.smithi172.stdout:0/779: creat d11/d14/d9a/dea/dab/dc1/dd9/f10a x:0 0 0 2024-03-19T06:05:42.663 INFO:tasks.workunit.client.1.smithi172.stdout:5/744: rmdir d5/d55/de7 39 2024-03-19T06:05:42.664 INFO:tasks.workunit.client.1.smithi172.stdout:6/897: dread d5/d8f/d31/d3d/d98/df9/f38 [0,4194304] 0 2024-03-19T06:05:42.665 INFO:tasks.workunit.client.1.smithi172.stdout:8/713: dread d0/d44/d46/d49/f5d [0,4194304] 0 2024-03-19T06:05:42.669 INFO:tasks.workunit.client.1.smithi172.stdout:9/735: dread d1/d7/dc/de/d34/d48/d89/f98 [0,4194304] 0 2024-03-19T06:05:42.669 INFO:tasks.workunit.client.1.smithi172.stdout:2/773: truncate d7/d1b/f3f 797270 0 2024-03-19T06:05:42.670 INFO:tasks.workunit.client.1.smithi172.stdout:4/822: creat df/d2b/d2d/f106 x:0 0 0 2024-03-19T06:05:42.672 INFO:tasks.workunit.client.1.smithi172.stdout:4/823: dread - df/d2b/d2d/d101/fec zero size 2024-03-19T06:05:42.676 INFO:tasks.workunit.client.1.smithi172.stdout:9/736: fsync d1/d7/dc/d47/f61 0 2024-03-19T06:05:42.677 INFO:tasks.workunit.client.1.smithi172.stdout:8/714: getdents d0/d44/d46/d49 0 2024-03-19T06:05:42.678 INFO:tasks.workunit.client.1.smithi172.stdout:2/774: rename d7/de/d58/d57/fc4 to d7/de/d58/d57/ffc 0 2024-03-19T06:05:42.680 INFO:tasks.workunit.client.1.smithi172.stdout:7/751: link d0/c7f d0/d22/d1d/d36/d8d/d5c/d67/cf9 0 2024-03-19T06:05:42.685 INFO:tasks.workunit.client.1.smithi172.stdout:3/782: dread d0/db0/db6/dc7/de0/df6/ff7 [0,4194304] 0 2024-03-19T06:05:42.686 INFO:tasks.workunit.client.1.smithi172.stdout:7/752: chown d0/d22/d35/dc7/feb 37816 1 2024-03-19T06:05:42.688 INFO:tasks.workunit.client.1.smithi172.stdout:4/824: read df/d2b/d2d/f9d [1969001,52128] 0 2024-03-19T06:05:42.689 INFO:tasks.workunit.client.1.smithi172.stdout:8/715: rename d0/d61/f6b to d0/d44/d46/d49/d26/dbc/fe0 0 2024-03-19T06:05:42.689 INFO:tasks.workunit.client.1.smithi172.stdout:2/775: chown d7/de/d58/d56/d89/de6/c87 0 1 2024-03-19T06:05:42.692 INFO:tasks.workunit.client.1.smithi172.stdout:5/745: dwrite d5/d14/d34/f75 [0,4194304] 0 2024-03-19T06:05:42.692 INFO:tasks.workunit.client.1.smithi172.stdout:0/780: dwrite d11/d14/d9a/dea/fe6 [0,4194304] 0 2024-03-19T06:05:42.694 INFO:tasks.workunit.client.1.smithi172.stdout:7/753: mkdir d0/d22/d1d/d85/da8/dfa 0 2024-03-19T06:05:42.697 INFO:tasks.workunit.client.1.smithi172.stdout:4/825: mknod df/d2b/d44/d67/c107 0 2024-03-19T06:05:42.697 INFO:tasks.workunit.client.1.smithi172.stdout:7/754: chown d0/d22/f9c 4647 1 2024-03-19T06:05:42.700 INFO:tasks.workunit.client.1.smithi172.stdout:0/781: rmdir d11/d18/d38/d3f/dbe 39 2024-03-19T06:05:42.701 INFO:tasks.workunit.client.1.smithi172.stdout:8/716: creat d0/d44/d46/d49/d26/dc0/d3d/d83/fe1 x:0 0 0 2024-03-19T06:05:42.705 INFO:tasks.workunit.client.1.smithi172.stdout:9/737: dwrite d1/d7/dc/de/f1d [4194304,4194304] 0 2024-03-19T06:05:42.705 INFO:tasks.workunit.client.1.smithi172.stdout:5/746: getdents d5/d1f/d2f/d53/dde 0 2024-03-19T06:05:42.706 INFO:tasks.workunit.client.1.smithi172.stdout:3/783: read d0/da8/d3a/fa3 [4650899,102184] 0 2024-03-19T06:05:42.712 INFO:tasks.workunit.client.1.smithi172.stdout:8/717: chown d0/d44/d46/d49/d26/d71/d81/l1b 20526 1 2024-03-19T06:05:42.713 INFO:tasks.workunit.client.1.smithi172.stdout:3/784: readlink d0/da8/l48 0 2024-03-19T06:05:42.716 INFO:tasks.workunit.client.1.smithi172.stdout:8/718: dread - d0/d61/d6a/d9f/fd8 zero size 2024-03-19T06:05:42.723 INFO:tasks.workunit.client.1.smithi172.stdout:4/826: write df/d2b/d2d/f8a [825561,63620] 0 2024-03-19T06:05:42.724 INFO:tasks.workunit.client.1.smithi172.stdout:2/776: dwrite d7/de/d58/d56/d86/d9d/fbf [0,4194304] 0 2024-03-19T06:05:42.724 INFO:tasks.workunit.client.1.smithi172.stdout:7/755: truncate d0/d22/d27/db0/fad 86766 0 2024-03-19T06:05:42.727 INFO:tasks.workunit.client.1.smithi172.stdout:0/782: rename d11/d14/db7/cd0 to d11/d14/d2c/c10b 0 2024-03-19T06:05:42.728 INFO:tasks.workunit.client.1.smithi172.stdout:8/719: write d0/d44/d46/d49/d26/dc0/d3d/fa1 [1411337,54938] 0 2024-03-19T06:05:42.728 INFO:tasks.workunit.client.1.smithi172.stdout:7/756: fsync d0/d22/d35/dc7/fd5 0 2024-03-19T06:05:42.729 INFO:tasks.workunit.client.1.smithi172.stdout:2/777: rmdir d7/de/d58/d55/d66/dc1 39 2024-03-19T06:05:42.732 INFO:tasks.workunit.client.1.smithi172.stdout:8/720: chown d0/f39 42527 1 2024-03-19T06:05:42.734 INFO:tasks.workunit.client.1.smithi172.stdout:5/747: rename d5/d55/fdb to d5/d1f/db4/ffd 0 2024-03-19T06:05:42.734 INFO:tasks.workunit.client.1.smithi172.stdout:4/827: mknod df/d2b/d2d/d101/dc9/c108 0 2024-03-19T06:05:42.734 INFO:tasks.workunit.client.1.smithi172.stdout:0/783: fsync d11/d14/d9a/dea/dab/dc1/dd9/de4/ff9 0 2024-03-19T06:05:42.735 INFO:tasks.workunit.client.1.smithi172.stdout:8/721: creat d0/d44/dd2/da2/fe2 x:0 0 0 2024-03-19T06:05:42.738 INFO:tasks.workunit.client.1.smithi172.stdout:0/784: chown d11/d14/d2c/d36/f100 3772092 1 2024-03-19T06:05:42.740 INFO:tasks.workunit.client.1.smithi172.stdout:4/828: mkdir df/d11/d12/d34/d109 0 2024-03-19T06:05:42.742 INFO:tasks.workunit.client.1.smithi172.stdout:0/785: fdatasync d11/d14/d2c/dbc/f107 0 2024-03-19T06:05:42.745 INFO:tasks.workunit.client.1.smithi172.stdout:8/722: write d0/d44/d46/d49/d26/d71/d81/d27/f1e [2941626,45399] 0 2024-03-19T06:05:42.746 INFO:tasks.workunit.client.1.smithi172.stdout:4/829: creat df/d11/d12/d26/d84/f10a x:0 0 0 2024-03-19T06:05:42.748 INFO:tasks.workunit.client.1.smithi172.stdout:3/785: write d0/d5/d6b/dae/fad [782698,10033] 0 2024-03-19T06:05:42.750 INFO:tasks.workunit.client.1.smithi172.stdout:0/786: symlink d11/d18/da5/da8/l10c 0 2024-03-19T06:05:42.754 INFO:tasks.workunit.client.1.smithi172.stdout:7/757: dwrite d0/fc5 [0,4194304] 0 2024-03-19T06:05:42.757 INFO:tasks.workunit.client.1.smithi172.stdout:3/786: rmdir d0/da8/d54 39 2024-03-19T06:05:42.757 INFO:tasks.workunit.client.1.smithi172.stdout:2/778: write d7/de/d58/d56/f39 [2350299,123987] 0 2024-03-19T06:05:42.759 INFO:tasks.workunit.client.1.smithi172.stdout:8/723: mkdir d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3 0 2024-03-19T06:05:42.760 INFO:tasks.workunit.client.1.smithi172.stdout:9/738: dwrite d1/d7/dc/de/d34/d48/fa4 [0,4194304] 0 2024-03-19T06:05:42.763 INFO:tasks.workunit.client.1.smithi172.stdout:8/724: chown d0/d61/d6a/cdc 88017679 1 2024-03-19T06:05:42.763 INFO:tasks.workunit.client.1.smithi172.stdout:0/787: rename d11/d14/d2c/l54 to d11/d14/d2c/d4e/l10d 0 2024-03-19T06:05:42.763 INFO:tasks.workunit.client.1.smithi172.stdout:9/739: read - d1/d7/dc/fe0 zero size 2024-03-19T06:05:42.763 INFO:tasks.workunit.client.1.smithi172.stdout:4/830: rmdir df/d11/d12 39 2024-03-19T06:05:42.765 INFO:tasks.workunit.client.1.smithi172.stdout:2/779: read d7/de/d58/d57/ffc [702112,129695] 0 2024-03-19T06:05:42.765 INFO:tasks.workunit.client.1.smithi172.stdout:5/748: dwrite d5/d14/d15/d40/d6a/fbe [0,4194304] 0 2024-03-19T06:05:42.767 INFO:tasks.workunit.client.1.smithi172.stdout:9/740: read - d1/d7/dc/fe8 zero size 2024-03-19T06:05:42.772 INFO:tasks.workunit.client.1.smithi172.stdout:3/787: mknod d0/da8/c109 0 2024-03-19T06:05:42.779 INFO:tasks.workunit.client.1.smithi172.stdout:9/741: rename d1/d7/dc/faf to d1/d7/dc/de/d34/dd7/f104 0 2024-03-19T06:05:42.783 INFO:tasks.workunit.client.1.smithi172.stdout:2/780: mkdir d7/de/dfd 0 2024-03-19T06:05:42.785 INFO:tasks.workunit.client.1.smithi172.stdout:0/788: mkdir d11/d18/d38/d3f/d43/d62/dc0/d10e 0 2024-03-19T06:05:42.787 INFO:tasks.workunit.client.1.smithi172.stdout:8/725: dwrite d0/d44/d46/d49/d26/d71/d81/d27/f1e [0,4194304] 0 2024-03-19T06:05:42.788 INFO:tasks.workunit.client.1.smithi172.stdout:3/788: fsync d0/da8/d54/d77/ffc 0 2024-03-19T06:05:42.792 INFO:tasks.workunit.client.1.smithi172.stdout:2/781: symlink d7/d4c/d70/lfe 0 2024-03-19T06:05:42.792 INFO:tasks.workunit.client.1.smithi172.stdout:9/742: creat d1/d7/dc/dbe/f105 x:0 0 0 2024-03-19T06:05:42.795 INFO:tasks.workunit.client.1.smithi172.stdout:5/749: write d5/fe [2742289,62669] 0 2024-03-19T06:05:42.795 INFO:tasks.workunit.client.1.smithi172.stdout:0/789: creat d11/d14/ded/f10f x:0 0 0 2024-03-19T06:05:42.797 INFO:tasks.workunit.client.1.smithi172.stdout:5/750: dread - d5/d14/d34/f94 zero size 2024-03-19T06:05:42.797 INFO:tasks.workunit.client.1.smithi172.stdout:8/726: unlink d0/d44/d46/d49/d26/cda 0 2024-03-19T06:05:42.797 INFO:tasks.workunit.client.1.smithi172.stdout:2/782: chown d7/da6 692 1 2024-03-19T06:05:42.802 INFO:tasks.workunit.client.1.smithi172.stdout:9/743: fdatasync d1/f9 0 2024-03-19T06:05:42.805 INFO:tasks.workunit.client.1.smithi172.stdout:5/751: rename d5/fd to d5/d55/d91/ffe 0 2024-03-19T06:05:42.807 INFO:tasks.workunit.client.1.smithi172.stdout:8/727: read d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/fa5 [490664,14416] 0 2024-03-19T06:05:42.810 INFO:tasks.workunit.client.1.smithi172.stdout:5/752: mkdir d5/d3d/d60/dff 0 2024-03-19T06:05:42.813 INFO:tasks.workunit.client.1.smithi172.stdout:8/728: readlink d0/d44/d46/d49/d26/d71/d81/l1b 0 2024-03-19T06:05:42.814 INFO:tasks.workunit.client.1.smithi172.stdout:3/789: dwrite d0/d5/d14/f17 [0,4194304] 0 2024-03-19T06:05:42.815 INFO:tasks.workunit.client.1.smithi172.stdout:9/744: truncate d1/d7/dc/de/f1f 4166658 0 2024-03-19T06:05:42.819 INFO:tasks.workunit.client.1.smithi172.stdout:3/790: chown d0/da8/d34/d4d/dc5/df2 14896100 1 2024-03-19T06:05:42.819 INFO:tasks.workunit.client.1.smithi172.stdout:8/729: mkdir d0/d61/d6a/d9f/de4 0 2024-03-19T06:05:42.822 INFO:tasks.workunit.client.1.smithi172.stdout:4/831: dwrite df/d2b/d2d/f38 [0,4194304] 0 2024-03-19T06:05:42.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:42 smithi072 ceph-mon[28706]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:42.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:42 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1528889629' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:05:42.828 INFO:tasks.workunit.client.1.smithi172.stdout:6/898: sync 2024-03-19T06:05:42.828 INFO:tasks.workunit.client.1.smithi172.stdout:1/781: sync 2024-03-19T06:05:42.828 INFO:tasks.workunit.client.1.smithi172.stdout:0/790: dwrite d11/d18/d38/d3f/f6e [0,4194304] 0 2024-03-19T06:05:42.831 INFO:tasks.workunit.client.1.smithi172.stdout:8/730: symlink d0/d44/d46/d49/d26/le5 0 2024-03-19T06:05:42.842 INFO:tasks.workunit.client.1.smithi172.stdout:6/899: creat d5/d8f/d31/d3d/d98/db6/d40/d53/d75/df8/f124 x:0 0 0 2024-03-19T06:05:42.843 INFO:tasks.workunit.client.1.smithi172.stdout:2/783: dwrite d7/de/d58/d56/f2b [0,4194304] 0 2024-03-19T06:05:42.850 INFO:tasks.workunit.client.1.smithi172.stdout:1/782: getdents da/dd/d31/dfb 0 2024-03-19T06:05:42.851 INFO:tasks.workunit.client.1.smithi172.stdout:3/791: write d0/da8/d60/f7e [2430886,17298] 0 2024-03-19T06:05:42.854 INFO:tasks.workunit.client.1.smithi172.stdout:6/900: creat d5/d11/d17/da4/f125 x:0 0 0 2024-03-19T06:05:42.857 INFO:tasks.workunit.client.1.smithi172.stdout:9/745: dread d1/fa [0,4194304] 0 2024-03-19T06:05:42.859 INFO:tasks.workunit.client.1.smithi172.stdout:4/832: dwrite df/d11/d12/d34/f74 [4194304,4194304] 0 2024-03-19T06:05:42.862 INFO:tasks.workunit.client.1.smithi172.stdout:3/792: write d0/d5/d6b/dae/db9/fef [617496,32293] 0 2024-03-19T06:05:42.873 INFO:tasks.workunit.client.1.smithi172.stdout:1/783: rename da/d7a/de0/lf4 to da/dd/d31/dfb/d14/d27/d53/l111 0 2024-03-19T06:05:42.874 INFO:tasks.workunit.client.1.smithi172.stdout:6/901: fsync d5/d8f/d31/d3d/d98/db6/d40/d53/d75/df8/f11d 0 2024-03-19T06:05:42.876 INFO:tasks.workunit.client.1.smithi172.stdout:8/731: dwrite d0/d44/d46/d49/d26/d71/d81/d27/d29/f32 [0,4194304] 0 2024-03-19T06:05:42.876 INFO:tasks.workunit.client.1.smithi172.stdout:3/793: symlink d0/d5/dfa/l10a 0 2024-03-19T06:05:42.878 INFO:tasks.workunit.client.1.smithi172.stdout:3/794: chown d0/da8/d25 880627 1 2024-03-19T06:05:42.878 INFO:tasks.workunit.client.1.smithi172.stdout:2/784: dwrite d7/f93 [0,4194304] 0 2024-03-19T06:05:42.879 INFO:tasks.workunit.client.1.smithi172.stdout:9/746: truncate d1/fa 3366655 0 2024-03-19T06:05:42.881 INFO:tasks.workunit.client.1.smithi172.stdout:1/784: creat da/d33/d52/f112 x:0 0 0 2024-03-19T06:05:42.881 INFO:tasks.workunit.client.1.smithi172.stdout:0/791: dwrite d11/d18/d38/f8f [4194304,4194304] 0 2024-03-19T06:05:42.882 INFO:tasks.workunit.client.1.smithi172.stdout:8/732: readlink d0/d44/l8f 0 2024-03-19T06:05:42.887 INFO:tasks.workunit.client.1.smithi172.stdout:0/792: chown d11/d18/da5/da8/lae 0 1 2024-03-19T06:05:42.888 INFO:tasks.workunit.client.1.smithi172.stdout:8/733: dread - d0/d44/d46/d49/d26/d71/d81/fba zero size 2024-03-19T06:05:42.888 INFO:tasks.workunit.client.1.smithi172.stdout:2/785: chown d7/de/f5b 35913 1 2024-03-19T06:05:42.892 INFO:tasks.workunit.client.1.smithi172.stdout:8/734: chown d0/d44/d46/d49/d26/dc0/l95 1518410 1 2024-03-19T06:05:42.893 INFO:tasks.workunit.client.1.smithi172.stdout:6/902: mknod d5/d11/d43/d45/da1/de1/dfa/dfc/c126 0 2024-03-19T06:05:42.893 INFO:tasks.workunit.client.1.smithi172.stdout:9/747: rmdir d1/d7/dc/d47/d78/d54 39 2024-03-19T06:05:42.897 INFO:tasks.workunit.client.1.smithi172.stdout:0/793: fsync d11/d18/d38/f80 0 2024-03-19T06:05:42.898 INFO:tasks.workunit.client.1.smithi172.stdout:1/785: link da/dd/d31/dfb/d14/d27/da7/c110 da/d7a/c113 0 2024-03-19T06:05:42.899 INFO:tasks.workunit.client.1.smithi172.stdout:4/833: truncate df/d11/d12/d21/f4b 1532527 0 2024-03-19T06:05:42.900 INFO:tasks.workunit.client.1.smithi172.stdout:3/795: dread d0/d5/d6b/f8f [0,4194304] 0 2024-03-19T06:05:42.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:42 smithi172 ceph-mon[35716]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:05:42.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:42 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1528889629' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:05:42.904 INFO:tasks.workunit.client.1.smithi172.stdout:4/834: write df/d11/d12/d26/f35 [2464321,42748] 0 2024-03-19T06:05:42.905 INFO:tasks.workunit.client.1.smithi172.stdout:6/903: unlink d5/d8f/d31/d3d/d98/db6/d40/d53/d75/dd3/fe2 0 2024-03-19T06:05:42.907 INFO:tasks.workunit.client.1.smithi172.stdout:9/748: dread d1/d7/dc/d47/d78/f7e [0,4194304] 0 2024-03-19T06:05:42.907 INFO:tasks.workunit.client.1.smithi172.stdout:1/786: fdatasync da/dd/d31/dfb/d14/d27/d3f/d5e/dab/fbe 0 2024-03-19T06:05:42.909 INFO:tasks.workunit.client.1.smithi172.stdout:8/735: link d0/d64/l68 d0/d61/d6a/d98/le6 0 2024-03-19T06:05:42.915 INFO:tasks.workunit.client.1.smithi172.stdout:4/835: truncate df/d11/d12/d21/f2a 4739351 0 2024-03-19T06:05:42.916 INFO:tasks.workunit.client.1.smithi172.stdout:9/749: write d1/d7/dc/de/d34/dd7/f104 [1877101,48112] 0 2024-03-19T06:05:42.919 INFO:tasks.workunit.client.1.smithi172.stdout:6/904: symlink d5/d11/d17/d36/d106/d119/l127 0 2024-03-19T06:05:42.925 INFO:tasks.workunit.client.1.smithi172.stdout:0/794: dwrite d11/d14/d9a/dea/f5a [0,4194304] 0 2024-03-19T06:05:42.925 INFO:tasks.workunit.client.1.smithi172.stdout:7/758: sync 2024-03-19T06:05:42.927 INFO:tasks.workunit.client.1.smithi172.stdout:4/836: fsync df/d11/d12/d21/f4b 0 2024-03-19T06:05:42.931 INFO:tasks.workunit.client.1.smithi172.stdout:8/736: read d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/f30 [80969,62659] 0 2024-03-19T06:05:42.931 INFO:tasks.workunit.client.1.smithi172.stdout:6/905: creat d5/d8f/d31/db8/f128 x:0 0 0 2024-03-19T06:05:42.934 INFO:tasks.workunit.client.1.smithi172.stdout:9/750: dread - d1/d7/dc/d47/d78/d54/d91/fbd zero size 2024-03-19T06:05:42.941 INFO:tasks.workunit.client.1.smithi172.stdout:7/759: mkdir d0/d22/d3d/dfb 0 2024-03-19T06:05:42.941 INFO:tasks.workunit.client.1.smithi172.stdout:8/737: mknod d0/d44/dd2/da2/ce7 0 2024-03-19T06:05:42.941 INFO:tasks.workunit.client.1.smithi172.stdout:1/787: dwrite da/fd6 [0,4194304] 0 2024-03-19T06:05:42.942 INFO:tasks.workunit.client.1.smithi172.stdout:2/786: dread d7/de/d58/d55/da8/f84 [0,4194304] 0 2024-03-19T06:05:42.944 INFO:tasks.workunit.client.1.smithi172.stdout:7/760: fsync d0/f9a 0 2024-03-19T06:05:42.944 INFO:tasks.workunit.client.1.smithi172.stdout:0/795: dread d11/d22/f4a [0,4194304] 0 2024-03-19T06:05:42.945 INFO:tasks.workunit.client.1.smithi172.stdout:8/738: write d0/fb6 [563726,123196] 0 2024-03-19T06:05:42.950 INFO:tasks.workunit.client.1.smithi172.stdout:1/788: symlink da/d3b/dcd/ddb/l114 0 2024-03-19T06:05:42.950 INFO:tasks.workunit.client.1.smithi172.stdout:6/906: fsync d5/d8f/d31/d3d/d98/db6/dc7/dd1/fd8 0 2024-03-19T06:05:42.951 INFO:tasks.workunit.client.1.smithi172.stdout:3/796: dwrite d0/fbc [0,4194304] 0 2024-03-19T06:05:42.951 INFO:tasks.workunit.client.1.smithi172.stdout:8/739: write d0/f58 [1960064,69482] 0 2024-03-19T06:05:42.954 INFO:tasks.workunit.client.1.smithi172.stdout:0/796: chown d11/d14/d2c/d8d/lb4 286 1 2024-03-19T06:05:42.957 INFO:tasks.workunit.client.1.smithi172.stdout:3/797: read d0/d5/d6b/dae/d88/fbd [4821427,11711] 0 2024-03-19T06:05:42.958 INFO:tasks.workunit.client.1.smithi172.stdout:3/798: chown d0/da8/d34 46613860 1 2024-03-19T06:05:42.960 INFO:tasks.workunit.client.1.smithi172.stdout:0/797: write d11/d14/d9a/fbd [663737,26823] 0 2024-03-19T06:05:42.960 INFO:tasks.workunit.client.1.smithi172.stdout:9/751: read d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/fa0 [72115,36196] 0 2024-03-19T06:05:42.962 INFO:tasks.workunit.client.1.smithi172.stdout:7/761: rename d0/d22/d1d/d36/f54 to d0/d22/d1d/d36/d56/ffc 0 2024-03-19T06:05:42.962 INFO:tasks.workunit.client.1.smithi172.stdout:6/907: mknod d5/c129 0 2024-03-19T06:05:42.964 INFO:tasks.workunit.client.1.smithi172.stdout:2/787: link d7/d4c/d70/fb3 d7/de/d58/d56/d81/fff 0 2024-03-19T06:05:42.964 INFO:tasks.workunit.client.1.smithi172.stdout:3/799: stat d0/da8/dce/d72/cff 0 2024-03-19T06:05:42.964 INFO:tasks.workunit.client.1.smithi172.stdout:6/908: readlink d5/l59 0 2024-03-19T06:05:42.967 INFO:tasks.workunit.client.1.smithi172.stdout:2/788: chown d7/de/d58/d56/d81/dda 232902411 1 2024-03-19T06:05:42.970 INFO:tasks.workunit.client.1.smithi172.stdout:9/752: mkdir d1/d7/dc/de/d34/dfd/d106 0 2024-03-19T06:05:42.970 INFO:tasks.workunit.client.1.smithi172.stdout:1/789: truncate da/dd/d31/dfb/d14/d27/d3f/d5e/dab/fbe 2388270 0 2024-03-19T06:05:42.972 INFO:tasks.workunit.client.1.smithi172.stdout:3/800: creat d0/da8/d54/d77/f10b x:0 0 0 2024-03-19T06:05:42.972 INFO:tasks.workunit.client.1.smithi172.stdout:0/798: stat d11/d18/d38/d3f/d9f/dbb/dc8 0 2024-03-19T06:05:42.974 INFO:tasks.workunit.client.1.smithi172.stdout:2/789: mkdir d7/db/d2c/d35/de5/d100 0 2024-03-19T06:05:42.974 INFO:tasks.workunit.client.1.smithi172.stdout:6/909: truncate d5/d8f/d31/d3d/f11c 5150006 0 2024-03-19T06:05:42.976 INFO:tasks.workunit.client.1.smithi172.stdout:1/790: chown da/dd/d31/dfb/d14/d27/f37 277246226 1 2024-03-19T06:05:42.977 INFO:tasks.workunit.client.1.smithi172.stdout:6/910: chown d5/d8f/fdc 3755454 1 2024-03-19T06:05:42.983 INFO:tasks.workunit.client.1.smithi172.stdout:6/911: read d5/d11/d43/d45/f97 [12233201,2870] 0 2024-03-19T06:05:42.983 INFO:tasks.workunit.client.1.smithi172.stdout:2/790: creat d7/de/d58/d56/d89/db5/f101 x:0 0 0 2024-03-19T06:05:42.986 INFO:tasks.workunit.client.1.smithi172.stdout:6/912: creat d5/d11/d43/d45/da1/de1/dfa/f12a x:0 0 0 2024-03-19T06:05:42.986 INFO:tasks.workunit.client.1.smithi172.stdout:1/791: mkdir da/d115 0 2024-03-19T06:05:42.988 INFO:tasks.workunit.client.1.smithi172.stdout:9/753: write d1/f1c [2387080,43080] 0 2024-03-19T06:05:42.994 INFO:tasks.workunit.client.1.smithi172.stdout:1/792: creat da/dd/d31/dfb/d14/d84/f116 x:0 0 0 2024-03-19T06:05:42.995 INFO:tasks.workunit.client.1.smithi172.stdout:9/754: creat d1/d7/dc/de/d34/d48/f107 x:0 0 0 2024-03-19T06:05:43.001 INFO:tasks.workunit.client.1.smithi172.stdout:3/801: dwrite d0/da8/d60/d67/f69 [0,4194304] 0 2024-03-19T06:05:43.001 INFO:tasks.workunit.client.1.smithi172.stdout:8/740: dread d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c/fb2 [4194304,4194304] 0 2024-03-19T06:05:43.002 INFO:tasks.workunit.client.1.smithi172.stdout:7/762: dread d0/f9a [0,4194304] 0 2024-03-19T06:05:43.005 INFO:tasks.workunit.client.1.smithi172.stdout:1/793: write da/dd/d31/dfb/d14/d27/d3f/d5e/dab/dde/fd5 [1045107,129825] 0 2024-03-19T06:05:43.008 INFO:tasks.workunit.client.1.smithi172.stdout:7/763: stat d0/d22/d1d/d36/d8d/d5c/c9b 0 2024-03-19T06:05:43.010 INFO:tasks.workunit.client.1.smithi172.stdout:3/802: creat d0/da8/d25/d21/f10c x:0 0 0 2024-03-19T06:05:43.012 INFO:tasks.workunit.client.1.smithi172.stdout:9/755: getdents d1/d7/dc/de/d34/d48/d82/d92/d95 0 2024-03-19T06:05:43.012 INFO:tasks.workunit.client.1.smithi172.stdout:6/913: dwrite d5/d11/d17/d36/d48/fdd [0,4194304] 0 2024-03-19T06:05:43.013 INFO:tasks.workunit.client.1.smithi172.stdout:2/791: dread d7/de/d58/d57/fd6 [0,4194304] 0 2024-03-19T06:05:43.016 INFO:tasks.workunit.client.1.smithi172.stdout:1/794: fsync da/dd/d31/dfb/d14/d27/f5a 0 2024-03-19T06:05:43.016 INFO:tasks.workunit.client.1.smithi172.stdout:7/764: creat d0/d22/d1d/d36/d56/ffd x:0 0 0 2024-03-19T06:05:43.019 INFO:tasks.workunit.client.1.smithi172.stdout:2/792: truncate d7/db/d45/f88 1226111 0 2024-03-19T06:05:43.026 INFO:tasks.workunit.client.1.smithi172.stdout:8/741: dread d0/d44/dd2/f4b [0,4194304] 0 2024-03-19T06:05:43.026 INFO:tasks.workunit.client.1.smithi172.stdout:3/803: truncate d0/da8/d34/f59 3237305 0 2024-03-19T06:05:43.026 INFO:tasks.workunit.client.1.smithi172.stdout:7/765: symlink d0/d22/d27/d86/lfe 0 2024-03-19T06:05:43.026 INFO:tasks.workunit.client.1.smithi172.stdout:3/804: stat d0/da8/d34/dda/fe7 0 2024-03-19T06:05:43.027 INFO:tasks.workunit.client.1.smithi172.stdout:1/795: dread - da/dd/d31/dfb/d14/d73/d102/fe8 zero size 2024-03-19T06:05:43.029 INFO:tasks.workunit.client.1.smithi172.stdout:7/766: write d0/d22/d1d/f32 [5167160,64636] 0 2024-03-19T06:05:43.029 INFO:tasks.workunit.client.1.smithi172.stdout:2/793: rmdir d7/db/d2c/d35/dbd 0 2024-03-19T06:05:43.032 INFO:tasks.workunit.client.1.smithi172.stdout:3/805: unlink d0/d5/c104 0 2024-03-19T06:05:43.035 INFO:tasks.workunit.client.1.smithi172.stdout:7/767: rmdir d0/d22/d35 39 2024-03-19T06:05:43.037 INFO:tasks.workunit.client.1.smithi172.stdout:1/796: dread da/dd/d31/dfb/fea [0,4194304] 0 2024-03-19T06:05:43.039 INFO:tasks.workunit.client.1.smithi172.stdout:3/806: mkdir d0/da8/d60/df1/d10d 0 2024-03-19T06:05:43.042 INFO:tasks.workunit.client.1.smithi172.stdout:8/742: dread d0/f9 [0,4194304] 0 2024-03-19T06:05:43.045 INFO:tasks.workunit.client.1.smithi172.stdout:1/797: creat da/d33/d59/f117 x:0 0 0 2024-03-19T06:05:43.046 INFO:tasks.workunit.client.1.smithi172.stdout:6/914: dwrite d5/d8f/d31/f60 [0,4194304] 0 2024-03-19T06:05:43.047 INFO:tasks.workunit.client.1.smithi172.stdout:1/798: read - da/d33/d59/dc1/ffd zero size 2024-03-19T06:05:43.050 INFO:tasks.workunit.client.1.smithi172.stdout:2/794: dread d7/f15 [0,4194304] 0 2024-03-19T06:05:43.057 INFO:tasks.workunit.client.1.smithi172.stdout:8/743: link d0/d61/d6a/c91 d0/d44/d46/d49/d26/d71/d81/ce8 0 2024-03-19T06:05:43.057 INFO:tasks.workunit.client.1.smithi172.stdout:9/756: dwrite d1/d7/dc/dbe/f3c [0,4194304] 0 2024-03-19T06:05:43.060 INFO:tasks.workunit.client.1.smithi172.stdout:1/799: unlink da/dd/d31/dfb/d14/d73/fcc 0 2024-03-19T06:05:43.068 INFO:tasks.workunit.client.1.smithi172.stdout:1/800: creat da/df9/f118 x:0 0 0 2024-03-19T06:05:43.068 INFO:tasks.workunit.client.1.smithi172.stdout:2/795: rename d7/de/d58/d55/d66/dc1/lc5 to d7/de/d58/d56/d86/d9e/l102 0 2024-03-19T06:05:43.069 INFO:tasks.workunit.client.1.smithi172.stdout:9/757: creat d1/d7/dc/d47/da5/f108 x:0 0 0 2024-03-19T06:05:43.071 INFO:tasks.workunit.client.1.smithi172.stdout:8/744: write d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/f7c [41480,45324] 0 2024-03-19T06:05:43.071 INFO:tasks.workunit.client.1.smithi172.stdout:5/753: sync 2024-03-19T06:05:43.072 INFO:tasks.workunit.client.1.smithi172.stdout:3/807: dwrite d0/da8/d54/d77/f10b [0,4194304] 0 2024-03-19T06:05:43.074 INFO:tasks.workunit.client.1.smithi172.stdout:7/768: dwrite d0/d22/d1d/d36/d40/f4e [4194304,4194304] 0 2024-03-19T06:05:43.075 INFO:tasks.workunit.client.1.smithi172.stdout:2/796: readlink d7/de/d58/d56/d86/d9e/ld1 0 2024-03-19T06:05:43.079 INFO:tasks.workunit.client.1.smithi172.stdout:8/745: stat d0/d44/d46/d49/d26/dbc 0 2024-03-19T06:05:43.079 INFO:tasks.workunit.client.1.smithi172.stdout:1/801: unlink da/dd/d31/dfb/d14/d27/d53/f71 0 2024-03-19T06:05:43.085 INFO:tasks.workunit.client.1.smithi172.stdout:9/758: creat d1/d7/dc/def/f109 x:0 0 0 2024-03-19T06:05:43.086 INFO:tasks.workunit.client.1.smithi172.stdout:1/802: creat da/dd/d31/dfb/d14/d84/d9b/f119 x:0 0 0 2024-03-19T06:05:43.087 INFO:tasks.workunit.client.1.smithi172.stdout:8/746: creat d0/d44/d46/d49/d26/dc0/d76/fe9 x:0 0 0 2024-03-19T06:05:43.157 INFO:tasks.workunit.client.1.smithi172.stdout:2/797: dwrite d7/db/d45/f88 [0,4194304] 0 2024-03-19T06:05:43.160 INFO:tasks.workunit.client.1.smithi172.stdout:7/769: truncate d0/d22/d1d/d36/f39 4555995 0 2024-03-19T06:05:43.162 INFO:tasks.workunit.client.1.smithi172.stdout:8/747: link d0/d44/d46/d49/d26/l82 d0/d44/d46/d49/d26/dc0/d76/lea 0 2024-03-19T06:05:43.162 INFO:tasks.workunit.client.1.smithi172.stdout:6/915: dread d5/d11/d43/d45/f97 [4194304,4194304] 0 2024-03-19T06:05:43.170 INFO:tasks.workunit.client.1.smithi172.stdout:3/808: dwrite d0/d5/d14/f89 [0,4194304] 0 2024-03-19T06:05:43.171 INFO:tasks.workunit.client.1.smithi172.stdout:8/748: fsync d0/d44/d46/d49/d26/d71/d81/d27/f1e 0 2024-03-19T06:05:43.171 INFO:tasks.workunit.client.1.smithi172.stdout:6/916: dread - d5/d11/d43/d45/da1/fcc zero size 2024-03-19T06:05:43.172 INFO:tasks.workunit.client.1.smithi172.stdout:2/798: truncate d7/d1b/f2d 1548840 0 2024-03-19T06:05:43.173 INFO:tasks.workunit.client.1.smithi172.stdout:3/809: readlink d0/da8/l2b 0 2024-03-19T06:05:43.173 INFO:tasks.workunit.client.1.smithi172.stdout:7/770: rmdir d0/d22/d35 39 2024-03-19T06:05:43.175 INFO:tasks.workunit.client.1.smithi172.stdout:9/759: dwrite d1/d7/fb6 [0,4194304] 0 2024-03-19T06:05:43.180 INFO:tasks.workunit.client.1.smithi172.stdout:8/749: unlink d0/ca 0 2024-03-19T06:05:43.180 INFO:tasks.workunit.client.1.smithi172.stdout:5/754: dread d5/d14/d56/f6f [0,4194304] 0 2024-03-19T06:05:43.182 INFO:tasks.workunit.client.1.smithi172.stdout:7/771: unlink d0/d22/d27/ce0 0 2024-03-19T06:05:43.187 INFO:tasks.workunit.client.1.smithi172.stdout:7/772: fdatasync d0/d22/d1d/d36/f60 0 2024-03-19T06:05:43.189 INFO:tasks.workunit.client.1.smithi172.stdout:5/755: mkdir d5/d3d/dd6/d100 0 2024-03-19T06:05:43.191 INFO:tasks.workunit.client.1.smithi172.stdout:7/773: write d0/d22/d3d/d41/fc2 [940116,97605] 0 2024-03-19T06:05:43.191 INFO:tasks.workunit.client.1.smithi172.stdout:2/799: dread d7/de/d58/d55/d5f/fc3 [0,4194304] 0 2024-03-19T06:05:43.195 INFO:tasks.workunit.client.1.smithi172.stdout:3/810: getdents d0/da8/d34/d4d/dc5 0 2024-03-19T06:05:43.195 INFO:tasks.workunit.client.1.smithi172.stdout:9/760: dwrite d1/d7/dc/def/ff7 [0,4194304] 0 2024-03-19T06:05:43.196 INFO:tasks.workunit.client.1.smithi172.stdout:2/800: chown d7/de/d58/d55/d5f/fb9 3 1 2024-03-19T06:05:43.197 INFO:tasks.workunit.client.1.smithi172.stdout:6/917: link d5/d11/d17/d1b/f21 d5/d8f/ddf/f12b 0 2024-03-19T06:05:43.200 INFO:tasks.workunit.client.1.smithi172.stdout:7/774: unlink d0/d22/d1d/d3a/d6b/la9 0 2024-03-19T06:05:43.201 INFO:tasks.workunit.client.1.smithi172.stdout:8/750: creat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/feb x:0 0 0 2024-03-19T06:05:43.201 INFO:tasks.workunit.client.1.smithi172.stdout:5/756: dread d5/d1f/f2a [0,4194304] 0 2024-03-19T06:05:43.202 INFO:tasks.workunit.client.1.smithi172.stdout:3/811: creat d0/d5/f10e x:0 0 0 2024-03-19T06:05:43.204 INFO:tasks.workunit.client.1.smithi172.stdout:3/812: fdatasync d0/d5/d6b/dae/fc8 0 2024-03-19T06:05:43.204 INFO:tasks.workunit.client.1.smithi172.stdout:6/918: mkdir d5/d8f/d31/d3d/d98/db6/d9f/d12c 0 2024-03-19T06:05:43.208 INFO:tasks.workunit.client.1.smithi172.stdout:2/801: creat d7/de/d58/d56/d89/db5/dca/f103 x:0 0 0 2024-03-19T06:05:43.210 INFO:tasks.workunit.client.1.smithi172.stdout:7/775: mknod d0/d22/d1d/d85/cff 0 2024-03-19T06:05:43.210 INFO:tasks.workunit.client.1.smithi172.stdout:0/799: sync 2024-03-19T06:05:43.211 INFO:tasks.workunit.client.1.smithi172.stdout:3/813: fdatasync d0/d5/d14/fbb 0 2024-03-19T06:05:43.214 INFO:tasks.workunit.client.1.smithi172.stdout:2/802: creat d7/de/d58/d57/f104 x:0 0 0 2024-03-19T06:05:43.217 INFO:tasks.workunit.client.1.smithi172.stdout:0/800: write d11/d22/d68/f63 [3878515,117835] 0 2024-03-19T06:05:43.218 INFO:tasks.workunit.client.1.smithi172.stdout:3/814: write d0/da8/d34/dda/fec [155788,38102] 0 2024-03-19T06:05:43.218 INFO:tasks.workunit.client.1.smithi172.stdout:5/757: creat d5/d1f/f101 x:0 0 0 2024-03-19T06:05:43.221 INFO:tasks.workunit.client.1.smithi172.stdout:2/803: chown d7/db/d2c/f4a 60119 1 2024-03-19T06:05:43.223 INFO:tasks.workunit.client.1.smithi172.stdout:3/815: chown d0/da8/d34/f64 338 1 2024-03-19T06:05:43.224 INFO:tasks.workunit.client.1.smithi172.stdout:6/919: rmdir d5/d8f/d31/d3d/d98/dac 0 2024-03-19T06:05:43.224 INFO:tasks.workunit.client.1.smithi172.stdout:9/761: dread d1/d7/dc/de/d34/d48/f70 [0,4194304] 0 2024-03-19T06:05:43.228 INFO:tasks.workunit.client.1.smithi172.stdout:9/762: dread d1/d7/dc/d47/d78/d54/fd5 [0,4194304] 0 2024-03-19T06:05:43.229 INFO:tasks.workunit.client.1.smithi172.stdout:7/776: link d0/d22/d1d/d36/l24 d0/d22/d1d/d36/de9/l100 0 2024-03-19T06:05:43.230 INFO:tasks.workunit.client.1.smithi172.stdout:7/777: read d0/d22/d3d/d41/f87 [7381712,26496] 0 2024-03-19T06:05:43.231 INFO:tasks.workunit.client.1.smithi172.stdout:9/763: write d1/d7/dc/de/d34/d48/d89/fdc [852203,96157] 0 2024-03-19T06:05:43.264 INFO:tasks.workunit.client.1.smithi172.stdout:5/758: symlink d5/d3c/d6c/d9b/l102 0 2024-03-19T06:05:43.267 INFO:tasks.workunit.client.1.smithi172.stdout:2/804: truncate d7/de/f42 1563966 0 2024-03-19T06:05:43.269 INFO:tasks.workunit.client.1.smithi172.stdout:5/759: symlink d5/d55/de9/l103 0 2024-03-19T06:05:43.270 INFO:tasks.workunit.client.1.smithi172.stdout:7/778: creat d0/d22/d1d/d85/da8/dfa/f101 x:0 0 0 2024-03-19T06:05:43.270 INFO:tasks.workunit.client.1.smithi172.stdout:9/764: write d1/d7/dc/de/d34/d48/d82/d92/fc7 [3663583,74453] 0 2024-03-19T06:05:43.271 INFO:tasks.workunit.client.1.smithi172.stdout:2/805: symlink d7/d4c/l105 0 2024-03-19T06:05:43.274 INFO:tasks.workunit.client.1.smithi172.stdout:5/760: chown d5/d14/d15/d40/d5c/fb7 146490 1 2024-03-19T06:05:43.274 INFO:tasks.workunit.client.1.smithi172.stdout:0/801: dwrite d11/d18/d38/d3f/f5e [0,4194304] 0 2024-03-19T06:05:43.277 INFO:tasks.workunit.client.1.smithi172.stdout:8/751: dwrite d0/f85 [0,4194304] 0 2024-03-19T06:05:43.279 INFO:tasks.workunit.client.1.smithi172.stdout:2/806: mkdir d7/db/d2c/d35/d106 0 2024-03-19T06:05:43.280 INFO:tasks.workunit.client.1.smithi172.stdout:9/765: mkdir d1/d7/dc/dbe/d65/d10a 0 2024-03-19T06:05:43.287 INFO:tasks.workunit.client.1.smithi172.stdout:5/761: truncate d5/d1f/d2f/d53/fef 519332 0 2024-03-19T06:05:43.287 INFO:tasks.workunit.client.1.smithi172.stdout:8/752: dread - d0/d44/d46/d49/d4f/fc4 zero size 2024-03-19T06:05:43.287 INFO:tasks.workunit.client.1.smithi172.stdout:2/807: chown d7/db/d2c/f38 1752 1 2024-03-19T06:05:43.289 INFO:tasks.workunit.client.1.smithi172.stdout:9/766: dread - d1/d7/dc/dbe/f9c zero size 2024-03-19T06:05:43.291 INFO:tasks.workunit.client.1.smithi172.stdout:0/802: read d11/d14/d9a/dea/fa0 [4912407,5793] 0 2024-03-19T06:05:43.292 INFO:tasks.workunit.client.1.smithi172.stdout:6/920: dwrite d5/d8f/d31/d3d/f54 [0,4194304] 0 2024-03-19T06:05:43.293 INFO:tasks.workunit.client.1.smithi172.stdout:5/762: rmdir d5/d1f/d2f/d53 39 2024-03-19T06:05:43.300 INFO:tasks.workunit.client.1.smithi172.stdout:6/921: rmdir d5/d11/d17/d1b 39 2024-03-19T06:05:43.300 INFO:tasks.workunit.client.1.smithi172.stdout:2/808: truncate d7/de/d58/d56/d81/dda/ff9 408201 0 2024-03-19T06:05:43.300 INFO:tasks.workunit.client.1.smithi172.stdout:0/803: creat d11/d14/d9a/dea/dab/f110 x:0 0 0 2024-03-19T06:05:43.300 INFO:tasks.workunit.client.1.smithi172.stdout:9/767: symlink d1/d7/dc/de/d34/d48/l10b 0 2024-03-19T06:05:43.303 INFO:tasks.workunit.client.1.smithi172.stdout:2/809: rmdir d7/de/d58/d56/d89 39 2024-03-19T06:05:43.306 INFO:tasks.workunit.client.1.smithi172.stdout:9/768: readlink d1/d7/dc/de/d34/d48/d82/d92/d95/db4/de5/lf9 0 2024-03-19T06:05:43.309 INFO:tasks.workunit.client.1.smithi172.stdout:8/753: dwrite d0/f11 [0,4194304] 0 2024-03-19T06:05:43.309 INFO:tasks.workunit.client.1.smithi172.stdout:9/769: chown d1/d7/dc/de/d34/f45 14 1 2024-03-19T06:05:43.310 INFO:tasks.workunit.client.1.smithi172.stdout:0/804: creat d11/d18/d38/d3f/f111 x:0 0 0 2024-03-19T06:05:43.311 INFO:tasks.workunit.client.1.smithi172.stdout:2/810: symlink d7/de/l107 0 2024-03-19T06:05:43.312 INFO:tasks.workunit.client.1.smithi172.stdout:9/770: write d1/d7/dc/dbe/f33 [2624418,86596] 0 2024-03-19T06:05:43.314 INFO:tasks.workunit.client.1.smithi172.stdout:0/805: fdatasync d11/d14/db7/fda 0 2024-03-19T06:05:43.318 INFO:tasks.workunit.client.1.smithi172.stdout:8/754: write d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c/fb2 [2131468,12671] 0 2024-03-19T06:05:43.318 INFO:tasks.workunit.client.1.smithi172.stdout:2/811: symlink d7/de/dfd/l108 0 2024-03-19T06:05:43.320 INFO:tasks.workunit.client.1.smithi172.stdout:4/837: sync 2024-03-19T06:05:43.323 INFO:tasks.workunit.client.1.smithi172.stdout:6/922: dwrite d5/d11/d17/f62 [0,4194304] 0 2024-03-19T06:05:43.334 INFO:tasks.workunit.client.1.smithi172.stdout:9/771: symlink d1/d7/dc/de/d34/d48/d82/l10c 0 2024-03-19T06:05:43.338 INFO:tasks.workunit.client.1.smithi172.stdout:2/812: write d7/d4c/d70/fef [977593,39773] 0 2024-03-19T06:05:43.339 INFO:tasks.workunit.client.1.smithi172.stdout:8/755: fsync d0/d61/d6a/d7e/f7f 0 2024-03-19T06:05:43.342 INFO:tasks.workunit.client.1.smithi172.stdout:6/923: mknod d5/d8f/d31/c12d 0 2024-03-19T06:05:43.343 INFO:tasks.workunit.client.1.smithi172.stdout:2/813: creat d7/d4c/d70/f109 x:0 0 0 2024-03-19T06:05:43.344 INFO:tasks.workunit.client.1.smithi172.stdout:8/756: unlink d0/fbd 0 2024-03-19T06:05:43.345 INFO:tasks.workunit.client.1.smithi172.stdout:6/924: read d5/d11/d17/d36/d48/f7d [2991350,1507] 0 2024-03-19T06:05:43.347 INFO:tasks.workunit.client.1.smithi172.stdout:4/838: creat df/d2b/d2d/f10b x:0 0 0 2024-03-19T06:05:43.351 INFO:tasks.workunit.client.1.smithi172.stdout:8/757: chown d0/d44/d46/d49/d26/d71/f72 12391422 1 2024-03-19T06:05:43.351 INFO:tasks.workunit.client.1.smithi172.stdout:2/814: creat d7/db/d2c/d35/d106/f10a x:0 0 0 2024-03-19T06:05:43.355 INFO:tasks.workunit.client.1.smithi172.stdout:6/925: creat d5/d8f/d31/d3d/d98/db6/d40/d53/f12e x:0 0 0 2024-03-19T06:05:43.357 INFO:tasks.workunit.client.1.smithi172.stdout:2/815: unlink d7/de/d58/d55/da8/ff7 0 2024-03-19T06:05:43.360 INFO:tasks.workunit.client.1.smithi172.stdout:6/926: truncate d5/d11/fab 242908 0 2024-03-19T06:05:43.360 INFO:tasks.workunit.client.1.smithi172.stdout:4/839: getdents df/d2b/d2d/dae 0 2024-03-19T06:05:43.361 INFO:tasks.workunit.client.1.smithi172.stdout:2/816: unlink d7/de/d58/d55/da8/f84 0 2024-03-19T06:05:43.363 INFO:tasks.workunit.client.1.smithi172.stdout:8/758: link d0/f3 d0/d44/d46/d49/d26/dc0/d3d/d83/fec 0 2024-03-19T06:05:43.364 INFO:tasks.workunit.client.1.smithi172.stdout:4/840: fsync df/d2b/d44/d67/fbd 0 2024-03-19T06:05:43.365 INFO:tasks.workunit.client.1.smithi172.stdout:2/817: creat d7/de/d58/d56/d86/d9d/dab/f10b x:0 0 0 2024-03-19T06:05:43.365 INFO:tasks.workunit.client.1.smithi172.stdout:8/759: mknod d0/d6f/ced 0 2024-03-19T06:05:43.367 INFO:tasks.workunit.client.1.smithi172.stdout:2/818: chown d7/de/dfd 12564 1 2024-03-19T06:05:43.367 INFO:tasks.workunit.client.1.smithi172.stdout:4/841: readlink df/d11/d12/l9a 0 2024-03-19T06:05:43.370 INFO:tasks.workunit.client.1.smithi172.stdout:2/819: chown d7/de/d58/d57/l7b 0 1 2024-03-19T06:05:43.373 INFO:tasks.workunit.client.1.smithi172.stdout:8/760: write d0/d44/d46/d49/d26/d71/d81/d27/d29/f32 [3765139,63598] 0 2024-03-19T06:05:43.373 INFO:tasks.workunit.client.1.smithi172.stdout:9/772: dwrite d1/d7/dc/de/d34/d48/d82/f88 [0,4194304] 0 2024-03-19T06:05:43.377 INFO:tasks.workunit.client.1.smithi172.stdout:2/820: chown d7/de/d58/d55/d5f/fc3 498967987 1 2024-03-19T06:05:43.380 INFO:tasks.workunit.client.1.smithi172.stdout:4/842: rename df/d2b/d2d/l5c to df/d11/d12/d21/d50/d63/dbb/dc4/dd3/l10c 0 2024-03-19T06:05:43.380 INFO:tasks.workunit.client.1.smithi172.stdout:8/761: truncate d0/d44/d46/d49/d26/dc0/fa6 657328 0 2024-03-19T06:05:43.382 INFO:tasks.workunit.client.1.smithi172.stdout:9/773: fsync d1/d7/f2e 0 2024-03-19T06:05:43.386 INFO:tasks.workunit.client.1.smithi172.stdout:2/821: write d7/de/d58/d56/f6b [3355889,59230] 0 2024-03-19T06:05:43.387 INFO:tasks.workunit.client.1.smithi172.stdout:9/774: unlink d1/db9/fba 0 2024-03-19T06:05:43.390 INFO:tasks.workunit.client.1.smithi172.stdout:2/822: mkdir d7/db/d2c/d35/de5/d10c 0 2024-03-19T06:05:43.390 INFO:tasks.workunit.client.1.smithi172.stdout:6/927: dread d5/d8f/d31/d3d/ff6 [0,4194304] 0 2024-03-19T06:05:43.394 INFO:tasks.workunit.client.1.smithi172.stdout:6/928: stat d5/d8f/d31/d3d/d98/db6/dc7/c113 0 2024-03-19T06:05:43.395 INFO:tasks.workunit.client.1.smithi172.stdout:2/823: mkdir d7/de/d58/d55/d6e/d10d 0 2024-03-19T06:05:43.398 INFO:tasks.workunit.client.1.smithi172.stdout:6/929: write d5/d11/d43/f4d [1277365,28314] 0 2024-03-19T06:05:43.404 INFO:tasks.workunit.client.1.smithi172.stdout:6/930: symlink d5/d8f/d31/d7b/l12f 0 2024-03-19T06:05:43.406 INFO:tasks.workunit.client.1.smithi172.stdout:9/775: dread d1/d7/dc/de/d34/d48/f70 [0,4194304] 0 2024-03-19T06:05:43.406 INFO:tasks.workunit.client.1.smithi172.stdout:8/762: dwrite d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/fb9 [0,4194304] 0 2024-03-19T06:05:43.413 INFO:tasks.workunit.client.1.smithi172.stdout:9/776: fdatasync d1/d7/dc/de/d34/d48/d89/fab 0 2024-03-19T06:05:43.414 INFO:tasks.workunit.client.1.smithi172.stdout:6/931: write d5/d8f/d31/d3d/d98/db6/d40/d53/d75/fee [3116656,88284] 0 2024-03-19T06:05:43.421 INFO:tasks.workunit.client.1.smithi172.stdout:2/824: dwrite d7/de/d58/d56/d86/d9d/dfb/ff3 [0,4194304] 0 2024-03-19T06:05:43.425 INFO:tasks.workunit.client.1.smithi172.stdout:4/843: dread fb [0,4194304] 0 2024-03-19T06:05:43.430 INFO:tasks.workunit.client.1.smithi172.stdout:2/825: dread - d7/de/d58/d55/d6e/fad zero size 2024-03-19T06:05:43.433 INFO:tasks.workunit.client.1.smithi172.stdout:4/844: mkdir df/d11/d10d 0 2024-03-19T06:05:43.435 INFO:tasks.workunit.client.0.smithi072.stdout:2/8: sync 2024-03-19T06:05:43.435 INFO:tasks.workunit.client.0.smithi072.stdout:7/40: sync 2024-03-19T06:05:43.435 INFO:tasks.workunit.client.1.smithi172.stdout:8/763: truncate d0/d44/d46/d49/d26/f51 419572 0 2024-03-19T06:05:43.436 INFO:tasks.workunit.client.0.smithi072.stdout:7/41: chown d2/d5/f7 1649081 1 2024-03-19T06:05:43.437 INFO:tasks.workunit.client.0.smithi072.stdout:2/9: symlink l3 0 2024-03-19T06:05:43.437 INFO:tasks.workunit.client.1.smithi172.stdout:1/803: sync 2024-03-19T06:05:43.438 INFO:tasks.workunit.client.1.smithi172.stdout:4/845: mkdir df/d2b/d44/d67/d10e 0 2024-03-19T06:05:43.438 INFO:tasks.workunit.client.0.smithi072.stdout:7/42: chown d2/d3/c8 1 1 2024-03-19T06:05:43.439 INFO:tasks.workunit.client.0.smithi072.stdout:2/10: mknod c4 0 2024-03-19T06:05:43.440 INFO:tasks.workunit.client.1.smithi172.stdout:2/826: truncate d7/de/f5d 329665 0 2024-03-19T06:05:43.442 INFO:tasks.workunit.client.0.smithi072.stdout:2/11: rename l0 to l5 0 2024-03-19T06:05:43.443 INFO:tasks.workunit.client.1.smithi172.stdout:1/804: mknod da/dd/c11a 0 2024-03-19T06:05:43.446 INFO:tasks.workunit.client.0.smithi072.stdout:7/43: truncate d2/d5/f6 80780 0 2024-03-19T06:05:43.448 INFO:tasks.workunit.client.1.smithi172.stdout:6/932: dwrite d5/d8f/d31/d7b/f7f [0,4194304] 0 2024-03-19T06:05:43.449 INFO:tasks.workunit.client.0.smithi072.stdout:2/12: unlink f1 0 2024-03-19T06:05:43.453 INFO:tasks.workunit.client.1.smithi172.stdout:4/846: mkdir df/d2b/d44/d67/d10f 0 2024-03-19T06:05:43.454 INFO:tasks.workunit.client.0.smithi072.stdout:7/44: rename d2/d3/c8 to d2/ca 0 2024-03-19T06:05:43.459 INFO:tasks.workunit.client.0.smithi072.stdout:7/45: fsync d2/d5/f7 0 2024-03-19T06:05:43.460 INFO:tasks.workunit.client.1.smithi172.stdout:6/933: chown d5/d8f/d31/d3d/d98/df9/le9 28139 1 2024-03-19T06:05:43.461 INFO:tasks.workunit.client.1.smithi172.stdout:4/847: write df/d2b/d99/faa [4907643,17496] 0 2024-03-19T06:05:43.462 INFO:tasks.workunit.client.1.smithi172.stdout:9/777: dwrite d1/d7/dc/de/d34/d48/d82/fc5 [0,4194304] 0 2024-03-19T06:05:43.465 INFO:tasks.workunit.client.0.smithi072.stdout:2/13: link c4 c6 0 2024-03-19T06:05:43.465 INFO:tasks.workunit.client.0.smithi072.stdout:2/14: truncate - no filename 2024-03-19T06:05:43.467 INFO:tasks.workunit.client.1.smithi172.stdout:4/848: unlink df/d2b/c31 0 2024-03-19T06:05:43.472 INFO:tasks.workunit.client.1.smithi172.stdout:8/764: dwrite d0/d61/fd9 [0,4194304] 0 2024-03-19T06:05:43.473 INFO:tasks.workunit.client.0.smithi072.stdout:2/15: mknod c7 0 2024-03-19T06:05:43.479 INFO:tasks.workunit.client.0.smithi072.stdout:2/16: mknod c8 0 2024-03-19T06:05:43.482 INFO:tasks.workunit.client.1.smithi172.stdout:4/849: getdents df/d2b/d99 0 2024-03-19T06:05:43.483 INFO:tasks.workunit.client.1.smithi172.stdout:2/827: dwrite d7/d1b/f22 [0,4194304] 0 2024-03-19T06:05:43.485 INFO:tasks.workunit.client.0.smithi072.stdout:2/17: chown l5 127457876 1 2024-03-19T06:05:43.487 INFO:tasks.workunit.client.1.smithi172.stdout:8/765: rmdir d0/d44/d46/d49/d26/d71/d81/d27 39 2024-03-19T06:05:43.491 INFO:tasks.workunit.client.0.smithi072.stdout:2/18: mknod c9 0 2024-03-19T06:05:43.491 INFO:tasks.workunit.client.1.smithi172.stdout:9/778: write d1/d7/dc/d47/f6a [339092,106525] 0 2024-03-19T06:05:43.492 INFO:tasks.workunit.client.1.smithi172.stdout:1/805: write da/dd/d31/dfb/d14/f62 [1859951,5275] 0 2024-03-19T06:05:43.495 INFO:tasks.workunit.client.0.smithi072.stdout:2/19: mknod ca 0 2024-03-19T06:05:43.500 INFO:tasks.workunit.client.1.smithi172.stdout:4/850: write df/d11/d12/d26/f43 [490716,57598] 0 2024-03-19T06:05:43.502 INFO:tasks.workunit.client.0.smithi072.stdout:2/20: mkdir db 0 2024-03-19T06:05:43.503 INFO:tasks.workunit.client.0.smithi072.stdout:2/21: truncate - no filename 2024-03-19T06:05:43.503 INFO:tasks.workunit.client.1.smithi172.stdout:1/806: write da/dd/d31/dfb/d14/d27/f32 [591767,125215] 0 2024-03-19T06:05:43.505 INFO:tasks.workunit.client.1.smithi172.stdout:8/766: write d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/feb [75335,77888] 0 2024-03-19T06:05:43.505 INFO:tasks.workunit.client.1.smithi172.stdout:4/851: chown df/d2b/da3/cc2 4384801 1 2024-03-19T06:05:43.506 INFO:tasks.workunit.client.1.smithi172.stdout:7/779: sync 2024-03-19T06:05:43.506 INFO:tasks.workunit.client.1.smithi172.stdout:3/816: sync 2024-03-19T06:05:43.508 INFO:tasks.workunit.client.1.smithi172.stdout:2/828: creat d7/de/d58/d56/d89/db5/dca/f10e x:0 0 0 2024-03-19T06:05:43.511 INFO:tasks.workunit.client.1.smithi172.stdout:6/934: dwrite d5/d11/d17/d36/d48/f9e [0,4194304] 0 2024-03-19T06:05:43.514 INFO:tasks.workunit.client.1.smithi172.stdout:7/780: mkdir d0/d22/d1d/d85/da8/d102 0 2024-03-19T06:05:43.516 INFO:tasks.workunit.client.0.smithi072.stdout:7/46: dwrite d2/d5/f6 [0,4194304] 0 2024-03-19T06:05:43.516 INFO:tasks.workunit.client.0.smithi072.stdout:2/22: link c4 db/cc 0 2024-03-19T06:05:43.517 INFO:tasks.workunit.client.1.smithi172.stdout:4/852: rename df/d2b/d2d/f106 to df/d2b/d2d/db0/f110 0 2024-03-19T06:05:43.517 INFO:tasks.workunit.client.1.smithi172.stdout:1/807: mknod da/d3b/ddf/c11b 0 2024-03-19T06:05:43.517 INFO:tasks.workunit.client.0.smithi072.stdout:2/23: stat l2 0 2024-03-19T06:05:43.518 INFO:tasks.workunit.client.0.smithi072.stdout:2/24: rename db to db/dd 22 2024-03-19T06:05:43.518 INFO:tasks.workunit.client.0.smithi072.stdout:2/25: dread - no filename 2024-03-19T06:05:43.519 INFO:tasks.workunit.client.1.smithi172.stdout:2/829: stat d7/de/d58/d57/f7d 0 2024-03-19T06:05:43.519 INFO:tasks.workunit.client.1.smithi172.stdout:6/935: symlink d5/d11/d43/l130 0 2024-03-19T06:05:43.525 INFO:tasks.workunit.client.1.smithi172.stdout:1/808: rmdir da/d3b/dcd/deb 39 2024-03-19T06:05:43.525 INFO:tasks.workunit.client.1.smithi172.stdout:7/781: chown d0/d22/d35/c89 742535763 1 2024-03-19T06:05:43.527 INFO:tasks.workunit.client.1.smithi172.stdout:6/936: mknod d5/d11/d17/d1b/c131 0 2024-03-19T06:05:43.530 INFO:tasks.workunit.client.0.smithi072.stdout:2/26: symlink db/le 0 2024-03-19T06:05:43.530 INFO:tasks.workunit.client.0.smithi072.stdout:2/27: read - no filename 2024-03-19T06:05:43.530 INFO:tasks.workunit.client.1.smithi172.stdout:3/817: rename d0/d5/d6b/c6e to d0/da8/c10f 0 2024-03-19T06:05:43.530 INFO:tasks.workunit.client.1.smithi172.stdout:2/830: mkdir d7/de/d58/d56/d89/db5/dca/d10f 0 2024-03-19T06:05:43.530 INFO:tasks.workunit.client.0.smithi072.stdout:2/28: stat db 0 2024-03-19T06:05:43.531 INFO:tasks.workunit.client.1.smithi172.stdout:6/937: fsync d5/d8f/ddf/f110 0 2024-03-19T06:05:43.532 INFO:tasks.workunit.client.0.smithi072.stdout:2/29: mknod db/cf 0 2024-03-19T06:05:43.533 INFO:tasks.workunit.client.1.smithi172.stdout:9/779: dwrite d1/d7/dc/de/d34/d48/d89/fdc [0,4194304] 0 2024-03-19T06:05:43.535 INFO:tasks.workunit.client.1.smithi172.stdout:1/809: write da/dd/d31/d47/dbf/fc0 [2289284,67470] 0 2024-03-19T06:05:43.538 INFO:tasks.workunit.client.1.smithi172.stdout:7/782: write d0/d22/d1d/d36/d8d/d5c/d67/fc3 [4930501,19477] 0 2024-03-19T06:05:43.538 INFO:tasks.workunit.client.1.smithi172.stdout:3/818: dread - d0/da8/d34/d4d/f5c zero size 2024-03-19T06:05:43.540 INFO:tasks.workunit.client.1.smithi172.stdout:5/763: sync 2024-03-19T06:05:43.540 INFO:tasks.workunit.client.1.smithi172.stdout:0/806: sync 2024-03-19T06:05:43.542 INFO:tasks.workunit.client.1.smithi172.stdout:8/767: rename d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d9c to d0/d44/d46/d49/d26/dc0/d3d/d83/dee 0 2024-03-19T06:05:43.542 INFO:tasks.workunit.client.0.smithi072.stdout:6/25: sync 2024-03-19T06:05:43.542 INFO:tasks.workunit.client.0.smithi072.stdout:5/258: sync 2024-03-19T06:05:43.542 INFO:tasks.workunit.client.0.smithi072.stdout:1/39: sync 2024-03-19T06:05:43.542 INFO:tasks.workunit.client.0.smithi072.stdout:8/68: sync 2024-03-19T06:05:43.543 INFO:tasks.workunit.client.0.smithi072.stdout:0/13: sync 2024-03-19T06:05:43.544 INFO:tasks.workunit.client.0.smithi072.stdout:0/14: dread - no filename 2024-03-19T06:05:43.544 INFO:tasks.workunit.client.0.smithi072.stdout:3/72: sync 2024-03-19T06:05:43.544 INFO:tasks.workunit.client.0.smithi072.stdout:4/57: sync 2024-03-19T06:05:43.544 INFO:tasks.workunit.client.0.smithi072.stdout:5/259: chown df 1 1 2024-03-19T06:05:43.544 INFO:tasks.workunit.client.0.smithi072.stdout:9/22: sync 2024-03-19T06:05:43.544 INFO:tasks.workunit.client.1.smithi172.stdout:1/810: dread - da/dd/d31/dfb/d14/d27/d3f/fe1 zero size 2024-03-19T06:05:43.544 INFO:tasks.workunit.client.0.smithi072.stdout:2/30: unlink l5 0 2024-03-19T06:05:43.545 INFO:tasks.workunit.client.0.smithi072.stdout:7/47: truncate d2/d5/f6 1588652 0 2024-03-19T06:05:43.546 INFO:tasks.workunit.client.1.smithi172.stdout:4/853: write df/d11/f1d [2946769,74151] 0 2024-03-19T06:05:43.547 INFO:tasks.workunit.client.1.smithi172.stdout:7/783: write d0/d22/d1d/d36/d40/f93 [9331406,43970] 0 2024-03-19T06:05:43.548 INFO:tasks.workunit.client.0.smithi072.stdout:4/58: read d5/f6 [3552251,3606] 0 2024-03-19T06:05:43.548 INFO:tasks.workunit.client.0.smithi072.stdout:7/48: chown d2/d3 2289 1 2024-03-19T06:05:43.549 INFO:tasks.workunit.client.1.smithi172.stdout:1/811: chown da/dd/d31/dfb/d14/d27/d3f/fc7 29264 1 2024-03-19T06:05:43.550 INFO:tasks.workunit.client.1.smithi172.stdout:7/784: write d0/fc5 [4936119,50189] 0 2024-03-19T06:05:43.552 INFO:tasks.workunit.client.1.smithi172.stdout:5/764: mkdir d5/d1f/db4/db9/d104 0 2024-03-19T06:05:43.553 INFO:tasks.workunit.client.1.smithi172.stdout:3/819: fsync d0/d5/d6b/dae/f95 0 2024-03-19T06:05:43.554 INFO:tasks.workunit.client.1.smithi172.stdout:7/785: mkdir d0/d22/d1d/d3a/d46/d103 0 2024-03-19T06:05:43.556 INFO:tasks.workunit.client.1.smithi172.stdout:4/854: write fb [587094,112264] 0 2024-03-19T06:05:43.559 INFO:tasks.workunit.client.1.smithi172.stdout:9/780: getdents d1/d7/dc/de/d34/d48/d82 0 2024-03-19T06:05:43.559 INFO:tasks.workunit.client.1.smithi172.stdout:5/765: mkdir d5/d3c/d6c/d9b/d105 0 2024-03-19T06:05:43.559 INFO:tasks.workunit.client.1.smithi172.stdout:0/807: symlink d11/d18/d38/d3f/dbe/d104/l112 0 2024-03-19T06:05:43.563 INFO:tasks.workunit.client.0.smithi072.stdout:8/69: truncate da/f11 821380 0 2024-03-19T06:05:43.567 INFO:tasks.workunit.client.0.smithi072.stdout:2/31: mkdir db/d10 0 2024-03-19T06:05:43.567 INFO:tasks.workunit.client.0.smithi072.stdout:2/32: write - no filename 2024-03-19T06:05:43.568 INFO:tasks.workunit.client.1.smithi172.stdout:8/768: getdents d0/d44/d46/d49/d26/dbc 0 2024-03-19T06:05:43.569 INFO:tasks.workunit.client.1.smithi172.stdout:6/938: truncate d5/d8f/d31/d7b/fa5 915140 0 2024-03-19T06:05:43.571 INFO:tasks.workunit.client.1.smithi172.stdout:4/855: rename df/d45/ce1 to df/d2b/d2d/dae/c111 0 2024-03-19T06:05:43.574 INFO:tasks.workunit.client.0.smithi072.stdout:1/40: write d1/f6 [1102008,100138] 0 2024-03-19T06:05:43.574 INFO:tasks.workunit.client.1.smithi172.stdout:1/812: creat da/d3b/dcd/f11c x:0 0 0 2024-03-19T06:05:43.575 INFO:tasks.workunit.client.1.smithi172.stdout:6/939: rmdir d5/d8f 39 2024-03-19T06:05:43.577 INFO:tasks.workunit.client.1.smithi172.stdout:4/856: mkdir df/d11/d12/d6e/d112 0 2024-03-19T06:05:43.580 INFO:tasks.workunit.client.0.smithi072.stdout:0/15: symlink d1/l4 0 2024-03-19T06:05:43.583 INFO:tasks.workunit.client.0.smithi072.stdout:8/70: symlink da/d13/l18 0 2024-03-19T06:05:43.584 INFO:tasks.workunit.client.0.smithi072.stdout:2/33: symlink db/l11 0 2024-03-19T06:05:43.586 INFO:tasks.workunit.client.0.smithi072.stdout:1/41: readlink d1/ld 0 2024-03-19T06:05:43.586 INFO:tasks.workunit.client.0.smithi072.stdout:7/49: dread d2/f4 [0,4194304] 0 2024-03-19T06:05:43.587 INFO:tasks.workunit.client.1.smithi172.stdout:1/813: write da/dd/d31/d47/fd3 [23938,32411] 0 2024-03-19T06:05:43.588 INFO:tasks.workunit.client.0.smithi072.stdout:6/26: getdents d7 0 2024-03-19T06:05:43.590 INFO:tasks.workunit.client.0.smithi072.stdout:0/16: creat d1/f5 x:0 0 0 2024-03-19T06:05:43.591 INFO:tasks.workunit.client.0.smithi072.stdout:3/73: dwrite d2/f5 [0,4194304] 0 2024-03-19T06:05:43.592 INFO:tasks.workunit.client.0.smithi072.stdout:0/17: chown d1/l4 586219868 1 2024-03-19T06:05:43.595 INFO:tasks.workunit.client.0.smithi072.stdout:0/18: dread - d1/f5 zero size 2024-03-19T06:05:43.597 INFO:tasks.workunit.client.0.smithi072.stdout:9/23: link l2 l6 0 2024-03-19T06:05:43.598 INFO:tasks.workunit.client.0.smithi072.stdout:4/59: write d5/d11/f16 [619143,80463] 0 2024-03-19T06:05:43.598 INFO:tasks.workunit.client.0.smithi072.stdout:9/24: stat c4 0 2024-03-19T06:05:43.598 INFO:tasks.workunit.client.0.smithi072.stdout:5/260: write df/d16/f39 [466433,29529] 0 2024-03-19T06:05:43.599 INFO:tasks.workunit.client.0.smithi072.stdout:0/19: truncate d1/f5 932825 0 2024-03-19T06:05:43.601 INFO:tasks.workunit.client.0.smithi072.stdout:6/27: mkdir d7/d9 0 2024-03-19T06:05:43.602 INFO:tasks.workunit.client.1.smithi172.stdout:7/786: dread d0/d22/d1d/d85/fbd [0,4194304] 0 2024-03-19T06:05:43.602 INFO:tasks.workunit.client.1.smithi172.stdout:4/857: mkdir df/d11/d12/d21/d113 0 2024-03-19T06:05:43.602 INFO:tasks.workunit.client.0.smithi072.stdout:0/20: read d1/f5 [423895,6118] 0 2024-03-19T06:05:43.603 INFO:tasks.workunit.client.0.smithi072.stdout:4/60: chown d5/d11/f16 260 1 2024-03-19T06:05:43.603 INFO:tasks.workunit.client.0.smithi072.stdout:8/71: fsync f9 0 2024-03-19T06:05:43.608 INFO:tasks.workunit.client.0.smithi072.stdout:2/34: mkdir db/d10/d12 0 2024-03-19T06:05:43.608 INFO:tasks.workunit.client.0.smithi072.stdout:2/35: dwrite - no filename 2024-03-19T06:05:43.608 INFO:tasks.workunit.client.1.smithi172.stdout:8/769: truncate d0/d61/fd9 1345926 0 2024-03-19T06:05:43.609 INFO:tasks.workunit.client.0.smithi072.stdout:0/21: readlink d1/l4 0 2024-03-19T06:05:43.610 INFO:tasks.workunit.client.1.smithi172.stdout:2/831: dwrite d7/de/d58/d55/d6e/fdc [0,4194304] 0 2024-03-19T06:05:43.612 INFO:tasks.workunit.client.0.smithi072.stdout:7/50: unlink d2/d5/f9 0 2024-03-19T06:05:43.612 INFO:tasks.workunit.client.1.smithi172.stdout:1/814: fdatasync da/d33/d59/dc1/fd8 0 2024-03-19T06:05:43.614 INFO:tasks.workunit.client.1.smithi172.stdout:7/787: chown d0/d22/d1d/d3a/d46/f7a 181 1 2024-03-19T06:05:43.615 INFO:tasks.workunit.client.0.smithi072.stdout:0/22: chown l0 34982 1 2024-03-19T06:05:43.615 INFO:tasks.workunit.client.0.smithi072.stdout:5/261: fdatasync df/d16/f41 0 2024-03-19T06:05:43.619 INFO:tasks.workunit.client.0.smithi072.stdout:9/25: unlink l6 0 2024-03-19T06:05:43.619 INFO:tasks.workunit.client.1.smithi172.stdout:4/858: mknod df/d2b/d2d/dae/c114 0 2024-03-19T06:05:43.621 INFO:tasks.workunit.client.0.smithi072.stdout:6/28: creat d7/d9/fa x:0 0 0 2024-03-19T06:05:43.622 INFO:tasks.workunit.client.1.smithi172.stdout:3/820: dwrite d0/da8/d25/d21/f10c [0,4194304] 0 2024-03-19T06:05:43.623 INFO:tasks.workunit.client.0.smithi072.stdout:3/74: dread d2/f5 [0,4194304] 0 2024-03-19T06:05:43.624 INFO:tasks.workunit.client.1.smithi172.stdout:9/781: dwrite d1/d7/f2e [0,4194304] 0 2024-03-19T06:05:43.625 INFO:tasks.workunit.client.0.smithi072.stdout:6/29: dread - d7/d9/fa zero size 2024-03-19T06:05:43.628 INFO:tasks.workunit.client.0.smithi072.stdout:4/61: fsync d5/f8 0 2024-03-19T06:05:43.628 INFO:tasks.workunit.client.0.smithi072.stdout:2/36: mkdir db/d10/d13 0 2024-03-19T06:05:43.629 INFO:tasks.workunit.client.0.smithi072.stdout:1/42: dwrite d1/f6 [0,4194304] 0 2024-03-19T06:05:43.629 INFO:tasks.workunit.client.1.smithi172.stdout:3/821: dread - d0/da8/dce/da7/fea zero size 2024-03-19T06:05:43.629 INFO:tasks.workunit.client.1.smithi172.stdout:0/808: dwrite d11/d14/f2e [0,4194304] 0 2024-03-19T06:05:43.634 INFO:tasks.workunit.client.1.smithi172.stdout:8/770: unlink d0/d44/dd2/da2/ldf 0 2024-03-19T06:05:43.634 INFO:tasks.workunit.client.1.smithi172.stdout:7/788: mkdir d0/d22/d27/d104 0 2024-03-19T06:05:43.634 INFO:tasks.workunit.client.1.smithi172.stdout:3/822: dread - d0/db0/db6/dc7/de0/ffd zero size 2024-03-19T06:05:43.635 INFO:tasks.workunit.client.0.smithi072.stdout:5/262: mknod df/d13/d24/d3d/c48 0 2024-03-19T06:05:43.635 INFO:tasks.workunit.client.1.smithi172.stdout:0/809: dread - d11/d14/d2c/d36/f100 zero size 2024-03-19T06:05:43.638 INFO:tasks.workunit.client.0.smithi072.stdout:0/23: dread d1/f5 [0,4194304] 0 2024-03-19T06:05:43.640 INFO:tasks.workunit.client.0.smithi072.stdout:7/51: truncate d2/f4 4847791 0 2024-03-19T06:05:43.640 INFO:tasks.workunit.client.0.smithi072.stdout:7/52: readlink - no filename 2024-03-19T06:05:43.643 INFO:tasks.workunit.client.1.smithi172.stdout:9/782: dread - d1/d7/dc/fb1 zero size 2024-03-19T06:05:43.644 INFO:tasks.workunit.client.1.smithi172.stdout:0/810: creat d11/d22/d32/daf/f113 x:0 0 0 2024-03-19T06:05:43.648 INFO:tasks.workunit.client.1.smithi172.stdout:6/940: link d5/d8f/d31/d3d/d98/df9/c5b d5/d8f/d31/d3d/d98/db6/d9f/c132 0 2024-03-19T06:05:43.649 INFO:tasks.workunit.client.0.smithi072.stdout:3/75: truncate f0 1516615 0 2024-03-19T06:05:43.655 INFO:tasks.workunit.client.1.smithi172.stdout:3/823: rename d0/d5/d14/f89 to d0/da8/d60/d67/f110 0 2024-03-19T06:05:43.657 INFO:tasks.workunit.client.0.smithi072.stdout:8/72: dwrite f9 [0,4194304] 0 2024-03-19T06:05:43.659 INFO:tasks.workunit.client.0.smithi072.stdout:6/30: mknod d7/cb 0 2024-03-19T06:05:43.663 INFO:tasks.workunit.client.1.smithi172.stdout:3/824: write d0/da8/d25/d21/f10c [4853720,9938] 0 2024-03-19T06:05:43.664 INFO:tasks.workunit.client.0.smithi072.stdout:1/43: rmdir d1 39 2024-03-19T06:05:43.665 INFO:tasks.workunit.client.1.smithi172.stdout:6/941: mkdir d5/d8f/d31/d3d/d98/d133 0 2024-03-19T06:05:43.665 INFO:tasks.workunit.client.1.smithi172.stdout:9/783: write d1/d7/dc/d47/d78/d54/fc8 [1232909,16953] 0 2024-03-19T06:05:43.668 INFO:tasks.workunit.client.1.smithi172.stdout:1/815: dwrite da/dd/d31/dfb/d14/d27/d53/fd2 [0,4194304] 0 2024-03-19T06:05:43.674 INFO:tasks.workunit.client.0.smithi072.stdout:4/62: symlink d5/l17 0 2024-03-19T06:05:43.677 INFO:tasks.workunit.client.0.smithi072.stdout:0/24: symlink d1/l6 0 2024-03-19T06:05:43.677 INFO:tasks.workunit.client.0.smithi072.stdout:7/53: mknod d2/d5/cb 0 2024-03-19T06:05:43.680 INFO:tasks.workunit.client.0.smithi072.stdout:9/26: link l2 l7 0 2024-03-19T06:05:43.680 INFO:tasks.workunit.client.1.smithi172.stdout:7/789: dwrite d0/d22/d1d/d36/d56/ffc [0,4194304] 0 2024-03-19T06:05:43.685 INFO:tasks.workunit.client.0.smithi072.stdout:6/31: creat d7/fc x:0 0 0 2024-03-19T06:05:43.686 INFO:tasks.workunit.client.1.smithi172.stdout:9/784: creat d1/d7/dc/d47/da5/f10d x:0 0 0 2024-03-19T06:05:43.687 INFO:tasks.workunit.client.1.smithi172.stdout:4/859: write df/d11/d12/d21/d50/d63/dbb/fab [3648611,63643] 0 2024-03-19T06:05:43.687 INFO:tasks.workunit.client.0.smithi072.stdout:6/32: write d7/fc [1014999,16054] 0 2024-03-19T06:05:43.689 INFO:tasks.workunit.client.0.smithi072.stdout:1/44: chown d1/ca 1443099279 1 2024-03-19T06:05:43.690 INFO:tasks.workunit.client.0.smithi072.stdout:1/45: readlink d1/l7 0 2024-03-19T06:05:43.692 INFO:tasks.workunit.client.0.smithi072.stdout:2/37: creat db/d10/d12/f14 x:0 0 0 2024-03-19T06:05:43.694 INFO:tasks.workunit.client.1.smithi172.stdout:7/790: truncate d0/d22/d1d/d36/f1f 1789605 0 2024-03-19T06:05:43.694 INFO:tasks.workunit.client.0.smithi072.stdout:3/76: dread f1 [4194304,4194304] 0 2024-03-19T06:05:43.700 INFO:tasks.workunit.client.0.smithi072.stdout:7/54: mknod d2/d3/cc 0 2024-03-19T06:05:43.700 INFO:tasks.workunit.client.0.smithi072.stdout:7/55: readlink - no filename 2024-03-19T06:05:43.702 INFO:tasks.workunit.client.1.smithi172.stdout:7/791: write d0/d22/d27/db0/d92/fb5 [767955,81931] 0 2024-03-19T06:05:43.703 INFO:tasks.workunit.client.1.smithi172.stdout:9/785: link d1/d7/dc/dbe/d65/lf6 d1/d7/dc/de/d34/d48/d82/d92/d95/l10e 0 2024-03-19T06:05:43.703 INFO:tasks.workunit.client.0.smithi072.stdout:9/27: mknod c8 0 2024-03-19T06:05:43.704 INFO:tasks.workunit.client.1.smithi172.stdout:2/832: dread d7/de/d58/d55/d66/dc1/fed [0,4194304] 0 2024-03-19T06:05:43.705 INFO:tasks.workunit.client.1.smithi172.stdout:9/786: dread - d1/d7/dc/fe0 zero size 2024-03-19T06:05:43.706 INFO:tasks.workunit.client.0.smithi072.stdout:6/33: symlink d7/ld 0 2024-03-19T06:05:43.708 INFO:tasks.workunit.client.0.smithi072.stdout:6/34: chown d7/cb 2052 1 2024-03-19T06:05:43.708 INFO:tasks.workunit.client.1.smithi172.stdout:7/792: creat d0/d22/d27/db0/df8/f105 x:0 0 0 2024-03-19T06:05:43.710 INFO:tasks.workunit.client.0.smithi072.stdout:4/63: truncate d5/f8 4757357 0 2024-03-19T06:05:43.710 INFO:tasks.workunit.client.1.smithi172.stdout:2/833: chown d7/de/d58/d56/d89/de6/dbc 2598 1 2024-03-19T06:05:43.712 INFO:tasks.workunit.client.1.smithi172.stdout:9/787: symlink d1/d7/dc/de/d34/d48/d82/d92/d95/db4/de5/l10f 0 2024-03-19T06:05:43.713 INFO:tasks.workunit.client.0.smithi072.stdout:1/46: rename d1/fe to d1/ff 0 2024-03-19T06:05:43.714 INFO:tasks.workunit.client.1.smithi172.stdout:7/793: write d0/d22/d1d/dc8/fc9 [971125,64022] 0 2024-03-19T06:05:43.714 INFO:tasks.workunit.client.0.smithi072.stdout:1/47: chown d1 307309209 1 2024-03-19T06:05:43.714 INFO:tasks.workunit.client.1.smithi172.stdout:2/834: mkdir d7/de/d58/d56/d86/d9d/d110 0 2024-03-19T06:05:43.716 INFO:tasks.workunit.client.0.smithi072.stdout:0/25: write d1/f5 [256062,127287] 0 2024-03-19T06:05:43.717 INFO:tasks.workunit.client.1.smithi172.stdout:1/816: creat da/dd/d31/dfb/d14/f11d x:0 0 0 2024-03-19T06:05:43.718 INFO:tasks.workunit.client.0.smithi072.stdout:0/26: write d1/f5 [488213,3666] 0 2024-03-19T06:05:43.720 INFO:tasks.workunit.client.0.smithi072.stdout:5/263: creat df/d13/f49 x:0 0 0 2024-03-19T06:05:43.721 INFO:tasks.workunit.client.1.smithi172.stdout:6/942: dread d5/d8f/f6a [0,4194304] 0 2024-03-19T06:05:43.723 INFO:tasks.workunit.client.1.smithi172.stdout:8/771: dread d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c/fb2 [0,4194304] 0 2024-03-19T06:05:43.728 INFO:tasks.workunit.client.0.smithi072.stdout:7/56: creat d2/d3/fd x:0 0 0 2024-03-19T06:05:43.730 INFO:tasks.workunit.client.0.smithi072.stdout:9/28: creat f9 x:0 0 0 2024-03-19T06:05:43.732 INFO:tasks.workunit.client.1.smithi172.stdout:4/860: write df/d11/d12/d6e/f89 [35591,45576] 0 2024-03-19T06:05:43.732 INFO:tasks.workunit.client.0.smithi072.stdout:8/73: dwrite da/d13/d14/f17 [0,4194304] 0 2024-03-19T06:05:43.734 INFO:tasks.workunit.client.0.smithi072.stdout:4/64: rename l2 to d5/l18 0 2024-03-19T06:05:43.737 INFO:tasks.workunit.client.0.smithi072.stdout:1/48: rename d1/lc to d1/l10 0 2024-03-19T06:05:43.738 INFO:tasks.workunit.client.0.smithi072.stdout:1/49: write d1/f6 [1318731,37408] 0 2024-03-19T06:05:43.744 INFO:tasks.workunit.client.1.smithi172.stdout:7/794: dwrite d0/d22/d1d/d3a/f3f [0,4194304] 0 2024-03-19T06:05:43.744 INFO:tasks.workunit.client.1.smithi172.stdout:3/825: dwrite d0/da8/d3a/fa6 [0,4194304] 0 2024-03-19T06:05:43.751 INFO:tasks.workunit.client.0.smithi072.stdout:2/38: symlink db/d10/d13/l15 0 2024-03-19T06:05:43.751 INFO:tasks.workunit.client.1.smithi172.stdout:2/835: dwrite d7/db/d2c/fe4 [0,4194304] 0 2024-03-19T06:05:43.752 INFO:tasks.workunit.client.0.smithi072.stdout:2/39: stat c7 0 2024-03-19T06:05:43.753 INFO:tasks.workunit.client.0.smithi072.stdout:2/40: fsync db/d10/d12/f14 0 2024-03-19T06:05:43.755 INFO:tasks.workunit.client.0.smithi072.stdout:5/264: symlink df/d13/d32/d28/l4a 0 2024-03-19T06:05:43.756 INFO:tasks.workunit.client.1.smithi172.stdout:9/788: link d1/d7/dc/de/c71 d1/d7/dc/de/d34/d48/d82/d92/c110 0 2024-03-19T06:05:43.756 INFO:tasks.workunit.client.1.smithi172.stdout:6/943: rename d5/d8f/d31/d3d/d98/df9/f6d to d5/d11/d17/d1b/d74/f134 0 2024-03-19T06:05:43.757 INFO:tasks.workunit.client.1.smithi172.stdout:8/772: unlink d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/c66 0 2024-03-19T06:05:43.758 INFO:tasks.workunit.client.0.smithi072.stdout:2/41: truncate db/d10/d12/f14 482022 0 2024-03-19T06:05:43.758 INFO:tasks.workunit.client.1.smithi172.stdout:3/826: rmdir d0/da8/d34/dda 39 2024-03-19T06:05:43.760 INFO:tasks.workunit.client.1.smithi172.stdout:5/766: sync 2024-03-19T06:05:43.762 INFO:tasks.workunit.client.1.smithi172.stdout:6/944: rmdir d5/d8f 39 2024-03-19T06:05:43.763 INFO:tasks.workunit.client.0.smithi072.stdout:2/42: truncate db/d10/d12/f14 984494 0 2024-03-19T06:05:43.763 INFO:tasks.workunit.client.1.smithi172.stdout:7/795: mknod d0/d22/d1d/d36/d8d/c106 0 2024-03-19T06:05:43.764 INFO:tasks.workunit.client.1.smithi172.stdout:2/836: creat d7/db/d2c/d35/de5/d10c/f111 x:0 0 0 2024-03-19T06:05:43.767 INFO:tasks.workunit.client.0.smithi072.stdout:2/43: write db/d10/d12/f14 [359899,15490] 0 2024-03-19T06:05:43.768 INFO:tasks.workunit.client.1.smithi172.stdout:3/827: write d0/da8/d54/d77/f10b [3991653,6416] 0 2024-03-19T06:05:43.770 INFO:tasks.workunit.client.0.smithi072.stdout:7/57: creat d2/d3/fe x:0 0 0 2024-03-19T06:05:43.771 INFO:tasks.workunit.client.0.smithi072.stdout:7/58: chown d2 394 1 2024-03-19T06:05:43.773 INFO:tasks.workunit.client.0.smithi072.stdout:9/29: creat fa x:0 0 0 2024-03-19T06:05:43.775 INFO:tasks.workunit.client.0.smithi072.stdout:6/35: write f6 [552413,106963] 0 2024-03-19T06:05:43.776 INFO:tasks.workunit.client.0.smithi072.stdout:8/74: mknod da/c19 0 2024-03-19T06:05:43.783 INFO:tasks.workunit.client.1.smithi172.stdout:0/811: sync 2024-03-19T06:05:43.788 INFO:tasks.workunit.client.0.smithi072.stdout:9/30: fsync f3 0 2024-03-19T06:05:43.790 INFO:tasks.workunit.client.0.smithi072.stdout:6/36: symlink d7/d9/le 0 2024-03-19T06:05:43.791 INFO:tasks.workunit.client.0.smithi072.stdout:8/75: dread da/d13/d14/f17 [0,4194304] 0 2024-03-19T06:05:43.792 INFO:tasks.workunit.client.1.smithi172.stdout:4/861: dread df/d2b/f40 [0,4194304] 0 2024-03-19T06:05:43.792 INFO:tasks.workunit.client.0.smithi072.stdout:8/76: chown f9 4 1 2024-03-19T06:05:43.798 INFO:tasks.workunit.client.0.smithi072.stdout:3/77: getdents d2/d3 0 2024-03-19T06:05:43.806 INFO:tasks.workunit.client.1.smithi172.stdout:1/817: truncate da/dd/d31/dfb/d14/d27/d53/ffc 3093615 0 2024-03-19T06:05:43.809 INFO:tasks.workunit.client.1.smithi172.stdout:1/818: read da/dd/d31/dfb/f68 [33315,94612] 0 2024-03-19T06:05:43.814 INFO:tasks.workunit.client.1.smithi172.stdout:3/828: dread d0/da8/d60/d67/f7d [0,4194304] 0 2024-03-19T06:05:43.815 INFO:tasks.workunit.client.0.smithi072.stdout:4/65: link d5/le d5/d11/l19 0 2024-03-19T06:05:43.817 INFO:tasks.workunit.client.0.smithi072.stdout:4/66: chown d5/f9 56667 1 2024-03-19T06:05:43.819 INFO:tasks.workunit.client.1.smithi172.stdout:1/819: creat da/dd/d31/d47/dbf/f11e x:0 0 0 2024-03-19T06:05:43.824 INFO:tasks.workunit.client.0.smithi072.stdout:0/27: getdents d1 0 2024-03-19T06:05:43.825 INFO:tasks.workunit.client.1.smithi172.stdout:4/862: dread df/d2b/f3b [0,4194304] 0 2024-03-19T06:05:43.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:43 smithi072 ceph-mon[28706]: pgmap v18: 65 pgs: 65 active+clean; 1.5 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 37 MiB/s rd, 114 MiB/s wr, 229 op/s 2024-03-19T06:05:43.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:43 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:05:43.828 INFO:tasks.workunit.client.0.smithi072.stdout:7/59: write d2/f4 [1586983,74850] 0 2024-03-19T06:05:43.828 INFO:tasks.workunit.client.1.smithi172.stdout:4/863: dread - df/d2b/d44/f4c zero size 2024-03-19T06:05:43.831 INFO:tasks.workunit.client.0.smithi072.stdout:9/31: rename l5 to lb 0 2024-03-19T06:05:43.831 INFO:tasks.workunit.client.0.smithi072.stdout:6/37: write f4 [1249327,42083] 0 2024-03-19T06:05:43.832 INFO:tasks.workunit.client.0.smithi072.stdout:8/77: write da/d13/f16 [90461,98904] 0 2024-03-19T06:05:43.832 INFO:tasks.workunit.client.0.smithi072.stdout:4/67: creat d5/d11/f1a x:0 0 0 2024-03-19T06:05:43.835 INFO:tasks.workunit.client.0.smithi072.stdout:5/265: link df/d13/d24/l46 df/l4b 0 2024-03-19T06:05:43.836 INFO:tasks.workunit.client.0.smithi072.stdout:1/50: getdents d1 0 2024-03-19T06:05:43.837 INFO:tasks.workunit.client.0.smithi072.stdout:9/32: chown fa 1573548 1 2024-03-19T06:05:43.837 INFO:tasks.workunit.client.0.smithi072.stdout:2/44: getdents db/d10 0 2024-03-19T06:05:43.838 INFO:tasks.workunit.client.0.smithi072.stdout:7/60: symlink d2/d5/lf 0 2024-03-19T06:05:43.838 INFO:tasks.workunit.client.1.smithi172.stdout:6/945: creat d5/d11/d17/da4/f135 x:0 0 0 2024-03-19T06:05:43.839 INFO:tasks.workunit.client.0.smithi072.stdout:9/33: fsync fa 0 2024-03-19T06:05:43.843 INFO:tasks.workunit.client.0.smithi072.stdout:5/266: symlink df/d13/d24/l4c 0 2024-03-19T06:05:43.843 INFO:tasks.workunit.client.0.smithi072.stdout:0/28: link d1/l6 d1/l7 0 2024-03-19T06:05:43.844 INFO:tasks.workunit.client.0.smithi072.stdout:9/34: truncate f9 828228 0 2024-03-19T06:05:43.844 INFO:tasks.workunit.client.0.smithi072.stdout:1/51: mkdir d1/d11 0 2024-03-19T06:05:43.847 INFO:tasks.workunit.client.0.smithi072.stdout:7/61: symlink d2/d3/l10 0 2024-03-19T06:05:43.848 INFO:tasks.workunit.client.1.smithi172.stdout:0/812: symlink d11/d14/ded/l114 0 2024-03-19T06:05:43.854 INFO:tasks.workunit.client.1.smithi172.stdout:3/829: creat d0/da8/dce/d72/f111 x:0 0 0 2024-03-19T06:05:43.855 INFO:tasks.workunit.client.0.smithi072.stdout:9/35: truncate f3 848509 0 2024-03-19T06:05:43.857 INFO:tasks.workunit.client.0.smithi072.stdout:2/45: dread db/d10/d12/f14 [0,4194304] 0 2024-03-19T06:05:43.858 INFO:tasks.workunit.client.0.smithi072.stdout:1/52: fdatasync d1/ff 0 2024-03-19T06:05:43.860 INFO:tasks.workunit.client.0.smithi072.stdout:8/78: link f8 da/d13/d14/f1a 0 2024-03-19T06:05:43.861 INFO:tasks.workunit.client.0.smithi072.stdout:0/29: dread d1/f5 [0,4194304] 0 2024-03-19T06:05:43.869 INFO:tasks.workunit.client.1.smithi172.stdout:7/796: symlink d0/d22/d1d/d3a/d46/d103/l107 0 2024-03-19T06:05:43.877 INFO:tasks.workunit.client.1.smithi172.stdout:3/830: write d0/d5/d6b/f8f [1082285,121744] 0 2024-03-19T06:05:43.878 INFO:tasks.workunit.client.0.smithi072.stdout:1/53: write d1/f6 [193265,56729] 0 2024-03-19T06:05:43.878 INFO:tasks.workunit.client.0.smithi072.stdout:8/79: read da/d13/d14/f17 [3647190,64402] 0 2024-03-19T06:05:43.879 INFO:tasks.workunit.client.1.smithi172.stdout:3/831: stat d0/da8/d60/l107 0 2024-03-19T06:05:43.881 INFO:tasks.workunit.client.0.smithi072.stdout:2/46: creat db/d10/f16 x:0 0 0 2024-03-19T06:05:43.882 INFO:tasks.workunit.client.1.smithi172.stdout:1/820: creat da/dd/d31/dfb/d36/f11f x:0 0 0 2024-03-19T06:05:43.885 INFO:tasks.workunit.client.1.smithi172.stdout:7/797: creat d0/d22/d1d/d85/da8/f108 x:0 0 0 2024-03-19T06:05:43.886 INFO:tasks.workunit.client.0.smithi072.stdout:0/30: dread d1/f5 [0,4194304] 0 2024-03-19T06:05:43.887 INFO:tasks.workunit.client.1.smithi172.stdout:7/798: dread - d0/d22/d3d/ff6 zero size 2024-03-19T06:05:43.888 INFO:tasks.workunit.client.1.smithi172.stdout:1/821: creat da/dd/d31/dfb/d14/d84/d9b/f120 x:0 0 0 2024-03-19T06:05:43.892 INFO:tasks.workunit.client.1.smithi172.stdout:7/799: write d0/d22/d27/db0/f2f [371022,54192] 0 2024-03-19T06:05:43.894 INFO:tasks.workunit.client.1.smithi172.stdout:1/822: write da/dd/d31/dfb/d14/d27/d53/fd2 [2734399,103485] 0 2024-03-19T06:05:43.895 INFO:tasks.workunit.client.1.smithi172.stdout:6/946: link d5/d8f/d31/d3d/d98/db6/l47 d5/d8f/d31/d84/df3/l136 0 2024-03-19T06:05:43.895 INFO:tasks.workunit.client.0.smithi072.stdout:1/54: symlink d1/l12 0 2024-03-19T06:05:43.897 INFO:tasks.workunit.client.1.smithi172.stdout:6/947: dread - d5/d8f/d31/d7b/fef zero size 2024-03-19T06:05:43.898 INFO:tasks.workunit.client.0.smithi072.stdout:9/36: truncate f3 1769459 0 2024-03-19T06:05:43.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:43 smithi172 ceph-mon[35716]: pgmap v18: 65 pgs: 65 active+clean; 1.5 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 37 MiB/s rd, 114 MiB/s wr, 229 op/s 2024-03-19T06:05:43.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:43 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:05:43.905 INFO:tasks.workunit.client.0.smithi072.stdout:8/80: mkdir da/d13/d14/d1b 0 2024-03-19T06:05:43.905 INFO:tasks.workunit.client.1.smithi172.stdout:1/823: dread - da/dd/d31/dfb/d36/f9a zero size 2024-03-19T06:05:43.907 INFO:tasks.workunit.client.1.smithi172.stdout:6/948: stat d5/d8f/d31/d3d/d98 0 2024-03-19T06:05:43.911 INFO:tasks.workunit.client.0.smithi072.stdout:6/38: dwrite f3 [0,4194304] 0 2024-03-19T06:05:43.915 INFO:tasks.workunit.client.0.smithi072.stdout:0/31: fsync d1/f5 0 2024-03-19T06:05:43.920 INFO:tasks.workunit.client.0.smithi072.stdout:7/62: dwrite d2/d3/fe [0,4194304] 0 2024-03-19T06:05:43.920 INFO:tasks.workunit.client.0.smithi072.stdout:9/37: symlink lc 0 2024-03-19T06:05:43.921 INFO:tasks.workunit.client.0.smithi072.stdout:3/78: dwrite f1 [4194304,4194304] 0 2024-03-19T06:05:43.923 INFO:tasks.workunit.client.0.smithi072.stdout:6/39: rmdir d7 39 2024-03-19T06:05:43.924 INFO:tasks.workunit.client.1.smithi172.stdout:1/824: creat da/dd/d31/dfb/d36/f121 x:0 0 0 2024-03-19T06:05:43.925 INFO:tasks.workunit.client.0.smithi072.stdout:2/47: dread db/d10/d12/f14 [0,4194304] 0 2024-03-19T06:05:43.931 INFO:tasks.workunit.client.1.smithi172.stdout:1/825: dread - da/dd/d31/dfb/d14/d84/f108 zero size 2024-03-19T06:05:43.932 INFO:tasks.workunit.client.0.smithi072.stdout:4/68: dwrite d5/f12 [0,4194304] 0 2024-03-19T06:05:43.936 INFO:tasks.workunit.client.0.smithi072.stdout:5/267: dwrite df/f17 [0,4194304] 0 2024-03-19T06:05:43.936 INFO:tasks.workunit.client.0.smithi072.stdout:0/32: mknod d1/c8 0 2024-03-19T06:05:43.942 INFO:tasks.workunit.client.0.smithi072.stdout:1/55: creat d1/d11/f13 x:0 0 0 2024-03-19T06:05:43.943 INFO:tasks.workunit.client.0.smithi072.stdout:7/63: creat d2/d5/f11 x:0 0 0 2024-03-19T06:05:43.944 INFO:tasks.workunit.client.1.smithi172.stdout:8/773: write d0/d61/d6a/d7e/f90 [693835,106149] 0 2024-03-19T06:05:43.945 INFO:tasks.workunit.client.0.smithi072.stdout:9/38: unlink f3 0 2024-03-19T06:05:43.946 INFO:tasks.workunit.client.0.smithi072.stdout:2/48: symlink db/l17 0 2024-03-19T06:05:43.947 INFO:tasks.workunit.client.1.smithi172.stdout:8/774: chown d0/d61/d6e/fc5 0 1 2024-03-19T06:05:43.948 INFO:tasks.workunit.client.0.smithi072.stdout:5/268: symlink df/d13/d24/d3d/d43/l4d 0 2024-03-19T06:05:43.948 INFO:tasks.workunit.client.0.smithi072.stdout:3/79: mknod d2/d3/c13 0 2024-03-19T06:05:43.950 INFO:tasks.workunit.client.1.smithi172.stdout:2/837: write d7/de/d58/d56/d86/f92 [741194,98161] 0 2024-03-19T06:05:43.951 INFO:tasks.workunit.client.0.smithi072.stdout:0/33: dread d1/f5 [0,4194304] 0 2024-03-19T06:05:43.951 INFO:tasks.workunit.client.0.smithi072.stdout:3/80: chown d2/cd 2695 1 2024-03-19T06:05:43.954 INFO:tasks.workunit.client.1.smithi172.stdout:2/838: write d7/d4c/ff1 [1689058,90101] 0 2024-03-19T06:05:43.956 INFO:tasks.workunit.client.0.smithi072.stdout:2/49: rmdir db 39 2024-03-19T06:05:43.956 INFO:tasks.workunit.client.0.smithi072.stdout:6/40: creat d7/d9/ff x:0 0 0 2024-03-19T06:05:43.958 INFO:tasks.workunit.client.0.smithi072.stdout:6/41: dread - d7/d9/ff zero size 2024-03-19T06:05:43.958 INFO:tasks.workunit.client.1.smithi172.stdout:2/839: truncate d7/de/d58/d55/d5f/fe0 159148 0 2024-03-19T06:05:43.959 INFO:tasks.workunit.client.1.smithi172.stdout:9/789: truncate d1/f75 498073 0 2024-03-19T06:05:43.962 INFO:tasks.workunit.client.1.smithi172.stdout:2/840: mkdir d7/de/d58/d55/da8/d112 0 2024-03-19T06:05:43.967 INFO:tasks.workunit.client.0.smithi072.stdout:8/81: dread f8 [0,4194304] 0 2024-03-19T06:05:43.969 INFO:tasks.workunit.client.0.smithi072.stdout:9/39: link c8 cd 0 2024-03-19T06:05:43.970 INFO:tasks.workunit.client.0.smithi072.stdout:6/42: unlink d7/ld 0 2024-03-19T06:05:43.976 INFO:tasks.workunit.client.1.smithi172.stdout:4/864: truncate df/d2b/d2d/f8a 331504 0 2024-03-19T06:05:43.980 INFO:tasks.workunit.client.0.smithi072.stdout:0/34: link d1/c8 d1/c9 0 2024-03-19T06:05:43.980 INFO:tasks.workunit.client.0.smithi072.stdout:6/43: stat c1 0 2024-03-19T06:05:43.980 INFO:tasks.workunit.client.0.smithi072.stdout:7/64: getdents d2/d3 0 2024-03-19T06:05:43.981 INFO:tasks.workunit.client.0.smithi072.stdout:9/40: write fa [390869,38937] 0 2024-03-19T06:05:43.981 INFO:tasks.workunit.client.1.smithi172.stdout:0/813: creat d11/d18/d38/d3f/d43/f115 x:0 0 0 2024-03-19T06:05:43.983 INFO:tasks.workunit.client.1.smithi172.stdout:4/865: truncate df/d11/d12/d21/d50/d63/dbb/dc4/fee 1506338 0 2024-03-19T06:05:43.983 INFO:tasks.workunit.client.1.smithi172.stdout:0/814: dread - d11/d18/d38/d3f/d43/f115 zero size 2024-03-19T06:05:43.983 INFO:tasks.workunit.client.0.smithi072.stdout:8/82: write da/d13/d14/f17 [959570,101547] 0 2024-03-19T06:05:43.991 INFO:tasks.workunit.client.0.smithi072.stdout:1/56: dwrite d1/f6 [0,4194304] 0 2024-03-19T06:05:43.992 INFO:tasks.workunit.client.0.smithi072.stdout:7/65: symlink d2/d5/l12 0 2024-03-19T06:05:43.993 INFO:tasks.workunit.client.1.smithi172.stdout:9/790: rmdir d1/d7/dc/d47/d78 39 2024-03-19T06:05:43.993 INFO:tasks.workunit.client.1.smithi172.stdout:6/949: write d5/d11/d43/d45/f5c [3952956,37833] 0 2024-03-19T06:05:43.995 INFO:tasks.workunit.client.0.smithi072.stdout:9/41: creat fe x:0 0 0 2024-03-19T06:05:43.995 INFO:tasks.workunit.client.1.smithi172.stdout:5/767: mknod d5/c106 0 2024-03-19T06:05:43.996 INFO:tasks.workunit.client.1.smithi172.stdout:8/775: mknod d0/d44/d46/d49/d26/cef 0 2024-03-19T06:05:43.996 INFO:tasks.workunit.client.1.smithi172.stdout:7/800: dwrite d0/d22/d1d/d36/d56/f6c [4194304,4194304] 0 2024-03-19T06:05:43.997 INFO:tasks.workunit.client.0.smithi072.stdout:3/81: dread d2/d3/fb [0,4194304] 0 2024-03-19T06:05:43.999 INFO:tasks.workunit.client.0.smithi072.stdout:6/44: dread f6 [0,4194304] 0 2024-03-19T06:05:43.999 INFO:tasks.workunit.client.1.smithi172.stdout:1/826: dwrite da/dd/d31/dfb/d14/d27/d3f/d5e/fd7 [0,4194304] 0 2024-03-19T06:05:44.000 INFO:tasks.workunit.client.0.smithi072.stdout:9/42: fsync fa 0 2024-03-19T06:05:44.002 INFO:tasks.workunit.client.1.smithi172.stdout:4/866: rmdir df/d11/d12/d6e 39 2024-03-19T06:05:44.004 INFO:tasks.workunit.client.0.smithi072.stdout:8/83: mknod da/d13/c1c 0 2024-03-19T06:05:44.004 INFO:tasks.workunit.client.1.smithi172.stdout:3/832: rmdir d0/da8 39 2024-03-19T06:05:44.008 INFO:tasks.workunit.client.0.smithi072.stdout:1/57: dread - d1/ff zero size 2024-03-19T06:05:44.008 INFO:tasks.workunit.client.1.smithi172.stdout:2/841: truncate d7/de/d58/d56/d86/d9e/fbb 4476946 0 2024-03-19T06:05:44.013 INFO:tasks.workunit.client.0.smithi072.stdout:5/269: dwrite df/d16/f39 [0,4194304] 0 2024-03-19T06:05:44.016 INFO:tasks.workunit.client.0.smithi072.stdout:0/35: truncate d1/f5 761993 0 2024-03-19T06:05:44.019 INFO:tasks.workunit.client.0.smithi072.stdout:7/66: truncate d2/d3/fd 173982 0 2024-03-19T06:05:44.022 INFO:tasks.workunit.client.1.smithi172.stdout:9/791: chown d1/d7/dc/d47/d78/d54/f6d 842 1 2024-03-19T06:05:44.022 INFO:tasks.workunit.client.1.smithi172.stdout:5/768: fsync d5/d14/d56/f6f 0 2024-03-19T06:05:44.024 INFO:tasks.workunit.client.1.smithi172.stdout:9/792: dread - d1/d7/fe9 zero size 2024-03-19T06:05:44.026 INFO:tasks.workunit.client.0.smithi072.stdout:9/43: chown l7 5897 1 2024-03-19T06:05:44.027 INFO:tasks.workunit.client.0.smithi072.stdout:6/45: creat d7/f10 x:0 0 0 2024-03-19T06:05:44.037 INFO:tasks.workunit.client.0.smithi072.stdout:9/44: chown lb 34369733 1 2024-03-19T06:05:44.038 INFO:tasks.workunit.client.1.smithi172.stdout:2/842: rmdir d7/db/d2c/d35/de5/d10c 39 2024-03-19T06:05:44.040 INFO:tasks.workunit.client.0.smithi072.stdout:7/67: chown d2/d5/l12 71976 1 2024-03-19T06:05:44.040 INFO:tasks.workunit.client.1.smithi172.stdout:2/843: readlink d7/d4c/l105 0 2024-03-19T06:05:44.040 INFO:tasks.workunit.client.1.smithi172.stdout:6/950: mknod d5/d11/d17/d36/df4/c137 0 2024-03-19T06:05:44.041 INFO:tasks.workunit.client.0.smithi072.stdout:1/58: rename d1/ff to d1/f14 0 2024-03-19T06:05:44.044 INFO:tasks.workunit.client.0.smithi072.stdout:2/50: dwrite db/d10/d12/f14 [0,4194304] 0 2024-03-19T06:05:44.049 INFO:tasks.workunit.client.0.smithi072.stdout:0/36: getdents d1 0 2024-03-19T06:05:44.050 INFO:tasks.workunit.client.0.smithi072.stdout:8/84: dread da/d13/f16 [0,4194304] 0 2024-03-19T06:05:44.051 INFO:tasks.workunit.client.0.smithi072.stdout:4/69: dwrite d5/f8 [0,4194304] 0 2024-03-19T06:05:44.052 INFO:tasks.workunit.client.0.smithi072.stdout:9/45: write fe [1028048,52607] 0 2024-03-19T06:05:44.053 INFO:tasks.workunit.client.1.smithi172.stdout:2/844: creat d7/de/d58/d56/d89/de6/f113 x:0 0 0 2024-03-19T06:05:44.056 INFO:tasks.workunit.client.1.smithi172.stdout:1/827: dread da/f77 [0,4194304] 0 2024-03-19T06:05:44.056 INFO:tasks.workunit.client.1.smithi172.stdout:9/793: mknod d1/d7/dc/d47/da3/c111 0 2024-03-19T06:05:44.063 INFO:tasks.workunit.client.0.smithi072.stdout:2/51: write db/d10/d12/f14 [2100980,82463] 0 2024-03-19T06:05:44.064 INFO:tasks.workunit.client.1.smithi172.stdout:9/794: fsync d1/d7/dc/dbe/f33 0 2024-03-19T06:05:44.064 INFO:tasks.workunit.client.1.smithi172.stdout:7/801: dread d0/d22/d1d/d36/d8d/f63 [0,4194304] 0 2024-03-19T06:05:44.064 INFO:tasks.workunit.client.1.smithi172.stdout:8/776: link d0/d44/d46/d49/d26/c50 d0/d44/d46/d49/d26/dc0/dbf/cf0 0 2024-03-19T06:05:44.065 INFO:tasks.workunit.client.0.smithi072.stdout:7/68: mkdir d2/d13 0 2024-03-19T06:05:44.070 INFO:tasks.workunit.client.1.smithi172.stdout:9/795: write d1/d7/dc/d47/d78/f7e [1261031,106945] 0 2024-03-19T06:05:44.070 INFO:tasks.workunit.client.1.smithi172.stdout:1/828: symlink da/dd/d31/dfb/d14/d27/da7/l122 0 2024-03-19T06:05:44.071 INFO:tasks.workunit.client.0.smithi072.stdout:9/46: chown fe 46526607 1 2024-03-19T06:05:44.072 INFO:tasks.workunit.client.0.smithi072.stdout:3/82: truncate f1 2563520 0 2024-03-19T06:05:44.073 INFO:tasks.workunit.client.1.smithi172.stdout:5/769: dwrite d5/d1f/db4/ffd [0,4194304] 0 2024-03-19T06:05:44.074 INFO:tasks.workunit.client.1.smithi172.stdout:4/867: write df/d11/d12/d34/f8d [959049,96375] 0 2024-03-19T06:05:44.074 INFO:tasks.workunit.client.1.smithi172.stdout:2/845: fsync d7/de/d58/d56/d86/d9e/fbb 0 2024-03-19T06:05:44.074 INFO:tasks.workunit.client.1.smithi172.stdout:8/777: readlink d0/d64/l68 0 2024-03-19T06:05:44.077 INFO:tasks.workunit.client.0.smithi072.stdout:9/47: chown lc 0 1 2024-03-19T06:05:44.082 INFO:tasks.workunit.client.1.smithi172.stdout:2/846: chown d7/de/d58/d55/d6e/fdc 428331 1 2024-03-19T06:05:44.086 INFO:tasks.workunit.client.1.smithi172.stdout:9/796: truncate d1/f9 176349 0 2024-03-19T06:05:44.087 INFO:tasks.workunit.client.0.smithi072.stdout:2/52: creat db/d10/f18 x:0 0 0 2024-03-19T06:05:44.088 INFO:tasks.workunit.client.1.smithi172.stdout:1/829: truncate da/dd/d31/dfb/d14/d84/d9b/fff 290465 0 2024-03-19T06:05:44.088 INFO:tasks.workunit.client.1.smithi172.stdout:2/847: stat d7/de/d58/d56/d86/d9d/d110 0 2024-03-19T06:05:44.092 INFO:tasks.workunit.client.0.smithi072.stdout:4/70: read d5/f9 [511940,54123] 0 2024-03-19T06:05:44.092 INFO:tasks.workunit.client.0.smithi072.stdout:2/53: read - db/d10/f16 zero size 2024-03-19T06:05:44.093 INFO:tasks.workunit.client.0.smithi072.stdout:0/37: unlink d1/c8 0 2024-03-19T06:05:44.093 INFO:tasks.workunit.client.0.smithi072.stdout:3/83: unlink d2/l12 0 2024-03-19T06:05:44.097 INFO:tasks.workunit.client.1.smithi172.stdout:5/770: creat d5/d3c/d6c/d9b/d105/f107 x:0 0 0 2024-03-19T06:05:44.098 INFO:tasks.workunit.client.1.smithi172.stdout:3/833: dread d0/d5/f3d [0,4194304] 0 2024-03-19T06:05:44.102 INFO:tasks.workunit.client.1.smithi172.stdout:6/951: dwrite d5/d11/d43/fb9 [0,4194304] 0 2024-03-19T06:05:44.103 INFO:tasks.workunit.client.0.smithi072.stdout:6/46: dwrite f3 [4194304,4194304] 0 2024-03-19T06:05:44.105 INFO:tasks.workunit.client.1.smithi172.stdout:7/802: write d0/d22/d1d/fcd [3179761,82684] 0 2024-03-19T06:05:44.107 INFO:tasks.workunit.client.1.smithi172.stdout:2/848: creat d7/de/d58/d56/d89/de6/dbc/dc6/f114 x:0 0 0 2024-03-19T06:05:44.109 INFO:tasks.workunit.client.1.smithi172.stdout:5/771: mkdir d5/d3c/d108 0 2024-03-19T06:05:44.113 INFO:tasks.workunit.client.1.smithi172.stdout:2/849: dread - d7/de/d58/d55/d6e/da5/feb zero size 2024-03-19T06:05:44.114 INFO:tasks.workunit.client.0.smithi072.stdout:6/47: readlink l5 0 2024-03-19T06:05:44.118 INFO:tasks.workunit.client.1.smithi172.stdout:1/830: rename da/dd/d31/dfb/d14/f35 to da/d33/d81/f123 0 2024-03-19T06:05:44.120 INFO:tasks.workunit.client.0.smithi072.stdout:5/270: dwrite df/d13/f23 [0,4194304] 0 2024-03-19T06:05:44.122 INFO:tasks.workunit.client.1.smithi172.stdout:3/834: unlink d0/da8/d3a/faa 0 2024-03-19T06:05:44.123 INFO:tasks.workunit.client.1.smithi172.stdout:2/850: symlink d7/de/d58/d55/d5f/l115 0 2024-03-19T06:05:44.125 INFO:tasks.workunit.client.1.smithi172.stdout:7/803: creat d0/d22/f109 x:0 0 0 2024-03-19T06:05:44.127 INFO:tasks.workunit.client.1.smithi172.stdout:9/797: write d1/d7/dc/dbe/f9c [367579,41921] 0 2024-03-19T06:05:44.129 INFO:tasks.workunit.client.0.smithi072.stdout:1/59: dwrite d1/d11/f13 [0,4194304] 0 2024-03-19T06:05:44.131 INFO:tasks.workunit.client.0.smithi072.stdout:2/54: dread - db/d10/f16 zero size 2024-03-19T06:05:44.132 INFO:tasks.workunit.client.1.smithi172.stdout:8/778: dwrite d0/d44/d46/f60 [0,4194304] 0 2024-03-19T06:05:44.132 INFO:tasks.workunit.client.1.smithi172.stdout:2/851: read d7/de/d58/d55/d5f/fc3 [262064,23619] 0 2024-03-19T06:05:44.132 INFO:tasks.workunit.client.1.smithi172.stdout:3/835: truncate d0/da8/d25/f1a 1707017 0 2024-03-19T06:05:44.136 INFO:tasks.workunit.client.0.smithi072.stdout:0/38: dread d1/f5 [0,4194304] 0 2024-03-19T06:05:44.139 INFO:tasks.workunit.client.1.smithi172.stdout:8/779: chown d0/d61/d6a/d98/le6 181171 1 2024-03-19T06:05:44.140 INFO:tasks.workunit.client.1.smithi172.stdout:7/804: creat d0/d22/d27/ded/f10a x:0 0 0 2024-03-19T06:05:44.140 INFO:tasks.workunit.client.1.smithi172.stdout:4/868: dread df/d11/d12/d21/d50/d63/dbb/fab [0,4194304] 0 2024-03-19T06:05:44.141 INFO:tasks.workunit.client.0.smithi072.stdout:8/85: dread f4 [0,4194304] 0 2024-03-19T06:05:44.141 INFO:tasks.workunit.client.1.smithi172.stdout:2/852: fsync d7/de/d58/d56/d86/d9d/fc9 0 2024-03-19T06:05:44.141 INFO:tasks.workunit.client.1.smithi172.stdout:3/836: chown d0/da8/d54/d77 366 1 2024-03-19T06:05:44.143 INFO:tasks.workunit.client.0.smithi072.stdout:1/60: creat d1/f15 x:0 0 0 2024-03-19T06:05:44.143 INFO:tasks.workunit.client.0.smithi072.stdout:6/48: creat d7/f11 x:0 0 0 2024-03-19T06:05:44.144 INFO:tasks.workunit.client.1.smithi172.stdout:9/798: unlink d1/d7/dc/d47/d78/d54/d91/c87 0 2024-03-19T06:05:44.145 INFO:tasks.workunit.client.1.smithi172.stdout:5/772: dwrite d5/d3d/f5b [0,4194304] 0 2024-03-19T06:05:44.146 INFO:tasks.workunit.client.0.smithi072.stdout:5/271: rmdir df/d13/d32 39 2024-03-19T06:05:44.149 INFO:tasks.workunit.client.0.smithi072.stdout:7/69: dwrite d2/d3/fe [0,4194304] 0 2024-03-19T06:05:44.151 INFO:tasks.workunit.client.1.smithi172.stdout:7/805: readlink d0/d22/d27/l37 0 2024-03-19T06:05:44.152 INFO:tasks.workunit.client.1.smithi172.stdout:3/837: stat d0/da8/d54/d90/f97 0 2024-03-19T06:05:44.154 INFO:tasks.workunit.client.1.smithi172.stdout:1/831: dwrite da/dd/d31/dfb/d14/d27/d3f/fe1 [0,4194304] 0 2024-03-19T06:05:44.154 INFO:tasks.workunit.client.1.smithi172.stdout:4/869: mkdir df/d2b/da3/d115 0 2024-03-19T06:05:44.157 INFO:tasks.workunit.client.1.smithi172.stdout:7/806: chown d0/d22/d1d/d36/d8d/d7d/c84 311271 1 2024-03-19T06:05:44.161 INFO:tasks.workunit.client.1.smithi172.stdout:5/773: creat d5/d55/df5/f109 x:0 0 0 2024-03-19T06:05:44.161 INFO:tasks.workunit.client.1.smithi172.stdout:1/832: chown da/dd/d31/dfb/d14/d73/d8b/f94 228038126 1 2024-03-19T06:05:44.162 INFO:tasks.workunit.client.1.smithi172.stdout:8/780: getdents d0/d44/d46/d49/d26/dbc/dc6 0 2024-03-19T06:05:44.166 INFO:tasks.workunit.client.1.smithi172.stdout:1/833: creat da/d7a/de0/f124 x:0 0 0 2024-03-19T06:05:44.169 INFO:tasks.workunit.client.1.smithi172.stdout:1/834: dread - da/dd/d31/dfb/fc8 zero size 2024-03-19T06:05:44.176 INFO:tasks.workunit.client.1.smithi172.stdout:1/835: creat da/dd/d31/dfb/d14/d27/da2/f125 x:0 0 0 2024-03-19T06:05:44.177 INFO:tasks.workunit.client.1.smithi172.stdout:8/781: rename d0/d44/d46/d49/c89 to d0/d44/dd2/cf1 0 2024-03-19T06:05:44.182 INFO:tasks.workunit.client.0.smithi072.stdout:9/48: dwrite fe [0,4194304] 0 2024-03-19T06:05:44.183 INFO:tasks.workunit.client.1.smithi172.stdout:5/774: rename d5/d1f/d2f/d62/fcb to d5/d55/de7/f10a 0 2024-03-19T06:05:44.184 INFO:tasks.workunit.client.1.smithi172.stdout:5/775: dread - d5/d1f/d2f/d62/fcc zero size 2024-03-19T06:05:44.186 INFO:tasks.workunit.client.1.smithi172.stdout:3/838: read d0/da8/d3a/fa3 [3104132,118333] 0 2024-03-19T06:05:44.193 INFO:tasks.workunit.client.0.smithi072.stdout:3/84: link f0 d2/d3/f14 0 2024-03-19T06:05:44.197 INFO:tasks.workunit.client.1.smithi172.stdout:7/807: dread d0/d22/d4b/fcf [0,4194304] 0 2024-03-19T06:05:44.198 INFO:tasks.workunit.client.1.smithi172.stdout:1/836: dwrite da/dd/d31/dfb/d14/d84/d9b/f119 [0,4194304] 0 2024-03-19T06:05:44.198 INFO:tasks.workunit.client.0.smithi072.stdout:9/49: symlink lf 0 2024-03-19T06:05:44.199 INFO:tasks.workunit.client.1.smithi172.stdout:3/839: rename d0/da8/dce/f100 to d0/da8/d60/df1/f112 0 2024-03-19T06:05:44.207 INFO:tasks.workunit.client.1.smithi172.stdout:3/840: mknod d0/da8/d34/c113 0 2024-03-19T06:05:44.208 INFO:tasks.workunit.client.0.smithi072.stdout:5/272: dread df/d14/f2a [0,4194304] 0 2024-03-19T06:05:44.211 INFO:tasks.workunit.client.0.smithi072.stdout:8/86: dread da/d13/d14/f17 [0,4194304] 0 2024-03-19T06:05:44.215 INFO:tasks.workunit.client.0.smithi072.stdout:3/85: write d2/d3/fb [618041,102360] 0 2024-03-19T06:05:44.216 INFO:tasks.workunit.client.0.smithi072.stdout:4/71: dwrite d5/f10 [0,4194304] 0 2024-03-19T06:05:44.217 INFO:tasks.workunit.client.0.smithi072.stdout:6/49: dread f4 [0,4194304] 0 2024-03-19T06:05:44.217 INFO:tasks.workunit.client.1.smithi172.stdout:7/808: truncate d0/d22/d1d/d85/fbd 442780 0 2024-03-19T06:05:44.218 INFO:tasks.workunit.client.0.smithi072.stdout:9/50: unlink f9 0 2024-03-19T06:05:44.219 INFO:tasks.workunit.client.1.smithi172.stdout:1/837: dread da/dd/d31/dfb/d14/d27/d53/fd2 [0,4194304] 0 2024-03-19T06:05:44.220 INFO:tasks.workunit.client.1.smithi172.stdout:3/841: mknod d0/da8/d34/c114 0 2024-03-19T06:05:44.222 INFO:tasks.workunit.client.0.smithi072.stdout:8/87: chown da 2930 1 2024-03-19T06:05:44.222 INFO:tasks.workunit.client.1.smithi172.stdout:9/799: truncate d1/d7/dc/d47/d78/d54/d91/f35 208343 0 2024-03-19T06:05:44.224 INFO:tasks.workunit.client.0.smithi072.stdout:2/55: dwrite db/d10/f16 [0,4194304] 0 2024-03-19T06:05:44.224 INFO:tasks.workunit.client.1.smithi172.stdout:3/842: readlink d0/da8/d54/l105 0 2024-03-19T06:05:44.225 INFO:tasks.workunit.client.1.smithi172.stdout:1/838: creat da/d7a/f126 x:0 0 0 2024-03-19T06:05:44.227 INFO:tasks.workunit.client.1.smithi172.stdout:7/809: creat d0/d22/d27/db0/df8/f10b x:0 0 0 2024-03-19T06:05:44.228 INFO:tasks.workunit.client.1.smithi172.stdout:4/870: dread df/f4d [0,4194304] 0 2024-03-19T06:05:44.230 INFO:tasks.workunit.client.0.smithi072.stdout:9/51: mknod c10 0 2024-03-19T06:05:44.232 INFO:tasks.workunit.client.1.smithi172.stdout:1/839: write da/dd/d31/dfb/d14/d27/d3f/d5e/dab/dde/ff2 [5201772,11539] 0 2024-03-19T06:05:44.233 INFO:tasks.workunit.client.1.smithi172.stdout:5/776: dread d5/d14/d15/d40/d6a/fbe [0,4194304] 0 2024-03-19T06:05:44.234 INFO:tasks.workunit.client.0.smithi072.stdout:1/61: dwrite d1/f6 [0,4194304] 0 2024-03-19T06:05:44.235 INFO:tasks.workunit.client.1.smithi172.stdout:1/840: chown da/df9/c10a 356141 1 2024-03-19T06:05:44.235 INFO:tasks.workunit.client.1.smithi172.stdout:9/800: creat d1/d7/dc/dbe/d65/f112 x:0 0 0 2024-03-19T06:05:44.238 INFO:tasks.workunit.client.0.smithi072.stdout:7/70: dwrite d2/d3/fe [0,4194304] 0 2024-03-19T06:05:44.240 INFO:tasks.workunit.client.1.smithi172.stdout:9/801: write d1/d7/dc/d47/d78/d54/d91/f6f [350389,115537] 0 2024-03-19T06:05:44.241 INFO:tasks.workunit.client.0.smithi072.stdout:4/72: mkdir d5/d1b 0 2024-03-19T06:05:44.242 INFO:tasks.workunit.client.1.smithi172.stdout:9/802: chown d1/d7/dc/d47/d78/f7e 155686092 1 2024-03-19T06:05:44.244 INFO:tasks.workunit.client.0.smithi072.stdout:2/56: mkdir db/d10/d13/d19 0 2024-03-19T06:05:44.246 INFO:tasks.workunit.client.0.smithi072.stdout:9/52: mkdir d11 0 2024-03-19T06:05:44.247 INFO:tasks.workunit.client.1.smithi172.stdout:9/803: readlink d1/d7/dc/d47/da3/l68 0 2024-03-19T06:05:44.249 INFO:tasks.workunit.client.0.smithi072.stdout:9/53: fsync fa 0 2024-03-19T06:05:44.249 INFO:tasks.workunit.client.0.smithi072.stdout:5/273: write df/d13/d32/f30 [2327862,23417] 0 2024-03-19T06:05:44.250 INFO:tasks.workunit.client.1.smithi172.stdout:8/782: link d0/f11 d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3/ff2 0 2024-03-19T06:05:44.254 INFO:tasks.workunit.client.1.smithi172.stdout:3/843: getdents d0/da8/d34/d4d 0 2024-03-19T06:05:44.257 INFO:tasks.workunit.client.1.smithi172.stdout:9/804: chown d1/d7/dc/de/d34/d48/d82/d92/d95/d9e 0 1 2024-03-19T06:05:44.257 INFO:tasks.workunit.client.1.smithi172.stdout:4/871: getdents df/d11/d12 0 2024-03-19T06:05:44.258 INFO:tasks.workunit.client.0.smithi072.stdout:1/62: mkdir d1/d16 0 2024-03-19T06:05:44.258 INFO:tasks.workunit.client.0.smithi072.stdout:8/88: fdatasync da/f11 0 2024-03-19T06:05:44.259 INFO:tasks.workunit.client.0.smithi072.stdout:7/71: mkdir d2/d5/d14 0 2024-03-19T06:05:44.260 INFO:tasks.workunit.client.0.smithi072.stdout:2/57: mknod db/c1a 0 2024-03-19T06:05:44.261 INFO:tasks.workunit.client.1.smithi172.stdout:9/805: readlink d1/lc4 0 2024-03-19T06:05:44.261 INFO:tasks.workunit.client.0.smithi072.stdout:6/50: dwrite d7/d9/fa [0,4194304] 0 2024-03-19T06:05:44.262 INFO:tasks.workunit.client.1.smithi172.stdout:7/810: dwrite d0/d22/d1d/f7b [0,4194304] 0 2024-03-19T06:05:44.263 INFO:tasks.workunit.client.1.smithi172.stdout:5/777: dwrite d5/d1f/fd8 [0,4194304] 0 2024-03-19T06:05:44.265 INFO:tasks.workunit.client.0.smithi072.stdout:5/274: mkdir df/d13/d24/d3d/d43/d4e 0 2024-03-19T06:05:44.268 INFO:tasks.workunit.client.0.smithi072.stdout:2/58: write db/d10/d12/f14 [2412763,119701] 0 2024-03-19T06:05:44.269 INFO:tasks.workunit.client.0.smithi072.stdout:3/86: getdents d2/d3 0 2024-03-19T06:05:44.270 INFO:tasks.workunit.client.1.smithi172.stdout:8/783: rename d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/f86 to d0/d44/ff3 0 2024-03-19T06:05:44.271 INFO:tasks.workunit.client.0.smithi072.stdout:9/54: creat d11/f12 x:0 0 0 2024-03-19T06:05:44.271 INFO:tasks.workunit.client.1.smithi172.stdout:1/841: getdents da/dd/d31/dfb/d14/d27/da7/db7 0 2024-03-19T06:05:44.273 INFO:tasks.workunit.client.1.smithi172.stdout:9/806: symlink d1/d7/dc/de/d34/d48/d82/d92/d95/db4/l113 0 2024-03-19T06:05:44.276 INFO:tasks.workunit.client.1.smithi172.stdout:4/872: symlink df/d2b/d2d/l116 0 2024-03-19T06:05:44.276 INFO:tasks.workunit.client.1.smithi172.stdout:0/815: sync 2024-03-19T06:05:44.276 INFO:tasks.workunit.client.1.smithi172.stdout:2/853: sync 2024-03-19T06:05:44.276 INFO:tasks.workunit.client.1.smithi172.stdout:6/952: sync 2024-03-19T06:05:44.278 INFO:tasks.workunit.client.0.smithi072.stdout:4/73: dwrite d5/d11/f16 [0,4194304] 0 2024-03-19T06:05:44.281 INFO:tasks.workunit.client.1.smithi172.stdout:0/816: fdatasync d11/d18/d38/f8f 0 2024-03-19T06:05:44.285 INFO:tasks.workunit.client.0.smithi072.stdout:1/63: fsync d1/f6 0 2024-03-19T06:05:44.285 INFO:tasks.workunit.client.0.smithi072.stdout:5/275: creat df/d13/d24/f4f x:0 0 0 2024-03-19T06:05:44.288 INFO:tasks.workunit.client.1.smithi172.stdout:8/784: rename d0/d44/dd2/f47 to d0/d44/d46/d49/d26/dbc/ff4 0 2024-03-19T06:05:44.290 INFO:tasks.workunit.client.0.smithi072.stdout:6/51: unlink f4 0 2024-03-19T06:05:44.290 INFO:tasks.workunit.client.0.smithi072.stdout:3/87: mkdir d2/d3/d15 0 2024-03-19T06:05:44.294 INFO:tasks.workunit.client.0.smithi072.stdout:9/55: creat d11/f13 x:0 0 0 2024-03-19T06:05:44.295 INFO:tasks.workunit.client.1.smithi172.stdout:4/873: getdents df/d11/d12/d6e/d112 0 2024-03-19T06:05:44.296 INFO:tasks.workunit.client.1.smithi172.stdout:5/778: read d5/d1f/d2f/d53/feb [470781,102517] 0 2024-03-19T06:05:44.296 INFO:tasks.workunit.client.1.smithi172.stdout:9/807: read d1/d7/dc/dbe/dc9/fda [1303487,42134] 0 2024-03-19T06:05:44.297 INFO:tasks.workunit.client.1.smithi172.stdout:6/953: write d5/d8f/d31/d7b/d7e/f88 [825282,72593] 0 2024-03-19T06:05:44.298 INFO:tasks.workunit.client.1.smithi172.stdout:2/854: creat d7/de/d58/d56/d86/d9e/f116 x:0 0 0 2024-03-19T06:05:44.300 INFO:tasks.workunit.client.0.smithi072.stdout:7/72: symlink d2/d5/d14/l15 0 2024-03-19T06:05:44.301 INFO:tasks.workunit.client.1.smithi172.stdout:8/785: read d0/d61/d6a/f93 [5662107,39132] 0 2024-03-19T06:05:44.302 INFO:tasks.workunit.client.1.smithi172.stdout:7/811: rename d0/d22/d3d/d41/cda to d0/d22/d1d/d85/da8/dfa/c10c 0 2024-03-19T06:05:44.305 INFO:tasks.workunit.client.0.smithi072.stdout:6/52: creat d7/f12 x:0 0 0 2024-03-19T06:05:44.305 INFO:tasks.workunit.client.0.smithi072.stdout:1/64: dwrite d1/d11/f13 [0,4194304] 0 2024-03-19T06:05:44.307 INFO:tasks.workunit.client.0.smithi072.stdout:1/65: chown d1/ld 4 1 2024-03-19T06:05:44.307 INFO:tasks.workunit.client.1.smithi172.stdout:0/817: chown d11/d18/d38/d3f/d43/d89/fc9 1 1 2024-03-19T06:05:44.308 INFO:tasks.workunit.client.0.smithi072.stdout:4/74: mkdir d5/d1b/d1c 0 2024-03-19T06:05:44.309 INFO:tasks.workunit.client.1.smithi172.stdout:8/786: mknod d0/d6f/cf5 0 2024-03-19T06:05:44.310 INFO:tasks.workunit.client.1.smithi172.stdout:9/808: read d1/d7/dc/d47/f61 [812389,127711] 0 2024-03-19T06:05:44.310 INFO:tasks.workunit.client.0.smithi072.stdout:2/59: rmdir db/d10/d13/d19 0 2024-03-19T06:05:44.313 INFO:tasks.workunit.client.0.smithi072.stdout:7/73: mknod d2/d3/c16 0 2024-03-19T06:05:44.313 INFO:tasks.workunit.client.1.smithi172.stdout:7/812: symlink d0/d22/d27/l10d 0 2024-03-19T06:05:44.317 INFO:tasks.workunit.client.1.smithi172.stdout:3/844: dwrite d0/da8/d3a/f86 [0,4194304] 0 2024-03-19T06:05:44.317 INFO:tasks.workunit.client.1.smithi172.stdout:6/954: read d5/d8f/d31/f60 [100287,48866] 0 2024-03-19T06:05:44.319 INFO:tasks.workunit.client.0.smithi072.stdout:6/53: rmdir d7/d9 39 2024-03-19T06:05:44.320 INFO:tasks.workunit.client.0.smithi072.stdout:6/54: chown f3 65806 1 2024-03-19T06:05:44.323 INFO:tasks.workunit.client.0.smithi072.stdout:6/55: read d7/fc [112544,16851] 0 2024-03-19T06:05:44.324 INFO:tasks.workunit.client.0.smithi072.stdout:6/56: chown f3 3825207 1 2024-03-19T06:05:44.325 INFO:tasks.workunit.client.1.smithi172.stdout:7/813: readlink d0/d22/d1d/d3a/d46/l96 0 2024-03-19T06:05:44.325 INFO:tasks.workunit.client.1.smithi172.stdout:9/809: unlink d1/d7/dc/f14 0 2024-03-19T06:05:44.325 INFO:tasks.workunit.client.0.smithi072.stdout:6/57: dread - d7/f12 zero size 2024-03-19T06:05:44.328 INFO:tasks.workunit.client.1.smithi172.stdout:1/842: dwrite da/dd/d31/dfb/fad [0,4194304] 0 2024-03-19T06:05:44.328 INFO:tasks.workunit.client.1.smithi172.stdout:3/845: creat d0/d5/d14/d52/f115 x:0 0 0 2024-03-19T06:05:44.329 INFO:tasks.workunit.client.0.smithi072.stdout:9/56: rename cd to d11/c14 0 2024-03-19T06:05:44.329 INFO:tasks.workunit.client.1.smithi172.stdout:6/955: write d5/d11/d43/d45/f5c [4113027,70546] 0 2024-03-19T06:05:44.329 INFO:tasks.workunit.client.0.smithi072.stdout:1/66: creat d1/d11/f17 x:0 0 0 2024-03-19T06:05:44.330 INFO:tasks.workunit.client.0.smithi072.stdout:9/57: fsync fe 0 2024-03-19T06:05:44.331 INFO:tasks.workunit.client.0.smithi072.stdout:4/75: fdatasync d5/ff 0 2024-03-19T06:05:44.333 INFO:tasks.workunit.client.0.smithi072.stdout:9/58: chown c4 510735974 1 2024-03-19T06:05:44.333 INFO:tasks.workunit.client.0.smithi072.stdout:1/67: truncate d1/f15 925234 0 2024-03-19T06:05:44.334 INFO:tasks.workunit.client.0.smithi072.stdout:2/60: creat db/d10/d12/f1b x:0 0 0 2024-03-19T06:05:44.335 INFO:tasks.workunit.client.0.smithi072.stdout:2/61: readlink db/l11 0 2024-03-19T06:05:44.335 INFO:tasks.workunit.client.0.smithi072.stdout:1/68: truncate d1/f15 1304340 0 2024-03-19T06:05:44.336 INFO:tasks.workunit.client.0.smithi072.stdout:2/62: chown db/d10/d12 16 1 2024-03-19T06:05:44.338 INFO:tasks.workunit.client.0.smithi072.stdout:1/69: read d1/f6 [2640074,29026] 0 2024-03-19T06:05:44.341 INFO:tasks.workunit.client.1.smithi172.stdout:5/779: write d5/d3c/f5a [1094518,64171] 0 2024-03-19T06:05:44.345 INFO:tasks.workunit.client.1.smithi172.stdout:9/810: write d1/d7/dc/de/d34/d48/d89/fdc [4827088,111380] 0 2024-03-19T06:05:44.348 INFO:tasks.workunit.client.1.smithi172.stdout:2/855: getdents d7/de/d58/d56/d86/d9d 0 2024-03-19T06:05:44.349 INFO:tasks.workunit.client.0.smithi072.stdout:6/58: write d7/d9/fa [2602421,128511] 0 2024-03-19T06:05:44.354 INFO:tasks.workunit.client.1.smithi172.stdout:4/874: dwrite df/d11/d12/d21/d50/ff8 [0,4194304] 0 2024-03-19T06:05:44.354 INFO:tasks.workunit.client.1.smithi172.stdout:8/787: dwrite d0/f39 [0,4194304] 0 2024-03-19T06:05:44.355 INFO:tasks.workunit.client.1.smithi172.stdout:6/956: mknod d5/d11/d43/d45/da1/de1/dfa/c138 0 2024-03-19T06:05:44.356 INFO:tasks.workunit.client.0.smithi072.stdout:4/76: fsync f3 0 2024-03-19T06:05:44.359 INFO:tasks.workunit.client.0.smithi072.stdout:9/59: mknod d11/c15 0 2024-03-19T06:05:44.359 INFO:tasks.workunit.client.1.smithi172.stdout:5/780: write d5/f27 [6336401,105225] 0 2024-03-19T06:05:44.364 INFO:tasks.workunit.client.0.smithi072.stdout:5/276: getdents df/d16 0 2024-03-19T06:05:44.368 INFO:tasks.workunit.client.1.smithi172.stdout:5/781: read - d5/d14/d15/d40/d6a/ff6 zero size 2024-03-19T06:05:44.369 INFO:tasks.workunit.client.1.smithi172.stdout:1/843: rename da/d33/d52 to da/dd/d31/dfb/d14/d27/d3f/d5e/dab/d127 0 2024-03-19T06:05:44.370 INFO:tasks.workunit.client.1.smithi172.stdout:2/856: unlink d7/de/d58/d55/da8/f75 0 2024-03-19T06:05:44.370 INFO:tasks.workunit.client.1.smithi172.stdout:7/814: link d0/d22/d4b/cae d0/d22/d1d/d36/c10e 0 2024-03-19T06:05:44.371 INFO:tasks.workunit.client.0.smithi072.stdout:2/63: dwrite db/d10/d12/f1b [0,4194304] 0 2024-03-19T06:05:44.372 INFO:tasks.workunit.client.0.smithi072.stdout:5/277: read fb [202664,23260] 0 2024-03-19T06:05:44.374 INFO:tasks.workunit.client.0.smithi072.stdout:1/70: dwrite d1/f15 [0,4194304] 0 2024-03-19T06:05:44.376 INFO:tasks.workunit.client.0.smithi072.stdout:6/59: symlink d7/d9/l13 0 2024-03-19T06:05:44.379 INFO:tasks.workunit.client.1.smithi172.stdout:1/844: write da/dd/d31/dfb/f23 [5111889,108197] 0 2024-03-19T06:05:44.381 INFO:tasks.workunit.client.1.smithi172.stdout:5/782: mknod d5/c10b 0 2024-03-19T06:05:44.383 INFO:tasks.workunit.client.1.smithi172.stdout:7/815: mkdir d0/d22/d1d/d85/d10f 0 2024-03-19T06:05:44.383 INFO:tasks.workunit.client.1.smithi172.stdout:2/857: read d7/de/d58/d56/d86/f92 [819693,111299] 0 2024-03-19T06:05:44.386 INFO:tasks.workunit.client.1.smithi172.stdout:3/846: dwrite d0/d5/d14/fd9 [0,4194304] 0 2024-03-19T06:05:44.388 INFO:tasks.workunit.client.0.smithi072.stdout:7/74: write d2/d5/f7 [981406,117333] 0 2024-03-19T06:05:44.390 INFO:tasks.workunit.client.0.smithi072.stdout:3/88: dwrite d2/d3/f14 [0,4194304] 0 2024-03-19T06:05:44.391 INFO:tasks.workunit.client.0.smithi072.stdout:9/60: mknod d11/c16 0 2024-03-19T06:05:44.395 INFO:tasks.workunit.client.0.smithi072.stdout:4/77: rename d5/f12 to d5/d1b/f1d 0 2024-03-19T06:05:44.395 INFO:tasks.workunit.client.1.smithi172.stdout:7/816: mkdir d0/d22/d1d/d36/d56/d110 0 2024-03-19T06:05:44.400 INFO:tasks.workunit.client.0.smithi072.stdout:1/71: chown d1/f14 58 1 2024-03-19T06:05:44.400 INFO:tasks.workunit.client.0.smithi072.stdout:5/278: mknod df/d13/d24/c50 0 2024-03-19T06:05:44.401 INFO:tasks.workunit.client.1.smithi172.stdout:2/858: creat d7/db/d2c/d35/f117 x:0 0 0 2024-03-19T06:05:44.404 INFO:tasks.workunit.client.1.smithi172.stdout:8/788: link d0/d44/c7d d0/d44/d46/d49/d26/dc0/d76/dc3/dc9/cf6 0 2024-03-19T06:05:44.408 INFO:tasks.workunit.client.1.smithi172.stdout:6/957: write d5/d11/d17/d1b/f25 [5164522,89213] 0 2024-03-19T06:05:44.408 INFO:tasks.workunit.client.1.smithi172.stdout:5/783: truncate d5/f1d 1765708 0 2024-03-19T06:05:44.409 INFO:tasks.workunit.client.1.smithi172.stdout:2/859: write d7/de/fd3 [588199,6712] 0 2024-03-19T06:05:44.409 INFO:tasks.workunit.client.0.smithi072.stdout:6/60: dread d7/d9/fa [0,4194304] 0 2024-03-19T06:05:44.412 INFO:tasks.workunit.client.1.smithi172.stdout:7/817: unlink d0/d22/d27/ded/f10a 0 2024-03-19T06:05:44.415 INFO:tasks.workunit.client.1.smithi172.stdout:5/784: fdatasync d5/d1f/f101 0 2024-03-19T06:05:44.416 INFO:tasks.workunit.client.1.smithi172.stdout:8/789: unlink d0/d44/d46/d49/d26/d71/f9e 0 2024-03-19T06:05:44.418 INFO:tasks.workunit.client.1.smithi172.stdout:3/847: creat d0/da8/d54/f116 x:0 0 0 2024-03-19T06:05:44.419 INFO:tasks.workunit.client.0.smithi072.stdout:6/61: fdatasync d7/f10 0 2024-03-19T06:05:44.421 INFO:tasks.workunit.client.1.smithi172.stdout:6/958: symlink d5/d11/d43/d45/da1/de1/dfa/l139 0 2024-03-19T06:05:44.423 INFO:tasks.workunit.client.1.smithi172.stdout:9/811: dread d1/d7/dc/de/d34/d48/fa4 [0,4194304] 0 2024-03-19T06:05:44.423 INFO:tasks.workunit.client.1.smithi172.stdout:7/818: creat d0/d22/d27/db0/df8/f111 x:0 0 0 2024-03-19T06:05:44.425 INFO:tasks.workunit.client.0.smithi072.stdout:2/64: dwrite db/d10/d12/f14 [0,4194304] 0 2024-03-19T06:05:44.426 INFO:tasks.workunit.client.1.smithi172.stdout:4/875: dwrite df/d11/d12/d21/d50/f94 [0,4194304] 0 2024-03-19T06:05:44.429 INFO:tasks.workunit.client.0.smithi072.stdout:3/89: mkdir d2/d3/d15/d16 0 2024-03-19T06:05:44.429 INFO:tasks.workunit.client.0.smithi072.stdout:6/62: write f3 [7789669,54957] 0 2024-03-19T06:05:44.432 INFO:tasks.workunit.client.0.smithi072.stdout:5/279: creat df/d13/d32/d45/f51 x:0 0 0 2024-03-19T06:05:44.434 INFO:tasks.workunit.client.1.smithi172.stdout:5/785: read d5/d3c/d6c/f9d [987194,63731] 0 2024-03-19T06:05:44.435 INFO:tasks.workunit.client.0.smithi072.stdout:2/65: read db/d10/d12/f14 [2074718,78898] 0 2024-03-19T06:05:44.435 INFO:tasks.workunit.client.0.smithi072.stdout:7/75: dwrite d2/d5/f7 [0,4194304] 0 2024-03-19T06:05:44.437 INFO:tasks.workunit.client.1.smithi172.stdout:9/812: dread d1/d7/dc/d47/f6a [0,4194304] 0 2024-03-19T06:05:44.439 INFO:tasks.workunit.client.0.smithi072.stdout:9/61: dwrite d11/f13 [0,4194304] 0 2024-03-19T06:05:44.441 INFO:tasks.workunit.client.0.smithi072.stdout:1/72: dread d1/f6 [0,4194304] 0 2024-03-19T06:05:44.442 INFO:tasks.workunit.client.1.smithi172.stdout:9/813: fsync d1/d7/dc/de/d34/d48/fd2 0 2024-03-19T06:05:44.442 INFO:tasks.workunit.client.0.smithi072.stdout:9/62: dread - d11/f12 zero size 2024-03-19T06:05:44.443 INFO:tasks.workunit.client.0.smithi072.stdout:9/63: readlink lf 0 2024-03-19T06:05:44.443 INFO:tasks.workunit.client.0.smithi072.stdout:7/76: mkdir d2/d3/d17 0 2024-03-19T06:05:44.445 INFO:tasks.workunit.client.1.smithi172.stdout:1/845: dread da/dd/d31/dfb/f23 [0,4194304] 0 2024-03-19T06:05:44.445 INFO:tasks.workunit.client.1.smithi172.stdout:7/819: creat d0/d22/d1d/d36/d56/f112 x:0 0 0 2024-03-19T06:05:44.452 INFO:tasks.workunit.client.0.smithi072.stdout:2/66: creat db/d10/d13/f1c x:0 0 0 2024-03-19T06:05:44.453 INFO:tasks.workunit.client.1.smithi172.stdout:3/848: rmdir d0/da8/d34/dde 0 2024-03-19T06:05:44.454 INFO:tasks.workunit.client.0.smithi072.stdout:5/280: mknod df/d13/d24/d3d/d43/c52 0 2024-03-19T06:05:44.455 INFO:tasks.workunit.client.1.smithi172.stdout:1/846: mknod da/d7a/c128 0 2024-03-19T06:05:44.455 INFO:tasks.workunit.client.1.smithi172.stdout:8/790: getdents d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/dcc 0 2024-03-19T06:05:44.456 INFO:tasks.workunit.client.0.smithi072.stdout:1/73: mkdir d1/d11/d18 0 2024-03-19T06:05:44.457 INFO:tasks.workunit.client.0.smithi072.stdout:5/281: chown df/d13/d24/c27 6463 1 2024-03-19T06:05:44.457 INFO:tasks.workunit.client.0.smithi072.stdout:2/67: truncate db/d10/d12/f1b 4675614 0 2024-03-19T06:05:44.460 INFO:tasks.workunit.client.1.smithi172.stdout:2/860: link d7/db/d2c/l8e d7/db/d2c/d35/l118 0 2024-03-19T06:05:44.460 INFO:tasks.workunit.client.0.smithi072.stdout:1/74: truncate d1/f6 4426495 0 2024-03-19T06:05:44.460 INFO:tasks.workunit.client.0.smithi072.stdout:9/64: creat d11/f17 x:0 0 0 2024-03-19T06:05:44.460 INFO:tasks.workunit.client.0.smithi072.stdout:4/78: write d5/f9 [91931,128751] 0 2024-03-19T06:05:44.462 INFO:tasks.workunit.client.0.smithi072.stdout:9/65: stat d11 0 2024-03-19T06:05:44.464 INFO:tasks.workunit.client.0.smithi072.stdout:3/90: write f1 [124513,74421] 0 2024-03-19T06:05:44.464 INFO:tasks.workunit.client.0.smithi072.stdout:1/75: read d1/f15 [54816,55037] 0 2024-03-19T06:05:44.464 INFO:tasks.workunit.client.0.smithi072.stdout:6/63: link d7/d9/le d7/d9/l14 0 2024-03-19T06:05:44.465 INFO:tasks.workunit.client.1.smithi172.stdout:8/791: creat d0/d64/ff7 x:0 0 0 2024-03-19T06:05:44.468 INFO:tasks.workunit.client.1.smithi172.stdout:2/861: fdatasync d7/de/d58/d55/d6e/fad 0 2024-03-19T06:05:44.469 INFO:tasks.workunit.client.1.smithi172.stdout:5/786: getdents d5/d3d/dd6 0 2024-03-19T06:05:44.470 INFO:tasks.workunit.client.0.smithi072.stdout:4/79: symlink d5/d1b/d1c/l1e 0 2024-03-19T06:05:44.471 INFO:tasks.workunit.client.0.smithi072.stdout:9/66: write d11/f12 [701690,86455] 0 2024-03-19T06:05:44.476 INFO:tasks.workunit.client.1.smithi172.stdout:4/876: dwrite df/d11/d12/d21/d50/f94 [4194304,4194304] 0 2024-03-19T06:05:44.476 INFO:tasks.workunit.client.0.smithi072.stdout:1/76: mkdir d1/d11/d18/d19 0 2024-03-19T06:05:44.477 INFO:tasks.workunit.client.0.smithi072.stdout:7/77: dwrite d2/d3/fd [0,4194304] 0 2024-03-19T06:05:44.478 INFO:tasks.workunit.client.0.smithi072.stdout:3/91: symlink d2/d3/d15/l17 0 2024-03-19T06:05:44.479 INFO:tasks.workunit.client.0.smithi072.stdout:9/67: mknod d11/c18 0 2024-03-19T06:05:44.480 INFO:tasks.workunit.client.1.smithi172.stdout:8/792: chown d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/d8c/f9a 401814265 1 2024-03-19T06:05:44.481 INFO:tasks.workunit.client.0.smithi072.stdout:4/80: symlink d5/d1b/d1c/l1f 0 2024-03-19T06:05:44.481 INFO:tasks.workunit.client.0.smithi072.stdout:7/78: chown d2/d3 59658086 1 2024-03-19T06:05:44.482 INFO:tasks.workunit.client.0.smithi072.stdout:1/77: write d1/d11/f17 [576215,42385] 0 2024-03-19T06:05:44.484 INFO:tasks.workunit.client.0.smithi072.stdout:9/68: creat d11/f19 x:0 0 0 2024-03-19T06:05:44.487 INFO:tasks.workunit.client.0.smithi072.stdout:7/79: mkdir d2/d3/d18 0 2024-03-19T06:05:44.487 INFO:tasks.workunit.client.1.smithi172.stdout:4/877: readlink df/d11/d12/d26/d84/da2/lf9 0 2024-03-19T06:05:44.487 INFO:tasks.workunit.client.1.smithi172.stdout:8/793: dread - d0/d44/d46/d49/d4f/fc4 zero size 2024-03-19T06:05:44.490 INFO:tasks.workunit.client.0.smithi072.stdout:9/69: unlink l7 0 2024-03-19T06:05:44.493 INFO:tasks.workunit.client.0.smithi072.stdout:7/80: truncate d2/d5/f6 2586936 0 2024-03-19T06:05:44.493 INFO:tasks.workunit.client.0.smithi072.stdout:6/64: dwrite d7/f11 [0,4194304] 0 2024-03-19T06:05:44.494 INFO:tasks.workunit.client.0.smithi072.stdout:1/78: unlink d1/d11/f17 0 2024-03-19T06:05:44.498 INFO:tasks.workunit.client.0.smithi072.stdout:6/65: rmdir d7 39 2024-03-19T06:05:44.500 INFO:tasks.workunit.client.1.smithi172.stdout:0/818: sync 2024-03-19T06:05:44.504 INFO:tasks.workunit.client.1.smithi172.stdout:2/862: dwrite d7/de/d58/d56/d86/d9d/dab/f10b [0,4194304] 0 2024-03-19T06:05:44.504 INFO:tasks.workunit.client.0.smithi072.stdout:7/81: unlink d2/d3/c16 0 2024-03-19T06:05:44.509 INFO:tasks.workunit.client.0.smithi072.stdout:6/66: readlink d7/d9/l13 0 2024-03-19T06:05:44.509 INFO:tasks.workunit.client.0.smithi072.stdout:5/282: write fb [3501365,75275] 0 2024-03-19T06:05:44.509 INFO:tasks.workunit.client.0.smithi072.stdout:7/82: truncate d2/d5/f7 4478721 0 2024-03-19T06:05:44.512 INFO:tasks.workunit.client.1.smithi172.stdout:4/878: rename df/d11/d12/d21/d58/f5b to df/d45/f117 0 2024-03-19T06:05:44.514 INFO:tasks.workunit.client.1.smithi172.stdout:2/863: fdatasync d7/f15 0 2024-03-19T06:05:44.514 INFO:tasks.workunit.client.1.smithi172.stdout:8/794: dread d0/d44/d46/d49/d26/d71/d81/f56 [0,4194304] 0 2024-03-19T06:05:44.516 INFO:tasks.workunit.client.0.smithi072.stdout:6/67: fdatasync d7/fc 0 2024-03-19T06:05:44.516 INFO:tasks.workunit.client.0.smithi072.stdout:1/79: dwrite d1/f6 [0,4194304] 0 2024-03-19T06:05:44.517 INFO:tasks.workunit.client.1.smithi172.stdout:3/849: dwrite d0/da8/dce/da7/fdb [0,4194304] 0 2024-03-19T06:05:44.521 INFO:tasks.workunit.client.1.smithi172.stdout:7/820: dread d0/d22/fb9 [0,4194304] 0 2024-03-19T06:05:44.526 INFO:tasks.workunit.client.0.smithi072.stdout:9/70: rmdir d11 39 2024-03-19T06:05:44.527 INFO:tasks.workunit.client.1.smithi172.stdout:5/787: dwrite d5/d3d/f5b [0,4194304] 0 2024-03-19T06:05:44.527 INFO:tasks.workunit.client.1.smithi172.stdout:0/819: creat d11/d14/d9a/dea/dab/dc1/dd9/de4/f116 x:0 0 0 2024-03-19T06:05:44.528 INFO:tasks.workunit.client.1.smithi172.stdout:4/879: creat df/d11/d12/d26/d84/f118 x:0 0 0 2024-03-19T06:05:44.528 INFO:tasks.workunit.client.0.smithi072.stdout:4/81: write d5/f13 [838148,7638] 0 2024-03-19T06:05:44.529 INFO:tasks.workunit.client.0.smithi072.stdout:1/80: unlink d1/c9 0 2024-03-19T06:05:44.530 INFO:tasks.workunit.client.0.smithi072.stdout:7/83: dread d2/d3/fe [0,4194304] 0 2024-03-19T06:05:44.531 INFO:tasks.workunit.client.1.smithi172.stdout:3/850: mknod d0/da8/d25/d21/c117 0 2024-03-19T06:05:44.531 INFO:tasks.workunit.client.1.smithi172.stdout:8/795: chown d0/d44/d46/d49/d26/d71/d81/d27/d29/f32 4576618 1 2024-03-19T06:05:44.532 INFO:tasks.workunit.client.1.smithi172.stdout:7/821: creat d0/d22/d1d/f113 x:0 0 0 2024-03-19T06:05:44.535 INFO:tasks.workunit.client.1.smithi172.stdout:2/864: mknod d7/de/d58/d55/d6e/d10d/c119 0 2024-03-19T06:05:44.538 INFO:tasks.workunit.client.0.smithi072.stdout:6/68: dread d7/f11 [0,4194304] 0 2024-03-19T06:05:44.539 INFO:tasks.workunit.client.1.smithi172.stdout:4/880: symlink df/d2b/da3/df5/l119 0 2024-03-19T06:05:44.543 INFO:tasks.workunit.client.0.smithi072.stdout:7/84: mknod d2/c19 0 2024-03-19T06:05:44.549 INFO:tasks.workunit.client.0.smithi072.stdout:3/92: dwrite d2/d3/f10 [4194304,4194304] 0 2024-03-19T06:05:44.549 INFO:tasks.workunit.client.1.smithi172.stdout:0/820: rename d11/d22/ca9 to d11/d14/d9a/dea/c117 0 2024-03-19T06:05:44.550 INFO:tasks.workunit.client.0.smithi072.stdout:1/81: mkdir d1/d11/d18/d19/d1a 0 2024-03-19T06:05:44.550 INFO:tasks.workunit.client.1.smithi172.stdout:8/796: chown d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/fa5 1 1 2024-03-19T06:05:44.550 INFO:tasks.workunit.client.0.smithi072.stdout:7/85: write d2/d3/fd [58696,106864] 0 2024-03-19T06:05:44.551 INFO:tasks.workunit.client.0.smithi072.stdout:6/69: rmdir d7/d9 39 2024-03-19T06:05:44.556 INFO:tasks.workunit.client.1.smithi172.stdout:7/822: dread d0/d22/d27/db0/d92/fb5 [0,4194304] 0 2024-03-19T06:05:44.562 INFO:tasks.workunit.client.0.smithi072.stdout:9/71: dwrite fa [0,4194304] 0 2024-03-19T06:05:44.567 INFO:tasks.workunit.client.0.smithi072.stdout:7/86: creat d2/f1a x:0 0 0 2024-03-19T06:05:44.568 INFO:tasks.workunit.client.0.smithi072.stdout:6/70: creat d7/f15 x:0 0 0 2024-03-19T06:05:44.568 INFO:tasks.workunit.client.1.smithi172.stdout:3/851: dwrite d0/da8/d25/f58 [0,4194304] 0 2024-03-19T06:05:44.570 INFO:tasks.workunit.client.1.smithi172.stdout:2/865: dread d7/db/d2c/fe4 [0,4194304] 0 2024-03-19T06:05:44.572 INFO:tasks.workunit.client.0.smithi072.stdout:5/283: dwrite df/d13/d32/d28/f44 [0,4194304] 0 2024-03-19T06:05:44.572 INFO:tasks.workunit.client.0.smithi072.stdout:4/82: truncate d5/f9 251935 0 2024-03-19T06:05:44.578 INFO:tasks.workunit.client.0.smithi072.stdout:6/71: chown d7/d9/l13 24 1 2024-03-19T06:05:44.590 INFO:tasks.workunit.client.0.smithi072.stdout:7/87: link d2/d5/f6 d2/d13/f1b 0 2024-03-19T06:05:44.592 INFO:tasks.workunit.client.0.smithi072.stdout:9/72: link d11/c16 d11/c1a 0 2024-03-19T06:05:44.593 INFO:tasks.workunit.client.1.smithi172.stdout:3/852: truncate d0/da8/d34/f59 2246676 0 2024-03-19T06:05:44.594 INFO:tasks.workunit.client.1.smithi172.stdout:2/866: dread d7/d4c/d70/f90 [0,4194304] 0 2024-03-19T06:05:44.597 INFO:tasks.workunit.client.0.smithi072.stdout:5/284: unlink df/d16/l21 0 2024-03-19T06:05:44.598 INFO:tasks.workunit.client.0.smithi072.stdout:6/72: symlink d7/l16 0 2024-03-19T06:05:44.601 INFO:tasks.workunit.client.1.smithi172.stdout:6/959: sync 2024-03-19T06:05:44.604 INFO:tasks.workunit.client.0.smithi072.stdout:6/73: symlink d7/d9/l17 0 2024-03-19T06:05:44.607 INFO:tasks.workunit.client.0.smithi072.stdout:3/93: write d2/d3/fc [672780,49938] 0 2024-03-19T06:05:44.614 INFO:tasks.workunit.client.0.smithi072.stdout:6/74: chown d7/d9/le 70939238 1 2024-03-19T06:05:44.615 INFO:tasks.workunit.client.1.smithi172.stdout:2/867: chown d7/de/d58/d55/fcb 673 1 2024-03-19T06:05:44.615 INFO:tasks.workunit.client.1.smithi172.stdout:5/788: truncate d5/f27 1919149 0 2024-03-19T06:05:44.616 INFO:tasks.workunit.client.0.smithi072.stdout:6/75: read f6 [78750,65441] 0 2024-03-19T06:05:44.617 INFO:tasks.workunit.client.1.smithi172.stdout:7/823: dwrite d0/d22/d27/db0/df8/f111 [0,4194304] 0 2024-03-19T06:05:44.617 INFO:tasks.workunit.client.1.smithi172.stdout:6/960: write d5/d11/d17/d36/fe8 [4005919,70599] 0 2024-03-19T06:05:44.617 INFO:tasks.workunit.client.1.smithi172.stdout:8/797: dwrite d0/f1f [0,4194304] 0 2024-03-19T06:05:44.619 INFO:tasks.workunit.client.0.smithi072.stdout:7/88: dwrite d2/f4 [0,4194304] 0 2024-03-19T06:05:44.619 INFO:tasks.workunit.client.0.smithi072.stdout:6/76: chown f3 2 1 2024-03-19T06:05:44.622 INFO:tasks.workunit.client.0.smithi072.stdout:6/77: mknod d7/d9/c18 0 2024-03-19T06:05:44.625 INFO:tasks.workunit.client.1.smithi172.stdout:9/814: dwrite d1/d7/dc/de/d34/d48/f5f [0,4194304] 0 2024-03-19T06:05:44.625 INFO:tasks.workunit.client.1.smithi172.stdout:5/789: chown d5/d55/de9/df7 654 1 2024-03-19T06:05:44.625 INFO:tasks.workunit.client.1.smithi172.stdout:6/961: write d5/d8f/d31/d3d/d98/db6/f109 [473054,118087] 0 2024-03-19T06:05:44.626 INFO:tasks.workunit.client.0.smithi072.stdout:7/89: symlink d2/d3/d18/l1c 0 2024-03-19T06:05:44.628 INFO:tasks.workunit.client.0.smithi072.stdout:7/90: readlink d2/d3/l10 0 2024-03-19T06:05:44.628 INFO:tasks.workunit.client.0.smithi072.stdout:9/73: dwrite fe [4194304,4194304] 0 2024-03-19T06:05:44.631 INFO:tasks.workunit.client.0.smithi072.stdout:3/94: dread f0 [0,4194304] 0 2024-03-19T06:05:44.632 INFO:tasks.workunit.client.1.smithi172.stdout:3/853: fsync d0/f7c 0 2024-03-19T06:05:44.632 INFO:tasks.workunit.client.1.smithi172.stdout:2/868: creat d7/db/d2c/d35/f11a x:0 0 0 2024-03-19T06:05:44.633 INFO:tasks.workunit.client.1.smithi172.stdout:7/824: rmdir d0/d22/d1d/d36/d8d 39 2024-03-19T06:05:44.634 INFO:tasks.workunit.client.0.smithi072.stdout:4/83: write d5/f9 [562966,71987] 0 2024-03-19T06:05:44.638 INFO:tasks.workunit.client.1.smithi172.stdout:4/881: dread df/d11/f1d [0,4194304] 0 2024-03-19T06:05:44.639 INFO:tasks.workunit.client.1.smithi172.stdout:6/962: creat d5/d8f/d31/d84/df3/f13a x:0 0 0 2024-03-19T06:05:44.640 INFO:tasks.workunit.client.0.smithi072.stdout:7/91: mkdir d2/d13/d1d 0 2024-03-19T06:05:44.642 INFO:tasks.workunit.client.1.smithi172.stdout:5/790: fdatasync d5/d55/d91/fb2 0 2024-03-19T06:05:44.643 INFO:tasks.workunit.client.1.smithi172.stdout:0/821: dread d11/d22/f34 [4194304,4194304] 0 2024-03-19T06:05:44.646 INFO:tasks.workunit.client.1.smithi172.stdout:8/798: link d0/d44/d46/d49/d26/d71/d81/fba d0/d61/d6e/ff8 0 2024-03-19T06:05:44.649 INFO:tasks.workunit.client.0.smithi072.stdout:9/74: dread d11/f12 [0,4194304] 0 2024-03-19T06:05:44.650 INFO:tasks.workunit.client.1.smithi172.stdout:8/799: readlink d0/le 0 2024-03-19T06:05:44.651 INFO:tasks.workunit.client.1.smithi172.stdout:9/815: mkdir d1/d7/dc/dbe/d114 0 2024-03-19T06:05:44.655 INFO:tasks.workunit.client.1.smithi172.stdout:4/882: write df/d11/d12/d21/d50/fac [804575,13357] 0 2024-03-19T06:05:44.657 INFO:tasks.workunit.client.0.smithi072.stdout:4/84: unlink f3 0 2024-03-19T06:05:44.658 INFO:tasks.workunit.client.1.smithi172.stdout:7/825: rename d0/d22/d1d/d3a/d6b to d0/d22/d27/ded/d114 0 2024-03-19T06:05:44.658 INFO:tasks.workunit.client.1.smithi172.stdout:4/883: chown df/d2b/d44/d67/ff2 78 1 2024-03-19T06:05:44.659 INFO:tasks.workunit.client.0.smithi072.stdout:7/92: unlink d2/d3/fe 0 2024-03-19T06:05:44.659 INFO:tasks.workunit.client.0.smithi072.stdout:6/78: dwrite d7/f10 [0,4194304] 0 2024-03-19T06:05:44.661 INFO:tasks.workunit.client.1.smithi172.stdout:0/822: creat d11/d14/d9a/dea/dab/dc1/f118 x:0 0 0 2024-03-19T06:05:44.661 INFO:tasks.workunit.client.0.smithi072.stdout:9/75: rmdir d11 39 2024-03-19T06:05:44.665 INFO:tasks.workunit.client.0.smithi072.stdout:3/95: rmdir d2/d3/d15/d16 0 2024-03-19T06:05:44.665 INFO:tasks.workunit.client.1.smithi172.stdout:8/800: mknod d0/d61/d6a/d98/cf9 0 2024-03-19T06:05:44.666 INFO:tasks.workunit.client.0.smithi072.stdout:6/79: truncate d7/d9/ff 373621 0 2024-03-19T06:05:44.666 INFO:tasks.workunit.client.0.smithi072.stdout:5/285: dwrite df/d13/d32/d28/f37 [0,4194304] 0 2024-03-19T06:05:44.667 INFO:tasks.workunit.client.0.smithi072.stdout:4/85: readlink d5/l18 0 2024-03-19T06:05:44.669 INFO:tasks.workunit.client.1.smithi172.stdout:8/801: fdatasync d0/d44/d46/d49/d26/dc0/d3d/d83/dee/fc1 0 2024-03-19T06:05:44.674 INFO:tasks.workunit.client.0.smithi072.stdout:4/86: fsync d5/f10 0 2024-03-19T06:05:44.674 INFO:tasks.workunit.client.1.smithi172.stdout:3/854: dread d0/fe [0,4194304] 0 2024-03-19T06:05:44.676 INFO:tasks.workunit.client.0.smithi072.stdout:9/76: creat d11/f1b x:0 0 0 2024-03-19T06:05:44.676 INFO:tasks.workunit.client.0.smithi072.stdout:5/286: rename df/d13/d32/d45 to df/d13/d32/d45/d53 22 2024-03-19T06:05:44.679 INFO:tasks.workunit.client.1.smithi172.stdout:6/963: link d5/f19 d5/d11/d43/d45/da1/f13b 0 2024-03-19T06:05:44.681 INFO:tasks.workunit.client.1.smithi172.stdout:0/823: creat d11/d18/d38/d3f/d43/dc5/f119 x:0 0 0 2024-03-19T06:05:44.682 INFO:tasks.workunit.client.1.smithi172.stdout:9/816: mknod d1/d7/dc/de/c115 0 2024-03-19T06:05:44.689 INFO:tasks.workunit.client.1.smithi172.stdout:8/802: dread d0/f3 [4194304,4194304] 0 2024-03-19T06:05:44.691 INFO:tasks.workunit.client.0.smithi072.stdout:3/96: dread d2/d3/f10 [4194304,4194304] 0 2024-03-19T06:05:44.691 INFO:tasks.workunit.client.1.smithi172.stdout:5/791: rename d5/d55/f63 to d5/d14/d15/d40/d6a/f10c 0 2024-03-19T06:05:44.692 INFO:tasks.workunit.client.1.smithi172.stdout:8/803: readlink d0/le 0 2024-03-19T06:05:44.693 INFO:tasks.workunit.client.1.smithi172.stdout:6/964: mkdir d5/d8f/d31/d3d/d98/db6/d40/d53/d13c 0 2024-03-19T06:05:44.694 INFO:tasks.workunit.client.0.smithi072.stdout:3/97: readlink d2/l7 0 2024-03-19T06:05:44.696 INFO:tasks.workunit.client.0.smithi072.stdout:6/80: dwrite f3 [8388608,4194304] 0 2024-03-19T06:05:44.698 INFO:tasks.workunit.client.1.smithi172.stdout:8/804: dread - d0/d44/dd2/da2/fe2 zero size 2024-03-19T06:05:44.698 INFO:tasks.workunit.client.1.smithi172.stdout:9/817: rmdir d1/d7/dc/de/d34 39 2024-03-19T06:05:44.698 INFO:tasks.workunit.client.1.smithi172.stdout:7/826: dwrite d0/d22/d1d/d36/d56/fea [0,4194304] 0 2024-03-19T06:05:44.699 INFO:tasks.workunit.client.0.smithi072.stdout:5/287: dread df/d14/f15 [0,4194304] 0 2024-03-19T06:05:44.703 INFO:tasks.workunit.client.0.smithi072.stdout:6/81: symlink d7/l19 0 2024-03-19T06:05:44.705 INFO:tasks.workunit.client.0.smithi072.stdout:5/288: chown df/l10 1492 1 2024-03-19T06:05:44.706 INFO:tasks.workunit.client.0.smithi072.stdout:6/82: creat d7/d9/f1a x:0 0 0 2024-03-19T06:05:44.707 INFO:tasks.workunit.client.1.smithi172.stdout:9/818: read d1/d7/dc/d47/f53 [4042979,26398] 0 2024-03-19T06:05:44.709 INFO:tasks.workunit.client.1.smithi172.stdout:5/792: mkdir d5/d3d/d60/d10d 0 2024-03-19T06:05:44.710 INFO:tasks.workunit.client.0.smithi072.stdout:5/289: chown df/d16/f36 15894 1 2024-03-19T06:05:44.710 INFO:tasks.workunit.client.1.smithi172.stdout:6/965: mkdir d5/d11/d17/d36/dca/d13d 0 2024-03-19T06:05:44.711 INFO:tasks.workunit.client.0.smithi072.stdout:3/98: getdents d2/d3 0 2024-03-19T06:05:44.712 INFO:tasks.workunit.client.1.smithi172.stdout:2/869: truncate d7/de/d58/d55/d6e/fdc 55483 0 2024-03-19T06:05:44.715 INFO:tasks.workunit.client.1.smithi172.stdout:8/805: creat d0/d64/ffa x:0 0 0 2024-03-19T06:05:44.715 INFO:tasks.workunit.client.1.smithi172.stdout:1/847: dread da/dd/d31/dfb/d14/d27/f93 [0,4194304] 0 2024-03-19T06:05:44.718 INFO:tasks.workunit.client.1.smithi172.stdout:7/827: mkdir d0/d22/d3d/d41/d115 0 2024-03-19T06:05:44.719 INFO:tasks.workunit.client.0.smithi072.stdout:4/87: dread d5/f9 [0,4194304] 0 2024-03-19T06:05:44.719 INFO:tasks.workunit.client.0.smithi072.stdout:9/77: rmdir d11 39 2024-03-19T06:05:44.719 INFO:tasks.workunit.client.1.smithi172.stdout:7/828: fsync d0/d22/d1d/fcd 0 2024-03-19T06:05:44.726 INFO:tasks.workunit.client.1.smithi172.stdout:2/870: rename d7/de/d58/d56/f46 to d7/de/d58/d56/d89/f11b 0 2024-03-19T06:05:44.727 INFO:tasks.workunit.client.0.smithi072.stdout:9/78: stat c8 0 2024-03-19T06:05:44.732 INFO:tasks.workunit.client.0.smithi072.stdout:4/88: dread d5/f9 [0,4194304] 0 2024-03-19T06:05:44.732 INFO:tasks.workunit.client.0.smithi072.stdout:7/93: dwrite d2/d13/f1b [0,4194304] 0 2024-03-19T06:05:44.734 INFO:tasks.workunit.client.1.smithi172.stdout:7/829: unlink d0/d22/d1d/d85/da8/fac 0 2024-03-19T06:05:44.735 INFO:tasks.workunit.client.0.smithi072.stdout:9/79: mknod d11/c1c 0 2024-03-19T06:05:44.738 INFO:tasks.workunit.client.0.smithi072.stdout:9/80: readlink lb 0 2024-03-19T06:05:44.740 INFO:tasks.workunit.client.0.smithi072.stdout:4/89: write d5/f9 [1306180,65369] 0 2024-03-19T06:05:44.741 INFO:tasks.workunit.client.0.smithi072.stdout:9/81: read fe [2573405,89426] 0 2024-03-19T06:05:44.742 INFO:tasks.workunit.client.1.smithi172.stdout:7/830: chown d0/d22/d1d/d36/d40/f4e 15814 1 2024-03-19T06:05:44.743 INFO:tasks.workunit.client.0.smithi072.stdout:5/290: dwrite df/d13/d32/f30 [0,4194304] 0 2024-03-19T06:05:44.744 INFO:tasks.workunit.client.0.smithi072.stdout:3/99: truncate d2/f5 3998696 0 2024-03-19T06:05:44.745 INFO:tasks.workunit.client.1.smithi172.stdout:5/793: dwrite d5/ff [4194304,4194304] 0 2024-03-19T06:05:44.745 INFO:tasks.workunit.client.1.smithi172.stdout:2/871: creat d7/de/d58/d56/d86/d9d/f11c x:0 0 0 2024-03-19T06:05:44.749 INFO:tasks.workunit.client.0.smithi072.stdout:5/291: mkdir df/d54 0 2024-03-19T06:05:44.752 INFO:tasks.workunit.client.0.smithi072.stdout:7/94: dread d2/d5/f6 [0,4194304] 0 2024-03-19T06:05:44.753 INFO:tasks.workunit.client.1.smithi172.stdout:5/794: write d5/d3c/f5a [319690,11343] 0 2024-03-19T06:05:44.754 INFO:tasks.workunit.client.0.smithi072.stdout:4/90: unlink l1 0 2024-03-19T06:05:44.756 INFO:tasks.workunit.client.1.smithi172.stdout:7/831: read d0/d22/d1d/d36/d8d/f63 [358101,14050] 0 2024-03-19T06:05:44.756 INFO:tasks.workunit.client.0.smithi072.stdout:7/95: symlink d2/d5/l1e 0 2024-03-19T06:05:44.757 INFO:tasks.workunit.client.1.smithi172.stdout:4/884: dread df/d11/d12/d26/f43 [0,4194304] 0 2024-03-19T06:05:44.761 INFO:tasks.workunit.client.0.smithi072.stdout:4/91: creat d5/d1b/f20 x:0 0 0 2024-03-19T06:05:44.761 INFO:tasks.workunit.client.0.smithi072.stdout:7/96: mknod d2/d13/c1f 0 2024-03-19T06:05:44.763 INFO:tasks.workunit.client.1.smithi172.stdout:6/966: write d5/d8f/d31/d7b/fa5 [1140761,33827] 0 2024-03-19T06:05:44.765 INFO:tasks.workunit.client.1.smithi172.stdout:5/795: fsync d5/d55/de7/f10a 0 2024-03-19T06:05:44.765 INFO:tasks.workunit.client.1.smithi172.stdout:8/806: write d0/d44/d46/d49/d26/dc0/d3d/d83/dee/fd6 [3491766,95679] 0 2024-03-19T06:05:44.767 INFO:tasks.workunit.client.0.smithi072.stdout:7/97: mkdir d2/d3/d18/d20 0 2024-03-19T06:05:44.770 INFO:tasks.workunit.client.1.smithi172.stdout:4/885: chown df/d11/d12/d26/d84/f10a 60 1 2024-03-19T06:05:44.771 INFO:tasks.workunit.client.0.smithi072.stdout:4/92: symlink d5/d15/l21 0 2024-03-19T06:05:44.772 INFO:tasks.workunit.client.0.smithi072.stdout:9/82: getdents d11 0 2024-03-19T06:05:44.773 INFO:tasks.workunit.client.0.smithi072.stdout:9/83: chown d11/c1c 7362 1 2024-03-19T06:05:44.773 INFO:tasks.workunit.client.0.smithi072.stdout:9/84: chown c4 881 1 2024-03-19T06:05:44.775 INFO:tasks.workunit.client.1.smithi172.stdout:8/807: fsync d0/d64/ffa 0 2024-03-19T06:05:44.776 INFO:tasks.workunit.client.1.smithi172.stdout:6/967: read - d5/d8f/d31/d3d/d98/db6/d9f/f120 zero size 2024-03-19T06:05:44.776 INFO:tasks.workunit.client.1.smithi172.stdout:1/848: dwrite da/dd/d31/dfb/d14/d84/d9b/f9d [0,4194304] 0 2024-03-19T06:05:44.778 INFO:tasks.workunit.client.1.smithi172.stdout:7/832: truncate d0/d22/d1d/d36/d40/da2/faf 2706828 0 2024-03-19T06:05:44.779 INFO:tasks.workunit.client.1.smithi172.stdout:5/796: truncate d5/d1f/d2f/d62/fcc 143413 0 2024-03-19T06:05:44.779 INFO:tasks.workunit.client.0.smithi072.stdout:4/93: mkdir d5/d15/d22 0 2024-03-19T06:05:44.781 INFO:tasks.workunit.client.1.smithi172.stdout:9/819: dread d1/d7/dc/de/d34/d48/fd2 [0,4194304] 0 2024-03-19T06:05:44.782 INFO:tasks.workunit.client.0.smithi072.stdout:4/94: truncate d5/d11/f1a 60142 0 2024-03-19T06:05:44.784 INFO:tasks.workunit.client.1.smithi172.stdout:6/968: fsync d5/d8f/d31/d3d/d98/db6/d40/d53/d75/df8/f11d 0 2024-03-19T06:05:44.786 INFO:tasks.workunit.client.1.smithi172.stdout:4/886: rename df/d2b/d44/c100 to df/d2b/d2d/d101/dc9/dd2/c11a 0 2024-03-19T06:05:44.792 INFO:tasks.workunit.client.0.smithi072.stdout:7/98: unlink d2/ca 0 2024-03-19T06:05:44.792 INFO:tasks.workunit.client.1.smithi172.stdout:9/820: write d1/d7/dc/de/d34/d48/d82/f88 [4184118,17663] 0 2024-03-19T06:05:44.793 INFO:tasks.workunit.client.1.smithi172.stdout:3/855: dread d0/d5/d6b/dae/d88/fbd [4194304,4194304] 0 2024-03-19T06:05:44.794 INFO:tasks.workunit.client.0.smithi072.stdout:7/99: stat d2/d3/d18 0 2024-03-19T06:05:44.794 INFO:tasks.workunit.client.1.smithi172.stdout:2/872: write d7/de/d58/d55/d6e/da5/fc8 [52481,103079] 0 2024-03-19T06:05:44.795 INFO:tasks.workunit.client.0.smithi072.stdout:9/85: dwrite fa [0,4194304] 0 2024-03-19T06:05:44.799 INFO:tasks.workunit.client.1.smithi172.stdout:4/887: symlink df/d11/d12/d21/d58/d60/l11b 0 2024-03-19T06:05:44.799 INFO:tasks.workunit.client.1.smithi172.stdout:7/833: mkdir d0/d22/d1d/d36/d40/ddb/d116 0 2024-03-19T06:05:44.800 INFO:tasks.workunit.client.0.smithi072.stdout:9/86: truncate d11/f12 1802042 0 2024-03-19T06:05:44.801 INFO:tasks.workunit.client.0.smithi072.stdout:9/87: write d11/f17 [675643,55099] 0 2024-03-19T06:05:44.805 INFO:tasks.workunit.client.0.smithi072.stdout:5/292: dwrite df/d3c/f35 [0,4194304] 0 2024-03-19T06:05:44.809 INFO:tasks.workunit.client.0.smithi072.stdout:9/88: creat d11/f1d x:0 0 0 2024-03-19T06:05:44.814 INFO:tasks.workunit.client.0.smithi072.stdout:7/100: dwrite d2/f4 [0,4194304] 0 2024-03-19T06:05:44.814 INFO:tasks.workunit.client.1.smithi172.stdout:6/969: dwrite d5/d8f/d31/d3d/d98/db6/d40/d53/fd0 [0,4194304] 0 2024-03-19T06:05:44.816 INFO:tasks.workunit.client.1.smithi172.stdout:7/834: getdents d0/d22 0 2024-03-19T06:05:44.817 INFO:tasks.workunit.client.0.smithi072.stdout:9/89: creat d11/f1e x:0 0 0 2024-03-19T06:05:44.822 INFO:tasks.workunit.client.0.smithi072.stdout:9/90: write fa [689066,70433] 0 2024-03-19T06:05:44.825 INFO:tasks.workunit.client.1.smithi172.stdout:0/824: dread d11/d18/d38/d3f/d43/f79 [0,4194304] 0 2024-03-19T06:05:44.825 INFO:tasks.workunit.client.0.smithi072.stdout:7/101: mkdir d2/d5/d21 0 2024-03-19T06:05:44.829 INFO:tasks.workunit.client.1.smithi172.stdout:6/970: chown d5/d8f/d31/d3d/d98/db6/d40/d53/d75/df8/f11d 131616 1 2024-03-19T06:05:44.829 INFO:tasks.workunit.client.0.smithi072.stdout:9/91: mkdir d11/d1f 0 2024-03-19T06:05:44.833 INFO:tasks.workunit.client.1.smithi172.stdout:0/825: write d11/d14/d2c/ffc [482097,23698] 0 2024-03-19T06:05:44.833 INFO:tasks.workunit.client.0.smithi072.stdout:7/102: write d2/f1a [15951,39739] 0 2024-03-19T06:05:44.833 INFO:tasks.workunit.client.0.smithi072.stdout:5/293: dwrite df/d13/d24/f4f [0,4194304] 0 2024-03-19T06:05:44.834 INFO:tasks.workunit.client.1.smithi172.stdout:9/821: dwrite d1/d7/fe9 [0,4194304] 0 2024-03-19T06:05:44.842 INFO:tasks.workunit.client.1.smithi172.stdout:5/797: truncate d5/d3d/f5b 2993405 0 2024-03-19T06:05:44.843 INFO:tasks.workunit.client.1.smithi172.stdout:0/826: unlink ff 0 2024-03-19T06:05:44.843 INFO:tasks.workunit.client.0.smithi072.stdout:5/294: creat df/d13/d32/d28/f55 x:0 0 0 2024-03-19T06:05:44.845 INFO:tasks.workunit.client.0.smithi072.stdout:7/103: mkdir d2/d5/d21/d22 0 2024-03-19T06:05:44.845 INFO:tasks.workunit.client.0.smithi072.stdout:5/295: write fb [688559,59873] 0 2024-03-19T06:05:44.846 INFO:tasks.workunit.client.0.smithi072.stdout:7/104: write d2/d5/f11 [279743,103652] 0 2024-03-19T06:05:44.849 INFO:tasks.workunit.client.1.smithi172.stdout:0/827: fdatasync d11/d14/d2c/d8d/fe8 0 2024-03-19T06:05:44.850 INFO:tasks.workunit.client.1.smithi172.stdout:8/808: dwrite d0/d44/d46/d49/d26/d71/d81/fba [0,4194304] 0 2024-03-19T06:05:44.854 INFO:tasks.workunit.client.1.smithi172.stdout:9/822: symlink d1/d7/dc/dbe/l116 0 2024-03-19T06:05:44.855 INFO:tasks.workunit.client.1.smithi172.stdout:2/873: write d7/de/d58/d57/fa4 [918966,32956] 0 2024-03-19T06:05:44.857 INFO:tasks.workunit.client.1.smithi172.stdout:8/809: unlink d0/l4 0 2024-03-19T06:05:44.858 INFO:tasks.workunit.client.1.smithi172.stdout:9/823: stat d1/d7/dc/d47/da3/l103 0 2024-03-19T06:05:44.859 INFO:tasks.workunit.client.1.smithi172.stdout:0/828: dread - d11/d14/d2c/d36/f4f zero size 2024-03-19T06:05:44.864 INFO:tasks.workunit.client.1.smithi172.stdout:0/829: write d11/d22/d68/f75 [3808308,121509] 0 2024-03-19T06:05:44.865 INFO:tasks.workunit.client.0.smithi072.stdout:4/95: dwrite d5/fa [0,4194304] 0 2024-03-19T06:05:44.867 INFO:tasks.workunit.client.1.smithi172.stdout:3/856: dwrite d0/da8/d34/d4d/fe1 [0,4194304] 0 2024-03-19T06:05:44.868 INFO:tasks.workunit.client.1.smithi172.stdout:8/810: write d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/fa5 [1518830,82837] 0 2024-03-19T06:05:44.873 INFO:tasks.workunit.client.0.smithi072.stdout:4/96: chown d5/f13 38 1 2024-03-19T06:05:44.877 INFO:tasks.workunit.client.1.smithi172.stdout:9/824: mknod d1/d7/dc/de/d34/d48/d82/d92/d95/db4/c117 0 2024-03-19T06:05:44.879 INFO:tasks.workunit.client.1.smithi172.stdout:1/849: dwrite da/dd/d31/dfb/d14/d73/d8b/f94 [0,4194304] 0 2024-03-19T06:05:44.880 INFO:tasks.workunit.client.0.smithi072.stdout:7/105: rmdir d2 39 2024-03-19T06:05:44.881 INFO:tasks.workunit.client.1.smithi172.stdout:3/857: creat d0/da8/d25/f118 x:0 0 0 2024-03-19T06:05:44.884 INFO:tasks.workunit.client.1.smithi172.stdout:8/811: creat d0/d44/d46/d49/d26/dc0/d3d/d83/ffb x:0 0 0 2024-03-19T06:05:44.884 INFO:tasks.workunit.client.1.smithi172.stdout:0/830: symlink d11/d18/d38/d3f/d43/l11a 0 2024-03-19T06:05:44.885 INFO:tasks.workunit.client.0.smithi072.stdout:7/106: truncate d2/d5/f11 1045392 0 2024-03-19T06:05:44.889 INFO:tasks.workunit.client.1.smithi172.stdout:5/798: dwrite d5/d3c/d6c/d9b/fc7 [4194304,4194304] 0 2024-03-19T06:05:44.890 INFO:tasks.workunit.client.0.smithi072.stdout:7/107: rename d2/d13/f1b to d2/d5/d14/f23 0 2024-03-19T06:05:44.891 INFO:tasks.workunit.client.1.smithi172.stdout:9/825: read d1/d7/dc/d47/f6a [49777,27238] 0 2024-03-19T06:05:44.893 INFO:tasks.workunit.client.0.smithi072.stdout:7/108: chown d2/d5/d14/l15 24 1 2024-03-19T06:05:44.894 INFO:tasks.workunit.client.0.smithi072.stdout:4/97: dwrite d5/f13 [0,4194304] 0 2024-03-19T06:05:44.896 INFO:tasks.workunit.client.1.smithi172.stdout:0/831: chown d11/d14/d9a/dea/fa0 3451824 1 2024-03-19T06:05:44.896 INFO:tasks.workunit.client.0.smithi072.stdout:4/98: chown d5/d1b/f1d 228138021 1 2024-03-19T06:05:44.901 INFO:tasks.workunit.client.1.smithi172.stdout:1/850: creat da/d7a/d106/f129 x:0 0 0 2024-03-19T06:05:44.901 INFO:tasks.workunit.client.1.smithi172.stdout:2/874: write d7/de/d58/d57/fd6 [3867371,105197] 0 2024-03-19T06:05:44.904 INFO:tasks.workunit.client.0.smithi072.stdout:4/99: mknod d5/d11/c23 0 2024-03-19T06:05:44.908 INFO:tasks.workunit.client.0.smithi072.stdout:5/296: fsync df/d13/d24/f4f 0 2024-03-19T06:05:44.908 INFO:tasks.workunit.client.1.smithi172.stdout:6/971: dwrite d5/d8f/d31/d3d/d98/df9/fe5 [0,4194304] 0 2024-03-19T06:05:44.914 INFO:tasks.workunit.client.1.smithi172.stdout:1/851: chown da/d3b/f3d 0 1 2024-03-19T06:05:44.916 INFO:tasks.workunit.client.1.smithi172.stdout:7/835: dread d0/d22/d1d/f4c [0,4194304] 0 2024-03-19T06:05:44.922 INFO:tasks.workunit.client.1.smithi172.stdout:7/836: readlink d0/d22/d1d/d36/d8d/d5c/d67/d82/lf2 0 2024-03-19T06:05:44.922 INFO:tasks.workunit.client.0.smithi072.stdout:7/109: dwrite d2/d5/f6 [4194304,4194304] 0 2024-03-19T06:05:44.923 INFO:tasks.workunit.client.1.smithi172.stdout:1/852: mkdir da/dd/d31/dfb/d14/d27/d3f/d5e/d12a 0 2024-03-19T06:05:44.927 INFO:tasks.workunit.client.0.smithi072.stdout:4/100: dwrite d5/f6 [0,4194304] 0 2024-03-19T06:05:44.927 INFO:tasks.workunit.client.1.smithi172.stdout:9/826: dwrite d1/d7/dc/dbe/f105 [0,4194304] 0 2024-03-19T06:05:44.930 INFO:tasks.workunit.client.0.smithi072.stdout:7/110: symlink d2/d13/l24 0 2024-03-19T06:05:44.930 INFO:tasks.workunit.client.1.smithi172.stdout:6/972: symlink d5/d8f/d31/d3d/d98/db6/d40/d53/dc2/d10b/l13e 0 2024-03-19T06:05:44.930 INFO:tasks.workunit.client.1.smithi172.stdout:3/858: dread d0/da8/d25/f1a [0,4194304] 0 2024-03-19T06:05:44.930 INFO:tasks.workunit.client.0.smithi072.stdout:5/297: dwrite df/d3c/f35 [0,4194304] 0 2024-03-19T06:05:44.932 INFO:tasks.workunit.client.1.smithi172.stdout:9/827: dread - d1/d7/dc/def/f109 zero size 2024-03-19T06:05:44.937 INFO:tasks.workunit.client.0.smithi072.stdout:5/298: fdatasync df/d14/f2a 0 2024-03-19T06:05:44.938 INFO:tasks.workunit.client.1.smithi172.stdout:9/828: rename d1/d7/dc to d1/d7/dc/d47/d78/d54/d118 22 2024-03-19T06:05:44.941 INFO:tasks.workunit.client.1.smithi172.stdout:1/853: creat da/dd/d31/dfb/d14/d73/f12b x:0 0 0 2024-03-19T06:05:44.943 INFO:tasks.workunit.client.1.smithi172.stdout:6/973: creat d5/d11/d17/d1b/f13f x:0 0 0 2024-03-19T06:05:44.945 INFO:tasks.workunit.client.0.smithi072.stdout:4/101: getdents d5/d1b 0 2024-03-19T06:05:44.949 INFO:tasks.workunit.client.1.smithi172.stdout:6/974: truncate d5/d11/d43/d45/da1/f121 455513 0 2024-03-19T06:05:44.951 INFO:tasks.workunit.client.0.smithi072.stdout:7/111: dread d2/d3/fd [0,4194304] 0 2024-03-19T06:05:44.952 INFO:tasks.workunit.client.0.smithi072.stdout:5/299: creat df/d13/f56 x:0 0 0 2024-03-19T06:05:44.958 INFO:tasks.workunit.client.1.smithi172.stdout:1/854: rename da/d3b/dcd/ddb/ldc to da/dd/d31/dfb/d14/d27/da7/db7/dca/l12c 0 2024-03-19T06:05:44.959 INFO:tasks.workunit.client.1.smithi172.stdout:9/829: link d1/d7/dc/f5d d1/d7/dc/dbe/d65/f119 0 2024-03-19T06:05:44.960 INFO:tasks.workunit.client.0.smithi072.stdout:7/112: symlink d2/d13/l25 0 2024-03-19T06:05:44.960 INFO:tasks.workunit.client.1.smithi172.stdout:1/855: stat da/dd/d31/dfb/d14/f62 0 2024-03-19T06:05:44.961 INFO:tasks.workunit.client.1.smithi172.stdout:9/830: chown d1/d7/fb6 12943 1 2024-03-19T06:05:44.962 INFO:tasks.workunit.client.1.smithi172.stdout:6/975: symlink d5/d8f/d31/d3d/d95/df0/l140 0 2024-03-19T06:05:44.962 INFO:tasks.workunit.client.0.smithi072.stdout:4/102: dread d5/f13 [0,4194304] 0 2024-03-19T06:05:44.964 INFO:tasks.workunit.client.0.smithi072.stdout:7/113: mkdir d2/d5/d26 0 2024-03-19T06:05:44.964 INFO:tasks.workunit.client.0.smithi072.stdout:7/114: chown d2/d5 128344 1 2024-03-19T06:05:44.966 INFO:tasks.workunit.client.1.smithi172.stdout:1/856: mknod da/d33/d59/dc1/c12d 0 2024-03-19T06:05:44.966 INFO:tasks.workunit.client.1.smithi172.stdout:5/799: write d5/d1f/d2f/fca [173780,36662] 0 2024-03-19T06:05:44.967 INFO:tasks.workunit.client.1.smithi172.stdout:9/831: rmdir d1/d7/dc/de 39 2024-03-19T06:05:44.968 INFO:tasks.workunit.client.1.smithi172.stdout:0/832: truncate d11/d14/d9a/dea/f5a 6408229 0 2024-03-19T06:05:44.970 INFO:tasks.workunit.client.1.smithi172.stdout:7/837: write d0/d22/d1d/d36/d40/fb1 [1538272,4403] 0 2024-03-19T06:05:44.972 INFO:tasks.workunit.client.1.smithi172.stdout:3/859: write d0/da8/d25/d21/fd5 [268441,96447] 0 2024-03-19T06:05:44.978 INFO:tasks.workunit.client.1.smithi172.stdout:8/812: dwrite d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/f5a [0,4194304] 0 2024-03-19T06:05:44.980 INFO:tasks.workunit.client.1.smithi172.stdout:3/860: rmdir d0/d5/d6b/dae/db9 39 2024-03-19T06:05:44.980 INFO:tasks.workunit.client.1.smithi172.stdout:5/800: getdents d5 0 2024-03-19T06:05:44.982 INFO:tasks.workunit.client.0.smithi072.stdout:4/103: dwrite d5/f6 [4194304,4194304] 0 2024-03-19T06:05:44.983 INFO:tasks.workunit.client.0.smithi072.stdout:7/115: dwrite d2/d5/d14/f23 [0,4194304] 0 2024-03-19T06:05:44.983 INFO:tasks.workunit.client.1.smithi172.stdout:8/813: dread - d0/d61/d6a/d9f/fd8 zero size 2024-03-19T06:05:44.985 INFO:tasks.workunit.client.1.smithi172.stdout:5/801: stat d5/d14/f7b 0 2024-03-19T06:05:44.985 INFO:tasks.workunit.client.0.smithi072.stdout:4/104: write d5/d11/f1a [855699,130875] 0 2024-03-19T06:05:44.986 INFO:tasks.workunit.client.0.smithi072.stdout:7/116: read d2/f1a [39301,8092] 0 2024-03-19T06:05:44.988 INFO:tasks.workunit.client.1.smithi172.stdout:7/838: rename d0/d22/d1d/d36/lb6 to d0/d22/d1d/d85/d10f/l117 0 2024-03-19T06:05:44.988 INFO:tasks.workunit.client.0.smithi072.stdout:7/117: chown d2/d5/f7 1060 1 2024-03-19T06:05:44.990 INFO:tasks.workunit.client.1.smithi172.stdout:3/861: readlink d0/da8/d60/d67/la9 0 2024-03-19T06:05:44.990 INFO:tasks.workunit.client.1.smithi172.stdout:5/802: chown d5/d1f/d2f/d53/fef 694783554 1 2024-03-19T06:05:44.991 INFO:tasks.workunit.client.1.smithi172.stdout:6/976: dwrite d5/d11/d43/f4d [8388608,4194304] 0 2024-03-19T06:05:44.992 INFO:tasks.workunit.client.0.smithi072.stdout:7/118: rename d2 to d2/d5/d21/d22/d27 22 2024-03-19T06:05:44.994 INFO:tasks.workunit.client.1.smithi172.stdout:8/814: chown d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/la8 236688 1 2024-03-19T06:05:44.995 INFO:tasks.workunit.client.0.smithi072.stdout:7/119: write d2/f1a [142057,47312] 0 2024-03-19T06:05:44.997 INFO:tasks.workunit.client.0.smithi072.stdout:7/120: readlink d2/d13/l25 0 2024-03-19T06:05:44.998 INFO:tasks.workunit.client.1.smithi172.stdout:6/977: write d5/fb [3712853,18406] 0 2024-03-19T06:05:44.999 INFO:tasks.workunit.client.1.smithi172.stdout:5/803: mkdir d5/d1f/d10e 0 2024-03-19T06:05:44.999 INFO:tasks.workunit.client.0.smithi072.stdout:7/121: write d2/d5/f7 [3955288,23758] 0 2024-03-19T06:05:45.002 INFO:tasks.workunit.client.0.smithi072.stdout:4/105: dread d5/d11/f16 [0,4194304] 0 2024-03-19T06:05:45.003 INFO:tasks.workunit.client.1.smithi172.stdout:0/833: dwrite f7 [0,4194304] 0 2024-03-19T06:05:45.003 INFO:tasks.workunit.client.1.smithi172.stdout:9/832: dread d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/fa0 [0,4194304] 0 2024-03-19T06:05:45.003 INFO:tasks.workunit.client.1.smithi172.stdout:5/804: dread - d5/d14/d9f/fc6 zero size 2024-03-19T06:05:45.006 INFO:tasks.workunit.client.1.smithi172.stdout:3/862: write d0/d5/d6b/dae/f95 [850738,112540] 0 2024-03-19T06:05:45.006 INFO:tasks.workunit.client.1.smithi172.stdout:1/857: truncate da/dd/d31/dfb/d14/d27/d3f/d5e/dab/d127/f55 26363 0 2024-03-19T06:05:45.010 INFO:tasks.workunit.client.1.smithi172.stdout:7/839: rename d0/d22/d3d/ff6 to d0/d22/d1d/d3a/d46/ddc/f118 0 2024-03-19T06:05:45.012 INFO:tasks.workunit.client.1.smithi172.stdout:9/833: chown d1/d7/dc/de/d34/d48/d82/d92/d95/db4 5324480 1 2024-03-19T06:05:45.015 INFO:tasks.workunit.client.1.smithi172.stdout:0/834: rmdir d11/d14/d9a/dea/dab/dc1 39 2024-03-19T06:05:45.015 INFO:tasks.workunit.client.0.smithi072.stdout:5/300: write df/f26 [667001,106805] 0 2024-03-19T06:05:45.016 INFO:tasks.workunit.client.1.smithi172.stdout:9/834: chown d1/d7/dc/de/c115 0 1 2024-03-19T06:05:45.016 INFO:tasks.workunit.client.1.smithi172.stdout:6/978: readlink d5/d8f/d31/d3d/d98/db6/l47 0 2024-03-19T06:05:45.017 INFO:tasks.workunit.client.0.smithi072.stdout:5/301: fdatasync df/d16/f39 0 2024-03-19T06:05:45.018 INFO:tasks.workunit.client.0.smithi072.stdout:5/302: chown df/d13/d32/d28/d42 113561 1 2024-03-19T06:05:45.020 INFO:tasks.workunit.client.1.smithi172.stdout:3/863: unlink d0/f7c 0 2024-03-19T06:05:45.023 INFO:tasks.workunit.client.1.smithi172.stdout:6/979: dread - d5/d8f/d31/db8/f128 zero size 2024-03-19T06:05:45.025 INFO:tasks.workunit.client.1.smithi172.stdout:8/815: link d0/d44/d46/f60 d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/ffc 0 2024-03-19T06:05:45.025 INFO:tasks.workunit.client.1.smithi172.stdout:7/840: write d0/d22/d1d/d85/da8/fbc [176942,86363] 0 2024-03-19T06:05:45.027 INFO:tasks.workunit.client.1.smithi172.stdout:5/805: creat d5/d1f/f10f x:0 0 0 2024-03-19T06:05:45.028 INFO:tasks.workunit.client.0.smithi072.stdout:4/106: unlink d5/d1b/f20 0 2024-03-19T06:05:45.028 INFO:tasks.workunit.client.1.smithi172.stdout:6/980: write d5/d8f/d31/f103 [2575709,119426] 0 2024-03-19T06:05:45.028 INFO:tasks.workunit.client.1.smithi172.stdout:0/835: symlink d11/d14/d2c/dbf/l11b 0 2024-03-19T06:05:45.031 INFO:tasks.workunit.client.1.smithi172.stdout:0/836: readlink d11/d18/d38/d3f/d43/l56 0 2024-03-19T06:05:45.032 INFO:tasks.workunit.client.1.smithi172.stdout:7/841: write d0/d22/d27/db0/df8/f105 [877028,70472] 0 2024-03-19T06:05:45.033 INFO:tasks.workunit.client.1.smithi172.stdout:8/816: creat d0/d44/dd2/ffd x:0 0 0 2024-03-19T06:05:45.033 INFO:tasks.workunit.client.1.smithi172.stdout:9/835: creat d1/d7/dc/dbe/d65/d10a/f11a x:0 0 0 2024-03-19T06:05:45.035 INFO:tasks.workunit.client.1.smithi172.stdout:2/875: sync 2024-03-19T06:05:45.035 INFO:tasks.workunit.client.1.smithi172.stdout:4/888: sync 2024-03-19T06:05:45.037 INFO:tasks.workunit.client.1.smithi172.stdout:5/806: write d5/d1f/d2f/d53/feb [1610718,71093] 0 2024-03-19T06:05:45.040 INFO:tasks.workunit.client.1.smithi172.stdout:1/858: creat da/dd/d31/dfb/d14/d73/f12e x:0 0 0 2024-03-19T06:05:45.040 INFO:tasks.workunit.client.1.smithi172.stdout:8/817: chown d0/d44/d46/d49/d26/dc0/d3d/ld4 29070 1 2024-03-19T06:05:45.040 INFO:tasks.workunit.client.0.smithi072.stdout:4/107: write d5/f13 [4492478,4844] 0 2024-03-19T06:05:45.041 INFO:tasks.workunit.client.0.smithi072.stdout:4/108: fsync d5/f10 0 2024-03-19T06:05:45.043 INFO:tasks.workunit.client.1.smithi172.stdout:7/842: mknod d0/d22/d1d/d85/da8/d102/c119 0 2024-03-19T06:05:45.047 INFO:tasks.workunit.client.1.smithi172.stdout:0/837: getdents d11/d22/d32/daf/d102 0 2024-03-19T06:05:45.047 INFO:tasks.workunit.client.1.smithi172.stdout:2/876: write d7/d1b/f2a [6201295,99629] 0 2024-03-19T06:05:45.047 INFO:tasks.workunit.client.1.smithi172.stdout:5/807: creat d5/d3c/d6c/d9b/f110 x:0 0 0 2024-03-19T06:05:45.048 INFO:tasks.workunit.client.0.smithi072.stdout:4/109: rename d5/cc to d5/c24 0 2024-03-19T06:05:45.049 INFO:tasks.workunit.client.0.smithi072.stdout:4/110: write d5/fa [3649251,45823] 0 2024-03-19T06:05:45.050 INFO:tasks.workunit.client.1.smithi172.stdout:8/818: mknod d0/d44/d46/d49/d4f/cfe 0 2024-03-19T06:05:45.051 INFO:tasks.workunit.client.0.smithi072.stdout:5/303: dread df/d16/f41 [0,4194304] 0 2024-03-19T06:05:45.051 INFO:tasks.workunit.client.1.smithi172.stdout:2/877: mknod d7/d4c/c11d 0 2024-03-19T06:05:45.053 INFO:tasks.workunit.client.0.smithi072.stdout:5/304: read df/d14/f15 [3008251,60170] 0 2024-03-19T06:05:45.053 INFO:tasks.workunit.client.0.smithi072.stdout:4/111: creat d5/f25 x:0 0 0 2024-03-19T06:05:45.054 INFO:tasks.workunit.client.1.smithi172.stdout:2/878: chown d7 35 1 2024-03-19T06:05:45.054 INFO:tasks.workunit.client.1.smithi172.stdout:5/808: unlink d5/c106 0 2024-03-19T06:05:45.055 INFO:tasks.workunit.client.0.smithi072.stdout:4/112: write d5/f13 [2428449,19149] 0 2024-03-19T06:05:45.056 INFO:tasks.workunit.client.1.smithi172.stdout:6/981: write d5/d8f/f70 [3530876,95969] 0 2024-03-19T06:05:45.057 INFO:tasks.workunit.client.1.smithi172.stdout:8/819: creat d0/d44/dd2/da2/fff x:0 0 0 2024-03-19T06:05:45.058 INFO:tasks.workunit.client.1.smithi172.stdout:2/879: write d7/d1b/f69 [3235344,110429] 0 2024-03-19T06:05:45.069 INFO:tasks.workunit.client.0.smithi072.stdout:5/305: dwrite df/f17 [0,4194304] 0 2024-03-19T06:05:45.070 INFO:tasks.workunit.client.1.smithi172.stdout:8/820: chown d0/d44/d46/d49/d26/dc0/d3d/d83/l97 10999 1 2024-03-19T06:05:45.070 INFO:tasks.workunit.client.1.smithi172.stdout:9/836: truncate d1/d7/dc/de/d34/d48/d82/d92/fc7 310883 0 2024-03-19T06:05:45.071 INFO:tasks.workunit.client.1.smithi172.stdout:2/880: fsync d7/de/d58/d56/d86/d9d/dfb/fd2 0 2024-03-19T06:05:45.072 INFO:tasks.workunit.client.1.smithi172.stdout:4/889: dwrite df/d2b/d2d/d101/dc9/ffb [0,4194304] 0 2024-03-19T06:05:45.075 INFO:tasks.workunit.client.0.smithi072.stdout:5/306: creat df/d13/d24/d3d/f57 x:0 0 0 2024-03-19T06:05:45.079 INFO:tasks.workunit.client.0.smithi072.stdout:4/113: dwrite d5/d11/f16 [0,4194304] 0 2024-03-19T06:05:45.080 INFO:tasks.workunit.client.1.smithi172.stdout:2/881: unlink d7/da6/cc7 0 2024-03-19T06:05:45.081 INFO:tasks.workunit.client.0.smithi072.stdout:4/114: stat d5/d1b/f1d 0 2024-03-19T06:05:45.082 INFO:tasks.workunit.client.1.smithi172.stdout:8/821: mkdir d0/d44/d46/d49/d26/d71/d81/d27/d100 0 2024-03-19T06:05:45.083 INFO:tasks.workunit.client.0.smithi072.stdout:4/115: read d5/fa [588904,129441] 0 2024-03-19T06:05:45.084 INFO:tasks.workunit.client.0.smithi072.stdout:5/307: rename df/d3c/l38 to df/d13/d32/d45/l58 0 2024-03-19T06:05:45.084 INFO:tasks.workunit.client.0.smithi072.stdout:4/116: read - d5/f25 zero size 2024-03-19T06:05:45.088 INFO:tasks.workunit.client.1.smithi172.stdout:3/864: dread d0/da8/d54/d90/f9c [0,4194304] 0 2024-03-19T06:05:45.091 INFO:tasks.workunit.client.0.smithi072.stdout:4/117: creat d5/f26 x:0 0 0 2024-03-19T06:05:45.092 INFO:tasks.workunit.client.1.smithi172.stdout:8/822: unlink d0/fb6 0 2024-03-19T06:05:45.093 INFO:tasks.workunit.client.1.smithi172.stdout:1/859: dwrite da/dd/d31/dfb/d14/d84/f108 [0,4194304] 0 2024-03-19T06:05:45.097 INFO:tasks.workunit.client.0.smithi072.stdout:4/118: creat d5/d15/d22/f27 x:0 0 0 2024-03-19T06:05:45.098 INFO:tasks.workunit.client.1.smithi172.stdout:3/865: write d0/da8/d25/d21/fd5 [623191,85034] 0 2024-03-19T06:05:45.101 INFO:tasks.workunit.client.0.smithi072.stdout:4/119: creat d5/f28 x:0 0 0 2024-03-19T06:05:45.101 INFO:tasks.workunit.client.1.smithi172.stdout:5/809: dread d5/d14/d15/d40/d6a/fbe [0,4194304] 0 2024-03-19T06:05:45.104 INFO:tasks.workunit.client.0.smithi072.stdout:5/308: dwrite df/d13/d24/f4f [0,4194304] 0 2024-03-19T06:05:45.104 INFO:tasks.workunit.client.1.smithi172.stdout:6/982: truncate d5/d11/d17/d36/dca/fcb 2235346 0 2024-03-19T06:05:45.105 INFO:tasks.workunit.client.1.smithi172.stdout:7/843: dread d0/d22/d1d/d36/d56/f79 [0,4194304] 0 2024-03-19T06:05:45.106 INFO:tasks.workunit.client.1.smithi172.stdout:8/823: symlink d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3/l101 0 2024-03-19T06:05:45.106 INFO:tasks.workunit.client.0.smithi072.stdout:5/309: stat df/d13/d32/d28 0 2024-03-19T06:05:45.109 INFO:tasks.workunit.client.1.smithi172.stdout:5/810: creat d5/d14/d34/f111 x:0 0 0 2024-03-19T06:05:45.110 INFO:tasks.workunit.client.1.smithi172.stdout:9/837: dwrite d1/d7/dc/dbe/f101 [0,4194304] 0 2024-03-19T06:05:45.113 INFO:tasks.workunit.client.0.smithi072.stdout:4/120: getdents d5/d1b/d1c 0 2024-03-19T06:05:45.114 INFO:tasks.workunit.client.0.smithi072.stdout:4/121: readlink d5/l18 0 2024-03-19T06:05:45.116 INFO:tasks.workunit.client.0.smithi072.stdout:4/122: write d5/f28 [710681,55591] 0 2024-03-19T06:05:45.116 INFO:tasks.workunit.client.1.smithi172.stdout:3/866: read d0/d5/d6b/dae/d88/fbd [1446312,71414] 0 2024-03-19T06:05:45.119 INFO:tasks.workunit.client.0.smithi072.stdout:4/123: write d5/f26 [139992,130246] 0 2024-03-19T06:05:45.120 INFO:tasks.workunit.client.0.smithi072.stdout:5/310: dread df/d3c/f35 [0,4194304] 0 2024-03-19T06:05:45.123 INFO:tasks.workunit.client.0.smithi072.stdout:4/124: dread - d5/f25 zero size 2024-03-19T06:05:45.124 INFO:tasks.workunit.client.0.smithi072.stdout:5/311: stat df/d14/f2a 0 2024-03-19T06:05:45.130 INFO:tasks.workunit.client.0.smithi072.stdout:4/125: symlink d5/l29 0 2024-03-19T06:05:45.130 INFO:tasks.workunit.client.0.smithi072.stdout:5/312: chown df/l4b 451 1 2024-03-19T06:05:45.133 INFO:tasks.workunit.client.0.smithi072.stdout:4/126: getdents d5/d1b/d1c 0 2024-03-19T06:05:45.136 INFO:tasks.workunit.client.0.smithi072.stdout:5/313: rename df/d13/d24/d3d to df/d13/d32/d28/d42/d59 0 2024-03-19T06:05:45.138 INFO:tasks.workunit.client.0.smithi072.stdout:4/127: write d5/fa [1866552,129964] 0 2024-03-19T06:05:45.141 INFO:tasks.workunit.client.0.smithi072.stdout:4/128: write d5/d1b/f1d [1421670,66733] 0 2024-03-19T06:05:45.144 INFO:tasks.workunit.client.0.smithi072.stdout:4/129: truncate d5/f10 5239736 0 2024-03-19T06:05:45.144 INFO:tasks.workunit.client.0.smithi072.stdout:5/314: rename df/d13/d32/d28/d42/d59/f57 to df/d13/d32/d28/d42/d59/d43/f5a 0 2024-03-19T06:05:45.144 INFO:tasks.workunit.client.0.smithi072.stdout:4/130: fsync d5/f6 0 2024-03-19T06:05:45.146 INFO:tasks.workunit.client.0.smithi072.stdout:4/131: write d5/f9 [1185282,18541] 0 2024-03-19T06:05:45.148 INFO:tasks.workunit.client.0.smithi072.stdout:4/132: read d5/f9 [227536,58398] 0 2024-03-19T06:05:45.148 INFO:tasks.workunit.client.0.smithi072.stdout:5/315: creat df/f5b x:0 0 0 2024-03-19T06:05:45.150 INFO:tasks.workunit.client.0.smithi072.stdout:4/133: mknod d5/d1b/c2a 0 2024-03-19T06:05:45.153 INFO:tasks.workunit.client.0.smithi072.stdout:4/134: creat d5/d1b/f2b x:0 0 0 2024-03-19T06:05:45.154 INFO:tasks.workunit.client.0.smithi072.stdout:5/316: mkdir df/d13/d32/d28/d42/d59/d43/d4e/d5c 0 2024-03-19T06:05:45.158 INFO:tasks.workunit.client.0.smithi072.stdout:5/317: rename df/d13/d32/d45 to df/d14/d5d 0 2024-03-19T06:05:45.159 INFO:tasks.workunit.client.0.smithi072.stdout:5/318: chown c1 40754 1 2024-03-19T06:05:45.168 INFO:tasks.workunit.client.0.smithi072.stdout:4/135: dwrite d5/ff [0,4194304] 0 2024-03-19T06:05:45.171 INFO:tasks.workunit.client.0.smithi072.stdout:5/319: dread df/d13/d32/d28/f37 [0,4194304] 0 2024-03-19T06:05:45.171 INFO:tasks.workunit.client.0.smithi072.stdout:4/136: creat d5/d15/d22/f2c x:0 0 0 2024-03-19T06:05:45.173 INFO:tasks.workunit.client.0.smithi072.stdout:4/137: fsync d5/f6 0 2024-03-19T06:05:45.176 INFO:tasks.workunit.client.0.smithi072.stdout:4/138: mkdir d5/d15/d22/d2d 0 2024-03-19T06:05:45.178 INFO:tasks.workunit.client.0.smithi072.stdout:4/139: chown d5/f9 15464351 1 2024-03-19T06:05:45.182 INFO:tasks.workunit.client.0.smithi072.stdout:4/140: creat d5/d1b/d1c/f2e x:0 0 0 2024-03-19T06:05:45.183 INFO:tasks.workunit.client.0.smithi072.stdout:5/320: dread df/f17 [0,4194304] 0 2024-03-19T06:05:45.185 INFO:tasks.workunit.client.0.smithi072.stdout:4/141: rename d5/f26 to d5/d1b/d1c/f2f 0 2024-03-19T06:05:45.187 INFO:tasks.workunit.client.0.smithi072.stdout:5/321: truncate df/d13/d32/f12 3532313 0 2024-03-19T06:05:45.189 INFO:tasks.workunit.client.0.smithi072.stdout:4/142: link d5/cb d5/c30 0 2024-03-19T06:05:45.190 INFO:tasks.workunit.client.0.smithi072.stdout:4/143: dread - d5/d15/d22/f2c zero size 2024-03-19T06:05:45.190 INFO:tasks.workunit.client.0.smithi072.stdout:5/322: creat df/d13/f5e x:0 0 0 2024-03-19T06:05:45.195 INFO:tasks.workunit.client.0.smithi072.stdout:5/323: rename f7 to df/d13/d32/d28/d42/d59/d43/d4e/d5c/f5f 0 2024-03-19T06:05:45.196 INFO:tasks.workunit.client.0.smithi072.stdout:5/324: write df/d13/f56 [66454,90831] 0 2024-03-19T06:05:45.198 INFO:tasks.workunit.client.0.smithi072.stdout:5/325: chown df/d13/f3e 15659 1 2024-03-19T06:05:45.200 INFO:tasks.workunit.client.0.smithi072.stdout:5/326: creat df/d16/f60 x:0 0 0 2024-03-19T06:05:45.202 INFO:tasks.workunit.client.0.smithi072.stdout:5/327: mkdir df/d16/d61 0 2024-03-19T06:05:45.203 INFO:tasks.workunit.client.0.smithi072.stdout:4/144: dwrite d5/f13 [0,4194304] 0 2024-03-19T06:05:45.205 INFO:tasks.workunit.client.0.smithi072.stdout:5/328: mkdir df/d13/d32/d28/d42/d59/d43/d62 0 2024-03-19T06:05:45.208 INFO:tasks.workunit.client.0.smithi072.stdout:4/145: rename d5/d15/d22/d2d to d5/d15/d31 0 2024-03-19T06:05:45.210 INFO:tasks.workunit.client.0.smithi072.stdout:4/146: mkdir d5/d32 0 2024-03-19T06:05:45.216 INFO:tasks.workunit.client.0.smithi072.stdout:4/147: rename d5/d15/d22/f2c to d5/d1b/f33 0 2024-03-19T06:05:45.220 INFO:tasks.workunit.client.0.smithi072.stdout:4/148: symlink d5/d1b/d1c/l34 0 2024-03-19T06:05:45.224 INFO:tasks.workunit.client.0.smithi072.stdout:5/329: write df/d16/f36 [236336,69080] 0 2024-03-19T06:05:45.226 INFO:tasks.workunit.client.0.smithi072.stdout:5/330: write df/f5b [453201,17037] 0 2024-03-19T06:05:45.232 INFO:tasks.workunit.client.0.smithi072.stdout:5/331: rename df/d13/d24/l4c to df/d13/d32/d28/d42/d59/d43/l63 0 2024-03-19T06:05:45.234 INFO:tasks.workunit.client.0.smithi072.stdout:4/149: dwrite d5/f28 [0,4194304] 0 2024-03-19T06:05:45.235 INFO:tasks.workunit.client.0.smithi072.stdout:4/150: chown d5/d11 1093447 1 2024-03-19T06:05:45.244 INFO:tasks.workunit.client.1.smithi172.stdout:7/844: rmdir d0/d22/d1d/d36/d40/dde 0 2024-03-19T06:05:45.245 INFO:tasks.workunit.client.1.smithi172.stdout:9/838: mknod d1/d7/dc/de/d34/d48/d82/d92/d95/db4/c11b 0 2024-03-19T06:05:45.247 INFO:tasks.workunit.client.1.smithi172.stdout:7/845: read - d0/d22/d4b/fc0 zero size 2024-03-19T06:05:45.247 INFO:tasks.workunit.client.0.smithi072.stdout:5/332: dwrite df/d13/f5e [0,4194304] 0 2024-03-19T06:05:45.249 INFO:tasks.workunit.client.1.smithi172.stdout:5/811: mknod d5/d3d/dd6/c112 0 2024-03-19T06:05:45.251 INFO:tasks.workunit.client.1.smithi172.stdout:1/860: creat da/d33/f12f x:0 0 0 2024-03-19T06:05:45.252 INFO:tasks.workunit.client.1.smithi172.stdout:3/867: creat d0/da8/d60/d67/dfe/f119 x:0 0 0 2024-03-19T06:05:45.254 INFO:tasks.workunit.client.1.smithi172.stdout:9/839: stat d1/d7/dc/de/d34/dd7/f104 0 2024-03-19T06:05:45.256 INFO:tasks.workunit.client.1.smithi172.stdout:1/861: write da/dd/d31/dfb/d14/f11d [1035370,53979] 0 2024-03-19T06:05:45.256 INFO:tasks.workunit.client.0.smithi072.stdout:5/333: creat df/f64 x:0 0 0 2024-03-19T06:05:45.257 INFO:tasks.workunit.client.1.smithi172.stdout:9/840: stat d1/d7/dc/dbe/lc0 0 2024-03-19T06:05:45.258 INFO:tasks.workunit.client.0.smithi072.stdout:4/151: truncate d5/d1b/f1d 2453528 0 2024-03-19T06:05:45.259 INFO:tasks.workunit.client.1.smithi172.stdout:7/846: rename d0/d22/d3d to d0/d22/d1d/d85/da8/dfa/d11a 0 2024-03-19T06:05:45.260 INFO:tasks.workunit.client.0.smithi072.stdout:4/152: stat d5/l17 0 2024-03-19T06:05:45.260 INFO:tasks.workunit.client.1.smithi172.stdout:8/824: dwrite d0/d44/d46/d49/d26/dc0/d3d/d83/dee/fa9 [0,4194304] 0 2024-03-19T06:05:45.260 INFO:tasks.workunit.client.0.smithi072.stdout:5/334: rmdir df/d13 39 2024-03-19T06:05:45.263 INFO:tasks.workunit.client.1.smithi172.stdout:5/812: mkdir d5/d1f/d2f/d53/dde/d113 0 2024-03-19T06:05:45.265 INFO:tasks.workunit.client.1.smithi172.stdout:1/862: truncate da/dd/d31/dfb/d14/d27/d3f/fe1 4622008 0 2024-03-19T06:05:45.266 INFO:tasks.workunit.client.1.smithi172.stdout:9/841: unlink d1/d7/dc/d47/da3/ldf 0 2024-03-19T06:05:45.268 INFO:tasks.workunit.client.0.smithi072.stdout:4/153: rename d5/l29 to d5/l35 0 2024-03-19T06:05:45.268 INFO:tasks.workunit.client.1.smithi172.stdout:8/825: creat d0/d61/f102 x:0 0 0 2024-03-19T06:05:45.268 INFO:tasks.workunit.client.1.smithi172.stdout:5/813: write d5/d55/f5f [4282142,31014] 0 2024-03-19T06:05:45.274 INFO:tasks.workunit.client.0.smithi072.stdout:4/154: rename d5/d11/f16 to d5/d11/f36 0 2024-03-19T06:05:45.275 INFO:tasks.workunit.client.1.smithi172.stdout:2/882: dread d7/de/d58/d56/d89/de6/f65 [0,4194304] 0 2024-03-19T06:05:45.275 INFO:tasks.workunit.client.1.smithi172.stdout:8/826: fsync d0/d61/d6a/d7e/f7f 0 2024-03-19T06:05:45.276 INFO:tasks.workunit.client.1.smithi172.stdout:1/863: mkdir da/dd/d31/dfb/d14/d27/d3f/d5e/dab/d130 0 2024-03-19T06:05:45.277 INFO:tasks.workunit.client.1.smithi172.stdout:5/814: mkdir d5/d55/de9/d114 0 2024-03-19T06:05:45.280 INFO:tasks.workunit.client.1.smithi172.stdout:2/883: readlink d7/de/l12 0 2024-03-19T06:05:45.281 INFO:tasks.workunit.client.1.smithi172.stdout:8/827: chown d0/d44/d46/d49/d4f/c74 116470 1 2024-03-19T06:05:45.283 INFO:tasks.workunit.client.1.smithi172.stdout:7/847: chown d0/d22/d4b 608905 1 2024-03-19T06:05:45.283 INFO:tasks.workunit.client.1.smithi172.stdout:3/868: dwrite d0/d5/d14/f17 [4194304,4194304] 0 2024-03-19T06:05:45.288 INFO:tasks.workunit.client.1.smithi172.stdout:7/848: fdatasync d0/d22/fb9 0 2024-03-19T06:05:45.288 INFO:tasks.workunit.client.0.smithi072.stdout:4/155: dwrite d5/f10 [4194304,4194304] 0 2024-03-19T06:05:45.289 INFO:tasks.workunit.client.1.smithi172.stdout:2/884: mknod d7/de/d58/d55/d66/dc1/de1/c11e 0 2024-03-19T06:05:45.292 INFO:tasks.workunit.client.1.smithi172.stdout:4/890: sync 2024-03-19T06:05:45.292 INFO:tasks.workunit.client.1.smithi172.stdout:0/838: sync 2024-03-19T06:05:45.292 INFO:tasks.workunit.client.0.smithi072.stdout:4/156: mkdir d5/d37 0 2024-03-19T06:05:45.295 INFO:tasks.workunit.client.0.smithi072.stdout:4/157: mknod d5/d11/c38 0 2024-03-19T06:05:45.296 INFO:tasks.workunit.client.0.smithi072.stdout:4/158: readlink d5/l18 0 2024-03-19T06:05:45.296 INFO:tasks.workunit.client.0.smithi072.stdout:4/159: fsync d5/f25 0 2024-03-19T06:05:45.300 INFO:tasks.workunit.client.0.smithi072.stdout:4/160: creat d5/d11/f39 x:0 0 0 2024-03-19T06:05:45.304 INFO:tasks.workunit.client.0.smithi072.stdout:4/161: mknod d5/d11/c3a 0 2024-03-19T06:05:45.304 INFO:tasks.workunit.client.1.smithi172.stdout:1/864: truncate da/d33/d4e/d60/f87 546722 0 2024-03-19T06:05:45.307 INFO:tasks.workunit.client.1.smithi172.stdout:1/865: symlink da/df9/l131 0 2024-03-19T06:05:45.315 INFO:tasks.workunit.client.1.smithi172.stdout:9/842: dread d1/d7/dc/d47/d78/f9f [4194304,4194304] 0 2024-03-19T06:05:45.317 INFO:tasks.workunit.client.1.smithi172.stdout:9/843: fsync d1/d7/f2e 0 2024-03-19T06:05:45.320 INFO:tasks.workunit.client.1.smithi172.stdout:1/866: dwrite da/dd/d31/dfb/d14/d27/d3f/fe1 [0,4194304] 0 2024-03-19T06:05:45.321 INFO:tasks.workunit.client.1.smithi172.stdout:4/891: dread df/d11/d12/d21/d50/ff8 [0,4194304] 0 2024-03-19T06:05:45.323 INFO:tasks.workunit.client.1.smithi172.stdout:4/892: write df/d2b/d44/f8e [1098334,51286] 0 2024-03-19T06:05:45.335 INFO:tasks.workunit.client.1.smithi172.stdout:6/983: sync 2024-03-19T06:05:45.392 INFO:tasks.workunit.client.0.smithi072.stdout:4/162: chown d5/d1b/f1d 10024 1 2024-03-19T06:05:45.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/163: chown d5/d1b/d1c/f2e 193320 1 2024-03-19T06:05:45.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/164: chown d5/d11/f36 359294946 1 2024-03-19T06:05:45.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/165: chown d5/d1b/d1c/f2e 25732806 1 2024-03-19T06:05:45.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/166: rename d5/d1b/d1c/l1f to d5/d37/l3b 0 2024-03-19T06:05:45.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/167: creat d5/d15/d31/f3c x:0 0 0 2024-03-19T06:05:45.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/168: truncate d5/d11/f1a 1444364 0 2024-03-19T06:05:45.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/169: mknod d5/d11/c3d 0 2024-03-19T06:05:45.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/170: mknod d5/d32/c3e 0 2024-03-19T06:05:45.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/171: mkdir d5/d15/d3f 0 2024-03-19T06:05:45.434 INFO:tasks.workunit.client.1.smithi172.stdout:7/849: chown d0/d22/d27/db0/d92 21724 1 2024-03-19T06:05:45.434 INFO:tasks.workunit.client.1.smithi172.stdout:8/828: symlink d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/l103 0 2024-03-19T06:05:45.434 INFO:tasks.workunit.client.1.smithi172.stdout:3/869: creat d0/db0/f11a x:0 0 0 2024-03-19T06:05:45.434 INFO:tasks.workunit.client.1.smithi172.stdout:5/815: write d5/d55/d91/ffe [3619938,59737] 0 2024-03-19T06:05:45.434 INFO:tasks.workunit.client.1.smithi172.stdout:6/984: rmdir d5/d8f 39 2024-03-19T06:05:45.434 INFO:tasks.workunit.client.1.smithi172.stdout:2/885: creat d7/db/d2c/d35/de5/d10c/f11f x:0 0 0 2024-03-19T06:05:45.434 INFO:tasks.workunit.client.1.smithi172.stdout:1/867: truncate da/f77 2306131 0 2024-03-19T06:05:45.434 INFO:tasks.workunit.client.1.smithi172.stdout:0/839: write d11/d18/d38/d3f/d43/d62/dc0/fe0 [790840,52708] 0 2024-03-19T06:05:45.434 INFO:tasks.workunit.client.1.smithi172.stdout:2/886: fsync d7/d1b/f33 0 2024-03-19T06:05:45.434 INFO:tasks.workunit.client.1.smithi172.stdout:6/985: unlink d5/d11/d17/c8d 0 2024-03-19T06:05:45.434 INFO:tasks.workunit.client.1.smithi172.stdout:1/868: dread - da/dd/d31/dfb/d14/d84/f116 zero size 2024-03-19T06:05:45.434 INFO:tasks.workunit.client.1.smithi172.stdout:4/893: write df/d45/f117 [1435504,82191] 0 2024-03-19T06:05:45.435 INFO:tasks.workunit.client.1.smithi172.stdout:6/986: fdatasync d5/d8f/ddf/f110 0 2024-03-19T06:05:45.435 INFO:tasks.workunit.client.1.smithi172.stdout:2/887: symlink d7/de/d58/d56/l120 0 2024-03-19T06:05:45.439 INFO:tasks.workunit.client.1.smithi172.stdout:1/869: rmdir da/dd/d31/dfb/d14/d27/da2/dcf 39 2024-03-19T06:05:45.441 INFO:tasks.workunit.client.1.smithi172.stdout:8/829: dwrite d0/d44/d46/d49/d26/d71/d81/d27/d29/fd1 [0,4194304] 0 2024-03-19T06:05:45.442 INFO:tasks.workunit.client.1.smithi172.stdout:3/870: dread d0/da8/d60/d67/f7d [0,4194304] 0 2024-03-19T06:05:45.442 INFO:tasks.workunit.client.1.smithi172.stdout:4/894: chown df/d2b/d44/d93/d102/f103 1860005512 1 2024-03-19T06:05:45.442 INFO:tasks.workunit.client.1.smithi172.stdout:6/987: write d5/d8f/f6b [1816845,119426] 0 2024-03-19T06:05:45.442 INFO:tasks.workunit.client.1.smithi172.stdout:2/888: chown d7/d1b/f22 388 1 2024-03-19T06:05:45.443 INFO:tasks.workunit.client.1.smithi172.stdout:0/840: symlink d11/d18/d38/d3f/d43/d62/l11c 0 2024-03-19T06:05:45.445 INFO:tasks.workunit.client.0.smithi072.stdout:4/172: dwrite d5/f25 [0,4194304] 0 2024-03-19T06:05:45.449 INFO:tasks.workunit.client.0.smithi072.stdout:4/173: symlink d5/d15/l40 0 2024-03-19T06:05:45.456 INFO:tasks.workunit.client.1.smithi172.stdout:2/889: write d7/d1b/f3f [2897855,64355] 0 2024-03-19T06:05:45.456 INFO:tasks.workunit.client.1.smithi172.stdout:9/844: dread d1/d7/dc/de/d34/f45 [0,4194304] 0 2024-03-19T06:05:45.456 INFO:tasks.workunit.client.1.smithi172.stdout:8/830: mknod d0/d44/d46/d49/d26/d71/c104 0 2024-03-19T06:05:45.456 INFO:tasks.workunit.client.1.smithi172.stdout:4/895: fdatasync df/d11/d12/d26/f43 0 2024-03-19T06:05:45.456 INFO:tasks.workunit.client.1.smithi172.stdout:3/871: truncate d0/da8/d60/d67/f110 4617073 0 2024-03-19T06:05:45.459 INFO:tasks.workunit.client.0.smithi072.stdout:4/174: mkdir d5/d15/d22/d41 0 2024-03-19T06:05:45.461 INFO:tasks.workunit.client.1.smithi172.stdout:5/816: dwrite d5/d55/d91/fd3 [4194304,4194304] 0 2024-03-19T06:05:45.461 INFO:tasks.workunit.client.1.smithi172.stdout:1/870: chown da/dd/d31/dfb/d14/d27/d3f/d5e/dab/dde/cf1 0 1 2024-03-19T06:05:45.463 INFO:tasks.workunit.client.1.smithi172.stdout:2/890: creat d7/db/d45/f121 x:0 0 0 2024-03-19T06:05:45.464 INFO:tasks.workunit.client.1.smithi172.stdout:9/845: mkdir d1/d7/dc/de/d34/dd7/d11c 0 2024-03-19T06:05:45.471 INFO:tasks.workunit.client.1.smithi172.stdout:3/872: unlink d0/da8/d60/d67/f73 0 2024-03-19T06:05:45.472 INFO:tasks.workunit.client.1.smithi172.stdout:9/846: creat d1/d7/dc/d47/da5/f11d x:0 0 0 2024-03-19T06:05:45.473 INFO:tasks.workunit.client.1.smithi172.stdout:5/817: creat d5/d14/d48/f115 x:0 0 0 2024-03-19T06:05:45.479 INFO:tasks.workunit.client.1.smithi172.stdout:4/896: link df/d11/d12/d21/d50/d63/fb3 df/d2b/d44/d67/d10e/f11c 0 2024-03-19T06:05:45.481 INFO:tasks.workunit.client.1.smithi172.stdout:2/891: symlink d7/db/d2c/d35/de5/d100/l122 0 2024-03-19T06:05:45.482 INFO:tasks.workunit.client.1.smithi172.stdout:5/818: mknod d5/d55/de9/c116 0 2024-03-19T06:05:45.485 INFO:tasks.workunit.client.1.smithi172.stdout:9/847: symlink d1/d7/dc/dbe/d114/l11e 0 2024-03-19T06:05:45.490 INFO:tasks.workunit.client.1.smithi172.stdout:2/892: truncate d7/d1b/f9c 542636 0 2024-03-19T06:05:45.495 INFO:tasks.workunit.client.1.smithi172.stdout:1/871: dwrite da/df9/f118 [0,4194304] 0 2024-03-19T06:05:45.497 INFO:tasks.workunit.client.1.smithi172.stdout:8/831: dread d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/fa5 [0,4194304] 0 2024-03-19T06:05:45.503 INFO:tasks.workunit.client.1.smithi172.stdout:5/819: rename d5/d1f/d2f/d53/feb to d5/d14/d56/f117 0 2024-03-19T06:05:45.504 INFO:tasks.workunit.client.1.smithi172.stdout:2/893: readlink d7/de/d58/d55/d66/dc1/le9 0 2024-03-19T06:05:45.507 INFO:tasks.workunit.client.1.smithi172.stdout:5/820: chown d5/d14/d34/d66/c9e 74909318 1 2024-03-19T06:05:45.509 INFO:tasks.workunit.client.1.smithi172.stdout:9/848: fdatasync d1/d7/dc/de/d34/d48/d82/d92/fc7 0 2024-03-19T06:05:45.509 INFO:tasks.workunit.client.1.smithi172.stdout:4/897: symlink df/d2b/da3/d115/l11d 0 2024-03-19T06:05:45.514 INFO:tasks.workunit.client.1.smithi172.stdout:6/988: dread d5/d11/d17/d36/d48/f7d [0,4194304] 0 2024-03-19T06:05:45.514 INFO:tasks.workunit.client.1.smithi172.stdout:8/832: dread d0/d44/d46/d49/d26/dbc/fe0 [0,4194304] 0 2024-03-19T06:05:45.514 INFO:tasks.workunit.client.1.smithi172.stdout:3/873: dwrite d0/da8/d54/d77/fac [0,4194304] 0 2024-03-19T06:05:45.515 INFO:tasks.workunit.client.1.smithi172.stdout:2/894: read - d7/de/d58/d56/d81/fff zero size 2024-03-19T06:05:45.517 INFO:tasks.workunit.client.1.smithi172.stdout:0/841: dread d11/d18/d38/f8f [4194304,4194304] 0 2024-03-19T06:05:45.522 INFO:tasks.workunit.client.1.smithi172.stdout:7/850: sync 2024-03-19T06:05:45.522 INFO:tasks.workunit.client.1.smithi172.stdout:9/849: rmdir d1/d7/dc/d47/da3/d7d 39 2024-03-19T06:05:45.523 INFO:tasks.workunit.client.1.smithi172.stdout:2/895: chown d7/de/d58/d56/d86/d9d/d110 0 1 2024-03-19T06:05:45.525 INFO:tasks.workunit.client.1.smithi172.stdout:0/842: symlink d11/d14/d9a/dea/l11d 0 2024-03-19T06:05:45.530 INFO:tasks.workunit.client.1.smithi172.stdout:1/872: dwrite da/dd/d31/d47/dbf/fc0 [0,4194304] 0 2024-03-19T06:05:45.533 INFO:tasks.workunit.client.1.smithi172.stdout:0/843: rmdir d11/d18/d38/d3f/d9f 39 2024-03-19T06:05:45.535 INFO:tasks.workunit.client.1.smithi172.stdout:8/833: read d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/f40 [661371,7073] 0 2024-03-19T06:05:45.536 INFO:tasks.workunit.client.1.smithi172.stdout:6/989: getdents d5/d8f/d31 0 2024-03-19T06:05:45.537 INFO:tasks.workunit.client.1.smithi172.stdout:5/821: dwrite d5/d1f/fb1 [4194304,4194304] 0 2024-03-19T06:05:45.541 INFO:tasks.workunit.client.1.smithi172.stdout:3/874: getdents d0/d5/dfa 0 2024-03-19T06:05:45.545 INFO:tasks.workunit.client.1.smithi172.stdout:7/851: chown d0/d22/d1d/d36/d8d/d5c/d67/d82/lf3 6872843 1 2024-03-19T06:05:45.549 INFO:tasks.workunit.client.1.smithi172.stdout:6/990: chown d5/d8f/f70 262 1 2024-03-19T06:05:45.554 INFO:tasks.workunit.client.1.smithi172.stdout:0/844: truncate d11/d14/d9a/dea/f5a 3858159 0 2024-03-19T06:05:45.554 INFO:tasks.workunit.client.1.smithi172.stdout:9/850: rename d1/d7/dc/de/d34/d48/f107 to d1/d7/dc/de/d34/f11f 0 2024-03-19T06:05:45.558 INFO:tasks.workunit.client.1.smithi172.stdout:2/896: link d7/de/d58/d56/d89/de6/dbc/dc6/f114 d7/de/d58/d56/d86/d9e/f123 0 2024-03-19T06:05:45.559 INFO:tasks.workunit.client.1.smithi172.stdout:0/845: chown d11/d14/d9a/dea/l11d 8754464 1 2024-03-19T06:05:45.560 INFO:tasks.workunit.client.1.smithi172.stdout:7/852: mkdir d0/d22/d1d/d36/d8d/d5c/d11b 0 2024-03-19T06:05:45.561 INFO:tasks.workunit.client.1.smithi172.stdout:6/991: mknod d5/d8f/d31/d3d/d98/db6/d40/d53/dc2/d10b/c141 0 2024-03-19T06:05:45.563 INFO:tasks.workunit.client.1.smithi172.stdout:3/875: rename d0/da8/dce/da7/ceb to d0/da8/d60/df1/c11b 0 2024-03-19T06:05:45.564 INFO:tasks.workunit.client.1.smithi172.stdout:4/898: dread df/d11/d12/d21/d58/f83 [0,4194304] 0 2024-03-19T06:05:45.568 INFO:tasks.workunit.client.1.smithi172.stdout:0/846: creat d11/d14/f11e x:0 0 0 2024-03-19T06:05:45.568 INFO:tasks.workunit.client.1.smithi172.stdout:4/899: rmdir df 39 2024-03-19T06:05:45.569 INFO:tasks.workunit.client.1.smithi172.stdout:9/851: mknod d1/d7/dc/de/d34/d48/d82/d92/d95/db4/c120 0 2024-03-19T06:05:45.570 INFO:tasks.workunit.client.1.smithi172.stdout:1/873: dwrite da/dd/d31/d47/dbf/fc0 [0,4194304] 0 2024-03-19T06:05:45.572 INFO:tasks.workunit.client.1.smithi172.stdout:2/897: creat d7/de/d58/d56/d86/d9d/f124 x:0 0 0 2024-03-19T06:05:45.575 INFO:tasks.workunit.client.1.smithi172.stdout:0/847: write d11/d14/d9a/fbd [1564776,29606] 0 2024-03-19T06:05:45.578 INFO:tasks.workunit.client.1.smithi172.stdout:8/834: dwrite d0/d61/f102 [0,4194304] 0 2024-03-19T06:05:45.578 INFO:tasks.workunit.client.1.smithi172.stdout:7/853: creat d0/d22/d27/db0/f11c x:0 0 0 2024-03-19T06:05:45.579 INFO:tasks.workunit.client.1.smithi172.stdout:5/822: dwrite d5/d14/d15/d40/f99 [0,4194304] 0 2024-03-19T06:05:45.589 INFO:tasks.workunit.client.1.smithi172.stdout:9/852: symlink d1/d7/dc/d47/d78/d54/d91/l121 0 2024-03-19T06:05:45.591 INFO:tasks.workunit.client.1.smithi172.stdout:4/900: readlink df/d11/d12/d26/daf/led 0 2024-03-19T06:05:45.592 INFO:tasks.workunit.client.1.smithi172.stdout:9/853: chown d1/d7/dc/de/d34/dd7 471077300 1 2024-03-19T06:05:45.592 INFO:tasks.workunit.client.1.smithi172.stdout:5/823: rename d5/d3d/lee to d5/d3d/d60/d10d/l118 0 2024-03-19T06:05:45.596 INFO:tasks.workunit.client.1.smithi172.stdout:8/835: mkdir d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3/d105 0 2024-03-19T06:05:45.598 INFO:tasks.workunit.client.1.smithi172.stdout:0/848: mkdir d11/d14/d2c/de7/d11f 0 2024-03-19T06:05:45.600 INFO:tasks.workunit.client.1.smithi172.stdout:3/876: dwrite d0/d5/d6b/f8f [0,4194304] 0 2024-03-19T06:05:45.602 INFO:tasks.workunit.client.1.smithi172.stdout:7/854: link d0/d22/d27/d86/fa1 d0/d22/d1d/dc8/f11d 0 2024-03-19T06:05:45.604 INFO:tasks.workunit.client.1.smithi172.stdout:1/874: dwrite da/d7a/d106/f129 [0,4194304] 0 2024-03-19T06:05:45.621 INFO:tasks.workunit.client.1.smithi172.stdout:7/855: dread - d0/d22/d1d/d85/da8/fe6 zero size 2024-03-19T06:05:45.622 INFO:tasks.workunit.client.1.smithi172.stdout:1/875: rmdir da/d7a/d106 39 2024-03-19T06:05:45.632 INFO:tasks.workunit.client.1.smithi172.stdout:1/876: mkdir da/dd/d31/dfb/d14/d27/d3f/d5e/d132 0 2024-03-19T06:05:45.633 INFO:tasks.workunit.client.1.smithi172.stdout:5/824: dwrite d5/d55/d91/fb2 [4194304,4194304] 0 2024-03-19T06:05:45.636 INFO:tasks.workunit.client.1.smithi172.stdout:8/836: dread d0/d44/d46/d49/d26/f7b [0,4194304] 0 2024-03-19T06:05:45.639 INFO:tasks.workunit.client.1.smithi172.stdout:2/898: dwrite d7/db/f24 [0,4194304] 0 2024-03-19T06:05:45.640 INFO:tasks.workunit.client.1.smithi172.stdout:4/901: dwrite df/d11/d12/d34/dd0/f105 [0,4194304] 0 2024-03-19T06:05:45.643 INFO:tasks.workunit.client.1.smithi172.stdout:1/877: truncate da/dd/d31/dfb/d14/d27/d3f/d5e/fb1 2394509 0 2024-03-19T06:05:45.657 INFO:tasks.workunit.client.1.smithi172.stdout:9/854: creat d1/d7/dc/d47/f122 x:0 0 0 2024-03-19T06:05:45.658 INFO:tasks.workunit.client.1.smithi172.stdout:0/849: mkdir d11/d18/d38/d3f/dbe/d104/d120 0 2024-03-19T06:05:45.659 INFO:tasks.workunit.client.1.smithi172.stdout:3/877: symlink d0/da8/d60/df1/l11c 0 2024-03-19T06:05:45.661 INFO:tasks.workunit.client.1.smithi172.stdout:3/878: write d0/da8/d3a/f86 [1867458,74043] 0 2024-03-19T06:05:45.664 INFO:tasks.workunit.client.1.smithi172.stdout:5/825: chown d5/f58 0 1 2024-03-19T06:05:45.666 INFO:tasks.workunit.client.1.smithi172.stdout:4/902: mknod df/d2b/d2d/d101/dc9/dca/c11e 0 2024-03-19T06:05:45.670 INFO:tasks.workunit.client.1.smithi172.stdout:3/879: symlink d0/da8/d34/d4d/l11d 0 2024-03-19T06:05:45.671 INFO:tasks.workunit.client.1.smithi172.stdout:5/826: mkdir d5/d1f/db4/db9/d119 0 2024-03-19T06:05:45.673 INFO:tasks.workunit.client.1.smithi172.stdout:9/855: truncate d1/d7/dc/dbe/dc9/fe3 299790 0 2024-03-19T06:05:45.677 INFO:tasks.workunit.client.1.smithi172.stdout:5/827: creat d5/d14/d15/d40/d6a/d7a/f11a x:0 0 0 2024-03-19T06:05:45.678 INFO:tasks.workunit.client.1.smithi172.stdout:7/856: rename d0/d22/d1d/d36/lb8 to d0/d22/d1d/d36/d8d/l11e 0 2024-03-19T06:05:45.681 INFO:tasks.workunit.client.1.smithi172.stdout:3/880: symlink d0/d5/d6b/dae/db9/dd7/l11e 0 2024-03-19T06:05:45.682 INFO:tasks.workunit.client.1.smithi172.stdout:9/856: mkdir d1/d7/dc/d47/d78/dfb/d123 0 2024-03-19T06:05:45.682 INFO:tasks.workunit.client.1.smithi172.stdout:0/850: dwrite d11/d18/da5/ff2 [0,4194304] 0 2024-03-19T06:05:45.685 INFO:tasks.workunit.client.1.smithi172.stdout:4/903: dread df/d11/d12/d21/d50/ff8 [0,4194304] 0 2024-03-19T06:05:45.687 INFO:tasks.workunit.client.1.smithi172.stdout:5/828: creat d5/d1f/d2f/d53/dde/d113/f11b x:0 0 0 2024-03-19T06:05:45.688 INFO:tasks.workunit.client.1.smithi172.stdout:3/881: readlink d0/da8/d25/d21/ld1 0 2024-03-19T06:05:45.688 INFO:tasks.workunit.client.1.smithi172.stdout:0/851: dread - d11/d14/d2c/d36/f8c zero size 2024-03-19T06:05:45.691 INFO:tasks.workunit.client.1.smithi172.stdout:4/904: rmdir df/d2b/d44/d93/d102 39 2024-03-19T06:05:45.693 INFO:tasks.workunit.client.1.smithi172.stdout:3/882: symlink d0/da8/d34/d4d/l11f 0 2024-03-19T06:05:45.695 INFO:tasks.workunit.client.1.smithi172.stdout:5/829: creat d5/d14/d9f/f11c x:0 0 0 2024-03-19T06:05:45.696 INFO:tasks.workunit.client.1.smithi172.stdout:0/852: creat d11/d18/da5/dcb/ddb/f121 x:0 0 0 2024-03-19T06:05:45.697 INFO:tasks.workunit.client.1.smithi172.stdout:4/905: mknod df/d11/d12/d26/c11f 0 2024-03-19T06:05:45.698 INFO:tasks.workunit.client.1.smithi172.stdout:5/830: dread - d5/d14/d34/f94 zero size 2024-03-19T06:05:45.702 INFO:tasks.workunit.client.1.smithi172.stdout:5/831: readlink d5/l89 0 2024-03-19T06:05:45.703 INFO:tasks.workunit.client.1.smithi172.stdout:7/857: dwrite d0/d22/d1d/fce [0,4194304] 0 2024-03-19T06:05:45.704 INFO:tasks.workunit.client.1.smithi172.stdout:4/906: symlink df/d2b/d2d/d101/dc9/l120 0 2024-03-19T06:05:45.705 INFO:tasks.workunit.client.1.smithi172.stdout:3/883: link d0/da8/d34/f8b d0/f120 0 2024-03-19T06:05:45.706 INFO:tasks.workunit.client.1.smithi172.stdout:4/907: dread - df/d2b/d2d/f10b zero size 2024-03-19T06:05:45.707 INFO:tasks.workunit.client.1.smithi172.stdout:5/832: chown d5/c44 896 1 2024-03-19T06:05:45.709 INFO:tasks.workunit.client.1.smithi172.stdout:4/908: creat df/d2b/d99/f121 x:0 0 0 2024-03-19T06:05:45.710 INFO:tasks.workunit.client.1.smithi172.stdout:7/858: mkdir d0/d22/d1d/d3a/d11f 0 2024-03-19T06:05:45.714 INFO:tasks.workunit.client.1.smithi172.stdout:7/859: chown d0/d22/d4b/cae 11781684 1 2024-03-19T06:05:45.717 INFO:tasks.workunit.client.1.smithi172.stdout:5/833: dread d5/d14/d56/f8c [0,4194304] 0 2024-03-19T06:05:45.720 INFO:tasks.workunit.client.1.smithi172.stdout:5/834: read d5/d55/f5f [2937903,1735] 0 2024-03-19T06:05:45.720 INFO:tasks.workunit.client.1.smithi172.stdout:2/899: write d7/de/d58/d56/d89/f11b [80073,90936] 0 2024-03-19T06:05:45.721 INFO:tasks.workunit.client.1.smithi172.stdout:2/900: stat d7/c7c 0 2024-03-19T06:05:45.722 INFO:tasks.workunit.client.1.smithi172.stdout:2/901: chown d7 25852 1 2024-03-19T06:05:45.724 INFO:tasks.workunit.client.1.smithi172.stdout:7/860: link d0/d22/d27/db0/f2f d0/d22/d35/f120 0 2024-03-19T06:05:45.725 INFO:tasks.workunit.client.1.smithi172.stdout:2/902: read d7/f15 [1020888,107101] 0 2024-03-19T06:05:45.727 INFO:tasks.workunit.client.1.smithi172.stdout:2/903: fdatasync d7/de/d58/d56/d86/d9d/f11c 0 2024-03-19T06:05:45.729 INFO:tasks.workunit.client.1.smithi172.stdout:2/904: write d7/de/d58/d57/fd4 [191393,83930] 0 2024-03-19T06:05:45.730 INFO:tasks.workunit.client.1.smithi172.stdout:5/835: mkdir d5/d3c/d108/d11d 0 2024-03-19T06:05:45.731 INFO:tasks.workunit.client.1.smithi172.stdout:6/992: sync 2024-03-19T06:05:45.736 INFO:tasks.workunit.client.1.smithi172.stdout:2/905: unlink d7/de/d58/d55/d5f/fc3 0 2024-03-19T06:05:45.737 INFO:tasks.workunit.client.1.smithi172.stdout:5/836: dread - d5/d3c/d6c/da2/faf zero size 2024-03-19T06:05:45.739 INFO:tasks.workunit.client.1.smithi172.stdout:2/906: readlink d7/de/d58/d56/l120 0 2024-03-19T06:05:45.739 INFO:tasks.workunit.client.1.smithi172.stdout:9/857: dwrite d1/d7/dc/d47/d78/d54/f6d [0,4194304] 0 2024-03-19T06:05:45.741 INFO:tasks.workunit.client.1.smithi172.stdout:0/853: dwrite d11/f91 [0,4194304] 0 2024-03-19T06:05:45.744 INFO:tasks.workunit.client.1.smithi172.stdout:5/837: mknod d5/d1f/d2f/d62/c11e 0 2024-03-19T06:05:45.746 INFO:tasks.workunit.client.0.smithi072.stdout:0/39: sync 2024-03-19T06:05:45.747 INFO:tasks.workunit.client.1.smithi172.stdout:5/838: fdatasync d5/d14/d34/f111 0 2024-03-19T06:05:45.748 INFO:tasks.workunit.client.1.smithi172.stdout:2/907: mkdir d7/de/d58/d56/d81/dda/d125 0 2024-03-19T06:05:45.748 INFO:tasks.workunit.client.1.smithi172.stdout:9/858: mknod d1/d7/dc/d47/d78/dfb/c124 0 2024-03-19T06:05:45.754 INFO:tasks.workunit.client.1.smithi172.stdout:5/839: creat d5/d3c/d6c/da2/f11f x:0 0 0 2024-03-19T06:05:45.758 INFO:tasks.workunit.client.1.smithi172.stdout:4/909: dread df/dd7/fe0 [0,4194304] 0 2024-03-19T06:05:45.761 INFO:tasks.workunit.client.1.smithi172.stdout:5/840: dread - d5/d14/d15/d40/d6a/ff6 zero size 2024-03-19T06:05:45.763 INFO:tasks.workunit.client.1.smithi172.stdout:9/859: creat d1/d7/dc/de/d34/dfd/d106/f125 x:0 0 0 2024-03-19T06:05:45.764 INFO:tasks.workunit.client.1.smithi172.stdout:4/910: truncate df/d11/d12/d26/f61 1581361 0 2024-03-19T06:05:45.766 INFO:tasks.workunit.client.1.smithi172.stdout:4/911: creat df/d11/d12/d21/f122 x:0 0 0 2024-03-19T06:05:45.768 INFO:tasks.workunit.client.1.smithi172.stdout:9/860: creat d1/d7/dc/dbe/f126 x:0 0 0 2024-03-19T06:05:45.774 INFO:tasks.workunit.client.0.smithi072.stdout:0/40: write d1/f5 [1657786,73366] 0 2024-03-19T06:05:45.780 INFO:tasks.workunit.client.1.smithi172.stdout:9/861: rename d1/d7/dc/de/f1d to d1/d7/dc/de/d34/d48/d82/d92/d95/db4/de5/f127 0 2024-03-19T06:05:45.780 INFO:tasks.workunit.client.1.smithi172.stdout:6/993: dread d5/d11/d43/d45/f97 [0,4194304] 0 2024-03-19T06:05:45.781 INFO:tasks.workunit.client.0.smithi072.stdout:0/41: creat d1/fa x:0 0 0 2024-03-19T06:05:45.783 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:45 smithi072 ceph-mon[28706]: pgmap v19: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 66 MiB/s rd, 173 MiB/s wr, 363 op/s 2024-03-19T06:05:45.785 INFO:tasks.workunit.client.0.smithi072.stdout:0/42: write d1/f5 [530272,63298] 0 2024-03-19T06:05:45.789 INFO:tasks.workunit.client.0.smithi072.stdout:0/43: creat d1/fb x:0 0 0 2024-03-19T06:05:45.791 INFO:tasks.workunit.client.1.smithi172.stdout:6/994: mknod d5/d11/d43/d45/da1/c142 0 2024-03-19T06:05:45.792 INFO:tasks.workunit.client.1.smithi172.stdout:0/854: dwrite d11/d22/d32/daf/fe2 [0,4194304] 0 2024-03-19T06:05:45.792 INFO:tasks.workunit.client.1.smithi172.stdout:7/861: dread d0/fc5 [0,4194304] 0 2024-03-19T06:05:45.795 INFO:tasks.workunit.client.1.smithi172.stdout:6/995: mknod d5/d8f/d31/c143 0 2024-03-19T06:05:45.796 INFO:tasks.workunit.client.0.smithi072.stdout:0/44: rename d1/l7 to d1/lc 0 2024-03-19T06:05:45.798 INFO:tasks.workunit.client.1.smithi172.stdout:5/841: dread d5/d3c/d6c/dbd/fc4 [0,4194304] 0 2024-03-19T06:05:45.800 INFO:tasks.workunit.client.0.smithi072.stdout:0/45: write d1/f5 [2236871,22443] 0 2024-03-19T06:05:45.800 INFO:tasks.workunit.client.1.smithi172.stdout:7/862: mkdir d0/d22/d1d/d36/d40/da2/d121 0 2024-03-19T06:05:45.801 INFO:tasks.workunit.client.1.smithi172.stdout:0/855: rmdir d11/d22/d46 39 2024-03-19T06:05:45.802 INFO:tasks.workunit.client.1.smithi172.stdout:4/912: dwrite df/d2b/d2d/f8a [0,4194304] 0 2024-03-19T06:05:45.805 INFO:tasks.workunit.client.0.smithi072.stdout:0/46: symlink d1/ld 0 2024-03-19T06:05:45.806 INFO:tasks.workunit.client.1.smithi172.stdout:7/863: mknod d0/d22/d1d/d3a/c122 0 2024-03-19T06:05:45.806 INFO:tasks.workunit.client.0.smithi072.stdout:0/47: truncate d1/fa 731092 0 2024-03-19T06:05:45.810 INFO:tasks.workunit.client.1.smithi172.stdout:9/862: dread d1/d7/dc/de/d34/d48/f70 [0,4194304] 0 2024-03-19T06:05:45.810 INFO:tasks.workunit.client.1.smithi172.stdout:5/842: fsync d5/d1f/db4/db9/fd0 0 2024-03-19T06:05:45.812 INFO:tasks.workunit.client.1.smithi172.stdout:0/856: link d11/d18/d38/d3f/d43/l11a d11/d14/ded/l122 0 2024-03-19T06:05:45.814 INFO:tasks.workunit.client.1.smithi172.stdout:7/864: write d0/d22/d1d/d36/d40/fb1 [894231,81681] 0 2024-03-19T06:05:45.814 INFO:tasks.workunit.client.0.smithi072.stdout:0/48: creat d1/fe x:0 0 0 2024-03-19T06:05:45.820 INFO:tasks.workunit.client.0.smithi072.stdout:0/49: rename d1/ld to d1/lf 0 2024-03-19T06:05:45.822 INFO:tasks.workunit.client.0.smithi072.stdout:0/50: truncate d1/fe 1045048 0 2024-03-19T06:05:45.822 INFO:tasks.workunit.client.0.smithi072.stdout:0/51: fsync d1/f5 0 2024-03-19T06:05:45.823 INFO:tasks.workunit.client.1.smithi172.stdout:5/843: rename d5/d14/d15/d40/d6a/ff6 to d5/d14/d15/f120 0 2024-03-19T06:05:45.825 INFO:tasks.workunit.client.1.smithi172.stdout:6/996: dwrite d5/d11/d17/d1b/d74/fb4 [0,4194304] 0 2024-03-19T06:05:45.825 INFO:tasks.workunit.client.1.smithi172.stdout:5/844: stat d5/d14/d15/d40/d5c/l71 0 2024-03-19T06:05:45.827 INFO:tasks.workunit.client.1.smithi172.stdout:7/865: getdents d0/d22/d1d/d3a/d46/ddc 0 2024-03-19T06:05:45.831 INFO:tasks.workunit.client.1.smithi172.stdout:8/837: sync 2024-03-19T06:05:45.831 INFO:tasks.workunit.client.1.smithi172.stdout:0/857: dread d11/d14/d9a/fbd [0,4194304] 0 2024-03-19T06:05:45.831 INFO:tasks.workunit.client.1.smithi172.stdout:7/866: stat d0/d22/d1d/d36/d8d/d5c/d67/d82 0 2024-03-19T06:05:45.834 INFO:tasks.workunit.client.1.smithi172.stdout:5/845: link d5/d1f/d2f/d62/fcc d5/d14/d56/f121 0 2024-03-19T06:05:45.834 INFO:tasks.workunit.client.0.smithi072.stdout:0/52: rmdir d1 39 2024-03-19T06:05:45.836 INFO:tasks.workunit.client.1.smithi172.stdout:8/838: mknod d0/d44/d46/d49/d26/dc0/d3d/c106 0 2024-03-19T06:05:45.837 INFO:tasks.workunit.client.0.smithi072.stdout:0/53: chown d1/fa 15907 1 2024-03-19T06:05:45.838 INFO:tasks.workunit.client.0.smithi072.stdout:0/54: chown d1/fe 940 1 2024-03-19T06:05:45.841 INFO:tasks.workunit.client.1.smithi172.stdout:4/913: dwrite df/d11/d12/d21/d50/d63/fb3 [0,4194304] 0 2024-03-19T06:05:45.842 INFO:tasks.workunit.client.1.smithi172.stdout:0/858: mkdir d11/d18/d123 0 2024-03-19T06:05:45.845 INFO:tasks.workunit.client.0.smithi072.stdout:0/55: truncate d1/f5 1697693 0 2024-03-19T06:05:45.848 INFO:tasks.workunit.client.1.smithi172.stdout:7/867: getdents d0/d22/d1d/d36/d8d/d5c/d67 0 2024-03-19T06:05:45.852 INFO:tasks.workunit.client.1.smithi172.stdout:5/846: getdents d5/d14/d34 0 2024-03-19T06:05:45.852 INFO:tasks.workunit.client.1.smithi172.stdout:4/914: mknod df/d11/d12/d26/d84/da2/c123 0 2024-03-19T06:05:45.854 INFO:tasks.workunit.client.1.smithi172.stdout:0/859: rename d11/d14/d2c/d36/f4f to d11/d18/d38/d3f/dbe/d104/f124 0 2024-03-19T06:05:45.857 INFO:tasks.workunit.client.1.smithi172.stdout:5/847: unlink d5/d14/l41 0 2024-03-19T06:05:45.858 INFO:tasks.workunit.client.0.smithi072.stdout:0/56: write d1/f5 [491687,97273] 0 2024-03-19T06:05:45.858 INFO:tasks.workunit.client.1.smithi172.stdout:7/868: truncate d0/d22/d1d/d36/d8d/f63 4684306 0 2024-03-19T06:05:45.858 INFO:tasks.workunit.client.1.smithi172.stdout:4/915: mknod df/d2b/d44/c124 0 2024-03-19T06:05:45.859 INFO:tasks.workunit.client.0.smithi072.stdout:0/57: truncate d1/fa 1482165 0 2024-03-19T06:05:45.861 INFO:tasks.workunit.client.0.smithi072.stdout:0/58: dread - d1/fb zero size 2024-03-19T06:05:45.861 INFO:tasks.workunit.client.1.smithi172.stdout:5/848: unlink d5/d14/d15/ca8 0 2024-03-19T06:05:45.862 INFO:tasks.workunit.client.1.smithi172.stdout:4/916: truncate df/d45/f96 989619 0 2024-03-19T06:05:45.864 INFO:tasks.workunit.client.0.smithi072.stdout:0/59: symlink d1/l10 0 2024-03-19T06:05:45.865 INFO:tasks.workunit.client.1.smithi172.stdout:7/869: creat d0/d22/d27/db0/f123 x:0 0 0 2024-03-19T06:05:45.867 INFO:tasks.workunit.client.1.smithi172.stdout:5/849: truncate d5/d55/f5f 396786 0 2024-03-19T06:05:45.867 INFO:tasks.workunit.client.0.smithi072.stdout:0/60: symlink d1/l11 0 2024-03-19T06:05:45.867 INFO:tasks.workunit.client.1.smithi172.stdout:6/997: dread d5/d11/d17/f3e [0,4194304] 0 2024-03-19T06:05:45.868 INFO:tasks.workunit.client.1.smithi172.stdout:0/860: dread - d11/d18/d38/d3f/dbe/d104/f124 zero size 2024-03-19T06:05:45.869 INFO:tasks.workunit.client.1.smithi172.stdout:4/917: truncate df/d2b/f3b 2626772 0 2024-03-19T06:05:45.870 INFO:tasks.workunit.client.1.smithi172.stdout:0/861: chown d11/d18/d38/d3f/d43/d89 4758 1 2024-03-19T06:05:45.872 INFO:tasks.workunit.client.1.smithi172.stdout:4/918: chown df/d2b/d2d/d101/dc9/dca/c11e 2013 1 2024-03-19T06:05:45.873 INFO:tasks.workunit.client.1.smithi172.stdout:0/862: fdatasync d11/d22/d68/fe1 0 2024-03-19T06:05:45.873 INFO:tasks.workunit.client.0.smithi072.stdout:0/61: link d1/l11 d1/l12 0 2024-03-19T06:05:45.874 INFO:tasks.workunit.client.0.smithi072.stdout:0/62: chown l0 67225 1 2024-03-19T06:05:45.875 INFO:tasks.workunit.client.0.smithi072.stdout:0/63: dread - d1/fb zero size 2024-03-19T06:05:45.876 INFO:tasks.workunit.client.1.smithi172.stdout:6/998: chown d5/d8f/d31/d3d/d98/db6/d9f/c132 98290 1 2024-03-19T06:05:45.876 INFO:tasks.workunit.client.1.smithi172.stdout:5/850: getdents d5/d1f/d2f/d62 0 2024-03-19T06:05:45.877 INFO:tasks.workunit.client.1.smithi172.stdout:0/863: getdents d11/d14/d9a/dea/de9 0 2024-03-19T06:05:45.881 INFO:tasks.workunit.client.1.smithi172.stdout:6/999: mknod d5/d11/d17/da4/c144 0 2024-03-19T06:05:45.885 INFO:tasks.workunit.client.1.smithi172.stdout:0/864: fdatasync d11/d14/f90 0 2024-03-19T06:05:45.887 INFO:tasks.workunit.client.0.smithi072.stdout:0/64: truncate d1/fe 440679 0 2024-03-19T06:05:45.888 INFO:tasks.workunit.client.1.smithi172.stdout:0/865: stat d11/d18/da5/da8/fac 0 2024-03-19T06:05:45.889 INFO:tasks.workunit.client.1.smithi172.stdout:7/870: dwrite d0/d22/d4b/fcf [0,4194304] 0 2024-03-19T06:05:45.890 INFO:tasks.workunit.client.1.smithi172.stdout:0/866: chown d11/d14/f1f 343823 1 2024-03-19T06:05:45.891 INFO:tasks.workunit.client.0.smithi072.stdout:0/65: rename d1/fa to d1/f13 0 2024-03-19T06:05:45.895 INFO:tasks.workunit.client.0.smithi072.stdout:0/66: creat d1/f14 x:0 0 0 2024-03-19T06:05:45.896 INFO:tasks.workunit.client.1.smithi172.stdout:0/867: creat d11/d18/d38/d3f/d43/d62/dc0/d10e/f125 x:0 0 0 2024-03-19T06:05:45.897 INFO:tasks.workunit.client.0.smithi072.stdout:0/67: chown d1/fb 44 1 2024-03-19T06:05:45.899 INFO:tasks.workunit.client.1.smithi172.stdout:5/851: dwrite d5/d3c/d6c/f93 [0,4194304] 0 2024-03-19T06:05:45.900 INFO:tasks.workunit.client.0.smithi072.stdout:0/68: write d1/f5 [887803,77381] 0 2024-03-19T06:05:45.901 INFO:tasks.workunit.client.1.smithi172.stdout:0/868: symlink d11/d14/ded/l126 0 2024-03-19T06:05:45.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:45 smithi172 ceph-mon[35716]: pgmap v19: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 66 MiB/s rd, 173 MiB/s wr, 363 op/s 2024-03-19T06:05:45.907 INFO:tasks.workunit.client.1.smithi172.stdout:5/852: stat d5/f16 0 2024-03-19T06:05:45.909 INFO:tasks.workunit.client.1.smithi172.stdout:7/871: truncate d0/d22/d1d/f32 1755640 0 2024-03-19T06:05:45.910 INFO:tasks.workunit.client.0.smithi072.stdout:0/69: rename d1/l4 to d1/l15 0 2024-03-19T06:05:45.910 INFO:tasks.workunit.client.1.smithi172.stdout:5/853: fdatasync d5/d1f/fcd 0 2024-03-19T06:05:45.912 INFO:tasks.workunit.client.1.smithi172.stdout:7/872: chown d0/d22/d1d/d36/fc 10 1 2024-03-19T06:05:45.914 INFO:tasks.workunit.client.1.smithi172.stdout:5/854: symlink d5/d3c/d6c/dbd/l122 0 2024-03-19T06:05:45.917 INFO:tasks.workunit.client.0.smithi072.stdout:0/70: link d1/l12 d1/l16 0 2024-03-19T06:05:45.920 INFO:tasks.workunit.client.0.smithi072.stdout:0/71: chown d1/l12 15 1 2024-03-19T06:05:45.924 INFO:tasks.workunit.client.1.smithi172.stdout:7/873: dread d0/d22/d35/f120 [0,4194304] 0 2024-03-19T06:05:45.925 INFO:tasks.workunit.client.0.smithi072.stdout:0/72: unlink d1/f13 0 2024-03-19T06:05:45.926 INFO:tasks.workunit.client.1.smithi172.stdout:7/874: mknod d0/d22/d35/c124 0 2024-03-19T06:05:45.927 INFO:tasks.workunit.client.1.smithi172.stdout:7/875: chown d0/d22/d35/f120 1472777 1 2024-03-19T06:05:45.930 INFO:tasks.workunit.client.1.smithi172.stdout:7/876: chown d0/d22/d1d/d36/d8d/d5c/d67/cf9 124895781 1 2024-03-19T06:05:45.933 INFO:tasks.workunit.client.0.smithi072.stdout:0/73: rmdir d1 39 2024-03-19T06:05:45.935 INFO:tasks.workunit.client.0.smithi072.stdout:0/74: fdatasync d1/fb 0 2024-03-19T06:05:45.935 INFO:tasks.workunit.client.1.smithi172.stdout:7/877: write d0/d22/d1d/d3a/d46/f78 [2635925,70876] 0 2024-03-19T06:05:45.939 INFO:tasks.workunit.client.1.smithi172.stdout:7/878: write d0/d22/d1d/d85/da8/dfa/d11a/d41/f87 [1764607,62880] 0 2024-03-19T06:05:45.941 INFO:tasks.workunit.client.0.smithi072.stdout:0/75: dread d1/f5 [0,4194304] 0 2024-03-19T06:05:45.942 INFO:tasks.workunit.client.1.smithi172.stdout:2/908: sync 2024-03-19T06:05:45.942 INFO:tasks.workunit.client.1.smithi172.stdout:1/878: sync 2024-03-19T06:05:45.942 INFO:tasks.workunit.client.1.smithi172.stdout:3/884: sync 2024-03-19T06:05:45.944 INFO:tasks.workunit.client.1.smithi172.stdout:7/879: truncate d0/d22/d1d/d3a/d46/f7a 557017 0 2024-03-19T06:05:45.944 INFO:tasks.workunit.client.1.smithi172.stdout:1/879: chown da/dd/d31/d47/dbf 1 1 2024-03-19T06:05:45.945 INFO:tasks.workunit.client.1.smithi172.stdout:3/885: chown d0/d5/d14/d52/l56 8540 1 2024-03-19T06:05:45.946 INFO:tasks.workunit.client.0.smithi072.stdout:0/76: getdents d1 0 2024-03-19T06:05:45.947 INFO:tasks.workunit.client.0.smithi072.stdout:0/77: read - d1/f14 zero size 2024-03-19T06:05:45.947 INFO:tasks.workunit.client.1.smithi172.stdout:2/909: mkdir d7/de/d58/d56/d89/de6/dbc/d126 0 2024-03-19T06:05:45.949 INFO:tasks.workunit.client.1.smithi172.stdout:7/880: mknod d0/d22/d1d/d85/da8/dfa/d11a/dfb/c125 0 2024-03-19T06:05:45.950 INFO:tasks.workunit.client.1.smithi172.stdout:2/910: creat d7/db/d45/f127 x:0 0 0 2024-03-19T06:05:45.953 INFO:tasks.workunit.client.1.smithi172.stdout:7/881: rmdir d0/d22/d1d/d85/da8/dfa/d11a/dfb 39 2024-03-19T06:05:45.954 INFO:tasks.workunit.client.1.smithi172.stdout:2/911: symlink d7/de/d58/d56/d81/l128 0 2024-03-19T06:05:45.956 INFO:tasks.workunit.client.1.smithi172.stdout:1/880: rename da/dd/d31/dfb/d14/d27/d3f/fc7 to da/dd/d31/dfb/f133 0 2024-03-19T06:05:45.956 INFO:tasks.workunit.client.1.smithi172.stdout:7/882: symlink d0/d22/d1d/d3a/dd2/l126 0 2024-03-19T06:05:45.958 INFO:tasks.workunit.client.1.smithi172.stdout:2/912: truncate d7/de/d58/d56/d86/d9d/f124 916652 0 2024-03-19T06:05:45.960 INFO:tasks.workunit.client.1.smithi172.stdout:1/881: read da/dd/d31/dfb/d14/d27/d3f/d5e/f7e [266616,18658] 0 2024-03-19T06:05:45.964 INFO:tasks.workunit.client.0.smithi072.stdout:0/78: dwrite d1/f5 [0,4194304] 0 2024-03-19T06:05:45.964 INFO:tasks.workunit.client.1.smithi172.stdout:1/882: write da/dd/d31/dfb/d14/d27/da2/f125 [783668,35417] 0 2024-03-19T06:05:45.969 INFO:tasks.workunit.client.1.smithi172.stdout:1/883: mknod da/dd/d31/dfb/d14/d84/d9b/c134 0 2024-03-19T06:05:45.969 INFO:tasks.workunit.client.1.smithi172.stdout:3/886: dread d0/da8/d3a/f86 [0,4194304] 0 2024-03-19T06:05:45.972 INFO:tasks.workunit.client.1.smithi172.stdout:2/913: truncate d7/db/f24 939909 0 2024-03-19T06:05:45.980 INFO:tasks.workunit.client.1.smithi172.stdout:2/914: mkdir d7/db/d2c/d35/de5/d129 0 2024-03-19T06:05:45.981 INFO:tasks.workunit.client.1.smithi172.stdout:3/887: link d0/d5/f23 d0/f121 0 2024-03-19T06:05:45.981 INFO:tasks.workunit.client.1.smithi172.stdout:1/884: write da/dd/d31/dfb/d14/d27/d3f/d5e/dab/d127/f55 [458884,91892] 0 2024-03-19T06:05:45.982 INFO:tasks.workunit.client.1.smithi172.stdout:7/883: dwrite d0/d22/d1d/f32 [0,4194304] 0 2024-03-19T06:05:45.987 INFO:tasks.workunit.client.1.smithi172.stdout:2/915: fsync d7/db/d2c/d35/fac 0 2024-03-19T06:05:45.988 INFO:tasks.workunit.client.1.smithi172.stdout:7/884: write d0/d22/d1d/d3a/d46/f78 [1788465,34579] 0 2024-03-19T06:05:45.988 INFO:tasks.workunit.client.1.smithi172.stdout:3/888: dread d0/d5/d14/fbb [0,4194304] 0 2024-03-19T06:05:45.990 INFO:tasks.workunit.client.1.smithi172.stdout:1/885: mkdir da/d3b/d95/ded/d135 0 2024-03-19T06:05:45.990 INFO:tasks.workunit.client.0.smithi072.stdout:0/79: dwrite d1/fe [0,4194304] 0 2024-03-19T06:05:45.992 INFO:tasks.workunit.client.1.smithi172.stdout:3/889: write d0/d5/d6b/dae/fc8 [3553873,110934] 0 2024-03-19T06:05:45.993 INFO:tasks.workunit.client.1.smithi172.stdout:1/886: write da/dd/d31/dfb/d14/d73/f12e [767924,118090] 0 2024-03-19T06:05:45.996 INFO:tasks.workunit.client.0.smithi072.stdout:0/80: write d1/fb [348801,35442] 0 2024-03-19T06:05:46.000 INFO:tasks.workunit.client.1.smithi172.stdout:2/916: creat d7/d4c/f12a x:0 0 0 2024-03-19T06:05:46.000 INFO:tasks.workunit.client.1.smithi172.stdout:7/885: mkdir d0/d22/d1d/d85/d10f/d127 0 2024-03-19T06:05:46.002 INFO:tasks.workunit.client.0.smithi072.stdout:0/81: symlink d1/l17 0 2024-03-19T06:05:46.006 INFO:tasks.workunit.client.1.smithi172.stdout:7/886: truncate d0/d22/d1d/dc8/fd8 950437 0 2024-03-19T06:05:46.006 INFO:tasks.workunit.client.1.smithi172.stdout:3/890: dread d0/da8/d25/d21/fd5 [0,4194304] 0 2024-03-19T06:05:46.010 INFO:tasks.workunit.client.1.smithi172.stdout:7/887: readlink d0/d22/d1d/d85/da8/dfa/d11a/d41/l5b 0 2024-03-19T06:05:46.010 INFO:tasks.workunit.client.1.smithi172.stdout:3/891: mknod d0/c122 0 2024-03-19T06:05:46.012 INFO:tasks.workunit.client.1.smithi172.stdout:1/887: dwrite da/df9/f118 [0,4194304] 0 2024-03-19T06:05:46.012 INFO:tasks.workunit.client.1.smithi172.stdout:7/888: chown d0/d22/d1d/d3a/d46/d103/l107 492858 1 2024-03-19T06:05:46.016 INFO:tasks.workunit.client.0.smithi072.stdout:0/82: creat d1/f18 x:0 0 0 2024-03-19T06:05:46.017 INFO:tasks.workunit.client.1.smithi172.stdout:2/917: write d7/de/fcc [3280196,125694] 0 2024-03-19T06:05:46.019 INFO:tasks.workunit.client.1.smithi172.stdout:3/892: creat d0/d5/d6b/dae/f123 x:0 0 0 2024-03-19T06:05:46.020 INFO:tasks.workunit.client.1.smithi172.stdout:1/888: dread da/d33/f75 [0,4194304] 0 2024-03-19T06:05:46.021 INFO:tasks.workunit.client.1.smithi172.stdout:2/918: creat d7/da6/f12b x:0 0 0 2024-03-19T06:05:46.023 INFO:tasks.workunit.client.1.smithi172.stdout:3/893: creat d0/da8/d60/df1/f124 x:0 0 0 2024-03-19T06:05:46.026 INFO:tasks.workunit.client.1.smithi172.stdout:2/919: creat d7/de/d58/d56/d81/dda/f12c x:0 0 0 2024-03-19T06:05:46.026 INFO:tasks.workunit.client.1.smithi172.stdout:1/889: symlink da/dd/d31/dfb/d14/d27/da7/db7/l136 0 2024-03-19T06:05:46.028 INFO:tasks.workunit.client.1.smithi172.stdout:3/894: rename d0/d5/d14 to d0/db0/d125 0 2024-03-19T06:05:46.030 INFO:tasks.workunit.client.1.smithi172.stdout:2/920: unlink d7/d4c/d70/daa/lc2 0 2024-03-19T06:05:46.032 INFO:tasks.workunit.client.1.smithi172.stdout:3/895: creat d0/da8/d60/df1/d10d/f126 x:0 0 0 2024-03-19T06:05:46.033 INFO:tasks.workunit.client.1.smithi172.stdout:7/889: dwrite d0/d22/d1d/d85/da8/dfa/d11a/d41/f87 [4194304,4194304] 0 2024-03-19T06:05:46.038 INFO:tasks.workunit.client.1.smithi172.stdout:2/921: mkdir d7/de/d58/d56/d89/de6/dbc/d126/d12d 0 2024-03-19T06:05:46.040 INFO:tasks.workunit.client.0.smithi072.stdout:0/83: rmdir d1 39 2024-03-19T06:05:46.041 INFO:tasks.workunit.client.1.smithi172.stdout:7/890: chown d0/d22/d1d/d85/da8/dfa/f101 3 1 2024-03-19T06:05:46.041 INFO:tasks.workunit.client.1.smithi172.stdout:1/890: link da/d3b/lda da/dd/d31/dfb/d14/d73/d102/l137 0 2024-03-19T06:05:46.059 INFO:tasks.workunit.client.0.smithi072.stdout:0/84: dwrite d1/f14 [0,4194304] 0 2024-03-19T06:05:46.062 INFO:tasks.workunit.client.0.smithi072.stdout:0/85: creat d1/f19 x:0 0 0 2024-03-19T06:05:46.067 INFO:tasks.workunit.client.0.smithi072.stdout:0/86: rmdir d1 39 2024-03-19T06:05:46.078 INFO:tasks.workunit.client.1.smithi172.stdout:9/863: sync 2024-03-19T06:05:46.079 INFO:tasks.workunit.client.1.smithi172.stdout:9/864: fsync d1/d7/dc/de/ff3 0 2024-03-19T06:05:46.080 INFO:tasks.workunit.client.0.smithi072.stdout:8/89: sync 2024-03-19T06:05:46.083 INFO:tasks.workunit.client.1.smithi172.stdout:2/922: truncate d7/de/d58/d57/f8d 1245136 0 2024-03-19T06:05:46.083 INFO:tasks.workunit.client.1.smithi172.stdout:7/891: creat d0/d22/d1d/d36/d40/f128 x:0 0 0 2024-03-19T06:05:46.084 INFO:tasks.workunit.client.0.smithi072.stdout:0/87: chown d1/fb 258066 1 2024-03-19T06:05:46.084 INFO:tasks.workunit.client.1.smithi172.stdout:1/891: unlink da/dd/d31/d97/cf3 0 2024-03-19T06:05:46.086 INFO:tasks.workunit.client.1.smithi172.stdout:7/892: write d0/d22/d1d/d3a/f3f [3709555,87487] 0 2024-03-19T06:05:46.093 INFO:tasks.workunit.client.1.smithi172.stdout:3/896: dwrite d0/fe [0,4194304] 0 2024-03-19T06:05:46.093 INFO:tasks.workunit.client.1.smithi172.stdout:7/893: creat d0/d22/d27/d86/f129 x:0 0 0 2024-03-19T06:05:46.096 INFO:tasks.workunit.client.1.smithi172.stdout:3/897: stat d0/da8/d60/f7e 0 2024-03-19T06:05:46.096 INFO:tasks.workunit.client.1.smithi172.stdout:1/892: link da/dd/d31/dfb/f64 da/dd/d31/dfb/d14/d27/d3f/f138 0 2024-03-19T06:05:46.104 INFO:tasks.workunit.client.1.smithi172.stdout:3/898: mkdir d0/d5/d6b/dae/db9/dd7/d127 0 2024-03-19T06:05:46.104 INFO:tasks.workunit.client.1.smithi172.stdout:2/923: truncate d7/db/d2c/fe4 1830399 0 2024-03-19T06:05:46.105 INFO:tasks.workunit.client.1.smithi172.stdout:1/893: mknod da/dd/d31/dfb/d14/d27/d53/c139 0 2024-03-19T06:05:46.107 INFO:tasks.workunit.client.0.smithi072.stdout:8/90: dwrite da/d13/f16 [0,4194304] 0 2024-03-19T06:05:46.107 INFO:tasks.workunit.client.1.smithi172.stdout:3/899: fdatasync d0/db0/db6/dc7/de0/ffd 0 2024-03-19T06:05:46.107 INFO:tasks.workunit.client.1.smithi172.stdout:9/865: dwrite d1/d7/dc/de/d34/d48/fa4 [0,4194304] 0 2024-03-19T06:05:46.107 INFO:tasks.workunit.client.1.smithi172.stdout:7/894: rename d0/d22/d27/ded/d114/ca4 to d0/d22/d27/db0/d92/c12a 0 2024-03-19T06:05:46.108 INFO:tasks.workunit.client.0.smithi072.stdout:0/88: dwrite d1/fb [0,4194304] 0 2024-03-19T06:05:46.108 INFO:tasks.workunit.client.0.smithi072.stdout:8/91: fsync f9 0 2024-03-19T06:05:46.113 INFO:tasks.workunit.client.1.smithi172.stdout:3/900: mkdir d0/da8/d3a/d128 0 2024-03-19T06:05:46.113 INFO:tasks.workunit.client.0.smithi072.stdout:0/89: fsync d1/f18 0 2024-03-19T06:05:46.115 INFO:tasks.workunit.client.1.smithi172.stdout:2/924: truncate d7/db/d2c/d35/f41 414190 0 2024-03-19T06:05:46.116 INFO:tasks.workunit.client.0.smithi072.stdout:8/92: write da/fc [882015,9617] 0 2024-03-19T06:05:46.119 INFO:tasks.workunit.client.0.smithi072.stdout:8/93: write da/fc [3634468,27097] 0 2024-03-19T06:05:46.121 INFO:tasks.workunit.client.0.smithi072.stdout:0/90: creat d1/f1a x:0 0 0 2024-03-19T06:05:46.123 INFO:tasks.workunit.client.0.smithi072.stdout:8/94: mkdir da/d13/d1d 0 2024-03-19T06:05:46.124 INFO:tasks.workunit.client.0.smithi072.stdout:0/91: truncate d1/f19 148573 0 2024-03-19T06:05:46.128 INFO:tasks.workunit.client.0.smithi072.stdout:8/95: unlink da/c19 0 2024-03-19T06:05:46.129 INFO:tasks.workunit.client.1.smithi172.stdout:7/895: mkdir d0/d22/d1d/d85/da8/dfa/d11a/d12b 0 2024-03-19T06:05:46.130 INFO:tasks.workunit.client.1.smithi172.stdout:1/894: unlink da/d3b/c8c 0 2024-03-19T06:05:46.130 INFO:tasks.workunit.client.1.smithi172.stdout:2/925: dread - d7/de/d58/d55/fcb zero size 2024-03-19T06:05:46.132 INFO:tasks.workunit.client.0.smithi072.stdout:8/96: creat da/d13/f1e x:0 0 0 2024-03-19T06:05:46.132 INFO:tasks.workunit.client.1.smithi172.stdout:9/866: dwrite d1/d7/fb6 [4194304,4194304] 0 2024-03-19T06:05:46.133 INFO:tasks.workunit.client.0.smithi072.stdout:0/92: creat d1/f1b x:0 0 0 2024-03-19T06:05:46.135 INFO:tasks.workunit.client.1.smithi172.stdout:7/896: write d0/d22/d1d/d3a/f3f [3845563,2852] 0 2024-03-19T06:05:46.136 INFO:tasks.workunit.client.1.smithi172.stdout:7/897: chown d0/d22/d1d/d3a/c122 5622 1 2024-03-19T06:05:46.138 INFO:tasks.workunit.client.1.smithi172.stdout:4/919: sync 2024-03-19T06:05:46.138 INFO:tasks.workunit.client.1.smithi172.stdout:8/839: sync 2024-03-19T06:05:46.138 INFO:tasks.workunit.client.1.smithi172.stdout:0/869: sync 2024-03-19T06:05:46.139 INFO:tasks.workunit.client.1.smithi172.stdout:2/926: unlink d7/de/l107 0 2024-03-19T06:05:46.139 INFO:tasks.workunit.client.1.smithi172.stdout:3/901: link d0/da8/d34/d4d/f4a d0/d5/d6b/dae/db9/dd7/f129 0 2024-03-19T06:05:46.139 INFO:tasks.workunit.client.0.smithi072.stdout:0/93: mkdir d1/d1c 0 2024-03-19T06:05:46.141 INFO:tasks.workunit.client.1.smithi172.stdout:9/867: rmdir d1/d7/dc/de/d34/d48 39 2024-03-19T06:05:46.144 INFO:tasks.workunit.client.1.smithi172.stdout:3/902: dread - d0/da8/dce/da7/fea zero size 2024-03-19T06:05:46.145 INFO:tasks.workunit.client.1.smithi172.stdout:8/840: stat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/la8 0 2024-03-19T06:05:46.147 INFO:tasks.workunit.client.1.smithi172.stdout:2/927: dread - d7/de/d58/d56/d89/db5/f101 zero size 2024-03-19T06:05:46.149 INFO:tasks.workunit.client.1.smithi172.stdout:3/903: stat d0/da8/d34/dda/fe7 0 2024-03-19T06:05:46.153 INFO:tasks.workunit.client.1.smithi172.stdout:7/898: rename d0/d22/d27/c4f to d0/d22/d1d/d85/da8/dfa/d11a/dfb/c12c 0 2024-03-19T06:05:46.158 INFO:tasks.workunit.client.1.smithi172.stdout:2/928: chown d7/de/d58/d55/d6e/ca7 16839 1 2024-03-19T06:05:46.158 INFO:tasks.workunit.client.1.smithi172.stdout:0/870: dread d11/d18/d38/f55 [0,4194304] 0 2024-03-19T06:05:46.158 INFO:tasks.workunit.client.1.smithi172.stdout:8/841: unlink d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/f57 0 2024-03-19T06:05:46.159 INFO:tasks.workunit.client.1.smithi172.stdout:3/904: rmdir d0/d5/d6b/dae/d88 39 2024-03-19T06:05:46.161 INFO:tasks.workunit.client.1.smithi172.stdout:0/871: creat d11/d14/d9a/f127 x:0 0 0 2024-03-19T06:05:46.162 INFO:tasks.workunit.client.1.smithi172.stdout:7/899: creat d0/d22/d27/d104/f12d x:0 0 0 2024-03-19T06:05:46.166 INFO:tasks.workunit.client.1.smithi172.stdout:8/842: rename d0/d44/d46/d49/d26/dc0/d76/lbb to d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/dcc/l107 0 2024-03-19T06:05:46.167 INFO:tasks.workunit.client.1.smithi172.stdout:7/900: mkdir d0/d22/d1d/d3a/d46/ddc/d12e 0 2024-03-19T06:05:46.169 INFO:tasks.workunit.client.1.smithi172.stdout:9/868: write d1/f75 [474224,86275] 0 2024-03-19T06:05:46.178 INFO:tasks.workunit.client.1.smithi172.stdout:2/929: dwrite d7/de/d58/d57/fa4 [0,4194304] 0 2024-03-19T06:05:46.179 INFO:tasks.workunit.client.0.smithi072.stdout:0/94: dwrite d1/f5 [4194304,4194304] 0 2024-03-19T06:05:46.185 INFO:tasks.workunit.client.1.smithi172.stdout:9/869: unlink d1/d7/dc/d47/d78/d54/d91/lff 0 2024-03-19T06:05:46.187 INFO:tasks.workunit.client.1.smithi172.stdout:3/905: dwrite d0/da8/fd [4194304,4194304] 0 2024-03-19T06:05:46.187 INFO:tasks.workunit.client.1.smithi172.stdout:1/895: dwrite da/dd/f39 [0,4194304] 0 2024-03-19T06:05:46.188 INFO:tasks.workunit.client.0.smithi072.stdout:0/95: creat d1/d1c/f1d x:0 0 0 2024-03-19T06:05:46.191 INFO:tasks.workunit.client.1.smithi172.stdout:0/872: dwrite d11/d14/d9a/dea/fe6 [0,4194304] 0 2024-03-19T06:05:46.199 INFO:tasks.workunit.client.1.smithi172.stdout:8/843: rename d0/d44/d46/d49/d26/dc0/d3d/c106 to d0/d44/d46/d49/d26/dc0/d76/dc3/dc9/c108 0 2024-03-19T06:05:46.200 INFO:tasks.workunit.client.1.smithi172.stdout:3/906: symlink d0/da8/d34/d4d/l12a 0 2024-03-19T06:05:46.201 INFO:tasks.workunit.client.0.smithi072.stdout:0/96: dread d1/f5 [0,4194304] 0 2024-03-19T06:05:46.201 INFO:tasks.workunit.client.1.smithi172.stdout:2/930: fdatasync d7/db/f13 0 2024-03-19T06:05:46.203 INFO:tasks.workunit.client.1.smithi172.stdout:8/844: readlink d0/d44/d46/d49/d26/le5 0 2024-03-19T06:05:46.203 INFO:tasks.workunit.client.1.smithi172.stdout:7/901: link d0/d22/d1d/d36/d8d/d7d/c84 d0/d22/c12f 0 2024-03-19T06:05:46.205 INFO:tasks.workunit.client.1.smithi172.stdout:2/931: mkdir d7/da6/d12e 0 2024-03-19T06:05:46.208 INFO:tasks.workunit.client.1.smithi172.stdout:0/873: chown d11/d18/d38/d3f/d9f/la4 97376901 1 2024-03-19T06:05:46.209 INFO:tasks.workunit.client.0.smithi072.stdout:0/97: stat d1/lc 0 2024-03-19T06:05:46.209 INFO:tasks.workunit.client.1.smithi172.stdout:3/907: creat d0/db0/db6/dc7/de0/df6/f12b x:0 0 0 2024-03-19T06:05:46.212 INFO:tasks.workunit.client.1.smithi172.stdout:7/902: fdatasync d0/d22/d35/dc7/fd5 0 2024-03-19T06:05:46.217 INFO:tasks.workunit.client.1.smithi172.stdout:3/908: readlink d0/d5/d6b/dae/db9/dd7/l11e 0 2024-03-19T06:05:46.224 INFO:tasks.workunit.client.1.smithi172.stdout:7/903: rmdir d0/d22/d1d/d3a/d46/ddc 39 2024-03-19T06:05:46.228 INFO:tasks.workunit.client.1.smithi172.stdout:9/870: dwrite d1/d7/dc/dbe/f126 [0,4194304] 0 2024-03-19T06:05:46.230 INFO:tasks.workunit.client.1.smithi172.stdout:7/904: creat d0/d22/d1d/d36/d56/dc6/f130 x:0 0 0 2024-03-19T06:05:46.241 INFO:tasks.workunit.client.1.smithi172.stdout:3/909: dwrite d0/da8/d3a/fa6 [0,4194304] 0 2024-03-19T06:05:46.244 INFO:tasks.workunit.client.1.smithi172.stdout:7/905: link d0/d22/d27/db0/ld3 d0/d22/d1d/d85/da8/dfa/d11a/l131 0 2024-03-19T06:05:46.249 INFO:tasks.workunit.client.1.smithi172.stdout:7/906: mknod d0/d22/d1d/d85/da8/c132 0 2024-03-19T06:05:46.253 INFO:tasks.workunit.client.1.smithi172.stdout:7/907: mkdir d0/d22/d1d/d3a/d11f/d133 0 2024-03-19T06:05:46.256 INFO:tasks.workunit.client.1.smithi172.stdout:7/908: symlink d0/d22/d27/db0/df8/l134 0 2024-03-19T06:05:46.260 INFO:tasks.workunit.client.1.smithi172.stdout:7/909: mknod d0/d22/d1d/d3a/d11f/d133/c135 0 2024-03-19T06:05:46.261 INFO:tasks.workunit.client.1.smithi172.stdout:8/845: dread d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/f30 [0,4194304] 0 2024-03-19T06:05:46.262 INFO:tasks.workunit.client.1.smithi172.stdout:7/910: mknod d0/d22/d27/db0/d92/c136 0 2024-03-19T06:05:46.272 INFO:tasks.workunit.client.1.smithi172.stdout:9/871: dread d1/d7/dc/dbe/fd8 [0,4194304] 0 2024-03-19T06:05:46.272 INFO:tasks.workunit.client.1.smithi172.stdout:3/910: dread d0/d5/f11 [0,4194304] 0 2024-03-19T06:05:46.279 INFO:tasks.workunit.client.1.smithi172.stdout:7/911: dwrite d0/d22/d4b/fcf [4194304,4194304] 0 2024-03-19T06:05:46.286 INFO:tasks.workunit.client.1.smithi172.stdout:5/855: sync 2024-03-19T06:05:46.291 INFO:tasks.workunit.client.1.smithi172.stdout:5/856: creat d5/d3c/d6c/da2/f123 x:0 0 0 2024-03-19T06:05:46.295 INFO:tasks.workunit.client.1.smithi172.stdout:1/896: truncate da/d33/d4e/f7d 3288337 0 2024-03-19T06:05:46.295 INFO:tasks.workunit.client.1.smithi172.stdout:5/857: mkdir d5/d14/d9f/d124 0 2024-03-19T06:05:46.298 INFO:tasks.workunit.client.1.smithi172.stdout:1/897: read - da/d33/d59/dc1/fd8 zero size 2024-03-19T06:05:46.298 INFO:tasks.workunit.client.1.smithi172.stdout:3/911: dread d0/d5/f3d [0,4194304] 0 2024-03-19T06:05:46.298 INFO:tasks.workunit.client.1.smithi172.stdout:0/874: write d11/d22/d46/f97 [327484,28947] 0 2024-03-19T06:05:46.301 INFO:tasks.workunit.client.1.smithi172.stdout:0/875: write d11/d22/d32/daf/fe2 [1641496,37708] 0 2024-03-19T06:05:46.302 INFO:tasks.workunit.client.1.smithi172.stdout:5/858: creat d5/d3d/dd6/d100/f125 x:0 0 0 2024-03-19T06:05:46.305 INFO:tasks.workunit.client.1.smithi172.stdout:3/912: creat d0/da8/dce/da7/f12c x:0 0 0 2024-03-19T06:05:46.306 INFO:tasks.workunit.client.1.smithi172.stdout:8/846: truncate d0/d44/d46/d49/d26/d71/d81/d27/d29/fd1 3703682 0 2024-03-19T06:05:46.308 INFO:tasks.workunit.client.1.smithi172.stdout:0/876: creat d11/d18/d38/d3f/dbe/d104/d120/f128 x:0 0 0 2024-03-19T06:05:46.308 INFO:tasks.workunit.client.1.smithi172.stdout:5/859: dread - d5/d14/d15/d40/d6a/fba zero size 2024-03-19T06:05:46.311 INFO:tasks.workunit.client.1.smithi172.stdout:7/912: write d0/d22/d1d/d36/d8d/d5c/d67/d82/fa5 [873721,125938] 0 2024-03-19T06:05:46.312 INFO:tasks.workunit.client.1.smithi172.stdout:3/913: mknod d0/c12d 0 2024-03-19T06:05:46.315 INFO:tasks.workunit.client.1.smithi172.stdout:8/847: symlink d0/d44/d46/d49/d26/dc0/dd3/l109 0 2024-03-19T06:05:46.316 INFO:tasks.workunit.client.1.smithi172.stdout:0/877: creat d11/d14/d2c/dbc/f129 x:0 0 0 2024-03-19T06:05:46.318 INFO:tasks.workunit.client.1.smithi172.stdout:3/914: unlink d0/da8/d3a/caf 0 2024-03-19T06:05:46.319 INFO:tasks.workunit.client.1.smithi172.stdout:7/913: dread - d0/d22/d27/db0/f11c zero size 2024-03-19T06:05:46.320 INFO:tasks.workunit.client.1.smithi172.stdout:5/860: rename d5/d1f/db4/ff4 to d5/d55/de9/df7/f126 0 2024-03-19T06:05:46.320 INFO:tasks.workunit.client.1.smithi172.stdout:9/872: dwrite d1/d7/dc/de/d34/d48/d89/fac [0,4194304] 0 2024-03-19T06:05:46.322 INFO:tasks.workunit.client.1.smithi172.stdout:3/915: fdatasync d0/da8/d60/d67/f84 0 2024-03-19T06:05:46.322 INFO:tasks.workunit.client.1.smithi172.stdout:8/848: symlink d0/d61/d6a/l10a 0 2024-03-19T06:05:46.324 INFO:tasks.workunit.client.1.smithi172.stdout:0/878: chown d11/d18/d38/d3f/ff6 1393892 1 2024-03-19T06:05:46.324 INFO:tasks.workunit.client.1.smithi172.stdout:1/898: dwrite da/f3c [0,4194304] 0 2024-03-19T06:05:46.325 INFO:tasks.workunit.client.1.smithi172.stdout:7/914: dread - d0/d22/d1d/d36/d40/f128 zero size 2024-03-19T06:05:46.329 INFO:tasks.workunit.client.1.smithi172.stdout:5/861: dread d5/d3c/d6c/dbd/fc9 [0,4194304] 0 2024-03-19T06:05:46.330 INFO:tasks.workunit.client.1.smithi172.stdout:9/873: readlink d1/d7/dc/d47/d78/d54/d91/l30 0 2024-03-19T06:05:46.330 INFO:tasks.workunit.client.1.smithi172.stdout:1/899: chown da/dd/d31/dfb/d14/d27/d3f/d5e/dab/dde 2032 1 2024-03-19T06:05:46.332 INFO:tasks.workunit.client.1.smithi172.stdout:7/915: symlink d0/d22/d35/l137 0 2024-03-19T06:05:46.334 INFO:tasks.workunit.client.1.smithi172.stdout:3/916: unlink d0/d5/d6b/dae/d88/cc6 0 2024-03-19T06:05:46.336 INFO:tasks.workunit.client.1.smithi172.stdout:1/900: chown da/d33/d59/f117 282170 1 2024-03-19T06:05:46.337 INFO:tasks.workunit.client.1.smithi172.stdout:7/916: write d0/d22/d1d/f113 [1008662,116092] 0 2024-03-19T06:05:46.340 INFO:tasks.workunit.client.1.smithi172.stdout:0/879: rename d11/d22/f4a to d11/d14/d9a/dea/dab/dc1/dd9/f12a 0 2024-03-19T06:05:46.345 INFO:tasks.workunit.client.1.smithi172.stdout:5/862: dread d5/d3d/d60/fe6 [0,4194304] 0 2024-03-19T06:05:46.346 INFO:tasks.workunit.client.1.smithi172.stdout:9/874: getdents d1/db9 0 2024-03-19T06:05:46.346 INFO:tasks.workunit.client.1.smithi172.stdout:1/901: rename da/dd/d31/dfb/d14/d27 to da/dd/d31/dfb/d14/d27/d53/d13a 22 2024-03-19T06:05:46.347 INFO:tasks.workunit.client.1.smithi172.stdout:7/917: write d0/d22/d1d/d85/da8/dfa/d11a/d41/fc2 [373351,81598] 0 2024-03-19T06:05:46.351 INFO:tasks.workunit.client.1.smithi172.stdout:9/875: write d1/d7/fe9 [4236571,110553] 0 2024-03-19T06:05:46.353 INFO:tasks.workunit.client.1.smithi172.stdout:0/880: dread d11/d14/d2c/d8d/f99 [0,4194304] 0 2024-03-19T06:05:46.353 INFO:tasks.workunit.client.1.smithi172.stdout:5/863: write d5/d55/de7/f10a [272201,73799] 0 2024-03-19T06:05:46.354 INFO:tasks.workunit.client.1.smithi172.stdout:7/918: chown d0/d22/d4b/cae 46563 1 2024-03-19T06:05:46.355 INFO:tasks.workunit.client.1.smithi172.stdout:8/849: dwrite d0/d61/d6a/d7e/f7f [4194304,4194304] 0 2024-03-19T06:05:46.356 INFO:tasks.workunit.client.1.smithi172.stdout:1/902: write da/d3b/dcd/ddb/f10d [40005,118602] 0 2024-03-19T06:05:46.361 INFO:tasks.workunit.client.1.smithi172.stdout:7/919: write d0/d22/d1d/d85/da8/f108 [219625,111955] 0 2024-03-19T06:05:46.362 INFO:tasks.workunit.client.1.smithi172.stdout:1/903: chown da/dd/d31/dfb/d14/d27/d53/l6c 676 1 2024-03-19T06:05:46.363 INFO:tasks.workunit.client.1.smithi172.stdout:0/881: creat d11/d18/d123/f12b x:0 0 0 2024-03-19T06:05:46.367 INFO:tasks.workunit.client.1.smithi172.stdout:9/876: truncate d1/d7/dc/dbe/d65/f119 2477342 0 2024-03-19T06:05:46.370 INFO:tasks.workunit.client.1.smithi172.stdout:5/864: link d5/d3c/d6c/d9b/f110 d5/d3c/d6c/d9b/f127 0 2024-03-19T06:05:46.373 INFO:tasks.workunit.client.1.smithi172.stdout:7/920: link d0/d22/d1d/d36/d56/dc6/f130 d0/d22/d35/dc7/f138 0 2024-03-19T06:05:46.375 INFO:tasks.workunit.client.1.smithi172.stdout:0/882: write d11/d18/d38/d3f/d43/f115 [870168,18982] 0 2024-03-19T06:05:46.378 INFO:tasks.workunit.client.1.smithi172.stdout:3/917: dwrite d0/f121 [0,4194304] 0 2024-03-19T06:05:46.379 INFO:tasks.workunit.client.1.smithi172.stdout:5/865: write d5/d3c/d6c/dbd/fc9 [540450,20415] 0 2024-03-19T06:05:46.379 INFO:tasks.workunit.client.1.smithi172.stdout:4/920: sync 2024-03-19T06:05:46.381 INFO:tasks.workunit.client.1.smithi172.stdout:3/918: fdatasync d0/da8/fd 0 2024-03-19T06:05:46.381 INFO:tasks.workunit.client.1.smithi172.stdout:8/850: dread d0/d44/d46/d49/d26/dbc/ff4 [4194304,4194304] 0 2024-03-19T06:05:46.385 INFO:tasks.workunit.client.1.smithi172.stdout:5/866: rmdir d5/d3d 39 2024-03-19T06:05:46.386 INFO:tasks.workunit.client.1.smithi172.stdout:3/919: dread - d0/da8/d60/d67/dfe/f119 zero size 2024-03-19T06:05:46.387 INFO:tasks.workunit.client.1.smithi172.stdout:7/921: mknod d0/d22/d1d/d3a/d46/ddc/c139 0 2024-03-19T06:05:46.393 INFO:tasks.workunit.client.1.smithi172.stdout:0/883: dread d11/d14/f1f [0,4194304] 0 2024-03-19T06:05:46.396 INFO:tasks.workunit.client.1.smithi172.stdout:9/877: write d1/d7/dc/de/d34/f45 [1247781,68719] 0 2024-03-19T06:05:46.402 INFO:tasks.workunit.client.1.smithi172.stdout:7/922: rename d0/d22/d27/d86/lf7 to d0/d22/d1d/d36/d8d/d5c/l13a 0 2024-03-19T06:05:46.412 INFO:tasks.workunit.client.1.smithi172.stdout:4/921: dwrite df/d11/d12/d34/f4e [0,4194304] 0 2024-03-19T06:05:46.420 INFO:tasks.workunit.client.1.smithi172.stdout:0/884: dread d11/f60 [0,4194304] 0 2024-03-19T06:05:46.422 INFO:tasks.workunit.client.1.smithi172.stdout:1/904: dread da/d33/f57 [0,4194304] 0 2024-03-19T06:05:46.422 INFO:tasks.workunit.client.1.smithi172.stdout:2/932: sync 2024-03-19T06:05:46.423 INFO:tasks.workunit.client.1.smithi172.stdout:3/920: dwrite d0/da8/d60/df1/f124 [0,4194304] 0 2024-03-19T06:05:46.424 INFO:tasks.workunit.client.1.smithi172.stdout:8/851: write d0/d61/d6a/d9f/fb0 [1290130,101430] 0 2024-03-19T06:05:46.435 INFO:tasks.workunit.client.1.smithi172.stdout:8/852: stat d0/d44/d46/d49/d26/d71/d81/f1a 0 2024-03-19T06:05:46.435 INFO:tasks.workunit.client.1.smithi172.stdout:5/867: dwrite d5/d3d/d60/fad [4194304,4194304] 0 2024-03-19T06:05:46.437 INFO:tasks.workunit.client.1.smithi172.stdout:3/921: mknod d0/d5/d6b/dae/d88/c12e 0 2024-03-19T06:05:46.441 INFO:tasks.workunit.client.1.smithi172.stdout:3/922: readlink d0/d5/l42 0 2024-03-19T06:05:46.444 INFO:tasks.workunit.client.1.smithi172.stdout:8/853: read d0/f3 [2674549,40038] 0 2024-03-19T06:05:46.445 INFO:tasks.workunit.client.1.smithi172.stdout:9/878: dwrite d1/d7/dc/d47/d78/d54/d91/f6f [0,4194304] 0 2024-03-19T06:05:46.448 INFO:tasks.workunit.client.1.smithi172.stdout:0/885: mkdir d11/d18/d38/d3f/d9f/dbb/dc8/d12c 0 2024-03-19T06:05:46.448 INFO:tasks.workunit.client.1.smithi172.stdout:7/923: dwrite d0/f9a [0,4194304] 0 2024-03-19T06:05:46.455 INFO:tasks.workunit.client.1.smithi172.stdout:5/868: stat d5/d3c/d6c/dbd/ld1 0 2024-03-19T06:05:46.455 INFO:tasks.workunit.client.1.smithi172.stdout:7/924: fdatasync d0/d22/d27/db0/f123 0 2024-03-19T06:05:46.455 INFO:tasks.workunit.client.1.smithi172.stdout:4/922: dwrite df/d45/f117 [0,4194304] 0 2024-03-19T06:05:46.456 INFO:tasks.workunit.client.1.smithi172.stdout:3/923: rename d0/da8/d60/d67 to d0/d12f 0 2024-03-19T06:05:46.458 INFO:tasks.workunit.client.1.smithi172.stdout:0/886: write d11/d18/da5/dcb/ddb/f121 [61338,3433] 0 2024-03-19T06:05:46.466 INFO:tasks.workunit.client.0.smithi072.stdout:1/82: sync 2024-03-19T06:05:46.469 INFO:tasks.workunit.client.0.smithi072.stdout:2/68: sync 2024-03-19T06:05:46.470 INFO:tasks.workunit.client.1.smithi172.stdout:3/924: mkdir d0/d5/dfa/d130 0 2024-03-19T06:05:46.470 INFO:tasks.workunit.client.1.smithi172.stdout:5/869: fdatasync d5/d14/d15/d40/d6a/f10c 0 2024-03-19T06:05:46.470 INFO:tasks.workunit.client.0.smithi072.stdout:2/69: fdatasync db/d10/f18 0 2024-03-19T06:05:46.471 INFO:tasks.workunit.client.1.smithi172.stdout:4/923: chown df/d11/d12/d26/f43 1131029 1 2024-03-19T06:05:46.472 INFO:tasks.workunit.client.1.smithi172.stdout:0/887: dread d11/fb8 [0,4194304] 0 2024-03-19T06:05:46.473 INFO:tasks.workunit.client.1.smithi172.stdout:7/925: symlink d0/d22/d1d/d85/da8/dfa/d11a/l13b 0 2024-03-19T06:05:46.474 INFO:tasks.workunit.client.1.smithi172.stdout:3/925: fdatasync d0/da8/dce/da7/f102 0 2024-03-19T06:05:46.476 INFO:tasks.workunit.client.1.smithi172.stdout:8/854: rename d0/d44/d46/d49/d26/d71/d81/d27/fd5 to d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3/d105/f10b 0 2024-03-19T06:05:46.479 INFO:tasks.workunit.client.1.smithi172.stdout:5/870: unlink d5/d3c/d6c/dbd/fc9 0 2024-03-19T06:05:46.480 INFO:tasks.workunit.client.0.smithi072.stdout:1/83: link d1/ld d1/d11/d18/d19/d1a/l1b 0 2024-03-19T06:05:46.488 INFO:tasks.workunit.client.1.smithi172.stdout:0/888: truncate d11/d18/da5/da8/fb1 1229639 0 2024-03-19T06:05:46.494 INFO:tasks.workunit.client.0.smithi072.stdout:1/84: dread d1/d11/f13 [0,4194304] 0 2024-03-19T06:05:46.494 INFO:tasks.workunit.client.1.smithi172.stdout:4/924: dread df/d11/d12/d21/d50/f5f [0,4194304] 0 2024-03-19T06:05:46.494 INFO:tasks.workunit.client.1.smithi172.stdout:8/855: getdents d0/d44/d46/d49/d26/d71/d81 0 2024-03-19T06:05:46.497 INFO:tasks.workunit.client.0.smithi072.stdout:1/85: creat d1/d11/f1c x:0 0 0 2024-03-19T06:05:46.506 INFO:tasks.workunit.client.1.smithi172.stdout:4/925: creat df/d11/d12/d6e/d112/f125 x:0 0 0 2024-03-19T06:05:46.509 INFO:tasks.workunit.client.1.smithi172.stdout:1/905: dwrite da/dd/d31/d97/fa1 [0,4194304] 0 2024-03-19T06:05:46.511 INFO:tasks.workunit.client.0.smithi072.stdout:1/86: write d1/f15 [1759768,63122] 0 2024-03-19T06:05:46.513 INFO:tasks.workunit.client.0.smithi072.stdout:1/87: chown d1/d11/d18/d19/d1a 33 1 2024-03-19T06:05:46.513 INFO:tasks.workunit.client.1.smithi172.stdout:0/889: truncate d11/d22/d68/ff4 630825 0 2024-03-19T06:05:46.516 INFO:tasks.workunit.client.1.smithi172.stdout:9/879: dwrite d1/d7/dc/d47/d78/d54/d91/f80 [0,4194304] 0 2024-03-19T06:05:46.516 INFO:tasks.workunit.client.1.smithi172.stdout:7/926: dread d0/d22/d1d/d36/d56/f79 [0,4194304] 0 2024-03-19T06:05:46.516 INFO:tasks.workunit.client.1.smithi172.stdout:3/926: dread d0/da8/d54/d90/f9c [4194304,4194304] 0 2024-03-19T06:05:46.517 INFO:tasks.workunit.client.1.smithi172.stdout:8/856: write d0/d44/d46/d49/d26/d71/d81/d27/d65/fc8 [831556,60415] 0 2024-03-19T06:05:46.518 INFO:tasks.workunit.client.1.smithi172.stdout:0/890: chown d11/l82 102263 1 2024-03-19T06:05:46.519 INFO:tasks.workunit.client.1.smithi172.stdout:4/926: mkdir df/d11/d12/d126 0 2024-03-19T06:05:46.523 INFO:tasks.workunit.client.1.smithi172.stdout:7/927: creat d0/d22/d1d/d3a/d11f/f13c x:0 0 0 2024-03-19T06:05:46.523 INFO:tasks.workunit.client.1.smithi172.stdout:8/857: truncate d0/d64/ff7 226557 0 2024-03-19T06:05:46.524 INFO:tasks.workunit.client.1.smithi172.stdout:2/933: dread d7/db/d2c/f38 [0,4194304] 0 2024-03-19T06:05:46.524 INFO:tasks.workunit.client.0.smithi072.stdout:1/88: dread d1/f6 [0,4194304] 0 2024-03-19T06:05:46.526 INFO:tasks.workunit.client.1.smithi172.stdout:3/927: creat d0/da8/dce/d72/f131 x:0 0 0 2024-03-19T06:05:46.526 INFO:tasks.workunit.client.0.smithi072.stdout:1/89: dread - d1/f14 zero size 2024-03-19T06:05:46.527 INFO:tasks.workunit.client.1.smithi172.stdout:7/928: stat d0/d22/d27/d86/lfe 0 2024-03-19T06:05:46.528 INFO:tasks.workunit.client.1.smithi172.stdout:0/891: mkdir d11/d14/d2c/dc2/d12d 0 2024-03-19T06:05:46.530 INFO:tasks.workunit.client.1.smithi172.stdout:3/928: read d0/da8/d3a/f86 [3930986,23939] 0 2024-03-19T06:05:46.531 INFO:tasks.workunit.client.0.smithi072.stdout:1/90: write d1/d11/f1c [70687,63741] 0 2024-03-19T06:05:46.532 INFO:tasks.workunit.client.1.smithi172.stdout:9/880: stat d1/d7/dc/de/d34/d48/d82/d92/d95/db4/l113 0 2024-03-19T06:05:46.535 INFO:tasks.workunit.client.1.smithi172.stdout:3/929: creat d0/d5/d6b/f132 x:0 0 0 2024-03-19T06:05:46.536 INFO:tasks.workunit.client.1.smithi172.stdout:5/871: dread d5/d14/d15/d40/d6a/d7a/fa0 [0,4194304] 0 2024-03-19T06:05:46.536 INFO:tasks.workunit.client.1.smithi172.stdout:2/934: truncate d7/db/d2c/f38 1125030 0 2024-03-19T06:05:46.537 INFO:tasks.workunit.client.1.smithi172.stdout:0/892: creat d11/d22/d46/d84/f12e x:0 0 0 2024-03-19T06:05:46.538 INFO:tasks.workunit.client.1.smithi172.stdout:9/881: symlink d1/d7/dc/db7/l128 0 2024-03-19T06:05:46.539 INFO:tasks.workunit.client.1.smithi172.stdout:0/893: read - d11/d14/d2c/d36/f100 zero size 2024-03-19T06:05:46.541 INFO:tasks.workunit.client.1.smithi172.stdout:3/930: dread - d0/da8/d54/d77/ffc zero size 2024-03-19T06:05:46.541 INFO:tasks.workunit.client.1.smithi172.stdout:5/872: mknod d5/d14/d15/d40/d6a/c128 0 2024-03-19T06:05:46.541 INFO:tasks.workunit.client.1.smithi172.stdout:0/894: fdatasync d11/d22/d32/f58 0 2024-03-19T06:05:46.547 INFO:tasks.workunit.client.0.smithi072.stdout:1/91: dread d1/d11/f1c [0,4194304] 0 2024-03-19T06:05:46.548 INFO:tasks.workunit.client.1.smithi172.stdout:2/935: mknod d7/de/d58/d56/d89/db5/dca/c12f 0 2024-03-19T06:05:46.548 INFO:tasks.workunit.client.1.smithi172.stdout:5/873: creat d5/d3d/d60/f129 x:0 0 0 2024-03-19T06:05:46.551 INFO:tasks.workunit.client.1.smithi172.stdout:3/931: symlink d0/db0/db6/dc7/l133 0 2024-03-19T06:05:46.554 INFO:tasks.workunit.client.0.smithi072.stdout:1/92: rename d1/d11/d18/d19/d1a/l1b to d1/l1d 0 2024-03-19T06:05:46.555 INFO:tasks.workunit.client.1.smithi172.stdout:5/874: dread - d5/d1f/db4/db9/fd0 zero size 2024-03-19T06:05:46.561 INFO:tasks.workunit.client.1.smithi172.stdout:0/895: write d11/d18/da5/da8/fac [2675167,118738] 0 2024-03-19T06:05:46.563 INFO:tasks.workunit.client.1.smithi172.stdout:3/932: getdents d0/d12f 0 2024-03-19T06:05:46.565 INFO:tasks.workunit.client.1.smithi172.stdout:5/875: getdents d5/d14/d9f/d124 0 2024-03-19T06:05:46.565 INFO:tasks.workunit.client.1.smithi172.stdout:8/858: dread d0/f85 [0,4194304] 0 2024-03-19T06:05:46.566 INFO:tasks.workunit.client.1.smithi172.stdout:9/882: dread d1/d7/dc/de/d34/f45 [0,4194304] 0 2024-03-19T06:05:46.570 INFO:tasks.workunit.client.1.smithi172.stdout:4/927: dwrite df/d2b/d2d/dae/fba [0,4194304] 0 2024-03-19T06:05:46.570 INFO:tasks.workunit.client.1.smithi172.stdout:0/896: creat d11/d18/d38/f12f x:0 0 0 2024-03-19T06:05:46.571 INFO:tasks.workunit.client.1.smithi172.stdout:3/933: creat d0/f134 x:0 0 0 2024-03-19T06:05:46.571 INFO:tasks.workunit.client.1.smithi172.stdout:0/897: fsync f7 0 2024-03-19T06:05:46.572 INFO:tasks.workunit.client.1.smithi172.stdout:4/928: chown df/d11 28747 1 2024-03-19T06:05:46.572 INFO:tasks.workunit.client.1.smithi172.stdout:9/883: write d1/d7/dc/d47/da5/f10d [896863,79771] 0 2024-03-19T06:05:46.574 INFO:tasks.workunit.client.1.smithi172.stdout:0/898: chown d11/d18/da5 299923303 1 2024-03-19T06:05:46.577 INFO:tasks.workunit.client.1.smithi172.stdout:8/859: rename d0/d44/d46/d49/d26/cef to d0/d6f/c10c 0 2024-03-19T06:05:46.577 INFO:tasks.workunit.client.1.smithi172.stdout:9/884: chown d1/d7/dc/dbe/f33 1468153 1 2024-03-19T06:05:46.578 INFO:tasks.workunit.client.1.smithi172.stdout:0/899: fsync d11/d22/d46/d84/f93 0 2024-03-19T06:05:46.585 INFO:tasks.workunit.client.1.smithi172.stdout:8/860: creat d0/d44/d46/d49/d26/dc0/d76/dc3/f10d x:0 0 0 2024-03-19T06:05:46.589 INFO:tasks.workunit.client.1.smithi172.stdout:5/876: dwrite d5/d3d/d60/f129 [0,4194304] 0 2024-03-19T06:05:46.589 INFO:tasks.workunit.client.1.smithi172.stdout:0/900: link d11/d14/f11e d11/d18/d38/d3f/d43/d89/f130 0 2024-03-19T06:05:46.591 INFO:tasks.workunit.client.1.smithi172.stdout:8/861: mkdir d0/d61/d6a/d98/d10e 0 2024-03-19T06:05:46.591 INFO:tasks.workunit.client.1.smithi172.stdout:2/936: dread d7/f83 [0,4194304] 0 2024-03-19T06:05:46.593 INFO:tasks.workunit.client.1.smithi172.stdout:9/885: write d1/d7/dc/de/f7c [768201,42409] 0 2024-03-19T06:05:46.598 INFO:tasks.workunit.client.1.smithi172.stdout:5/877: write d5/d14/d15/d40/d6a/d7a/f11a [852791,110472] 0 2024-03-19T06:05:46.603 INFO:tasks.workunit.client.1.smithi172.stdout:9/886: readlink d1/d7/dc/de/d34/d48/l72 0 2024-03-19T06:05:46.605 INFO:tasks.workunit.client.1.smithi172.stdout:8/862: readlink d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/la8 0 2024-03-19T06:05:46.606 INFO:tasks.workunit.client.1.smithi172.stdout:5/878: mknod d5/d3c/d6c/c12a 0 2024-03-19T06:05:46.607 INFO:tasks.workunit.client.1.smithi172.stdout:3/934: dwrite d0/d5/d6b/dae/f123 [0,4194304] 0 2024-03-19T06:05:46.608 INFO:tasks.workunit.client.1.smithi172.stdout:0/901: write d11/d14/d9a/dea/fa0 [1535426,94282] 0 2024-03-19T06:05:46.608 INFO:tasks.workunit.client.1.smithi172.stdout:4/929: dwrite df/d11/f86 [4194304,4194304] 0 2024-03-19T06:05:46.611 INFO:tasks.workunit.client.1.smithi172.stdout:9/887: mknod d1/d7/dc/de/d34/d48/d82/c129 0 2024-03-19T06:05:46.615 INFO:tasks.workunit.client.1.smithi172.stdout:0/902: write d11/d22/d68/f63 [376424,44509] 0 2024-03-19T06:05:46.616 INFO:tasks.workunit.client.1.smithi172.stdout:5/879: rename d5/d14/d15 to d5/d14/d15/d12b 22 2024-03-19T06:05:46.626 INFO:tasks.workunit.client.1.smithi172.stdout:2/937: write d7/de/d58/d56/d89/de6/dbc/dc6/f114 [43885,11042] 0 2024-03-19T06:05:46.634 INFO:tasks.workunit.client.1.smithi172.stdout:4/930: dwrite df/f4d [0,4194304] 0 2024-03-19T06:05:46.651 INFO:tasks.workunit.client.1.smithi172.stdout:8/863: dread d0/f2 [0,4194304] 0 2024-03-19T06:05:46.656 INFO:tasks.workunit.client.1.smithi172.stdout:5/880: stat d5/d14/d15/l80 0 2024-03-19T06:05:46.657 INFO:tasks.workunit.client.1.smithi172.stdout:2/938: creat d7/db/d2c/d35/f130 x:0 0 0 2024-03-19T06:05:46.660 INFO:tasks.workunit.client.1.smithi172.stdout:9/888: mkdir d1/d7/dc/d47/da3/d12a 0 2024-03-19T06:05:46.661 INFO:tasks.workunit.client.1.smithi172.stdout:8/864: rename d0/d61/d6a/f93 to d0/d44/d46/d49/d26/f10f 0 2024-03-19T06:05:46.661 INFO:tasks.workunit.client.1.smithi172.stdout:9/889: stat d1/d7/dc/d47/d78/f79 0 2024-03-19T06:05:46.665 INFO:tasks.workunit.client.1.smithi172.stdout:1/906: sync 2024-03-19T06:05:46.665 INFO:tasks.workunit.client.1.smithi172.stdout:7/929: sync 2024-03-19T06:05:46.665 INFO:tasks.workunit.client.1.smithi172.stdout:2/939: read d7/de/d58/d56/fba [397089,89604] 0 2024-03-19T06:05:46.666 INFO:tasks.workunit.client.1.smithi172.stdout:0/903: creat d11/d22/f131 x:0 0 0 2024-03-19T06:05:46.670 INFO:tasks.workunit.client.1.smithi172.stdout:4/931: creat df/d11/d12/f127 x:0 0 0 2024-03-19T06:05:46.672 INFO:tasks.workunit.client.1.smithi172.stdout:9/890: unlink d1/c6b 0 2024-03-19T06:05:46.672 INFO:tasks.workunit.client.1.smithi172.stdout:5/881: dwrite d5/d14/d9f/fd7 [0,4194304] 0 2024-03-19T06:05:46.675 INFO:tasks.workunit.client.1.smithi172.stdout:9/891: chown d1/d7/dc/de/d34/d48/d89/ffc 781 1 2024-03-19T06:05:46.686 INFO:tasks.workunit.client.1.smithi172.stdout:1/907: rename da/d33/d4e/d60 to da/d33/d59/d13b 0 2024-03-19T06:05:46.687 INFO:tasks.workunit.client.1.smithi172.stdout:0/904: link d11/d18/da5/da8/fb1 d11/d14/d9a/dea/dab/dc1/dd9/f132 0 2024-03-19T06:05:46.689 INFO:tasks.workunit.client.1.smithi172.stdout:1/908: fsync da/dd/d31/dfb/d14/d27/d3f/fe1 0 2024-03-19T06:05:46.692 INFO:tasks.workunit.client.1.smithi172.stdout:7/930: dread d0/d22/d1d/d85/da8/dfa/d11a/d41/fc2 [0,4194304] 0 2024-03-19T06:05:46.694 INFO:tasks.workunit.client.1.smithi172.stdout:1/909: read da/dd/d31/dfb/f64 [151686,111326] 0 2024-03-19T06:05:46.699 INFO:tasks.workunit.client.1.smithi172.stdout:7/931: mkdir d0/d22/d1d/d36/d40/da2/d13d 0 2024-03-19T06:05:46.701 INFO:tasks.workunit.client.1.smithi172.stdout:1/910: mkdir da/d13c 0 2024-03-19T06:05:46.701 INFO:tasks.workunit.client.1.smithi172.stdout:5/882: write d5/d14/d9f/fea [4055065,122969] 0 2024-03-19T06:05:46.706 INFO:tasks.workunit.client.1.smithi172.stdout:3/935: dwrite d0/da8/d54/d77/f78 [0,4194304] 0 2024-03-19T06:05:46.715 INFO:tasks.workunit.client.1.smithi172.stdout:8/865: dwrite d0/d44/d46/f87 [0,4194304] 0 2024-03-19T06:05:46.718 INFO:tasks.workunit.client.1.smithi172.stdout:7/932: readlink d0/d22/d1d/d36/de9/l100 0 2024-03-19T06:05:46.720 INFO:tasks.workunit.client.1.smithi172.stdout:2/940: dwrite d7/de/f5d [0,4194304] 0 2024-03-19T06:05:46.722 INFO:tasks.workunit.client.1.smithi172.stdout:1/911: dread da/f5f [0,4194304] 0 2024-03-19T06:05:46.724 INFO:tasks.workunit.client.1.smithi172.stdout:2/941: chown d7/de/dfd 3 1 2024-03-19T06:05:46.724 INFO:tasks.workunit.client.1.smithi172.stdout:9/892: dwrite d1/f6 [0,4194304] 0 2024-03-19T06:05:46.725 INFO:tasks.workunit.client.1.smithi172.stdout:7/933: fdatasync d0/d22/d27/d104/f12d 0 2024-03-19T06:05:46.725 INFO:tasks.workunit.client.1.smithi172.stdout:4/932: getdents df/d11/d12/d21/d58 0 2024-03-19T06:05:46.728 INFO:tasks.workunit.client.1.smithi172.stdout:0/905: dwrite d11/d14/d2c/d8d/fe8 [0,4194304] 0 2024-03-19T06:05:46.733 INFO:tasks.workunit.client.1.smithi172.stdout:1/912: fdatasync da/dd/d31/dfb/d14/d27/d3f/d5e/dab/d127/f112 0 2024-03-19T06:05:46.735 INFO:tasks.workunit.client.1.smithi172.stdout:5/883: truncate d5/d14/d15/d40/d6a/f6d 4225921 0 2024-03-19T06:05:46.736 INFO:tasks.workunit.client.1.smithi172.stdout:8/866: truncate d0/d64/d80/f45 2988373 0 2024-03-19T06:05:46.737 INFO:tasks.workunit.client.1.smithi172.stdout:2/942: rmdir d7/de/d58/d55/d6e 39 2024-03-19T06:05:46.737 INFO:tasks.workunit.client.1.smithi172.stdout:4/933: truncate df/d11/f32 2813521 0 2024-03-19T06:05:46.739 INFO:tasks.workunit.client.1.smithi172.stdout:9/893: creat d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/f12b x:0 0 0 2024-03-19T06:05:46.745 INFO:tasks.workunit.client.1.smithi172.stdout:9/894: readlink d1/d7/dc/d47/d78/d54/d91/l6c 0 2024-03-19T06:05:46.752 INFO:tasks.workunit.client.0.smithi072.stdout:5/335: sync 2024-03-19T06:05:46.752 INFO:tasks.workunit.client.0.smithi072.stdout:4/175: sync 2024-03-19T06:05:46.753 INFO:tasks.workunit.client.0.smithi072.stdout:6/83: sync 2024-03-19T06:05:46.753 INFO:tasks.workunit.client.0.smithi072.stdout:9/92: sync 2024-03-19T06:05:46.753 INFO:tasks.workunit.client.0.smithi072.stdout:3/100: sync 2024-03-19T06:05:46.753 INFO:tasks.workunit.client.0.smithi072.stdout:7/122: sync 2024-03-19T06:05:46.755 INFO:tasks.workunit.client.1.smithi172.stdout:5/884: creat d5/d14/d48/f12c x:0 0 0 2024-03-19T06:05:46.758 INFO:tasks.workunit.client.1.smithi172.stdout:5/885: write d5/d14/d15/d40/d6a/d7a/f11a [1633379,78148] 0 2024-03-19T06:05:46.762 INFO:tasks.workunit.client.0.smithi072.stdout:3/101: rename d2/ca to d2/d3/c18 0 2024-03-19T06:05:46.762 INFO:tasks.workunit.client.1.smithi172.stdout:3/936: dread d0/da8/dce/fb3 [0,4194304] 0 2024-03-19T06:05:46.765 INFO:tasks.workunit.client.1.smithi172.stdout:9/895: dread d1/d7/dc/dbe/f9c [0,4194304] 0 2024-03-19T06:05:46.766 INFO:tasks.workunit.client.0.smithi072.stdout:4/176: mkdir d5/d15/d3f/d42 0 2024-03-19T06:05:46.766 INFO:tasks.workunit.client.1.smithi172.stdout:0/906: rename d11/d14/d2c/d4e/l76 to d11/d22/d32/l133 0 2024-03-19T06:05:46.769 INFO:tasks.workunit.client.0.smithi072.stdout:7/123: creat d2/d3/d18/d20/f28 x:0 0 0 2024-03-19T06:05:46.769 INFO:tasks.workunit.client.0.smithi072.stdout:9/93: dread fe [4194304,4194304] 0 2024-03-19T06:05:46.770 INFO:tasks.workunit.client.1.smithi172.stdout:1/913: mkdir da/d33/d13d 0 2024-03-19T06:05:46.773 INFO:tasks.workunit.client.0.smithi072.stdout:3/102: chown d2/f5 833687 1 2024-03-19T06:05:46.774 INFO:tasks.workunit.client.1.smithi172.stdout:4/934: unlink df/d11/f37 0 2024-03-19T06:05:46.774 INFO:tasks.workunit.client.1.smithi172.stdout:1/914: write da/d33/f12f [229148,37786] 0 2024-03-19T06:05:46.774 INFO:tasks.workunit.client.1.smithi172.stdout:1/915: chown da/dd/c11a 3603 1 2024-03-19T06:05:46.774 INFO:tasks.workunit.client.0.smithi072.stdout:9/94: mknod d11/c20 0 2024-03-19T06:05:46.776 INFO:tasks.workunit.client.1.smithi172.stdout:2/943: rename d7/db/d2c/d35/f117 to d7/da6/d12e/f131 0 2024-03-19T06:05:46.776 INFO:tasks.workunit.client.0.smithi072.stdout:7/124: rename d2/d3/cc to d2/d3/d17/c29 0 2024-03-19T06:05:46.777 INFO:tasks.workunit.client.1.smithi172.stdout:8/867: write d0/d44/d46/d49/d26/d71/d81/d27/d29/f4c [993446,81127] 0 2024-03-19T06:05:46.779 INFO:tasks.workunit.client.0.smithi072.stdout:5/336: unlink df/d13/c29 0 2024-03-19T06:05:46.780 INFO:tasks.workunit.client.0.smithi072.stdout:3/103: unlink f0 0 2024-03-19T06:05:46.780 INFO:tasks.workunit.client.1.smithi172.stdout:0/907: mkdir d11/d14/d2c/dc2/dcf/d134 0 2024-03-19T06:05:46.782 INFO:tasks.workunit.client.1.smithi172.stdout:4/935: creat df/dd7/f128 x:0 0 0 2024-03-19T06:05:46.785 INFO:tasks.workunit.client.1.smithi172.stdout:7/934: truncate d0/d22/d1d/d3a/d46/f78 3182038 0 2024-03-19T06:05:46.785 INFO:tasks.workunit.client.0.smithi072.stdout:5/337: creat df/d13/d24/f65 x:0 0 0 2024-03-19T06:05:46.786 INFO:tasks.workunit.client.0.smithi072.stdout:4/177: dwrite d5/d11/f1a [0,4194304] 0 2024-03-19T06:05:46.787 INFO:tasks.workunit.client.0.smithi072.stdout:5/338: fdatasync df/d14/d5d/f51 0 2024-03-19T06:05:46.792 INFO:tasks.workunit.client.0.smithi072.stdout:5/339: fsync df/d13/d32/d28/f37 0 2024-03-19T06:05:46.792 INFO:tasks.workunit.client.1.smithi172.stdout:9/896: creat d1/d7/dc/de/d34/dd7/d11c/f12c x:0 0 0 2024-03-19T06:05:46.794 INFO:tasks.workunit.client.1.smithi172.stdout:0/908: creat d11/d18/d38/d3f/d43/dc5/f135 x:0 0 0 2024-03-19T06:05:46.795 INFO:tasks.workunit.client.0.smithi072.stdout:7/125: dread d2/d5/f11 [0,4194304] 0 2024-03-19T06:05:46.799 INFO:tasks.workunit.client.0.smithi072.stdout:7/126: write d2/d5/f7 [3898649,15575] 0 2024-03-19T06:05:46.800 INFO:tasks.workunit.client.1.smithi172.stdout:3/937: link d0/da8/d3a/lab d0/da8/d34/d4d/dc5/df2/l135 0 2024-03-19T06:05:46.801 INFO:tasks.workunit.client.1.smithi172.stdout:2/944: write d7/de/d58/d56/d81/f9a [463093,35586] 0 2024-03-19T06:05:46.808 INFO:tasks.workunit.client.1.smithi172.stdout:0/909: read - d11/d18/d38/d3f/d43/d62/fce zero size 2024-03-19T06:05:46.809 INFO:tasks.workunit.client.1.smithi172.stdout:1/916: dread da/dd/d31/f34 [0,4194304] 0 2024-03-19T06:05:46.809 INFO:tasks.workunit.client.1.smithi172.stdout:5/886: dwrite d5/f27 [0,4194304] 0 2024-03-19T06:05:46.810 INFO:tasks.workunit.client.1.smithi172.stdout:2/945: unlink d7/c7c 0 2024-03-19T06:05:46.813 INFO:tasks.workunit.client.1.smithi172.stdout:7/935: write d0/d22/d1d/d36/d56/dc6/f130 [935218,46304] 0 2024-03-19T06:05:46.813 INFO:tasks.workunit.client.1.smithi172.stdout:0/910: chown d11/d18/d38/d3f/f6e 3154069 1 2024-03-19T06:05:46.814 INFO:tasks.workunit.client.1.smithi172.stdout:2/946: dread - d7/db/d2c/d35/d106/f10a zero size 2024-03-19T06:05:46.816 INFO:tasks.workunit.client.0.smithi072.stdout:4/178: dwrite d5/d11/f1a [0,4194304] 0 2024-03-19T06:05:46.817 INFO:tasks.workunit.client.1.smithi172.stdout:4/936: rename df/d11/d12/d21/d50/d63/dbb/dc4/dd3 to df/d11/d12/d21/d50/d63/d129 0 2024-03-19T06:05:46.819 INFO:tasks.workunit.client.0.smithi072.stdout:4/179: write d5/d15/d22/f27 [33845,79724] 0 2024-03-19T06:05:46.819 INFO:tasks.workunit.client.1.smithi172.stdout:0/911: readlink d11/d18/d38/d3f/d43/d62/l11c 0 2024-03-19T06:05:46.819 INFO:tasks.workunit.client.1.smithi172.stdout:3/938: mkdir d0/da8/d3a/d136 0 2024-03-19T06:05:46.822 INFO:tasks.workunit.client.0.smithi072.stdout:3/104: dread d2/d3/f10 [0,4194304] 0 2024-03-19T06:05:46.826 INFO:tasks.workunit.client.1.smithi172.stdout:3/939: fsync d0/d12f/f69 0 2024-03-19T06:05:46.827 INFO:tasks.workunit.client.1.smithi172.stdout:7/936: symlink d0/d22/d1d/d3a/d11f/d133/l13e 0 2024-03-19T06:05:46.828 INFO:tasks.workunit.client.1.smithi172.stdout:0/912: readlink d11/d18/d38/d3f/d43/d62/l11c 0 2024-03-19T06:05:46.831 INFO:tasks.workunit.client.1.smithi172.stdout:4/937: readlink df/d11/d12/d26/d84/da2/lf9 0 2024-03-19T06:05:46.835 INFO:tasks.workunit.client.1.smithi172.stdout:5/887: rename d5/d14/d15/d40/d6a/fba to d5/d55/de7/f12d 0 2024-03-19T06:05:46.835 INFO:tasks.workunit.client.0.smithi072.stdout:7/127: truncate d2/d3/fd 3881440 0 2024-03-19T06:05:46.838 INFO:tasks.workunit.client.1.smithi172.stdout:9/897: dwrite d1/d7/dc/de/d34/d48/d82/d92/d95/db4/de5/f127 [0,4194304] 0 2024-03-19T06:05:46.839 INFO:tasks.workunit.client.0.smithi072.stdout:4/180: unlink d5/f13 0 2024-03-19T06:05:46.841 INFO:tasks.workunit.client.1.smithi172.stdout:3/940: creat d0/d5/dfa/d130/f137 x:0 0 0 2024-03-19T06:05:46.841 INFO:tasks.workunit.client.1.smithi172.stdout:4/938: readlink df/d2b/d2d/d101/dc9/dca/le7 0 2024-03-19T06:05:46.847 INFO:tasks.workunit.client.1.smithi172.stdout:1/917: creat da/d3b/ddf/f13e x:0 0 0 2024-03-19T06:05:46.850 INFO:tasks.workunit.client.0.smithi072.stdout:7/128: mknod d2/d13/d1d/c2a 0 2024-03-19T06:05:46.850 INFO:tasks.workunit.client.1.smithi172.stdout:9/898: creat d1/d7/dc/dbe/d114/f12d x:0 0 0 2024-03-19T06:05:46.851 INFO:tasks.workunit.client.1.smithi172.stdout:2/947: dwrite d7/de/d58/d56/d81/f9a [0,4194304] 0 2024-03-19T06:05:46.855 INFO:tasks.workunit.client.0.smithi072.stdout:7/129: unlink d2/d13/l24 0 2024-03-19T06:05:46.860 INFO:tasks.workunit.client.0.smithi072.stdout:3/105: dwrite d2/f5 [0,4194304] 0 2024-03-19T06:05:46.866 INFO:tasks.workunit.client.1.smithi172.stdout:2/948: symlink d7/de/d58/d56/d89/de6/dbc/l132 0 2024-03-19T06:05:46.866 INFO:tasks.workunit.client.0.smithi072.stdout:7/130: mkdir d2/d13/d1d/d2b 0 2024-03-19T06:05:46.867 INFO:tasks.workunit.client.1.smithi172.stdout:9/899: read d1/f9 [66879,60749] 0 2024-03-19T06:05:46.868 INFO:tasks.workunit.client.1.smithi172.stdout:7/937: dwrite d0/d22/d1d/d36/d40/fb1 [0,4194304] 0 2024-03-19T06:05:46.868 INFO:tasks.workunit.client.1.smithi172.stdout:5/888: dwrite d5/d3c/d6c/d9b/d105/f107 [0,4194304] 0 2024-03-19T06:05:46.872 INFO:tasks.workunit.client.1.smithi172.stdout:5/889: truncate d5/d1f/f10f 1518 0 2024-03-19T06:05:46.878 INFO:tasks.workunit.client.1.smithi172.stdout:9/900: rename d1/d7/dc/de/c84 to d1/d7/dc/def/c12e 0 2024-03-19T06:05:46.879 INFO:tasks.workunit.client.0.smithi072.stdout:3/106: getdents d2/d3 0 2024-03-19T06:05:46.885 INFO:tasks.workunit.client.1.smithi172.stdout:2/949: creat d7/de/d58/d55/d6e/f133 x:0 0 0 2024-03-19T06:05:46.886 INFO:tasks.workunit.client.0.smithi072.stdout:3/107: write d2/d3/fb [1264641,28079] 0 2024-03-19T06:05:46.887 INFO:tasks.workunit.client.1.smithi172.stdout:7/938: creat d0/d22/d1d/d36/d40/da2/d13d/f13f x:0 0 0 2024-03-19T06:05:46.887 INFO:tasks.workunit.client.1.smithi172.stdout:2/950: fdatasync d7/db/d45/f121 0 2024-03-19T06:05:46.887 INFO:tasks.workunit.client.1.smithi172.stdout:4/939: write df/d2b/da3/fb4 [2648010,1828] 0 2024-03-19T06:05:46.891 INFO:tasks.workunit.client.0.smithi072.stdout:3/108: mkdir d2/d19 0 2024-03-19T06:05:46.894 INFO:tasks.workunit.client.1.smithi172.stdout:5/890: rename d5/d14/d15/d40/d5c/f9a to d5/d14/d15/d40/f12e 0 2024-03-19T06:05:46.897 INFO:tasks.workunit.client.0.smithi072.stdout:7/131: dwrite d2/f1a [0,4194304] 0 2024-03-19T06:05:46.898 INFO:tasks.workunit.client.1.smithi172.stdout:8/868: sync 2024-03-19T06:05:46.898 INFO:tasks.workunit.client.1.smithi172.stdout:0/913: dread d11/d18/d38/d3f/d8b/fa3 [0,4194304] 0 2024-03-19T06:05:46.899 INFO:tasks.workunit.client.1.smithi172.stdout:2/951: mkdir d7/de/d58/d55/d66/dc1/d134 0 2024-03-19T06:05:46.904 INFO:tasks.workunit.client.1.smithi172.stdout:0/914: write d11/d18/d38/f12f [310386,91468] 0 2024-03-19T06:05:46.904 INFO:tasks.workunit.client.1.smithi172.stdout:2/952: stat d7/de/d58/d55/d66/dc1/fed 0 2024-03-19T06:05:46.909 INFO:tasks.workunit.client.1.smithi172.stdout:9/901: rename d1/d7/dc/dbe/dc9/fda to d1/f12f 0 2024-03-19T06:05:46.909 INFO:tasks.workunit.client.1.smithi172.stdout:8/869: mknod d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/c110 0 2024-03-19T06:05:46.910 INFO:tasks.workunit.client.1.smithi172.stdout:3/941: dread d0/da8/d34/d4d/f4a [4194304,4194304] 0 2024-03-19T06:05:46.913 INFO:tasks.workunit.client.0.smithi072.stdout:3/109: dwrite f1 [0,4194304] 0 2024-03-19T06:05:46.914 INFO:tasks.workunit.client.1.smithi172.stdout:4/940: getdents df/d11/d12/d6e 0 2024-03-19T06:05:46.915 INFO:tasks.workunit.client.1.smithi172.stdout:0/915: chown d11/d22/d68/ff4 0 1 2024-03-19T06:05:46.918 INFO:tasks.workunit.client.1.smithi172.stdout:4/941: chown df/d11/d12/d26/daf/ccf 108 1 2024-03-19T06:05:46.919 INFO:tasks.workunit.client.1.smithi172.stdout:0/916: write d11/d22/d32/daf/f113 [986822,128178] 0 2024-03-19T06:05:46.924 INFO:tasks.workunit.client.1.smithi172.stdout:3/942: mkdir d0/d5/dfa/d130/d138 0 2024-03-19T06:05:46.925 INFO:tasks.workunit.client.1.smithi172.stdout:1/918: dread da/dd/d31/dfb/d14/f100 [0,4194304] 0 2024-03-19T06:05:46.928 INFO:tasks.workunit.client.1.smithi172.stdout:3/943: dread - d0/da8/d54/d90/fcd zero size 2024-03-19T06:05:46.929 INFO:tasks.workunit.client.1.smithi172.stdout:9/902: rename d1/d7/dc/dbe/d65/d10a to d1/d7/dc/d47/d78/d54/d91/d130 0 2024-03-19T06:05:46.929 INFO:tasks.workunit.client.0.smithi072.stdout:7/132: write d2/d3/fd [4651077,34938] 0 2024-03-19T06:05:46.930 INFO:tasks.workunit.client.0.smithi072.stdout:3/110: dread d2/f5 [0,4194304] 0 2024-03-19T06:05:46.932 INFO:tasks.workunit.client.1.smithi172.stdout:3/944: chown d0/da8/d34/d4d/d103 0 1 2024-03-19T06:05:46.932 INFO:tasks.workunit.client.1.smithi172.stdout:7/939: dwrite d0/d22/d1d/d36/d40/f5f [0,4194304] 0 2024-03-19T06:05:46.932 INFO:tasks.workunit.client.0.smithi072.stdout:3/111: fsync d2/d3/fc 0 2024-03-19T06:05:46.936 INFO:tasks.workunit.client.0.smithi072.stdout:7/133: getdents d2/d13/d1d/d2b 0 2024-03-19T06:05:46.937 INFO:tasks.workunit.client.1.smithi172.stdout:8/870: write d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/f8a [1990796,65018] 0 2024-03-19T06:05:46.938 INFO:tasks.workunit.client.0.smithi072.stdout:7/134: chown d2/d5/cb 8977 1 2024-03-19T06:05:46.940 INFO:tasks.workunit.client.1.smithi172.stdout:4/942: creat df/d11/d12/d69/f12a x:0 0 0 2024-03-19T06:05:46.942 INFO:tasks.workunit.client.1.smithi172.stdout:3/945: fsync d0/d5/f11 0 2024-03-19T06:05:46.944 INFO:tasks.workunit.client.0.smithi072.stdout:3/112: unlink d2/cf 0 2024-03-19T06:05:46.945 INFO:tasks.workunit.client.1.smithi172.stdout:8/871: chown d0/f9 725676302 1 2024-03-19T06:05:46.948 INFO:tasks.workunit.client.1.smithi172.stdout:3/946: fdatasync d0/d12f/f84 0 2024-03-19T06:05:46.948 INFO:tasks.workunit.client.1.smithi172.stdout:2/953: dwrite d7/db/d2c/d35/fac [0,4194304] 0 2024-03-19T06:05:46.949 INFO:tasks.workunit.client.1.smithi172.stdout:9/903: write d1/db9/fd9 [3594449,57852] 0 2024-03-19T06:05:46.951 INFO:tasks.workunit.client.1.smithi172.stdout:4/943: fdatasync df/d11/d12/d21/d50/fc3 0 2024-03-19T06:05:46.955 INFO:tasks.workunit.client.1.smithi172.stdout:7/940: rename d0/l53 to d0/d22/d1d/d85/da8/dfa/d11a/dfb/l140 0 2024-03-19T06:05:46.955 INFO:tasks.workunit.client.0.smithi072.stdout:7/135: dread d2/f1a [0,4194304] 0 2024-03-19T06:05:46.956 INFO:tasks.workunit.client.1.smithi172.stdout:0/917: getdents d11/d14/d9a/dea/dab/dc1/dd9/de4 0 2024-03-19T06:05:46.957 INFO:tasks.workunit.client.1.smithi172.stdout:1/919: truncate da/dd/d31/dfb/d36/f121 465571 0 2024-03-19T06:05:46.958 INFO:tasks.workunit.client.1.smithi172.stdout:5/891: dread d5/d14/f7b [4194304,4194304] 0 2024-03-19T06:05:46.960 INFO:tasks.workunit.client.1.smithi172.stdout:3/947: truncate d0/da8/d34/d4d/f4a 6554199 0 2024-03-19T06:05:46.961 INFO:tasks.workunit.client.1.smithi172.stdout:4/944: truncate df/d2b/d44/fe5 265394 0 2024-03-19T06:05:46.962 INFO:tasks.workunit.client.0.smithi072.stdout:7/136: fdatasync d2/d5/f11 0 2024-03-19T06:05:46.963 INFO:tasks.workunit.client.1.smithi172.stdout:7/941: write d0/d22/d1d/d36/d56/f112 [137766,61254] 0 2024-03-19T06:05:46.965 INFO:tasks.workunit.client.1.smithi172.stdout:0/918: truncate d11/f83 2140963 0 2024-03-19T06:05:46.965 INFO:tasks.workunit.client.1.smithi172.stdout:1/920: truncate da/dd/d31/dfb/d36/f121 953700 0 2024-03-19T06:05:46.965 INFO:tasks.workunit.client.0.smithi072.stdout:3/113: dwrite d2/f5 [0,4194304] 0 2024-03-19T06:05:46.965 INFO:tasks.workunit.client.1.smithi172.stdout:3/948: truncate d0/d12f/dfe/f119 940124 0 2024-03-19T06:05:46.968 INFO:tasks.workunit.client.0.smithi072.stdout:7/137: symlink d2/d3/l2c 0 2024-03-19T06:05:46.971 INFO:tasks.workunit.client.0.smithi072.stdout:3/114: mknod d2/d19/c1a 0 2024-03-19T06:05:46.975 INFO:tasks.workunit.client.1.smithi172.stdout:0/919: unlink d11/d22/d46/d84/ffe 0 2024-03-19T06:05:46.975 INFO:tasks.workunit.client.0.smithi072.stdout:3/115: symlink d2/d3/l1b 0 2024-03-19T06:05:46.977 INFO:tasks.workunit.client.1.smithi172.stdout:3/949: mknod d0/d5/d6b/dae/db9/c139 0 2024-03-19T06:05:46.978 INFO:tasks.workunit.client.1.smithi172.stdout:0/920: read d11/f13 [2724017,45203] 0 2024-03-19T06:05:46.978 INFO:tasks.workunit.client.1.smithi172.stdout:2/954: write d7/de/d58/d56/fba [1633517,24485] 0 2024-03-19T06:05:46.979 INFO:tasks.workunit.client.1.smithi172.stdout:8/872: truncate d0/d44/d46/f60 1288595 0 2024-03-19T06:05:46.980 INFO:tasks.workunit.client.1.smithi172.stdout:9/904: rename d1/d7/dc/de/d34/dd7/d11c/f12c to d1/d7/dc/de/f131 0 2024-03-19T06:05:46.981 INFO:tasks.workunit.client.0.smithi072.stdout:7/138: rmdir d2/d5/d21/d22 0 2024-03-19T06:05:46.983 INFO:tasks.workunit.client.1.smithi172.stdout:4/945: truncate df/d2b/f3b 1152794 0 2024-03-19T06:05:46.985 INFO:tasks.workunit.client.1.smithi172.stdout:5/892: getdents d5/d55 0 2024-03-19T06:05:46.989 INFO:tasks.workunit.client.1.smithi172.stdout:2/955: write d7/de/d58/d56/d86/f92 [425944,130108] 0 2024-03-19T06:05:46.993 INFO:tasks.workunit.client.1.smithi172.stdout:9/905: mkdir d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/d132 0 2024-03-19T06:05:46.997 INFO:tasks.workunit.client.0.smithi072.stdout:7/139: truncate d2/f1a 2863877 0 2024-03-19T06:05:46.999 INFO:tasks.workunit.client.1.smithi172.stdout:2/956: truncate d7/de/d58/d56/d89/de6/f113 434493 0 2024-03-19T06:05:47.001 INFO:tasks.workunit.client.0.smithi072.stdout:3/116: mkdir d2/d3/d15/d1c 0 2024-03-19T06:05:47.002 INFO:tasks.workunit.client.1.smithi172.stdout:5/893: dread d5/d3c/f5a [0,4194304] 0 2024-03-19T06:05:47.005 INFO:tasks.workunit.client.1.smithi172.stdout:9/906: getdents d1/d7/dc/db7 0 2024-03-19T06:05:47.005 INFO:tasks.workunit.client.1.smithi172.stdout:7/942: dread d0/d22/d1d/d36/f39 [0,4194304] 0 2024-03-19T06:05:47.005 INFO:tasks.workunit.client.1.smithi172.stdout:2/957: symlink d7/de/dfd/l135 0 2024-03-19T06:05:47.006 INFO:tasks.workunit.client.1.smithi172.stdout:1/921: rename da/dd/d31/dfb/d14/d27/c65 to da/c13f 0 2024-03-19T06:05:47.007 INFO:tasks.workunit.client.1.smithi172.stdout:5/894: write d5/d3d/f8d [5030243,14712] 0 2024-03-19T06:05:47.008 INFO:tasks.workunit.client.1.smithi172.stdout:3/950: dread d0/d5/f11 [0,4194304] 0 2024-03-19T06:05:47.010 INFO:tasks.workunit.client.0.smithi072.stdout:3/117: unlink d2/c4 0 2024-03-19T06:05:47.011 INFO:tasks.workunit.client.0.smithi072.stdout:7/140: write d2/d5/f11 [802608,27376] 0 2024-03-19T06:05:47.013 INFO:tasks.workunit.client.0.smithi072.stdout:7/141: chown d2/d3/fd 81428 1 2024-03-19T06:05:47.013 INFO:tasks.workunit.client.1.smithi172.stdout:0/921: rename d11/d14/d9a/cd8 to d11/d14/c136 0 2024-03-19T06:05:47.014 INFO:tasks.workunit.client.1.smithi172.stdout:9/907: read d1/d7/dc/d47/d78/d54/fc8 [768032,7061] 0 2024-03-19T06:05:47.014 INFO:tasks.workunit.client.1.smithi172.stdout:5/895: mknod d5/d3d/d60/d10d/c12f 0 2024-03-19T06:05:47.015 INFO:tasks.workunit.client.1.smithi172.stdout:1/922: fdatasync da/dd/d31/dfb/d14/d27/d3f/d5e/f76 0 2024-03-19T06:05:47.016 INFO:tasks.workunit.client.1.smithi172.stdout:2/958: dread d7/de/d58/d57/fd4 [0,4194304] 0 2024-03-19T06:05:47.017 INFO:tasks.workunit.client.1.smithi172.stdout:8/873: rename d0/d44/d46/d49/d26/d71/c104 to d0/d61/d6a/d9f/c111 0 2024-03-19T06:05:47.018 INFO:tasks.workunit.client.0.smithi072.stdout:7/142: creat d2/d3/d18/f2d x:0 0 0 2024-03-19T06:05:47.019 INFO:tasks.workunit.client.1.smithi172.stdout:2/959: stat d7/db/f13 0 2024-03-19T06:05:47.020 INFO:tasks.workunit.client.1.smithi172.stdout:5/896: symlink d5/d1f/d2f/d53/l130 0 2024-03-19T06:05:47.021 INFO:tasks.workunit.client.1.smithi172.stdout:4/946: rename df/d11/d12/d21/f122 to df/d11/d12/d21/d50/d63/dbb/f12b 0 2024-03-19T06:05:47.021 INFO:tasks.workunit.client.0.smithi072.stdout:3/118: rename d2/d3/l11 to d2/l1d 0 2024-03-19T06:05:47.022 INFO:tasks.workunit.client.1.smithi172.stdout:8/874: dread - d0/d44/d46/d49/d26/dc0/d3d/d83/fe1 zero size 2024-03-19T06:05:47.024 INFO:tasks.workunit.client.0.smithi072.stdout:3/119: rmdir d2/d19 39 2024-03-19T06:05:47.024 INFO:tasks.workunit.client.1.smithi172.stdout:9/908: creat d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/f133 x:0 0 0 2024-03-19T06:05:47.024 INFO:tasks.workunit.client.1.smithi172.stdout:0/922: creat d11/d22/d46/f137 x:0 0 0 2024-03-19T06:05:47.024 INFO:tasks.workunit.client.1.smithi172.stdout:2/960: creat d7/d1b/f136 x:0 0 0 2024-03-19T06:05:47.025 INFO:tasks.workunit.client.1.smithi172.stdout:5/897: mknod d5/d14/d56/c131 0 2024-03-19T06:05:47.025 INFO:tasks.workunit.client.1.smithi172.stdout:1/923: mkdir da/dd/d140 0 2024-03-19T06:05:47.027 INFO:tasks.workunit.client.1.smithi172.stdout:3/951: getdents d0/da8/d3a 0 2024-03-19T06:05:47.028 INFO:tasks.workunit.client.0.smithi072.stdout:3/120: mkdir d2/d19/d1e 0 2024-03-19T06:05:47.028 INFO:tasks.workunit.client.1.smithi172.stdout:9/909: dread - d1/d7/dc/de/f131 zero size 2024-03-19T06:05:47.030 INFO:tasks.workunit.client.0.smithi072.stdout:3/121: symlink d2/l1f 0 2024-03-19T06:05:47.036 INFO:tasks.workunit.client.0.smithi072.stdout:3/122: mknod d2/d3/d15/c20 0 2024-03-19T06:05:47.044 INFO:tasks.workunit.client.0.smithi072.stdout:3/123: dread d2/f5 [0,4194304] 0 2024-03-19T06:05:47.055 INFO:tasks.workunit.client.0.smithi072.stdout:8/97: sync 2024-03-19T06:05:47.055 INFO:tasks.workunit.client.0.smithi072.stdout:0/98: sync 2024-03-19T06:05:47.056 INFO:tasks.workunit.client.1.smithi172.stdout:7/943: rename d0/d22/d1d/d36/d56/f6c to d0/d22/d27/ded/f141 0 2024-03-19T06:05:47.058 INFO:tasks.workunit.client.0.smithi072.stdout:8/98: truncate da/d13/f16 5079361 0 2024-03-19T06:05:47.062 INFO:tasks.workunit.client.1.smithi172.stdout:2/961: mkdir d7/de/d58/d56/d86/d9e/d137 0 2024-03-19T06:05:47.063 INFO:tasks.workunit.client.0.smithi072.stdout:3/124: dwrite d2/d3/fb [4194304,4194304] 0 2024-03-19T06:05:47.064 INFO:tasks.workunit.client.1.smithi172.stdout:5/898: stat d5/f1d 0 2024-03-19T06:05:47.065 INFO:tasks.workunit.client.0.smithi072.stdout:3/125: chown f1 426351149 1 2024-03-19T06:05:47.065 INFO:tasks.workunit.client.1.smithi172.stdout:4/947: dread df/d11/d12/d26/f61 [0,4194304] 0 2024-03-19T06:05:47.069 INFO:tasks.workunit.client.1.smithi172.stdout:7/944: creat d0/d22/d1d/d85/d10f/f142 x:0 0 0 2024-03-19T06:05:47.070 INFO:tasks.workunit.client.0.smithi072.stdout:0/99: dread d1/fe [0,4194304] 0 2024-03-19T06:05:47.071 INFO:tasks.workunit.client.1.smithi172.stdout:0/923: symlink d11/l138 0 2024-03-19T06:05:47.074 INFO:tasks.workunit.client.1.smithi172.stdout:3/952: mkdir d0/db0/db6/dc7/de0/d13a 0 2024-03-19T06:05:47.075 INFO:tasks.workunit.client.1.smithi172.stdout:9/910: dread d1/fa [0,4194304] 0 2024-03-19T06:05:47.076 INFO:tasks.workunit.client.1.smithi172.stdout:5/899: creat d5/d14/d34/f132 x:0 0 0 2024-03-19T06:05:47.079 INFO:tasks.workunit.client.1.smithi172.stdout:5/900: write d5/d14/d9f/fea [2420284,83147] 0 2024-03-19T06:05:47.080 INFO:tasks.workunit.client.1.smithi172.stdout:0/924: creat d11/d18/d123/f139 x:0 0 0 2024-03-19T06:05:47.081 INFO:tasks.workunit.client.1.smithi172.stdout:7/945: rename d0/d22/d1d/d36/l24 to d0/d22/d27/l143 0 2024-03-19T06:05:47.081 INFO:tasks.workunit.client.1.smithi172.stdout:2/962: dwrite d7/f8 [4194304,4194304] 0 2024-03-19T06:05:47.082 INFO:tasks.workunit.client.1.smithi172.stdout:3/953: creat d0/da8/d25/f13b x:0 0 0 2024-03-19T06:05:47.085 INFO:tasks.workunit.client.1.smithi172.stdout:8/875: getdents d0/d44/d46/d49/d26/d71/d81/d27/d65 0 2024-03-19T06:05:47.086 INFO:tasks.workunit.client.0.smithi072.stdout:3/126: dread d2/d3/f10 [4194304,4194304] 0 2024-03-19T06:05:47.091 INFO:tasks.workunit.client.1.smithi172.stdout:5/901: mkdir d5/d3d/dd6/d100/d133 0 2024-03-19T06:05:47.091 INFO:tasks.workunit.client.1.smithi172.stdout:9/911: rename d1/d7/dc/d47/d78/lb0 to d1/d7/dc/dbe/d65/l134 0 2024-03-19T06:05:47.092 INFO:tasks.workunit.client.1.smithi172.stdout:7/946: stat d0/d22/d1d/d36/c19 0 2024-03-19T06:05:47.094 INFO:tasks.workunit.client.1.smithi172.stdout:2/963: read - d7/da6/fd9 zero size 2024-03-19T06:05:47.094 INFO:tasks.workunit.client.0.smithi072.stdout:0/100: dwrite d1/d1c/f1d [0,4194304] 0 2024-03-19T06:05:47.099 INFO:tasks.workunit.client.1.smithi172.stdout:5/902: chown d5/d3c/d6c/l6e 1355 1 2024-03-19T06:05:47.101 INFO:tasks.workunit.client.1.smithi172.stdout:8/876: dread d0/d44/d46/d49/d26/f51 [0,4194304] 0 2024-03-19T06:05:47.102 INFO:tasks.workunit.client.0.smithi072.stdout:0/101: symlink d1/l1e 0 2024-03-19T06:05:47.105 INFO:tasks.workunit.client.0.smithi072.stdout:0/102: write d1/f14 [4764184,46732] 0 2024-03-19T06:05:47.108 INFO:tasks.workunit.client.1.smithi172.stdout:9/912: mkdir d1/d7/d135 0 2024-03-19T06:05:47.108 INFO:tasks.workunit.client.0.smithi072.stdout:3/127: dwrite f1 [0,4194304] 0 2024-03-19T06:05:47.110 INFO:tasks.workunit.client.1.smithi172.stdout:2/964: rmdir d7/de/d58/d55/d6e 39 2024-03-19T06:05:47.110 INFO:tasks.workunit.client.0.smithi072.stdout:0/103: write d1/d1c/f1d [4595646,451] 0 2024-03-19T06:05:47.112 INFO:tasks.workunit.client.1.smithi172.stdout:3/954: rename d0/da8/dce/da7/c92 to d0/da8/d54/c13c 0 2024-03-19T06:05:47.112 INFO:tasks.workunit.client.1.smithi172.stdout:4/948: write df/d11/d12/f1a [5214615,58022] 0 2024-03-19T06:05:47.113 INFO:tasks.workunit.client.0.smithi072.stdout:0/104: truncate d1/f1b 864109 0 2024-03-19T06:05:47.114 INFO:tasks.workunit.client.0.smithi072.stdout:3/128: symlink d2/d19/l21 0 2024-03-19T06:05:47.116 INFO:tasks.workunit.client.0.smithi072.stdout:0/105: truncate d1/f19 340216 0 2024-03-19T06:05:47.117 INFO:tasks.workunit.client.0.smithi072.stdout:0/106: fsync d1/fb 0 2024-03-19T06:05:47.118 INFO:tasks.workunit.client.0.smithi072.stdout:3/129: creat d2/d3/d15/d1c/f22 x:0 0 0 2024-03-19T06:05:47.119 INFO:tasks.workunit.client.1.smithi172.stdout:4/949: chown df/d2b/f57 10 1 2024-03-19T06:05:47.122 INFO:tasks.workunit.client.1.smithi172.stdout:8/877: symlink d0/l112 0 2024-03-19T06:05:47.123 INFO:tasks.workunit.client.0.smithi072.stdout:0/107: symlink d1/l1f 0 2024-03-19T06:05:47.123 INFO:tasks.workunit.client.0.smithi072.stdout:3/130: truncate d2/d3/fc 1451435 0 2024-03-19T06:05:47.127 INFO:tasks.workunit.client.1.smithi172.stdout:2/965: creat d7/de/d58/d55/d6e/f138 x:0 0 0 2024-03-19T06:05:47.127 INFO:tasks.workunit.client.0.smithi072.stdout:0/108: symlink d1/d1c/l20 0 2024-03-19T06:05:47.127 INFO:tasks.workunit.client.1.smithi172.stdout:5/903: dwrite d5/d1f/d2f/fca [0,4194304] 0 2024-03-19T06:05:47.129 INFO:tasks.workunit.client.0.smithi072.stdout:3/131: rename d2/d3/fc to d2/d3/d15/d1c/f23 0 2024-03-19T06:05:47.130 INFO:tasks.workunit.client.1.smithi172.stdout:9/913: write d1/d7/dc/d47/fd0 [57522,89585] 0 2024-03-19T06:05:47.131 INFO:tasks.workunit.client.1.smithi172.stdout:4/950: fdatasync df/d11/f32 0 2024-03-19T06:05:47.132 INFO:tasks.workunit.client.1.smithi172.stdout:0/925: dwrite f6 [0,4194304] 0 2024-03-19T06:05:47.134 INFO:tasks.workunit.client.0.smithi072.stdout:0/109: rename d1/l1e to d1/d1c/l21 0 2024-03-19T06:05:47.136 INFO:tasks.workunit.client.1.smithi172.stdout:2/966: readlink d7/de/d58/d56/d89/de6/dbc/l132 0 2024-03-19T06:05:47.139 INFO:tasks.workunit.client.1.smithi172.stdout:7/947: dwrite d0/d22/d27/db0/fe8 [0,4194304] 0 2024-03-19T06:05:47.142 INFO:tasks.workunit.client.1.smithi172.stdout:5/904: chown d5/d55/de7/f12d 162873 1 2024-03-19T06:05:47.143 INFO:tasks.workunit.client.1.smithi172.stdout:2/967: symlink d7/de/d58/d56/d89/de6/dbc/l139 0 2024-03-19T06:05:47.145 INFO:tasks.workunit.client.0.smithi072.stdout:0/110: rename d1/l12 to d1/d1c/l22 0 2024-03-19T06:05:47.147 INFO:tasks.workunit.client.0.smithi072.stdout:0/111: stat d1/fe 0 2024-03-19T06:05:47.147 INFO:tasks.workunit.client.1.smithi172.stdout:2/968: write d7/da6/f12b [489115,122330] 0 2024-03-19T06:05:47.149 INFO:tasks.workunit.client.1.smithi172.stdout:4/951: dread df/d11/d12/d26/f61 [0,4194304] 0 2024-03-19T06:05:47.149 INFO:tasks.workunit.client.1.smithi172.stdout:8/878: rename d0/d44/d46/d49/d26/l82 to d0/d44/d46/d49/d26/dc0/dbf/l113 0 2024-03-19T06:05:47.151 INFO:tasks.workunit.client.1.smithi172.stdout:4/952: chown df/d11/d12/d26/ff4 121148373 1 2024-03-19T06:05:47.151 INFO:tasks.workunit.client.1.smithi172.stdout:0/926: creat d11/d14/d2c/d36/f13a x:0 0 0 2024-03-19T06:05:47.153 INFO:tasks.workunit.client.1.smithi172.stdout:0/927: stat d11/d22/d68/f75 0 2024-03-19T06:05:47.153 INFO:tasks.workunit.client.1.smithi172.stdout:3/955: truncate d0/da8/dce/da7/f94 3928947 0 2024-03-19T06:05:47.155 INFO:tasks.workunit.client.1.smithi172.stdout:5/905: creat d5/d1f/db4/db9/f134 x:0 0 0 2024-03-19T06:05:47.156 INFO:tasks.workunit.client.1.smithi172.stdout:7/948: mknod d0/d22/d1d/d3a/d46/d103/c144 0 2024-03-19T06:05:47.156 INFO:tasks.workunit.client.1.smithi172.stdout:9/914: dread d1/f56 [0,4194304] 0 2024-03-19T06:05:47.157 INFO:tasks.workunit.client.1.smithi172.stdout:5/906: dread - d5/d14/d48/f12c zero size 2024-03-19T06:05:47.157 INFO:tasks.workunit.client.0.smithi072.stdout:3/132: rename d2/d3/c18 to d2/c24 0 2024-03-19T06:05:47.158 INFO:tasks.workunit.client.1.smithi172.stdout:2/969: mknod d7/da6/d12e/c13a 0 2024-03-19T06:05:47.158 INFO:tasks.workunit.client.0.smithi072.stdout:3/133: chown d2 0 1 2024-03-19T06:05:47.159 INFO:tasks.workunit.client.1.smithi172.stdout:8/879: mknod d0/d44/d46/d49/d26/d71/d81/c114 0 2024-03-19T06:05:47.160 INFO:tasks.workunit.client.1.smithi172.stdout:0/928: mknod d11/d14/ded/c13b 0 2024-03-19T06:05:47.160 INFO:tasks.workunit.client.1.smithi172.stdout:5/907: chown d5/d14/d15/d40/d6a/f10c 478343130 1 2024-03-19T06:05:47.162 INFO:tasks.workunit.client.1.smithi172.stdout:0/929: chown d11/d18/d38/d3f/d43/d89 25410 1 2024-03-19T06:05:47.163 INFO:tasks.workunit.client.0.smithi072.stdout:0/112: rename d1/fe to d1/d1c/f23 0 2024-03-19T06:05:47.164 INFO:tasks.workunit.client.1.smithi172.stdout:2/970: truncate d7/de/d58/d55/d6e/da5/fc8 201822 0 2024-03-19T06:05:47.164 INFO:tasks.workunit.client.1.smithi172.stdout:3/956: symlink d0/d5/df8/l13d 0 2024-03-19T06:05:47.166 INFO:tasks.workunit.client.1.smithi172.stdout:0/930: truncate d11/d22/d68/f75 4497308 0 2024-03-19T06:05:47.168 INFO:tasks.workunit.client.1.smithi172.stdout:5/908: symlink d5/d1f/d10e/l135 0 2024-03-19T06:05:47.169 INFO:tasks.workunit.client.1.smithi172.stdout:9/915: creat d1/d7/dc/d47/f136 x:0 0 0 2024-03-19T06:05:47.170 INFO:tasks.workunit.client.1.smithi172.stdout:0/931: symlink d11/d18/d38/d3f/d8b/l13c 0 2024-03-19T06:05:47.170 INFO:tasks.workunit.client.1.smithi172.stdout:5/909: fdatasync d5/d14/d9f/f11c 0 2024-03-19T06:05:47.172 INFO:tasks.workunit.client.1.smithi172.stdout:9/916: unlink d1/db9/fc6 0 2024-03-19T06:05:47.173 INFO:tasks.workunit.client.1.smithi172.stdout:0/932: chown d11/d18/d38/d3f/d43/d62/dc0/lf3 10702374 1 2024-03-19T06:05:47.177 INFO:tasks.workunit.client.1.smithi172.stdout:5/910: creat d5/d3c/d6c/f136 x:0 0 0 2024-03-19T06:05:47.178 INFO:tasks.workunit.client.1.smithi172.stdout:9/917: write d1/d7/dc/de/f131 [478879,84865] 0 2024-03-19T06:05:47.178 INFO:tasks.workunit.client.1.smithi172.stdout:0/933: mknod d11/d14/d2c/d36/c13d 0 2024-03-19T06:05:47.179 INFO:tasks.workunit.client.0.smithi072.stdout:3/134: readlink d2/d3/l1b 0 2024-03-19T06:05:47.184 INFO:tasks.workunit.client.1.smithi172.stdout:0/934: creat d11/d14/db7/f13e x:0 0 0 2024-03-19T06:05:47.184 INFO:tasks.workunit.client.0.smithi072.stdout:0/113: getdents d1/d1c 0 2024-03-19T06:05:47.186 INFO:tasks.workunit.client.1.smithi172.stdout:3/957: dwrite d0/d5/dfa/d130/f137 [0,4194304] 0 2024-03-19T06:05:47.190 INFO:tasks.workunit.client.1.smithi172.stdout:3/958: write d0/da8/d25/f58 [1687165,103773] 0 2024-03-19T06:05:47.190 INFO:tasks.workunit.client.1.smithi172.stdout:7/949: write d0/d22/d4b/faa [5944,6835] 0 2024-03-19T06:05:47.192 INFO:tasks.workunit.client.1.smithi172.stdout:8/880: stat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3/ff2 0 2024-03-19T06:05:47.192 INFO:tasks.workunit.client.1.smithi172.stdout:2/971: dread d7/de/d58/d56/d86/d9d/dab/f10b [0,4194304] 0 2024-03-19T06:05:47.193 INFO:tasks.workunit.client.0.smithi072.stdout:0/114: truncate d1/f14 2191759 0 2024-03-19T06:05:47.194 INFO:tasks.workunit.client.1.smithi172.stdout:8/881: readlink d0/d44/d46/d49/d4f/lcf 0 2024-03-19T06:05:47.196 INFO:tasks.workunit.client.1.smithi172.stdout:0/935: creat d11/d18/d38/d3f/d43/d62/dc0/f13f x:0 0 0 2024-03-19T06:05:47.201 INFO:tasks.workunit.client.1.smithi172.stdout:3/959: dread - d0/da8/d54/d90/fe3 zero size 2024-03-19T06:05:47.202 INFO:tasks.workunit.client.1.smithi172.stdout:2/972: fdatasync d7/de/d58/d57/fd4 0 2024-03-19T06:05:47.204 INFO:tasks.workunit.client.1.smithi172.stdout:9/918: dread d1/d7/dc/d47/da5/f10d [0,4194304] 0 2024-03-19T06:05:47.204 INFO:tasks.workunit.client.1.smithi172.stdout:8/882: rename d0/d6f to d0/d44/d46/d49/d26/dc0/dbf/d115 0 2024-03-19T06:05:47.207 INFO:tasks.workunit.client.1.smithi172.stdout:9/919: dread - d1/d7/dc/fb1 zero size 2024-03-19T06:05:47.208 INFO:tasks.workunit.client.1.smithi172.stdout:0/936: truncate d11/d18/d38/d3f/d43/d62/f74 3142549 0 2024-03-19T06:05:47.211 INFO:tasks.workunit.client.1.smithi172.stdout:2/973: dread d7/de/d58/d56/d89/de6/dbc/dc6/f114 [0,4194304] 0 2024-03-19T06:05:47.211 INFO:tasks.workunit.client.1.smithi172.stdout:5/911: truncate d5/d3d/d60/fad 5103900 0 2024-03-19T06:05:47.211 INFO:tasks.workunit.client.0.smithi072.stdout:0/115: unlink d1/f14 0 2024-03-19T06:05:47.212 INFO:tasks.workunit.client.1.smithi172.stdout:5/912: chown d5/d3c/d6c/l6e 7 1 2024-03-19T06:05:47.213 INFO:tasks.workunit.client.1.smithi172.stdout:3/960: unlink d0/da8/d54/c13c 0 2024-03-19T06:05:47.214 INFO:tasks.workunit.client.0.smithi072.stdout:0/116: mkdir d1/d1c/d24 0 2024-03-19T06:05:47.216 INFO:tasks.workunit.client.1.smithi172.stdout:2/974: truncate d7/de/d58/d56/d86/d9d/fc9 646813 0 2024-03-19T06:05:47.216 INFO:tasks.workunit.client.0.smithi072.stdout:0/117: mknod d1/d1c/c25 0 2024-03-19T06:05:47.217 INFO:tasks.workunit.client.0.smithi072.stdout:0/118: dread - d1/f1a zero size 2024-03-19T06:05:47.219 INFO:tasks.workunit.client.0.smithi072.stdout:0/119: mknod d1/c26 0 2024-03-19T06:05:47.220 INFO:tasks.workunit.client.1.smithi172.stdout:9/920: creat d1/d7/dc/de/d34/f137 x:0 0 0 2024-03-19T06:05:47.220 INFO:tasks.workunit.client.1.smithi172.stdout:7/950: write d0/d22/d1d/d3a/d46/f7a [142928,125616] 0 2024-03-19T06:05:47.221 INFO:tasks.workunit.client.1.smithi172.stdout:5/913: rename d5/d1f/f2a to d5/d3c/d6c/d9b/d105/f137 0 2024-03-19T06:05:47.221 INFO:tasks.workunit.client.1.smithi172.stdout:8/883: link d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/f40 d0/d44/d46/f116 0 2024-03-19T06:05:47.222 INFO:tasks.workunit.client.1.smithi172.stdout:7/951: read d0/f9a [3953106,67198] 0 2024-03-19T06:05:47.222 INFO:tasks.workunit.client.0.smithi072.stdout:0/120: mkdir d1/d1c/d24/d27 0 2024-03-19T06:05:47.222 INFO:tasks.workunit.client.0.smithi072.stdout:0/121: chown d1 20968 1 2024-03-19T06:05:47.223 INFO:tasks.workunit.client.1.smithi172.stdout:3/961: truncate d0/da8/d54/fdc 331545 0 2024-03-19T06:05:47.225 INFO:tasks.workunit.client.1.smithi172.stdout:2/975: rename d7/d1b/l64 to d7/de/d58/d55/d66/dc1/de1/l13b 0 2024-03-19T06:05:47.225 INFO:tasks.workunit.client.1.smithi172.stdout:5/914: read d5/d55/de7/f10a [45996,51444] 0 2024-03-19T06:05:47.226 INFO:tasks.workunit.client.1.smithi172.stdout:3/962: stat d0/d5/d6b/le8 0 2024-03-19T06:05:47.227 INFO:tasks.workunit.client.1.smithi172.stdout:7/952: mkdir d0/d22/d27/ded/d145 0 2024-03-19T06:05:47.228 INFO:tasks.workunit.client.1.smithi172.stdout:9/921: rename d1/d7/dc/dbe/ca2 to d1/d7/dc/de/d34/d48/d89/c138 0 2024-03-19T06:05:47.229 INFO:tasks.workunit.client.1.smithi172.stdout:7/953: write d0/d22/d1d/d85/d10f/f142 [691576,27077] 0 2024-03-19T06:05:47.231 INFO:tasks.workunit.client.1.smithi172.stdout:8/884: creat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/dcc/f117 x:0 0 0 2024-03-19T06:05:47.232 INFO:tasks.workunit.client.1.smithi172.stdout:5/915: truncate d5/d1f/fcd 693881 0 2024-03-19T06:05:47.232 INFO:tasks.workunit.client.1.smithi172.stdout:3/963: rmdir d0/da8/d34/d4d 39 2024-03-19T06:05:47.235 INFO:tasks.workunit.client.1.smithi172.stdout:8/885: stat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28 0 2024-03-19T06:05:47.236 INFO:tasks.workunit.client.0.smithi072.stdout:0/122: dwrite d1/fb [0,4194304] 0 2024-03-19T06:05:47.239 INFO:tasks.workunit.client.1.smithi172.stdout:5/916: truncate d5/d1f/d2f/d62/fcc 43124 0 2024-03-19T06:05:47.245 INFO:tasks.workunit.client.1.smithi172.stdout:5/917: symlink d5/d14/l138 0 2024-03-19T06:05:47.250 INFO:tasks.workunit.client.1.smithi172.stdout:1/924: sync 2024-03-19T06:05:47.251 INFO:tasks.workunit.client.1.smithi172.stdout:8/886: unlink d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/lb1 0 2024-03-19T06:05:47.251 INFO:tasks.workunit.client.0.smithi072.stdout:0/123: dread d1/f5 [0,4194304] 0 2024-03-19T06:05:47.252 INFO:tasks.workunit.client.1.smithi172.stdout:7/954: dwrite d0/d22/d1d/d3a/d11f/f13c [0,4194304] 0 2024-03-19T06:05:47.253 INFO:tasks.workunit.client.1.smithi172.stdout:9/922: dwrite d1/d7/dc/de/d34/f137 [0,4194304] 0 2024-03-19T06:05:47.256 INFO:tasks.workunit.client.1.smithi172.stdout:1/925: fdatasync da/dd/d31/dfb/d36/f9a 0 2024-03-19T06:05:47.262 INFO:tasks.workunit.client.0.smithi072.stdout:0/124: link l0 d1/d1c/d24/d27/l28 0 2024-03-19T06:05:47.263 INFO:tasks.workunit.client.1.smithi172.stdout:5/918: creat d5/d3d/d60/d10d/f139 x:0 0 0 2024-03-19T06:05:47.264 INFO:tasks.workunit.client.1.smithi172.stdout:9/923: chown d1/d7/dc/de/d34/fca 17498 1 2024-03-19T06:05:47.266 INFO:tasks.workunit.client.1.smithi172.stdout:1/926: chown da/dd/d31/dfb/d14/d73/d8b/c9c 442586 1 2024-03-19T06:05:47.266 INFO:tasks.workunit.client.1.smithi172.stdout:7/955: write d0/d22/f109 [383986,4923] 0 2024-03-19T06:05:47.267 INFO:tasks.workunit.client.0.smithi072.stdout:0/125: creat d1/d1c/d24/d27/f29 x:0 0 0 2024-03-19T06:05:47.270 INFO:tasks.workunit.client.1.smithi172.stdout:5/919: creat d5/d3d/dd6/f13a x:0 0 0 2024-03-19T06:05:47.274 INFO:tasks.workunit.client.1.smithi172.stdout:5/920: symlink d5/d55/l13b 0 2024-03-19T06:05:47.274 INFO:tasks.workunit.client.1.smithi172.stdout:2/976: dwrite d7/de/d58/d55/d5f/fb9 [0,4194304] 0 2024-03-19T06:05:47.278 INFO:tasks.workunit.client.1.smithi172.stdout:7/956: getdents d0/d22/d27/db0 0 2024-03-19T06:05:47.286 INFO:tasks.workunit.client.0.smithi072.stdout:0/126: dwrite d1/d1c/f23 [0,4194304] 0 2024-03-19T06:05:47.290 INFO:tasks.workunit.client.0.smithi072.stdout:0/127: symlink d1/d1c/d24/l2a 0 2024-03-19T06:05:47.291 INFO:tasks.workunit.client.1.smithi172.stdout:7/957: dread d0/d22/d1d/d3a/d11f/f13c [0,4194304] 0 2024-03-19T06:05:47.292 INFO:tasks.workunit.client.0.smithi072.stdout:0/128: chown d1/d1c/d24/d27/f29 755834926 1 2024-03-19T06:05:47.295 INFO:tasks.workunit.client.1.smithi172.stdout:8/887: dread d0/d44/d46/d49/d26/f3e [0,4194304] 0 2024-03-19T06:05:47.382 INFO:tasks.workunit.client.1.smithi172.stdout:4/953: sync 2024-03-19T06:05:47.424 INFO:tasks.workunit.client.1.smithi172.stdout:0/937: sync 2024-03-19T06:05:47.471 INFO:tasks.workunit.client.0.smithi072.stdout:0/129: truncate d1/f1b 1219741 0 2024-03-19T06:05:47.474 INFO:tasks.workunit.client.0.smithi072.stdout:0/130: dread d1/f19 [0,4194304] 0 2024-03-19T06:05:47.475 INFO:tasks.workunit.client.1.smithi172.stdout:9/924: rename d1/d7/dc/de/d34/d48/d82/d92/d95/db4/c120 to d1/d7/dc/de/d34/d48/d82/d92/d95/db4/de5/c139 0 2024-03-19T06:05:47.476 INFO:tasks.workunit.client.0.smithi072.stdout:0/131: chown d1/d1c/c25 5370595 1 2024-03-19T06:05:47.481 INFO:tasks.workunit.client.0.smithi072.stdout:0/132: unlink d1/l1f 0 2024-03-19T06:05:47.482 INFO:tasks.workunit.client.0.smithi072.stdout:0/133: dread - d1/f18 zero size 2024-03-19T06:05:47.483 INFO:tasks.workunit.client.1.smithi172.stdout:3/964: sync 2024-03-19T06:05:47.483 INFO:tasks.workunit.client.1.smithi172.stdout:1/927: sync 2024-03-19T06:05:47.486 INFO:tasks.workunit.client.0.smithi072.stdout:0/134: truncate d1/f18 380352 0 2024-03-19T06:05:47.486 INFO:tasks.workunit.client.1.smithi172.stdout:7/958: rmdir d0/d22/d1d/d3a/d11f/d133 39 2024-03-19T06:05:47.493 INFO:tasks.workunit.client.1.smithi172.stdout:2/977: mknod d7/de/d58/d55/d66/c13c 0 2024-03-19T06:05:47.495 INFO:tasks.workunit.client.1.smithi172.stdout:3/965: write d0/db0/d125/f17 [3468808,42459] 0 2024-03-19T06:05:47.496 INFO:tasks.workunit.client.1.smithi172.stdout:4/954: read df/d2b/d2d/f8c [653659,2720] 0 2024-03-19T06:05:47.497 INFO:tasks.workunit.client.1.smithi172.stdout:9/925: mknod d1/d7/dc/de/d34/dfd/d106/c13a 0 2024-03-19T06:05:47.498 INFO:tasks.workunit.client.1.smithi172.stdout:0/938: symlink d11/d22/d46/dd2/l140 0 2024-03-19T06:05:47.499 INFO:tasks.workunit.client.1.smithi172.stdout:1/928: truncate da/dd/d31/f34 742739 0 2024-03-19T06:05:47.503 INFO:tasks.workunit.client.1.smithi172.stdout:9/926: symlink d1/db9/l13b 0 2024-03-19T06:05:47.504 INFO:tasks.workunit.client.1.smithi172.stdout:7/959: write d0/d22/d27/db0/f2f [434963,107659] 0 2024-03-19T06:05:47.507 INFO:tasks.workunit.client.1.smithi172.stdout:3/966: truncate d0/da8/d60/df1/d10d/f126 501910 0 2024-03-19T06:05:47.509 INFO:tasks.workunit.client.0.smithi072.stdout:0/135: dwrite d1/f5 [4194304,4194304] 0 2024-03-19T06:05:47.510 INFO:tasks.workunit.client.1.smithi172.stdout:2/978: mkdir d7/de/d58/d56/d86/d9e/d13d 0 2024-03-19T06:05:47.510 INFO:tasks.workunit.client.1.smithi172.stdout:0/939: symlink d11/d14/d2c/l141 0 2024-03-19T06:05:47.511 INFO:tasks.workunit.client.0.smithi072.stdout:0/136: chown d1/d1c/l20 79701 1 2024-03-19T06:05:47.514 INFO:tasks.workunit.client.1.smithi172.stdout:1/929: fdatasync da/dd/d31/dfb/d14/d27/d3f/d5e/dab/d127/fb6 0 2024-03-19T06:05:47.514 INFO:tasks.workunit.client.1.smithi172.stdout:3/967: chown d0/da8/dce/l7a 57728 1 2024-03-19T06:05:47.518 INFO:tasks.workunit.client.1.smithi172.stdout:9/927: truncate d1/d7/dc/de/d34/dfd/d106/f125 769372 0 2024-03-19T06:05:47.519 INFO:tasks.workunit.client.1.smithi172.stdout:1/930: chown da/d33/f105 0 1 2024-03-19T06:05:47.525 INFO:tasks.workunit.client.1.smithi172.stdout:7/960: dread d0/d22/d1d/d85/fbd [0,4194304] 0 2024-03-19T06:05:47.526 INFO:tasks.workunit.client.0.smithi072.stdout:0/137: rename d1/d1c/d24/l2a to d1/l2b 0 2024-03-19T06:05:47.526 INFO:tasks.workunit.client.1.smithi172.stdout:0/940: symlink d11/d14/d9a/dea/de9/l142 0 2024-03-19T06:05:47.528 INFO:tasks.workunit.client.1.smithi172.stdout:9/928: fdatasync d1/d7/dc/de/d34/f137 0 2024-03-19T06:05:47.532 INFO:tasks.workunit.client.1.smithi172.stdout:3/968: write d0/da8/d54/d90/f9c [459395,3538] 0 2024-03-19T06:05:47.532 INFO:tasks.workunit.client.1.smithi172.stdout:8/888: dwrite d0/d44/d46/d49/d26/d71/d81/fba [0,4194304] 0 2024-03-19T06:05:47.534 INFO:tasks.workunit.client.0.smithi072.stdout:0/138: mkdir d1/d2c 0 2024-03-19T06:05:47.537 INFO:tasks.workunit.client.1.smithi172.stdout:2/979: write d7/db/f16 [3683000,119484] 0 2024-03-19T06:05:47.539 INFO:tasks.workunit.client.1.smithi172.stdout:3/969: readlink d0/l55 0 2024-03-19T06:05:47.544 INFO:tasks.workunit.client.1.smithi172.stdout:5/921: dwrite d5/d14/d56/f64 [0,4194304] 0 2024-03-19T06:05:47.544 INFO:tasks.workunit.client.0.smithi072.stdout:0/139: dread d1/fb [0,4194304] 0 2024-03-19T06:05:47.546 INFO:tasks.workunit.client.1.smithi172.stdout:8/889: unlink d0/d61/d6a/d9f/c111 0 2024-03-19T06:05:47.546 INFO:tasks.workunit.client.1.smithi172.stdout:9/929: chown d1/d7/dc/de/d34/l60 220598814 1 2024-03-19T06:05:47.546 INFO:tasks.workunit.client.0.smithi072.stdout:0/140: write d1/d1c/d24/d27/f29 [207034,72178] 0 2024-03-19T06:05:47.547 INFO:tasks.workunit.client.1.smithi172.stdout:4/955: dwrite df/d2b/d2d/db0/f110 [0,4194304] 0 2024-03-19T06:05:47.550 INFO:tasks.workunit.client.0.smithi072.stdout:0/141: mknod d1/c2d 0 2024-03-19T06:05:47.551 INFO:tasks.workunit.client.1.smithi172.stdout:1/931: truncate da/dd/d31/dfb/f68 543082 0 2024-03-19T06:05:47.553 INFO:tasks.workunit.client.1.smithi172.stdout:7/961: creat d0/d22/d1d/d85/da8/dfa/d11a/d12b/f146 x:0 0 0 2024-03-19T06:05:47.558 INFO:tasks.workunit.client.1.smithi172.stdout:5/922: chown d5/d3c/d6c/d9b/l102 4040 1 2024-03-19T06:05:47.566 INFO:tasks.workunit.client.1.smithi172.stdout:1/932: dread - da/dd/d31/dfb/d14/d73/d8b/fac zero size 2024-03-19T06:05:47.569 INFO:tasks.workunit.client.1.smithi172.stdout:0/941: dwrite d11/d14/d2c/d36/f13a [0,4194304] 0 2024-03-19T06:05:47.569 INFO:tasks.workunit.client.1.smithi172.stdout:7/962: creat d0/d22/d1d/d36/d56/d110/f147 x:0 0 0 2024-03-19T06:05:47.570 INFO:tasks.workunit.client.1.smithi172.stdout:5/923: truncate d5/d14/d48/f115 626454 0 2024-03-19T06:05:47.572 INFO:tasks.workunit.client.0.smithi072.stdout:0/142: dwrite d1/d1c/d24/d27/f29 [0,4194304] 0 2024-03-19T06:05:47.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:47 smithi072 ceph-mon[28706]: pgmap v20: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 43 MiB/s rd, 91 MiB/s wr, 222 op/s 2024-03-19T06:05:47.580 INFO:tasks.workunit.client.0.smithi072.stdout:0/143: dread d1/f1b [0,4194304] 0 2024-03-19T06:05:47.581 INFO:tasks.workunit.client.1.smithi172.stdout:3/970: dwrite d0/d5/d6b/dae/f95 [0,4194304] 0 2024-03-19T06:05:47.582 INFO:tasks.workunit.client.1.smithi172.stdout:0/942: creat d11/d18/da5/dcb/ddb/f143 x:0 0 0 2024-03-19T06:05:47.587 INFO:tasks.workunit.client.1.smithi172.stdout:5/924: rename d5/d14/f7b to d5/d1f/db4/f13c 0 2024-03-19T06:05:47.589 INFO:tasks.workunit.client.1.smithi172.stdout:3/971: write d0/db0/db6/dc7/de0/ffd [894552,129841] 0 2024-03-19T06:05:47.594 INFO:tasks.workunit.client.1.smithi172.stdout:2/980: write d7/de/d58/d56/d81/fff [209435,129286] 0 2024-03-19T06:05:47.594 INFO:tasks.workunit.client.1.smithi172.stdout:3/972: chown d0/da8/d25/d21 5904751 1 2024-03-19T06:05:47.599 INFO:tasks.workunit.client.1.smithi172.stdout:5/925: rename d5/f1d to d5/d14/d15/d40/d6a/f13d 0 2024-03-19T06:05:47.600 INFO:tasks.workunit.client.1.smithi172.stdout:7/963: dwrite d0/d22/d1d/d36/d40/f5f [4194304,4194304] 0 2024-03-19T06:05:47.603 INFO:tasks.workunit.client.1.smithi172.stdout:3/973: write d0/d5/d6b/dae/fad [404016,50980] 0 2024-03-19T06:05:47.607 INFO:tasks.workunit.client.1.smithi172.stdout:3/974: fdatasync d0/da8/d54/d77/f99 0 2024-03-19T06:05:47.607 INFO:tasks.workunit.client.1.smithi172.stdout:1/933: write da/f77 [1572236,61533] 0 2024-03-19T06:05:47.613 INFO:tasks.workunit.client.1.smithi172.stdout:3/975: write d0/f121 [3383420,26637] 0 2024-03-19T06:05:47.613 INFO:tasks.workunit.client.1.smithi172.stdout:7/964: mknod d0/d22/d1d/d36/de9/c148 0 2024-03-19T06:05:47.616 INFO:tasks.workunit.client.1.smithi172.stdout:2/981: truncate d7/de/d58/d56/d89/de6/dbc/dc6/fdb 665154 0 2024-03-19T06:05:47.618 INFO:tasks.workunit.client.0.smithi072.stdout:0/144: dwrite d1/f19 [0,4194304] 0 2024-03-19T06:05:47.620 INFO:tasks.workunit.client.1.smithi172.stdout:9/930: dread d1/d7/dc/de/d34/d48/fb2 [0,4194304] 0 2024-03-19T06:05:47.621 INFO:tasks.workunit.client.1.smithi172.stdout:1/934: dread da/d33/f12f [0,4194304] 0 2024-03-19T06:05:47.623 INFO:tasks.workunit.client.1.smithi172.stdout:4/956: dwrite df/d11/d12/d21/d50/f5f [0,4194304] 0 2024-03-19T06:05:47.625 INFO:tasks.workunit.client.0.smithi072.stdout:0/145: creat d1/d1c/d24/d27/f2e x:0 0 0 2024-03-19T06:05:47.628 INFO:tasks.workunit.client.0.smithi072.stdout:0/146: getdents d1/d2c 0 2024-03-19T06:05:47.638 INFO:tasks.workunit.client.1.smithi172.stdout:1/935: read da/dd/d31/dfb/d14/d84/d9b/f119 [3102116,123725] 0 2024-03-19T06:05:47.648 INFO:tasks.workunit.client.1.smithi172.stdout:0/943: dread d11/d14/d9a/dea/fe6 [0,4194304] 0 2024-03-19T06:05:47.649 INFO:tasks.workunit.client.1.smithi172.stdout:2/982: dwrite d7/de/fcc [0,4194304] 0 2024-03-19T06:05:47.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:47 smithi172 ceph-mon[35716]: pgmap v20: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 43 MiB/s rd, 91 MiB/s wr, 222 op/s 2024-03-19T06:05:47.656 INFO:tasks.workunit.client.1.smithi172.stdout:9/931: link d1/d7/dc/dbe/d65/f112 d1/d7/dc/de/d34/d48/d82/f13c 0 2024-03-19T06:05:47.658 INFO:tasks.workunit.client.1.smithi172.stdout:3/976: dwrite d0/da8/d60/fd8 [0,4194304] 0 2024-03-19T06:05:47.662 INFO:tasks.workunit.client.1.smithi172.stdout:1/936: dwrite da/f3c [0,4194304] 0 2024-03-19T06:05:47.663 INFO:tasks.workunit.client.1.smithi172.stdout:4/957: dread - df/d2b/d44/d93/d102/f103 zero size 2024-03-19T06:05:47.663 INFO:tasks.workunit.client.0.smithi072.stdout:0/147: truncate d1/f18 122270 0 2024-03-19T06:05:47.665 INFO:tasks.workunit.client.0.smithi072.stdout:0/148: chown d1/f1a 2201 1 2024-03-19T06:05:47.666 INFO:tasks.workunit.client.1.smithi172.stdout:8/890: sync 2024-03-19T06:05:47.666 INFO:tasks.workunit.client.1.smithi172.stdout:0/944: link f10 d11/d18/d38/d3f/d43/d62/f144 0 2024-03-19T06:05:47.673 INFO:tasks.workunit.client.1.smithi172.stdout:2/983: dread d7/de/d58/d56/fba [0,4194304] 0 2024-03-19T06:05:47.673 INFO:tasks.workunit.client.1.smithi172.stdout:9/932: symlink d1/d7/dc/de/d34/d48/d82/d92/l13d 0 2024-03-19T06:05:47.674 INFO:tasks.workunit.client.1.smithi172.stdout:1/937: dread - da/dd/d31/dfb/d14/d73/d102/fe8 zero size 2024-03-19T06:05:47.677 INFO:tasks.workunit.client.1.smithi172.stdout:4/958: creat df/d2b/d2d/db0/f12c x:0 0 0 2024-03-19T06:05:47.677 INFO:tasks.workunit.client.1.smithi172.stdout:0/945: mknod d11/d22/d46/d84/c145 0 2024-03-19T06:05:47.678 INFO:tasks.workunit.client.1.smithi172.stdout:7/965: dread d0/d22/d1d/d36/d56/f79 [0,4194304] 0 2024-03-19T06:05:47.678 INFO:tasks.workunit.client.1.smithi172.stdout:8/891: creat d0/d44/d46/d49/d26/d71/d81/d27/f118 x:0 0 0 2024-03-19T06:05:47.681 INFO:tasks.workunit.client.1.smithi172.stdout:9/933: symlink d1/d7/dc/dbe/dc9/l13e 0 2024-03-19T06:05:47.683 INFO:tasks.workunit.client.0.smithi072.stdout:0/149: dwrite d1/d1c/f1d [0,4194304] 0 2024-03-19T06:05:47.688 INFO:tasks.workunit.client.1.smithi172.stdout:2/984: dread d7/de/d58/d57/ffc [0,4194304] 0 2024-03-19T06:05:47.688 INFO:tasks.workunit.client.1.smithi172.stdout:3/977: dwrite d0/d5/d6b/f8f [0,4194304] 0 2024-03-19T06:05:47.692 INFO:tasks.workunit.client.0.smithi072.stdout:0/150: dread d1/f19 [0,4194304] 0 2024-03-19T06:05:47.709 INFO:tasks.workunit.client.1.smithi172.stdout:3/978: dwrite d0/da8/dce/d72/f111 [0,4194304] 0 2024-03-19T06:05:47.714 INFO:tasks.workunit.client.1.smithi172.stdout:5/926: truncate d5/d55/de9/df7/f126 1251483 0 2024-03-19T06:05:47.716 INFO:tasks.workunit.client.1.smithi172.stdout:0/946: unlink d11/d14/d2c/d8d/lb4 0 2024-03-19T06:05:47.719 INFO:tasks.workunit.client.0.smithi072.stdout:1/93: sync 2024-03-19T06:05:47.719 INFO:tasks.workunit.client.0.smithi072.stdout:6/84: sync 2024-03-19T06:05:47.720 INFO:tasks.workunit.client.0.smithi072.stdout:2/70: sync 2024-03-19T06:05:47.720 INFO:tasks.workunit.client.0.smithi072.stdout:1/94: stat d1/f6 0 2024-03-19T06:05:47.721 INFO:tasks.workunit.client.1.smithi172.stdout:7/966: dread d0/d22/d1d/d3a/f3f [0,4194304] 0 2024-03-19T06:05:47.723 INFO:tasks.workunit.client.0.smithi072.stdout:1/95: truncate d1/d11/f1c 1134244 0 2024-03-19T06:05:47.725 INFO:tasks.workunit.client.1.smithi172.stdout:5/927: creat d5/d14/d15/d40/d6a/d7a/f13e x:0 0 0 2024-03-19T06:05:47.727 INFO:tasks.workunit.client.1.smithi172.stdout:0/947: mknod d11/d18/d38/d3f/c146 0 2024-03-19T06:05:47.727 INFO:tasks.workunit.client.0.smithi072.stdout:6/85: mkdir d7/d9/d1b 0 2024-03-19T06:05:47.730 INFO:tasks.workunit.client.1.smithi172.stdout:4/959: getdents df/d2b 0 2024-03-19T06:05:47.731 INFO:tasks.workunit.client.0.smithi072.stdout:2/71: rmdir db/d10/d12 39 2024-03-19T06:05:47.732 INFO:tasks.workunit.client.1.smithi172.stdout:5/928: dread d5/d14/d56/f121 [0,4194304] 0 2024-03-19T06:05:47.732 INFO:tasks.workunit.client.0.smithi072.stdout:2/72: stat db/d10/d13/l15 0 2024-03-19T06:05:47.733 INFO:tasks.workunit.client.1.smithi172.stdout:0/948: write d11/d18/d38/d3f/f6e [2846534,81030] 0 2024-03-19T06:05:47.733 INFO:tasks.workunit.client.1.smithi172.stdout:1/938: dread da/dd/d31/dfb/d14/d27/d3f/d5e/dab/d127/fb6 [0,4194304] 0 2024-03-19T06:05:47.733 INFO:tasks.workunit.client.0.smithi072.stdout:1/96: write d1/d11/f13 [1662220,106284] 0 2024-03-19T06:05:47.734 INFO:tasks.workunit.client.1.smithi172.stdout:4/960: readlink df/d2b/da3/d115/l11d 0 2024-03-19T06:05:47.735 INFO:tasks.workunit.client.1.smithi172.stdout:1/939: stat da/d3b/ddf 0 2024-03-19T06:05:47.737 INFO:tasks.workunit.client.1.smithi172.stdout:8/892: write d0/d44/d46/d49/d26/f3e [5604081,19635] 0 2024-03-19T06:05:47.737 INFO:tasks.workunit.client.1.smithi172.stdout:5/929: chown d5/d1f/l39 406 1 2024-03-19T06:05:47.738 INFO:tasks.workunit.client.0.smithi072.stdout:0/151: unlink d1/f18 0 2024-03-19T06:05:47.738 INFO:tasks.workunit.client.1.smithi172.stdout:2/985: write d7/de/d58/d55/f98 [216107,117896] 0 2024-03-19T06:05:47.738 INFO:tasks.workunit.client.1.smithi172.stdout:0/949: rmdir d11/d14/d9a/dea/de9 39 2024-03-19T06:05:47.741 INFO:tasks.workunit.client.0.smithi072.stdout:2/73: rmdir db/d10/d13 39 2024-03-19T06:05:47.742 INFO:tasks.workunit.client.1.smithi172.stdout:3/979: write d0/da8/f2c [8923526,20466] 0 2024-03-19T06:05:47.742 INFO:tasks.workunit.client.0.smithi072.stdout:0/152: write d1/d1c/d24/d27/f29 [2620028,112416] 0 2024-03-19T06:05:47.744 INFO:tasks.workunit.client.0.smithi072.stdout:0/153: stat d1/d1c/d24 0 2024-03-19T06:05:47.746 INFO:tasks.workunit.client.1.smithi172.stdout:5/930: stat d5/d14/d15/d40/f12e 0 2024-03-19T06:05:47.747 INFO:tasks.workunit.client.1.smithi172.stdout:2/986: dread d7/d1b/f33 [0,4194304] 0 2024-03-19T06:05:47.748 INFO:tasks.workunit.client.1.smithi172.stdout:0/950: readlink d11/d18/d38/d3f/d43/l11a 0 2024-03-19T06:05:47.749 INFO:tasks.workunit.client.0.smithi072.stdout:0/154: creat d1/d1c/f2f x:0 0 0 2024-03-19T06:05:47.751 INFO:tasks.workunit.client.1.smithi172.stdout:1/940: write da/dd/d31/dfb/d14/d27/d3f/d5e/fd7 [3380800,3471] 0 2024-03-19T06:05:47.755 INFO:tasks.workunit.client.0.smithi072.stdout:0/155: mknod d1/d1c/d24/d27/c30 0 2024-03-19T06:05:47.755 INFO:tasks.workunit.client.1.smithi172.stdout:0/951: fsync d11/d18/d38/d3f/f5e 0 2024-03-19T06:05:47.755 INFO:tasks.workunit.client.1.smithi172.stdout:8/893: link d0/d44/dd2/c3c d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/c119 0 2024-03-19T06:05:47.757 INFO:tasks.workunit.client.0.smithi072.stdout:1/97: dwrite d1/d11/f13 [0,4194304] 0 2024-03-19T06:05:47.759 INFO:tasks.workunit.client.0.smithi072.stdout:6/86: dwrite d7/f11 [0,4194304] 0 2024-03-19T06:05:47.759 INFO:tasks.workunit.client.0.smithi072.stdout:1/98: chown d1/l12 157199 1 2024-03-19T06:05:47.760 INFO:tasks.workunit.client.0.smithi072.stdout:1/99: chown d1 1442802 1 2024-03-19T06:05:47.760 INFO:tasks.workunit.client.0.smithi072.stdout:0/156: creat d1/d1c/f31 x:0 0 0 2024-03-19T06:05:47.761 INFO:tasks.workunit.client.1.smithi172.stdout:8/894: creat d0/d64/d80/f11a x:0 0 0 2024-03-19T06:05:47.762 INFO:tasks.workunit.client.1.smithi172.stdout:9/934: dwrite d1/d7/dc/d47/da3/fa8 [0,4194304] 0 2024-03-19T06:05:47.762 INFO:tasks.workunit.client.0.smithi072.stdout:0/157: write d1/d1c/f31 [1027580,26089] 0 2024-03-19T06:05:47.763 INFO:tasks.workunit.client.1.smithi172.stdout:1/941: creat da/d3b/d95/ded/d135/f141 x:0 0 0 2024-03-19T06:05:47.763 INFO:tasks.workunit.client.1.smithi172.stdout:2/987: dread d7/de/d58/d57/f7d [0,4194304] 0 2024-03-19T06:05:47.772 INFO:tasks.workunit.client.1.smithi172.stdout:5/931: truncate d5/d14/d56/f117 333012 0 2024-03-19T06:05:47.772 INFO:tasks.workunit.client.0.smithi072.stdout:6/87: creat d7/d9/d1b/f1c x:0 0 0 2024-03-19T06:05:47.774 INFO:tasks.workunit.client.1.smithi172.stdout:8/895: creat d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/f11b x:0 0 0 2024-03-19T06:05:47.778 INFO:tasks.workunit.client.1.smithi172.stdout:1/942: chown da/dd/d31/dfb/d14/d73/d102/fe3 1090 1 2024-03-19T06:05:47.778 INFO:tasks.workunit.client.0.smithi072.stdout:6/88: dread f6 [0,4194304] 0 2024-03-19T06:05:47.780 INFO:tasks.workunit.client.1.smithi172.stdout:3/980: dwrite d0/da8/d25/f58 [0,4194304] 0 2024-03-19T06:05:47.783 INFO:tasks.workunit.client.0.smithi072.stdout:0/158: dread d1/f19 [0,4194304] 0 2024-03-19T06:05:47.784 INFO:tasks.workunit.client.1.smithi172.stdout:5/932: rename d5/d3c/d6c/da2/ca6 to d5/d1f/d10e/c13f 0 2024-03-19T06:05:47.788 INFO:tasks.workunit.client.0.smithi072.stdout:1/100: dwrite d1/f14 [0,4194304] 0 2024-03-19T06:05:47.791 INFO:tasks.workunit.client.1.smithi172.stdout:1/943: stat da/d33/d59/d13b/f87 0 2024-03-19T06:05:47.791 INFO:tasks.workunit.client.1.smithi172.stdout:3/981: mknod d0/da8/d60/c13e 0 2024-03-19T06:05:47.793 INFO:tasks.workunit.client.0.smithi072.stdout:0/159: rename d1/d1c/f2f to d1/d1c/d24/f32 0 2024-03-19T06:05:47.794 INFO:tasks.workunit.client.0.smithi072.stdout:2/74: dread db/d10/d12/f1b [0,4194304] 0 2024-03-19T06:05:47.794 INFO:tasks.workunit.client.1.smithi172.stdout:0/952: dwrite d11/d14/d2c/d4e/f87 [0,4194304] 0 2024-03-19T06:05:47.797 INFO:tasks.workunit.client.1.smithi172.stdout:5/933: truncate d5/d14/d48/fe4 867430 0 2024-03-19T06:05:47.797 INFO:tasks.workunit.client.1.smithi172.stdout:3/982: creat d0/d5/f13f x:0 0 0 2024-03-19T06:05:47.798 INFO:tasks.workunit.client.1.smithi172.stdout:0/953: creat d11/d22/d46/dd2/f147 x:0 0 0 2024-03-19T06:05:47.801 INFO:tasks.workunit.client.0.smithi072.stdout:2/75: readlink db/d10/d13/l15 0 2024-03-19T06:05:47.802 INFO:tasks.workunit.client.1.smithi172.stdout:8/896: getdents d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3 0 2024-03-19T06:05:47.802 INFO:tasks.workunit.client.1.smithi172.stdout:5/934: unlink c3 0 2024-03-19T06:05:47.808 INFO:tasks.workunit.client.1.smithi172.stdout:3/983: creat d0/da8/d34/f140 x:0 0 0 2024-03-19T06:05:47.811 INFO:tasks.workunit.client.0.smithi072.stdout:4/181: sync 2024-03-19T06:05:47.812 INFO:tasks.workunit.client.0.smithi072.stdout:6/89: write d7/fc [1026712,114972] 0 2024-03-19T06:05:47.812 INFO:tasks.workunit.client.0.smithi072.stdout:0/160: write d1/d1c/d24/f32 [881422,98614] 0 2024-03-19T06:05:47.814 INFO:tasks.workunit.client.1.smithi172.stdout:1/944: symlink da/dd/d31/dfb/d14/d84/l142 0 2024-03-19T06:05:47.814 INFO:tasks.workunit.client.1.smithi172.stdout:5/935: unlink d5/d14/d34/d66/c9e 0 2024-03-19T06:05:47.815 INFO:tasks.workunit.client.0.smithi072.stdout:2/76: creat db/d10/f1d x:0 0 0 2024-03-19T06:05:47.819 INFO:tasks.workunit.client.0.smithi072.stdout:1/101: write d1/f14 [5054349,100507] 0 2024-03-19T06:05:47.822 INFO:tasks.workunit.client.1.smithi172.stdout:1/945: fsync da/dd/d31/dfb/d14/d27/f5a 0 2024-03-19T06:05:47.823 INFO:tasks.workunit.client.1.smithi172.stdout:5/936: chown d5/d3c/d6c/d9b/d105/f137 1646144 1 2024-03-19T06:05:47.825 INFO:tasks.workunit.client.1.smithi172.stdout:9/935: dread d1/d7/dc/de/d34/d48/d89/f98 [0,4194304] 0 2024-03-19T06:05:47.826 INFO:tasks.workunit.client.0.smithi072.stdout:6/90: rmdir d7/d9/d1b 39 2024-03-19T06:05:47.827 INFO:tasks.workunit.client.0.smithi072.stdout:2/77: rmdir db 39 2024-03-19T06:05:47.828 INFO:tasks.workunit.client.0.smithi072.stdout:4/182: dwrite d5/f8 [0,4194304] 0 2024-03-19T06:05:47.830 INFO:tasks.workunit.client.0.smithi072.stdout:4/183: fdatasync d5/f6 0 2024-03-19T06:05:47.833 INFO:tasks.workunit.client.0.smithi072.stdout:1/102: creat d1/d16/f1e x:0 0 0 2024-03-19T06:05:47.834 INFO:tasks.workunit.client.0.smithi072.stdout:1/103: rename d1 to d1/d1f 22 2024-03-19T06:05:47.834 INFO:tasks.workunit.client.1.smithi172.stdout:1/946: dread da/d33/f75 [0,4194304] 0 2024-03-19T06:05:47.836 INFO:tasks.workunit.client.0.smithi072.stdout:0/161: link d1/l6 d1/d1c/d24/d27/l33 0 2024-03-19T06:05:47.836 INFO:tasks.workunit.client.0.smithi072.stdout:4/184: write d5/d1b/d1c/f2f [438532,56665] 0 2024-03-19T06:05:47.837 INFO:tasks.workunit.client.0.smithi072.stdout:2/78: creat db/f1e x:0 0 0 2024-03-19T06:05:47.837 INFO:tasks.workunit.client.0.smithi072.stdout:6/91: creat d7/f1d x:0 0 0 2024-03-19T06:05:47.838 INFO:tasks.workunit.client.0.smithi072.stdout:2/79: fsync db/d10/f16 0 2024-03-19T06:05:47.839 INFO:tasks.workunit.client.0.smithi072.stdout:4/185: write d5/f10 [2721441,31473] 0 2024-03-19T06:05:47.840 INFO:tasks.workunit.client.1.smithi172.stdout:0/954: dwrite d11/d18/d38/f12f [0,4194304] 0 2024-03-19T06:05:47.843 INFO:tasks.workunit.client.0.smithi072.stdout:0/162: rename d1/l2b to d1/d1c/l34 0 2024-03-19T06:05:47.844 INFO:tasks.workunit.client.0.smithi072.stdout:4/186: mknod d5/d15/d3f/c43 0 2024-03-19T06:05:47.845 INFO:tasks.workunit.client.1.smithi172.stdout:3/984: write d0/da8/d34/d4d/f2d [1581017,10005] 0 2024-03-19T06:05:47.846 INFO:tasks.workunit.client.0.smithi072.stdout:4/187: fdatasync d5/f10 0 2024-03-19T06:05:47.849 INFO:tasks.workunit.client.0.smithi072.stdout:4/188: write d5/f10 [1908216,19314] 0 2024-03-19T06:05:47.850 INFO:tasks.workunit.client.1.smithi172.stdout:8/897: dwrite d0/f2d [0,4194304] 0 2024-03-19T06:05:47.859 INFO:tasks.workunit.client.0.smithi072.stdout:6/92: dwrite d7/f12 [0,4194304] 0 2024-03-19T06:05:47.864 INFO:tasks.workunit.client.0.smithi072.stdout:6/93: mkdir d7/d9/d1e 0 2024-03-19T06:05:47.867 INFO:tasks.workunit.client.1.smithi172.stdout:0/955: link d11/d14/d9a/dea/l11d d11/dc3/l148 0 2024-03-19T06:05:47.867 INFO:tasks.workunit.client.0.smithi072.stdout:6/94: rename d7 to d7/d9/d1f 22 2024-03-19T06:05:47.868 INFO:tasks.workunit.client.1.smithi172.stdout:9/936: dwrite d1/d7/dc/de/d34/d48/d82/f88 [0,4194304] 0 2024-03-19T06:05:47.869 INFO:tasks.workunit.client.1.smithi172.stdout:1/947: getdents da/dd/d31/dfb/d14/d73 0 2024-03-19T06:05:47.871 INFO:tasks.workunit.client.1.smithi172.stdout:5/937: dwrite d5/d55/d91/fb2 [0,4194304] 0 2024-03-19T06:05:47.871 INFO:tasks.workunit.client.1.smithi172.stdout:9/937: dread - d1/d7/dc/d47/da5/f108 zero size 2024-03-19T06:05:47.872 INFO:tasks.workunit.client.0.smithi072.stdout:6/95: rename d7/d9/l14 to d7/d9/d1e/l20 0 2024-03-19T06:05:47.872 INFO:tasks.workunit.client.0.smithi072.stdout:6/96: stat l5 0 2024-03-19T06:05:47.872 INFO:tasks.workunit.client.1.smithi172.stdout:0/956: chown d11/d14/d2c/c96 505863 1 2024-03-19T06:05:47.876 INFO:tasks.workunit.client.1.smithi172.stdout:5/938: chown d5/d55/ldd 1366272987 1 2024-03-19T06:05:47.877 INFO:tasks.workunit.client.0.smithi072.stdout:6/97: rmdir d7/d9/d1b 39 2024-03-19T06:05:47.880 INFO:tasks.workunit.client.1.smithi172.stdout:8/898: write d0/d44/f7a [819936,101907] 0 2024-03-19T06:05:47.881 INFO:tasks.workunit.client.1.smithi172.stdout:1/948: creat da/dd/d31/dfb/d14/d73/f143 x:0 0 0 2024-03-19T06:05:47.883 INFO:tasks.workunit.client.1.smithi172.stdout:5/939: rmdir d5/d55/d91 39 2024-03-19T06:05:47.885 INFO:tasks.workunit.client.0.smithi072.stdout:6/98: dread - d7/d9/d1b/f1c zero size 2024-03-19T06:05:47.886 INFO:tasks.workunit.client.1.smithi172.stdout:9/938: truncate d1/d7/dc/de/d34/d48/fd2 4365565 0 2024-03-19T06:05:47.887 INFO:tasks.workunit.client.1.smithi172.stdout:8/899: creat d0/d44/f11c x:0 0 0 2024-03-19T06:05:47.890 INFO:tasks.workunit.client.1.smithi172.stdout:1/949: chown da/dd/d31/dfb/d14/d27/d3f/d5e/dab/d127/f112 6323 1 2024-03-19T06:05:47.892 INFO:tasks.workunit.client.1.smithi172.stdout:4/961: sync 2024-03-19T06:05:47.892 INFO:tasks.workunit.client.1.smithi172.stdout:7/967: sync 2024-03-19T06:05:47.894 INFO:tasks.workunit.client.0.smithi072.stdout:4/189: dwrite d5/d1b/f1d [0,4194304] 0 2024-03-19T06:05:47.896 INFO:tasks.workunit.client.1.smithi172.stdout:8/900: fsync d0/d44/d46/d49/d26/dc0/d3d/d83/dee/fd6 0 2024-03-19T06:05:47.899 INFO:tasks.workunit.client.0.smithi072.stdout:4/190: creat d5/d15/d22/f44 x:0 0 0 2024-03-19T06:05:47.900 INFO:tasks.workunit.client.0.smithi072.stdout:6/99: getdents d7/d9/d1b 0 2024-03-19T06:05:47.901 INFO:tasks.workunit.client.1.smithi172.stdout:5/940: write d5/d55/de9/df7/f126 [1482582,1341] 0 2024-03-19T06:05:47.901 INFO:tasks.workunit.client.0.smithi072.stdout:4/191: write d5/f6 [9381400,110426] 0 2024-03-19T06:05:47.902 INFO:tasks.workunit.client.0.smithi072.stdout:4/192: chown d5/d11 239836 1 2024-03-19T06:05:47.904 INFO:tasks.workunit.client.0.smithi072.stdout:4/193: write d5/f28 [1936892,106551] 0 2024-03-19T06:05:47.907 INFO:tasks.workunit.client.1.smithi172.stdout:7/968: write d0/d22/d1d/d36/d40/f128 [575535,61433] 0 2024-03-19T06:05:47.910 INFO:tasks.workunit.client.0.smithi072.stdout:4/194: creat d5/d15/d22/f45 x:0 0 0 2024-03-19T06:05:47.912 INFO:tasks.workunit.client.0.smithi072.stdout:4/195: write d5/d11/f39 [375168,41998] 0 2024-03-19T06:05:47.914 INFO:tasks.workunit.client.1.smithi172.stdout:9/939: dread d1/d7/dc/dbe/dc9/fe3 [0,4194304] 0 2024-03-19T06:05:47.914 INFO:tasks.workunit.client.1.smithi172.stdout:0/957: dwrite d11/d18/d123/f139 [0,4194304] 0 2024-03-19T06:05:47.915 INFO:tasks.workunit.client.0.smithi072.stdout:4/196: chown d5/d15/d22/d41 3966 1 2024-03-19T06:05:47.916 INFO:tasks.workunit.client.0.smithi072.stdout:4/197: symlink d5/d32/l46 0 2024-03-19T06:05:47.918 INFO:tasks.workunit.client.1.smithi172.stdout:7/969: stat d0/d22/d1d/d85/da8/dfa/d11a/f64 0 2024-03-19T06:05:47.918 INFO:tasks.workunit.client.1.smithi172.stdout:1/950: rename da/dd/d31/dfb/d36/f38 to da/dd/d31/dfb/d14/d27/d53/dc2/f144 0 2024-03-19T06:05:47.920 INFO:tasks.workunit.client.0.smithi072.stdout:4/198: symlink d5/d15/d3f/d42/l47 0 2024-03-19T06:05:47.924 INFO:tasks.workunit.client.1.smithi172.stdout:0/958: mkdir d11/d14/d2c/dc2/dcf/d149 0 2024-03-19T06:05:47.925 INFO:tasks.workunit.client.0.smithi072.stdout:4/199: getdents d5/d1b 0 2024-03-19T06:05:47.926 INFO:tasks.workunit.client.1.smithi172.stdout:1/951: write da/dd/d31/dfb/d14/d27/da2/f125 [617849,106271] 0 2024-03-19T06:05:47.926 INFO:tasks.workunit.client.1.smithi172.stdout:9/940: creat d1/d7/dc/de/d34/dfd/f13f x:0 0 0 2024-03-19T06:05:47.929 INFO:tasks.workunit.client.0.smithi072.stdout:4/200: symlink d5/l48 0 2024-03-19T06:05:47.932 INFO:tasks.workunit.client.1.smithi172.stdout:5/941: dwrite d5/d1f/f101 [0,4194304] 0 2024-03-19T06:05:47.933 INFO:tasks.workunit.client.1.smithi172.stdout:2/988: sync 2024-03-19T06:05:47.934 INFO:tasks.workunit.client.0.smithi072.stdout:6/100: getdents d7/d9 0 2024-03-19T06:05:47.937 INFO:tasks.workunit.client.1.smithi172.stdout:7/970: dread d0/d22/d1d/d85/da8/f108 [0,4194304] 0 2024-03-19T06:05:47.938 INFO:tasks.workunit.client.1.smithi172.stdout:0/959: write d11/d18/d38/d3f/d43/d62/dc0/fe0 [990152,14241] 0 2024-03-19T06:05:47.942 INFO:tasks.workunit.client.1.smithi172.stdout:4/962: dwrite df/d11/d12/d26/f43 [0,4194304] 0 2024-03-19T06:05:47.944 INFO:tasks.workunit.client.1.smithi172.stdout:2/989: symlink d7/de/d58/d56/l13e 0 2024-03-19T06:05:47.944 INFO:tasks.workunit.client.1.smithi172.stdout:1/952: mknod da/dd/d31/dfb/d14/d27/da7/db7/dca/c145 0 2024-03-19T06:05:47.946 INFO:tasks.workunit.client.1.smithi172.stdout:8/901: write d0/d44/d46/d49/d26/d71/d81/d27/d29/f32 [3708266,90442] 0 2024-03-19T06:05:47.947 INFO:tasks.workunit.client.1.smithi172.stdout:3/985: dread d0/da8/dce/da7/fdb [0,4194304] 0 2024-03-19T06:05:47.947 INFO:tasks.workunit.client.1.smithi172.stdout:5/942: truncate d5/fda 696124 0 2024-03-19T06:05:47.949 INFO:tasks.workunit.client.1.smithi172.stdout:2/990: chown d7/db/d2c/d35/lf4 7085 1 2024-03-19T06:05:47.950 INFO:tasks.workunit.client.0.smithi072.stdout:6/101: mkdir d7/d9/d1b/d21 0 2024-03-19T06:05:47.951 INFO:tasks.workunit.client.0.smithi072.stdout:4/201: link d5/d11/c3d d5/d11/c49 0 2024-03-19T06:05:47.952 INFO:tasks.workunit.client.1.smithi172.stdout:0/960: fsync d11/d14/d9a/dea/dab/dc1/dd9/f12a 0 2024-03-19T06:05:47.955 INFO:tasks.workunit.client.1.smithi172.stdout:4/963: rmdir df/d11/d10d 0 2024-03-19T06:05:47.957 INFO:tasks.workunit.client.1.smithi172.stdout:5/943: write d5/d3c/f5a [1463576,6466] 0 2024-03-19T06:05:47.957 INFO:tasks.workunit.client.1.smithi172.stdout:8/902: fdatasync d0/f9 0 2024-03-19T06:05:47.960 INFO:tasks.workunit.client.1.smithi172.stdout:2/991: dread - d7/de/d58/d56/d89/db5/dca/f10e zero size 2024-03-19T06:05:47.961 INFO:tasks.workunit.client.1.smithi172.stdout:3/986: symlink d0/d5/d6b/dae/db9/dd7/d127/l141 0 2024-03-19T06:05:47.962 INFO:tasks.workunit.client.1.smithi172.stdout:1/953: fdatasync da/dd/d31/dfb/d14/d27/d3f/d5e/f7e 0 2024-03-19T06:05:47.962 INFO:tasks.workunit.client.1.smithi172.stdout:9/941: dwrite d1/d7/dc/dbe/f9c [0,4194304] 0 2024-03-19T06:05:47.962 INFO:tasks.workunit.client.1.smithi172.stdout:5/944: chown d5/d3c/d6c/d9b 3 1 2024-03-19T06:05:47.966 INFO:tasks.workunit.client.0.smithi072.stdout:4/202: rename d5/d15/d3f/d42/l47 to d5/d15/d22/d41/l4a 0 2024-03-19T06:05:47.967 INFO:tasks.workunit.client.1.smithi172.stdout:0/961: fdatasync d11/d18/d38/d3f/dbe/fd3 0 2024-03-19T06:05:47.968 INFO:tasks.workunit.client.1.smithi172.stdout:4/964: fdatasync df/d2b/d2d/f46 0 2024-03-19T06:05:47.974 INFO:tasks.workunit.client.1.smithi172.stdout:1/954: dread da/dd/d31/dfb/f133 [0,4194304] 0 2024-03-19T06:05:47.974 INFO:tasks.workunit.client.1.smithi172.stdout:2/992: write d7/de/d58/d56/d86/d9d/fbf [3382441,93429] 0 2024-03-19T06:05:47.975 INFO:tasks.workunit.client.1.smithi172.stdout:0/962: unlink d11/d22/d46/d84/l88 0 2024-03-19T06:05:47.980 INFO:tasks.workunit.client.1.smithi172.stdout:9/942: creat d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/d132/f140 x:0 0 0 2024-03-19T06:05:47.981 INFO:tasks.workunit.client.1.smithi172.stdout:0/963: unlink d11/d22/d68/ff4 0 2024-03-19T06:05:47.990 INFO:tasks.workunit.client.1.smithi172.stdout:1/955: write da/dd/d31/dfb/d14/f11d [11433,81605] 0 2024-03-19T06:05:47.990 INFO:tasks.workunit.client.1.smithi172.stdout:7/971: dread d0/d22/d1d/d36/f1f [0,4194304] 0 2024-03-19T06:05:47.991 INFO:tasks.workunit.client.1.smithi172.stdout:3/987: rename d0/da8/d25/f1a to d0/db0/db6/dc7/de0/f142 0 2024-03-19T06:05:47.991 INFO:tasks.workunit.client.1.smithi172.stdout:4/965: link df/d11/d12/d69/l6a df/d2b/d2d/db0/l12d 0 2024-03-19T06:05:47.991 INFO:tasks.workunit.client.1.smithi172.stdout:4/966: fdatasync df/d2b/d2d/db0/f12c 0 2024-03-19T06:05:47.991 INFO:tasks.workunit.client.1.smithi172.stdout:5/945: dwrite d5/d3c/d6c/f93 [0,4194304] 0 2024-03-19T06:05:47.997 INFO:tasks.workunit.client.1.smithi172.stdout:9/943: link d1/d7/dc/de/ff3 d1/d7/dc/de/d34/dd7/d11c/f141 0 2024-03-19T06:05:47.998 INFO:tasks.workunit.client.1.smithi172.stdout:3/988: truncate d0/da8/d34/dda/fe7 503986 0 2024-03-19T06:05:48.000 INFO:tasks.workunit.client.1.smithi172.stdout:5/946: creat d5/d1f/d10e/f140 x:0 0 0 2024-03-19T06:05:48.000 INFO:tasks.workunit.client.1.smithi172.stdout:9/944: dread - d1/d7/dc/fb1 zero size 2024-03-19T06:05:48.006 INFO:tasks.workunit.client.1.smithi172.stdout:5/947: write d5/f27 [1945586,95736] 0 2024-03-19T06:05:48.009 INFO:tasks.workunit.client.1.smithi172.stdout:3/989: fsync d0/da8/d34/dda/fec 0 2024-03-19T06:05:48.010 INFO:tasks.workunit.client.1.smithi172.stdout:9/945: mkdir d1/d7/dc/dbe/d142 0 2024-03-19T06:05:48.015 INFO:tasks.workunit.client.1.smithi172.stdout:5/948: mknod d5/d3c/d6c/da2/c141 0 2024-03-19T06:05:48.015 INFO:tasks.workunit.client.1.smithi172.stdout:8/903: dread d0/f1f [4194304,4194304] 0 2024-03-19T06:05:48.016 INFO:tasks.workunit.client.1.smithi172.stdout:3/990: fsync d0/f4 0 2024-03-19T06:05:48.016 INFO:tasks.workunit.client.1.smithi172.stdout:7/972: dwrite d0/d22/d35/dc7/f138 [0,4194304] 0 2024-03-19T06:05:48.022 INFO:tasks.workunit.client.1.smithi172.stdout:5/949: mknod d5/d14/d56/c142 0 2024-03-19T06:05:48.029 INFO:tasks.workunit.client.1.smithi172.stdout:2/993: dread d7/db/f16 [0,4194304] 0 2024-03-19T06:05:48.029 INFO:tasks.workunit.client.1.smithi172.stdout:7/973: creat d0/d22/d1d/d85/d10f/f149 x:0 0 0 2024-03-19T06:05:48.032 INFO:tasks.workunit.client.1.smithi172.stdout:1/956: dread da/d33/d4e/f7d [0,4194304] 0 2024-03-19T06:05:48.033 INFO:tasks.workunit.client.1.smithi172.stdout:8/904: creat d0/d44/d46/d49/d26/dc0/f11d x:0 0 0 2024-03-19T06:05:48.039 INFO:tasks.workunit.client.1.smithi172.stdout:3/991: getdents d0/da8/d34 0 2024-03-19T06:05:48.040 INFO:tasks.workunit.client.1.smithi172.stdout:8/905: mknod d0/d44/d46/d49/d26/dc0/d3d/c11e 0 2024-03-19T06:05:48.041 INFO:tasks.workunit.client.1.smithi172.stdout:4/967: dread df/d2b/d99/faa [0,4194304] 0 2024-03-19T06:05:48.046 INFO:tasks.workunit.client.1.smithi172.stdout:1/957: creat da/dd/d31/dfb/d14/d73/f146 x:0 0 0 2024-03-19T06:05:48.048 INFO:tasks.workunit.client.1.smithi172.stdout:4/968: mknod df/d2b/d2d/db0/c12e 0 2024-03-19T06:05:48.056 INFO:tasks.workunit.client.0.smithi072.stdout:9/95: sync 2024-03-19T06:05:48.056 INFO:tasks.workunit.client.0.smithi072.stdout:8/99: sync 2024-03-19T06:05:48.057 INFO:tasks.workunit.client.0.smithi072.stdout:5/340: sync 2024-03-19T06:05:48.057 INFO:tasks.workunit.client.0.smithi072.stdout:7/143: sync 2024-03-19T06:05:48.057 INFO:tasks.workunit.client.0.smithi072.stdout:3/135: sync 2024-03-19T06:05:48.058 INFO:tasks.workunit.client.0.smithi072.stdout:8/100: readlink da/l15 0 2024-03-19T06:05:48.059 INFO:tasks.workunit.client.1.smithi172.stdout:4/969: creat df/d11/d12/d21/d50/d63/f12f x:0 0 0 2024-03-19T06:05:48.060 INFO:tasks.workunit.client.0.smithi072.stdout:4/203: truncate d5/d11/f1a 61512 0 2024-03-19T06:05:48.060 INFO:tasks.workunit.client.1.smithi172.stdout:2/994: dwrite d7/de/d58/d57/fa4 [4194304,4194304] 0 2024-03-19T06:05:48.060 INFO:tasks.workunit.client.1.smithi172.stdout:3/992: dread d0/da8/d54/d90/f97 [0,4194304] 0 2024-03-19T06:05:48.061 INFO:tasks.workunit.client.0.smithi072.stdout:7/144: write d2/d3/fd [2198717,110402] 0 2024-03-19T06:05:48.062 INFO:tasks.workunit.client.1.smithi172.stdout:9/946: dread d1/d7/dc/dbe/f105 [0,4194304] 0 2024-03-19T06:05:48.062 INFO:tasks.workunit.client.0.smithi072.stdout:8/101: fsync f8 0 2024-03-19T06:05:48.064 INFO:tasks.workunit.client.1.smithi172.stdout:5/950: dwrite d5/d55/de7/f10a [0,4194304] 0 2024-03-19T06:05:48.068 INFO:tasks.workunit.client.0.smithi072.stdout:6/102: dread f3 [4194304,4194304] 0 2024-03-19T06:05:48.071 INFO:tasks.workunit.client.0.smithi072.stdout:4/204: symlink d5/d32/l4b 0 2024-03-19T06:05:48.073 INFO:tasks.workunit.client.1.smithi172.stdout:1/958: link da/dd/d31/dfb/fc8 da/d3b/d95/ded/f147 0 2024-03-19T06:05:48.073 INFO:tasks.workunit.client.0.smithi072.stdout:6/103: stat d7 0 2024-03-19T06:05:48.074 INFO:tasks.workunit.client.1.smithi172.stdout:8/906: dwrite d0/d44/d46/d49/d4f/fc4 [0,4194304] 0 2024-03-19T06:05:48.074 INFO:tasks.workunit.client.1.smithi172.stdout:3/993: mkdir d0/da8/d60/d143 0 2024-03-19T06:05:48.075 INFO:tasks.workunit.client.0.smithi072.stdout:5/341: creat df/d16/d61/f66 x:0 0 0 2024-03-19T06:05:48.078 INFO:tasks.workunit.client.0.smithi072.stdout:4/205: write d5/d1b/d1c/f2f [327035,35100] 0 2024-03-19T06:05:48.079 INFO:tasks.workunit.client.1.smithi172.stdout:2/995: rename d7/de/d58/d56/d86 to d7/de/d58/d56/d86/d9d/dab/d13f 22 2024-03-19T06:05:48.079 INFO:tasks.workunit.client.1.smithi172.stdout:7/974: dread d0/d22/d1d/d85/da8/dfa/d11a/d41/f87 [0,4194304] 0 2024-03-19T06:05:48.079 INFO:tasks.workunit.client.1.smithi172.stdout:5/951: rmdir d5/d14/d15/d40/d6a/d7a 39 2024-03-19T06:05:48.080 INFO:tasks.workunit.client.1.smithi172.stdout:9/947: symlink d1/d7/dc/d47/da3/d12a/l143 0 2024-03-19T06:05:48.081 INFO:tasks.workunit.client.0.smithi072.stdout:7/145: rename d2/d3/l2c to d2/l2e 0 2024-03-19T06:05:48.082 INFO:tasks.workunit.client.1.smithi172.stdout:8/907: write d0/d44/d46/d49/d26/d71/d81/fba [3801206,109444] 0 2024-03-19T06:05:48.084 INFO:tasks.workunit.client.0.smithi072.stdout:6/104: symlink d7/l22 0 2024-03-19T06:05:48.087 INFO:tasks.workunit.client.0.smithi072.stdout:5/342: readlink df/d14/d5d/l58 0 2024-03-19T06:05:48.087 INFO:tasks.workunit.client.0.smithi072.stdout:4/206: mkdir d5/d15/d31/d4c 0 2024-03-19T06:05:48.092 INFO:tasks.workunit.client.1.smithi172.stdout:9/948: fdatasync d1/d7/dc/dbe/d65/f97 0 2024-03-19T06:05:48.093 INFO:tasks.workunit.client.0.smithi072.stdout:9/96: dwrite d11/f13 [4194304,4194304] 0 2024-03-19T06:05:48.094 INFO:tasks.workunit.client.0.smithi072.stdout:7/146: rmdir d2/d3/d18/d20 39 2024-03-19T06:05:48.096 INFO:tasks.workunit.client.1.smithi172.stdout:5/952: rename d5/d3c/d6c/lb3 to d5/d14/d15/d40/d6a/de5/l143 0 2024-03-19T06:05:48.097 INFO:tasks.workunit.client.0.smithi072.stdout:8/102: dwrite da/d13/f16 [0,4194304] 0 2024-03-19T06:05:48.099 INFO:tasks.workunit.client.0.smithi072.stdout:3/136: dread d2/d3/f10 [4194304,4194304] 0 2024-03-19T06:05:48.099 INFO:tasks.workunit.client.0.smithi072.stdout:9/97: chown d11/f19 0 1 2024-03-19T06:05:48.099 INFO:tasks.workunit.client.0.smithi072.stdout:6/105: creat d7/d9/d1e/f23 x:0 0 0 2024-03-19T06:05:48.101 INFO:tasks.workunit.client.0.smithi072.stdout:5/343: truncate df/d13/d24/f65 936911 0 2024-03-19T06:05:48.102 INFO:tasks.workunit.client.1.smithi172.stdout:5/953: fdatasync d5/d3c/d6c/dbd/fc4 0 2024-03-19T06:05:48.104 INFO:tasks.workunit.client.1.smithi172.stdout:4/970: dwrite df/d2b/d99/f121 [0,4194304] 0 2024-03-19T06:05:48.106 INFO:tasks.workunit.client.0.smithi072.stdout:5/344: readlink lc 0 2024-03-19T06:05:48.106 INFO:tasks.workunit.client.0.smithi072.stdout:3/137: stat d2/d3/d15/c20 0 2024-03-19T06:05:48.106 INFO:tasks.workunit.client.0.smithi072.stdout:8/103: mknod da/d13/d1d/c1f 0 2024-03-19T06:05:48.106 INFO:tasks.workunit.client.0.smithi072.stdout:9/98: mknod d11/d1f/c21 0 2024-03-19T06:05:48.109 INFO:tasks.workunit.client.1.smithi172.stdout:9/949: symlink d1/d7/dc/d47/l144 0 2024-03-19T06:05:48.112 INFO:tasks.workunit.client.0.smithi072.stdout:5/345: mknod df/d13/d32/d28/c67 0 2024-03-19T06:05:48.113 INFO:tasks.workunit.client.1.smithi172.stdout:5/954: creat d5/d3c/d6c/da2/f144 x:0 0 0 2024-03-19T06:05:48.113 INFO:tasks.workunit.client.1.smithi172.stdout:4/971: rename df/d11/d12/d21 to df/d11/d12/d21/d50/d63/d130 22 2024-03-19T06:05:48.115 INFO:tasks.workunit.client.0.smithi072.stdout:3/138: mkdir d2/d3/d25 0 2024-03-19T06:05:48.116 INFO:tasks.workunit.client.0.smithi072.stdout:5/346: fdatasync df/f64 0 2024-03-19T06:05:48.116 INFO:tasks.workunit.client.0.smithi072.stdout:6/106: creat d7/d9/d1b/d21/f24 x:0 0 0 2024-03-19T06:05:48.117 INFO:tasks.workunit.client.0.smithi072.stdout:7/147: rename d2/d5/d14 to d2/d3/d18/d2f 0 2024-03-19T06:05:48.119 INFO:tasks.workunit.client.0.smithi072.stdout:5/347: creat df/d3c/f68 x:0 0 0 2024-03-19T06:05:48.120 INFO:tasks.workunit.client.0.smithi072.stdout:6/107: chown d7/d9/l13 18304 1 2024-03-19T06:05:48.120 INFO:tasks.workunit.client.1.smithi172.stdout:5/955: mknod d5/d14/d9f/c145 0 2024-03-19T06:05:48.123 INFO:tasks.workunit.client.0.smithi072.stdout:7/148: write d2/d3/fd [5083330,43235] 0 2024-03-19T06:05:48.126 INFO:tasks.workunit.client.0.smithi072.stdout:6/108: symlink d7/d9/d1b/d21/l25 0 2024-03-19T06:05:48.126 INFO:tasks.workunit.client.1.smithi172.stdout:4/972: rename df/d2b/c90 to df/d11/d12/d21/d50/d63/dbb/c131 0 2024-03-19T06:05:48.129 INFO:tasks.workunit.client.1.smithi172.stdout:8/908: link d0/d44/d46/d49/d26/dc0/d76/fe9 d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/f11f 0 2024-03-19T06:05:48.131 INFO:tasks.workunit.client.1.smithi172.stdout:9/950: mkdir d1/d145 0 2024-03-19T06:05:48.133 INFO:tasks.workunit.client.0.smithi072.stdout:6/109: creat d7/d9/d1e/f26 x:0 0 0 2024-03-19T06:05:48.134 INFO:tasks.workunit.client.1.smithi172.stdout:9/951: fdatasync d1/d7/dc/fe8 0 2024-03-19T06:05:48.134 INFO:tasks.workunit.client.0.smithi072.stdout:7/149: truncate d2/d3/d18/f2d 498084 0 2024-03-19T06:05:48.136 INFO:tasks.workunit.client.1.smithi172.stdout:1/959: write da/dd/d31/dfb/d14/d73/d102/fe3 [1003448,130483] 0 2024-03-19T06:05:48.137 INFO:tasks.workunit.client.0.smithi072.stdout:6/110: chown d7/l19 228637 1 2024-03-19T06:05:48.138 INFO:tasks.workunit.client.1.smithi172.stdout:1/960: dread - da/dd/d31/dfb/d14/ffe zero size 2024-03-19T06:05:48.139 INFO:tasks.workunit.client.0.smithi072.stdout:6/111: readlink d7/l16 0 2024-03-19T06:05:48.143 INFO:tasks.workunit.client.1.smithi172.stdout:8/909: unlink d0/f85 0 2024-03-19T06:05:48.145 INFO:tasks.workunit.client.0.smithi072.stdout:9/99: dwrite d11/f19 [0,4194304] 0 2024-03-19T06:05:48.146 INFO:tasks.workunit.client.0.smithi072.stdout:3/139: truncate d2/f5 2111223 0 2024-03-19T06:05:48.147 INFO:tasks.workunit.client.0.smithi072.stdout:6/112: write d7/d9/fa [2792589,40360] 0 2024-03-19T06:05:48.147 INFO:tasks.workunit.client.1.smithi172.stdout:7/975: write d0/d22/d1d/f45 [3108363,35727] 0 2024-03-19T06:05:48.149 INFO:tasks.workunit.client.0.smithi072.stdout:6/113: write d7/d9/d1e/f26 [776926,23121] 0 2024-03-19T06:05:48.150 INFO:tasks.workunit.client.1.smithi172.stdout:5/956: creat d5/d14/d15/f146 x:0 0 0 2024-03-19T06:05:48.151 INFO:tasks.workunit.client.0.smithi072.stdout:5/348: write df/d14/f2a [607337,86252] 0 2024-03-19T06:05:48.152 INFO:tasks.workunit.client.1.smithi172.stdout:0/964: sync 2024-03-19T06:05:48.152 INFO:tasks.workunit.client.1.smithi172.stdout:9/952: chown d1/d7/dc/de/c71 1030786580 1 2024-03-19T06:05:48.154 INFO:tasks.workunit.client.0.smithi072.stdout:5/349: readlink df/d13/d24/l46 0 2024-03-19T06:05:48.155 INFO:tasks.workunit.client.1.smithi172.stdout:3/994: dwrite d0/d5/d6b/dae/d88/fa2 [0,4194304] 0 2024-03-19T06:05:48.155 INFO:tasks.workunit.client.0.smithi072.stdout:9/100: unlink d11/c16 0 2024-03-19T06:05:48.157 INFO:tasks.workunit.client.0.smithi072.stdout:6/114: mknod d7/c27 0 2024-03-19T06:05:48.158 INFO:tasks.workunit.client.1.smithi172.stdout:9/953: chown d1/fa 856626482 1 2024-03-19T06:05:48.160 INFO:tasks.workunit.client.0.smithi072.stdout:5/350: write df/d13/f23 [4639023,3408] 0 2024-03-19T06:05:48.160 INFO:tasks.workunit.client.0.smithi072.stdout:6/115: chown d7/d9/d1b/d21/l25 3911 1 2024-03-19T06:05:48.162 INFO:tasks.workunit.client.1.smithi172.stdout:8/910: write d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/feb [1116639,92189] 0 2024-03-19T06:05:48.163 INFO:tasks.workunit.client.0.smithi072.stdout:5/351: write df/d13/f56 [896127,99544] 0 2024-03-19T06:05:48.166 INFO:tasks.workunit.client.0.smithi072.stdout:9/101: creat d11/f22 x:0 0 0 2024-03-19T06:05:48.169 INFO:tasks.workunit.client.1.smithi172.stdout:9/954: chown d1/d7/dc/dbe/d114 2546012 1 2024-03-19T06:05:48.169 INFO:tasks.workunit.client.1.smithi172.stdout:2/996: dread d7/de/d58/d55/fce [0,4194304] 0 2024-03-19T06:05:48.169 INFO:tasks.workunit.client.1.smithi172.stdout:7/976: creat d0/d22/d1d/d3a/d46/ddc/d12e/f14a x:0 0 0 2024-03-19T06:05:48.169 INFO:tasks.workunit.client.0.smithi072.stdout:3/140: rename d2/d3/d15/d1c to d2/d3/d26 0 2024-03-19T06:05:48.171 INFO:tasks.workunit.client.1.smithi172.stdout:5/957: chown d5/d55/l7f 980 1 2024-03-19T06:05:48.172 INFO:tasks.workunit.client.0.smithi072.stdout:7/150: truncate d2/d3/fd 745137 0 2024-03-19T06:05:48.173 INFO:tasks.workunit.client.0.smithi072.stdout:6/116: mknod d7/d9/d1e/c28 0 2024-03-19T06:05:48.173 INFO:tasks.workunit.client.0.smithi072.stdout:7/151: readlink d2/d13/l25 0 2024-03-19T06:05:48.176 INFO:tasks.workunit.client.1.smithi172.stdout:2/997: symlink d7/d4c/d70/l140 0 2024-03-19T06:05:48.178 INFO:tasks.workunit.client.0.smithi072.stdout:3/141: write d2/d3/f10 [7798620,38401] 0 2024-03-19T06:05:48.178 INFO:tasks.workunit.client.0.smithi072.stdout:8/104: dread f9 [0,4194304] 0 2024-03-19T06:05:48.180 INFO:tasks.workunit.client.0.smithi072.stdout:5/352: creat df/f69 x:0 0 0 2024-03-19T06:05:48.181 INFO:tasks.workunit.client.0.smithi072.stdout:8/105: chown da/d13/d1d 3 1 2024-03-19T06:05:48.181 INFO:tasks.workunit.client.0.smithi072.stdout:9/102: dread fa [0,4194304] 0 2024-03-19T06:05:48.182 INFO:tasks.workunit.client.1.smithi172.stdout:9/955: fsync d1/d7/dc/d47/d78/f79 0 2024-03-19T06:05:48.183 INFO:tasks.workunit.client.0.smithi072.stdout:9/103: fdatasync d11/f1b 0 2024-03-19T06:05:48.183 INFO:tasks.workunit.client.0.smithi072.stdout:6/117: creat d7/d9/d1b/d21/f29 x:0 0 0 2024-03-19T06:05:48.185 INFO:tasks.workunit.client.1.smithi172.stdout:1/961: dwrite da/dd/d31/dfb/d14/f62 [0,4194304] 0 2024-03-19T06:05:48.186 INFO:tasks.workunit.client.0.smithi072.stdout:7/152: mknod d2/d13/d1d/d2b/c30 0 2024-03-19T06:05:48.186 INFO:tasks.workunit.client.0.smithi072.stdout:6/118: stat d7/d9/d1b 0 2024-03-19T06:05:48.188 INFO:tasks.workunit.client.1.smithi172.stdout:0/965: dwrite d11/d22/d46/dd2/f147 [0,4194304] 0 2024-03-19T06:05:48.189 INFO:tasks.workunit.client.1.smithi172.stdout:8/911: mknod d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/c120 0 2024-03-19T06:05:48.193 INFO:tasks.workunit.client.1.smithi172.stdout:8/912: chown d0/d44/d46/d49/d26/dc0 33928058 1 2024-03-19T06:05:48.193 INFO:tasks.workunit.client.0.smithi072.stdout:3/142: dread d2/d3/f10 [4194304,4194304] 0 2024-03-19T06:05:48.195 INFO:tasks.workunit.client.0.smithi072.stdout:5/353: rmdir df/d16 39 2024-03-19T06:05:48.196 INFO:tasks.workunit.client.1.smithi172.stdout:7/977: dread d0/d22/d35/dc7/f138 [0,4194304] 0 2024-03-19T06:05:48.196 INFO:tasks.workunit.client.1.smithi172.stdout:2/998: rmdir d7/de/d58/d55/d6e/da5 39 2024-03-19T06:05:48.198 INFO:tasks.workunit.client.1.smithi172.stdout:3/995: getdents d0/d5/df8 0 2024-03-19T06:05:48.198 INFO:tasks.workunit.client.1.smithi172.stdout:5/958: mknod d5/d14/d15/d40/c147 0 2024-03-19T06:05:48.203 INFO:tasks.workunit.client.1.smithi172.stdout:4/973: dwrite df/d11/d12/d26/f61 [0,4194304] 0 2024-03-19T06:05:48.207 INFO:tasks.workunit.client.0.smithi072.stdout:8/106: mknod da/d13/c20 0 2024-03-19T06:05:48.209 INFO:tasks.workunit.client.1.smithi172.stdout:3/996: dread - d0/da8/d54/d90/fe3 zero size 2024-03-19T06:05:48.209 INFO:tasks.workunit.client.1.smithi172.stdout:1/962: dread - da/d3b/dcd/ff7 zero size 2024-03-19T06:05:48.209 INFO:tasks.workunit.client.0.smithi072.stdout:9/104: rename d11/f13 to d11/f23 0 2024-03-19T06:05:48.211 INFO:tasks.workunit.client.1.smithi172.stdout:8/913: mknod d0/d44/d46/d49/d26/dc0/d76/c121 0 2024-03-19T06:05:48.214 INFO:tasks.workunit.client.1.smithi172.stdout:7/978: chown d0/d22/d1d/d36/d8d/d5c/cab 41929620 1 2024-03-19T06:05:48.215 INFO:tasks.workunit.client.1.smithi172.stdout:5/959: mkdir d5/d14/d15/d40/d6a/de5/d148 0 2024-03-19T06:05:48.221 INFO:tasks.workunit.client.0.smithi072.stdout:8/107: mkdir da/d21 0 2024-03-19T06:05:48.221 INFO:tasks.workunit.client.0.smithi072.stdout:8/108: chown da/d13 1652 1 2024-03-19T06:05:48.222 INFO:tasks.workunit.client.1.smithi172.stdout:9/956: dwrite d1/d7/dc/d47/f122 [0,4194304] 0 2024-03-19T06:05:48.222 INFO:tasks.workunit.client.1.smithi172.stdout:1/963: dread - da/dd/d31/d47/dbf/f11e zero size 2024-03-19T06:05:48.226 INFO:tasks.workunit.client.1.smithi172.stdout:5/960: chown d5/d14/d9f/f11c 924 1 2024-03-19T06:05:48.226 INFO:tasks.workunit.client.1.smithi172.stdout:3/997: mkdir d0/da8/d34/d4d/dc5/df2/d144 0 2024-03-19T06:05:48.226 INFO:tasks.workunit.client.0.smithi072.stdout:3/143: symlink d2/d3/l27 0 2024-03-19T06:05:48.227 INFO:tasks.workunit.client.1.smithi172.stdout:7/979: mknod d0/d22/d1d/d3a/d11f/c14b 0 2024-03-19T06:05:48.228 INFO:tasks.workunit.client.0.smithi072.stdout:6/119: getdents d7/d9 0 2024-03-19T06:05:48.234 INFO:tasks.workunit.client.0.smithi072.stdout:5/354: dwrite df/d16/f39 [4194304,4194304] 0 2024-03-19T06:05:48.234 INFO:tasks.workunit.client.1.smithi172.stdout:2/999: read d7/de/d58/d56/d89/de6/dbc/dc6/f114 [25197,97738] 0 2024-03-19T06:05:48.235 INFO:tasks.workunit.client.1.smithi172.stdout:0/966: dwrite d11/d22/d68/f75 [0,4194304] 0 2024-03-19T06:05:48.235 INFO:tasks.workunit.client.1.smithi172.stdout:9/957: rmdir d1/d7/dc/de/d34 39 2024-03-19T06:05:48.239 INFO:tasks.workunit.client.0.smithi072.stdout:5/355: write df/d13/f56 [434910,79501] 0 2024-03-19T06:05:48.241 INFO:tasks.workunit.client.1.smithi172.stdout:7/980: creat d0/d22/d1d/d85/da8/dfa/f14c x:0 0 0 2024-03-19T06:05:48.241 INFO:tasks.workunit.client.1.smithi172.stdout:9/958: chown d1/d7/dc/de/c2d 59508605 1 2024-03-19T06:05:48.242 INFO:tasks.workunit.client.1.smithi172.stdout:8/914: write d0/d44/d46/d49/d26/d71/f72 [894522,95141] 0 2024-03-19T06:05:48.245 INFO:tasks.workunit.client.1.smithi172.stdout:5/961: mkdir d5/d3d/d60/dff/d149 0 2024-03-19T06:05:48.247 INFO:tasks.workunit.client.0.smithi072.stdout:6/120: rename d7/d9/d1e/f23 to d7/d9/d1b/f2a 0 2024-03-19T06:05:48.248 INFO:tasks.workunit.client.0.smithi072.stdout:6/121: dread - d7/f1d zero size 2024-03-19T06:05:48.251 INFO:tasks.workunit.client.0.smithi072.stdout:6/122: fsync d7/d9/ff 0 2024-03-19T06:05:48.252 INFO:tasks.workunit.client.1.smithi172.stdout:1/964: mknod da/d3b/c148 0 2024-03-19T06:05:48.252 INFO:tasks.workunit.client.1.smithi172.stdout:0/967: creat d11/f14a x:0 0 0 2024-03-19T06:05:48.253 INFO:tasks.workunit.client.0.smithi072.stdout:3/144: mknod d2/d3/d25/c28 0 2024-03-19T06:05:48.254 INFO:tasks.workunit.client.1.smithi172.stdout:8/915: creat d0/d44/d46/d49/d26/dc0/d3d/d83/dee/f122 x:0 0 0 2024-03-19T06:05:48.256 INFO:tasks.workunit.client.0.smithi072.stdout:9/105: mkdir d11/d24 0 2024-03-19T06:05:48.260 INFO:tasks.workunit.client.1.smithi172.stdout:9/959: write d1/d7/dc/d47/d78/d54/fc8 [995345,3815] 0 2024-03-19T06:05:48.260 INFO:tasks.workunit.client.0.smithi072.stdout:6/123: mkdir d7/d9/d2b 0 2024-03-19T06:05:48.261 INFO:tasks.workunit.client.0.smithi072.stdout:8/109: dwrite da/d13/d14/f1a [0,4194304] 0 2024-03-19T06:05:48.261 INFO:tasks.workunit.client.1.smithi172.stdout:4/974: dwrite df/d2b/d44/d67/f3f [0,4194304] 0 2024-03-19T06:05:48.264 INFO:tasks.workunit.client.1.smithi172.stdout:1/965: write da/dd/d31/dfb/d14/d27/d3f/d5e/dab/dde/fd5 [1996134,64292] 0 2024-03-19T06:05:48.264 INFO:tasks.workunit.client.0.smithi072.stdout:9/106: fdatasync fa 0 2024-03-19T06:05:48.268 INFO:tasks.workunit.client.1.smithi172.stdout:8/916: mkdir d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3/d105/d123 0 2024-03-19T06:05:48.270 INFO:tasks.workunit.client.1.smithi172.stdout:4/975: chown df/d11/d12/d21/d58/d60/f7a 1461 1 2024-03-19T06:05:48.272 INFO:tasks.workunit.client.0.smithi072.stdout:6/124: dread - d7/d9/d1b/f1c zero size 2024-03-19T06:05:48.273 INFO:tasks.workunit.client.1.smithi172.stdout:9/960: creat d1/d7/dc/db7/f146 x:0 0 0 2024-03-19T06:05:48.273 INFO:tasks.workunit.client.1.smithi172.stdout:3/998: truncate d0/da8/d54/d77/f78 779527 0 2024-03-19T06:05:48.274 INFO:tasks.workunit.client.0.smithi072.stdout:8/110: symlink da/l22 0 2024-03-19T06:05:48.274 INFO:tasks.workunit.client.0.smithi072.stdout:6/125: dread - d7/d9/d1b/d21/f29 zero size 2024-03-19T06:05:48.275 INFO:tasks.workunit.client.1.smithi172.stdout:8/917: mknod d0/d44/dd2/da2/c124 0 2024-03-19T06:05:48.277 INFO:tasks.workunit.client.0.smithi072.stdout:6/126: write d7/f15 [343605,34442] 0 2024-03-19T06:05:48.277 INFO:tasks.workunit.client.1.smithi172.stdout:3/999: write d0/d5/f13f [539764,79711] 0 2024-03-19T06:05:48.277 INFO:tasks.workunit.client.1.smithi172.stdout:9/961: fdatasync d1/d7/dc/def/f109 0 2024-03-19T06:05:48.278 INFO:tasks.workunit.client.1.smithi172.stdout:4/976: write df/d2b/d99/f121 [2414355,44341] 0 2024-03-19T06:05:48.280 INFO:tasks.workunit.client.0.smithi072.stdout:6/127: write d7/f11 [2961026,115194] 0 2024-03-19T06:05:48.281 INFO:tasks.workunit.client.0.smithi072.stdout:3/145: link d2/d3/l27 d2/d3/d26/l29 0 2024-03-19T06:05:48.282 INFO:tasks.workunit.client.1.smithi172.stdout:8/918: write d0/d44/d46/d49/d26/dc0/d3d/fa1 [1675411,76193] 0 2024-03-19T06:05:48.282 INFO:tasks.workunit.client.1.smithi172.stdout:5/962: dwrite d5/d14/d15/d40/f99 [0,4194304] 0 2024-03-19T06:05:48.282 INFO:tasks.workunit.client.1.smithi172.stdout:9/962: chown d1/l36 6092982 1 2024-03-19T06:05:48.283 INFO:tasks.workunit.client.0.smithi072.stdout:3/146: stat d2/d19 0 2024-03-19T06:05:48.286 INFO:tasks.workunit.client.1.smithi172.stdout:4/977: creat df/dd7/f132 x:0 0 0 2024-03-19T06:05:48.286 INFO:tasks.workunit.client.0.smithi072.stdout:6/128: symlink d7/l2c 0 2024-03-19T06:05:48.288 INFO:tasks.workunit.client.0.smithi072.stdout:3/147: write d2/d3/f10 [1040554,98903] 0 2024-03-19T06:05:48.291 INFO:tasks.workunit.client.1.smithi172.stdout:5/963: dread - d5/d55/df5/f109 zero size 2024-03-19T06:05:48.293 INFO:tasks.workunit.client.0.smithi072.stdout:6/129: creat d7/f2d x:0 0 0 2024-03-19T06:05:48.295 INFO:tasks.workunit.client.0.smithi072.stdout:8/111: dwrite da/d13/d14/f1a [0,4194304] 0 2024-03-19T06:05:48.295 INFO:tasks.workunit.client.1.smithi172.stdout:8/919: rmdir d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3/d105/d123 0 2024-03-19T06:05:48.298 INFO:tasks.workunit.client.1.smithi172.stdout:5/964: chown d5/d3d/dd6/d100/d133 170181392 1 2024-03-19T06:05:48.299 INFO:tasks.workunit.client.0.smithi072.stdout:3/148: mknod d2/d3/c2a 0 2024-03-19T06:05:48.300 INFO:tasks.workunit.client.0.smithi072.stdout:6/130: chown d7/d9/ff 25495 1 2024-03-19T06:05:48.300 INFO:tasks.workunit.client.1.smithi172.stdout:9/963: rename d1/d7/dc/d47/da3/f74 to d1/d7/dc/de/d34/d48/d82/d92/d95/db4/f147 0 2024-03-19T06:05:48.305 INFO:tasks.workunit.client.0.smithi072.stdout:6/131: mkdir d7/d2e 0 2024-03-19T06:05:48.307 INFO:tasks.workunit.client.1.smithi172.stdout:0/968: dwrite d11/d22/d32/f44 [0,4194304] 0 2024-03-19T06:05:48.308 INFO:tasks.workunit.client.1.smithi172.stdout:7/981: dwrite d0/d22/d27/fdf [0,4194304] 0 2024-03-19T06:05:48.313 INFO:tasks.workunit.client.1.smithi172.stdout:7/982: write d0/d22/d27/db0/df8/f111 [2831815,854] 0 2024-03-19T06:05:48.321 INFO:tasks.workunit.client.1.smithi172.stdout:8/920: mkdir d0/d125 0 2024-03-19T06:05:48.326 INFO:tasks.workunit.client.0.smithi072.stdout:3/149: dwrite d2/d3/f10 [0,4194304] 0 2024-03-19T06:05:48.327 INFO:tasks.workunit.client.1.smithi172.stdout:5/965: unlink d5/d3c/d6c/f136 0 2024-03-19T06:05:48.333 INFO:tasks.workunit.client.1.smithi172.stdout:7/983: creat d0/d22/d1d/d36/d8d/d5c/d67/f14d x:0 0 0 2024-03-19T06:05:48.336 INFO:tasks.workunit.client.1.smithi172.stdout:7/984: chown d0/d22/d1d/d85/d10f/f149 10544 1 2024-03-19T06:05:48.344 INFO:tasks.workunit.client.1.smithi172.stdout:4/978: dread df/d11/d12/d21/d50/d63/dbb/f68 [0,4194304] 0 2024-03-19T06:05:48.347 INFO:tasks.workunit.client.1.smithi172.stdout:8/921: creat d0/d44/d46/d49/d26/d71/d81/d27/d100/f126 x:0 0 0 2024-03-19T06:05:48.347 INFO:tasks.workunit.client.1.smithi172.stdout:7/985: creat d0/d22/d35/d8e/f14e x:0 0 0 2024-03-19T06:05:48.348 INFO:tasks.workunit.client.1.smithi172.stdout:4/979: chown df/d11/d12/d21/l4a 86 1 2024-03-19T06:05:48.349 INFO:tasks.workunit.client.0.smithi072.stdout:6/132: dwrite d7/d9/d1b/d21/f24 [0,4194304] 0 2024-03-19T06:05:48.352 INFO:tasks.workunit.client.1.smithi172.stdout:4/980: read df/d11/d12/d21/d50/f5f [4122664,63953] 0 2024-03-19T06:05:48.352 INFO:tasks.workunit.client.1.smithi172.stdout:7/986: fsync d0/d22/d1d/d3a/d46/f99 0 2024-03-19T06:05:48.355 INFO:tasks.workunit.client.0.smithi072.stdout:8/112: dwrite da/f11 [0,4194304] 0 2024-03-19T06:05:48.359 INFO:tasks.workunit.client.0.smithi072.stdout:6/133: stat d7/d9/d1e/f26 0 2024-03-19T06:05:48.360 INFO:tasks.workunit.client.0.smithi072.stdout:8/113: mknod da/d13/d14/c23 0 2024-03-19T06:05:48.361 INFO:tasks.workunit.client.0.smithi072.stdout:3/150: truncate f1 1207389 0 2024-03-19T06:05:48.363 INFO:tasks.workunit.client.0.smithi072.stdout:6/134: creat d7/d2e/f2f x:0 0 0 2024-03-19T06:05:48.364 INFO:tasks.workunit.client.0.smithi072.stdout:3/151: read - d2/d3/d26/f22 zero size 2024-03-19T06:05:48.366 INFO:tasks.workunit.client.0.smithi072.stdout:8/114: symlink da/d13/d14/d1b/l24 0 2024-03-19T06:05:48.368 INFO:tasks.workunit.client.0.smithi072.stdout:3/152: chown d2/d19/c1a 0 1 2024-03-19T06:05:48.368 INFO:tasks.workunit.client.0.smithi072.stdout:6/135: dread - d7/d9/d1b/d21/f29 zero size 2024-03-19T06:05:48.370 INFO:tasks.workunit.client.1.smithi172.stdout:7/987: readlink d0/d22/d1d/d36/d8d/d5c/l13a 0 2024-03-19T06:05:48.373 INFO:tasks.workunit.client.0.smithi072.stdout:3/153: mknod d2/d3/c2b 0 2024-03-19T06:05:48.375 INFO:tasks.workunit.client.1.smithi172.stdout:8/922: rename d0/d44/d46/d49/d26/dc0/dbf/l113 to d0/d44/d46/d49/d26/d71/l127 0 2024-03-19T06:05:48.377 INFO:tasks.workunit.client.1.smithi172.stdout:7/988: creat d0/d22/d1d/d85/da8/dfa/d11a/dfb/f14f x:0 0 0 2024-03-19T06:05:48.379 INFO:tasks.workunit.client.0.smithi072.stdout:3/154: creat d2/f2c x:0 0 0 2024-03-19T06:05:48.381 INFO:tasks.workunit.client.1.smithi172.stdout:5/966: dread d5/d14/d15/d40/f73 [0,4194304] 0 2024-03-19T06:05:48.382 INFO:tasks.workunit.client.1.smithi172.stdout:0/969: dwrite d11/d22/d68/fb2 [0,4194304] 0 2024-03-19T06:05:48.382 INFO:tasks.workunit.client.1.smithi172.stdout:8/923: fsync d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/fb9 0 2024-03-19T06:05:48.382 INFO:tasks.workunit.client.1.smithi172.stdout:7/989: fdatasync d0/d22/d1d/d85/da8/fbc 0 2024-03-19T06:05:48.384 INFO:tasks.workunit.client.1.smithi172.stdout:7/990: stat d0/d22/d27/db0/df8/f111 0 2024-03-19T06:05:48.385 INFO:tasks.workunit.client.0.smithi072.stdout:6/136: dwrite d7/d9/ff [0,4194304] 0 2024-03-19T06:05:48.387 INFO:tasks.workunit.client.0.smithi072.stdout:8/115: dwrite f9 [4194304,4194304] 0 2024-03-19T06:05:48.387 INFO:tasks.workunit.client.1.smithi172.stdout:4/981: rename f6 to df/d11/d12/d21/d50/d63/f133 0 2024-03-19T06:05:48.390 INFO:tasks.workunit.client.1.smithi172.stdout:8/924: mknod d0/d44/d46/d49/d26/dc0/dd3/c128 0 2024-03-19T06:05:48.390 INFO:tasks.workunit.client.0.smithi072.stdout:6/137: dread - d7/f2d zero size 2024-03-19T06:05:48.393 INFO:tasks.workunit.client.0.smithi072.stdout:3/155: rename d2/d3/d25/c28 to d2/d3/d26/c2d 0 2024-03-19T06:05:48.400 INFO:tasks.workunit.client.0.smithi072.stdout:8/116: mknod da/d13/d14/d1b/c25 0 2024-03-19T06:05:48.401 INFO:tasks.workunit.client.1.smithi172.stdout:8/925: symlink d0/d44/d46/d49/d26/d71/d81/d27/l129 0 2024-03-19T06:05:48.403 INFO:tasks.workunit.client.0.smithi072.stdout:3/156: fsync d2/d3/fb 0 2024-03-19T06:05:48.406 INFO:tasks.workunit.client.0.smithi072.stdout:3/157: mknod d2/d19/c2e 0 2024-03-19T06:05:48.409 INFO:tasks.workunit.client.0.smithi072.stdout:8/117: rmdir da/d21 0 2024-03-19T06:05:48.409 INFO:tasks.workunit.client.0.smithi072.stdout:3/158: fsync d2/d3/d26/f23 0 2024-03-19T06:05:48.410 INFO:tasks.workunit.client.0.smithi072.stdout:6/138: dwrite d7/d9/ff [0,4194304] 0 2024-03-19T06:05:48.416 INFO:tasks.workunit.client.0.smithi072.stdout:8/118: rename da/ce to da/c26 0 2024-03-19T06:05:48.418 INFO:tasks.workunit.client.0.smithi072.stdout:3/159: getdents d2/d19/d1e 0 2024-03-19T06:05:48.419 INFO:tasks.workunit.client.0.smithi072.stdout:3/160: stat d2 0 2024-03-19T06:05:48.419 INFO:tasks.workunit.client.0.smithi072.stdout:6/139: mkdir d7/d9/d30 0 2024-03-19T06:05:48.421 INFO:tasks.workunit.client.0.smithi072.stdout:6/140: chown l5 2743 1 2024-03-19T06:05:48.421 INFO:tasks.workunit.client.0.smithi072.stdout:3/161: write d2/d3/d26/f22 [115548,38882] 0 2024-03-19T06:05:48.423 INFO:tasks.workunit.client.1.smithi172.stdout:4/982: creat df/d2b/d44/d67/d10e/f134 x:0 0 0 2024-03-19T06:05:48.424 INFO:tasks.workunit.client.1.smithi172.stdout:7/991: link d0/d22/d1d/d85/da8/c132 d0/d22/d1d/d3a/d46/d103/c150 0 2024-03-19T06:05:48.424 INFO:tasks.workunit.client.1.smithi172.stdout:0/970: write d11/d18/d38/f92 [439413,74124] 0 2024-03-19T06:05:48.427 INFO:tasks.workunit.client.0.smithi072.stdout:3/162: creat d2/f2f x:0 0 0 2024-03-19T06:05:48.428 INFO:tasks.workunit.client.0.smithi072.stdout:3/163: chown d2/l1f 9382 1 2024-03-19T06:05:48.428 INFO:tasks.workunit.client.1.smithi172.stdout:4/983: mkdir df/d2b/d44/d67/d10e/d135 0 2024-03-19T06:05:48.429 INFO:tasks.workunit.client.1.smithi172.stdout:0/971: truncate d11/d14/d2c/d4e/f87 4815577 0 2024-03-19T06:05:48.430 INFO:tasks.workunit.client.1.smithi172.stdout:7/992: symlink d0/d22/d1d/d85/da8/d102/l151 0 2024-03-19T06:05:48.431 INFO:tasks.workunit.client.1.smithi172.stdout:8/926: mknod d0/d44/d46/d49/d26/dc0/c12a 0 2024-03-19T06:05:48.433 INFO:tasks.workunit.client.1.smithi172.stdout:0/972: truncate d11/d14/d9a/dea/dab/f110 607159 0 2024-03-19T06:05:48.434 INFO:tasks.workunit.client.1.smithi172.stdout:0/973: chown d11/d18 53 1 2024-03-19T06:05:48.435 INFO:tasks.workunit.client.1.smithi172.stdout:7/993: creat d0/d22/d1d/d36/d56/dc6/f152 x:0 0 0 2024-03-19T06:05:48.437 INFO:tasks.workunit.client.1.smithi172.stdout:0/974: fsync d11/d18/da5/da8/fac 0 2024-03-19T06:05:48.437 INFO:tasks.workunit.client.0.smithi072.stdout:6/141: dwrite d7/f10 [0,4194304] 0 2024-03-19T06:05:48.440 INFO:tasks.workunit.client.1.smithi172.stdout:0/975: truncate d11/d14/d9a/dea/fe6 4552028 0 2024-03-19T06:05:48.441 INFO:tasks.workunit.client.1.smithi172.stdout:7/994: mkdir d0/d22/d1d/d36/d8d/d5c/d153 0 2024-03-19T06:05:48.442 INFO:tasks.workunit.client.0.smithi072.stdout:6/142: unlink d7/d9/d1b/f1c 0 2024-03-19T06:05:48.448 INFO:tasks.workunit.client.1.smithi172.stdout:0/976: truncate d11/d18/d38/d3f/d43/d89/fc9 780882 0 2024-03-19T06:05:48.448 INFO:tasks.workunit.client.1.smithi172.stdout:7/995: creat d0/d22/d1d/d85/d10f/d127/f154 x:0 0 0 2024-03-19T06:05:48.449 INFO:tasks.workunit.client.0.smithi072.stdout:3/164: dwrite d2/d3/d26/f22 [0,4194304] 0 2024-03-19T06:05:48.451 INFO:tasks.workunit.client.0.smithi072.stdout:6/143: dread d7/d9/d1e/f26 [0,4194304] 0 2024-03-19T06:05:48.453 INFO:tasks.workunit.client.0.smithi072.stdout:3/165: creat d2/f30 x:0 0 0 2024-03-19T06:05:48.454 INFO:tasks.workunit.client.1.smithi172.stdout:4/984: dwrite df/d11/d12/d69/fb7 [0,4194304] 0 2024-03-19T06:05:48.464 INFO:tasks.workunit.client.1.smithi172.stdout:4/985: chown df/d2b/d2d/d101/dc9/l120 465198 1 2024-03-19T06:05:48.467 INFO:tasks.workunit.client.0.smithi072.stdout:3/166: dread d2/d3/d26/f22 [0,4194304] 0 2024-03-19T06:05:48.468 INFO:tasks.workunit.client.1.smithi172.stdout:4/986: rmdir df/d2b/d44/d93/d102 39 2024-03-19T06:05:48.471 INFO:tasks.workunit.client.1.smithi172.stdout:0/977: write d11/d22/d68/fa2 [662842,83509] 0 2024-03-19T06:05:48.475 INFO:tasks.workunit.client.1.smithi172.stdout:4/987: getdents df/d11/d12/d26/d84/da2 0 2024-03-19T06:05:48.476 INFO:tasks.workunit.client.1.smithi172.stdout:0/978: mkdir d11/d18/d38/d3f/d43/d62/dc0/d14b 0 2024-03-19T06:05:48.477 INFO:tasks.workunit.client.1.smithi172.stdout:4/988: truncate df/d11/d12/f1a 6190594 0 2024-03-19T06:05:48.479 INFO:tasks.workunit.client.1.smithi172.stdout:0/979: truncate d11/d22/f34 2012674 0 2024-03-19T06:05:48.480 INFO:tasks.workunit.client.1.smithi172.stdout:4/989: symlink df/d11/d12/d126/l136 0 2024-03-19T06:05:48.484 INFO:tasks.workunit.client.1.smithi172.stdout:4/990: creat df/d2b/d44/f137 x:0 0 0 2024-03-19T06:05:48.485 INFO:tasks.workunit.client.1.smithi172.stdout:1/966: sync 2024-03-19T06:05:48.485 INFO:tasks.workunit.client.1.smithi172.stdout:4/991: chown c4 33024 1 2024-03-19T06:05:48.487 INFO:tasks.workunit.client.1.smithi172.stdout:0/980: dread d11/d18/d38/d3f/dbe/fd3 [0,4194304] 0 2024-03-19T06:05:48.492 INFO:tasks.workunit.client.1.smithi172.stdout:0/981: truncate d11/d18/d38/d3f/d43/d62/f95 761148 0 2024-03-19T06:05:48.494 INFO:tasks.workunit.client.1.smithi172.stdout:0/982: chown d11/d22/d68/fa6 1300173 1 2024-03-19T06:05:48.497 INFO:tasks.workunit.client.0.smithi072.stdout:6/144: mkdir d7/d9/d1b/d31 0 2024-03-19T06:05:48.504 INFO:tasks.workunit.client.1.smithi172.stdout:0/983: symlink d11/d18/d38/d3f/d9f/dbb/dc8/d12c/l14c 0 2024-03-19T06:05:48.504 INFO:tasks.workunit.client.0.smithi072.stdout:3/167: getdents d2 0 2024-03-19T06:05:48.506 INFO:tasks.workunit.client.1.smithi172.stdout:4/992: dwrite df/d11/d12/d21/d50/d63/dbb/f68 [0,4194304] 0 2024-03-19T06:05:48.507 INFO:tasks.workunit.client.0.smithi072.stdout:3/168: mknod d2/d3/d26/c31 0 2024-03-19T06:05:48.512 INFO:tasks.workunit.client.1.smithi172.stdout:4/993: unlink df/d2b/d44/d67/ff2 0 2024-03-19T06:05:48.515 INFO:tasks.workunit.client.0.smithi072.stdout:6/145: dwrite d7/d9/d1b/d21/f29 [0,4194304] 0 2024-03-19T06:05:48.517 INFO:tasks.workunit.client.1.smithi172.stdout:4/994: mkdir df/d11/d12/d26/d84/da2/d138 0 2024-03-19T06:05:48.521 INFO:tasks.workunit.client.0.smithi072.stdout:6/146: mknod d7/c32 0 2024-03-19T06:05:48.525 INFO:tasks.workunit.client.1.smithi172.stdout:4/995: creat df/d2b/d2d/d101/dc9/dd2/f139 x:0 0 0 2024-03-19T06:05:48.526 INFO:tasks.workunit.client.1.smithi172.stdout:4/996: fdatasync df/d11/d12/d69/f12a 0 2024-03-19T06:05:48.526 INFO:tasks.workunit.client.0.smithi072.stdout:6/147: mkdir d7/d9/d1b/d33 0 2024-03-19T06:05:48.527 INFO:tasks.workunit.client.0.smithi072.stdout:3/169: dwrite d2/d3/f14 [0,4194304] 0 2024-03-19T06:05:48.528 INFO:tasks.workunit.client.1.smithi172.stdout:4/997: fsync df/d11/d12/d6e/d112/f125 0 2024-03-19T06:05:48.528 INFO:tasks.workunit.client.1.smithi172.stdout:0/984: dwrite d11/d18/d38/d3f/d8b/fa3 [4194304,4194304] 0 2024-03-19T06:05:48.530 INFO:tasks.workunit.client.0.smithi072.stdout:3/170: truncate d2/f2c 216895 0 2024-03-19T06:05:48.530 INFO:tasks.workunit.client.1.smithi172.stdout:0/985: readlink d11/d18/da5/da8/l10c 0 2024-03-19T06:05:48.538 INFO:tasks.workunit.client.0.smithi072.stdout:6/148: rename d7/f8 to d7/f34 0 2024-03-19T06:05:48.538 INFO:tasks.workunit.client.0.smithi072.stdout:3/171: creat d2/d19/d1e/f32 x:0 0 0 2024-03-19T06:05:48.539 INFO:tasks.workunit.client.0.smithi072.stdout:6/149: readlink d7/l2c 0 2024-03-19T06:05:48.549 INFO:tasks.workunit.client.1.smithi172.stdout:0/986: dread d11/d18/d38/d3f/d8b/fa3 [4194304,4194304] 0 2024-03-19T06:05:48.553 INFO:tasks.workunit.client.0.smithi072.stdout:6/150: dwrite d7/f11 [0,4194304] 0 2024-03-19T06:05:48.556 INFO:tasks.workunit.client.1.smithi172.stdout:0/987: link d11/f12 d11/d18/d38/d3f/f14d 0 2024-03-19T06:05:48.561 INFO:tasks.workunit.client.1.smithi172.stdout:0/988: getdents d11/d14/d2c/dc2/dcf/d149 0 2024-03-19T06:05:48.562 INFO:tasks.workunit.client.0.smithi072.stdout:3/172: write d2/f5 [1991855,52140] 0 2024-03-19T06:05:48.565 INFO:tasks.workunit.client.0.smithi072.stdout:3/173: symlink d2/d19/d1e/l33 0 2024-03-19T06:05:48.566 INFO:tasks.workunit.client.1.smithi172.stdout:0/989: creat d11/d14/d2c/dc2/dcf/d105/f14e x:0 0 0 2024-03-19T06:05:48.568 INFO:tasks.workunit.client.1.smithi172.stdout:4/998: dwrite df/d11/d12/d21/d58/ffd [0,4194304] 0 2024-03-19T06:05:48.575 INFO:tasks.workunit.client.1.smithi172.stdout:0/990: symlink d11/d22/d46/l14f 0 2024-03-19T06:05:48.576 INFO:tasks.workunit.client.0.smithi072.stdout:3/174: dread d2/d3/d26/f23 [0,4194304] 0 2024-03-19T06:05:48.579 INFO:tasks.workunit.client.1.smithi172.stdout:0/991: symlink d11/d18/d38/d3f/d9f/l150 0 2024-03-19T06:05:48.579 INFO:tasks.workunit.client.0.smithi072.stdout:3/175: symlink d2/d3/d25/l34 0 2024-03-19T06:05:48.584 INFO:tasks.workunit.client.1.smithi172.stdout:0/992: unlink d11/d18/d38/d3f/d43/d62/dc0/lf3 0 2024-03-19T06:05:48.584 INFO:tasks.workunit.client.1.smithi172.stdout:4/999: dwrite df/d11/d12/d21/d50/d63/dbb/f68 [0,4194304] 0 2024-03-19T06:05:48.587 INFO:tasks.workunit.client.1.smithi172.stdout:0/993: write d11/d14/d9a/dea/dab/f110 [579075,32037] 0 2024-03-19T06:05:48.593 INFO:tasks.workunit.client.1.smithi172.stdout:0/994: write d11/d22/d46/f6b [927018,118604] 0 2024-03-19T06:05:48.595 INFO:tasks.workunit.client.0.smithi072.stdout:3/176: write f1 [728561,40171] 0 2024-03-19T06:05:48.597 INFO:tasks.workunit.client.1.smithi172.stdout:0/995: creat d11/d14/d2c/dc2/dcf/f151 x:0 0 0 2024-03-19T06:05:48.600 INFO:tasks.workunit.client.0.smithi072.stdout:3/177: creat d2/d3/d26/f35 x:0 0 0 2024-03-19T06:05:48.601 INFO:tasks.workunit.client.1.smithi172.stdout:0/996: mknod d11/d14/d2c/dc2/c152 0 2024-03-19T06:05:48.601 INFO:tasks.workunit.client.0.smithi072.stdout:3/178: write d2/f5 [1190270,78260] 0 2024-03-19T06:05:48.603 INFO:tasks.workunit.client.0.smithi072.stdout:3/179: rmdir d2/d19 39 2024-03-19T06:05:48.609 INFO:tasks.workunit.client.0.smithi072.stdout:3/180: creat d2/d3/d15/f36 x:0 0 0 2024-03-19T06:05:48.611 INFO:tasks.workunit.client.0.smithi072.stdout:3/181: unlink d2/d3/c2a 0 2024-03-19T06:05:48.612 INFO:tasks.workunit.client.0.smithi072.stdout:3/182: fdatasync d2/d3/d26/f23 0 2024-03-19T06:05:48.615 INFO:tasks.workunit.client.1.smithi172.stdout:0/997: dwrite d11/d14/db7/f13e [0,4194304] 0 2024-03-19T06:05:48.617 INFO:tasks.workunit.client.1.smithi172.stdout:9/964: sync 2024-03-19T06:05:48.618 INFO:tasks.workunit.client.0.smithi072.stdout:3/183: dread d2/d3/d26/f23 [0,4194304] 0 2024-03-19T06:05:48.619 INFO:tasks.workunit.client.1.smithi172.stdout:0/998: mkdir d11/dc3/d153 0 2024-03-19T06:05:48.619 INFO:tasks.workunit.client.1.smithi172.stdout:9/965: stat d1/d7/dc/d47/da5/f108 0 2024-03-19T06:05:48.620 INFO:tasks.workunit.client.0.smithi072.stdout:3/184: fdatasync d2/d3/d26/f22 0 2024-03-19T06:05:48.620 INFO:tasks.workunit.client.1.smithi172.stdout:9/966: fdatasync d1/d7/dc/d47/d78/d54/f6d 0 2024-03-19T06:05:48.621 INFO:tasks.workunit.client.1.smithi172.stdout:0/999: truncate d11/f13 3449264 0 2024-03-19T06:05:48.623 INFO:tasks.workunit.client.1.smithi172.stdout:9/967: chown d1/d7/dc/dbe/dc9/fe3 1437117 1 2024-03-19T06:05:48.627 INFO:tasks.workunit.client.0.smithi072.stdout:3/185: symlink d2/l37 0 2024-03-19T06:05:48.629 INFO:tasks.workunit.client.1.smithi172.stdout:9/968: dread d1/d7/dc/d47/d78/d54/d91/f35 [0,4194304] 0 2024-03-19T06:05:48.631 INFO:tasks.workunit.client.1.smithi172.stdout:9/969: write d1/d7/dc/de/d34/f137 [3667242,70814] 0 2024-03-19T06:05:48.636 INFO:tasks.workunit.client.0.smithi072.stdout:1/104: sync 2024-03-19T06:05:48.640 INFO:tasks.workunit.client.0.smithi072.stdout:1/105: mknod d1/d11/d18/d19/d1a/c20 0 2024-03-19T06:05:48.640 INFO:tasks.workunit.client.1.smithi172.stdout:9/970: dread d1/d7/dc/d47/fd0 [0,4194304] 0 2024-03-19T06:05:48.641 INFO:tasks.workunit.client.0.smithi072.stdout:3/186: dwrite d2/f2c [0,4194304] 0 2024-03-19T06:05:48.646 INFO:tasks.workunit.client.0.smithi072.stdout:1/106: rmdir d1 39 2024-03-19T06:05:48.651 INFO:tasks.workunit.client.1.smithi172.stdout:7/996: sync 2024-03-19T06:05:48.652 INFO:tasks.workunit.client.1.smithi172.stdout:8/927: sync 2024-03-19T06:05:48.652 INFO:tasks.workunit.client.1.smithi172.stdout:5/967: sync 2024-03-19T06:05:48.654 INFO:tasks.workunit.client.1.smithi172.stdout:7/997: write d0/d22/d4b/fcf [7137322,58395] 0 2024-03-19T06:05:48.654 INFO:tasks.workunit.client.1.smithi172.stdout:8/928: dread - d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/f11b zero size 2024-03-19T06:05:48.664 INFO:tasks.workunit.client.0.smithi072.stdout:1/107: fsync d1/f14 0 2024-03-19T06:05:48.666 INFO:tasks.workunit.client.0.smithi072.stdout:3/187: link d2/d3/l1b d2/d19/d1e/l38 0 2024-03-19T06:05:48.666 INFO:tasks.workunit.client.0.smithi072.stdout:1/108: readlink d1/l8 0 2024-03-19T06:05:48.671 INFO:tasks.workunit.client.0.smithi072.stdout:3/188: creat d2/d3/d25/f39 x:0 0 0 2024-03-19T06:05:48.671 INFO:tasks.workunit.client.0.smithi072.stdout:1/109: fdatasync d1/f6 0 2024-03-19T06:05:48.673 INFO:tasks.workunit.client.0.smithi072.stdout:3/189: chown d2/f30 103 1 2024-03-19T06:05:48.674 INFO:tasks.workunit.client.0.smithi072.stdout:1/110: truncate d1/d11/f1c 1244659 0 2024-03-19T06:05:48.675 INFO:tasks.workunit.client.0.smithi072.stdout:3/190: write d2/d3/f14 [4049363,101155] 0 2024-03-19T06:05:48.682 INFO:tasks.workunit.client.0.smithi072.stdout:1/111: dread d1/f14 [4194304,4194304] 0 2024-03-19T06:05:48.685 INFO:tasks.workunit.client.0.smithi072.stdout:3/191: dread d2/f5 [0,4194304] 0 2024-03-19T06:05:48.686 INFO:tasks.workunit.client.0.smithi072.stdout:3/192: chown d2/d19/d1e/f32 67777 1 2024-03-19T06:05:48.690 INFO:tasks.workunit.client.0.smithi072.stdout:1/112: link d1/l1d d1/d11/d18/l21 0 2024-03-19T06:05:48.692 INFO:tasks.workunit.client.1.smithi172.stdout:1/967: sync 2024-03-19T06:05:48.696 INFO:tasks.workunit.client.0.smithi072.stdout:3/193: dread d2/d3/f14 [0,4194304] 0 2024-03-19T06:05:48.699 INFO:tasks.workunit.client.1.smithi172.stdout:5/968: symlink d5/d3c/d6c/d9b/l14a 0 2024-03-19T06:05:48.701 INFO:tasks.workunit.client.1.smithi172.stdout:8/929: creat d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/f12b x:0 0 0 2024-03-19T06:05:48.702 INFO:tasks.workunit.client.1.smithi172.stdout:9/971: symlink d1/d7/dc/d47/l148 0 2024-03-19T06:05:48.704 INFO:tasks.workunit.client.0.smithi072.stdout:3/194: link d2/d19/d1e/l38 d2/d19/d1e/l3a 0 2024-03-19T06:05:48.704 INFO:tasks.workunit.client.1.smithi172.stdout:7/998: creat d0/d22/d1d/d36/d8d/d5c/d153/f155 x:0 0 0 2024-03-19T06:05:48.704 INFO:tasks.workunit.client.1.smithi172.stdout:5/969: write d5/d3c/d6c/da2/f144 [311186,81312] 0 2024-03-19T06:05:48.705 INFO:tasks.workunit.client.1.smithi172.stdout:9/972: fsync d1/d7/dc/dbe/d114/f12d 0 2024-03-19T06:05:48.708 INFO:tasks.workunit.client.0.smithi072.stdout:1/113: dwrite d1/d16/f1e [0,4194304] 0 2024-03-19T06:05:48.709 INFO:tasks.workunit.client.1.smithi172.stdout:7/999: fsync d0/d22/d1d/d36/d40/fb1 0 2024-03-19T06:05:48.710 INFO:tasks.workunit.client.1.smithi172.stdout:9/973: read - d1/d7/dc/def/f109 zero size 2024-03-19T06:05:48.712 INFO:tasks.workunit.client.0.smithi072.stdout:3/195: rename d2/cd to d2/d19/c3b 0 2024-03-19T06:05:48.714 INFO:tasks.workunit.client.1.smithi172.stdout:5/970: mkdir d5/d1f/d2f/d53/d14b 0 2024-03-19T06:05:48.715 INFO:tasks.workunit.client.0.smithi072.stdout:1/114: creat d1/d11/d18/d19/f22 x:0 0 0 2024-03-19T06:05:48.715 INFO:tasks.workunit.client.1.smithi172.stdout:8/930: getdents d0/d44/d46/d49/d26/dc0/d76/dc3/dc9 0 2024-03-19T06:05:48.715 INFO:tasks.workunit.client.1.smithi172.stdout:9/974: chown d1/d7/dc/de/d34/dd7/d11c 2245 1 2024-03-19T06:05:48.716 INFO:tasks.workunit.client.0.smithi072.stdout:3/196: stat d2/d3/d26/l29 0 2024-03-19T06:05:48.717 INFO:tasks.workunit.client.0.smithi072.stdout:1/115: rename d1/d11/d18/d19 to d1/d11/d18/d19/d1a/d23 22 2024-03-19T06:05:48.719 INFO:tasks.workunit.client.0.smithi072.stdout:3/197: write d2/d3/d26/f35 [340281,41887] 0 2024-03-19T06:05:48.719 INFO:tasks.workunit.client.1.smithi172.stdout:5/971: unlink d5/c32 0 2024-03-19T06:05:48.721 INFO:tasks.workunit.client.0.smithi072.stdout:1/116: mkdir d1/d11/d18/d19/d1a/d24 0 2024-03-19T06:05:48.721 INFO:tasks.workunit.client.0.smithi072.stdout:3/198: write d2/d3/d25/f39 [377819,89470] 0 2024-03-19T06:05:48.723 INFO:tasks.workunit.client.0.smithi072.stdout:1/117: chown d1/d11/d18/d19/d1a/c20 36 1 2024-03-19T06:05:48.723 INFO:tasks.workunit.client.1.smithi172.stdout:1/968: dwrite da/dd/d31/d47/dbf/fc0 [4194304,4194304] 0 2024-03-19T06:05:48.724 INFO:tasks.workunit.client.1.smithi172.stdout:9/975: dread - d1/d7/dc/de/d34/d48/d82/f100 zero size 2024-03-19T06:05:48.725 INFO:tasks.workunit.client.0.smithi072.stdout:1/118: chown d1/d11/d18/d19/d1a/c20 1 1 2024-03-19T06:05:48.725 INFO:tasks.workunit.client.0.smithi072.stdout:3/199: symlink d2/l3c 0 2024-03-19T06:05:48.730 INFO:tasks.workunit.client.1.smithi172.stdout:8/931: rename d0/d44/d46/d49/d26/dc0/d76/dc3/dc9/c108 to d0/d44/d46/d49/d26/c12c 0 2024-03-19T06:05:48.734 INFO:tasks.workunit.client.1.smithi172.stdout:1/969: symlink da/l149 0 2024-03-19T06:05:48.735 INFO:tasks.workunit.client.1.smithi172.stdout:5/972: mkdir d5/d14/d15/d40/d6a/de5/d148/d14c 0 2024-03-19T06:05:48.736 INFO:tasks.workunit.client.1.smithi172.stdout:9/976: mkdir d1/d145/d149 0 2024-03-19T06:05:48.738 INFO:tasks.workunit.client.1.smithi172.stdout:9/977: readlink d1/d7/dc/d47/l86 0 2024-03-19T06:05:48.739 INFO:tasks.workunit.client.1.smithi172.stdout:1/970: mkdir da/dd/d31/dfb/d14/d27/d3f/d5e/dab/d14a 0 2024-03-19T06:05:48.739 INFO:tasks.workunit.client.0.smithi072.stdout:1/119: dread d1/d11/f1c [0,4194304] 0 2024-03-19T06:05:48.739 INFO:tasks.workunit.client.1.smithi172.stdout:5/973: mknod d5/d3c/d6c/c14d 0 2024-03-19T06:05:48.743 INFO:tasks.workunit.client.0.smithi072.stdout:1/120: getdents d1/d11/d18/d19/d1a/d24 0 2024-03-19T06:05:48.745 INFO:tasks.workunit.client.0.smithi072.stdout:3/200: dwrite d2/d3/d15/f36 [0,4194304] 0 2024-03-19T06:05:48.747 INFO:tasks.workunit.client.0.smithi072.stdout:1/121: getdents d1/d11/d18/d19/d1a/d24 0 2024-03-19T06:05:48.748 INFO:tasks.workunit.client.0.smithi072.stdout:1/122: readlink d1/l12 0 2024-03-19T06:05:48.748 INFO:tasks.workunit.client.1.smithi172.stdout:9/978: readlink d1/d7/dc/de/d34/d48/d82/d92/d95/db4/de5/l10f 0 2024-03-19T06:05:48.749 INFO:tasks.workunit.client.1.smithi172.stdout:5/974: fsync d5/d3d/dd6/f13a 0 2024-03-19T06:05:48.753 INFO:tasks.workunit.client.1.smithi172.stdout:5/975: mkdir d5/d14/d48/d14e 0 2024-03-19T06:05:48.754 INFO:tasks.workunit.client.0.smithi072.stdout:1/123: rename d1/d11/d18/d19/d1a/d24 to d1/d11/d18/d19/d1a/d25 0 2024-03-19T06:05:48.755 INFO:tasks.workunit.client.1.smithi172.stdout:1/971: truncate da/dd/d31/dfb/d14/d27/d3f/d5e/f7e 67860 0 2024-03-19T06:05:48.755 INFO:tasks.workunit.client.0.smithi072.stdout:3/201: dread d2/d3/d26/f22 [0,4194304] 0 2024-03-19T06:05:48.755 INFO:tasks.workunit.client.0.smithi072.stdout:1/124: truncate d1/d16/f1e 4418218 0 2024-03-19T06:05:48.760 INFO:tasks.workunit.client.1.smithi172.stdout:1/972: mkdir da/d33/d81/d14b 0 2024-03-19T06:05:48.764 INFO:tasks.workunit.client.1.smithi172.stdout:1/973: chown da/l22 86207 1 2024-03-19T06:05:48.765 INFO:tasks.workunit.client.1.smithi172.stdout:1/974: stat da/d7a/c128 0 2024-03-19T06:05:48.772 INFO:tasks.workunit.client.0.smithi072.stdout:3/202: dwrite d2/d3/fb [0,4194304] 0 2024-03-19T06:05:48.774 INFO:tasks.workunit.client.0.smithi072.stdout:3/203: read d2/d3/fb [2175532,21925] 0 2024-03-19T06:05:48.794 INFO:tasks.workunit.client.0.smithi072.stdout:3/204: dwrite d2/d3/d25/f39 [0,4194304] 0 2024-03-19T06:05:48.798 INFO:tasks.workunit.client.0.smithi072.stdout:3/205: rename d2/d3/d26 to d2/d3/d26/d3d 22 2024-03-19T06:05:48.800 INFO:tasks.workunit.client.0.smithi072.stdout:3/206: fsync d2/d3/fb 0 2024-03-19T06:05:48.820 INFO:tasks.workunit.client.0.smithi072.stdout:3/207: dwrite d2/d3/d26/f23 [0,4194304] 0 2024-03-19T06:05:48.824 INFO:tasks.workunit.client.0.smithi072.stdout:3/208: symlink d2/l3e 0 2024-03-19T06:05:48.826 INFO:tasks.workunit.client.0.smithi072.stdout:3/209: readlink d2/d19/l21 0 2024-03-19T06:05:48.830 INFO:tasks.workunit.client.0.smithi072.stdout:3/210: mknod d2/d19/c3f 0 2024-03-19T06:05:48.835 INFO:tasks.workunit.client.0.smithi072.stdout:3/211: mkdir d2/d40 0 2024-03-19T06:05:48.838 INFO:tasks.workunit.client.1.smithi172.stdout:9/979: dwrite d1/d7/dc/de/d34/d48/d82/fc5 [4194304,4194304] 0 2024-03-19T06:05:48.839 INFO:tasks.workunit.client.0.smithi072.stdout:3/212: rmdir d2/d3/d25 39 2024-03-19T06:05:48.842 INFO:tasks.workunit.client.1.smithi172.stdout:1/975: write da/dd/d31/dfb/f1d [3101114,42375] 0 2024-03-19T06:05:48.847 INFO:tasks.workunit.client.1.smithi172.stdout:9/980: write d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/d132/f140 [704289,24091] 0 2024-03-19T06:05:48.849 INFO:tasks.workunit.client.1.smithi172.stdout:1/976: mkdir da/dd/d31/dfb/d14/d27/da2/d14c 0 2024-03-19T06:05:48.851 INFO:tasks.workunit.client.1.smithi172.stdout:9/981: stat d1/d7/dc/de/d34/lbc 0 2024-03-19T06:05:48.852 INFO:tasks.workunit.client.1.smithi172.stdout:5/976: dwrite d5/d3c/d6c/da2/faf [0,4194304] 0 2024-03-19T06:05:48.853 INFO:tasks.workunit.client.1.smithi172.stdout:8/932: sync 2024-03-19T06:05:48.858 INFO:tasks.workunit.client.1.smithi172.stdout:9/982: symlink d1/d7/dc/de/l14a 0 2024-03-19T06:05:48.860 INFO:tasks.workunit.client.0.smithi072.stdout:3/213: dwrite d2/d3/d26/f35 [0,4194304] 0 2024-03-19T06:05:48.863 INFO:tasks.workunit.client.1.smithi172.stdout:1/977: creat da/dd/d31/dfb/d14/d27/da2/dcf/f14d x:0 0 0 2024-03-19T06:05:48.866 INFO:tasks.workunit.client.1.smithi172.stdout:1/978: creat da/d3b/dcd/de9/f14e x:0 0 0 2024-03-19T06:05:48.869 INFO:tasks.workunit.client.1.smithi172.stdout:1/979: stat da/dd/d31/dfb/f64 0 2024-03-19T06:05:48.871 INFO:tasks.workunit.client.1.smithi172.stdout:1/980: chown da/df9/c10a 9957 1 2024-03-19T06:05:48.875 INFO:tasks.workunit.client.1.smithi172.stdout:8/933: dwrite d0/d44/d46/d49/d26/dc0/d3d/d83/fec [4194304,4194304] 0 2024-03-19T06:05:48.878 INFO:tasks.workunit.client.1.smithi172.stdout:1/981: fsync da/dd/d31/dfb/d14/f101 0 2024-03-19T06:05:48.878 INFO:tasks.workunit.client.0.smithi072.stdout:3/214: dread d2/d3/d26/f23 [0,4194304] 0 2024-03-19T06:05:48.880 INFO:tasks.workunit.client.1.smithi172.stdout:8/934: truncate d0/f58 4171532 0 2024-03-19T06:05:48.883 INFO:tasks.workunit.client.1.smithi172.stdout:1/982: truncate da/dd/d31/dfb/d14/d27/f32 672589 0 2024-03-19T06:05:48.883 INFO:tasks.workunit.client.1.smithi172.stdout:9/983: unlink d1/d7/dc/de/d34/d48/d82/d92/l13d 0 2024-03-19T06:05:48.885 INFO:tasks.workunit.client.0.smithi072.stdout:3/215: getdents d2/d19 0 2024-03-19T06:05:48.887 INFO:tasks.workunit.client.1.smithi172.stdout:8/935: write d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/dcc/f117 [703352,189] 0 2024-03-19T06:05:48.887 INFO:tasks.workunit.client.0.smithi072.stdout:3/216: read d2/d3/d26/f23 [2853243,94025] 0 2024-03-19T06:05:48.889 INFO:tasks.workunit.client.0.smithi072.stdout:3/217: truncate d2/f5 2927105 0 2024-03-19T06:05:48.892 INFO:tasks.workunit.client.1.smithi172.stdout:1/983: fsync da/dd/d31/dfb/fc8 0 2024-03-19T06:05:48.897 INFO:tasks.workunit.client.1.smithi172.stdout:1/984: mkdir da/dd/d31/dfb/d14/d27/d3f/d5e/d132/d14f 0 2024-03-19T06:05:48.905 INFO:tasks.workunit.client.1.smithi172.stdout:8/936: dwrite d0/d44/d46/d49/d26/f3e [0,4194304] 0 2024-03-19T06:05:48.908 INFO:tasks.workunit.client.0.smithi072.stdout:3/218: dwrite d2/d19/d1e/f32 [0,4194304] 0 2024-03-19T06:05:48.911 INFO:tasks.workunit.client.0.smithi072.stdout:3/219: readlink d2/l37 0 2024-03-19T06:05:48.917 INFO:tasks.workunit.client.1.smithi172.stdout:8/937: getdents d0/d44/d46/d49/d26/dbc/dc6 0 2024-03-19T06:05:48.923 INFO:tasks.workunit.client.1.smithi172.stdout:8/938: stat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3/l101 0 2024-03-19T06:05:48.931 INFO:tasks.workunit.client.1.smithi172.stdout:9/984: dread d1/d7/dc/dbe/d65/f97 [0,4194304] 0 2024-03-19T06:05:48.933 INFO:tasks.workunit.client.1.smithi172.stdout:1/985: write da/dd/d31/dfb/d14/f101 [360099,53973] 0 2024-03-19T06:05:48.935 INFO:tasks.workunit.client.1.smithi172.stdout:9/985: mknod d1/d7/dc/de/d34/dfd/d106/c14b 0 2024-03-19T06:05:48.937 INFO:tasks.workunit.client.1.smithi172.stdout:9/986: chown d1/d7/dc/d47/d78/d54/d91/l44 11632101 1 2024-03-19T06:05:48.941 INFO:tasks.workunit.client.1.smithi172.stdout:9/987: mkdir d1/d7/d14c 0 2024-03-19T06:05:48.944 INFO:tasks.workunit.client.0.smithi072.stdout:3/220: dwrite d2/d3/d26/f23 [0,4194304] 0 2024-03-19T06:05:48.965 INFO:tasks.workunit.client.1.smithi172.stdout:8/939: dread d0/f58 [0,4194304] 0 2024-03-19T06:05:48.968 INFO:tasks.workunit.client.0.smithi072.stdout:3/221: mknod d2/d19/c41 0 2024-03-19T06:05:48.969 INFO:tasks.workunit.client.1.smithi172.stdout:1/986: dread da/dd/d31/d47/fe4 [0,4194304] 0 2024-03-19T06:05:48.971 INFO:tasks.workunit.client.0.smithi072.stdout:3/222: rmdir d2/d3/d25 39 2024-03-19T06:05:48.975 INFO:tasks.workunit.client.0.smithi072.stdout:3/223: link d2/d3/d25/f39 d2/d3/d25/f42 0 2024-03-19T06:05:48.977 INFO:tasks.workunit.client.0.smithi072.stdout:3/224: mkdir d2/d19/d1e/d43 0 2024-03-19T06:05:48.988 INFO:tasks.workunit.client.0.smithi072.stdout:3/225: dwrite d2/d3/f10 [0,4194304] 0 2024-03-19T06:05:48.990 INFO:tasks.workunit.client.0.smithi072.stdout:3/226: write d2/f2c [2023280,68410] 0 2024-03-19T06:05:49.028 INFO:tasks.workunit.client.0.smithi072.stdout:3/227: mknod d2/d3/d15/c44 0 2024-03-19T06:05:49.030 INFO:tasks.workunit.client.0.smithi072.stdout:3/228: rmdir d2/d3/d25 39 2024-03-19T06:05:49.042 INFO:tasks.workunit.client.1.smithi172.stdout:9/988: rmdir d1/d7/dc/d47/d78/d54/d91/d130 39 2024-03-19T06:05:49.043 INFO:tasks.workunit.client.1.smithi172.stdout:8/940: rmdir d0/d44/d46/d49/d26/d71/d81 39 2024-03-19T06:05:49.044 INFO:tasks.workunit.client.0.smithi072.stdout:3/229: dread d2/d3/d26/f22 [0,4194304] 0 2024-03-19T06:05:49.074 INFO:tasks.workunit.client.1.smithi172.stdout:8/941: symlink d0/d44/d46/d49/l12d 0 2024-03-19T06:05:49.076 INFO:tasks.workunit.client.1.smithi172.stdout:9/989: rename d1/d7/dc/dbe/d114/l11e to d1/d7/dc/d47/d78/d54/d91/d130/l14d 0 2024-03-19T06:05:49.081 INFO:tasks.workunit.client.0.smithi072.stdout:3/230: symlink d2/d19/d1e/l45 0 2024-03-19T06:05:49.083 INFO:tasks.workunit.client.0.smithi072.stdout:3/231: chown d2/d19/d1e/f32 62 1 2024-03-19T06:05:49.083 INFO:tasks.workunit.client.1.smithi172.stdout:1/987: getdents da/d3b/d95 0 2024-03-19T06:05:49.084 INFO:tasks.workunit.client.0.smithi072.stdout:3/232: stat d2/l37 0 2024-03-19T06:05:49.090 INFO:tasks.workunit.client.1.smithi172.stdout:1/988: creat da/dd/d31/dfb/d14/d27/d3f/d5e/dab/f150 x:0 0 0 2024-03-19T06:05:49.091 INFO:tasks.workunit.client.1.smithi172.stdout:5/977: chown d5/d14/d15/d40/d6a/d7a/f13e 17915 1 2024-03-19T06:05:49.093 INFO:tasks.workunit.client.1.smithi172.stdout:1/989: creat da/d3b/d95/f151 x:0 0 0 2024-03-19T06:05:49.096 INFO:tasks.workunit.client.1.smithi172.stdout:8/942: dread d0/d44/d46/d49/d26/d71/d81/f1a [0,4194304] 0 2024-03-19T06:05:49.099 INFO:tasks.workunit.client.1.smithi172.stdout:1/990: mknod da/dd/d31/dfb/d14/d27/da2/d14c/c152 0 2024-03-19T06:05:49.099 INFO:tasks.workunit.client.1.smithi172.stdout:8/943: write d0/f3 [8608126,91868] 0 2024-03-19T06:05:49.102 INFO:tasks.workunit.client.1.smithi172.stdout:9/990: dwrite d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/fa0 [0,4194304] 0 2024-03-19T06:05:49.103 INFO:tasks.workunit.client.1.smithi172.stdout:1/991: chown da/dd/d31/dfb/d14/d27/da2/dcf/f14d 42974 1 2024-03-19T06:05:49.111 INFO:tasks.workunit.client.1.smithi172.stdout:8/944: dread d0/d44/dd2/f4b [0,4194304] 0 2024-03-19T06:05:49.111 INFO:tasks.workunit.client.1.smithi172.stdout:9/991: symlink d1/d7/dc/de/l14e 0 2024-03-19T06:05:49.115 INFO:tasks.workunit.client.1.smithi172.stdout:8/945: creat d0/d44/d46/d49/d26/d71/d81/d27/f12e x:0 0 0 2024-03-19T06:05:49.119 INFO:tasks.workunit.client.1.smithi172.stdout:8/946: readlink d0/d44/d46/d49/la7 0 2024-03-19T06:05:49.120 INFO:tasks.workunit.client.1.smithi172.stdout:1/992: dread da/dd/d31/dfb/d14/d27/d3f/d5e/dab/dde/fd5 [0,4194304] 0 2024-03-19T06:05:49.125 INFO:tasks.workunit.client.1.smithi172.stdout:9/992: dread d1/d7/dc/de/d34/d48/f5f [0,4194304] 0 2024-03-19T06:05:49.125 INFO:tasks.workunit.client.1.smithi172.stdout:1/993: mkdir da/dd/d31/dfb/d14/d27/d3f/d5e/dab/d14a/d153 0 2024-03-19T06:05:49.130 INFO:tasks.workunit.client.1.smithi172.stdout:1/994: getdents da/dd/d31/dfb/d14/d27/da7/db7 0 2024-03-19T06:05:49.131 INFO:tasks.workunit.client.1.smithi172.stdout:1/995: chown da/d33/d4e/l56 53455781 1 2024-03-19T06:05:49.136 INFO:tasks.workunit.client.1.smithi172.stdout:1/996: link da/dd/d31/c54 da/d7a/c154 0 2024-03-19T06:05:49.140 INFO:tasks.workunit.client.1.smithi172.stdout:9/993: dwrite d1/d7/dc/de/d34/d48/d82/d92/d95/d9e/f12b [0,4194304] 0 2024-03-19T06:05:49.142 INFO:tasks.workunit.client.1.smithi172.stdout:1/997: truncate da/dd/d31/dfb/d14/d73/d102/f104 740333 0 2024-03-19T06:05:49.161 INFO:tasks.workunit.client.1.smithi172.stdout:9/994: dwrite d1/d7/dc/d47/d78/d54/fd5 [0,4194304] 0 2024-03-19T06:05:49.168 INFO:tasks.workunit.client.1.smithi172.stdout:9/995: creat d1/d7/dc/d47/d78/d54/d91/d130/f14f x:0 0 0 2024-03-19T06:05:49.174 INFO:tasks.workunit.client.1.smithi172.stdout:9/996: getdents d1/d145/d149 0 2024-03-19T06:05:49.178 INFO:tasks.workunit.client.1.smithi172.stdout:1/998: dread da/dd/d31/dfb/d14/d27/d3f/d5e/fd7 [0,4194304] 0 2024-03-19T06:05:49.184 INFO:tasks.workunit.client.1.smithi172.stdout:9/997: creat d1/d7/dc/de/d34/d48/d82/f150 x:0 0 0 2024-03-19T06:05:49.188 INFO:tasks.workunit.client.1.smithi172.stdout:1/999: creat da/d3b/d95/f155 x:0 0 0 2024-03-19T06:05:49.190 INFO:tasks.workunit.client.1.smithi172.stdout:9/998: symlink d1/d7/dc/d47/da3/l151 0 2024-03-19T06:05:49.192 INFO:tasks.workunit.client.1.smithi172.stdout:9/999: rmdir d1/d7/dd4 39 2024-03-19T06:05:49.304 INFO:tasks.workunit.client.1.smithi172.stdout:8/947: sync 2024-03-19T06:05:49.321 INFO:tasks.workunit.client.1.smithi172.stdout:8/948: link d0/d44/d46/d49/cad d0/d61/d6a/d9f/de4/c12f 0 2024-03-19T06:05:49.329 INFO:tasks.workunit.client.1.smithi172.stdout:8/949: creat d0/d44/d46/d49/d26/d71/d81/d27/d100/f130 x:0 0 0 2024-03-19T06:05:49.336 INFO:tasks.workunit.client.1.smithi172.stdout:8/950: fsync d0/d44/d46/d49/d26/d71/d81/f1a 0 2024-03-19T06:05:49.371 INFO:tasks.workunit.client.1.smithi172.stdout:5/978: dwrite d5/d3c/d6c/dbd/fc4 [0,4194304] 0 2024-03-19T06:05:49.375 INFO:tasks.workunit.client.1.smithi172.stdout:5/979: read - d5/d3c/d6c/da2/f11f zero size 2024-03-19T06:05:49.391 INFO:tasks.workunit.client.1.smithi172.stdout:8/951: dwrite d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d8b/feb [0,4194304] 0 2024-03-19T06:05:49.395 INFO:tasks.workunit.client.1.smithi172.stdout:8/952: chown d0/c6c 118952 1 2024-03-19T06:05:49.406 INFO:tasks.workunit.client.1.smithi172.stdout:8/953: creat d0/d44/d46/d49/d26/d71/d81/d27/f131 x:0 0 0 2024-03-19T06:05:49.420 INFO:tasks.workunit.client.1.smithi172.stdout:8/954: symlink d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3/d105/l132 0 2024-03-19T06:05:49.426 INFO:tasks.workunit.client.0.smithi072.stdout:2/80: sync 2024-03-19T06:05:49.431 INFO:tasks.workunit.client.1.smithi172.stdout:8/955: creat d0/d44/d46/d49/d26/d71/d81/d27/d100/f133 x:0 0 0 2024-03-19T06:05:49.434 INFO:tasks.workunit.client.1.smithi172.stdout:5/980: dread d5/d55/d91/fcf [0,4194304] 0 2024-03-19T06:05:49.438 INFO:tasks.workunit.client.1.smithi172.stdout:8/956: readlink d0/d44/d46/d49/d26/d71/d81/laa 0 2024-03-19T06:05:49.448 INFO:tasks.workunit.client.1.smithi172.stdout:8/957: dread - d0/d44/d46/d49/d26/d71/d81/d27/d100/f130 zero size 2024-03-19T06:05:49.449 INFO:tasks.workunit.client.1.smithi172.stdout:8/958: readlink d0/l52 0 2024-03-19T06:05:49.455 INFO:tasks.workunit.client.1.smithi172.stdout:5/981: write d5/d14/d34/f94 [458392,10871] 0 2024-03-19T06:05:49.459 INFO:tasks.workunit.client.1.smithi172.stdout:8/959: mkdir d0/d44/d46/d49/d26/dc0/d134 0 2024-03-19T06:05:49.460 INFO:tasks.workunit.client.1.smithi172.stdout:5/982: read d5/d3c/d6c/d9b/fc7 [3553629,84759] 0 2024-03-19T06:05:49.462 INFO:tasks.workunit.client.0.smithi072.stdout:2/81: dwrite db/d10/f1d [0,4194304] 0 2024-03-19T06:05:49.465 INFO:tasks.workunit.client.0.smithi072.stdout:2/82: write db/d10/f16 [4135730,103132] 0 2024-03-19T06:05:49.468 INFO:tasks.workunit.client.1.smithi172.stdout:8/960: fdatasync d0/d44/d46/d49/d26/d71/d81/d27/d65/d9d/f7c 0 2024-03-19T06:05:49.474 INFO:tasks.workunit.client.1.smithi172.stdout:5/983: rename d5/fda to d5/d14/d15/d40/d6a/de5/f14f 0 2024-03-19T06:05:49.475 INFO:tasks.workunit.client.0.smithi072.stdout:2/83: getdents db/d10/d13 0 2024-03-19T06:05:49.492 INFO:tasks.workunit.client.1.smithi172.stdout:5/984: write d5/d14/d15/d40/d6a/fbe [1000791,44624] 0 2024-03-19T06:05:49.493 INFO:tasks.workunit.client.1.smithi172.stdout:5/985: chown d5/d14/d56 1 1 2024-03-19T06:05:49.500 INFO:tasks.workunit.client.1.smithi172.stdout:5/986: truncate d5/d1f/d2f/d53/dde/d113/f11b 738609 0 2024-03-19T06:05:49.501 INFO:tasks.workunit.client.1.smithi172.stdout:8/961: dread d0/d44/d46/d49/d26/d71/d81/d27/f1e [0,4194304] 0 2024-03-19T06:05:49.505 INFO:tasks.workunit.client.1.smithi172.stdout:8/962: truncate d0/f58 4505746 0 2024-03-19T06:05:49.508 INFO:tasks.workunit.client.1.smithi172.stdout:8/963: creat d0/d44/f135 x:0 0 0 2024-03-19T06:05:49.509 INFO:tasks.workunit.client.1.smithi172.stdout:5/987: fdatasync d5/d3d/d60/fad 0 2024-03-19T06:05:49.512 INFO:tasks.workunit.client.1.smithi172.stdout:5/988: chown d5/d14/d9f/cab 3327972 1 2024-03-19T06:05:49.515 INFO:tasks.workunit.client.1.smithi172.stdout:5/989: write d5/d3d/d60/fe6 [495431,109942] 0 2024-03-19T06:05:49.518 INFO:tasks.workunit.client.1.smithi172.stdout:5/990: write d5/d14/d48/f12c [136162,79155] 0 2024-03-19T06:05:49.524 INFO:tasks.workunit.client.1.smithi172.stdout:8/964: dwrite d0/d61/d6e/ff8 [0,4194304] 0 2024-03-19T06:05:49.545 INFO:tasks.workunit.client.1.smithi172.stdout:5/991: rename d5/d14/d15/d40/d5c/l8b to d5/d3d/l150 0 2024-03-19T06:05:49.549 INFO:tasks.workunit.client.1.smithi172.stdout:5/992: mknod d5/d3d/dd6/d100/c151 0 2024-03-19T06:05:49.551 INFO:tasks.workunit.client.1.smithi172.stdout:8/965: dwrite d0/d44/ff3 [0,4194304] 0 2024-03-19T06:05:49.552 INFO:tasks.workunit.client.1.smithi172.stdout:5/993: chown d5/d14/d15/d40/d5c/fb7 25847948 1 2024-03-19T06:05:49.553 INFO:tasks.workunit.client.1.smithi172.stdout:8/966: chown d0/d44/dd2/da2 4 1 2024-03-19T06:05:49.557 INFO:tasks.workunit.client.1.smithi172.stdout:8/967: symlink d0/d64/l136 0 2024-03-19T06:05:49.561 INFO:tasks.workunit.client.0.smithi072.stdout:0/163: sync 2024-03-19T06:05:49.561 INFO:tasks.workunit.client.0.smithi072.stdout:4/207: sync 2024-03-19T06:05:49.561 INFO:tasks.workunit.client.1.smithi172.stdout:8/968: chown d0/d44/d46/f60 18 1 2024-03-19T06:05:49.563 INFO:tasks.workunit.client.1.smithi172.stdout:5/994: write d5/d14/f69 [1193863,42090] 0 2024-03-19T06:05:49.566 INFO:tasks.workunit.client.1.smithi172.stdout:8/969: read d0/d44/d46/d49/d26/dc0/d3d/d83/dee/fd6 [271778,55440] 0 2024-03-19T06:05:49.568 INFO:tasks.workunit.client.0.smithi072.stdout:0/164: chown d1/l16 4597681 1 2024-03-19T06:05:49.569 INFO:tasks.workunit.client.1.smithi172.stdout:8/970: write d0/d64/ff7 [10407,99596] 0 2024-03-19T06:05:49.571 INFO:tasks.workunit.client.1.smithi172.stdout:5/995: symlink d5/d3c/l152 0 2024-03-19T06:05:49.573 INFO:tasks.workunit.client.1.smithi172.stdout:8/971: chown d0/d44/d46/d49/d26/d71/d81/c114 112977970 1 2024-03-19T06:05:49.574 INFO:tasks.workunit.client.0.smithi072.stdout:0/165: chown d1/lf 2 1 2024-03-19T06:05:49.590 INFO:tasks.workunit.client.1.smithi172.stdout:8/972: dwrite d0/d44/d46/d49/d26/d71/d81/d27/d29/f32 [4194304,4194304] 0 2024-03-19T06:05:49.600 INFO:tasks.workunit.client.0.smithi072.stdout:4/208: dwrite d5/f28 [0,4194304] 0 2024-03-19T06:05:49.605 INFO:tasks.workunit.client.1.smithi172.stdout:8/973: dread d0/d44/d46/d49/d26/f3e [0,4194304] 0 2024-03-19T06:05:49.606 INFO:tasks.workunit.client.0.smithi072.stdout:0/166: dwrite d1/f1b [0,4194304] 0 2024-03-19T06:05:49.608 INFO:tasks.workunit.client.0.smithi072.stdout:4/209: symlink d5/d32/l4d 0 2024-03-19T06:05:49.611 INFO:tasks.workunit.client.1.smithi172.stdout:8/974: chown d0/d44/d46/d49/d26/d71/d81/d27/d29/fd1 13 1 2024-03-19T06:05:49.613 INFO:tasks.workunit.client.0.smithi072.stdout:4/210: symlink d5/d15/d31/d4c/l4e 0 2024-03-19T06:05:49.615 INFO:tasks.workunit.client.0.smithi072.stdout:4/211: chown d5/fa 2 1 2024-03-19T06:05:49.617 INFO:tasks.workunit.client.0.smithi072.stdout:4/212: write d5/f28 [1613347,32642] 0 2024-03-19T06:05:49.630 INFO:tasks.workunit.client.0.smithi072.stdout:4/213: rename d5/c24 to d5/d15/c4f 0 2024-03-19T06:05:49.633 INFO:tasks.workunit.client.0.smithi072.stdout:0/167: dwrite d1/d1c/f1d [0,4194304] 0 2024-03-19T06:05:49.634 INFO:tasks.workunit.client.0.smithi072.stdout:1/125: sync 2024-03-19T06:05:49.634 INFO:tasks.workunit.client.0.smithi072.stdout:5/356: sync 2024-03-19T06:05:49.634 INFO:tasks.workunit.client.0.smithi072.stdout:8/119: sync 2024-03-19T06:05:49.634 INFO:tasks.workunit.client.0.smithi072.stdout:6/151: sync 2024-03-19T06:05:49.634 INFO:tasks.workunit.client.0.smithi072.stdout:9/107: sync 2024-03-19T06:05:49.634 INFO:tasks.workunit.client.0.smithi072.stdout:7/153: sync 2024-03-19T06:05:49.635 INFO:tasks.workunit.client.0.smithi072.stdout:7/154: stat d2/d5/f7 0 2024-03-19T06:05:49.637 INFO:tasks.workunit.client.0.smithi072.stdout:7/155: chown d2/d5/f11 536336274 1 2024-03-19T06:05:49.640 INFO:tasks.workunit.client.0.smithi072.stdout:0/168: chown d1/c9 353 1 2024-03-19T06:05:49.640 INFO:tasks.workunit.client.0.smithi072.stdout:6/152: stat d7/d9/l13 0 2024-03-19T06:05:49.641 INFO:tasks.workunit.client.0.smithi072.stdout:8/120: mkdir da/d27 0 2024-03-19T06:05:49.643 INFO:tasks.workunit.client.0.smithi072.stdout:0/169: chown d1/d1c/f23 422948412 1 2024-03-19T06:05:49.643 INFO:tasks.workunit.client.0.smithi072.stdout:1/126: unlink d1/f14 0 2024-03-19T06:05:49.645 INFO:tasks.workunit.client.0.smithi072.stdout:4/214: truncate d5/d11/f1a 549291 0 2024-03-19T06:05:49.646 INFO:tasks.workunit.client.0.smithi072.stdout:7/156: dread d2/d5/f11 [0,4194304] 0 2024-03-19T06:05:49.648 INFO:tasks.workunit.client.0.smithi072.stdout:6/153: creat d7/d2e/f35 x:0 0 0 2024-03-19T06:05:49.649 INFO:tasks.workunit.client.0.smithi072.stdout:6/154: readlink d7/d9/l13 0 2024-03-19T06:05:49.649 INFO:tasks.workunit.client.0.smithi072.stdout:8/121: creat da/d13/d14/f28 x:0 0 0 2024-03-19T06:05:49.655 INFO:tasks.workunit.client.0.smithi072.stdout:4/215: rename d5/d1b/d1c to d5/d15/d50 0 2024-03-19T06:05:49.657 INFO:tasks.workunit.client.0.smithi072.stdout:0/170: mknod d1/c35 0 2024-03-19T06:05:49.657 INFO:tasks.workunit.client.0.smithi072.stdout:7/157: write d2/d3/fd [829668,17849] 0 2024-03-19T06:05:49.658 INFO:tasks.workunit.client.0.smithi072.stdout:8/122: symlink da/l29 0 2024-03-19T06:05:49.658 INFO:tasks.workunit.client.0.smithi072.stdout:6/155: mknod d7/d2e/c36 0 2024-03-19T06:05:49.660 INFO:tasks.workunit.client.0.smithi072.stdout:0/171: write d1/f1a [349851,60667] 0 2024-03-19T06:05:49.660 INFO:tasks.workunit.client.0.smithi072.stdout:9/108: creat d11/f25 x:0 0 0 2024-03-19T06:05:49.660 INFO:tasks.workunit.client.0.smithi072.stdout:4/216: symlink d5/d15/d22/l51 0 2024-03-19T06:05:49.662 INFO:tasks.workunit.client.0.smithi072.stdout:8/123: creat da/f2a x:0 0 0 2024-03-19T06:05:49.663 INFO:tasks.workunit.client.0.smithi072.stdout:6/156: creat d7/d9/d1b/f37 x:0 0 0 2024-03-19T06:05:49.664 INFO:tasks.workunit.client.0.smithi072.stdout:9/109: fsync fe 0 2024-03-19T06:05:49.668 INFO:tasks.workunit.client.0.smithi072.stdout:6/157: unlink d7/l16 0 2024-03-19T06:05:49.670 INFO:tasks.workunit.client.0.smithi072.stdout:0/172: rename d1/l6 to d1/d1c/d24/d27/l36 0 2024-03-19T06:05:49.678 INFO:tasks.workunit.client.0.smithi072.stdout:8/124: rename da/d13/d14/f1a to da/d13/d1d/f2b 0 2024-03-19T06:05:49.678 INFO:tasks.workunit.client.1.smithi172.stdout:8/975: dread d0/d44/d46/d49/d26/d71/d81/d27/d29/f32 [0,4194304] 0 2024-03-19T06:05:49.678 INFO:tasks.workunit.client.0.smithi072.stdout:8/125: dread - da/f2a zero size 2024-03-19T06:05:49.680 INFO:tasks.workunit.client.0.smithi072.stdout:8/126: fdatasync da/f11 0 2024-03-19T06:05:49.680 INFO:tasks.workunit.client.0.smithi072.stdout:6/158: dread d7/f11 [0,4194304] 0 2024-03-19T06:05:49.682 INFO:tasks.workunit.client.1.smithi172.stdout:8/976: truncate d0/d44/d46/f60 1741955 0 2024-03-19T06:05:49.684 INFO:tasks.workunit.client.1.smithi172.stdout:8/977: chown d0/d44/d46/d49/d26/dc0/dd3 93265 1 2024-03-19T06:05:49.685 INFO:tasks.workunit.client.0.smithi072.stdout:6/159: truncate d7/d9/d1b/f2a 72645 0 2024-03-19T06:05:49.690 INFO:tasks.workunit.client.0.smithi072.stdout:4/217: dread d5/fa [0,4194304] 0 2024-03-19T06:05:49.691 INFO:tasks.workunit.client.0.smithi072.stdout:6/160: creat d7/d9/d30/f38 x:0 0 0 2024-03-19T06:05:49.692 INFO:tasks.workunit.client.0.smithi072.stdout:9/110: mkdir d11/d26 0 2024-03-19T06:05:49.693 INFO:tasks.workunit.client.0.smithi072.stdout:8/127: dread f9 [4194304,4194304] 0 2024-03-19T06:05:49.694 INFO:tasks.workunit.client.0.smithi072.stdout:0/173: getdents d1 0 2024-03-19T06:05:49.695 INFO:tasks.workunit.client.0.smithi072.stdout:8/128: stat da/c10 0 2024-03-19T06:05:49.696 INFO:tasks.workunit.client.1.smithi172.stdout:5/996: sync 2024-03-19T06:05:49.703 INFO:tasks.workunit.client.1.smithi172.stdout:5/997: unlink d5/d3c/d6c/d9b/d105/f107 0 2024-03-19T06:05:49.703 INFO:tasks.workunit.client.0.smithi072.stdout:8/129: read da/d13/d14/f17 [3259499,75916] 0 2024-03-19T06:05:49.703 INFO:tasks.workunit.client.0.smithi072.stdout:9/111: creat d11/d1f/f27 x:0 0 0 2024-03-19T06:05:49.704 INFO:tasks.workunit.client.0.smithi072.stdout:6/161: mknod d7/d9/d1b/d31/c39 0 2024-03-19T06:05:49.704 INFO:tasks.workunit.client.0.smithi072.stdout:9/112: write fa [4052110,48071] 0 2024-03-19T06:05:49.704 INFO:tasks.workunit.client.0.smithi072.stdout:8/130: mknod da/d13/d14/c2c 0 2024-03-19T06:05:49.711 INFO:tasks.workunit.client.0.smithi072.stdout:6/162: dread d7/fc [0,4194304] 0 2024-03-19T06:05:49.713 INFO:tasks.workunit.client.1.smithi172.stdout:8/978: dwrite d0/f37 [0,4194304] 0 2024-03-19T06:05:49.714 INFO:tasks.workunit.client.0.smithi072.stdout:0/174: dread d1/d1c/d24/d27/f29 [0,4194304] 0 2024-03-19T06:05:49.714 INFO:tasks.workunit.client.1.smithi172.stdout:5/998: rename d5/d55/de9/ce0 to d5/d55/de9/c153 0 2024-03-19T06:05:49.714 INFO:tasks.workunit.client.0.smithi072.stdout:6/163: write d7/f1d [629319,119127] 0 2024-03-19T06:05:49.718 INFO:tasks.workunit.client.0.smithi072.stdout:6/164: fsync d7/f12 0 2024-03-19T06:05:49.719 INFO:tasks.workunit.client.0.smithi072.stdout:0/175: creat d1/d2c/f37 x:0 0 0 2024-03-19T06:05:49.720 INFO:tasks.workunit.client.0.smithi072.stdout:8/131: write f4 [2108615,10515] 0 2024-03-19T06:05:49.720 INFO:tasks.workunit.client.0.smithi072.stdout:4/218: dwrite d5/d11/f1a [0,4194304] 0 2024-03-19T06:05:49.724 INFO:tasks.workunit.client.0.smithi072.stdout:9/113: dread d11/f12 [0,4194304] 0 2024-03-19T06:05:49.725 INFO:tasks.workunit.client.1.smithi172.stdout:8/979: symlink d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3/d105/l137 0 2024-03-19T06:05:49.726 INFO:tasks.workunit.client.0.smithi072.stdout:6/165: mkdir d7/d9/d30/d3a 0 2024-03-19T06:05:49.728 INFO:tasks.workunit.client.0.smithi072.stdout:4/219: mkdir d5/d37/d52 0 2024-03-19T06:05:49.730 INFO:tasks.workunit.client.0.smithi072.stdout:9/114: write d11/f12 [663584,126906] 0 2024-03-19T06:05:49.731 INFO:tasks.workunit.client.1.smithi172.stdout:8/980: creat d0/d125/f138 x:0 0 0 2024-03-19T06:05:49.733 INFO:tasks.workunit.client.0.smithi072.stdout:0/176: unlink d1/d1c/l21 0 2024-03-19T06:05:49.734 INFO:tasks.workunit.client.0.smithi072.stdout:8/132: creat da/f2d x:0 0 0 2024-03-19T06:05:49.737 INFO:tasks.workunit.client.0.smithi072.stdout:9/115: read d11/f23 [7718141,113445] 0 2024-03-19T06:05:49.738 INFO:tasks.workunit.client.1.smithi172.stdout:8/981: mkdir d0/d44/d46/d49/d26/d139 0 2024-03-19T06:05:49.740 INFO:tasks.workunit.client.0.smithi072.stdout:9/116: write d11/f12 [2781617,93315] 0 2024-03-19T06:05:49.741 INFO:tasks.workunit.client.1.smithi172.stdout:5/999: write d5/d1f/db4/db9/fd0 [968490,15488] 0 2024-03-19T06:05:49.743 INFO:tasks.workunit.client.1.smithi172.stdout:8/982: mknod d0/d64/d80/c13a 0 2024-03-19T06:05:49.745 INFO:tasks.workunit.client.0.smithi072.stdout:9/117: fsync d11/f22 0 2024-03-19T06:05:49.748 INFO:tasks.workunit.client.1.smithi172.stdout:8/983: fsync d0/d44/d46/d49/d26/d71/d81/d27/d29/fd1 0 2024-03-19T06:05:49.749 INFO:tasks.workunit.client.0.smithi072.stdout:6/166: dwrite d7/d9/d1b/d21/f29 [0,4194304] 0 2024-03-19T06:05:49.750 INFO:tasks.workunit.client.0.smithi072.stdout:9/118: creat d11/d24/f28 x:0 0 0 2024-03-19T06:05:49.753 INFO:tasks.workunit.client.0.smithi072.stdout:6/167: mkdir d7/d9/d1b/d3b 0 2024-03-19T06:05:49.754 INFO:tasks.workunit.client.1.smithi172.stdout:8/984: mknod d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/c13b 0 2024-03-19T06:05:49.754 INFO:tasks.workunit.client.0.smithi072.stdout:9/119: mknod d11/d24/c29 0 2024-03-19T06:05:49.756 INFO:tasks.workunit.client.0.smithi072.stdout:9/120: mkdir d11/d1f/d2a 0 2024-03-19T06:05:49.757 INFO:tasks.workunit.client.0.smithi072.stdout:0/177: dwrite d1/f5 [4194304,4194304] 0 2024-03-19T06:05:49.761 INFO:tasks.workunit.client.0.smithi072.stdout:0/178: mknod d1/d1c/c38 0 2024-03-19T06:05:49.761 INFO:tasks.workunit.client.0.smithi072.stdout:0/179: readlink d1/l16 0 2024-03-19T06:05:49.763 INFO:tasks.workunit.client.0.smithi072.stdout:0/180: chown d1/d1c/f1d 3 1 2024-03-19T06:05:49.766 INFO:tasks.workunit.client.0.smithi072.stdout:2/84: sync 2024-03-19T06:05:49.766 INFO:tasks.workunit.client.0.smithi072.stdout:3/233: sync 2024-03-19T06:05:49.768 INFO:tasks.workunit.client.0.smithi072.stdout:6/168: dwrite d7/d9/ff [0,4194304] 0 2024-03-19T06:05:49.772 INFO:tasks.workunit.client.1.smithi172.stdout:8/985: dwrite d0/d125/f138 [0,4194304] 0 2024-03-19T06:05:49.773 INFO:tasks.workunit.client.0.smithi072.stdout:6/169: write d7/fc [1190952,82362] 0 2024-03-19T06:05:49.776 INFO:tasks.workunit.client.0.smithi072.stdout:3/234: rename d2/d3/le to d2/l46 0 2024-03-19T06:05:49.777 INFO:tasks.workunit.client.0.smithi072.stdout:0/181: dread d1/d1c/f1d [0,4194304] 0 2024-03-19T06:05:49.781 INFO:tasks.workunit.client.1.smithi172.stdout:8/986: mkdir d0/d64/d13c 0 2024-03-19T06:05:49.791 INFO:tasks.workunit.client.1.smithi172.stdout:8/987: link d0/d44/dd2/da2/ce7 d0/d44/d46/d49/d26/d71/c13d 0 2024-03-19T06:05:49.794 INFO:tasks.workunit.client.0.smithi072.stdout:6/170: creat d7/f3c x:0 0 0 2024-03-19T06:05:49.794 INFO:tasks.workunit.client.1.smithi172.stdout:8/988: mkdir d0/d61/d6a/d9f/d13e 0 2024-03-19T06:05:49.797 INFO:tasks.workunit.client.0.smithi072.stdout:2/85: dwrite db/d10/d13/f1c [0,4194304] 0 2024-03-19T06:05:49.798 INFO:tasks.workunit.client.0.smithi072.stdout:0/182: getdents d1/d1c/d24 0 2024-03-19T06:05:49.799 INFO:tasks.workunit.client.0.smithi072.stdout:6/171: creat d7/d9/d30/d3a/f3d x:0 0 0 2024-03-19T06:05:49.801 INFO:tasks.workunit.client.0.smithi072.stdout:0/183: rmdir d1/d2c 39 2024-03-19T06:05:49.802 INFO:tasks.workunit.client.0.smithi072.stdout:2/86: fdatasync db/d10/d12/f14 0 2024-03-19T06:05:49.815 INFO:tasks.workunit.client.1.smithi172.stdout:8/989: dwrite d0/d44/d46/d49/d26/dc0/d3d/d83/ffb [0,4194304] 0 2024-03-19T06:05:49.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:49 smithi072 ceph-mon[28706]: pgmap v21: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 52 MiB/s rd, 108 MiB/s wr, 249 op/s 2024-03-19T06:05:49.873 INFO:tasks.workunit.client.0.smithi072.stdout:6/172: mknod d7/d9/d1b/d3b/c3e 0 2024-03-19T06:05:49.876 INFO:tasks.workunit.client.0.smithi072.stdout:2/87: unlink db/cf 0 2024-03-19T06:05:49.877 INFO:tasks.workunit.client.0.smithi072.stdout:6/173: unlink d7/c32 0 2024-03-19T06:05:49.878 INFO:tasks.workunit.client.0.smithi072.stdout:2/88: stat db/d10 0 2024-03-19T06:05:49.884 INFO:tasks.workunit.client.0.smithi072.stdout:2/89: creat db/d10/f1f x:0 0 0 2024-03-19T06:05:49.888 INFO:tasks.workunit.client.0.smithi072.stdout:2/90: read db/d10/f1d [2396917,22915] 0 2024-03-19T06:05:49.888 INFO:tasks.workunit.client.0.smithi072.stdout:3/235: dwrite d2/d3/d25/f39 [0,4194304] 0 2024-03-19T06:05:49.895 INFO:tasks.workunit.client.0.smithi072.stdout:6/174: truncate d7/f11 1260461 0 2024-03-19T06:05:49.897 INFO:tasks.workunit.client.0.smithi072.stdout:0/184: dread d1/fb [0,4194304] 0 2024-03-19T06:05:49.900 INFO:tasks.workunit.client.0.smithi072.stdout:6/175: chown d7/f34 1839867 1 2024-03-19T06:05:49.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:49 smithi172 ceph-mon[35716]: pgmap v21: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 52 MiB/s rd, 108 MiB/s wr, 249 op/s 2024-03-19T06:05:49.907 INFO:tasks.workunit.client.0.smithi072.stdout:0/185: creat d1/d1c/d24/d27/f39 x:0 0 0 2024-03-19T06:05:49.913 INFO:tasks.workunit.client.0.smithi072.stdout:0/186: mknod d1/d2c/c3a 0 2024-03-19T06:05:49.914 INFO:tasks.workunit.client.0.smithi072.stdout:3/236: dread d2/d3/fb [4194304,4194304] 0 2024-03-19T06:05:49.916 INFO:tasks.workunit.client.0.smithi072.stdout:0/187: read d1/d1c/f1d [3106085,21937] 0 2024-03-19T06:05:49.920 INFO:tasks.workunit.client.0.smithi072.stdout:2/91: dwrite db/d10/f16 [0,4194304] 0 2024-03-19T06:05:49.920 INFO:tasks.workunit.client.0.smithi072.stdout:0/188: symlink d1/d2c/l3b 0 2024-03-19T06:05:49.924 INFO:tasks.workunit.client.0.smithi072.stdout:6/176: dwrite d7/d9/d1b/d21/f24 [0,4194304] 0 2024-03-19T06:05:49.928 INFO:tasks.workunit.client.0.smithi072.stdout:2/92: write db/d10/d12/f1b [214283,56620] 0 2024-03-19T06:05:49.931 INFO:tasks.workunit.client.0.smithi072.stdout:0/189: creat d1/f3c x:0 0 0 2024-03-19T06:05:49.932 INFO:tasks.workunit.client.0.smithi072.stdout:6/177: mkdir d7/d3f 0 2024-03-19T06:05:49.933 INFO:tasks.workunit.client.0.smithi072.stdout:3/237: dread d2/f5 [0,4194304] 0 2024-03-19T06:05:49.941 INFO:tasks.workunit.client.0.smithi072.stdout:6/178: creat d7/d9/d1b/d31/f40 x:0 0 0 2024-03-19T06:05:49.943 INFO:tasks.workunit.client.0.smithi072.stdout:2/93: getdents db/d10 0 2024-03-19T06:05:49.945 INFO:tasks.workunit.client.0.smithi072.stdout:3/238: unlink d2/d3/l1b 0 2024-03-19T06:05:49.947 INFO:tasks.workunit.client.0.smithi072.stdout:2/94: rmdir db/d10/d12 39 2024-03-19T06:05:49.951 INFO:tasks.workunit.client.0.smithi072.stdout:2/95: rmdir db 39 2024-03-19T06:05:49.951 INFO:tasks.workunit.client.1.smithi172.stdout:8/990: sync 2024-03-19T06:05:49.952 INFO:tasks.workunit.client.0.smithi072.stdout:0/190: dwrite d1/f1a [0,4194304] 0 2024-03-19T06:05:49.954 INFO:tasks.workunit.client.0.smithi072.stdout:6/179: dread d7/f10 [0,4194304] 0 2024-03-19T06:05:49.957 INFO:tasks.workunit.client.0.smithi072.stdout:3/239: creat d2/d40/f47 x:0 0 0 2024-03-19T06:05:49.960 INFO:tasks.workunit.client.0.smithi072.stdout:3/240: chown d2/d3/l27 377639 1 2024-03-19T06:05:49.965 INFO:tasks.workunit.client.1.smithi172.stdout:8/991: rename d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/c110 to d0/d44/d46/d49/d4f/c13f 0 2024-03-19T06:05:49.966 INFO:tasks.workunit.client.0.smithi072.stdout:3/241: symlink d2/d40/l48 0 2024-03-19T06:05:49.967 INFO:tasks.workunit.client.0.smithi072.stdout:2/96: creat db/d10/d13/f20 x:0 0 0 2024-03-19T06:05:49.968 INFO:tasks.workunit.client.0.smithi072.stdout:6/180: getdents d7/d9/d30 0 2024-03-19T06:05:49.969 INFO:tasks.workunit.client.0.smithi072.stdout:2/97: read - db/d10/d13/f20 zero size 2024-03-19T06:05:49.969 INFO:tasks.workunit.client.0.smithi072.stdout:3/242: mknod d2/d3/d25/c49 0 2024-03-19T06:05:49.972 INFO:tasks.workunit.client.1.smithi172.stdout:8/992: creat d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55/de3/f140 x:0 0 0 2024-03-19T06:05:49.973 INFO:tasks.workunit.client.1.smithi172.stdout:8/993: stat d0/d44/d46/d49/d4f/c74 0 2024-03-19T06:05:49.974 INFO:tasks.workunit.client.0.smithi072.stdout:3/243: creat d2/d3/d26/f4a x:0 0 0 2024-03-19T06:05:49.976 INFO:tasks.workunit.client.0.smithi072.stdout:6/181: mkdir d7/d9/d1b/d33/d41 0 2024-03-19T06:05:49.976 INFO:tasks.workunit.client.0.smithi072.stdout:3/244: chown d2/d3/d15/c20 125 1 2024-03-19T06:05:49.977 INFO:tasks.workunit.client.0.smithi072.stdout:3/245: write d2/d3/fb [3688476,105487] 0 2024-03-19T06:05:49.978 INFO:tasks.workunit.client.0.smithi072.stdout:6/182: creat d7/d3f/f42 x:0 0 0 2024-03-19T06:05:49.981 INFO:tasks.workunit.client.0.smithi072.stdout:3/246: creat d2/d40/f4b x:0 0 0 2024-03-19T06:05:49.984 INFO:tasks.workunit.client.0.smithi072.stdout:3/247: readlink d2/l9 0 2024-03-19T06:05:49.985 INFO:tasks.workunit.client.1.smithi172.stdout:8/994: getdents d0/d44/d46/d49/d26/d71/d81/d27/d29/d28/d55 0 2024-03-19T06:05:49.989 INFO:tasks.workunit.client.0.smithi072.stdout:2/98: dwrite db/d10/d12/f1b [0,4194304] 0 2024-03-19T06:05:49.992 INFO:tasks.workunit.client.1.smithi172.stdout:8/995: mkdir d0/d44/d46/d49/d26/dc0/d76/dc3/dc9/d141 0 2024-03-19T06:05:49.993 INFO:tasks.workunit.client.0.smithi072.stdout:3/248: link d2/d3/d15/f36 d2/d3/d15/f4c 0 2024-03-19T06:05:49.995 INFO:tasks.workunit.client.0.smithi072.stdout:2/99: mknod db/d10/d13/c21 0 2024-03-19T06:05:49.995 INFO:tasks.workunit.client.1.smithi172.stdout:8/996: chown d0/d44/d46/d49/d26/dc0/d134 3668688 1 2024-03-19T06:05:50.002 INFO:tasks.workunit.client.0.smithi072.stdout:6/183: dwrite d7/f34 [0,4194304] 0 2024-03-19T06:05:50.011 INFO:tasks.workunit.client.0.smithi072.stdout:6/184: write d7/f10 [4990018,47059] 0 2024-03-19T06:05:50.014 INFO:tasks.workunit.client.1.smithi172.stdout:8/997: link d0/d61/d6a/d98/cde d0/d44/d46/d49/d26/dc0/dbf/d115/c142 0 2024-03-19T06:05:50.017 INFO:tasks.workunit.client.0.smithi072.stdout:6/185: truncate d7/d9/d1b/d31/f40 210606 0 2024-03-19T06:05:50.018 INFO:tasks.workunit.client.1.smithi172.stdout:8/998: symlink d0/d61/d6a/d9f/l143 0 2024-03-19T06:05:50.020 INFO:tasks.workunit.client.0.smithi072.stdout:6/186: chown d7/d3f/f42 77812447 1 2024-03-19T06:05:50.020 INFO:tasks.workunit.client.0.smithi072.stdout:3/249: dwrite d2/d3/d15/f4c [0,4194304] 0 2024-03-19T06:05:50.023 INFO:tasks.workunit.client.1.smithi172.stdout:8/999: creat d0/d64/f144 x:0 0 0 2024-03-19T06:05:50.024 INFO:tasks.workunit.client.0.smithi072.stdout:3/250: truncate d2/f2f 544224 0 2024-03-19T06:05:50.024 INFO:tasks.workunit.client.0.smithi072.stdout:6/187: mknod d7/d9/d2b/c43 0 2024-03-19T06:05:50.039 INFO:tasks.workunit.client.1.smithi172.stderr:+ rm -rf -- ./tmp.nIpYvxUuyy 2024-03-19T06:05:50.040 INFO:tasks.workunit.client.0.smithi072.stdout:3/251: dwrite d2/d3/d26/f23 [0,4194304] 0 2024-03-19T06:05:50.042 INFO:tasks.workunit.client.0.smithi072.stdout:6/188: dwrite d7/f10 [4194304,4194304] 0 2024-03-19T06:05:50.042 INFO:tasks.workunit.client.0.smithi072.stdout:3/252: write d2/d3/d26/f35 [2618088,34956] 0 2024-03-19T06:05:50.045 INFO:tasks.workunit.client.0.smithi072.stdout:3/253: write d2/d40/f47 [104211,92576] 0 2024-03-19T06:05:50.058 INFO:tasks.workunit.client.0.smithi072.stdout:3/254: dread d2/f5 [0,4194304] 0 2024-03-19T06:05:50.060 INFO:tasks.workunit.client.0.smithi072.stdout:3/255: read d2/f2f [186966,11278] 0 2024-03-19T06:05:50.062 INFO:tasks.workunit.client.0.smithi072.stdout:3/256: dread - d2/f30 zero size 2024-03-19T06:05:50.067 INFO:tasks.workunit.client.0.smithi072.stdout:6/189: dwrite d7/f11 [0,4194304] 0 2024-03-19T06:05:50.069 INFO:tasks.workunit.client.0.smithi072.stdout:3/257: mkdir d2/d3/d15/d4d 0 2024-03-19T06:05:50.072 INFO:tasks.workunit.client.0.smithi072.stdout:6/190: truncate d7/d9/d1b/d21/f24 4454094 0 2024-03-19T06:05:50.077 INFO:tasks.workunit.client.0.smithi072.stdout:6/191: truncate d7/f3c 533064 0 2024-03-19T06:05:50.077 INFO:tasks.workunit.client.0.smithi072.stdout:6/192: readlink l5 0 2024-03-19T06:05:50.081 INFO:tasks.workunit.client.0.smithi072.stdout:6/193: rename d7/d9/d30/d3a to d7/d3f/d44 0 2024-03-19T06:05:50.088 INFO:tasks.workunit.client.0.smithi072.stdout:6/194: mkdir d7/d9/d1b/d33/d41/d45 0 2024-03-19T06:05:50.090 INFO:tasks.workunit.client.0.smithi072.stdout:3/258: dwrite d2/f2f [0,4194304] 0 2024-03-19T06:05:50.091 INFO:tasks.workunit.client.0.smithi072.stdout:6/195: mknod d7/c46 0 2024-03-19T06:05:50.092 INFO:tasks.workunit.client.0.smithi072.stdout:6/196: chown d7/d9/d30 1075997 1 2024-03-19T06:05:50.098 INFO:tasks.workunit.client.0.smithi072.stdout:3/259: rmdir d2/d3/d15/d4d 0 2024-03-19T06:05:50.103 INFO:tasks.workunit.client.0.smithi072.stdout:3/260: chown d2/d19/d1e/l38 288 1 2024-03-19T06:05:50.111 INFO:tasks.workunit.client.0.smithi072.stdout:6/197: dwrite d7/f10 [4194304,4194304] 0 2024-03-19T06:05:50.115 INFO:tasks.workunit.client.0.smithi072.stdout:6/198: creat d7/d2e/f47 x:0 0 0 2024-03-19T06:05:50.116 INFO:tasks.workunit.client.0.smithi072.stdout:6/199: stat d7/d9/d1b/d21/l25 0 2024-03-19T06:05:50.118 INFO:tasks.workunit.client.0.smithi072.stdout:3/261: dread d2/d3/d15/f4c [0,4194304] 0 2024-03-19T06:05:50.118 INFO:tasks.workunit.client.0.smithi072.stdout:6/200: fdatasync d7/d2e/f2f 0 2024-03-19T06:05:50.120 INFO:tasks.workunit.client.0.smithi072.stdout:3/262: write d2/d40/f47 [1155441,97423] 0 2024-03-19T06:05:50.127 INFO:tasks.workunit.client.0.smithi072.stdout:3/263: mknod d2/c4e 0 2024-03-19T06:05:50.139 INFO:tasks.workunit.client.0.smithi072.stdout:6/201: dwrite d7/f1d [0,4194304] 0 2024-03-19T06:05:50.142 INFO:tasks.workunit.client.0.smithi072.stdout:6/202: write d7/d3f/f42 [480105,58370] 0 2024-03-19T06:05:50.144 INFO:tasks.workunit.client.0.smithi072.stdout:5/357: sync 2024-03-19T06:05:50.145 INFO:tasks.workunit.client.0.smithi072.stdout:7/158: sync 2024-03-19T06:05:50.148 INFO:tasks.workunit.client.0.smithi072.stdout:3/264: dwrite d2/d3/fb [8388608,4194304] 0 2024-03-19T06:05:50.156 INFO:tasks.workunit.client.0.smithi072.stdout:5/358: creat df/d13/d32/d28/d42/f6a x:0 0 0 2024-03-19T06:05:50.158 INFO:tasks.workunit.client.0.smithi072.stdout:5/359: chown df/d14/f2f 220 1 2024-03-19T06:05:50.159 INFO:tasks.workunit.client.0.smithi072.stdout:3/265: rmdir d2/d3/d26 39 2024-03-19T06:05:50.161 INFO:tasks.workunit.client.0.smithi072.stdout:7/159: unlink d2/d3/d18/d20/f28 0 2024-03-19T06:05:50.165 INFO:tasks.workunit.client.0.smithi072.stdout:7/160: mkdir d2/d5/d21/d31 0 2024-03-19T06:05:50.166 INFO:tasks.workunit.client.0.smithi072.stdout:3/266: rmdir d2/d3/d26 39 2024-03-19T06:05:50.168 INFO:tasks.workunit.client.0.smithi072.stdout:5/360: creat df/d13/f6b x:0 0 0 2024-03-19T06:05:50.170 INFO:tasks.workunit.client.0.smithi072.stdout:6/203: fsync d7/f1d 0 2024-03-19T06:05:50.172 INFO:tasks.workunit.client.0.smithi072.stdout:7/161: getdents d2 0 2024-03-19T06:05:50.173 INFO:tasks.workunit.client.0.smithi072.stdout:6/204: mkdir d7/d9/d1b/d3b/d48 0 2024-03-19T06:05:50.174 INFO:tasks.workunit.client.0.smithi072.stdout:7/162: mknod d2/d5/c32 0 2024-03-19T06:05:50.176 INFO:tasks.workunit.client.0.smithi072.stdout:6/205: unlink d7/l2c 0 2024-03-19T06:05:50.178 INFO:tasks.workunit.client.0.smithi072.stdout:6/206: chown d7/d9/d2b/c43 5677117 1 2024-03-19T06:05:50.181 INFO:tasks.workunit.client.0.smithi072.stdout:7/163: rename d2/d13 to d2/d3/d18/d33 0 2024-03-19T06:05:50.182 INFO:tasks.workunit.client.0.smithi072.stdout:6/207: write d7/d9/d1b/f2a [199082,70629] 0 2024-03-19T06:05:50.189 INFO:tasks.workunit.client.0.smithi072.stdout:3/267: dwrite d2/d3/d15/f4c [4194304,4194304] 0 2024-03-19T06:05:50.192 INFO:tasks.workunit.client.0.smithi072.stdout:3/268: readlink d2/d3/d15/l17 0 2024-03-19T06:05:50.194 INFO:tasks.workunit.client.0.smithi072.stdout:3/269: mknod d2/d19/c4f 0 2024-03-19T06:05:50.196 INFO:tasks.workunit.client.0.smithi072.stdout:3/270: write d2/d3/d25/f42 [3266269,9317] 0 2024-03-19T06:05:50.199 INFO:tasks.workunit.client.0.smithi072.stdout:7/164: link d2/d5/lf d2/d3/d18/d33/d1d/d2b/l34 0 2024-03-19T06:05:50.203 INFO:tasks.workunit.client.0.smithi072.stdout:3/271: unlink d2/d40/f4b 0 2024-03-19T06:05:50.204 INFO:tasks.workunit.client.0.smithi072.stdout:1/127: sync 2024-03-19T06:05:50.206 INFO:tasks.workunit.client.0.smithi072.stdout:1/128: write d1/d11/f13 [310948,62464] 0 2024-03-19T06:05:50.209 INFO:tasks.workunit.client.0.smithi072.stdout:3/272: truncate d2/d3/d26/f4a 759595 0 2024-03-19T06:05:50.210 INFO:tasks.workunit.client.0.smithi072.stdout:1/129: chown d1/d11/d18/d19/d1a 1233 1 2024-03-19T06:05:50.216 INFO:tasks.workunit.client.0.smithi072.stdout:1/130: dread d1/d11/f1c [0,4194304] 0 2024-03-19T06:05:50.223 INFO:tasks.workunit.client.0.smithi072.stdout:7/165: dwrite d2/f1a [0,4194304] 0 2024-03-19T06:05:50.230 INFO:tasks.workunit.client.0.smithi072.stdout:7/166: creat d2/d5/d21/d31/f35 x:0 0 0 2024-03-19T06:05:50.232 INFO:tasks.workunit.client.0.smithi072.stdout:7/167: fsync d2/d5/f6 0 2024-03-19T06:05:50.235 INFO:tasks.workunit.client.0.smithi072.stdout:7/168: readlink d2/d5/lf 0 2024-03-19T06:05:50.237 INFO:tasks.workunit.client.0.smithi072.stdout:1/131: dwrite d1/d11/d18/d19/f22 [0,4194304] 0 2024-03-19T06:05:50.240 INFO:tasks.workunit.client.0.smithi072.stdout:7/169: rmdir d2/d3 39 2024-03-19T06:05:50.243 INFO:tasks.workunit.client.0.smithi072.stdout:1/132: getdents d1/d11/d18/d19/d1a/d25 0 2024-03-19T06:05:50.249 INFO:tasks.workunit.client.0.smithi072.stdout:1/133: mknod d1/d11/d18/d19/d1a/c26 0 2024-03-19T06:05:50.250 INFO:tasks.workunit.client.0.smithi072.stdout:7/170: rename d2/c19 to d2/d3/d18/d20/c36 0 2024-03-19T06:05:50.255 INFO:tasks.workunit.client.0.smithi072.stdout:7/171: symlink d2/d3/d18/d2f/l37 0 2024-03-19T06:05:50.258 INFO:tasks.workunit.client.0.smithi072.stdout:7/172: write d2/d3/d18/d2f/f23 [8071012,3689] 0 2024-03-19T06:05:50.261 INFO:tasks.workunit.client.0.smithi072.stdout:7/173: chown d2/d5/f6 9899255 1 2024-03-19T06:05:50.265 INFO:tasks.workunit.client.0.smithi072.stdout:7/174: truncate d2/d5/f11 1323830 0 2024-03-19T06:05:50.267 INFO:tasks.workunit.client.0.smithi072.stdout:1/134: dread d1/d11/d18/d19/f22 [0,4194304] 0 2024-03-19T06:05:50.268 INFO:tasks.workunit.client.0.smithi072.stdout:7/175: mknod d2/d3/d17/c38 0 2024-03-19T06:05:50.269 INFO:tasks.workunit.client.0.smithi072.stdout:7/176: chown d2/d5/d21/d31 659393603 1 2024-03-19T06:05:50.269 INFO:tasks.workunit.client.0.smithi072.stdout:1/135: creat d1/f27 x:0 0 0 2024-03-19T06:05:50.271 INFO:tasks.workunit.client.0.smithi072.stdout:7/177: creat d2/d5/f39 x:0 0 0 2024-03-19T06:05:50.275 INFO:tasks.workunit.client.0.smithi072.stdout:7/178: mkdir d2/d3/d18/d20/d3a 0 2024-03-19T06:05:50.277 INFO:tasks.workunit.client.0.smithi072.stdout:7/179: fsync d2/d5/f7 0 2024-03-19T06:05:50.282 INFO:tasks.workunit.client.0.smithi072.stdout:7/180: mkdir d2/d3/d18/d33/d1d/d3b 0 2024-03-19T06:05:50.288 INFO:tasks.workunit.client.0.smithi072.stdout:7/181: creat d2/d3/d18/d33/f3c x:0 0 0 2024-03-19T06:05:50.294 INFO:tasks.workunit.client.0.smithi072.stdout:1/136: dread d1/d11/f13 [0,4194304] 0 2024-03-19T06:05:50.297 INFO:tasks.workunit.client.0.smithi072.stdout:1/137: write d1/d11/d18/d19/f22 [347721,98506] 0 2024-03-19T06:05:50.299 INFO:tasks.workunit.client.0.smithi072.stdout:1/138: fsync d1/f15 0 2024-03-19T06:05:50.300 INFO:tasks.workunit.client.0.smithi072.stdout:7/182: truncate d2/d5/f6 6407020 0 2024-03-19T06:05:50.303 INFO:tasks.workunit.client.0.smithi072.stdout:1/139: write d1/d16/f1e [4916299,6366] 0 2024-03-19T06:05:50.308 INFO:tasks.workunit.client.0.smithi072.stdout:7/183: rename d2/d5 to d2/d3/d18/d33/d1d/d2b/d3d 0 2024-03-19T06:05:50.309 INFO:tasks.workunit.client.0.smithi072.stdout:1/140: fsync d1/d11/f1c 0 2024-03-19T06:05:50.310 INFO:tasks.workunit.client.0.smithi072.stdout:7/184: fsync d2/d3/fd 0 2024-03-19T06:05:50.310 INFO:tasks.workunit.client.0.smithi072.stdout:1/141: chown d1/ca 2855 1 2024-03-19T06:05:50.314 INFO:tasks.workunit.client.0.smithi072.stdout:1/142: creat d1/d11/d18/f28 x:0 0 0 2024-03-19T06:05:50.315 INFO:tasks.workunit.client.0.smithi072.stdout:1/143: chown d1/ca 367009 1 2024-03-19T06:05:50.333 INFO:tasks.workunit.client.0.smithi072.stdout:7/185: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f11 [0,4194304] 0 2024-03-19T06:05:50.337 INFO:tasks.workunit.client.0.smithi072.stdout:1/144: dwrite d1/f15 [4194304,4194304] 0 2024-03-19T06:05:50.347 INFO:tasks.workunit.client.0.smithi072.stdout:1/145: creat d1/d11/f29 x:0 0 0 2024-03-19T06:05:50.363 INFO:tasks.workunit.client.0.smithi072.stdout:1/146: truncate d1/d16/f1e 2254392 0 2024-03-19T06:05:50.366 INFO:tasks.workunit.client.0.smithi072.stdout:1/147: write d1/d11/f13 [3579112,31807] 0 2024-03-19T06:05:50.368 INFO:tasks.workunit.client.0.smithi072.stdout:1/148: chown d1/l8 1307 1 2024-03-19T06:05:50.369 INFO:tasks.workunit.client.0.smithi072.stdout:1/149: write d1/d11/f29 [578821,31061] 0 2024-03-19T06:05:50.374 INFO:tasks.workunit.client.0.smithi072.stdout:1/150: creat d1/d11/d18/d19/d1a/f2a x:0 0 0 2024-03-19T06:05:50.377 INFO:tasks.workunit.client.0.smithi072.stdout:1/151: creat d1/d11/d18/d19/d1a/d25/f2b x:0 0 0 2024-03-19T06:05:50.379 INFO:tasks.workunit.client.0.smithi072.stdout:1/152: symlink d1/d16/l2c 0 2024-03-19T06:05:50.381 INFO:tasks.workunit.client.0.smithi072.stdout:1/153: fdatasync d1/d11/d18/f28 0 2024-03-19T06:05:50.384 INFO:tasks.workunit.client.0.smithi072.stdout:1/154: rename d1/l8 to d1/l2d 0 2024-03-19T06:05:50.390 INFO:tasks.workunit.client.0.smithi072.stdout:1/155: fsync d1/d16/f1e 0 2024-03-19T06:05:50.392 INFO:tasks.workunit.client.0.smithi072.stdout:1/156: fdatasync d1/d11/d18/f28 0 2024-03-19T06:05:50.396 INFO:tasks.workunit.client.0.smithi072.stdout:1/157: write d1/d11/d18/d19/d1a/f2a [51468,42647] 0 2024-03-19T06:05:50.402 INFO:tasks.workunit.client.0.smithi072.stdout:1/158: rename d1/d11/d18/d19/d1a/d25/f2b to d1/d11/d18/f2e 0 2024-03-19T06:05:50.405 INFO:tasks.workunit.client.0.smithi072.stdout:1/159: mknod d1/d16/c2f 0 2024-03-19T06:05:50.405 INFO:tasks.workunit.client.0.smithi072.stdout:1/160: stat d1 0 2024-03-19T06:05:50.405 INFO:tasks.workunit.client.0.smithi072.stdout:1/161: readlink d1/l12 0 2024-03-19T06:05:50.420 INFO:tasks.workunit.client.0.smithi072.stdout:1/162: dwrite d1/d11/d18/d19/d1a/f2a [0,4194304] 0 2024-03-19T06:05:50.424 INFO:tasks.workunit.client.0.smithi072.stdout:1/163: mknod d1/d11/d18/d19/d1a/d25/c30 0 2024-03-19T06:05:50.429 INFO:tasks.workunit.client.0.smithi072.stdout:0/191: sync 2024-03-19T06:05:50.429 INFO:tasks.workunit.client.0.smithi072.stdout:4/220: sync 2024-03-19T06:05:50.429 INFO:tasks.workunit.client.0.smithi072.stdout:9/121: sync 2024-03-19T06:05:50.429 INFO:tasks.workunit.client.0.smithi072.stdout:2/100: sync 2024-03-19T06:05:50.429 INFO:tasks.workunit.client.0.smithi072.stdout:8/133: sync 2024-03-19T06:05:50.431 INFO:tasks.workunit.client.0.smithi072.stdout:0/192: readlink d1/d1c/l20 0 2024-03-19T06:05:50.433 INFO:tasks.workunit.client.0.smithi072.stdout:8/134: chown da/d13/d14/d1b/l24 211707071 1 2024-03-19T06:05:50.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/221: write d5/d11/f1a [206451,128617] 0 2024-03-19T06:05:50.435 INFO:tasks.workunit.client.0.smithi072.stdout:9/122: unlink lc 0 2024-03-19T06:05:50.437 INFO:tasks.workunit.client.0.smithi072.stdout:0/193: readlink l0 0 2024-03-19T06:05:50.437 INFO:tasks.workunit.client.0.smithi072.stdout:4/222: mkdir d5/d15/d53 0 2024-03-19T06:05:50.440 INFO:tasks.workunit.client.0.smithi072.stdout:2/101: rename db/d10/f1f to db/f22 0 2024-03-19T06:05:50.443 INFO:tasks.workunit.client.0.smithi072.stdout:4/223: symlink d5/d15/d22/l54 0 2024-03-19T06:05:50.446 INFO:tasks.workunit.client.0.smithi072.stdout:8/135: rename da/d13/f16 to da/f2e 0 2024-03-19T06:05:50.447 INFO:tasks.workunit.client.0.smithi072.stdout:8/136: fsync da/fc 0 2024-03-19T06:05:50.447 INFO:tasks.workunit.client.0.smithi072.stdout:1/164: dwrite d1/d16/f1e [0,4194304] 0 2024-03-19T06:05:50.450 INFO:tasks.workunit.client.0.smithi072.stdout:9/123: truncate fe 7669192 0 2024-03-19T06:05:50.452 INFO:tasks.workunit.client.0.smithi072.stdout:9/124: rename d11 to d11/d1f/d2a/d2b 22 2024-03-19T06:05:50.454 INFO:tasks.workunit.client.0.smithi072.stdout:2/102: mknod db/d10/d12/c23 0 2024-03-19T06:05:50.458 INFO:tasks.workunit.client.0.smithi072.stdout:0/194: creat d1/f3d x:0 0 0 2024-03-19T06:05:50.468 INFO:tasks.workunit.client.0.smithi072.stdout:8/137: link f9 da/d13/f2f 0 2024-03-19T06:05:50.470 INFO:tasks.workunit.client.0.smithi072.stdout:2/103: write db/d10/f16 [3671451,18514] 0 2024-03-19T06:05:50.481 INFO:tasks.workunit.client.0.smithi072.stdout:9/125: dwrite fa [0,4194304] 0 2024-03-19T06:05:50.483 INFO:tasks.workunit.client.0.smithi072.stdout:2/104: truncate db/d10/f18 740116 0 2024-03-19T06:05:50.503 INFO:tasks.workunit.client.0.smithi072.stdout:8/138: dwrite f4 [0,4194304] 0 2024-03-19T06:05:50.505 INFO:tasks.workunit.client.0.smithi072.stdout:0/195: dread d1/d1c/d24/d27/f29 [0,4194304] 0 2024-03-19T06:05:50.507 INFO:tasks.workunit.client.0.smithi072.stdout:4/224: dwrite d5/f9 [0,4194304] 0 2024-03-19T06:05:50.514 INFO:tasks.workunit.client.0.smithi072.stdout:1/165: dread d1/f6 [0,4194304] 0 2024-03-19T06:05:50.514 INFO:tasks.workunit.client.0.smithi072.stdout:0/196: write d1/d1c/f23 [2308255,23145] 0 2024-03-19T06:05:50.515 INFO:tasks.workunit.client.0.smithi072.stdout:2/105: dwrite db/d10/f18 [0,4194304] 0 2024-03-19T06:05:50.515 INFO:tasks.workunit.client.0.smithi072.stdout:8/139: mkdir da/d27/d30 0 2024-03-19T06:05:50.520 INFO:tasks.workunit.client.0.smithi072.stdout:1/166: read d1/f15 [7331482,92941] 0 2024-03-19T06:05:50.520 INFO:tasks.workunit.client.0.smithi072.stdout:0/197: read - d1/d2c/f37 zero size 2024-03-19T06:05:50.520 INFO:tasks.workunit.client.0.smithi072.stdout:8/140: write f4 [836891,130318] 0 2024-03-19T06:05:50.520 INFO:tasks.workunit.client.0.smithi072.stdout:2/106: dread - db/f22 zero size 2024-03-19T06:05:50.532 INFO:tasks.workunit.client.0.smithi072.stdout:1/167: write d1/d11/d18/d19/d1a/f2a [3937655,17640] 0 2024-03-19T06:05:50.535 INFO:tasks.workunit.client.0.smithi072.stdout:2/107: dread db/d10/d12/f1b [4194304,4194304] 0 2024-03-19T06:05:50.540 INFO:tasks.workunit.client.0.smithi072.stdout:4/225: dread d5/fa [0,4194304] 0 2024-03-19T06:05:50.541 INFO:tasks.workunit.client.0.smithi072.stdout:2/108: mkdir db/d10/d13/d24 0 2024-03-19T06:05:50.544 INFO:tasks.workunit.client.0.smithi072.stdout:4/226: symlink d5/d15/d22/l55 0 2024-03-19T06:05:50.545 INFO:tasks.workunit.client.0.smithi072.stdout:8/141: write da/d13/f2f [3259498,35985] 0 2024-03-19T06:05:50.546 INFO:tasks.workunit.client.0.smithi072.stdout:2/109: creat db/d10/d13/f25 x:0 0 0 2024-03-19T06:05:50.547 INFO:tasks.workunit.client.0.smithi072.stdout:0/198: truncate d1/fb 1655559 0 2024-03-19T06:05:50.548 INFO:tasks.workunit.client.0.smithi072.stdout:4/227: dread - d5/d15/d50/f2e zero size 2024-03-19T06:05:50.552 INFO:tasks.workunit.client.0.smithi072.stdout:2/110: creat db/d10/d13/f26 x:0 0 0 2024-03-19T06:05:50.553 INFO:tasks.workunit.client.0.smithi072.stdout:4/228: symlink d5/d15/d50/l56 0 2024-03-19T06:05:50.554 INFO:tasks.workunit.client.0.smithi072.stdout:8/142: fsync f9 0 2024-03-19T06:05:50.558 INFO:tasks.workunit.client.0.smithi072.stdout:4/229: chown d5/d15/d50/l56 0 1 2024-03-19T06:05:50.559 INFO:tasks.workunit.client.0.smithi072.stdout:9/126: dread fe [4194304,4194304] 0 2024-03-19T06:05:50.559 INFO:tasks.workunit.client.0.smithi072.stdout:1/168: dwrite d1/f27 [0,4194304] 0 2024-03-19T06:05:50.561 INFO:tasks.workunit.client.0.smithi072.stdout:2/111: creat db/d10/f27 x:0 0 0 2024-03-19T06:05:50.563 INFO:tasks.workunit.client.0.smithi072.stdout:4/230: mknod d5/d15/d31/c57 0 2024-03-19T06:05:50.564 INFO:tasks.workunit.client.0.smithi072.stdout:4/231: fdatasync d5/ff 0 2024-03-19T06:05:50.565 INFO:tasks.workunit.client.0.smithi072.stdout:2/112: chown db/d10/d12/f1b 8 1 2024-03-19T06:05:50.566 INFO:tasks.workunit.client.0.smithi072.stdout:8/143: rename da/c12 to da/d13/d14/d1b/c31 0 2024-03-19T06:05:50.567 INFO:tasks.workunit.client.0.smithi072.stdout:8/144: chown da 63 1 2024-03-19T06:05:50.568 INFO:tasks.workunit.client.0.smithi072.stdout:4/232: truncate d5/d11/f36 4427137 0 2024-03-19T06:05:50.568 INFO:tasks.workunit.client.0.smithi072.stdout:0/199: dread d1/fb [0,4194304] 0 2024-03-19T06:05:50.568 INFO:tasks.workunit.client.0.smithi072.stdout:8/145: fdatasync da/fc 0 2024-03-19T06:05:50.569 INFO:tasks.workunit.client.0.smithi072.stdout:1/169: creat d1/d16/f31 x:0 0 0 2024-03-19T06:05:50.570 INFO:tasks.workunit.client.0.smithi072.stdout:8/146: stat da/d13/f2f 0 2024-03-19T06:05:50.572 INFO:tasks.workunit.client.0.smithi072.stdout:8/147: write f4 [410722,87571] 0 2024-03-19T06:05:50.573 INFO:tasks.workunit.client.0.smithi072.stdout:9/127: creat d11/d26/f2c x:0 0 0 2024-03-19T06:05:50.574 INFO:tasks.workunit.client.0.smithi072.stdout:5/361: sync 2024-03-19T06:05:50.574 INFO:tasks.workunit.client.0.smithi072.stdout:2/113: symlink db/l28 0 2024-03-19T06:05:50.577 INFO:tasks.workunit.client.0.smithi072.stdout:1/170: mknod d1/d11/c32 0 2024-03-19T06:05:50.579 INFO:tasks.workunit.client.0.smithi072.stdout:8/148: unlink da/d13/f2f 0 2024-03-19T06:05:50.580 INFO:tasks.workunit.client.0.smithi072.stdout:5/362: dread - df/d13/d32/d28/d42/d59/d43/f5a zero size 2024-03-19T06:05:50.585 INFO:tasks.workunit.client.0.smithi072.stdout:1/171: unlink d1/d11/d18/d19/f22 0 2024-03-19T06:05:50.588 INFO:tasks.workunit.client.0.smithi072.stdout:9/128: link d11/d1f/f27 d11/d26/f2d 0 2024-03-19T06:05:50.588 INFO:tasks.workunit.client.0.smithi072.stdout:8/149: symlink da/d13/d14/d1b/l32 0 2024-03-19T06:05:50.591 INFO:tasks.workunit.client.0.smithi072.stdout:0/200: dwrite d1/f3c [0,4194304] 0 2024-03-19T06:05:50.592 INFO:tasks.workunit.client.0.smithi072.stdout:1/172: creat d1/d11/d18/f33 x:0 0 0 2024-03-19T06:05:50.592 INFO:tasks.workunit.client.0.smithi072.stdout:4/233: getdents d5/d11 0 2024-03-19T06:05:50.593 INFO:tasks.workunit.client.0.smithi072.stdout:5/363: symlink df/d54/l6c 0 2024-03-19T06:05:50.595 INFO:tasks.workunit.client.0.smithi072.stdout:9/129: symlink d11/d26/l2e 0 2024-03-19T06:05:50.597 INFO:tasks.workunit.client.0.smithi072.stdout:8/150: fdatasync da/f2e 0 2024-03-19T06:05:50.599 INFO:tasks.workunit.client.0.smithi072.stdout:4/234: write d5/d15/d22/f45 [462415,75934] 0 2024-03-19T06:05:50.601 INFO:tasks.workunit.client.0.smithi072.stdout:0/201: mkdir d1/d1c/d24/d3e 0 2024-03-19T06:05:50.605 INFO:tasks.workunit.client.0.smithi072.stdout:1/173: creat d1/d11/d18/d19/d1a/f34 x:0 0 0 2024-03-19T06:05:50.609 INFO:tasks.workunit.client.0.smithi072.stdout:0/202: chown d1/d1c/l34 328448 1 2024-03-19T06:05:50.613 INFO:tasks.workunit.client.0.smithi072.stdout:8/151: truncate da/f2e 2007010 0 2024-03-19T06:05:50.615 INFO:tasks.workunit.client.0.smithi072.stdout:1/174: mknod d1/d11/d18/d19/d1a/c35 0 2024-03-19T06:05:50.615 INFO:tasks.workunit.client.0.smithi072.stdout:2/114: dwrite db/d10/f1d [0,4194304] 0 2024-03-19T06:05:50.615 INFO:tasks.workunit.client.0.smithi072.stdout:0/203: mkdir d1/d1c/d24/d3f 0 2024-03-19T06:05:50.618 INFO:tasks.workunit.client.0.smithi072.stdout:5/364: link df/d13/d32/d28/f44 df/d16/d61/f6d 0 2024-03-19T06:05:50.619 INFO:tasks.workunit.client.0.smithi072.stdout:2/115: write db/d10/d13/f20 [240974,60892] 0 2024-03-19T06:05:50.620 INFO:tasks.workunit.client.0.smithi072.stdout:8/152: unlink da/cb 0 2024-03-19T06:05:50.622 INFO:tasks.workunit.client.0.smithi072.stdout:5/365: fsync df/d13/d24/f4f 0 2024-03-19T06:05:50.623 INFO:tasks.workunit.client.0.smithi072.stdout:1/175: symlink d1/l36 0 2024-03-19T06:05:50.625 INFO:tasks.workunit.client.0.smithi072.stdout:0/204: readlink d1/d1c/d24/d27/l33 0 2024-03-19T06:05:50.627 INFO:tasks.workunit.client.0.smithi072.stdout:1/176: stat d1/d11/f29 0 2024-03-19T06:05:50.627 INFO:tasks.workunit.client.0.smithi072.stdout:8/153: read f4 [1106402,98893] 0 2024-03-19T06:05:50.629 INFO:tasks.workunit.client.0.smithi072.stdout:9/130: dwrite d11/f23 [4194304,4194304] 0 2024-03-19T06:05:50.630 INFO:tasks.workunit.client.0.smithi072.stdout:8/154: write da/d13/d14/f28 [325265,91207] 0 2024-03-19T06:05:50.631 INFO:tasks.workunit.client.0.smithi072.stdout:4/235: truncate d5/d11/f36 674713 0 2024-03-19T06:05:50.633 INFO:tasks.workunit.client.0.smithi072.stdout:2/116: creat db/f29 x:0 0 0 2024-03-19T06:05:50.634 INFO:tasks.workunit.client.0.smithi072.stdout:5/366: dread - df/d13/f49 zero size 2024-03-19T06:05:50.635 INFO:tasks.workunit.client.0.smithi072.stdout:2/117: write db/d10/d13/f26 [876963,67651] 0 2024-03-19T06:05:50.637 INFO:tasks.workunit.client.0.smithi072.stdout:2/118: rename db/d10/d13 to db/d10/d13/d2a 22 2024-03-19T06:05:50.638 INFO:tasks.workunit.client.0.smithi072.stdout:0/205: symlink d1/d1c/d24/l40 0 2024-03-19T06:05:50.638 INFO:tasks.workunit.client.0.smithi072.stdout:1/177: mknod d1/d11/d18/d19/d1a/d25/c37 0 2024-03-19T06:05:50.640 INFO:tasks.workunit.client.0.smithi072.stdout:4/236: mkdir d5/d32/d58 0 2024-03-19T06:05:50.641 INFO:tasks.workunit.client.0.smithi072.stdout:9/131: truncate d11/f1e 1000035 0 2024-03-19T06:05:50.643 INFO:tasks.workunit.client.0.smithi072.stdout:5/367: read df/f26 [510179,45094] 0 2024-03-19T06:05:50.643 INFO:tasks.workunit.client.0.smithi072.stdout:1/178: dread - d1/d11/d18/f33 zero size 2024-03-19T06:05:50.643 INFO:tasks.workunit.client.0.smithi072.stdout:0/206: chown d1/d1c/d24/d27/l36 184772 1 2024-03-19T06:05:50.644 INFO:tasks.workunit.client.0.smithi072.stdout:2/119: mkdir db/d10/d2b 0 2024-03-19T06:05:50.646 INFO:tasks.workunit.client.0.smithi072.stdout:2/120: fdatasync db/f1e 0 2024-03-19T06:05:50.647 INFO:tasks.workunit.client.0.smithi072.stdout:4/237: symlink d5/d11/l59 0 2024-03-19T06:05:50.647 INFO:tasks.workunit.client.0.smithi072.stdout:6/208: sync 2024-03-19T06:05:50.648 INFO:tasks.workunit.client.0.smithi072.stdout:7/186: sync 2024-03-19T06:05:50.648 INFO:tasks.workunit.client.0.smithi072.stdout:3/273: sync 2024-03-19T06:05:50.649 INFO:tasks.workunit.client.0.smithi072.stdout:6/209: readlink l5 0 2024-03-19T06:05:50.650 INFO:tasks.workunit.client.0.smithi072.stdout:8/155: getdents da/d13/d1d 0 2024-03-19T06:05:50.651 INFO:tasks.workunit.client.0.smithi072.stdout:5/368: write df/d13/d24/f4f [4706743,23027] 0 2024-03-19T06:05:50.652 INFO:tasks.workunit.client.0.smithi072.stdout:9/132: symlink d11/d24/l2f 0 2024-03-19T06:05:50.653 INFO:tasks.workunit.client.0.smithi072.stdout:1/179: rename d1/d11/d18/f28 to d1/d16/f38 0 2024-03-19T06:05:50.657 INFO:tasks.workunit.client.0.smithi072.stdout:2/121: write db/d10/d12/f1b [5119991,15402] 0 2024-03-19T06:05:50.660 INFO:tasks.workunit.client.0.smithi072.stdout:3/274: read d2/d3/d26/f22 [477754,2251] 0 2024-03-19T06:05:50.662 INFO:tasks.workunit.client.0.smithi072.stdout:5/369: symlink df/d13/d32/d28/d42/l6e 0 2024-03-19T06:05:50.662 INFO:tasks.workunit.client.0.smithi072.stdout:9/133: truncate fe 4106550 0 2024-03-19T06:05:50.663 INFO:tasks.workunit.client.0.smithi072.stdout:8/156: read f9 [3476164,113610] 0 2024-03-19T06:05:50.663 INFO:tasks.workunit.client.0.smithi072.stdout:2/122: read - db/d10/f27 zero size 2024-03-19T06:05:50.665 INFO:tasks.workunit.client.0.smithi072.stdout:6/210: rename d7/d9/d1b/d21/f29 to d7/d9/d2b/f49 0 2024-03-19T06:05:50.666 INFO:tasks.workunit.client.0.smithi072.stdout:1/180: unlink d1/d11/d18/f33 0 2024-03-19T06:05:50.668 INFO:tasks.workunit.client.0.smithi072.stdout:3/275: unlink d2/f2c 0 2024-03-19T06:05:50.673 INFO:tasks.workunit.client.0.smithi072.stdout:0/207: dwrite d1/d1c/d24/d27/f2e [0,4194304] 0 2024-03-19T06:05:50.673 INFO:tasks.workunit.client.0.smithi072.stdout:7/187: getdents d2/d3/d18/d20 0 2024-03-19T06:05:50.674 INFO:tasks.workunit.client.0.smithi072.stdout:9/134: truncate d11/f1b 1040044 0 2024-03-19T06:05:50.674 INFO:tasks.workunit.client.0.smithi072.stdout:6/211: chown d7/d9/d1b/d33/d41/d45 17077139 1 2024-03-19T06:05:50.676 INFO:tasks.workunit.client.0.smithi072.stdout:2/123: mknod db/d10/d2b/c2c 0 2024-03-19T06:05:50.677 INFO:tasks.workunit.client.0.smithi072.stdout:1/181: creat d1/d11/f39 x:0 0 0 2024-03-19T06:05:50.678 INFO:tasks.workunit.client.0.smithi072.stdout:8/157: read da/f2e [1417472,74568] 0 2024-03-19T06:05:50.681 INFO:tasks.workunit.client.0.smithi072.stdout:0/208: stat d1/lf 0 2024-03-19T06:05:50.682 INFO:tasks.workunit.client.0.smithi072.stdout:0/209: dread - d1/d2c/f37 zero size 2024-03-19T06:05:50.683 INFO:tasks.workunit.client.0.smithi072.stdout:7/188: write d2/f4 [4871233,90123] 0 2024-03-19T06:05:50.688 INFO:tasks.workunit.client.0.smithi072.stdout:7/189: write d2/f4 [4516625,13129] 0 2024-03-19T06:05:50.689 INFO:tasks.workunit.client.0.smithi072.stdout:9/135: fsync d11/d26/f2d 0 2024-03-19T06:05:50.694 INFO:tasks.workunit.client.0.smithi072.stdout:1/182: creat d1/d16/f3a x:0 0 0 2024-03-19T06:05:50.694 INFO:tasks.workunit.client.0.smithi072.stdout:6/212: mknod d7/d9/d1b/d33/c4a 0 2024-03-19T06:05:50.696 INFO:tasks.workunit.client.0.smithi072.stdout:7/190: fsync d2/f4 0 2024-03-19T06:05:50.697 INFO:tasks.workunit.client.0.smithi072.stdout:5/370: dwrite df/d13/f5e [0,4194304] 0 2024-03-19T06:05:50.704 INFO:tasks.workunit.client.0.smithi072.stdout:8/158: rename da/d13/c1c to da/d27/c33 0 2024-03-19T06:05:50.704 INFO:tasks.workunit.client.0.smithi072.stdout:0/210: rmdir d1/d1c 39 2024-03-19T06:05:50.705 INFO:tasks.workunit.client.0.smithi072.stdout:3/276: getdents d2/d19/d1e/d43 0 2024-03-19T06:05:50.708 INFO:tasks.workunit.client.0.smithi072.stdout:7/191: unlink d2/d3/d17/c38 0 2024-03-19T06:05:50.712 INFO:tasks.workunit.client.0.smithi072.stdout:1/183: mkdir d1/d11/d18/d19/d1a/d3b 0 2024-03-19T06:05:50.714 INFO:tasks.workunit.client.0.smithi072.stdout:0/211: creat d1/d2c/f41 x:0 0 0 2024-03-19T06:05:50.719 INFO:tasks.workunit.client.0.smithi072.stdout:4/238: dread d5/f6 [0,4194304] 0 2024-03-19T06:05:50.731 INFO:tasks.workunit.client.0.smithi072.stdout:7/192: creat d2/d3/d18/d33/d1d/d2b/d3d/d26/f3e x:0 0 0 2024-03-19T06:05:50.731 INFO:tasks.workunit.client.0.smithi072.stdout:2/124: dwrite db/f29 [0,4194304] 0 2024-03-19T06:05:50.732 INFO:tasks.workunit.client.0.smithi072.stdout:0/212: write d1/f5 [561590,43712] 0 2024-03-19T06:05:50.738 INFO:tasks.workunit.client.0.smithi072.stdout:5/371: truncate df/d13/d32/f12 2320540 0 2024-03-19T06:05:50.738 INFO:tasks.workunit.client.0.smithi072.stdout:4/239: read d5/f9 [473927,118744] 0 2024-03-19T06:05:50.741 INFO:tasks.workunit.client.0.smithi072.stdout:3/277: write d2/f2f [4323855,116753] 0 2024-03-19T06:05:50.745 INFO:tasks.workunit.client.0.smithi072.stdout:4/240: fdatasync d5/d15/d31/f3c 0 2024-03-19T06:05:50.746 INFO:tasks.workunit.client.0.smithi072.stdout:2/125: write db/d10/f1d [2544648,100556] 0 2024-03-19T06:05:50.747 INFO:tasks.workunit.client.0.smithi072.stdout:6/213: dread d7/d9/d2b/f49 [0,4194304] 0 2024-03-19T06:05:50.747 INFO:tasks.workunit.client.0.smithi072.stdout:5/372: chown df/d13/f3e 211337 1 2024-03-19T06:05:50.750 INFO:tasks.workunit.client.0.smithi072.stdout:4/241: stat d5/d11/f39 0 2024-03-19T06:05:50.753 INFO:tasks.workunit.client.0.smithi072.stdout:4/242: stat d5/d32/l4b 0 2024-03-19T06:05:50.755 INFO:tasks.workunit.client.0.smithi072.stdout:7/193: mkdir d2/d3/d18/d3f 0 2024-03-19T06:05:50.757 INFO:tasks.workunit.client.0.smithi072.stdout:2/126: read db/d10/d12/f14 [3589543,51306] 0 2024-03-19T06:05:50.757 INFO:tasks.workunit.client.0.smithi072.stdout:9/136: dwrite d11/f17 [0,4194304] 0 2024-03-19T06:05:50.759 INFO:tasks.workunit.client.0.smithi072.stdout:6/214: stat d7/d9/le 0 2024-03-19T06:05:50.765 INFO:tasks.workunit.client.0.smithi072.stdout:7/194: dread - d2/d3/d18/d33/d1d/d2b/d3d/f39 zero size 2024-03-19T06:05:50.766 INFO:tasks.workunit.client.0.smithi072.stdout:4/243: creat d5/d1b/f5a x:0 0 0 2024-03-19T06:05:50.766 INFO:tasks.workunit.client.0.smithi072.stdout:0/213: mknod d1/d1c/d24/d3e/c42 0 2024-03-19T06:05:50.767 INFO:tasks.workunit.client.0.smithi072.stdout:1/184: dread d1/d11/f13 [0,4194304] 0 2024-03-19T06:05:50.767 INFO:tasks.workunit.client.0.smithi072.stdout:2/127: mkdir db/d10/d2b/d2d 0 2024-03-19T06:05:50.772 INFO:tasks.workunit.client.0.smithi072.stdout:9/137: rename d11/d26/f2d to d11/d24/f30 0 2024-03-19T06:05:50.773 INFO:tasks.workunit.client.0.smithi072.stdout:2/128: fdatasync db/d10/f16 0 2024-03-19T06:05:50.774 INFO:tasks.workunit.client.0.smithi072.stdout:4/244: creat d5/d15/d50/f5b x:0 0 0 2024-03-19T06:05:50.777 INFO:tasks.workunit.client.0.smithi072.stdout:1/185: chown d1/l1d 622 1 2024-03-19T06:05:50.782 INFO:tasks.workunit.client.0.smithi072.stdout:2/129: chown db/d10/f18 0 1 2024-03-19T06:05:50.783 INFO:tasks.workunit.client.0.smithi072.stdout:4/245: chown d5/d1b/f33 57844587 1 2024-03-19T06:05:50.786 INFO:tasks.workunit.client.0.smithi072.stdout:9/138: write d11/f17 [3496444,37554] 0 2024-03-19T06:05:50.793 INFO:tasks.workunit.client.0.smithi072.stdout:1/186: write d1/d11/f13 [4939372,15408] 0 2024-03-19T06:05:50.793 INFO:tasks.workunit.client.0.smithi072.stdout:3/278: dwrite d2/d3/d26/f23 [4194304,4194304] 0 2024-03-19T06:05:50.793 INFO:tasks.workunit.client.0.smithi072.stdout:7/195: unlink d2/f1a 0 2024-03-19T06:05:50.793 INFO:tasks.workunit.client.0.smithi072.stdout:5/373: write fe [2763138,34557] 0 2024-03-19T06:05:50.802 INFO:tasks.workunit.client.0.smithi072.stdout:4/246: mknod d5/d15/d31/d4c/c5c 0 2024-03-19T06:05:50.802 INFO:tasks.workunit.client.0.smithi072.stdout:7/196: chown d2/d3/d18/d33/d1d/d2b/l34 14 1 2024-03-19T06:05:50.803 INFO:tasks.workunit.client.0.smithi072.stdout:8/159: dread f8 [0,4194304] 0 2024-03-19T06:05:50.808 INFO:tasks.workunit.client.0.smithi072.stdout:4/247: chown d5/d11/c38 504 1 2024-03-19T06:05:50.818 INFO:tasks.workunit.client.0.smithi072.stdout:5/374: creat df/d13/d32/d28/d42/d59/d43/d4e/d5c/f6f x:0 0 0 2024-03-19T06:05:50.818 INFO:tasks.workunit.client.0.smithi072.stdout:4/248: readlink d5/d15/d22/d41/l4a 0 2024-03-19T06:05:50.825 INFO:tasks.workunit.client.0.smithi072.stdout:1/187: truncate d1/d16/f1e 1488425 0 2024-03-19T06:05:50.829 INFO:tasks.workunit.client.0.smithi072.stdout:4/249: creat d5/d1b/f5d x:0 0 0 2024-03-19T06:05:50.829 INFO:tasks.workunit.client.0.smithi072.stdout:2/130: dwrite db/d10/f16 [0,4194304] 0 2024-03-19T06:05:50.829 INFO:tasks.workunit.client.0.smithi072.stdout:1/188: read - d1/d16/f3a zero size 2024-03-19T06:05:50.831 INFO:tasks.workunit.client.0.smithi072.stdout:5/375: rmdir df/d13/d32/d28 39 2024-03-19T06:05:50.833 INFO:tasks.workunit.client.0.smithi072.stdout:6/215: dread d7/f12 [0,4194304] 0 2024-03-19T06:05:50.835 INFO:tasks.workunit.client.0.smithi072.stdout:1/189: dread - d1/d16/f3a zero size 2024-03-19T06:05:50.838 INFO:tasks.workunit.client.0.smithi072.stdout:6/216: readlink d7/d9/le 0 2024-03-19T06:05:50.845 INFO:tasks.workunit.client.0.smithi072.stdout:6/217: stat d7/f3c 0 2024-03-19T06:05:50.849 INFO:tasks.workunit.client.0.smithi072.stdout:1/190: chown d1/d11/d18/d19/d1a/c20 2 1 2024-03-19T06:05:50.849 INFO:tasks.workunit.client.0.smithi072.stdout:9/139: dwrite d11/f1b [0,4194304] 0 2024-03-19T06:05:50.855 INFO:tasks.workunit.client.0.smithi072.stdout:3/279: dread d2/d3/f10 [4194304,4194304] 0 2024-03-19T06:05:50.858 INFO:tasks.workunit.client.0.smithi072.stdout:8/160: dwrite da/f2e [0,4194304] 0 2024-03-19T06:05:50.860 INFO:tasks.workunit.client.0.smithi072.stdout:2/131: creat db/d10/f2e x:0 0 0 2024-03-19T06:05:50.862 INFO:tasks.workunit.client.0.smithi072.stdout:9/140: mknod d11/d1f/c31 0 2024-03-19T06:05:50.865 INFO:tasks.workunit.client.0.smithi072.stdout:1/191: read - d1/d11/f39 zero size 2024-03-19T06:05:50.866 INFO:tasks.workunit.client.0.smithi072.stdout:0/214: dread d1/d1c/f23 [0,4194304] 0 2024-03-19T06:05:50.868 INFO:tasks.workunit.client.0.smithi072.stdout:8/161: rmdir da/d13/d14 39 2024-03-19T06:05:50.870 INFO:tasks.workunit.client.0.smithi072.stdout:9/141: dread - d11/d26/f2c zero size 2024-03-19T06:05:50.877 INFO:tasks.workunit.client.0.smithi072.stdout:3/280: stat d2/d3/d25/c49 0 2024-03-19T06:05:50.877 INFO:tasks.workunit.client.0.smithi072.stdout:7/197: dwrite d2/d3/d18/d2f/f23 [4194304,4194304] 0 2024-03-19T06:05:50.877 INFO:tasks.workunit.client.0.smithi072.stdout:2/132: getdents db/d10/d13/d24 0 2024-03-19T06:05:50.877 INFO:tasks.workunit.client.0.smithi072.stdout:0/215: dread - d1/f3d zero size 2024-03-19T06:05:50.885 INFO:tasks.workunit.client.0.smithi072.stdout:1/192: mkdir d1/d11/d18/d19/d1a/d25/d3c 0 2024-03-19T06:05:50.888 INFO:tasks.workunit.client.0.smithi072.stdout:7/198: dread - d2/d3/d18/d33/f3c zero size 2024-03-19T06:05:50.888 INFO:tasks.workunit.client.0.smithi072.stdout:8/162: creat da/f34 x:0 0 0 2024-03-19T06:05:50.890 INFO:tasks.workunit.client.0.smithi072.stdout:9/142: rename d11/d24/c29 to d11/d24/c32 0 2024-03-19T06:05:50.892 INFO:tasks.workunit.client.0.smithi072.stdout:4/250: dwrite d5/d15/d22/f44 [0,4194304] 0 2024-03-19T06:05:50.893 INFO:tasks.workunit.client.0.smithi072.stdout:2/133: creat db/f2f x:0 0 0 2024-03-19T06:05:50.900 INFO:tasks.workunit.client.0.smithi072.stdout:8/163: fdatasync f4 0 2024-03-19T06:05:50.904 INFO:tasks.workunit.client.0.smithi072.stdout:2/134: creat db/f30 x:0 0 0 2024-03-19T06:05:50.904 INFO:tasks.workunit.client.0.smithi072.stdout:4/251: write d5/d1b/f1d [2841085,114087] 0 2024-03-19T06:05:50.904 INFO:tasks.workunit.client.0.smithi072.stdout:3/281: write d2/d3/f10 [5038784,118823] 0 2024-03-19T06:05:50.904 INFO:tasks.workunit.client.0.smithi072.stdout:1/193: unlink d1/d16/f1e 0 2024-03-19T06:05:50.908 INFO:tasks.workunit.client.0.smithi072.stdout:5/376: dwrite df/d13/d32/f3a [0,4194304] 0 2024-03-19T06:05:50.908 INFO:tasks.workunit.client.0.smithi072.stdout:7/199: dread - d2/d3/d18/d33/d1d/d2b/d3d/d26/f3e zero size 2024-03-19T06:05:50.910 INFO:tasks.workunit.client.0.smithi072.stdout:2/135: dread - db/f1e zero size 2024-03-19T06:05:50.911 INFO:tasks.workunit.client.0.smithi072.stdout:0/216: dread d1/fb [0,4194304] 0 2024-03-19T06:05:50.912 INFO:tasks.workunit.client.0.smithi072.stdout:4/252: fsync d5/d15/d50/f5b 0 2024-03-19T06:05:50.914 INFO:tasks.workunit.client.0.smithi072.stdout:2/136: chown db/f2f 354 1 2024-03-19T06:05:50.914 INFO:tasks.workunit.client.0.smithi072.stdout:7/200: readlink d2/d3/d18/l1c 0 2024-03-19T06:05:50.923 INFO:tasks.workunit.client.0.smithi072.stdout:2/137: write db/d10/f2e [860266,121449] 0 2024-03-19T06:05:50.923 INFO:tasks.workunit.client.0.smithi072.stdout:3/282: mkdir d2/d3/d15/d50 0 2024-03-19T06:05:50.926 INFO:tasks.workunit.client.0.smithi072.stdout:2/138: fsync db/d10/d13/f26 0 2024-03-19T06:05:50.927 INFO:tasks.workunit.client.0.smithi072.stdout:0/217: readlink d1/lc 0 2024-03-19T06:05:50.929 INFO:tasks.workunit.client.0.smithi072.stdout:1/194: mknod d1/d11/d18/d19/d1a/d3b/c3d 0 2024-03-19T06:05:50.931 INFO:tasks.workunit.client.0.smithi072.stdout:2/139: readlink l3 0 2024-03-19T06:05:50.931 INFO:tasks.workunit.client.0.smithi072.stdout:4/253: truncate d5/d1b/f2b 927172 0 2024-03-19T06:05:50.939 INFO:tasks.workunit.client.0.smithi072.stdout:1/195: write d1/f6 [291122,2747] 0 2024-03-19T06:05:50.942 INFO:tasks.workunit.client.0.smithi072.stdout:8/164: dwrite da/fc [0,4194304] 0 2024-03-19T06:05:50.945 INFO:tasks.workunit.client.0.smithi072.stdout:0/218: dread d1/d1c/d24/f32 [0,4194304] 0 2024-03-19T06:05:50.947 INFO:tasks.workunit.client.0.smithi072.stdout:4/254: unlink d5/d32/l4d 0 2024-03-19T06:05:50.951 INFO:tasks.workunit.client.0.smithi072.stdout:9/143: dread d11/f12 [0,4194304] 0 2024-03-19T06:05:50.956 INFO:tasks.workunit.client.0.smithi072.stdout:8/165: chown da/d13/d14 3462400 1 2024-03-19T06:05:50.959 INFO:tasks.workunit.client.0.smithi072.stdout:8/166: readlink da/l29 0 2024-03-19T06:05:50.959 INFO:tasks.workunit.client.0.smithi072.stdout:1/196: rmdir d1/d11/d18 39 2024-03-19T06:05:50.962 INFO:tasks.workunit.client.0.smithi072.stdout:0/219: rename d1/d1c/f31 to d1/d1c/f43 0 2024-03-19T06:05:50.963 INFO:tasks.workunit.client.0.smithi072.stdout:3/283: truncate d2/d3/d25/f42 1907430 0 2024-03-19T06:05:50.963 INFO:tasks.workunit.client.0.smithi072.stdout:2/140: dread db/d10/f2e [0,4194304] 0 2024-03-19T06:05:50.964 INFO:tasks.workunit.client.0.smithi072.stdout:9/144: symlink d11/d26/l33 0 2024-03-19T06:05:50.969 INFO:tasks.workunit.client.0.smithi072.stdout:7/201: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f39 [0,4194304] 0 2024-03-19T06:05:50.970 INFO:tasks.workunit.client.0.smithi072.stdout:1/197: unlink d1/d11/f29 0 2024-03-19T06:05:50.971 INFO:tasks.workunit.client.0.smithi072.stdout:2/141: stat db/d10/d2b 0 2024-03-19T06:05:50.975 INFO:tasks.workunit.client.0.smithi072.stdout:2/142: write db/f29 [3508164,67430] 0 2024-03-19T06:05:50.978 INFO:tasks.workunit.client.0.smithi072.stdout:0/220: symlink d1/d1c/d24/l44 0 2024-03-19T06:05:50.983 INFO:tasks.workunit.client.0.smithi072.stdout:7/202: unlink d2/f4 0 2024-03-19T06:05:50.983 INFO:tasks.workunit.client.0.smithi072.stdout:2/143: mkdir db/d10/d13/d31 0 2024-03-19T06:05:50.985 INFO:tasks.workunit.client.0.smithi072.stdout:9/145: mknod d11/d1f/d2a/c34 0 2024-03-19T06:05:50.986 INFO:tasks.workunit.client.0.smithi072.stdout:0/221: creat d1/d1c/f45 x:0 0 0 2024-03-19T06:05:50.988 INFO:tasks.workunit.client.0.smithi072.stdout:9/146: readlink lf 0 2024-03-19T06:05:50.991 INFO:tasks.workunit.client.0.smithi072.stdout:5/377: dread df/d16/f41 [0,4194304] 0 2024-03-19T06:05:50.991 INFO:tasks.workunit.client.0.smithi072.stdout:7/203: readlink d2/d3/d18/d2f/l37 0 2024-03-19T06:05:50.993 INFO:tasks.workunit.client.0.smithi072.stdout:8/167: dread da/fc [0,4194304] 0 2024-03-19T06:05:50.993 INFO:tasks.workunit.client.0.smithi072.stdout:5/378: read - df/d3c/f68 zero size 2024-03-19T06:05:50.994 INFO:tasks.workunit.client.0.smithi072.stdout:2/144: unlink c6 0 2024-03-19T06:05:50.996 INFO:tasks.workunit.client.0.smithi072.stdout:1/198: creat d1/d11/d18/d19/d1a/d25/d3c/f3e x:0 0 0 2024-03-19T06:05:50.997 INFO:tasks.workunit.client.0.smithi072.stdout:3/284: getdents d2/d19 0 2024-03-19T06:05:50.997 INFO:tasks.workunit.client.0.smithi072.stdout:1/199: fdatasync d1/f27 0 2024-03-19T06:05:50.998 INFO:tasks.workunit.client.0.smithi072.stdout:8/168: write f8 [3743398,73005] 0 2024-03-19T06:05:51.001 INFO:tasks.workunit.client.0.smithi072.stdout:9/147: rename l2 to d11/l35 0 2024-03-19T06:05:51.002 INFO:tasks.workunit.client.0.smithi072.stdout:0/222: dread d1/fb [0,4194304] 0 2024-03-19T06:05:51.004 INFO:tasks.workunit.client.0.smithi072.stdout:0/223: dread - d1/d2c/f41 zero size 2024-03-19T06:05:51.005 INFO:tasks.workunit.client.0.smithi072.stdout:1/200: symlink d1/d16/l3f 0 2024-03-19T06:05:51.006 INFO:tasks.workunit.client.0.smithi072.stdout:8/169: creat da/d13/d14/f35 x:0 0 0 2024-03-19T06:05:51.007 INFO:tasks.workunit.client.0.smithi072.stdout:9/148: write d11/f19 [4062759,63364] 0 2024-03-19T06:05:51.010 INFO:tasks.workunit.client.0.smithi072.stdout:9/149: truncate d11/f25 768793 0 2024-03-19T06:05:51.012 INFO:tasks.workunit.client.0.smithi072.stdout:7/204: rename d2/d3/d18/d33/d1d/d2b/d3d/d26/f3e to d2/d3/d18/d33/d1d/f40 0 2024-03-19T06:05:51.016 INFO:tasks.workunit.client.0.smithi072.stdout:7/205: readlink d2/d3/d18/d2f/l37 0 2024-03-19T06:05:51.016 INFO:tasks.workunit.client.0.smithi072.stdout:4/255: dread d5/ff [0,4194304] 0 2024-03-19T06:05:51.016 INFO:tasks.workunit.client.0.smithi072.stdout:1/201: write d1/d11/d18/f2e [454796,95065] 0 2024-03-19T06:05:51.017 INFO:tasks.workunit.client.0.smithi072.stdout:0/224: symlink d1/d1c/d24/d3e/l46 0 2024-03-19T06:05:51.018 INFO:tasks.workunit.client.0.smithi072.stdout:3/285: rmdir d2/d19/d1e/d43 0 2024-03-19T06:05:51.020 INFO:tasks.workunit.client.0.smithi072.stdout:9/150: mkdir d11/d1f/d2a/d36 0 2024-03-19T06:05:51.023 INFO:tasks.workunit.client.0.smithi072.stdout:3/286: readlink d2/d19/d1e/l38 0 2024-03-19T06:05:51.025 INFO:tasks.workunit.client.0.smithi072.stdout:1/202: creat d1/d11/d18/f40 x:0 0 0 2024-03-19T06:05:51.026 INFO:tasks.workunit.client.0.smithi072.stdout:2/145: rename db/cc to db/d10/d2b/c32 0 2024-03-19T06:05:51.028 INFO:tasks.workunit.client.0.smithi072.stdout:7/206: symlink d2/l41 0 2024-03-19T06:05:51.028 INFO:tasks.workunit.client.0.smithi072.stdout:0/225: getdents d1/d1c/d24/d3f 0 2024-03-19T06:05:51.034 INFO:tasks.workunit.client.0.smithi072.stdout:9/151: creat d11/f37 x:0 0 0 2024-03-19T06:05:51.035 INFO:tasks.workunit.client.0.smithi072.stdout:2/146: rename db/d10/d2b to db/d10/d2b/d2d/d33 22 2024-03-19T06:05:51.038 INFO:tasks.workunit.client.0.smithi072.stdout:8/170: dwrite f8 [4194304,4194304] 0 2024-03-19T06:05:51.039 INFO:tasks.workunit.client.0.smithi072.stdout:5/379: dread df/d14/f15 [0,4194304] 0 2024-03-19T06:05:51.047 INFO:tasks.workunit.client.0.smithi072.stdout:5/380: fdatasync df/d16/f39 0 2024-03-19T06:05:51.048 INFO:tasks.workunit.client.0.smithi072.stdout:3/287: getdents d2/d19/d1e 0 2024-03-19T06:05:51.048 INFO:tasks.workunit.client.0.smithi072.stdout:3/288: chown d2/d19 0 1 2024-03-19T06:05:51.048 INFO:tasks.workunit.client.0.smithi072.stdout:7/207: symlink d2/d3/d18/d33/d1d/d2b/d3d/l42 0 2024-03-19T06:05:51.051 INFO:tasks.workunit.client.0.smithi072.stdout:3/289: chown d2/d19/c4f 35916421 1 2024-03-19T06:05:51.052 INFO:tasks.workunit.client.0.smithi072.stdout:4/256: dwrite d5/d15/d50/f2e [0,4194304] 0 2024-03-19T06:05:51.052 INFO:tasks.workunit.client.0.smithi072.stdout:7/208: chown d2/d3/d18/d33/d1d/d2b/l34 3 1 2024-03-19T06:05:51.053 INFO:tasks.workunit.client.0.smithi072.stdout:3/290: fsync d2/d3/d26/f35 0 2024-03-19T06:05:51.053 INFO:tasks.workunit.client.0.smithi072.stdout:0/226: rename d1/d1c/d24/d27/f2e to d1/d1c/d24/d3e/f47 0 2024-03-19T06:05:51.054 INFO:tasks.workunit.client.0.smithi072.stdout:4/257: chown d5/d15/d3f/d42 70275 1 2024-03-19T06:05:51.058 INFO:tasks.workunit.client.0.smithi072.stdout:8/171: link da/fc da/f36 0 2024-03-19T06:05:51.058 INFO:tasks.workunit.client.0.smithi072.stdout:2/147: rename db/c1a to db/d10/d2b/d2d/c34 0 2024-03-19T06:05:51.059 INFO:tasks.workunit.client.0.smithi072.stdout:0/227: mknod d1/d1c/d24/c48 0 2024-03-19T06:05:51.062 INFO:tasks.workunit.client.0.smithi072.stdout:7/209: write d2/d3/d18/d33/d1d/f40 [16112,74700] 0 2024-03-19T06:05:51.062 INFO:tasks.workunit.client.0.smithi072.stdout:8/172: mkdir da/d37 0 2024-03-19T06:05:51.063 INFO:tasks.workunit.client.0.smithi072.stdout:4/258: creat d5/d15/d3f/f5e x:0 0 0 2024-03-19T06:05:51.066 INFO:tasks.workunit.client.0.smithi072.stdout:7/210: readlink d2/d3/d18/d33/d1d/d2b/d3d/l12 0 2024-03-19T06:05:51.067 INFO:tasks.workunit.client.0.smithi072.stdout:0/228: fdatasync d1/d1c/d24/f32 0 2024-03-19T06:05:51.074 INFO:tasks.workunit.client.0.smithi072.stdout:4/259: symlink d5/d37/d52/l5f 0 2024-03-19T06:05:51.075 INFO:tasks.workunit.client.0.smithi072.stdout:7/211: mkdir d2/d3/d43 0 2024-03-19T06:05:51.075 INFO:tasks.workunit.client.0.smithi072.stdout:4/260: chown d5 10227028 1 2024-03-19T06:05:51.076 INFO:tasks.workunit.client.0.smithi072.stdout:8/173: rename da/d27/c33 to da/d27/d30/c38 0 2024-03-19T06:05:51.078 INFO:tasks.workunit.client.0.smithi072.stdout:8/174: fsync da/f34 0 2024-03-19T06:05:51.081 INFO:tasks.workunit.client.0.smithi072.stdout:4/261: mknod d5/d1b/c60 0 2024-03-19T06:05:51.082 INFO:tasks.workunit.client.0.smithi072.stdout:2/148: dread db/f29 [0,4194304] 0 2024-03-19T06:05:51.082 INFO:tasks.workunit.client.0.smithi072.stdout:8/175: chown da/d13/d14 3 1 2024-03-19T06:05:51.085 INFO:tasks.workunit.client.0.smithi072.stdout:3/291: dwrite d2/d3/d15/f36 [4194304,4194304] 0 2024-03-19T06:05:51.085 INFO:tasks.workunit.client.0.smithi072.stdout:2/149: write db/f2f [133593,40156] 0 2024-03-19T06:05:51.086 INFO:tasks.workunit.client.0.smithi072.stdout:8/176: readlink da/d13/l18 0 2024-03-19T06:05:51.086 INFO:tasks.workunit.client.0.smithi072.stdout:4/262: mkdir d5/d15/d22/d41/d61 0 2024-03-19T06:05:51.089 INFO:tasks.workunit.client.0.smithi072.stdout:4/263: fdatasync d5/d15/d22/f45 0 2024-03-19T06:05:51.091 INFO:tasks.workunit.client.0.smithi072.stdout:8/177: creat da/d27/f39 x:0 0 0 2024-03-19T06:05:51.092 INFO:tasks.workunit.client.0.smithi072.stdout:4/264: fsync d5/d15/d22/f45 0 2024-03-19T06:05:51.093 INFO:tasks.workunit.client.0.smithi072.stdout:3/292: rmdir d2/d3/d15/d50 0 2024-03-19T06:05:51.094 INFO:tasks.workunit.client.0.smithi072.stdout:2/150: mkdir db/d10/d13/d31/d35 0 2024-03-19T06:05:51.095 INFO:tasks.workunit.client.0.smithi072.stdout:7/212: write d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/f35 [1842,92189] 0 2024-03-19T06:05:51.098 INFO:tasks.workunit.client.0.smithi072.stdout:4/265: creat d5/d37/f62 x:0 0 0 2024-03-19T06:05:51.098 INFO:tasks.workunit.client.0.smithi072.stdout:0/229: dwrite d1/d1c/f1d [0,4194304] 0 2024-03-19T06:05:51.100 INFO:tasks.workunit.client.0.smithi072.stdout:0/230: chown d1/d1c/d24/d3e/f47 86934 1 2024-03-19T06:05:51.102 INFO:tasks.workunit.client.0.smithi072.stdout:2/151: chown db/d10/d13/f26 1 1 2024-03-19T06:05:51.105 INFO:tasks.workunit.client.0.smithi072.stdout:5/381: dread df/d13/d32/f12 [0,4194304] 0 2024-03-19T06:05:51.106 INFO:tasks.workunit.client.0.smithi072.stdout:2/152: write db/d10/d13/f25 [927617,52296] 0 2024-03-19T06:05:51.107 INFO:tasks.workunit.client.0.smithi072.stdout:0/231: fsync d1/d1c/f43 0 2024-03-19T06:05:51.110 INFO:tasks.workunit.client.0.smithi072.stdout:0/232: stat d1/d1c/d24/d3e/c42 0 2024-03-19T06:05:51.112 INFO:tasks.workunit.client.0.smithi072.stdout:8/178: dread da/f36 [0,4194304] 0 2024-03-19T06:05:51.112 INFO:tasks.workunit.client.0.smithi072.stdout:3/293: getdents d2 0 2024-03-19T06:05:51.113 INFO:tasks.workunit.client.0.smithi072.stdout:5/382: unlink df/d16/c34 0 2024-03-19T06:05:51.114 INFO:tasks.workunit.client.0.smithi072.stdout:3/294: chown d2/d19/c1a 2039 1 2024-03-19T06:05:51.116 INFO:tasks.workunit.client.0.smithi072.stdout:3/295: dread - d2/f30 zero size 2024-03-19T06:05:51.116 INFO:tasks.workunit.client.0.smithi072.stdout:2/153: rmdir db/d10/d2b/d2d 39 2024-03-19T06:05:51.124 INFO:tasks.workunit.client.0.smithi072.stdout:3/296: unlink d2/d19/l21 0 2024-03-19T06:05:51.127 INFO:tasks.workunit.client.0.smithi072.stdout:4/266: truncate d5/fa 173681 0 2024-03-19T06:05:51.129 INFO:tasks.workunit.client.0.smithi072.stdout:0/233: dread d1/f3c [0,4194304] 0 2024-03-19T06:05:51.129 INFO:tasks.workunit.client.0.smithi072.stdout:8/179: getdents da/d13/d14/d1b 0 2024-03-19T06:05:51.129 INFO:tasks.workunit.client.0.smithi072.stdout:5/383: write df/d14/f2f [453840,44240] 0 2024-03-19T06:05:51.130 INFO:tasks.workunit.client.0.smithi072.stdout:3/297: mknod d2/d3/c51 0 2024-03-19T06:05:51.132 INFO:tasks.workunit.client.0.smithi072.stdout:8/180: read f8 [2205461,111342] 0 2024-03-19T06:05:51.133 INFO:tasks.workunit.client.0.smithi072.stdout:4/267: symlink d5/d15/d50/l63 0 2024-03-19T06:05:51.134 INFO:tasks.workunit.client.0.smithi072.stdout:3/298: stat d2/d3/d15 0 2024-03-19T06:05:51.136 INFO:tasks.workunit.client.0.smithi072.stdout:5/384: mkdir df/d13/d24/d70 0 2024-03-19T06:05:51.137 INFO:tasks.workunit.client.0.smithi072.stdout:4/268: fsync d5/d15/d22/f45 0 2024-03-19T06:05:51.137 INFO:tasks.workunit.client.0.smithi072.stdout:8/181: fdatasync da/d13/f1e 0 2024-03-19T06:05:51.140 INFO:tasks.workunit.client.0.smithi072.stdout:3/299: creat d2/d19/f52 x:0 0 0 2024-03-19T06:05:51.142 INFO:tasks.workunit.client.0.smithi072.stdout:2/154: dwrite db/d10/f27 [0,4194304] 0 2024-03-19T06:05:51.143 INFO:tasks.workunit.client.0.smithi072.stdout:8/182: unlink da/f2e 0 2024-03-19T06:05:51.153 INFO:tasks.workunit.client.0.smithi072.stdout:5/385: creat df/d13/d32/d28/d42/d59/d43/d62/f71 x:0 0 0 2024-03-19T06:05:51.157 INFO:tasks.workunit.client.0.smithi072.stdout:2/155: symlink db/d10/d13/d24/l36 0 2024-03-19T06:05:51.159 INFO:tasks.workunit.client.0.smithi072.stdout:4/269: getdents d5/d15/d31 0 2024-03-19T06:05:51.159 INFO:tasks.workunit.client.0.smithi072.stdout:5/386: symlink df/d13/d24/l72 0 2024-03-19T06:05:51.159 INFO:tasks.workunit.client.0.smithi072.stdout:2/156: chown ca 47091984 1 2024-03-19T06:05:51.160 INFO:tasks.workunit.client.0.smithi072.stdout:3/300: getdents d2/d3 0 2024-03-19T06:05:51.160 INFO:tasks.workunit.client.0.smithi072.stdout:4/270: chown d5/d1b 304791 1 2024-03-19T06:05:51.163 INFO:tasks.workunit.client.0.smithi072.stdout:4/271: chown d5/d32/d58 79039748 1 2024-03-19T06:05:51.164 INFO:tasks.workunit.client.0.smithi072.stdout:5/387: creat df/d16/d61/f73 x:0 0 0 2024-03-19T06:05:51.165 INFO:tasks.workunit.client.0.smithi072.stdout:3/301: creat d2/d19/f53 x:0 0 0 2024-03-19T06:05:51.166 INFO:tasks.workunit.client.0.smithi072.stdout:3/302: dread - d2/d19/f53 zero size 2024-03-19T06:05:51.167 INFO:tasks.workunit.client.0.smithi072.stdout:4/272: symlink d5/d37/l64 0 2024-03-19T06:05:51.169 INFO:tasks.workunit.client.0.smithi072.stdout:3/303: dread - d2/f30 zero size 2024-03-19T06:05:51.170 INFO:tasks.workunit.client.0.smithi072.stdout:8/183: dwrite da/d13/d14/f17 [0,4194304] 0 2024-03-19T06:05:51.173 INFO:tasks.workunit.client.0.smithi072.stdout:2/157: link db/d10/d2b/d2d/c34 db/d10/d2b/d2d/c37 0 2024-03-19T06:05:51.174 INFO:tasks.workunit.client.0.smithi072.stdout:3/304: symlink d2/d3/d15/l54 0 2024-03-19T06:05:51.175 INFO:tasks.workunit.client.0.smithi072.stdout:8/184: mknod da/d27/c3a 0 2024-03-19T06:05:51.176 INFO:tasks.workunit.client.0.smithi072.stdout:3/305: chown d2/d19 13365 1 2024-03-19T06:05:51.180 INFO:tasks.workunit.client.0.smithi072.stdout:2/158: rename db/d10/f16 to db/f38 0 2024-03-19T06:05:51.180 INFO:tasks.workunit.client.0.smithi072.stdout:5/388: link df/d14/l2e df/d13/d32/d28/d42/d59/d43/d4e/l74 0 2024-03-19T06:05:51.184 INFO:tasks.workunit.client.0.smithi072.stdout:2/159: creat db/d10/d12/f39 x:0 0 0 2024-03-19T06:05:51.185 INFO:tasks.workunit.client.0.smithi072.stdout:2/160: readlink db/l17 0 2024-03-19T06:05:51.187 INFO:tasks.workunit.client.0.smithi072.stdout:5/389: rename fe to df/d13/d32/d28/d42/d59/d43/f75 0 2024-03-19T06:05:51.189 INFO:tasks.workunit.client.0.smithi072.stdout:2/161: creat db/d10/d13/d31/f3a x:0 0 0 2024-03-19T06:05:51.191 INFO:tasks.workunit.client.0.smithi072.stdout:4/273: dread d5/f9 [0,4194304] 0 2024-03-19T06:05:51.192 INFO:tasks.workunit.client.0.smithi072.stdout:5/390: symlink df/d13/d32/d28/d42/d59/d43/d4e/l76 0 2024-03-19T06:05:51.198 INFO:tasks.workunit.client.0.smithi072.stdout:8/185: truncate da/f36 2124575 0 2024-03-19T06:05:51.199 INFO:tasks.workunit.client.0.smithi072.stdout:5/391: rmdir df/d13/d24 39 2024-03-19T06:05:51.199 INFO:tasks.workunit.client.0.smithi072.stdout:4/274: rename d5/c30 to d5/d11/c65 0 2024-03-19T06:05:51.201 INFO:tasks.workunit.client.0.smithi072.stdout:3/306: dwrite d2/d3/d26/f23 [8388608,4194304] 0 2024-03-19T06:05:51.204 INFO:tasks.workunit.client.0.smithi072.stdout:5/392: unlink df/d14/l40 0 2024-03-19T06:05:51.205 INFO:tasks.workunit.client.0.smithi072.stdout:3/307: write d2/f30 [745820,85225] 0 2024-03-19T06:05:51.207 INFO:tasks.workunit.client.0.smithi072.stdout:8/186: write da/d13/d14/f28 [149203,105068] 0 2024-03-19T06:05:51.208 INFO:tasks.workunit.client.0.smithi072.stdout:3/308: chown d2/d3 14209 1 2024-03-19T06:05:51.208 INFO:tasks.workunit.client.0.smithi072.stdout:2/162: dread db/f29 [0,4194304] 0 2024-03-19T06:05:51.209 INFO:tasks.workunit.client.0.smithi072.stdout:4/275: creat d5/d15/d22/d41/d61/f66 x:0 0 0 2024-03-19T06:05:51.210 INFO:tasks.workunit.client.0.smithi072.stdout:3/309: write d2/f2f [5388348,104592] 0 2024-03-19T06:05:51.211 INFO:tasks.workunit.client.0.smithi072.stdout:4/276: dread - d5/d1b/f5a zero size 2024-03-19T06:05:51.212 INFO:tasks.workunit.client.0.smithi072.stdout:5/393: mknod df/d13/d32/d28/d42/d59/c77 0 2024-03-19T06:05:51.218 INFO:tasks.workunit.client.0.smithi072.stdout:3/310: rmdir d2/d3/d15 39 2024-03-19T06:05:51.219 INFO:tasks.workunit.client.0.smithi072.stdout:4/277: creat d5/d15/d3f/d42/f67 x:0 0 0 2024-03-19T06:05:51.221 INFO:tasks.workunit.client.0.smithi072.stdout:5/394: fsync df/d13/d24/f4f 0 2024-03-19T06:05:51.225 INFO:tasks.workunit.client.0.smithi072.stdout:4/278: symlink d5/d11/l68 0 2024-03-19T06:05:51.228 INFO:tasks.workunit.client.0.smithi072.stdout:2/163: dread db/d10/d13/f26 [0,4194304] 0 2024-03-19T06:05:51.232 INFO:tasks.workunit.client.0.smithi072.stdout:3/311: truncate d2/d3/d26/f22 1017541 0 2024-03-19T06:05:51.233 INFO:tasks.workunit.client.0.smithi072.stdout:2/164: symlink db/d10/d12/l3b 0 2024-03-19T06:05:51.237 INFO:tasks.workunit.client.0.smithi072.stdout:8/187: dwrite da/f2a [0,4194304] 0 2024-03-19T06:05:51.237 INFO:tasks.workunit.client.0.smithi072.stdout:2/165: dread - db/f1e zero size 2024-03-19T06:05:51.238 INFO:tasks.workunit.client.0.smithi072.stdout:3/312: mknod d2/d3/d26/c55 0 2024-03-19T06:05:51.242 INFO:tasks.workunit.client.0.smithi072.stdout:4/279: getdents d5/d15/d3f/d42 0 2024-03-19T06:05:51.242 INFO:tasks.workunit.client.0.smithi072.stdout:3/313: chown d2/d3/d26/l29 3 1 2024-03-19T06:05:51.244 INFO:tasks.workunit.client.0.smithi072.stdout:2/166: creat db/d10/d13/d31/f3c x:0 0 0 2024-03-19T06:05:51.245 INFO:tasks.workunit.client.0.smithi072.stdout:4/280: dread - d5/d15/d3f/d42/f67 zero size 2024-03-19T06:05:51.248 INFO:tasks.workunit.client.0.smithi072.stdout:2/167: fdatasync db/d10/d13/f25 0 2024-03-19T06:05:51.252 INFO:tasks.workunit.client.0.smithi072.stdout:5/395: dwrite df/d16/f39 [0,4194304] 0 2024-03-19T06:05:51.258 INFO:tasks.workunit.client.0.smithi072.stdout:5/396: write df/d14/d5d/f51 [571512,75568] 0 2024-03-19T06:05:51.261 INFO:tasks.workunit.client.0.smithi072.stdout:3/314: truncate d2/d19/d1e/f32 651766 0 2024-03-19T06:05:51.266 INFO:tasks.workunit.client.0.smithi072.stdout:5/397: getdents df/d13/d32/d28 0 2024-03-19T06:05:51.275 INFO:tasks.workunit.client.0.smithi072.stdout:3/315: mknod d2/d40/c56 0 2024-03-19T06:05:51.277 INFO:tasks.workunit.client.0.smithi072.stdout:2/168: dread db/f38 [0,4194304] 0 2024-03-19T06:05:51.284 INFO:tasks.workunit.client.0.smithi072.stdout:4/281: dwrite d5/d1b/f33 [0,4194304] 0 2024-03-19T06:05:51.285 INFO:tasks.workunit.client.0.smithi072.stdout:5/398: dread df/d14/d5d/f51 [0,4194304] 0 2024-03-19T06:05:51.286 INFO:tasks.workunit.client.0.smithi072.stdout:8/188: dread da/f11 [0,4194304] 0 2024-03-19T06:05:51.288 INFO:tasks.workunit.client.0.smithi072.stdout:2/169: truncate db/d10/d13/d31/f3c 531850 0 2024-03-19T06:05:51.291 INFO:tasks.workunit.client.0.smithi072.stdout:8/189: mkdir da/d3b 0 2024-03-19T06:05:51.295 INFO:tasks.workunit.client.0.smithi072.stdout:2/170: creat db/d10/d13/d24/f3d x:0 0 0 2024-03-19T06:05:51.298 INFO:tasks.workunit.client.0.smithi072.stdout:2/171: mknod db/d10/d2b/d2d/c3e 0 2024-03-19T06:05:51.299 INFO:tasks.workunit.client.0.smithi072.stdout:3/316: dread f1 [0,4194304] 0 2024-03-19T06:05:51.300 INFO:tasks.workunit.client.0.smithi072.stdout:8/190: mkdir da/d13/d1d/d3c 0 2024-03-19T06:05:51.305 INFO:tasks.workunit.client.0.smithi072.stdout:8/191: creat da/d27/d30/f3d x:0 0 0 2024-03-19T06:05:51.308 INFO:tasks.workunit.client.0.smithi072.stdout:3/317: rename d2/l37 to d2/d19/d1e/l57 0 2024-03-19T06:05:51.309 INFO:tasks.workunit.client.0.smithi072.stdout:5/399: write df/d13/d32/d28/f44 [1570373,12112] 0 2024-03-19T06:05:51.311 INFO:tasks.workunit.client.0.smithi072.stdout:4/282: truncate d5/d1b/f33 763462 0 2024-03-19T06:05:51.313 INFO:tasks.workunit.client.0.smithi072.stdout:4/283: dread - d5/d1b/f5a zero size 2024-03-19T06:05:51.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:51 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:51.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:51 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:51.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:51 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:05:51.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:51 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:05:51.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:51 smithi072 ceph-mon[28706]: Updating smithi072:/etc/ceph/ceph.conf 2024-03-19T06:05:51.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:51 smithi072 ceph-mon[28706]: Updating smithi172:/etc/ceph/ceph.conf 2024-03-19T06:05:51.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:51 smithi072 ceph-mon[28706]: pgmap v22: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 73 MiB/s rd, 178 MiB/s wr, 411 op/s 2024-03-19T06:05:51.357 INFO:tasks.workunit.client.0.smithi072.stdout:5/400: truncate df/d13/f3e 964078 0 2024-03-19T06:05:51.359 INFO:tasks.workunit.client.0.smithi072.stdout:8/192: getdents da/d13/d1d 0 2024-03-19T06:05:51.363 INFO:tasks.workunit.client.0.smithi072.stdout:2/172: dwrite db/d10/d13/d31/f3c [0,4194304] 0 2024-03-19T06:05:51.367 INFO:tasks.workunit.client.0.smithi072.stdout:4/284: dread d5/d1b/f2b [0,4194304] 0 2024-03-19T06:05:51.370 INFO:tasks.workunit.client.0.smithi072.stdout:2/173: unlink db/d10/d13/f1c 0 2024-03-19T06:05:51.372 INFO:tasks.workunit.client.0.smithi072.stdout:5/401: rename df/d13/d32/f30 to df/d13/d32/d28/d42/f78 0 2024-03-19T06:05:51.373 INFO:tasks.workunit.client.0.smithi072.stdout:2/174: chown db/d10/d12/f39 95 1 2024-03-19T06:05:51.379 INFO:tasks.workunit.client.0.smithi072.stdout:8/193: getdents da/d13/d14 0 2024-03-19T06:05:51.380 INFO:tasks.workunit.client.0.smithi072.stdout:3/318: dwrite d2/d3/d25/f42 [0,4194304] 0 2024-03-19T06:05:51.380 INFO:tasks.workunit.client.0.smithi072.stdout:2/175: mkdir db/d10/d2b/d2d/d3f 0 2024-03-19T06:05:51.382 INFO:tasks.workunit.client.0.smithi072.stdout:5/402: creat df/d13/d32/d28/d42/f79 x:0 0 0 2024-03-19T06:05:51.386 INFO:tasks.workunit.client.0.smithi072.stdout:2/176: truncate db/d10/d13/f26 1237640 0 2024-03-19T06:05:51.390 INFO:tasks.workunit.client.0.smithi072.stdout:4/285: dread d5/d15/d50/f2e [0,4194304] 0 2024-03-19T06:05:51.391 INFO:tasks.workunit.client.0.smithi072.stdout:5/403: truncate df/d13/d32/d28/d42/f79 782556 0 2024-03-19T06:05:51.391 INFO:tasks.workunit.client.0.smithi072.stdout:8/194: truncate da/d13/d14/f35 204746 0 2024-03-19T06:05:51.395 INFO:tasks.workunit.client.0.smithi072.stdout:3/319: link d2/d3/d26/f22 d2/d3/d26/f58 0 2024-03-19T06:05:51.397 INFO:tasks.workunit.client.0.smithi072.stdout:8/195: write da/d13/d1d/f2b [8192646,82698] 0 2024-03-19T06:05:51.398 INFO:tasks.workunit.client.0.smithi072.stdout:3/320: creat d2/d3/d26/f59 x:0 0 0 2024-03-19T06:05:51.399 INFO:tasks.workunit.client.0.smithi072.stdout:8/196: write f8 [1353974,5749] 0 2024-03-19T06:05:51.401 INFO:tasks.workunit.client.0.smithi072.stdout:2/177: rename db/d10/d2b/d2d/c34 to db/c40 0 2024-03-19T06:05:51.402 INFO:tasks.workunit.client.0.smithi072.stdout:3/321: mknod d2/d3/d26/c5a 0 2024-03-19T06:05:51.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:51 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:51.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:51 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:51.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:51 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:05:51.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:51 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:05:51.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:51 smithi172 ceph-mon[35716]: Updating smithi072:/etc/ceph/ceph.conf 2024-03-19T06:05:51.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:51 smithi172 ceph-mon[35716]: Updating smithi172:/etc/ceph/ceph.conf 2024-03-19T06:05:51.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:51 smithi172 ceph-mon[35716]: pgmap v22: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 73 MiB/s rd, 178 MiB/s wr, 411 op/s 2024-03-19T06:05:51.404 INFO:tasks.workunit.client.0.smithi072.stdout:8/197: mkdir da/d13/d1d/d3c/d3e 0 2024-03-19T06:05:51.406 INFO:tasks.workunit.client.0.smithi072.stdout:4/286: rename d5/f9 to d5/d37/f69 0 2024-03-19T06:05:51.406 INFO:tasks.workunit.client.0.smithi072.stdout:3/322: chown d2/d3/d26/f59 3346 1 2024-03-19T06:05:51.408 INFO:tasks.workunit.client.0.smithi072.stdout:4/287: fsync d5/d11/f1a 0 2024-03-19T06:05:51.409 INFO:tasks.workunit.client.0.smithi072.stdout:2/178: rename db/d10/d2b/c2c to db/d10/d13/d31/c41 0 2024-03-19T06:05:51.411 INFO:tasks.workunit.client.0.smithi072.stdout:5/404: link df/d13/d32/d28/d42/f78 df/d13/d32/d28/d42/f7a 0 2024-03-19T06:05:51.411 INFO:tasks.workunit.client.0.smithi072.stdout:3/323: fdatasync d2/d3/f10 0 2024-03-19T06:05:51.412 INFO:tasks.workunit.client.0.smithi072.stdout:8/198: mkdir da/d13/d3f 0 2024-03-19T06:05:51.413 INFO:tasks.workunit.client.0.smithi072.stdout:4/288: rename d5/d15/d22/l51 to d5/d15/d3f/l6a 0 2024-03-19T06:05:51.415 INFO:tasks.workunit.client.0.smithi072.stdout:2/179: link db/f22 db/d10/d2b/d2d/d3f/f42 0 2024-03-19T06:05:51.416 INFO:tasks.workunit.client.0.smithi072.stdout:5/405: truncate df/d16/f36 952333 0 2024-03-19T06:05:51.416 INFO:tasks.workunit.client.0.smithi072.stdout:2/180: readlink db/l28 0 2024-03-19T06:05:51.418 INFO:tasks.workunit.client.0.smithi072.stdout:4/289: rename d5/d15/d22/f27 to d5/d15/d3f/f6b 0 2024-03-19T06:05:51.418 INFO:tasks.workunit.client.0.smithi072.stdout:8/199: link da/l15 da/d37/l40 0 2024-03-19T06:05:51.419 INFO:tasks.workunit.client.0.smithi072.stdout:5/406: chown df/d13/d24/c50 659 1 2024-03-19T06:05:51.419 INFO:tasks.workunit.client.0.smithi072.stdout:4/290: stat d5/d37 0 2024-03-19T06:05:51.422 INFO:tasks.workunit.client.0.smithi072.stdout:5/407: write df/d16/d61/f66 [404055,79789] 0 2024-03-19T06:05:51.423 INFO:tasks.workunit.client.0.smithi072.stdout:2/181: link db/d10/d13/f25 db/d10/d13/d31/d35/f43 0 2024-03-19T06:05:51.424 INFO:tasks.workunit.client.0.smithi072.stdout:4/291: creat d5/d15/d53/f6c x:0 0 0 2024-03-19T06:05:51.428 INFO:tasks.workunit.client.0.smithi072.stdout:2/182: mkdir db/d10/d44 0 2024-03-19T06:05:51.430 INFO:tasks.workunit.client.0.smithi072.stdout:2/183: readlink db/d10/d12/l3b 0 2024-03-19T06:05:51.430 INFO:tasks.workunit.client.0.smithi072.stdout:5/408: symlink df/d13/d32/d28/d42/d59/d43/d4e/l7b 0 2024-03-19T06:05:51.430 INFO:tasks.workunit.client.0.smithi072.stdout:5/409: readlink lc 0 2024-03-19T06:05:51.433 INFO:tasks.workunit.client.0.smithi072.stdout:2/184: chown db/d10/d13/l15 77 1 2024-03-19T06:05:51.434 INFO:tasks.workunit.client.0.smithi072.stdout:2/185: fdatasync db/d10/f18 0 2024-03-19T06:05:51.435 INFO:tasks.workunit.client.0.smithi072.stdout:8/200: rmdir da/d13 39 2024-03-19T06:05:51.436 INFO:tasks.workunit.client.0.smithi072.stdout:5/410: dread df/d14/d5d/f51 [0,4194304] 0 2024-03-19T06:05:51.438 INFO:tasks.workunit.client.0.smithi072.stdout:2/186: fdatasync db/d10/f1d 0 2024-03-19T06:05:51.438 INFO:tasks.workunit.client.0.smithi072.stdout:5/411: readlink df/d54/l6c 0 2024-03-19T06:05:51.441 INFO:tasks.workunit.client.0.smithi072.stdout:5/412: chown df/d16/f60 2803 1 2024-03-19T06:05:51.441 INFO:tasks.workunit.client.0.smithi072.stdout:2/187: fsync db/d10/d13/d31/f3c 0 2024-03-19T06:05:51.443 INFO:tasks.workunit.client.0.smithi072.stdout:8/201: mkdir da/d27/d41 0 2024-03-19T06:05:51.444 INFO:tasks.workunit.client.0.smithi072.stdout:8/202: fsync f4 0 2024-03-19T06:05:51.449 INFO:tasks.workunit.client.0.smithi072.stdout:5/413: creat df/d13/d32/d28/d42/d59/d43/d4e/d5c/f7c x:0 0 0 2024-03-19T06:05:51.459 INFO:tasks.workunit.client.0.smithi072.stdout:2/188: dread db/f38 [0,4194304] 0 2024-03-19T06:05:51.462 INFO:tasks.workunit.client.0.smithi072.stdout:4/292: dread d5/f10 [0,4194304] 0 2024-03-19T06:05:51.466 INFO:tasks.workunit.client.0.smithi072.stdout:2/189: mkdir db/d10/d2b/d45 0 2024-03-19T06:05:51.471 INFO:tasks.workunit.client.0.smithi072.stdout:2/190: fsync db/d10/f18 0 2024-03-19T06:05:51.472 INFO:tasks.workunit.client.0.smithi072.stdout:8/203: dwrite da/f34 [0,4194304] 0 2024-03-19T06:05:51.473 INFO:tasks.workunit.client.0.smithi072.stdout:4/293: getdents d5/d15/d53 0 2024-03-19T06:05:51.475 INFO:tasks.workunit.client.0.smithi072.stdout:8/204: read da/f34 [511493,121719] 0 2024-03-19T06:05:51.475 INFO:tasks.workunit.client.0.smithi072.stdout:5/414: dwrite df/d13/d32/d28/d42/f6a [0,4194304] 0 2024-03-19T06:05:51.480 INFO:tasks.workunit.client.0.smithi072.stdout:4/294: mkdir d5/d15/d31/d6d 0 2024-03-19T06:05:51.487 INFO:tasks.workunit.client.0.smithi072.stdout:8/205: readlink da/d37/l40 0 2024-03-19T06:05:51.487 INFO:tasks.workunit.client.0.smithi072.stdout:5/415: chown df/d13/d32/d28/d42/d59/d43/d4e/d5c/f5f 10826 1 2024-03-19T06:05:51.488 INFO:tasks.workunit.client.0.smithi072.stdout:5/416: stat df/f17 0 2024-03-19T06:05:51.491 INFO:tasks.workunit.client.0.smithi072.stdout:2/191: getdents db/d10/d2b/d2d/d3f 0 2024-03-19T06:05:51.492 INFO:tasks.workunit.client.0.smithi072.stdout:2/192: fsync db/f1e 0 2024-03-19T06:05:51.493 INFO:tasks.workunit.client.0.smithi072.stdout:4/295: link d5/d1b/f2b d5/d15/d31/d4c/f6e 0 2024-03-19T06:05:51.497 INFO:tasks.workunit.client.0.smithi072.stdout:8/206: symlink da/d27/d41/l42 0 2024-03-19T06:05:51.498 INFO:tasks.workunit.client.0.smithi072.stdout:2/193: dread - db/f30 zero size 2024-03-19T06:05:51.498 INFO:tasks.workunit.client.0.smithi072.stdout:5/417: truncate df/d13/f49 746829 0 2024-03-19T06:05:51.498 INFO:tasks.workunit.client.0.smithi072.stdout:4/296: mkdir d5/d15/d31/d6f 0 2024-03-19T06:05:51.498 INFO:tasks.workunit.client.0.smithi072.stdout:8/207: dread - da/d27/f39 zero size 2024-03-19T06:05:51.501 INFO:tasks.workunit.client.0.smithi072.stdout:4/297: creat d5/d15/d22/d41/d61/f70 x:0 0 0 2024-03-19T06:05:51.502 INFO:tasks.workunit.client.0.smithi072.stdout:8/208: creat da/d27/f43 x:0 0 0 2024-03-19T06:05:51.503 INFO:tasks.workunit.client.0.smithi072.stdout:2/194: rename db/f29 to db/d10/d2b/d2d/f46 0 2024-03-19T06:05:51.504 INFO:tasks.workunit.client.0.smithi072.stdout:5/418: symlink df/d13/d32/d28/d42/d59/d43/d62/l7d 0 2024-03-19T06:05:51.504 INFO:tasks.workunit.client.0.smithi072.stdout:8/209: dread - da/d27/f43 zero size 2024-03-19T06:05:51.505 INFO:tasks.workunit.client.0.smithi072.stdout:2/195: readlink db/d10/d13/d24/l36 0 2024-03-19T06:05:51.505 INFO:tasks.workunit.client.0.smithi072.stdout:8/210: chown f9 652 1 2024-03-19T06:05:51.506 INFO:tasks.workunit.client.0.smithi072.stdout:4/298: mkdir d5/d15/d22/d41/d61/d71 0 2024-03-19T06:05:51.509 INFO:tasks.workunit.client.0.smithi072.stdout:2/196: write db/d10/f1d [2657037,12396] 0 2024-03-19T06:05:51.509 INFO:tasks.workunit.client.0.smithi072.stdout:4/299: fdatasync d5/d15/d50/f2f 0 2024-03-19T06:05:51.514 INFO:tasks.workunit.client.0.smithi072.stdout:8/211: creat da/d13/d14/d1b/f44 x:0 0 0 2024-03-19T06:05:51.516 INFO:tasks.workunit.client.0.smithi072.stdout:2/197: symlink db/d10/l47 0 2024-03-19T06:05:51.518 INFO:tasks.workunit.client.0.smithi072.stdout:4/300: mkdir d5/d15/d22/d41/d61/d71/d72 0 2024-03-19T06:05:51.518 INFO:tasks.workunit.client.0.smithi072.stdout:2/198: fdatasync db/d10/d13/d31/f3a 0 2024-03-19T06:05:51.520 INFO:tasks.workunit.client.0.smithi072.stdout:8/212: mkdir da/d13/d3f/d45 0 2024-03-19T06:05:51.521 INFO:tasks.workunit.client.0.smithi072.stdout:5/419: write df/d13/d32/d28/f55 [846568,116253] 0 2024-03-19T06:05:51.524 INFO:tasks.workunit.client.0.smithi072.stdout:5/420: fsync df/d3c/f68 0 2024-03-19T06:05:51.524 INFO:tasks.workunit.client.0.smithi072.stdout:8/213: creat da/d27/d41/f46 x:0 0 0 2024-03-19T06:05:51.526 INFO:tasks.workunit.client.0.smithi072.stdout:8/214: dread - da/d13/f1e zero size 2024-03-19T06:05:51.529 INFO:tasks.workunit.client.0.smithi072.stdout:5/421: mkdir df/d16/d61/d7e 0 2024-03-19T06:05:51.529 INFO:tasks.workunit.client.0.smithi072.stdout:8/215: fsync da/d13/f1e 0 2024-03-19T06:05:51.530 INFO:tasks.workunit.client.0.smithi072.stdout:2/199: dread db/d10/d13/f25 [0,4194304] 0 2024-03-19T06:05:51.537 INFO:tasks.workunit.client.0.smithi072.stdout:2/200: mkdir db/d10/d2b/d2d/d3f/d48 0 2024-03-19T06:05:51.537 INFO:tasks.workunit.client.0.smithi072.stdout:8/216: truncate da/fc 974522 0 2024-03-19T06:05:51.537 INFO:tasks.workunit.client.0.smithi072.stdout:5/422: rmdir df/d13/d24/d70 0 2024-03-19T06:05:51.539 INFO:tasks.workunit.client.0.smithi072.stdout:2/201: write db/f1e [339545,24074] 0 2024-03-19T06:05:51.545 INFO:tasks.workunit.client.0.smithi072.stdout:2/202: rename db/d10/d12/f39 to db/d10/d44/f49 0 2024-03-19T06:05:51.546 INFO:tasks.workunit.client.0.smithi072.stdout:4/301: dread d5/d1b/f1d [0,4194304] 0 2024-03-19T06:05:51.547 INFO:tasks.workunit.client.0.smithi072.stdout:2/203: dread - db/f30 zero size 2024-03-19T06:05:51.550 INFO:tasks.workunit.client.0.smithi072.stdout:2/204: stat db/d10/d2b/c32 0 2024-03-19T06:05:51.552 INFO:tasks.workunit.client.0.smithi072.stdout:8/217: dread f4 [0,4194304] 0 2024-03-19T06:05:51.552 INFO:tasks.workunit.client.0.smithi072.stdout:5/423: write df/d13/f3e [1451339,129333] 0 2024-03-19T06:05:51.553 INFO:tasks.workunit.client.0.smithi072.stdout:4/302: read d5/d1b/f2b [427655,14552] 0 2024-03-19T06:05:51.555 INFO:tasks.workunit.client.0.smithi072.stdout:2/205: write db/d10/d2b/d2d/f46 [417921,125369] 0 2024-03-19T06:05:51.556 INFO:tasks.workunit.client.0.smithi072.stdout:8/218: chown da/d27/d41/f46 26090 1 2024-03-19T06:05:51.558 INFO:tasks.workunit.client.0.smithi072.stdout:4/303: mkdir d5/d15/d73 0 2024-03-19T06:05:51.559 INFO:tasks.workunit.client.0.smithi072.stdout:8/219: write da/f2a [2704990,90046] 0 2024-03-19T06:05:51.561 INFO:tasks.workunit.client.0.smithi072.stdout:8/220: write da/d13/d14/f35 [852917,76137] 0 2024-03-19T06:05:51.563 INFO:tasks.workunit.client.0.smithi072.stdout:2/206: creat db/d10/d2b/f4a x:0 0 0 2024-03-19T06:05:51.563 INFO:tasks.workunit.client.0.smithi072.stdout:4/304: mknod d5/d32/d58/c74 0 2024-03-19T06:05:51.564 INFO:tasks.workunit.client.0.smithi072.stdout:2/207: stat db/d10/d12/l3b 0 2024-03-19T06:05:51.565 INFO:tasks.workunit.client.0.smithi072.stdout:8/221: creat da/d27/f47 x:0 0 0 2024-03-19T06:05:51.566 INFO:tasks.workunit.client.0.smithi072.stdout:5/424: truncate df/d13/f23 277676 0 2024-03-19T06:05:51.566 INFO:tasks.workunit.client.0.smithi072.stdout:4/305: write d5/d15/d50/f5b [671366,71930] 0 2024-03-19T06:05:51.567 INFO:tasks.workunit.client.0.smithi072.stdout:8/222: chown da/d27/f43 77605278 1 2024-03-19T06:05:51.567 INFO:tasks.workunit.client.0.smithi072.stdout:2/208: fdatasync db/d10/d13/d31/f3c 0 2024-03-19T06:05:51.571 INFO:tasks.workunit.client.0.smithi072.stdout:5/425: chown df/d13/d32/d28/d42/d59/d43/d4e/l7b 595 1 2024-03-19T06:05:51.571 INFO:tasks.workunit.client.0.smithi072.stdout:8/223: mknod da/d13/d1d/d3c/c48 0 2024-03-19T06:05:51.573 INFO:tasks.workunit.client.0.smithi072.stdout:5/426: write df/d16/d61/f66 [1205358,89805] 0 2024-03-19T06:05:51.576 INFO:tasks.workunit.client.0.smithi072.stdout:4/306: getdents d5/d15/d22/d41/d61 0 2024-03-19T06:05:51.576 INFO:tasks.workunit.client.0.smithi072.stdout:2/209: link db/f22 db/d10/d2b/f4b 0 2024-03-19T06:05:51.577 INFO:tasks.workunit.client.0.smithi072.stdout:5/427: write df/d13/d32/d28/d42/f79 [1495963,123883] 0 2024-03-19T06:05:51.577 INFO:tasks.workunit.client.0.smithi072.stdout:8/224: creat da/d13/d3f/d45/f49 x:0 0 0 2024-03-19T06:05:51.579 INFO:tasks.workunit.client.0.smithi072.stdout:4/307: dread - d5/d15/d22/d41/d61/f70 zero size 2024-03-19T06:05:51.581 INFO:tasks.workunit.client.0.smithi072.stdout:5/428: symlink df/d54/l7f 0 2024-03-19T06:05:51.583 INFO:tasks.workunit.client.0.smithi072.stdout:2/210: symlink db/d10/d2b/d2d/d3f/d48/l4c 0 2024-03-19T06:05:51.584 INFO:tasks.workunit.client.0.smithi072.stdout:4/308: creat d5/d15/d31/d4c/f75 x:0 0 0 2024-03-19T06:05:51.588 INFO:tasks.workunit.client.0.smithi072.stdout:4/309: mkdir d5/d15/d73/d76 0 2024-03-19T06:05:51.591 INFO:tasks.workunit.client.0.smithi072.stdout:4/310: symlink d5/d15/d73/l77 0 2024-03-19T06:05:51.593 INFO:tasks.workunit.client.0.smithi072.stdout:8/225: dread da/d13/d14/f17 [0,4194304] 0 2024-03-19T06:05:51.593 INFO:tasks.workunit.client.0.smithi072.stdout:2/211: write db/d10/d13/d31/d35/f43 [1853451,119377] 0 2024-03-19T06:05:51.597 INFO:tasks.workunit.client.0.smithi072.stdout:4/311: mknod d5/d15/d31/d4c/c78 0 2024-03-19T06:05:51.598 INFO:tasks.workunit.client.0.smithi072.stdout:2/212: mknod db/c4d 0 2024-03-19T06:05:51.599 INFO:tasks.workunit.client.0.smithi072.stdout:5/429: dwrite df/d14/f2f [0,4194304] 0 2024-03-19T06:05:51.599 INFO:tasks.workunit.client.0.smithi072.stdout:2/213: dread - db/f30 zero size 2024-03-19T06:05:51.604 INFO:tasks.workunit.client.0.smithi072.stdout:8/226: dread da/f36 [0,4194304] 0 2024-03-19T06:05:51.604 INFO:tasks.workunit.client.0.smithi072.stdout:5/430: write df/d14/f2f [4764225,56365] 0 2024-03-19T06:05:51.604 INFO:tasks.workunit.client.0.smithi072.stdout:2/214: write db/d10/d13/d31/f3c [708156,90356] 0 2024-03-19T06:05:51.605 INFO:tasks.workunit.client.0.smithi072.stdout:5/431: chown df/d13/d24/c50 1682 1 2024-03-19T06:05:51.606 INFO:tasks.workunit.client.0.smithi072.stdout:2/215: readlink db/d10/d12/l3b 0 2024-03-19T06:05:51.614 INFO:tasks.workunit.client.0.smithi072.stdout:8/227: truncate da/d13/d14/f17 387237 0 2024-03-19T06:05:51.614 INFO:tasks.workunit.client.0.smithi072.stdout:2/216: truncate db/d10/f18 3501189 0 2024-03-19T06:05:51.617 INFO:tasks.workunit.client.0.smithi072.stdout:2/217: stat db/d10/d2b/f4b 0 2024-03-19T06:05:51.619 INFO:tasks.workunit.client.0.smithi072.stdout:4/312: dwrite d5/f6 [4194304,4194304] 0 2024-03-19T06:05:51.625 INFO:tasks.workunit.client.0.smithi072.stdout:8/228: write f9 [3332063,102181] 0 2024-03-19T06:05:51.627 INFO:tasks.workunit.client.0.smithi072.stdout:4/313: mknod d5/d15/d22/d41/c79 0 2024-03-19T06:05:51.629 INFO:tasks.workunit.client.0.smithi072.stdout:2/218: rename ca to db/d10/d2b/c4e 0 2024-03-19T06:05:51.630 INFO:tasks.workunit.client.0.smithi072.stdout:5/432: dwrite df/d13/d32/d28/d42/d59/d43/f5a [0,4194304] 0 2024-03-19T06:05:51.638 INFO:tasks.workunit.client.0.smithi072.stdout:8/229: rename da/d13/d1d/d3c to da/d4a 0 2024-03-19T06:05:51.641 INFO:tasks.workunit.client.0.smithi072.stdout:8/230: chown da/d27/d41/f46 10742113 1 2024-03-19T06:05:51.642 INFO:tasks.workunit.client.0.smithi072.stdout:8/231: chown f8 138914891 1 2024-03-19T06:05:51.646 INFO:tasks.workunit.client.0.smithi072.stdout:8/232: fsync da/d27/d30/f3d 0 2024-03-19T06:05:51.646 INFO:tasks.workunit.client.0.smithi072.stdout:4/314: dread d5/d1b/f1d [0,4194304] 0 2024-03-19T06:05:51.652 INFO:tasks.workunit.client.0.smithi072.stdout:5/433: dwrite df/d16/d61/f6d [0,4194304] 0 2024-03-19T06:05:51.655 INFO:tasks.workunit.client.0.smithi072.stdout:8/233: getdents da/d4a 0 2024-03-19T06:05:51.661 INFO:tasks.workunit.client.0.smithi072.stdout:8/234: symlink da/d27/d41/l4b 0 2024-03-19T06:05:51.662 INFO:tasks.workunit.client.0.smithi072.stdout:2/219: truncate db/d10/d12/f1b 1684533 0 2024-03-19T06:05:51.663 INFO:tasks.workunit.client.0.smithi072.stdout:2/220: chown db/c4d 292251711 1 2024-03-19T06:05:51.664 INFO:tasks.workunit.client.0.smithi072.stdout:5/434: dread df/d16/d61/f6d [0,4194304] 0 2024-03-19T06:05:51.665 INFO:tasks.workunit.client.0.smithi072.stdout:2/221: write db/f2f [266596,111473] 0 2024-03-19T06:05:51.669 INFO:tasks.workunit.client.0.smithi072.stdout:8/235: unlink da/d13/f1e 0 2024-03-19T06:05:51.670 INFO:tasks.workunit.client.0.smithi072.stdout:4/315: write d5/d1b/f2b [363309,12356] 0 2024-03-19T06:05:51.670 INFO:tasks.workunit.client.0.smithi072.stdout:8/236: chown da/d13/d14 312092 1 2024-03-19T06:05:51.672 INFO:tasks.workunit.client.0.smithi072.stdout:8/237: write da/d13/d14/f28 [1051072,109877] 0 2024-03-19T06:05:51.674 INFO:tasks.workunit.client.0.smithi072.stdout:8/238: stat da/l15 0 2024-03-19T06:05:51.675 INFO:tasks.workunit.client.0.smithi072.stdout:5/435: creat df/d13/d32/d28/f80 x:0 0 0 2024-03-19T06:05:51.678 INFO:tasks.workunit.client.0.smithi072.stdout:5/436: write df/d13/d32/d28/d42/d59/d43/d4e/d5c/f6f [64907,50445] 0 2024-03-19T06:05:51.681 INFO:tasks.workunit.client.0.smithi072.stdout:5/437: write df/d13/d32/d28/d42/f79 [1526238,48305] 0 2024-03-19T06:05:51.682 INFO:tasks.workunit.client.0.smithi072.stdout:2/222: truncate db/d10/f18 1237020 0 2024-03-19T06:05:51.683 INFO:tasks.workunit.client.0.smithi072.stdout:8/239: symlink da/d4a/l4c 0 2024-03-19T06:05:51.683 INFO:tasks.workunit.client.0.smithi072.stdout:2/223: chown db/d10/d44 254601437 1 2024-03-19T06:05:51.684 INFO:tasks.workunit.client.0.smithi072.stdout:4/316: mkdir d5/d15/d31/d6d/d7a 0 2024-03-19T06:05:51.690 INFO:tasks.workunit.client.0.smithi072.stdout:2/224: rename db/d10/d13/f25 to db/f4f 0 2024-03-19T06:05:51.691 INFO:tasks.workunit.client.0.smithi072.stdout:8/240: mknod da/d37/c4d 0 2024-03-19T06:05:51.692 INFO:tasks.workunit.client.0.smithi072.stdout:2/225: dread - db/d10/d13/d24/f3d zero size 2024-03-19T06:05:51.697 INFO:tasks.workunit.client.0.smithi072.stdout:5/438: link df/d13/d32/d28/d42/f6a df/d13/d32/d28/f81 0 2024-03-19T06:05:51.699 INFO:tasks.workunit.client.0.smithi072.stdout:8/241: symlink da/d13/d3f/d45/l4e 0 2024-03-19T06:05:51.703 INFO:tasks.workunit.client.0.smithi072.stdout:8/242: unlink f9 0 2024-03-19T06:05:51.706 INFO:tasks.workunit.client.0.smithi072.stdout:5/439: truncate df/d16/f36 904373 0 2024-03-19T06:05:51.709 INFO:tasks.workunit.client.0.smithi072.stdout:2/226: getdents db/d10/d13/d31 0 2024-03-19T06:05:51.714 INFO:tasks.workunit.client.0.smithi072.stdout:5/440: link df/d13/d32/d28/f81 df/d13/d24/f82 0 2024-03-19T06:05:51.717 INFO:tasks.workunit.client.0.smithi072.stdout:8/243: rename da/d13/d14/d1b/f44 to da/d13/f4f 0 2024-03-19T06:05:51.725 INFO:tasks.workunit.client.0.smithi072.stdout:8/244: creat da/f50 x:0 0 0 2024-03-19T06:05:51.727 INFO:tasks.workunit.client.0.smithi072.stdout:8/245: write da/d13/d14/f28 [839698,70930] 0 2024-03-19T06:05:51.727 INFO:tasks.workunit.client.0.smithi072.stdout:5/441: rename df/d14/l2e to df/d13/l83 0 2024-03-19T06:05:51.730 INFO:tasks.workunit.client.0.smithi072.stdout:8/246: chown da/d13/d1d/c1f 11917357 1 2024-03-19T06:05:51.731 INFO:tasks.workunit.client.0.smithi072.stdout:4/317: write d5/f25 [1276209,29734] 0 2024-03-19T06:05:51.732 INFO:tasks.workunit.client.0.smithi072.stdout:8/247: readlink da/d13/d14/d1b/l24 0 2024-03-19T06:05:51.732 INFO:tasks.workunit.client.0.smithi072.stdout:5/442: read df/d13/d24/f4f [1782494,128895] 0 2024-03-19T06:05:51.737 INFO:tasks.workunit.client.0.smithi072.stdout:2/227: dread db/d10/d12/f14 [0,4194304] 0 2024-03-19T06:05:51.738 INFO:tasks.workunit.client.0.smithi072.stdout:4/318: rename d5/d15/d73/d76 to d5/d15/d22/d41/d7b 0 2024-03-19T06:05:51.739 INFO:tasks.workunit.client.0.smithi072.stdout:8/248: creat da/f51 x:0 0 0 2024-03-19T06:05:51.743 INFO:tasks.workunit.client.0.smithi072.stdout:2/228: rename c7 to db/d10/d13/c50 0 2024-03-19T06:05:51.747 INFO:tasks.workunit.client.0.smithi072.stdout:4/319: mkdir d5/d15/d22/d41/d7b/d7c 0 2024-03-19T06:05:51.747 INFO:tasks.workunit.client.0.smithi072.stdout:8/249: mkdir da/d27/d52 0 2024-03-19T06:05:51.749 INFO:tasks.workunit.client.0.smithi072.stdout:2/229: creat db/d10/d13/f51 x:0 0 0 2024-03-19T06:05:51.754 INFO:tasks.workunit.client.0.smithi072.stdout:5/443: getdents df/d13/d32/d28/d42/d59/d43/d62 0 2024-03-19T06:05:51.758 INFO:tasks.workunit.client.0.smithi072.stdout:8/250: rename da/fc to da/d13/f53 0 2024-03-19T06:05:51.760 INFO:tasks.workunit.client.0.smithi072.stdout:5/444: truncate df/d14/f15 1766270 0 2024-03-19T06:05:51.766 INFO:tasks.workunit.client.0.smithi072.stdout:5/445: mknod df/d13/d32/d28/d42/d59/d43/d4e/c84 0 2024-03-19T06:05:51.767 INFO:tasks.workunit.client.0.smithi072.stdout:2/230: dread db/d10/f27 [0,4194304] 0 2024-03-19T06:05:51.770 INFO:tasks.workunit.client.0.smithi072.stdout:8/251: dread da/d13/d14/f35 [0,4194304] 0 2024-03-19T06:05:51.771 INFO:tasks.workunit.client.0.smithi072.stdout:4/320: dwrite d5/d15/d22/f44 [0,4194304] 0 2024-03-19T06:05:51.772 INFO:tasks.workunit.client.0.smithi072.stdout:2/231: mknod db/c52 0 2024-03-19T06:05:51.775 INFO:tasks.workunit.client.0.smithi072.stdout:5/446: mkdir df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85 0 2024-03-19T06:05:51.776 INFO:tasks.workunit.client.0.smithi072.stdout:2/232: write db/d10/d13/f26 [2123812,110277] 0 2024-03-19T06:05:51.778 INFO:tasks.workunit.client.0.smithi072.stdout:8/252: creat da/d3b/f54 x:0 0 0 2024-03-19T06:05:51.778 INFO:tasks.workunit.client.0.smithi072.stdout:5/447: stat df/d13/l83 0 2024-03-19T06:05:51.780 INFO:tasks.workunit.client.0.smithi072.stdout:8/253: mknod da/d27/c55 0 2024-03-19T06:05:51.782 INFO:tasks.workunit.client.0.smithi072.stdout:8/254: read - da/d27/d30/f3d zero size 2024-03-19T06:05:51.784 INFO:tasks.workunit.client.0.smithi072.stdout:2/233: getdents db/d10/d13/d24 0 2024-03-19T06:05:51.795 INFO:tasks.workunit.client.0.smithi072.stdout:8/255: rename da/d37/l40 to da/d13/d14/d1b/l56 0 2024-03-19T06:05:51.796 INFO:tasks.workunit.client.0.smithi072.stdout:2/234: creat db/d10/d2b/d2d/d3f/d48/f53 x:0 0 0 2024-03-19T06:05:51.805 INFO:tasks.workunit.client.0.smithi072.stdout:8/256: mkdir da/d13/d14/d1b/d57 0 2024-03-19T06:05:51.806 INFO:tasks.workunit.client.0.smithi072.stdout:2/235: truncate db/f22 512561 0 2024-03-19T06:05:51.810 INFO:tasks.workunit.client.0.smithi072.stdout:5/448: dread df/f17 [0,4194304] 0 2024-03-19T06:05:51.818 INFO:tasks.workunit.client.0.smithi072.stdout:5/449: write df/d16/f36 [1693652,99414] 0 2024-03-19T06:05:51.819 INFO:tasks.workunit.client.0.smithi072.stdout:8/257: dread f4 [0,4194304] 0 2024-03-19T06:05:51.822 INFO:tasks.workunit.client.0.smithi072.stdout:2/236: dread db/d10/f27 [0,4194304] 0 2024-03-19T06:05:51.825 INFO:tasks.workunit.client.0.smithi072.stdout:8/258: link da/d13/c20 da/d13/d14/d1b/d57/c58 0 2024-03-19T06:05:51.831 INFO:tasks.workunit.client.0.smithi072.stdout:5/450: dread df/d14/f2a [0,4194304] 0 2024-03-19T06:05:51.834 INFO:tasks.workunit.client.0.smithi072.stdout:5/451: creat df/d16/d61/f86 x:0 0 0 2024-03-19T06:05:51.836 INFO:tasks.workunit.client.0.smithi072.stdout:2/237: dread db/d10/d13/d31/f3c [0,4194304] 0 2024-03-19T06:05:51.837 INFO:tasks.workunit.client.0.smithi072.stdout:2/238: readlink db/le 0 2024-03-19T06:05:51.842 INFO:tasks.workunit.client.0.smithi072.stdout:5/452: write fb [78031,75343] 0 2024-03-19T06:05:51.842 INFO:tasks.workunit.client.0.smithi072.stdout:2/239: dread - db/d10/d2b/d2d/d3f/d48/f53 zero size 2024-03-19T06:05:51.844 INFO:tasks.workunit.client.0.smithi072.stdout:2/240: fdatasync db/d10/d13/f20 0 2024-03-19T06:05:51.844 INFO:tasks.workunit.client.0.smithi072.stdout:8/259: dwrite da/f2d [0,4194304] 0 2024-03-19T06:05:51.846 INFO:tasks.workunit.client.0.smithi072.stdout:8/260: chown da/d13/d3f/d45 1171361 1 2024-03-19T06:05:51.850 INFO:tasks.workunit.client.0.smithi072.stdout:2/241: read db/d10/d2b/f4b [288140,14063] 0 2024-03-19T06:05:51.853 INFO:tasks.workunit.client.0.smithi072.stdout:8/261: rename da/d13/d3f/d45/l4e to da/d13/d3f/d45/l59 0 2024-03-19T06:05:51.862 INFO:tasks.workunit.client.0.smithi072.stdout:2/242: dread db/d10/d12/f14 [0,4194304] 0 2024-03-19T06:05:51.862 INFO:tasks.workunit.client.0.smithi072.stdout:5/453: dwrite df/d13/d32/d28/f55 [0,4194304] 0 2024-03-19T06:05:51.867 INFO:tasks.workunit.client.0.smithi072.stdout:2/243: creat db/d10/d44/f54 x:0 0 0 2024-03-19T06:05:51.870 INFO:tasks.workunit.client.0.smithi072.stdout:5/454: chown df/d13/d32/d28/d42/f7a 6 1 2024-03-19T06:05:51.871 INFO:tasks.workunit.client.0.smithi072.stdout:2/244: write db/d10/f2e [1234524,106569] 0 2024-03-19T06:05:51.874 INFO:tasks.workunit.client.0.smithi072.stdout:5/455: write df/d13/d32/d28/d42/d59/d43/d4e/d5c/f7c [955082,10137] 0 2024-03-19T06:05:51.876 INFO:tasks.workunit.client.0.smithi072.stdout:5/456: read - df/d16/d61/f86 zero size 2024-03-19T06:05:51.876 INFO:tasks.workunit.client.0.smithi072.stdout:2/245: creat db/d10/d2b/d45/f55 x:0 0 0 2024-03-19T06:05:51.878 INFO:tasks.workunit.client.0.smithi072.stdout:5/457: dread - df/d3c/f68 zero size 2024-03-19T06:05:51.881 INFO:tasks.workunit.client.0.smithi072.stdout:5/458: write df/d13/f5e [2868762,114139] 0 2024-03-19T06:05:51.887 INFO:tasks.workunit.client.0.smithi072.stdout:2/246: write db/d10/d12/f1b [1021129,78251] 0 2024-03-19T06:05:51.887 INFO:tasks.workunit.client.0.smithi072.stdout:5/459: write df/d13/d32/d28/d42/f7a [4982446,84569] 0 2024-03-19T06:05:51.893 INFO:tasks.workunit.client.0.smithi072.stdout:2/247: symlink db/d10/d2b/l56 0 2024-03-19T06:05:51.894 INFO:tasks.workunit.client.0.smithi072.stdout:2/248: chown db/d10/d12/l3b 0 1 2024-03-19T06:05:51.896 INFO:tasks.workunit.client.0.smithi072.stdout:2/249: symlink db/l57 0 2024-03-19T06:05:51.897 INFO:tasks.workunit.client.0.smithi072.stdout:5/460: link df/d13/d32/d28/d42/d59/d43/c52 df/d16/d61/c87 0 2024-03-19T06:05:51.899 INFO:tasks.workunit.client.0.smithi072.stdout:5/461: mknod df/d16/c88 0 2024-03-19T06:05:51.901 INFO:tasks.workunit.client.0.smithi072.stdout:6/218: sync 2024-03-19T06:05:51.901 INFO:tasks.workunit.client.0.smithi072.stdout:2/250: dread db/d10/d13/f20 [0,4194304] 0 2024-03-19T06:05:51.904 INFO:tasks.workunit.client.0.smithi072.stdout:2/251: creat db/d10/d2b/d45/f58 x:0 0 0 2024-03-19T06:05:51.906 INFO:tasks.workunit.client.0.smithi072.stdout:6/219: creat d7/d9/d1b/d31/f4b x:0 0 0 2024-03-19T06:05:51.910 INFO:tasks.workunit.client.0.smithi072.stdout:2/252: mkdir db/d10/d59 0 2024-03-19T06:05:51.918 INFO:tasks.workunit.client.0.smithi072.stdout:5/462: dwrite df/d16/f39 [4194304,4194304] 0 2024-03-19T06:05:51.935 INFO:tasks.workunit.client.0.smithi072.stdout:2/253: dwrite db/d10/f1d [0,4194304] 0 2024-03-19T06:05:51.938 INFO:tasks.workunit.client.0.smithi072.stdout:6/220: dread d7/f34 [0,4194304] 0 2024-03-19T06:05:51.941 INFO:tasks.workunit.client.0.smithi072.stdout:2/254: fsync db/d10/d2b/f4b 0 2024-03-19T06:05:51.942 INFO:tasks.workunit.client.0.smithi072.stdout:5/463: dwrite df/d13/f6b [0,4194304] 0 2024-03-19T06:05:51.946 INFO:tasks.workunit.client.0.smithi072.stdout:6/221: dread d7/d9/d1b/f2a [0,4194304] 0 2024-03-19T06:05:51.947 INFO:tasks.workunit.client.0.smithi072.stdout:5/464: write df/d13/d24/f65 [1876332,58788] 0 2024-03-19T06:05:51.949 INFO:tasks.workunit.client.0.smithi072.stdout:2/255: symlink db/d10/d59/l5a 0 2024-03-19T06:05:51.953 INFO:tasks.workunit.client.0.smithi072.stdout:6/222: creat d7/d9/d1b/d3b/d48/f4c x:0 0 0 2024-03-19T06:05:51.953 INFO:tasks.workunit.client.0.smithi072.stdout:6/223: readlink d7/d9/l13 0 2024-03-19T06:05:51.969 INFO:tasks.workunit.client.0.smithi072.stdout:5/465: dwrite df/d16/d61/f73 [0,4194304] 0 2024-03-19T06:05:51.975 INFO:tasks.workunit.client.0.smithi072.stdout:2/256: dwrite db/d10/d2b/d45/f58 [0,4194304] 0 2024-03-19T06:05:51.980 INFO:tasks.workunit.client.0.smithi072.stdout:2/257: write db/f2f [1040940,20418] 0 2024-03-19T06:05:51.982 INFO:tasks.workunit.client.0.smithi072.stdout:6/224: dwrite d7/d9/d1b/d21/f24 [0,4194304] 0 2024-03-19T06:05:51.984 INFO:tasks.workunit.client.0.smithi072.stdout:5/466: symlink df/d3c/l89 0 2024-03-19T06:05:51.988 INFO:tasks.workunit.client.0.smithi072.stdout:6/225: rename f6 to d7/d9/d1e/f4d 0 2024-03-19T06:05:51.989 INFO:tasks.workunit.client.0.smithi072.stdout:5/467: stat df/c2b 0 2024-03-19T06:05:51.992 INFO:tasks.workunit.client.0.smithi072.stdout:6/226: readlink d7/d9/l17 0 2024-03-19T06:05:51.999 INFO:tasks.workunit.client.0.smithi072.stdout:5/468: rename df/d13/d32/d28/d42/d59/c48 to df/d54/c8a 0 2024-03-19T06:05:52.004 INFO:tasks.workunit.client.0.smithi072.stdout:2/258: dwrite db/d10/d44/f54 [0,4194304] 0 2024-03-19T06:05:52.009 INFO:tasks.workunit.client.0.smithi072.stdout:2/259: rmdir db/d10/d44 39 2024-03-19T06:05:52.014 INFO:tasks.workunit.client.0.smithi072.stdout:5/469: dread df/d13/d32/d28/d42/d59/d43/d4e/d5c/f7c [0,4194304] 0 2024-03-19T06:05:52.016 INFO:tasks.workunit.client.0.smithi072.stdout:5/470: chown df/d16/d61 1855300 1 2024-03-19T06:05:52.020 INFO:tasks.workunit.client.0.smithi072.stdout:6/227: dwrite d7/d2e/f35 [0,4194304] 0 2024-03-19T06:05:52.022 INFO:tasks.workunit.client.0.smithi072.stdout:6/228: dread - d7/d2e/f47 zero size 2024-03-19T06:05:52.025 INFO:tasks.workunit.client.0.smithi072.stdout:5/471: symlink df/d13/d32/d28/d42/d59/d43/d4e/d5c/l8b 0 2024-03-19T06:05:52.028 INFO:tasks.workunit.client.0.smithi072.stdout:6/229: dread d7/f15 [0,4194304] 0 2024-03-19T06:05:52.030 INFO:tasks.workunit.client.0.smithi072.stdout:5/472: symlink df/l8c 0 2024-03-19T06:05:52.036 INFO:tasks.workunit.client.0.smithi072.stdout:2/260: dwrite db/d10/d13/d31/f3c [0,4194304] 0 2024-03-19T06:05:52.037 INFO:tasks.workunit.client.0.smithi072.stdout:5/473: creat df/d13/d32/d28/d42/d59/d43/d62/f8d x:0 0 0 2024-03-19T06:05:52.054 INFO:tasks.workunit.client.0.smithi072.stdout:6/230: truncate d7/d9/fa 772694 0 2024-03-19T06:05:52.056 INFO:tasks.workunit.client.0.smithi072.stdout:6/231: fdatasync d7/d9/d30/f38 0 2024-03-19T06:05:52.058 INFO:tasks.workunit.client.0.smithi072.stdout:2/261: fdatasync db/d10/d13/d31/f3c 0 2024-03-19T06:05:52.061 INFO:tasks.workunit.client.0.smithi072.stdout:5/474: dwrite df/d16/f41 [0,4194304] 0 2024-03-19T06:05:52.064 INFO:tasks.workunit.client.0.smithi072.stdout:6/232: link d7/cb d7/d9/d1b/d33/d41/c4e 0 2024-03-19T06:05:52.064 INFO:tasks.workunit.client.0.smithi072.stdout:2/262: rename db/l28 to db/d10/d12/l5b 0 2024-03-19T06:05:52.067 INFO:tasks.workunit.client.0.smithi072.stdout:5/475: getdents df/d3c 0 2024-03-19T06:05:52.070 INFO:tasks.workunit.client.0.smithi072.stdout:6/233: mknod d7/d9/d1b/d3b/d48/c4f 0 2024-03-19T06:05:52.071 INFO:tasks.workunit.client.0.smithi072.stdout:2/263: dread db/f22 [0,4194304] 0 2024-03-19T06:05:52.074 INFO:tasks.workunit.client.0.smithi072.stdout:6/234: fdatasync d7/d9/f1a 0 2024-03-19T06:05:52.077 INFO:tasks.workunit.client.0.smithi072.stdout:6/235: write f3 [3357392,125569] 0 2024-03-19T06:05:52.079 INFO:tasks.workunit.client.0.smithi072.stdout:6/236: fdatasync d7/d3f/f42 0 2024-03-19T06:05:52.079 INFO:tasks.workunit.client.0.smithi072.stdout:2/264: creat db/d10/d59/f5c x:0 0 0 2024-03-19T06:05:52.081 INFO:tasks.workunit.client.0.smithi072.stdout:5/476: link df/d13/d24/l46 df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/l8e 0 2024-03-19T06:05:52.081 INFO:tasks.workunit.client.0.smithi072.stdout:6/237: stat d7/d9/d1b/d3b/c3e 0 2024-03-19T06:05:52.086 INFO:tasks.workunit.client.0.smithi072.stdout:6/238: mknod d7/d9/d1b/d33/d41/c50 0 2024-03-19T06:05:52.087 INFO:tasks.workunit.client.0.smithi072.stdout:5/477: mknod df/d13/d32/d28/d42/d59/d43/c8f 0 2024-03-19T06:05:52.088 INFO:tasks.workunit.client.0.smithi072.stdout:6/239: rmdir d7/d9/d1b/d3b/d48 39 2024-03-19T06:05:52.091 INFO:tasks.workunit.client.0.smithi072.stdout:5/478: symlink df/d14/l90 0 2024-03-19T06:05:52.100 INFO:tasks.workunit.client.0.smithi072.stdout:5/479: dread df/d13/f3e [0,4194304] 0 2024-03-19T06:05:52.106 INFO:tasks.workunit.client.0.smithi072.stdout:5/480: truncate df/d13/d32/d28/d42/d59/d43/d62/f8d 702413 0 2024-03-19T06:05:52.107 INFO:tasks.workunit.client.0.smithi072.stdout:6/240: dwrite d7/d9/f1a [0,4194304] 0 2024-03-19T06:05:52.111 INFO:tasks.workunit.client.0.smithi072.stdout:6/241: creat d7/d9/d30/f51 x:0 0 0 2024-03-19T06:05:52.114 INFO:tasks.workunit.client.0.smithi072.stdout:6/242: write d7/d9/d2b/f49 [4102324,30808] 0 2024-03-19T06:05:52.120 INFO:tasks.workunit.client.0.smithi072.stdout:6/243: symlink d7/d9/d1b/d3b/d48/l52 0 2024-03-19T06:05:52.123 INFO:tasks.workunit.client.0.smithi072.stdout:5/481: dwrite df/d16/d61/f73 [0,4194304] 0 2024-03-19T06:05:52.129 INFO:tasks.workunit.client.0.smithi072.stdout:6/244: getdents d7/d9/d1b/d21 0 2024-03-19T06:05:52.130 INFO:tasks.workunit.client.0.smithi072.stdout:5/482: creat df/d13/d32/d28/d42/d59/d43/d4e/d5c/f91 x:0 0 0 2024-03-19T06:05:52.132 INFO:tasks.workunit.client.0.smithi072.stdout:6/245: write d7/d3f/d44/f3d [24723,48315] 0 2024-03-19T06:05:52.137 INFO:tasks.workunit.client.0.smithi072.stdout:5/483: rename df/d13/d32/d28/f55 to df/d13/d32/d28/d42/d59/d43/d62/f92 0 2024-03-19T06:05:52.138 INFO:tasks.workunit.client.0.smithi072.stdout:6/246: creat d7/d9/d2b/f53 x:0 0 0 2024-03-19T06:05:52.139 INFO:tasks.workunit.client.0.smithi072.stdout:5/484: chown df/d14/f2f 5 1 2024-03-19T06:05:52.141 INFO:tasks.workunit.client.0.smithi072.stdout:6/247: write d7/d9/d1b/f37 [365736,74610] 0 2024-03-19T06:05:52.142 INFO:tasks.workunit.client.0.smithi072.stdout:5/485: getdents df/d16/d61/d7e 0 2024-03-19T06:05:52.144 INFO:tasks.workunit.client.0.smithi072.stdout:6/248: mkdir d7/d9/d30/d54 0 2024-03-19T06:05:52.145 INFO:tasks.workunit.client.0.smithi072.stdout:5/486: rename c1 to df/d54/c93 0 2024-03-19T06:05:52.146 INFO:tasks.workunit.client.0.smithi072.stdout:6/249: symlink d7/d9/d30/l55 0 2024-03-19T06:05:52.148 INFO:tasks.workunit.client.0.smithi072.stdout:5/487: fsync df/d3c/f35 0 2024-03-19T06:05:52.150 INFO:tasks.workunit.client.0.smithi072.stdout:6/250: unlink d7/d9/d1b/d21/l25 0 2024-03-19T06:05:52.152 INFO:tasks.workunit.client.0.smithi072.stdout:6/251: write d7/d2e/f47 [703080,23588] 0 2024-03-19T06:05:52.153 INFO:tasks.workunit.client.0.smithi072.stdout:6/252: readlink d7/d9/l13 0 2024-03-19T06:05:52.153 INFO:tasks.workunit.client.0.smithi072.stdout:5/488: unlink df/l10 0 2024-03-19T06:05:52.155 INFO:tasks.workunit.client.0.smithi072.stdout:6/253: dread - d7/d9/d30/f38 zero size 2024-03-19T06:05:52.156 INFO:tasks.workunit.client.0.smithi072.stdout:5/489: mknod df/d13/d24/c94 0 2024-03-19T06:05:52.158 INFO:tasks.workunit.client.0.smithi072.stdout:6/254: mknod d7/d9/d30/c56 0 2024-03-19T06:05:52.159 INFO:tasks.workunit.client.0.smithi072.stdout:6/255: fdatasync d7/f34 0 2024-03-19T06:05:52.159 INFO:tasks.workunit.client.0.smithi072.stdout:5/490: write df/d14/d5d/f51 [411156,45196] 0 2024-03-19T06:05:52.162 INFO:tasks.workunit.client.0.smithi072.stdout:6/256: symlink d7/d9/d2b/l57 0 2024-03-19T06:05:52.162 INFO:tasks.workunit.client.0.smithi072.stdout:5/491: symlink df/d13/d32/d28/d42/d59/d43/d4e/l95 0 2024-03-19T06:05:52.163 INFO:tasks.workunit.client.0.smithi072.stdout:6/257: stat d7/d9/d2b/l57 0 2024-03-19T06:05:52.164 INFO:tasks.workunit.client.0.smithi072.stdout:6/258: creat d7/d3f/f58 x:0 0 0 2024-03-19T06:05:52.165 INFO:tasks.workunit.client.0.smithi072.stdout:5/492: truncate df/d14/d5d/f51 926799 0 2024-03-19T06:05:52.166 INFO:tasks.workunit.client.0.smithi072.stdout:6/259: write d7/d2e/f47 [524709,38379] 0 2024-03-19T06:05:52.166 INFO:tasks.workunit.client.0.smithi072.stdout:5/493: chown df/d13/d24/l72 205 1 2024-03-19T06:05:52.360 INFO:tasks.workunit.client.0.smithi072.stdout:1/203: sync 2024-03-19T06:05:52.375 INFO:tasks.workunit.client.0.smithi072.stdout:1/204: creat d1/d11/d18/d19/d1a/d25/d3c/f41 x:0 0 0 2024-03-19T06:05:52.389 INFO:tasks.workunit.client.0.smithi072.stdout:6/260: dwrite d7/d3f/f42 [0,4194304] 0 2024-03-19T06:05:52.398 INFO:tasks.workunit.client.0.smithi072.stdout:1/205: dwrite d1/d11/d18/d19/d1a/d25/d3c/f41 [0,4194304] 0 2024-03-19T06:05:52.402 INFO:tasks.workunit.client.0.smithi072.stdout:1/206: write d1/d11/d18/f40 [484268,11369] 0 2024-03-19T06:05:52.403 INFO:tasks.workunit.client.0.smithi072.stdout:1/207: dread - d1/d16/f3a zero size 2024-03-19T06:05:52.440 INFO:tasks.workunit.client.0.smithi072.stdout:5/494: dwrite df/d13/d32/d28/f81 [0,4194304] 0 2024-03-19T06:05:52.448 INFO:tasks.workunit.client.0.smithi072.stdout:1/208: getdents d1/d11/d18 0 2024-03-19T06:05:52.467 INFO:tasks.workunit.client.0.smithi072.stdout:1/209: dwrite d1/d11/f1c [0,4194304] 0 2024-03-19T06:05:52.472 INFO:tasks.workunit.client.0.smithi072.stdout:1/210: fdatasync d1/d16/f38 0 2024-03-19T06:05:52.489 INFO:tasks.workunit.client.0.smithi072.stdout:6/261: rename d7/f12 to d7/d9/d1b/d33/d41/f59 0 2024-03-19T06:05:52.490 INFO:tasks.workunit.client.0.smithi072.stdout:6/262: chown d7 6523 1 2024-03-19T06:05:52.518 INFO:tasks.workunit.client.0.smithi072.stdout:1/211: dread d1/d11/d18/d19/d1a/f2a [0,4194304] 0 2024-03-19T06:05:52.539 INFO:tasks.workunit.client.0.smithi072.stdout:1/212: dwrite d1/d11/d18/f2e [0,4194304] 0 2024-03-19T06:05:52.541 INFO:tasks.workunit.client.0.smithi072.stdout:6/263: dread d7/f10 [4194304,4194304] 0 2024-03-19T06:05:52.546 INFO:tasks.workunit.client.0.smithi072.stdout:6/264: fdatasync d7/d9/d1b/d31/f4b 0 2024-03-19T06:05:52.546 INFO:tasks.workunit.client.0.smithi072.stdout:6/265: chown d7/d3f 12 1 2024-03-19T06:05:52.551 INFO:tasks.workunit.client.0.smithi072.stdout:1/213: link d1/d11/d18/d19/d1a/d25/d3c/f41 d1/d11/d18/d19/d1a/d3b/f42 0 2024-03-19T06:05:52.566 INFO:tasks.workunit.client.0.smithi072.stdout:6/266: dwrite d7/d9/d1e/f4d [0,4194304] 0 2024-03-19T06:05:52.571 INFO:tasks.workunit.client.0.smithi072.stdout:6/267: creat d7/d9/d30/f5a x:0 0 0 2024-03-19T06:05:52.573 INFO:tasks.workunit.client.0.smithi072.stdout:6/268: dread - d7/d9/d1b/d3b/d48/f4c zero size 2024-03-19T06:05:52.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:52 smithi072 ceph-mon[28706]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T06:05:52.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:52 smithi072 ceph-mon[28706]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T06:05:52.576 INFO:tasks.workunit.client.0.smithi072.stdout:1/214: dwrite d1/d11/d18/f40 [0,4194304] 0 2024-03-19T06:05:52.577 INFO:tasks.workunit.client.0.smithi072.stdout:6/269: mknod d7/c5b 0 2024-03-19T06:05:52.578 INFO:tasks.workunit.client.0.smithi072.stdout:1/215: write d1/d11/f1c [2738516,15477] 0 2024-03-19T06:05:52.579 INFO:tasks.workunit.client.0.smithi072.stdout:6/270: dread - d7/d3f/f58 zero size 2024-03-19T06:05:52.585 INFO:tasks.workunit.client.0.smithi072.stdout:1/216: creat d1/d11/d18/d19/d1a/d25/f43 x:0 0 0 2024-03-19T06:05:52.588 INFO:tasks.workunit.client.0.smithi072.stdout:1/217: mknod d1/d16/c44 0 2024-03-19T06:05:52.593 INFO:tasks.workunit.client.0.smithi072.stdout:1/218: rename d1/d16/l2c to d1/l45 0 2024-03-19T06:05:52.597 INFO:tasks.workunit.client.0.smithi072.stdout:6/271: dwrite d7/f2d [0,4194304] 0 2024-03-19T06:05:52.600 INFO:tasks.workunit.client.0.smithi072.stdout:6/272: truncate d7/d3f/f58 434023 0 2024-03-19T06:05:52.602 INFO:tasks.workunit.client.0.smithi072.stdout:1/219: link d1/d11/d18/d19/d1a/d25/c37 d1/d11/d18/d19/d1a/d25/d3c/c46 0 2024-03-19T06:05:52.602 INFO:tasks.workunit.client.0.smithi072.stdout:6/273: readlink d7/d9/l17 0 2024-03-19T06:05:52.603 INFO:tasks.workunit.client.0.smithi072.stdout:1/220: dread - d1/d16/f38 zero size 2024-03-19T06:05:52.607 INFO:tasks.workunit.client.0.smithi072.stdout:1/221: symlink d1/d16/l47 0 2024-03-19T06:05:52.607 INFO:tasks.workunit.client.0.smithi072.stdout:6/274: creat d7/d9/d1b/d33/d41/d45/f5c x:0 0 0 2024-03-19T06:05:52.612 INFO:tasks.workunit.client.0.smithi072.stdout:6/275: mkdir d7/d9/d2b/d5d 0 2024-03-19T06:05:52.616 INFO:tasks.workunit.client.0.smithi072.stdout:1/222: write d1/f15 [666768,130486] 0 2024-03-19T06:05:52.617 INFO:tasks.workunit.client.0.smithi072.stdout:1/223: readlink d1/l10 0 2024-03-19T06:05:52.618 INFO:tasks.workunit.client.0.smithi072.stdout:1/224: stat d1/d16 0 2024-03-19T06:05:52.618 INFO:tasks.workunit.client.0.smithi072.stdout:6/276: rename d7/f10 to d7/d9/d1b/d3b/f5e 0 2024-03-19T06:05:52.620 INFO:tasks.workunit.client.0.smithi072.stdout:6/277: chown d7/d2e/f2f 28485 1 2024-03-19T06:05:52.622 INFO:tasks.workunit.client.0.smithi072.stdout:1/225: getdents d1/d11/d18 0 2024-03-19T06:05:52.625 INFO:tasks.workunit.client.0.smithi072.stdout:1/226: mkdir d1/d11/d18/d19/d1a/d25/d3c/d48 0 2024-03-19T06:05:52.627 INFO:tasks.workunit.client.0.smithi072.stdout:6/278: truncate f3 3067728 0 2024-03-19T06:05:52.632 INFO:tasks.workunit.client.0.smithi072.stdout:6/279: creat d7/d3f/f5f x:0 0 0 2024-03-19T06:05:52.635 INFO:tasks.workunit.client.0.smithi072.stdout:6/280: stat d7/d9/d1b/d3b/d48 0 2024-03-19T06:05:52.638 INFO:tasks.workunit.client.0.smithi072.stdout:6/281: mkdir d7/d2e/d60 0 2024-03-19T06:05:52.640 INFO:tasks.workunit.client.0.smithi072.stdout:6/282: fdatasync d7/d9/d30/f51 0 2024-03-19T06:05:52.641 INFO:tasks.workunit.client.0.smithi072.stdout:6/283: chown d7/d9/d1b/d33/c4a 502327345 1 2024-03-19T06:05:52.643 INFO:tasks.workunit.client.0.smithi072.stdout:1/227: dwrite d1/d11/d18/f40 [4194304,4194304] 0 2024-03-19T06:05:52.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:52 smithi172 ceph-mon[35716]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T06:05:52.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:52 smithi172 ceph-mon[35716]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T06:05:52.660 INFO:tasks.workunit.client.0.smithi072.stdout:1/228: dwrite d1/d11/d18/d19/d1a/d25/d3c/f3e [0,4194304] 0 2024-03-19T06:05:52.661 INFO:tasks.workunit.client.0.smithi072.stdout:1/229: fsync d1/d16/f31 0 2024-03-19T06:05:52.668 INFO:tasks.workunit.client.0.smithi072.stdout:1/230: creat d1/d11/d18/f49 x:0 0 0 2024-03-19T06:05:52.672 INFO:tasks.workunit.client.0.smithi072.stdout:9/152: sync 2024-03-19T06:05:52.677 INFO:tasks.workunit.client.0.smithi072.stdout:1/231: link d1/d16/c44 d1/d11/d18/d19/c4a 0 2024-03-19T06:05:52.678 INFO:tasks.workunit.client.0.smithi072.stdout:1/232: dread - d1/d11/d18/f49 zero size 2024-03-19T06:05:52.680 INFO:tasks.workunit.client.0.smithi072.stdout:1/233: fdatasync d1/d11/d18/d19/d1a/d25/f43 0 2024-03-19T06:05:52.683 INFO:tasks.workunit.client.0.smithi072.stdout:1/234: symlink d1/d11/l4b 0 2024-03-19T06:05:52.691 INFO:tasks.workunit.client.0.smithi072.stdout:9/153: write fe [3480718,125244] 0 2024-03-19T06:05:52.700 INFO:tasks.workunit.client.0.smithi072.stdout:1/235: dread d1/d11/d18/d19/d1a/d25/d3c/f3e [0,4194304] 0 2024-03-19T06:05:52.703 INFO:tasks.workunit.client.0.smithi072.stdout:1/236: write d1/d11/f39 [162018,22615] 0 2024-03-19T06:05:52.704 INFO:tasks.workunit.client.0.smithi072.stdout:1/237: chown d1/d11/d18/d19/d1a/c35 4386 1 2024-03-19T06:05:52.705 INFO:tasks.workunit.client.0.smithi072.stdout:9/154: dread d11/f12 [0,4194304] 0 2024-03-19T06:05:52.706 INFO:tasks.workunit.client.0.smithi072.stdout:1/238: fsync d1/d11/d18/f40 0 2024-03-19T06:05:52.710 INFO:tasks.workunit.client.0.smithi072.stdout:9/155: mknod d11/d1f/d2a/d36/c38 0 2024-03-19T06:05:52.711 INFO:tasks.workunit.client.0.smithi072.stdout:1/239: mknod d1/d11/d18/d19/d1a/d25/d3c/c4c 0 2024-03-19T06:05:52.711 INFO:tasks.workunit.client.0.smithi072.stdout:9/156: fdatasync d11/f37 0 2024-03-19T06:05:52.713 INFO:tasks.workunit.client.0.smithi072.stdout:9/157: chown d11/l35 133 1 2024-03-19T06:05:52.720 INFO:tasks.workunit.client.0.smithi072.stdout:9/158: getdents d11/d1f/d2a 0 2024-03-19T06:05:52.724 INFO:tasks.workunit.client.0.smithi072.stdout:1/240: dread d1/f6 [0,4194304] 0 2024-03-19T06:05:52.728 INFO:tasks.workunit.client.0.smithi072.stdout:9/159: write d11/d1f/f27 [681243,110053] 0 2024-03-19T06:05:52.732 INFO:tasks.workunit.client.0.smithi072.stdout:9/160: creat d11/d1f/f39 x:0 0 0 2024-03-19T06:05:52.734 INFO:tasks.workunit.client.0.smithi072.stdout:1/241: truncate d1/d11/d18/f2e 437501 0 2024-03-19T06:05:52.736 INFO:tasks.workunit.client.0.smithi072.stdout:9/161: truncate d11/f1d 46036 0 2024-03-19T06:05:52.737 INFO:tasks.workunit.client.0.smithi072.stdout:1/242: creat d1/f4d x:0 0 0 2024-03-19T06:05:52.738 INFO:tasks.workunit.client.0.smithi072.stdout:9/162: creat d11/d1f/f3a x:0 0 0 2024-03-19T06:05:52.739 INFO:tasks.workunit.client.0.smithi072.stdout:1/243: creat d1/f4e x:0 0 0 2024-03-19T06:05:52.742 INFO:tasks.workunit.client.0.smithi072.stdout:9/163: unlink d11/d1f/c31 0 2024-03-19T06:05:52.744 INFO:tasks.workunit.client.0.smithi072.stdout:1/244: symlink d1/d16/l4f 0 2024-03-19T06:05:52.745 INFO:tasks.workunit.client.0.smithi072.stdout:9/164: creat d11/d26/f3b x:0 0 0 2024-03-19T06:05:52.746 INFO:tasks.workunit.client.0.smithi072.stdout:1/245: creat d1/f50 x:0 0 0 2024-03-19T06:05:52.746 INFO:tasks.workunit.client.0.smithi072.stdout:9/165: read - d11/f37 zero size 2024-03-19T06:05:52.747 INFO:tasks.workunit.client.0.smithi072.stdout:9/166: chown d11 59 1 2024-03-19T06:05:52.748 INFO:tasks.workunit.client.0.smithi072.stdout:9/167: dread - d11/d26/f2c zero size 2024-03-19T06:05:52.765 INFO:tasks.workunit.client.0.smithi072.stdout:9/168: dwrite d11/d26/f2c [0,4194304] 0 2024-03-19T06:05:52.769 INFO:tasks.workunit.client.0.smithi072.stdout:9/169: write d11/d26/f2c [5151875,81569] 0 2024-03-19T06:05:52.769 INFO:tasks.workunit.client.0.smithi072.stdout:1/246: dwrite d1/d11/d18/d19/d1a/d25/d3c/f3e [0,4194304] 0 2024-03-19T06:05:52.772 INFO:tasks.workunit.client.0.smithi072.stdout:1/247: dread - d1/f4e zero size 2024-03-19T06:05:52.782 INFO:tasks.workunit.client.0.smithi072.stdout:1/248: rename d1/d16/c2f to d1/d11/d18/d19/d1a/d25/d3c/c51 0 2024-03-19T06:05:52.803 INFO:tasks.workunit.client.0.smithi072.stdout:1/249: dread d1/d11/f13 [0,4194304] 0 2024-03-19T06:05:52.803 INFO:tasks.workunit.client.0.smithi072.stdout:1/250: stat d1/l1d 0 2024-03-19T06:05:52.815 INFO:tasks.workunit.client.0.smithi072.stdout:1/251: dwrite d1/d11/f39 [0,4194304] 0 2024-03-19T06:05:52.842 INFO:tasks.workunit.client.0.smithi072.stdout:1/252: dread d1/f15 [4194304,4194304] 0 2024-03-19T06:05:52.844 INFO:tasks.workunit.client.0.smithi072.stdout:1/253: write d1/d16/f38 [927838,47065] 0 2024-03-19T06:05:52.861 INFO:tasks.workunit.client.0.smithi072.stdout:1/254: dwrite d1/d11/d18/f2e [0,4194304] 0 2024-03-19T06:05:52.866 INFO:tasks.workunit.client.0.smithi072.stdout:1/255: mkdir d1/d11/d18/d19/d1a/d25/d3c/d52 0 2024-03-19T06:05:52.870 INFO:tasks.workunit.client.0.smithi072.stdout:1/256: unlink d1/f50 0 2024-03-19T06:05:52.876 INFO:tasks.workunit.client.0.smithi072.stdout:1/257: unlink d1/d11/d18/d19/d1a/d25/d3c/f41 0 2024-03-19T06:05:52.893 INFO:tasks.workunit.client.0.smithi072.stdout:1/258: dread d1/d11/d18/d19/d1a/d3b/f42 [0,4194304] 0 2024-03-19T06:05:52.896 INFO:tasks.workunit.client.0.smithi072.stdout:1/259: mknod d1/d16/c53 0 2024-03-19T06:05:52.911 INFO:tasks.workunit.client.0.smithi072.stdout:1/260: dwrite d1/f6 [0,4194304] 0 2024-03-19T06:05:52.933 INFO:tasks.workunit.client.0.smithi072.stdout:1/261: dwrite d1/f4e [0,4194304] 0 2024-03-19T06:05:52.935 INFO:tasks.workunit.client.0.smithi072.stdout:1/262: write d1/f15 [272100,63185] 0 2024-03-19T06:05:52.940 INFO:tasks.workunit.client.0.smithi072.stdout:1/263: unlink d1/d11/d18/f40 0 2024-03-19T06:05:52.940 INFO:tasks.workunit.client.0.smithi072.stdout:1/264: stat d1/d16/f31 0 2024-03-19T06:05:52.949 INFO:tasks.workunit.client.0.smithi072.stdout:1/265: unlink d1/d11/d18/d19/d1a/d3b/f42 0 2024-03-19T06:05:52.952 INFO:tasks.workunit.client.0.smithi072.stdout:1/266: truncate d1/d11/d18/d19/d1a/f34 496344 0 2024-03-19T06:05:52.955 INFO:tasks.workunit.client.0.smithi072.stdout:1/267: dread d1/d11/d18/d19/d1a/f34 [0,4194304] 0 2024-03-19T06:05:53.097 INFO:tasks.workunit.client.0.smithi072.stdout:7/213: sync 2024-03-19T06:05:53.098 INFO:tasks.workunit.client.0.smithi072.stdout:0/234: sync 2024-03-19T06:05:53.102 INFO:tasks.workunit.client.0.smithi072.stdout:0/235: write d1/d1c/d24/d27/f29 [4619931,35714] 0 2024-03-19T06:05:53.105 INFO:tasks.workunit.client.0.smithi072.stdout:0/236: chown d1/d2c/l3b 774 1 2024-03-19T06:05:53.106 INFO:tasks.workunit.client.0.smithi072.stdout:0/237: fsync d1/f1a 0 2024-03-19T06:05:53.107 INFO:tasks.workunit.client.0.smithi072.stdout:7/214: truncate d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/f35 376574 0 2024-03-19T06:05:53.110 INFO:tasks.workunit.client.0.smithi072.stdout:7/215: dread - d2/d3/d18/d33/f3c zero size 2024-03-19T06:05:53.111 INFO:tasks.workunit.client.0.smithi072.stdout:0/238: creat d1/d2c/f49 x:0 0 0 2024-03-19T06:05:53.128 INFO:tasks.workunit.client.0.smithi072.stdout:7/216: truncate d2/d3/d18/d33/d1d/d2b/d3d/f7 898279 0 2024-03-19T06:05:53.137 INFO:tasks.workunit.client.0.smithi072.stdout:0/239: dread d1/d1c/d24/d27/f29 [0,4194304] 0 2024-03-19T06:05:53.138 INFO:tasks.workunit.client.0.smithi072.stdout:0/240: readlink l0 0 2024-03-19T06:05:53.139 INFO:tasks.workunit.client.0.smithi072.stdout:0/241: chown d1/d2c/c3a 105539456 1 2024-03-19T06:05:53.141 INFO:tasks.workunit.client.0.smithi072.stdout:0/242: chown d1/d1c/d24/f32 11801730 1 2024-03-19T06:05:53.145 INFO:tasks.workunit.client.0.smithi072.stdout:7/217: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f39 [0,4194304] 0 2024-03-19T06:05:53.152 INFO:tasks.workunit.client.0.smithi072.stdout:7/218: rmdir d2/d3/d18/d33/d1d/d2b/d3d/d21 39 2024-03-19T06:05:53.155 INFO:tasks.workunit.client.0.smithi072.stdout:7/219: write d2/d3/d18/d33/d1d/d2b/d3d/f39 [78305,84442] 0 2024-03-19T06:05:53.160 INFO:tasks.workunit.client.0.smithi072.stdout:7/220: chown d2/d3/d18/d33/d1d/d2b/d3d/d21 16087831 1 2024-03-19T06:05:53.161 INFO:tasks.workunit.client.0.smithi072.stdout:0/243: dwrite d1/f1a [0,4194304] 0 2024-03-19T06:05:53.166 INFO:tasks.workunit.client.0.smithi072.stdout:7/221: dread d2/d3/d18/f2d [0,4194304] 0 2024-03-19T06:05:53.177 INFO:tasks.workunit.client.0.smithi072.stdout:0/244: dread d1/d1c/f43 [0,4194304] 0 2024-03-19T06:05:53.183 INFO:tasks.workunit.client.0.smithi072.stdout:0/245: mkdir d1/d1c/d24/d3f/d4a 0 2024-03-19T06:05:53.187 INFO:tasks.workunit.client.0.smithi072.stdout:0/246: symlink d1/l4b 0 2024-03-19T06:05:53.192 INFO:tasks.workunit.client.0.smithi072.stdout:0/247: creat d1/d1c/f4c x:0 0 0 2024-03-19T06:05:53.198 INFO:tasks.workunit.client.0.smithi072.stdout:0/248: link d1/c35 d1/d1c/d24/d3f/c4d 0 2024-03-19T06:05:53.202 INFO:tasks.workunit.client.0.smithi072.stdout:0/249: creat d1/f4e x:0 0 0 2024-03-19T06:05:53.204 INFO:tasks.workunit.client.0.smithi072.stdout:0/250: creat d1/d1c/f4f x:0 0 0 2024-03-19T06:05:53.219 INFO:tasks.workunit.client.0.smithi072.stdout:0/251: truncate d1/d1c/f23 807577 0 2024-03-19T06:05:53.225 INFO:tasks.workunit.client.0.smithi072.stdout:0/252: unlink d1/d1c/d24/d3e/f47 0 2024-03-19T06:05:53.230 INFO:tasks.workunit.client.0.smithi072.stdout:0/253: symlink d1/d2c/l50 0 2024-03-19T06:05:53.243 INFO:tasks.workunit.client.0.smithi072.stdout:0/254: dwrite d1/f5 [8388608,4194304] 0 2024-03-19T06:05:53.244 INFO:tasks.workunit.client.0.smithi072.stdout:0/255: readlink d1/d1c/l34 0 2024-03-19T06:05:53.246 INFO:tasks.workunit.client.0.smithi072.stdout:0/256: write d1/d2c/f49 [440789,8602] 0 2024-03-19T06:05:53.249 INFO:tasks.workunit.client.0.smithi072.stdout:0/257: write d1/d2c/f41 [176107,24277] 0 2024-03-19T06:05:53.256 INFO:tasks.workunit.client.0.smithi072.stdout:0/258: mknod d1/d1c/d24/d3f/d4a/c51 0 2024-03-19T06:05:53.258 INFO:tasks.workunit.client.0.smithi072.stdout:0/259: chown d1/d2c/l50 17776 1 2024-03-19T06:05:53.273 INFO:tasks.workunit.client.0.smithi072.stdout:0/260: dwrite d1/d1c/f45 [0,4194304] 0 2024-03-19T06:05:53.277 INFO:tasks.workunit.client.0.smithi072.stdout:0/261: creat d1/d2c/f52 x:0 0 0 2024-03-19T06:05:53.281 INFO:tasks.workunit.client.0.smithi072.stdout:0/262: chown d1/l10 7639457 1 2024-03-19T06:05:53.285 INFO:tasks.workunit.client.0.smithi072.stdout:0/263: mkdir d1/d53 0 2024-03-19T06:05:53.289 INFO:tasks.workunit.client.0.smithi072.stdout:0/264: creat d1/d1c/d24/d27/f54 x:0 0 0 2024-03-19T06:05:53.291 INFO:tasks.workunit.client.0.smithi072.stdout:0/265: rmdir d1/d1c/d24/d3f 39 2024-03-19T06:05:53.293 INFO:tasks.workunit.client.0.smithi072.stdout:0/266: chown d1/f1b 71335 1 2024-03-19T06:05:53.305 INFO:tasks.workunit.client.0.smithi072.stdout:0/267: write d1/d1c/f23 [1409783,20066] 0 2024-03-19T06:05:53.313 INFO:tasks.workunit.client.0.smithi072.stdout:0/268: rename d1/l15 to d1/l55 0 2024-03-19T06:05:53.316 INFO:tasks.workunit.client.0.smithi072.stdout:0/269: creat d1/d1c/d24/d3f/d4a/f56 x:0 0 0 2024-03-19T06:05:53.319 INFO:tasks.workunit.client.0.smithi072.stdout:0/270: symlink d1/l57 0 2024-03-19T06:05:53.324 INFO:tasks.workunit.client.0.smithi072.stdout:0/271: getdents d1/d2c 0 2024-03-19T06:05:53.325 INFO:tasks.workunit.client.0.smithi072.stdout:0/272: stat d1/d2c/f49 0 2024-03-19T06:05:53.328 INFO:tasks.workunit.client.0.smithi072.stdout:0/273: write d1/d1c/d24/d27/f29 [436489,38068] 0 2024-03-19T06:05:53.341 INFO:tasks.workunit.client.0.smithi072.stdout:0/274: dwrite d1/f5 [0,4194304] 0 2024-03-19T06:05:53.345 INFO:tasks.workunit.client.0.smithi072.stdout:0/275: creat d1/f58 x:0 0 0 2024-03-19T06:05:53.349 INFO:tasks.workunit.client.0.smithi072.stdout:0/276: rmdir d1/d53 0 2024-03-19T06:05:53.353 INFO:tasks.workunit.client.0.smithi072.stdout:0/277: mkdir d1/d1c/d24/d3e/d59 0 2024-03-19T06:05:53.364 INFO:tasks.workunit.client.0.smithi072.stdout:0/278: dread d1/f5 [0,4194304] 0 2024-03-19T06:05:53.476 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:53 smithi072 ceph-mon[28706]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-19T06:05:53.476 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:53 smithi072 ceph-mon[28706]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-03-19T06:05:53.477 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:53 smithi072 ceph-mon[28706]: pgmap v23: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 60 MiB/s rd, 155 MiB/s wr, 331 op/s 2024-03-19T06:05:53.480 INFO:tasks.workunit.client.0.smithi072.stdout:8/262: sync 2024-03-19T06:05:53.480 INFO:tasks.workunit.client.0.smithi072.stdout:4/321: sync 2024-03-19T06:05:53.480 INFO:tasks.workunit.client.0.smithi072.stdout:3/324: sync 2024-03-19T06:05:53.503 INFO:tasks.workunit.client.0.smithi072.stdout:4/322: truncate d5/d37/f69 297107 0 2024-03-19T06:05:53.507 INFO:tasks.workunit.client.0.smithi072.stdout:4/323: mkdir d5/d15/d31/d7d 0 2024-03-19T06:05:53.515 INFO:tasks.workunit.client.0.smithi072.stdout:8/263: dwrite da/d27/f47 [0,4194304] 0 2024-03-19T06:05:53.516 INFO:tasks.workunit.client.0.smithi072.stdout:3/325: dwrite d2/d40/f47 [0,4194304] 0 2024-03-19T06:05:53.522 INFO:tasks.workunit.client.0.smithi072.stdout:3/326: chown d2/d3/d25/f39 3866131 1 2024-03-19T06:05:53.525 INFO:tasks.workunit.client.0.smithi072.stdout:3/327: dread - d2/d19/f52 zero size 2024-03-19T06:05:53.527 INFO:tasks.workunit.client.0.smithi072.stdout:8/264: rename da/d13/d3f/d45 to da/d4a/d3e/d5a 0 2024-03-19T06:05:53.529 INFO:tasks.workunit.client.0.smithi072.stdout:3/328: symlink d2/d19/l5b 0 2024-03-19T06:05:53.534 INFO:tasks.workunit.client.0.smithi072.stdout:3/329: creat d2/d19/f5c x:0 0 0 2024-03-19T06:05:53.536 INFO:tasks.workunit.client.0.smithi072.stdout:4/324: dwrite d5/f8 [4194304,4194304] 0 2024-03-19T06:05:53.542 INFO:tasks.workunit.client.0.smithi072.stdout:3/330: symlink d2/d3/d26/l5d 0 2024-03-19T06:05:53.547 INFO:tasks.workunit.client.0.smithi072.stdout:3/331: mknod d2/d3/d25/c5e 0 2024-03-19T06:05:53.548 INFO:tasks.workunit.client.0.smithi072.stdout:3/332: read - d2/d19/f53 zero size 2024-03-19T06:05:53.556 INFO:tasks.workunit.client.0.smithi072.stdout:8/265: rename da/d4a to da/d27/d52/d5b 0 2024-03-19T06:05:53.559 INFO:tasks.workunit.client.0.smithi072.stdout:8/266: fdatasync da/f34 0 2024-03-19T06:05:53.561 INFO:tasks.workunit.client.0.smithi072.stdout:8/267: readlink da/d27/d41/l4b 0 2024-03-19T06:05:53.565 INFO:tasks.workunit.client.0.smithi072.stdout:3/333: link d2/d3/c51 d2/d19/d1e/c5f 0 2024-03-19T06:05:53.568 INFO:tasks.workunit.client.0.smithi072.stdout:3/334: dread - d2/d19/f53 zero size 2024-03-19T06:05:53.572 INFO:tasks.workunit.client.0.smithi072.stdout:3/335: creat d2/f60 x:0 0 0 2024-03-19T06:05:53.577 INFO:tasks.workunit.client.0.smithi072.stdout:8/268: dread f4 [0,4194304] 0 2024-03-19T06:05:53.580 INFO:tasks.workunit.client.0.smithi072.stdout:8/269: mkdir da/d37/d5c 0 2024-03-19T06:05:53.586 INFO:tasks.workunit.client.0.smithi072.stdout:8/270: creat da/d13/d14/d1b/d57/f5d x:0 0 0 2024-03-19T06:05:53.589 INFO:tasks.workunit.client.0.smithi072.stdout:8/271: chown da/d13/d14/d1b/c31 0 1 2024-03-19T06:05:53.592 INFO:tasks.workunit.client.0.smithi072.stdout:8/272: creat da/d3b/f5e x:0 0 0 2024-03-19T06:05:53.616 INFO:tasks.workunit.client.0.smithi072.stdout:3/336: dread d2/d3/d26/f35 [0,4194304] 0 2024-03-19T06:05:53.619 INFO:tasks.workunit.client.0.smithi072.stdout:3/337: symlink d2/l61 0 2024-03-19T06:05:53.620 INFO:tasks.workunit.client.0.smithi072.stdout:3/338: fsync d2/d3/d25/f39 0 2024-03-19T06:05:53.646 INFO:tasks.workunit.client.0.smithi072.stdout:3/339: dread d2/d3/f10 [4194304,4194304] 0 2024-03-19T06:05:53.649 INFO:tasks.workunit.client.0.smithi072.stdout:3/340: mknod d2/d40/c62 0 2024-03-19T06:05:53.652 INFO:tasks.workunit.client.0.smithi072.stdout:3/341: symlink d2/d3/l63 0 2024-03-19T06:05:53.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:53 smithi172 ceph-mon[35716]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-19T06:05:53.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:53 smithi172 ceph-mon[35716]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-03-19T06:05:53.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:53 smithi172 ceph-mon[35716]: pgmap v23: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 60 MiB/s rd, 155 MiB/s wr, 331 op/s 2024-03-19T06:05:53.667 INFO:tasks.workunit.client.0.smithi072.stdout:3/342: dwrite d2/d3/d25/f42 [4194304,4194304] 0 2024-03-19T06:05:53.674 INFO:tasks.workunit.client.0.smithi072.stdout:3/343: mknod d2/d19/c64 0 2024-03-19T06:05:53.679 INFO:tasks.workunit.client.0.smithi072.stdout:3/344: write f1 [1883723,456] 0 2024-03-19T06:05:53.686 INFO:tasks.workunit.client.0.smithi072.stdout:3/345: creat d2/d19/f65 x:0 0 0 2024-03-19T06:05:53.691 INFO:tasks.workunit.client.0.smithi072.stdout:3/346: mkdir d2/d3/d15/d66 0 2024-03-19T06:05:53.693 INFO:tasks.workunit.client.0.smithi072.stdout:3/347: chown d2/d19/c41 1169 1 2024-03-19T06:05:53.708 INFO:tasks.workunit.client.0.smithi072.stdout:3/348: dwrite d2/f5 [0,4194304] 0 2024-03-19T06:05:53.723 INFO:tasks.workunit.client.0.smithi072.stdout:3/349: dwrite d2/d3/d25/f39 [4194304,4194304] 0 2024-03-19T06:05:53.754 INFO:tasks.workunit.client.0.smithi072.stdout:3/350: truncate d2/f2f 2153094 0 2024-03-19T06:05:53.864 INFO:tasks.workunit.client.0.smithi072.stdout:2/265: sync 2024-03-19T06:05:53.866 INFO:tasks.workunit.client.0.smithi072.stdout:3/351: creat d2/d3/d15/f67 x:0 0 0 2024-03-19T06:05:53.866 INFO:tasks.workunit.client.0.smithi072.stdout:3/352: chown f1 0 1 2024-03-19T06:05:53.873 INFO:tasks.workunit.client.0.smithi072.stdout:2/266: getdents db/d10/d13/d31/d35 0 2024-03-19T06:05:53.873 INFO:tasks.workunit.client.0.smithi072.stdout:3/353: link d2/d19/c1a d2/d3/c68 0 2024-03-19T06:05:53.876 INFO:tasks.workunit.client.0.smithi072.stdout:2/267: truncate db/d10/d13/f20 679559 0 2024-03-19T06:05:53.877 INFO:tasks.workunit.client.0.smithi072.stdout:3/354: mknod d2/d3/d15/d66/c69 0 2024-03-19T06:05:53.880 INFO:tasks.workunit.client.0.smithi072.stdout:3/355: readlink d2/d19/d1e/l45 0 2024-03-19T06:05:53.882 INFO:tasks.workunit.client.0.smithi072.stdout:2/268: unlink db/d10/d13/c50 0 2024-03-19T06:05:53.885 INFO:tasks.workunit.client.0.smithi072.stdout:2/269: truncate db/d10/d2b/d45/f55 532129 0 2024-03-19T06:05:53.895 INFO:tasks.workunit.client.0.smithi072.stdout:3/356: rmdir d2/d3/d15 39 2024-03-19T06:05:53.902 INFO:tasks.workunit.client.0.smithi072.stdout:3/357: write d2/d3/f14 [3414018,89006] 0 2024-03-19T06:05:53.902 INFO:tasks.workunit.client.0.smithi072.stdout:2/270: dwrite db/d10/d12/f14 [0,4194304] 0 2024-03-19T06:05:53.906 INFO:tasks.workunit.client.0.smithi072.stdout:2/271: creat db/d10/d13/d31/f5d x:0 0 0 2024-03-19T06:05:53.920 INFO:tasks.workunit.client.0.smithi072.stdout:3/358: dwrite d2/d3/d26/f35 [4194304,4194304] 0 2024-03-19T06:05:53.926 INFO:tasks.workunit.client.0.smithi072.stdout:2/272: dwrite db/d10/d13/d24/f3d [0,4194304] 0 2024-03-19T06:05:53.927 INFO:tasks.workunit.client.0.smithi072.stdout:3/359: creat d2/d19/d1e/f6a x:0 0 0 2024-03-19T06:05:53.931 INFO:tasks.workunit.client.0.smithi072.stdout:2/273: symlink db/d10/d13/d31/d35/l5e 0 2024-03-19T06:05:53.934 INFO:tasks.workunit.client.0.smithi072.stdout:2/274: truncate db/d10/d2b/f4a 874645 0 2024-03-19T06:05:53.938 INFO:tasks.workunit.client.0.smithi072.stdout:2/275: creat db/d10/d13/d24/f5f x:0 0 0 2024-03-19T06:05:53.947 INFO:tasks.workunit.client.0.smithi072.stdout:2/276: rename db/d10/d2b/d2d/c3e to db/d10/d44/c60 0 2024-03-19T06:05:53.949 INFO:tasks.workunit.client.0.smithi072.stdout:3/360: dwrite d2/d19/f65 [0,4194304] 0 2024-03-19T06:05:53.951 INFO:tasks.workunit.client.0.smithi072.stdout:3/361: truncate d2/f60 212247 0 2024-03-19T06:05:53.952 INFO:tasks.workunit.client.0.smithi072.stdout:2/277: mkdir db/d10/d13/d24/d61 0 2024-03-19T06:05:53.954 INFO:tasks.workunit.client.0.smithi072.stdout:3/362: truncate d2/d19/f52 919863 0 2024-03-19T06:05:53.971 INFO:tasks.workunit.client.0.smithi072.stdout:2/278: truncate db/d10/f27 3320113 0 2024-03-19T06:05:53.973 INFO:tasks.workunit.client.0.smithi072.stdout:2/279: dread - db/d10/d44/f49 zero size 2024-03-19T06:05:53.977 INFO:tasks.workunit.client.0.smithi072.stdout:2/280: dread db/d10/d2b/d2d/d3f/f42 [0,4194304] 0 2024-03-19T06:05:53.980 INFO:tasks.workunit.client.0.smithi072.stdout:3/363: dwrite d2/d19/d1e/f32 [0,4194304] 0 2024-03-19T06:05:53.980 INFO:tasks.workunit.client.0.smithi072.stdout:2/281: mkdir db/d10/d2b/d2d/d62 0 2024-03-19T06:05:53.983 INFO:tasks.workunit.client.0.smithi072.stdout:3/364: write d2/d3/d25/f39 [30294,24319] 0 2024-03-19T06:05:53.985 INFO:tasks.workunit.client.0.smithi072.stdout:2/282: creat db/d10/d2b/d2d/d62/f63 x:0 0 0 2024-03-19T06:05:53.988 INFO:tasks.workunit.client.0.smithi072.stdout:2/283: write db/d10/d13/d24/f3d [1264281,59462] 0 2024-03-19T06:05:53.988 INFO:tasks.workunit.client.0.smithi072.stdout:3/365: mkdir d2/d3/d15/d66/d6b 0 2024-03-19T06:05:53.992 INFO:tasks.workunit.client.0.smithi072.stdout:3/366: creat d2/d19/f6c x:0 0 0 2024-03-19T06:05:53.994 INFO:tasks.workunit.client.0.smithi072.stdout:2/284: mknod db/d10/d13/d31/d35/c64 0 2024-03-19T06:05:53.994 INFO:tasks.workunit.client.0.smithi072.stdout:3/367: write d2/f60 [182449,130637] 0 2024-03-19T06:05:53.998 INFO:tasks.workunit.client.0.smithi072.stdout:2/285: dread db/f22 [0,4194304] 0 2024-03-19T06:05:54.001 INFO:tasks.workunit.client.0.smithi072.stdout:2/286: write db/d10/d13/f26 [3252091,95463] 0 2024-03-19T06:05:54.001 INFO:tasks.workunit.client.0.smithi072.stdout:3/368: rename d2/d3/d15/f36 to d2/d3/f6d 0 2024-03-19T06:05:54.008 INFO:tasks.workunit.client.0.smithi072.stdout:3/369: symlink d2/d3/d15/d66/d6b/l6e 0 2024-03-19T06:05:54.009 INFO:tasks.workunit.client.0.smithi072.stdout:3/370: fdatasync d2/d19/f65 0 2024-03-19T06:05:54.011 INFO:tasks.workunit.client.0.smithi072.stdout:3/371: write d2/d19/f52 [1417810,39201] 0 2024-03-19T06:05:54.014 INFO:tasks.workunit.client.0.smithi072.stdout:5/495: sync 2024-03-19T06:05:54.014 INFO:tasks.workunit.client.0.smithi072.stdout:6/284: sync 2024-03-19T06:05:54.016 INFO:tasks.workunit.client.0.smithi072.stdout:6/285: chown d7/d9/d30/d54 173992508 1 2024-03-19T06:05:54.019 INFO:tasks.workunit.client.0.smithi072.stdout:2/287: dread db/d10/f18 [0,4194304] 0 2024-03-19T06:05:54.019 INFO:tasks.workunit.client.0.smithi072.stdout:5/496: unlink df/d16/f41 0 2024-03-19T06:05:54.021 INFO:tasks.workunit.client.0.smithi072.stdout:6/286: unlink d7/d9/d1b/d3b/d48/c4f 0 2024-03-19T06:05:54.024 INFO:tasks.workunit.client.0.smithi072.stdout:3/372: truncate d2/d3/f14 3406719 0 2024-03-19T06:05:54.024 INFO:tasks.workunit.client.0.smithi072.stdout:6/287: fsync d7/f11 0 2024-03-19T06:05:54.024 INFO:tasks.workunit.client.0.smithi072.stdout:2/288: creat db/d10/d44/f65 x:0 0 0 2024-03-19T06:05:54.026 INFO:tasks.workunit.client.0.smithi072.stdout:5/497: rename df/d13/d32/f12 to df/f96 0 2024-03-19T06:05:54.027 INFO:tasks.workunit.client.0.smithi072.stdout:6/288: creat d7/d9/d1b/d33/d41/d45/f61 x:0 0 0 2024-03-19T06:05:54.029 INFO:tasks.workunit.client.0.smithi072.stdout:2/289: mkdir db/d10/d2b/d2d/d66 0 2024-03-19T06:05:54.030 INFO:tasks.workunit.client.0.smithi072.stdout:3/373: creat d2/d19/d1e/f6f x:0 0 0 2024-03-19T06:05:54.034 INFO:tasks.workunit.client.0.smithi072.stdout:5/498: chown df/d14/c2c 22745190 1 2024-03-19T06:05:54.035 INFO:tasks.workunit.client.0.smithi072.stdout:2/290: dread db/d10/d2b/f4a [0,4194304] 0 2024-03-19T06:05:54.040 INFO:tasks.workunit.client.0.smithi072.stdout:5/499: mkdir df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97 0 2024-03-19T06:05:54.040 INFO:tasks.workunit.client.0.smithi072.stdout:6/289: write d7/d9/d1e/f26 [1264746,63271] 0 2024-03-19T06:05:54.042 INFO:tasks.workunit.client.0.smithi072.stdout:2/291: rename db/d10/d13/l15 to db/d10/d59/l67 0 2024-03-19T06:05:54.045 INFO:tasks.workunit.client.0.smithi072.stdout:6/290: creat d7/d9/d1b/d3b/f62 x:0 0 0 2024-03-19T06:05:54.046 INFO:tasks.workunit.client.0.smithi072.stdout:2/292: symlink db/d10/d2b/d2d/d3f/l68 0 2024-03-19T06:05:54.048 INFO:tasks.workunit.client.0.smithi072.stdout:6/291: unlink d7/d2e/f2f 0 2024-03-19T06:05:54.049 INFO:tasks.workunit.client.0.smithi072.stdout:6/292: chown d7/d2e/f35 1 1 2024-03-19T06:05:54.049 INFO:tasks.workunit.client.0.smithi072.stdout:2/293: symlink db/d10/d13/l69 0 2024-03-19T06:05:54.050 INFO:tasks.workunit.client.0.smithi072.stdout:6/293: fdatasync d7/d9/d2b/f53 0 2024-03-19T06:05:54.051 INFO:tasks.workunit.client.0.smithi072.stdout:5/500: getdents df/d13/d32/d28/d42/d59/d43 0 2024-03-19T06:05:54.053 INFO:tasks.workunit.client.0.smithi072.stdout:2/294: write db/d10/d13/d31/d35/f43 [1422663,62195] 0 2024-03-19T06:05:54.058 INFO:tasks.workunit.client.0.smithi072.stdout:2/295: mkdir db/d10/d2b/d2d/d6a 0 2024-03-19T06:05:54.074 INFO:tasks.workunit.client.0.smithi072.stdout:5/501: dwrite df/d16/f60 [0,4194304] 0 2024-03-19T06:05:54.075 INFO:tasks.workunit.client.0.smithi072.stdout:2/296: dwrite db/f30 [0,4194304] 0 2024-03-19T06:05:54.079 INFO:tasks.workunit.client.0.smithi072.stdout:2/297: mkdir db/d10/d2b/d2d/d62/d6b 0 2024-03-19T06:05:54.080 INFO:tasks.workunit.client.0.smithi072.stdout:5/502: truncate df/d14/f15 1213906 0 2024-03-19T06:05:54.083 INFO:tasks.workunit.client.0.smithi072.stdout:2/298: mknod db/d10/d59/c6c 0 2024-03-19T06:05:54.085 INFO:tasks.workunit.client.0.smithi072.stdout:5/503: creat df/d13/d24/f98 x:0 0 0 2024-03-19T06:05:54.086 INFO:tasks.workunit.client.0.smithi072.stdout:2/299: fdatasync db/d10/f18 0 2024-03-19T06:05:54.089 INFO:tasks.workunit.client.0.smithi072.stdout:5/504: creat df/d13/d32/d28/f99 x:0 0 0 2024-03-19T06:05:54.090 INFO:tasks.workunit.client.0.smithi072.stdout:2/300: write db/d10/d2b/d2d/f46 [2335742,90799] 0 2024-03-19T06:05:54.100 INFO:tasks.workunit.client.0.smithi072.stdout:5/505: creat df/d14/f9a x:0 0 0 2024-03-19T06:05:54.102 INFO:tasks.workunit.client.0.smithi072.stdout:5/506: mknod df/c9b 0 2024-03-19T06:05:54.105 INFO:tasks.workunit.client.0.smithi072.stdout:2/301: write db/f22 [629367,129133] 0 2024-03-19T06:05:54.106 INFO:tasks.workunit.client.0.smithi072.stdout:5/507: mkdir df/d16/d61/d9c 0 2024-03-19T06:05:54.106 INFO:tasks.workunit.client.0.smithi072.stdout:2/302: chown c8 405 1 2024-03-19T06:05:54.118 INFO:tasks.workunit.client.0.smithi072.stdout:2/303: dwrite db/f4f [0,4194304] 0 2024-03-19T06:05:54.125 INFO:tasks.workunit.client.0.smithi072.stdout:2/304: chown db/c40 849098889 1 2024-03-19T06:05:54.127 INFO:tasks.workunit.client.0.smithi072.stdout:2/305: write db/d10/d13/f20 [1265044,55239] 0 2024-03-19T06:05:54.129 INFO:tasks.workunit.client.0.smithi072.stdout:2/306: write db/d10/d13/d31/f5d [592493,121887] 0 2024-03-19T06:05:54.134 INFO:tasks.workunit.client.0.smithi072.stdout:2/307: unlink db/d10/d59/l67 0 2024-03-19T06:05:54.138 INFO:tasks.workunit.client.0.smithi072.stdout:2/308: rename db/l17 to db/d10/d2b/l6d 0 2024-03-19T06:05:54.140 INFO:tasks.workunit.client.0.smithi072.stdout:2/309: write db/d10/d2b/d45/f58 [4212595,59845] 0 2024-03-19T06:05:54.143 INFO:tasks.workunit.client.0.smithi072.stdout:2/310: chown db/d10/d13/l69 28796 1 2024-03-19T06:05:54.145 INFO:tasks.workunit.client.0.smithi072.stdout:2/311: mkdir db/d10/d59/d6e 0 2024-03-19T06:05:54.147 INFO:tasks.workunit.client.0.smithi072.stdout:2/312: write db/d10/d2b/d2d/f46 [5057813,95808] 0 2024-03-19T06:05:54.152 INFO:tasks.workunit.client.0.smithi072.stdout:2/313: creat db/d10/d2b/d2d/d66/f6f x:0 0 0 2024-03-19T06:05:54.161 INFO:tasks.workunit.client.0.smithi072.stdout:2/314: dread db/d10/d13/d31/f3c [0,4194304] 0 2024-03-19T06:05:54.166 INFO:tasks.workunit.client.0.smithi072.stdout:2/315: dread db/d10/d2b/f4b [0,4194304] 0 2024-03-19T06:05:54.169 INFO:tasks.workunit.client.0.smithi072.stdout:2/316: creat db/d10/d13/d31/f70 x:0 0 0 2024-03-19T06:05:54.173 INFO:tasks.workunit.client.0.smithi072.stdout:2/317: unlink db/d10/l47 0 2024-03-19T06:05:54.175 INFO:tasks.workunit.client.0.smithi072.stdout:2/318: write db/d10/d13/d24/f3d [4038310,33252] 0 2024-03-19T06:05:54.191 INFO:tasks.workunit.client.0.smithi072.stdout:2/319: dwrite db/d10/d2b/f4b [0,4194304] 0 2024-03-19T06:05:54.194 INFO:tasks.workunit.client.0.smithi072.stdout:2/320: write db/d10/d13/d24/f3d [2039445,90157] 0 2024-03-19T06:05:54.199 INFO:tasks.workunit.client.0.smithi072.stdout:2/321: fsync db/d10/d13/d24/f3d 0 2024-03-19T06:05:54.203 INFO:tasks.workunit.client.0.smithi072.stdout:2/322: creat db/d10/d2b/d2d/d62/d6b/f71 x:0 0 0 2024-03-19T06:05:54.204 INFO:tasks.workunit.client.0.smithi072.stdout:2/323: dread - db/d10/d59/f5c zero size 2024-03-19T06:05:54.208 INFO:tasks.workunit.client.0.smithi072.stdout:2/324: mkdir db/d10/d13/d24/d72 0 2024-03-19T06:05:54.211 INFO:tasks.workunit.client.0.smithi072.stdout:2/325: getdents db/d10/d2b/d2d/d3f 0 2024-03-19T06:05:54.213 INFO:tasks.workunit.client.0.smithi072.stdout:2/326: read - db/d10/d2b/d2d/d62/f63 zero size 2024-03-19T06:05:54.216 INFO:tasks.workunit.client.0.smithi072.stdout:2/327: truncate db/d10/d44/f65 1044729 0 2024-03-19T06:05:54.218 INFO:tasks.workunit.client.0.smithi072.stdout:2/328: mknod db/d10/d13/d31/c73 0 2024-03-19T06:05:54.223 INFO:tasks.workunit.client.0.smithi072.stdout:2/329: rename db/d10/d44/f49 to db/d10/d13/d24/d72/f74 0 2024-03-19T06:05:54.226 INFO:tasks.workunit.client.0.smithi072.stdout:2/330: write db/d10/d2b/d2d/d3f/d48/f53 [956140,120821] 0 2024-03-19T06:05:54.230 INFO:tasks.workunit.client.0.smithi072.stdout:2/331: creat db/d10/d13/d24/f75 x:0 0 0 2024-03-19T06:05:54.232 INFO:tasks.workunit.client.0.smithi072.stdout:2/332: creat db/d10/d13/f76 x:0 0 0 2024-03-19T06:05:54.246 INFO:tasks.workunit.client.0.smithi072.stdout:2/333: dwrite db/d10/d13/f51 [0,4194304] 0 2024-03-19T06:05:54.249 INFO:tasks.workunit.client.0.smithi072.stdout:2/334: chown db/d10/d13/d31/c73 20 1 2024-03-19T06:05:54.253 INFO:tasks.workunit.client.0.smithi072.stdout:2/335: mkdir db/d10/d2b/d2d/d77 0 2024-03-19T06:05:54.258 INFO:tasks.workunit.client.0.smithi072.stdout:2/336: getdents db/d10/d2b/d2d/d66 0 2024-03-19T06:05:54.260 INFO:tasks.workunit.client.0.smithi072.stdout:2/337: dread - db/d10/d13/d24/f75 zero size 2024-03-19T06:05:54.265 INFO:tasks.workunit.client.0.smithi072.stdout:2/338: link db/d10/d13/d31/c73 db/d10/d59/c78 0 2024-03-19T06:05:54.268 INFO:tasks.workunit.client.0.smithi072.stdout:2/339: mkdir db/d10/d79 0 2024-03-19T06:05:54.268 INFO:tasks.workunit.client.0.smithi072.stdout:2/340: stat db/d10/f18 0 2024-03-19T06:05:54.271 INFO:tasks.workunit.client.0.smithi072.stdout:2/341: mknod db/d10/d2b/d2d/d62/c7a 0 2024-03-19T06:05:54.272 INFO:tasks.workunit.client.0.smithi072.stdout:2/342: chown db/d10/d13/d24 39 1 2024-03-19T06:05:54.282 INFO:tasks.workunit.client.0.smithi072.stdout:2/343: dread db/d10/d12/f14 [0,4194304] 0 2024-03-19T06:05:54.287 INFO:tasks.workunit.client.0.smithi072.stdout:2/344: creat db/d10/d2b/d2d/d3f/d48/f7b x:0 0 0 2024-03-19T06:05:54.291 INFO:tasks.workunit.client.0.smithi072.stdout:2/345: mkdir db/d10/d13/d7c 0 2024-03-19T06:05:54.293 INFO:tasks.workunit.client.0.smithi072.stdout:2/346: fsync db/d10/d13/f26 0 2024-03-19T06:05:54.299 INFO:tasks.workunit.client.0.smithi072.stdout:2/347: rmdir db/d10/d2b/d2d/d62/d6b 39 2024-03-19T06:05:54.302 INFO:tasks.workunit.client.0.smithi072.stdout:2/348: write db/d10/f1d [1644175,69772] 0 2024-03-19T06:05:54.308 INFO:tasks.workunit.client.0.smithi072.stdout:2/349: mkdir db/d10/d13/d24/d61/d7d 0 2024-03-19T06:05:54.312 INFO:tasks.workunit.client.0.smithi072.stdout:2/350: mknod db/d10/d13/c7e 0 2024-03-19T06:05:54.327 INFO:tasks.workunit.client.0.smithi072.stdout:2/351: dwrite db/d10/d13/f26 [0,4194304] 0 2024-03-19T06:05:54.349 INFO:tasks.workunit.client.0.smithi072.stdout:2/352: dwrite db/d10/d13/d31/f5d [0,4194304] 0 2024-03-19T06:05:54.355 INFO:tasks.workunit.client.0.smithi072.stdout:2/353: symlink db/d10/d13/d31/d35/l7f 0 2024-03-19T06:05:54.360 INFO:tasks.workunit.client.0.smithi072.stdout:2/354: mkdir db/d10/d13/d80 0 2024-03-19T06:05:54.363 INFO:tasks.workunit.client.0.smithi072.stdout:2/355: readlink db/d10/d13/d24/l36 0 2024-03-19T06:05:54.378 INFO:tasks.workunit.client.0.smithi072.stdout:2/356: write db/d10/f18 [514257,14559] 0 2024-03-19T06:05:54.383 INFO:tasks.workunit.client.0.smithi072.stdout:2/357: rmdir db/d10/d13/d24 39 2024-03-19T06:05:54.384 INFO:tasks.workunit.client.0.smithi072.stdout:2/358: stat db/d10/d59/d6e 0 2024-03-19T06:05:54.400 INFO:tasks.workunit.client.0.smithi072.stdout:2/359: dwrite db/d10/d2b/f4b [0,4194304] 0 2024-03-19T06:05:54.401 INFO:tasks.workunit.client.0.smithi072.stdout:9/170: sync 2024-03-19T06:05:54.401 INFO:tasks.workunit.client.0.smithi072.stdout:7/222: sync 2024-03-19T06:05:54.401 INFO:tasks.workunit.client.0.smithi072.stdout:4/325: sync 2024-03-19T06:05:54.404 INFO:tasks.workunit.client.0.smithi072.stdout:8/273: sync 2024-03-19T06:05:54.404 INFO:tasks.workunit.client.0.smithi072.stdout:1/268: sync 2024-03-19T06:05:54.404 INFO:tasks.workunit.client.0.smithi072.stdout:0/279: sync 2024-03-19T06:05:54.405 INFO:tasks.workunit.client.0.smithi072.stdout:8/274: dread - da/f50 zero size 2024-03-19T06:05:54.406 INFO:tasks.workunit.client.0.smithi072.stdout:4/326: write d5/d15/d22/d41/d61/f70 [293785,33606] 0 2024-03-19T06:05:54.409 INFO:tasks.workunit.client.0.smithi072.stdout:1/269: read d1/d16/f38 [230306,22282] 0 2024-03-19T06:05:54.410 INFO:tasks.workunit.client.0.smithi072.stdout:4/327: chown d5/d15/d73 3 1 2024-03-19T06:05:54.415 INFO:tasks.workunit.client.0.smithi072.stdout:4/328: write d5/d1b/f5a [706736,62535] 0 2024-03-19T06:05:54.416 INFO:tasks.workunit.client.0.smithi072.stdout:7/223: mknod d2/d3/d18/d33/d1d/d2b/c44 0 2024-03-19T06:05:54.427 INFO:tasks.workunit.client.0.smithi072.stdout:2/360: creat db/d10/d13/d24/d72/f81 x:0 0 0 2024-03-19T06:05:54.427 INFO:tasks.workunit.client.0.smithi072.stdout:4/329: mkdir d5/d1b/d7e 0 2024-03-19T06:05:54.430 INFO:tasks.workunit.client.0.smithi072.stdout:0/280: dwrite d1/f58 [0,4194304] 0 2024-03-19T06:05:54.431 INFO:tasks.workunit.client.0.smithi072.stdout:2/361: chown db/d10/f2e 1 1 2024-03-19T06:05:54.437 INFO:tasks.workunit.client.0.smithi072.stdout:8/275: dwrite da/d13/d14/f28 [0,4194304] 0 2024-03-19T06:05:54.437 INFO:tasks.workunit.client.0.smithi072.stdout:1/270: rename d1/d16/l3f to d1/d11/d18/d19/d1a/d3b/l54 0 2024-03-19T06:05:54.445 INFO:tasks.workunit.client.0.smithi072.stdout:2/362: mkdir db/d10/d2b/d2d/d3f/d48/d82 0 2024-03-19T06:05:54.450 INFO:tasks.workunit.client.0.smithi072.stdout:7/224: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f6 [0,4194304] 0 2024-03-19T06:05:54.450 INFO:tasks.workunit.client.0.smithi072.stdout:0/281: creat d1/d1c/d24/d3f/d4a/f5a x:0 0 0 2024-03-19T06:05:54.453 INFO:tasks.workunit.client.0.smithi072.stdout:1/271: fsync d1/d16/f38 0 2024-03-19T06:05:54.454 INFO:tasks.workunit.client.0.smithi072.stdout:9/171: dread d11/f1b [0,4194304] 0 2024-03-19T06:05:54.460 INFO:tasks.workunit.client.0.smithi072.stdout:4/330: link d5/d15/d53/f6c d5/d15/d31/d7d/f7f 0 2024-03-19T06:05:54.463 INFO:tasks.workunit.client.0.smithi072.stdout:2/363: dwrite db/d10/f1d [0,4194304] 0 2024-03-19T06:05:54.465 INFO:tasks.workunit.client.0.smithi072.stdout:8/276: write da/d13/f4f [107131,70110] 0 2024-03-19T06:05:54.467 INFO:tasks.workunit.client.0.smithi072.stdout:8/277: write da/d13/f4f [617667,18908] 0 2024-03-19T06:05:54.474 INFO:tasks.workunit.client.0.smithi072.stdout:0/282: creat d1/d1c/d24/d3e/f5b x:0 0 0 2024-03-19T06:05:54.474 INFO:tasks.workunit.client.0.smithi072.stdout:7/225: creat d2/d3/d18/d33/d1d/d2b/f45 x:0 0 0 2024-03-19T06:05:54.474 INFO:tasks.workunit.client.0.smithi072.stdout:1/272: mkdir d1/d11/d18/d55 0 2024-03-19T06:05:54.478 INFO:tasks.workunit.client.0.smithi072.stdout:0/283: read d1/f3c [485831,74686] 0 2024-03-19T06:05:54.479 INFO:tasks.workunit.client.0.smithi072.stdout:7/226: unlink d2/d3/d18/f2d 0 2024-03-19T06:05:54.482 INFO:tasks.workunit.client.0.smithi072.stdout:4/331: mknod d5/d15/d22/d41/d61/d71/d72/c80 0 2024-03-19T06:05:54.483 INFO:tasks.workunit.client.0.smithi072.stdout:0/284: write d1/d1c/f4c [617986,32706] 0 2024-03-19T06:05:54.483 INFO:tasks.workunit.client.0.smithi072.stdout:9/172: creat d11/f3c x:0 0 0 2024-03-19T06:05:54.483 INFO:tasks.workunit.client.0.smithi072.stdout:2/364: rmdir db/d10/d79 0 2024-03-19T06:05:54.488 INFO:tasks.workunit.client.0.smithi072.stdout:4/332: write d5/d15/d3f/f5e [311938,66552] 0 2024-03-19T06:05:54.488 INFO:tasks.workunit.client.0.smithi072.stdout:7/227: chown d2/d3/d18/d33/d1d/d2b/d3d/l12 13 1 2024-03-19T06:05:54.491 INFO:tasks.workunit.client.0.smithi072.stdout:2/365: mknod db/d10/d2b/d2d/d62/d6b/c83 0 2024-03-19T06:05:54.492 INFO:tasks.workunit.client.0.smithi072.stdout:7/228: chown d2/d3/d18/d33/d1d/d2b/d3d/f6 9 1 2024-03-19T06:05:54.492 INFO:tasks.workunit.client.0.smithi072.stdout:4/333: read d5/f6 [5091380,54045] 0 2024-03-19T06:05:54.492 INFO:tasks.workunit.client.0.smithi072.stdout:1/273: dread d1/d11/d18/d19/d1a/f2a [0,4194304] 0 2024-03-19T06:05:54.496 INFO:tasks.workunit.client.0.smithi072.stdout:4/334: fdatasync d5/d15/d53/f6c 0 2024-03-19T06:05:54.496 INFO:tasks.workunit.client.0.smithi072.stdout:7/229: rmdir d2/d3/d18/d20 39 2024-03-19T06:05:54.497 INFO:tasks.workunit.client.0.smithi072.stdout:1/274: write d1/f4d [175780,29999] 0 2024-03-19T06:05:54.498 INFO:tasks.workunit.client.0.smithi072.stdout:2/366: unlink db/d10/d2b/d2d/d3f/l68 0 2024-03-19T06:05:54.500 INFO:tasks.workunit.client.0.smithi072.stdout:4/335: mknod d5/d15/d3f/c81 0 2024-03-19T06:05:54.509 INFO:tasks.workunit.client.0.smithi072.stdout:1/275: chown d1/d11/d18/d19/d1a/d25/d3c/c46 0 1 2024-03-19T06:05:54.509 INFO:tasks.workunit.client.0.smithi072.stdout:9/173: dwrite d11/f37 [0,4194304] 0 2024-03-19T06:05:54.510 INFO:tasks.workunit.client.0.smithi072.stdout:2/367: write db/d10/d12/f1b [1976729,93410] 0 2024-03-19T06:05:54.511 INFO:tasks.workunit.client.0.smithi072.stdout:4/336: rename d5/f28 to d5/d15/d31/d6d/f82 0 2024-03-19T06:05:54.516 INFO:tasks.workunit.client.0.smithi072.stdout:0/285: dwrite d1/d1c/d24/d27/f39 [0,4194304] 0 2024-03-19T06:05:54.519 INFO:tasks.workunit.client.0.smithi072.stdout:9/174: creat d11/d1f/f3d x:0 0 0 2024-03-19T06:05:54.519 INFO:tasks.workunit.client.0.smithi072.stdout:2/368: symlink db/d10/d2b/d2d/d3f/d48/l84 0 2024-03-19T06:05:54.521 INFO:tasks.workunit.client.0.smithi072.stdout:2/369: stat l3 0 2024-03-19T06:05:54.524 INFO:tasks.workunit.client.0.smithi072.stdout:0/286: creat d1/d1c/d24/d3f/f5c x:0 0 0 2024-03-19T06:05:54.525 INFO:tasks.workunit.client.0.smithi072.stdout:4/337: rename d5/d15/d3f/f5e to d5/d32/d58/f83 0 2024-03-19T06:05:54.533 INFO:tasks.workunit.client.0.smithi072.stdout:2/370: truncate db/d10/d13/d24/f3d 4262616 0 2024-03-19T06:05:54.538 INFO:tasks.workunit.client.0.smithi072.stdout:0/287: truncate d1/d1c/d24/f32 304505 0 2024-03-19T06:05:54.541 INFO:tasks.workunit.client.0.smithi072.stdout:7/230: dwrite d2/d3/d18/d33/f3c [0,4194304] 0 2024-03-19T06:05:54.542 INFO:tasks.workunit.client.0.smithi072.stdout:1/276: dwrite d1/d11/d18/f49 [0,4194304] 0 2024-03-19T06:05:54.543 INFO:tasks.workunit.client.0.smithi072.stdout:0/288: chown d1/d1c/d24/d3e/d59 376 1 2024-03-19T06:05:54.547 INFO:tasks.workunit.client.0.smithi072.stdout:4/338: rmdir d5/d32 39 2024-03-19T06:05:54.550 INFO:tasks.workunit.client.0.smithi072.stdout:1/277: write d1/d11/f13 [4698056,123760] 0 2024-03-19T06:05:54.554 INFO:tasks.workunit.client.0.smithi072.stdout:9/175: truncate d11/f1e 777644 0 2024-03-19T06:05:54.554 INFO:tasks.workunit.client.0.smithi072.stdout:0/289: truncate d1/d1c/d24/d3f/d4a/f5a 106249 0 2024-03-19T06:05:54.558 INFO:tasks.workunit.client.0.smithi072.stdout:1/278: creat d1/d11/d18/f56 x:0 0 0 2024-03-19T06:05:54.559 INFO:tasks.workunit.client.0.smithi072.stdout:2/371: truncate db/d10/d13/d31/d35/f43 1728858 0 2024-03-19T06:05:54.563 INFO:tasks.workunit.client.0.smithi072.stdout:9/176: mkdir d11/d1f/d2a/d36/d3e 0 2024-03-19T06:05:54.564 INFO:tasks.workunit.client.0.smithi072.stdout:0/290: mkdir d1/d1c/d24/d27/d5d 0 2024-03-19T06:05:54.564 INFO:tasks.workunit.client.0.smithi072.stdout:9/177: stat d11/f23 0 2024-03-19T06:05:54.568 INFO:tasks.workunit.client.0.smithi072.stdout:4/339: getdents d5/d15/d22/d41/d61/d71/d72 0 2024-03-19T06:05:54.569 INFO:tasks.workunit.client.0.smithi072.stdout:1/279: truncate d1/d11/d18/d19/d1a/f2a 4947162 0 2024-03-19T06:05:54.573 INFO:tasks.workunit.client.0.smithi072.stdout:7/231: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f39 [4194304,4194304] 0 2024-03-19T06:05:54.573 INFO:tasks.workunit.client.0.smithi072.stdout:2/372: readlink db/d10/d12/l5b 0 2024-03-19T06:05:54.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:54 smithi072 ceph-mon[28706]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T06:05:54.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:54 smithi072 ceph-mon[28706]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T06:05:54.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:54 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:54.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:54 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:54.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:54 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:54.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:54 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:54.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:54 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:54.579 INFO:tasks.workunit.client.0.smithi072.stdout:1/280: dread d1/f4d [0,4194304] 0 2024-03-19T06:05:54.579 INFO:tasks.workunit.client.0.smithi072.stdout:4/340: truncate d5/d11/f36 277603 0 2024-03-19T06:05:54.581 INFO:tasks.workunit.client.0.smithi072.stdout:2/373: write db/d10/d12/f14 [5092835,7045] 0 2024-03-19T06:05:54.581 INFO:tasks.workunit.client.0.smithi072.stdout:7/232: creat d2/d3/d18/d33/d1d/f46 x:0 0 0 2024-03-19T06:05:54.582 INFO:tasks.workunit.client.0.smithi072.stdout:9/178: dread d11/f1e [0,4194304] 0 2024-03-19T06:05:54.585 INFO:tasks.workunit.client.0.smithi072.stdout:4/341: mknod d5/d37/d52/c84 0 2024-03-19T06:05:54.591 INFO:tasks.workunit.client.0.smithi072.stdout:1/281: rename d1/d11/d18/d19/d1a/c35 to d1/d16/c57 0 2024-03-19T06:05:54.593 INFO:tasks.workunit.client.0.smithi072.stdout:7/233: unlink d2/d3/d18/d2f/l15 0 2024-03-19T06:05:54.594 INFO:tasks.workunit.client.0.smithi072.stdout:4/342: creat d5/d32/d58/f85 x:0 0 0 2024-03-19T06:05:54.597 INFO:tasks.workunit.client.0.smithi072.stdout:9/179: rename fa to d11/d1f/d2a/d36/f3f 0 2024-03-19T06:05:54.599 INFO:tasks.workunit.client.0.smithi072.stdout:4/343: write d5/d15/d31/f3c [1037143,59632] 0 2024-03-19T06:05:54.599 INFO:tasks.workunit.client.0.smithi072.stdout:9/180: chown d11/d24 6892440 1 2024-03-19T06:05:54.604 INFO:tasks.workunit.client.0.smithi072.stdout:9/181: write d11/f37 [4818495,71038] 0 2024-03-19T06:05:54.609 INFO:tasks.workunit.client.0.smithi072.stdout:9/182: write d11/f17 [4298442,35098] 0 2024-03-19T06:05:54.613 INFO:tasks.workunit.client.0.smithi072.stdout:4/344: mknod d5/d15/d31/d6f/c86 0 2024-03-19T06:05:54.614 INFO:tasks.workunit.client.0.smithi072.stdout:1/282: link d1/d11/d18/d19/d1a/c26 d1/d11/d18/d19/d1a/d25/d3c/d48/c58 0 2024-03-19T06:05:54.615 INFO:tasks.workunit.client.0.smithi072.stdout:2/374: dwrite db/d10/d2b/d2d/d62/d6b/f71 [0,4194304] 0 2024-03-19T06:05:54.617 INFO:tasks.workunit.client.0.smithi072.stdout:4/345: stat d5/d37/d52/l5f 0 2024-03-19T06:05:54.622 INFO:tasks.workunit.client.0.smithi072.stdout:4/346: fdatasync d5/d15/d50/f2f 0 2024-03-19T06:05:54.625 INFO:tasks.workunit.client.0.smithi072.stdout:4/347: stat d5/d11/f1a 0 2024-03-19T06:05:54.626 INFO:tasks.workunit.client.0.smithi072.stdout:2/375: creat db/d10/d2b/f85 x:0 0 0 2024-03-19T06:05:54.630 INFO:tasks.workunit.client.0.smithi072.stdout:4/348: readlink d5/l35 0 2024-03-19T06:05:54.631 INFO:tasks.workunit.client.0.smithi072.stdout:1/283: link d1/ld d1/d11/l59 0 2024-03-19T06:05:54.635 INFO:tasks.workunit.client.0.smithi072.stdout:7/234: truncate d2/d3/d18/d33/f3c 3410818 0 2024-03-19T06:05:54.640 INFO:tasks.workunit.client.0.smithi072.stdout:9/183: truncate d11/d26/f2c 2472267 0 2024-03-19T06:05:54.642 INFO:tasks.workunit.client.0.smithi072.stdout:4/349: link d5/d11/l59 d5/d1b/d7e/l87 0 2024-03-19T06:05:54.645 INFO:tasks.workunit.client.0.smithi072.stdout:9/184: chown d11/d1f/d2a/d36/f3f 145354 1 2024-03-19T06:05:54.645 INFO:tasks.workunit.client.0.smithi072.stdout:4/350: stat d5/d15/d31 0 2024-03-19T06:05:54.654 INFO:tasks.workunit.client.0.smithi072.stdout:4/351: fsync d5/fa 0 2024-03-19T06:05:54.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:54 smithi172 ceph-mon[35716]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T06:05:54.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:54 smithi172 ceph-mon[35716]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T06:05:54.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:54 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:54.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:54 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:54.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:54 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:54.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:54 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:54.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:54 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:05:54.658 INFO:tasks.workunit.client.0.smithi072.stdout:4/352: chown d5/d15/d31/d4c 109050 1 2024-03-19T06:05:54.660 INFO:tasks.workunit.client.0.smithi072.stdout:2/376: dread db/d10/d12/f14 [0,4194304] 0 2024-03-19T06:05:54.661 INFO:tasks.workunit.client.0.smithi072.stdout:1/284: truncate d1/d11/f39 3128701 0 2024-03-19T06:05:54.665 INFO:tasks.workunit.client.0.smithi072.stdout:4/353: unlink d5/cb 0 2024-03-19T06:05:54.671 INFO:tasks.workunit.client.0.smithi072.stdout:2/377: mkdir db/d10/d13/d24/d72/d86 0 2024-03-19T06:05:54.671 INFO:tasks.workunit.client.0.smithi072.stdout:7/235: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f6 [4194304,4194304] 0 2024-03-19T06:05:54.672 INFO:tasks.workunit.client.0.smithi072.stdout:4/354: creat d5/d15/d31/d6d/d7a/f88 x:0 0 0 2024-03-19T06:05:54.675 INFO:tasks.workunit.client.0.smithi072.stdout:7/236: chown d2/d3/d18/d33/c1f 470 1 2024-03-19T06:05:54.678 INFO:tasks.workunit.client.0.smithi072.stdout:2/378: creat db/d10/d2b/d2d/d3f/d48/f87 x:0 0 0 2024-03-19T06:05:54.679 INFO:tasks.workunit.client.0.smithi072.stdout:4/355: truncate d5/d15/d31/d6d/d7a/f88 577927 0 2024-03-19T06:05:54.682 INFO:tasks.workunit.client.0.smithi072.stdout:7/237: write d2/d3/d18/d33/d1d/f46 [687800,23123] 0 2024-03-19T06:05:54.684 INFO:tasks.workunit.client.0.smithi072.stdout:9/185: link d11/d26/f2c d11/d1f/d2a/d36/f40 0 2024-03-19T06:05:54.692 INFO:tasks.workunit.client.0.smithi072.stdout:1/285: dread d1/d11/d18/d19/d1a/d25/d3c/f3e [0,4194304] 0 2024-03-19T06:05:54.705 INFO:tasks.workunit.client.0.smithi072.stdout:7/238: creat d2/d3/d18/d20/f47 x:0 0 0 2024-03-19T06:05:54.706 INFO:tasks.workunit.client.0.smithi072.stdout:1/286: creat d1/d16/f5a x:0 0 0 2024-03-19T06:05:54.707 INFO:tasks.workunit.client.0.smithi072.stdout:1/287: stat d1/d16/f3a 0 2024-03-19T06:05:54.711 INFO:tasks.workunit.client.0.smithi072.stdout:7/239: chown d2/d3/d18/d2f/f23 383323 1 2024-03-19T06:05:54.711 INFO:tasks.workunit.client.0.smithi072.stdout:9/186: mknod d11/d1f/d2a/d36/d3e/c41 0 2024-03-19T06:05:54.711 INFO:tasks.workunit.client.0.smithi072.stdout:9/187: stat d11/f25 0 2024-03-19T06:05:54.714 INFO:tasks.workunit.client.0.smithi072.stdout:2/379: getdents db/d10/d2b/d2d 0 2024-03-19T06:05:54.716 INFO:tasks.workunit.client.0.smithi072.stdout:1/288: rmdir d1/d11/d18/d55 0 2024-03-19T06:05:54.717 INFO:tasks.workunit.client.0.smithi072.stdout:9/188: fdatasync d11/f1d 0 2024-03-19T06:05:54.722 INFO:tasks.workunit.client.0.smithi072.stdout:9/189: write d11/d1f/f27 [483910,20809] 0 2024-03-19T06:05:54.723 INFO:tasks.workunit.client.0.smithi072.stdout:1/289: write d1/d16/f3a [204483,52223] 0 2024-03-19T06:05:54.724 INFO:tasks.workunit.client.0.smithi072.stdout:2/380: rename db/d10/d59/d6e to db/d10/d2b/d2d/d62/d6b/d88 0 2024-03-19T06:05:54.725 INFO:tasks.workunit.client.0.smithi072.stdout:9/190: chown d11/f19 3528583 1 2024-03-19T06:05:54.731 INFO:tasks.workunit.client.0.smithi072.stdout:1/290: write d1/d11/d18/d19/d1a/d25/f43 [876256,115204] 0 2024-03-19T06:05:54.732 INFO:tasks.workunit.client.0.smithi072.stdout:9/191: creat d11/d1f/d2a/d36/f42 x:0 0 0 2024-03-19T06:05:54.738 INFO:tasks.workunit.client.0.smithi072.stdout:1/291: chown d1/l45 3424 1 2024-03-19T06:05:54.743 INFO:tasks.workunit.client.0.smithi072.stdout:9/192: chown d11/d24/c32 1496451008 1 2024-03-19T06:05:54.745 INFO:tasks.workunit.client.0.smithi072.stdout:2/381: symlink db/d10/d2b/d2d/d6a/l89 0 2024-03-19T06:05:54.748 INFO:tasks.workunit.client.0.smithi072.stdout:9/193: stat c8 0 2024-03-19T06:05:54.750 INFO:tasks.workunit.client.0.smithi072.stdout:1/292: creat d1/d11/d18/d19/d1a/d25/d3c/f5b x:0 0 0 2024-03-19T06:05:54.754 INFO:tasks.workunit.client.0.smithi072.stdout:1/293: chown d1/d11/d18 130047476 1 2024-03-19T06:05:54.755 INFO:tasks.workunit.client.0.smithi072.stdout:2/382: creat db/d10/d2b/d2d/d62/d6b/f8a x:0 0 0 2024-03-19T06:05:54.756 INFO:tasks.workunit.client.0.smithi072.stdout:9/194: dread - d11/d24/f28 zero size 2024-03-19T06:05:54.759 INFO:tasks.workunit.client.0.smithi072.stdout:4/356: dwrite d5/d37/f69 [0,4194304] 0 2024-03-19T06:05:54.759 INFO:tasks.workunit.client.0.smithi072.stdout:7/240: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f11 [0,4194304] 0 2024-03-19T06:05:54.765 INFO:tasks.workunit.client.0.smithi072.stdout:2/383: fsync db/d10/d12/f14 0 2024-03-19T06:05:54.767 INFO:tasks.workunit.client.0.smithi072.stdout:9/195: read - d11/d1f/d2a/d36/f42 zero size 2024-03-19T06:05:54.772 INFO:tasks.workunit.client.0.smithi072.stdout:7/241: read - d2/d3/d18/d20/f47 zero size 2024-03-19T06:05:54.780 INFO:tasks.workunit.client.0.smithi072.stdout:9/196: chown d11/d1f/d2a/d36/d3e/c41 53777238 1 2024-03-19T06:05:54.783 INFO:tasks.workunit.client.0.smithi072.stdout:2/384: mknod db/d10/d2b/d2d/d66/c8b 0 2024-03-19T06:05:54.784 INFO:tasks.workunit.client.0.smithi072.stdout:2/385: readlink l2 0 2024-03-19T06:05:54.790 INFO:tasks.workunit.client.0.smithi072.stdout:7/242: rename d2/d3/d18/d2f/f23 to d2/d3/d17/f48 0 2024-03-19T06:05:54.790 INFO:tasks.workunit.client.0.smithi072.stdout:2/386: mkdir db/d10/d13/d7c/d8c 0 2024-03-19T06:05:54.795 INFO:tasks.workunit.client.0.smithi072.stdout:1/294: dwrite d1/f4e [0,4194304] 0 2024-03-19T06:05:54.796 INFO:tasks.workunit.client.0.smithi072.stdout:2/387: creat db/d10/d59/f8d x:0 0 0 2024-03-19T06:05:54.797 INFO:tasks.workunit.client.0.smithi072.stdout:7/243: fdatasync d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/f35 0 2024-03-19T06:05:54.798 INFO:tasks.workunit.client.0.smithi072.stdout:2/388: readlink db/l11 0 2024-03-19T06:05:54.799 INFO:tasks.workunit.client.0.smithi072.stdout:7/244: readlink d2/d3/d18/d33/d1d/d2b/d3d/l12 0 2024-03-19T06:05:54.801 INFO:tasks.workunit.client.0.smithi072.stdout:1/295: fdatasync d1/d16/f3a 0 2024-03-19T06:05:54.806 INFO:tasks.workunit.client.0.smithi072.stdout:7/245: dread - d2/d3/d18/d33/d1d/d2b/f45 zero size 2024-03-19T06:05:54.809 INFO:tasks.workunit.client.0.smithi072.stdout:1/296: stat d1/d11/d18/d19/d1a/d3b/l54 0 2024-03-19T06:05:54.813 INFO:tasks.workunit.client.0.smithi072.stdout:7/246: creat d2/d3/d18/d33/d1d/d2b/f49 x:0 0 0 2024-03-19T06:05:54.814 INFO:tasks.workunit.client.0.smithi072.stdout:1/297: chown d1/d11/c32 5133 1 2024-03-19T06:05:54.815 INFO:tasks.workunit.client.0.smithi072.stdout:9/197: dwrite d11/f25 [0,4194304] 0 2024-03-19T06:05:54.817 INFO:tasks.workunit.client.0.smithi072.stdout:1/298: readlink d1/d11/d18/d19/d1a/d3b/l54 0 2024-03-19T06:05:54.819 INFO:tasks.workunit.client.0.smithi072.stdout:7/247: stat d2/d3/d18/d33/d1d/d2b/d3d/l12 0 2024-03-19T06:05:54.822 INFO:tasks.workunit.client.0.smithi072.stdout:9/198: chown d11/c14 44696 1 2024-03-19T06:05:54.823 INFO:tasks.workunit.client.0.smithi072.stdout:2/389: dread db/d10/d2b/d2d/d3f/d48/f53 [0,4194304] 0 2024-03-19T06:05:54.823 INFO:tasks.workunit.client.0.smithi072.stdout:1/299: stat d1/d11/d18/d19/d1a/f2a 0 2024-03-19T06:05:54.827 INFO:tasks.workunit.client.0.smithi072.stdout:1/300: chown d1/l10 172 1 2024-03-19T06:05:54.827 INFO:tasks.workunit.client.0.smithi072.stdout:7/248: readlink d2/d3/d18/d33/d1d/d2b/d3d/l42 0 2024-03-19T06:05:54.830 INFO:tasks.workunit.client.0.smithi072.stdout:9/199: unlink d11/c14 0 2024-03-19T06:05:54.832 INFO:tasks.workunit.client.0.smithi072.stdout:1/301: chown d1/d11/d18/d19/d1a/d25 978441 1 2024-03-19T06:05:54.833 INFO:tasks.workunit.client.0.smithi072.stdout:9/200: mkdir d11/d1f/d43 0 2024-03-19T06:05:54.836 INFO:tasks.workunit.client.0.smithi072.stdout:9/201: read - d11/d1f/f3d zero size 2024-03-19T06:05:54.837 INFO:tasks.workunit.client.0.smithi072.stdout:2/390: rename db/d10/d13/d7c/d8c to db/d10/d13/d8e 0 2024-03-19T06:05:54.839 INFO:tasks.workunit.client.0.smithi072.stdout:7/249: creat d2/d3/d18/d33/d1d/d2b/f4a x:0 0 0 2024-03-19T06:05:54.840 INFO:tasks.workunit.client.0.smithi072.stdout:9/202: truncate d11/f19 5104171 0 2024-03-19T06:05:54.842 INFO:tasks.workunit.client.0.smithi072.stdout:9/203: dread - d11/d1f/f3a zero size 2024-03-19T06:05:54.842 INFO:tasks.workunit.client.0.smithi072.stdout:1/302: creat d1/d11/d18/d19/d1a/d25/d3c/d52/f5c x:0 0 0 2024-03-19T06:05:54.844 INFO:tasks.workunit.client.0.smithi072.stdout:9/204: chown c10 3458661 1 2024-03-19T06:05:54.845 INFO:tasks.workunit.client.0.smithi072.stdout:2/391: rmdir db/d10/d2b 39 2024-03-19T06:05:54.847 INFO:tasks.workunit.client.0.smithi072.stdout:9/205: rmdir d11/d1f/d2a/d36/d3e 39 2024-03-19T06:05:54.849 INFO:tasks.workunit.client.0.smithi072.stdout:9/206: dread - d11/d24/f28 zero size 2024-03-19T06:05:54.853 INFO:tasks.workunit.client.0.smithi072.stdout:2/392: chown db/d10/d2b/d45/f55 10306357 1 2024-03-19T06:05:54.858 INFO:tasks.workunit.client.0.smithi072.stdout:9/207: dread d11/f1e [0,4194304] 0 2024-03-19T06:05:54.858 INFO:tasks.workunit.client.0.smithi072.stdout:1/303: dread d1/d11/d18/d19/d1a/d25/f43 [0,4194304] 0 2024-03-19T06:05:54.861 INFO:tasks.workunit.client.0.smithi072.stdout:9/208: chown d11/f17 2082693 1 2024-03-19T06:05:54.861 INFO:tasks.workunit.client.0.smithi072.stdout:1/304: fdatasync d1/d11/f1c 0 2024-03-19T06:05:54.862 INFO:tasks.workunit.client.0.smithi072.stdout:2/393: truncate db/d10/d2b/d2d/d62/f63 53572 0 2024-03-19T06:05:54.863 INFO:tasks.workunit.client.0.smithi072.stdout:1/305: truncate d1/f6 4507216 0 2024-03-19T06:05:54.864 INFO:tasks.workunit.client.0.smithi072.stdout:2/394: chown db/d10/d13/d31/d35 3 1 2024-03-19T06:05:54.865 INFO:tasks.workunit.client.0.smithi072.stdout:2/395: chown db 256715 1 2024-03-19T06:05:54.921 INFO:tasks.workunit.client.0.smithi072.stdout:9/209: write d11/d1f/f39 [682768,90212] 0 2024-03-19T06:05:54.924 INFO:tasks.workunit.client.0.smithi072.stdout:1/306: truncate d1/d16/f5a 1016601 0 2024-03-19T06:05:54.926 INFO:tasks.workunit.client.0.smithi072.stdout:7/250: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f7 [0,4194304] 0 2024-03-19T06:05:54.928 INFO:tasks.workunit.client.0.smithi072.stdout:2/396: truncate db/d10/d13/d24/d72/f81 937757 0 2024-03-19T06:05:54.929 INFO:tasks.workunit.client.0.smithi072.stdout:1/307: symlink d1/d11/d18/l5d 0 2024-03-19T06:05:54.931 INFO:tasks.workunit.client.0.smithi072.stdout:7/251: creat d2/d3/d18/d33/d1d/d2b/f4b x:0 0 0 2024-03-19T06:05:54.933 INFO:tasks.workunit.client.0.smithi072.stdout:7/252: fsync d2/d3/d18/d33/d1d/f46 0 2024-03-19T06:05:54.934 INFO:tasks.workunit.client.0.smithi072.stdout:9/210: creat d11/f44 x:0 0 0 2024-03-19T06:05:54.936 INFO:tasks.workunit.client.0.smithi072.stdout:7/253: stat d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/f35 0 2024-03-19T06:05:54.936 INFO:tasks.workunit.client.0.smithi072.stdout:2/397: symlink db/d10/d2b/d45/l8f 0 2024-03-19T06:05:54.938 INFO:tasks.workunit.client.0.smithi072.stdout:2/398: readlink db/d10/d2b/d2d/d6a/l89 0 2024-03-19T06:05:54.943 INFO:tasks.workunit.client.0.smithi072.stdout:9/211: write d11/f1e [987366,28588] 0 2024-03-19T06:05:54.950 INFO:tasks.workunit.client.0.smithi072.stdout:2/399: write db/d10/d2b/d2d/d3f/d48/f53 [611880,120460] 0 2024-03-19T06:05:54.950 INFO:tasks.workunit.client.0.smithi072.stdout:1/308: dwrite d1/f27 [4194304,4194304] 0 2024-03-19T06:05:54.953 INFO:tasks.workunit.client.0.smithi072.stdout:7/254: truncate d2/d3/d18/d33/f3c 1150671 0 2024-03-19T06:05:54.959 INFO:tasks.workunit.client.0.smithi072.stdout:1/309: dread d1/d11/d18/d19/d1a/f34 [0,4194304] 0 2024-03-19T06:05:54.966 INFO:tasks.workunit.client.0.smithi072.stdout:1/310: chown d1/d11/d18/d19/d1a/d25/c30 320 1 2024-03-19T06:05:54.966 INFO:tasks.workunit.client.0.smithi072.stdout:9/212: dwrite fe [4194304,4194304] 0 2024-03-19T06:05:54.972 INFO:tasks.workunit.client.0.smithi072.stdout:2/400: dwrite db/d10/d13/d31/f70 [0,4194304] 0 2024-03-19T06:05:54.974 INFO:tasks.workunit.client.0.smithi072.stdout:9/213: write d11/f1b [3711848,94248] 0 2024-03-19T06:05:54.975 INFO:tasks.workunit.client.0.smithi072.stdout:2/401: chown db/l57 59 1 2024-03-19T06:05:54.982 INFO:tasks.workunit.client.0.smithi072.stdout:2/402: write db/d10/d2b/d2d/d62/d6b/f71 [1310029,128108] 0 2024-03-19T06:05:54.989 INFO:tasks.workunit.client.0.smithi072.stdout:2/403: truncate db/d10/d59/f5c 585228 0 2024-03-19T06:05:54.989 INFO:tasks.workunit.client.0.smithi072.stdout:9/214: dread d11/d1f/f27 [0,4194304] 0 2024-03-19T06:05:54.989 INFO:tasks.workunit.client.0.smithi072.stdout:7/255: dwrite d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/f35 [0,4194304] 0 2024-03-19T06:05:54.997 INFO:tasks.workunit.client.0.smithi072.stdout:9/215: unlink d11/d1f/d2a/d36/c38 0 2024-03-19T06:05:54.998 INFO:tasks.workunit.client.0.smithi072.stdout:2/404: write db/d10/d2b/d45/f55 [188986,12810] 0 2024-03-19T06:05:55.001 INFO:tasks.workunit.client.0.smithi072.stdout:1/311: dwrite d1/d11/d18/d19/d1a/d25/d3c/f5b [0,4194304] 0 2024-03-19T06:05:55.004 INFO:tasks.workunit.client.0.smithi072.stdout:2/405: symlink db/d10/d12/l90 0 2024-03-19T06:05:55.005 INFO:tasks.workunit.client.0.smithi072.stdout:9/216: mkdir d11/d1f/d2a/d36/d45 0 2024-03-19T06:05:55.009 INFO:tasks.workunit.client.0.smithi072.stdout:9/217: chown d11/d1f/f27 24045462 1 2024-03-19T06:05:55.010 INFO:tasks.workunit.client.0.smithi072.stdout:7/256: rename d2/d3/d18/d33/d1d/f40 to d2/f4c 0 2024-03-19T06:05:55.010 INFO:tasks.workunit.client.0.smithi072.stdout:2/406: rmdir db/d10/d13/d31 39 2024-03-19T06:05:55.014 INFO:tasks.workunit.client.0.smithi072.stdout:9/218: chown d11/c1a 57842 1 2024-03-19T06:05:55.018 INFO:tasks.workunit.client.0.smithi072.stdout:9/219: chown d11/d1f/d2a/d36/f42 59747 1 2024-03-19T06:05:55.021 INFO:tasks.workunit.client.0.smithi072.stdout:7/257: link d2/d3/d18/d33/d1d/d2b/d3d/cb d2/d3/d18/d3f/c4d 0 2024-03-19T06:05:55.024 INFO:tasks.workunit.client.0.smithi072.stdout:7/258: dread - d2/d3/d18/d33/d1d/d2b/f4a zero size 2024-03-19T06:05:55.024 INFO:tasks.workunit.client.0.smithi072.stdout:1/312: dread d1/d11/f13 [0,4194304] 0 2024-03-19T06:05:55.028 INFO:tasks.workunit.client.0.smithi072.stdout:7/259: creat d2/d3/d43/f4e x:0 0 0 2024-03-19T06:05:55.028 INFO:tasks.workunit.client.0.smithi072.stdout:2/407: dread db/d10/d13/d31/f5d [0,4194304] 0 2024-03-19T06:05:55.029 INFO:tasks.workunit.client.0.smithi072.stdout:7/260: chown d2/d3/d18/d33/d1d/d2b/d3d 13 1 2024-03-19T06:05:55.030 INFO:tasks.workunit.client.0.smithi072.stdout:2/408: symlink db/d10/d13/d24/l91 0 2024-03-19T06:05:55.031 INFO:tasks.workunit.client.0.smithi072.stdout:7/261: chown d2/d3/d18/d33 793427429 1 2024-03-19T06:05:55.041 INFO:tasks.workunit.client.0.smithi072.stdout:9/220: dwrite d11/d1f/d2a/d36/f3f [0,4194304] 0 2024-03-19T06:05:55.044 INFO:tasks.workunit.client.0.smithi072.stdout:1/313: dwrite d1/d16/f31 [0,4194304] 0 2024-03-19T06:05:55.047 INFO:tasks.workunit.client.0.smithi072.stdout:9/221: symlink d11/d26/l46 0 2024-03-19T06:05:55.054 INFO:tasks.workunit.client.0.smithi072.stdout:9/222: rename d11/d26/l46 to d11/d26/l47 0 2024-03-19T06:05:55.059 INFO:tasks.workunit.client.0.smithi072.stdout:7/262: dwrite d2/f4c [0,4194304] 0 2024-03-19T06:05:55.059 INFO:tasks.workunit.client.0.smithi072.stdout:9/223: unlink d11/d26/l2e 0 2024-03-19T06:05:55.063 INFO:tasks.workunit.client.0.smithi072.stdout:9/224: chown d11/d1f/d2a/d36/f3f 2392940 1 2024-03-19T06:05:55.075 INFO:tasks.workunit.client.0.smithi072.stdout:1/314: dwrite d1/d11/d18/f49 [0,4194304] 0 2024-03-19T06:05:55.080 INFO:tasks.workunit.client.0.smithi072.stdout:7/263: creat d2/d3/d18/d33/d1d/d2b/d3d/f4f x:0 0 0 2024-03-19T06:05:55.082 INFO:tasks.workunit.client.0.smithi072.stdout:1/315: getdents d1/d11/d18/d19/d1a/d25/d3c/d48 0 2024-03-19T06:05:55.084 INFO:tasks.workunit.client.0.smithi072.stdout:9/225: truncate fe 6257443 0 2024-03-19T06:05:55.085 INFO:tasks.workunit.client.0.smithi072.stdout:7/264: mkdir d2/d3/d18/d20/d3a/d50 0 2024-03-19T06:05:55.087 INFO:tasks.workunit.client.0.smithi072.stdout:7/265: chown d2/d3/d18/d33/d1d 5853 1 2024-03-19T06:05:55.089 INFO:tasks.workunit.client.0.smithi072.stdout:9/226: creat d11/d24/f48 x:0 0 0 2024-03-19T06:05:55.092 INFO:tasks.workunit.client.0.smithi072.stdout:7/266: symlink d2/d3/d18/d33/d1d/d3b/l51 0 2024-03-19T06:05:55.106 INFO:tasks.workunit.client.0.smithi072.stdout:1/316: truncate d1/d11/d18/d19/d1a/d25/d3c/f3e 670155 0 2024-03-19T06:05:55.107 INFO:tasks.workunit.client.0.smithi072.stdout:7/267: write d2/d3/d18/d33/f3c [1728996,127636] 0 2024-03-19T06:05:55.108 INFO:tasks.workunit.client.0.smithi072.stdout:1/317: chown d1/d16/c53 0 1 2024-03-19T06:05:55.108 INFO:tasks.workunit.client.0.smithi072.stdout:9/227: dwrite d11/f44 [0,4194304] 0 2024-03-19T06:05:55.112 INFO:tasks.workunit.client.0.smithi072.stdout:7/268: write d2/d3/d18/d33/d1d/d2b/f49 [809206,117383] 0 2024-03-19T06:05:55.116 INFO:tasks.workunit.client.0.smithi072.stdout:9/228: getdents d11/d1f/d2a/d36 0 2024-03-19T06:05:55.119 INFO:tasks.workunit.client.0.smithi072.stdout:9/229: mknod d11/d24/c49 0 2024-03-19T06:05:55.123 INFO:tasks.workunit.client.0.smithi072.stdout:7/269: rename d2/d3/d18/d33/d1d/d2b/c44 to d2/d3/d18/d3f/c52 0 2024-03-19T06:05:55.126 INFO:tasks.workunit.client.0.smithi072.stdout:3/374: sync 2024-03-19T06:05:55.127 INFO:tasks.workunit.client.0.smithi072.stdout:9/230: chown d11/c18 790870 1 2024-03-19T06:05:55.127 INFO:tasks.workunit.client.0.smithi072.stdout:3/375: readlink d2/l1f 0 2024-03-19T06:05:55.128 INFO:tasks.workunit.client.0.smithi072.stdout:7/270: stat d2/d3/d18/d33/d1d/d2b/d3d/l12 0 2024-03-19T06:05:55.128 INFO:tasks.workunit.client.0.smithi072.stdout:1/318: dwrite d1/f4e [0,4194304] 0 2024-03-19T06:05:55.129 INFO:tasks.workunit.client.0.smithi072.stdout:3/376: fdatasync d2/d19/f6c 0 2024-03-19T06:05:55.132 INFO:tasks.workunit.client.0.smithi072.stdout:3/377: readlink d2/d3/l63 0 2024-03-19T06:05:55.135 INFO:tasks.workunit.client.0.smithi072.stdout:3/378: dread - d2/d3/d15/f67 zero size 2024-03-19T06:05:55.137 INFO:tasks.workunit.client.0.smithi072.stdout:9/231: truncate d11/d1f/d2a/d36/f40 3456328 0 2024-03-19T06:05:55.139 INFO:tasks.workunit.client.0.smithi072.stdout:9/232: write d11/f19 [4983727,4406] 0 2024-03-19T06:05:55.140 INFO:tasks.workunit.client.0.smithi072.stdout:9/233: stat d11/f1e 0 2024-03-19T06:05:55.142 INFO:tasks.workunit.client.0.smithi072.stdout:3/379: mkdir d2/d3/d15/d66/d70 0 2024-03-19T06:05:55.145 INFO:tasks.workunit.client.0.smithi072.stdout:9/234: creat d11/d1f/d2a/d36/d45/f4a x:0 0 0 2024-03-19T06:05:55.146 INFO:tasks.workunit.client.0.smithi072.stdout:3/380: fsync d2/d3/d25/f42 0 2024-03-19T06:05:55.147 INFO:tasks.workunit.client.0.smithi072.stdout:1/319: dread d1/d11/d18/d19/d1a/f2a [0,4194304] 0 2024-03-19T06:05:55.148 INFO:tasks.workunit.client.0.smithi072.stdout:3/381: chown d2/d3 38141 1 2024-03-19T06:05:55.148 INFO:tasks.workunit.client.0.smithi072.stdout:9/235: write d11/f17 [3284575,33701] 0 2024-03-19T06:05:55.151 INFO:tasks.workunit.client.0.smithi072.stdout:3/382: write d2/d19/f65 [2022096,52598] 0 2024-03-19T06:05:55.151 INFO:tasks.workunit.client.0.smithi072.stdout:9/236: rmdir d11/d1f/d2a/d36 39 2024-03-19T06:05:55.155 INFO:tasks.workunit.client.0.smithi072.stdout:9/237: unlink lf 0 2024-03-19T06:05:55.155 INFO:tasks.workunit.client.0.smithi072.stdout:7/271: dwrite d2/d3/d17/f48 [4194304,4194304] 0 2024-03-19T06:05:55.158 INFO:tasks.workunit.client.0.smithi072.stdout:9/238: chown c8 5 1 2024-03-19T06:05:55.159 INFO:tasks.workunit.client.0.smithi072.stdout:7/272: mkdir d2/d3/d18/d33/d53 0 2024-03-19T06:05:55.311 INFO:tasks.workunit.client.0.smithi072.stdout:9/239: mkdir d11/d4b 0 2024-03-19T06:05:55.314 INFO:tasks.workunit.client.0.smithi072.stdout:9/240: fdatasync d11/d1f/f39 0 2024-03-19T06:05:55.316 INFO:tasks.workunit.client.0.smithi072.stdout:7/273: symlink d2/d3/d18/d33/d1d/d2b/d3d/l54 0 2024-03-19T06:05:55.319 INFO:tasks.workunit.client.0.smithi072.stdout:9/241: fsync d11/d1f/d2a/d36/f42 0 2024-03-19T06:05:55.324 INFO:tasks.workunit.client.0.smithi072.stdout:3/383: dread d2/f2f [0,4194304] 0 2024-03-19T06:05:55.325 INFO:tasks.workunit.client.0.smithi072.stdout:7/274: unlink d2/d3/d18/d33/d1d/d2b/d3d/f6 0 2024-03-19T06:05:55.327 INFO:tasks.workunit.client.0.smithi072.stdout:3/384: chown d2/d19/d1e/l45 0 1 2024-03-19T06:05:55.330 INFO:tasks.workunit.client.0.smithi072.stdout:9/242: rmdir d11/d24 39 2024-03-19T06:05:55.331 INFO:tasks.workunit.client.0.smithi072.stdout:7/275: write d2/d3/d18/d33/d1d/d2b/d3d/f4f [319973,26762] 0 2024-03-19T06:05:55.337 INFO:tasks.workunit.client.0.smithi072.stdout:7/276: truncate d2/d3/d18/d33/d1d/d2b/f4b 1040018 0 2024-03-19T06:05:55.340 INFO:tasks.workunit.client.0.smithi072.stdout:7/277: write d2/d3/d18/d33/d1d/f46 [890260,9889] 0 2024-03-19T06:05:55.342 INFO:tasks.workunit.client.0.smithi072.stdout:9/243: mkdir d11/d24/d4c 0 2024-03-19T06:05:55.345 INFO:tasks.workunit.client.0.smithi072.stdout:7/278: truncate d2/d3/d18/d33/d1d/d2b/f4a 592318 0 2024-03-19T06:05:55.348 INFO:tasks.workunit.client.0.smithi072.stdout:9/244: mkdir d11/d1f/d2a/d36/d45/d4d 0 2024-03-19T06:05:55.349 INFO:tasks.workunit.client.0.smithi072.stdout:7/279: write d2/d3/d18/d33/d1d/d2b/f45 [130884,11105] 0 2024-03-19T06:05:55.351 INFO:tasks.workunit.client.0.smithi072.stdout:9/245: write d11/d1f/f39 [1292918,118826] 0 2024-03-19T06:05:55.357 INFO:tasks.workunit.client.0.smithi072.stdout:7/280: symlink d2/d3/d18/d33/d1d/d2b/l55 0 2024-03-19T06:05:55.357 INFO:tasks.workunit.client.0.smithi072.stdout:7/281: dread - d2/d3/d18/d20/f47 zero size 2024-03-19T06:05:55.363 INFO:tasks.workunit.client.0.smithi072.stdout:7/282: symlink d2/l56 0 2024-03-19T06:05:55.373 INFO:tasks.workunit.client.0.smithi072.stdout:9/246: dwrite d11/d24/f30 [0,4194304] 0 2024-03-19T06:05:55.384 INFO:tasks.workunit.client.0.smithi072.stdout:7/283: rmdir d2/d3/d18/d33/d1d/d2b/d3d/d26 0 2024-03-19T06:05:55.389 INFO:tasks.workunit.client.0.smithi072.stdout:9/247: link d11/d1f/d2a/d36/f42 d11/d1f/d43/f4e 0 2024-03-19T06:05:55.392 INFO:tasks.workunit.client.0.smithi072.stdout:7/284: mknod d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/c57 0 2024-03-19T06:05:55.403 INFO:tasks.workunit.client.0.smithi072.stdout:7/285: dread d2/d3/d18/d33/d1d/f46 [0,4194304] 0 2024-03-19T06:05:55.407 INFO:tasks.workunit.client.0.smithi072.stdout:7/286: write d2/d3/d18/d33/d1d/d2b/d3d/f7 [4678607,35683] 0 2024-03-19T06:05:55.407 INFO:tasks.workunit.client.0.smithi072.stdout:9/248: dwrite d11/f25 [0,4194304] 0 2024-03-19T06:05:55.410 INFO:tasks.workunit.client.0.smithi072.stdout:9/249: truncate d11/f1e 1531841 0 2024-03-19T06:05:55.411 INFO:tasks.workunit.client.0.smithi072.stdout:9/250: fdatasync d11/d1f/f39 0 2024-03-19T06:05:55.424 INFO:tasks.workunit.client.0.smithi072.stdout:7/287: dread d2/d3/d18/d33/d1d/d2b/f49 [0,4194304] 0 2024-03-19T06:05:55.439 INFO:tasks.workunit.client.0.smithi072.stdout:9/251: dread d11/f17 [0,4194304] 0 2024-03-19T06:05:55.441 INFO:tasks.workunit.client.0.smithi072.stdout:7/288: dwrite d2/d3/d18/d33/d1d/d2b/f4a [0,4194304] 0 2024-03-19T06:05:55.445 INFO:tasks.workunit.client.0.smithi072.stdout:9/252: unlink d11/c1c 0 2024-03-19T06:05:55.453 INFO:tasks.workunit.client.0.smithi072.stdout:8/278: sync 2024-03-19T06:05:55.453 INFO:tasks.workunit.client.0.smithi072.stdout:4/357: sync 2024-03-19T06:05:55.455 INFO:tasks.workunit.client.0.smithi072.stdout:6/294: sync 2024-03-19T06:05:55.455 INFO:tasks.workunit.client.0.smithi072.stdout:0/291: sync 2024-03-19T06:05:55.456 INFO:tasks.workunit.client.0.smithi072.stdout:5/508: sync 2024-03-19T06:05:55.457 INFO:tasks.workunit.client.0.smithi072.stdout:5/509: stat df/d54/l7f 0 2024-03-19T06:05:55.461 INFO:tasks.workunit.client.0.smithi072.stdout:4/358: read d5/f25 [906892,16709] 0 2024-03-19T06:05:55.462 INFO:tasks.workunit.client.0.smithi072.stdout:0/292: readlink d1/d1c/d24/d27/l33 0 2024-03-19T06:05:55.463 INFO:tasks.workunit.client.0.smithi072.stdout:9/253: dread fe [4194304,4194304] 0 2024-03-19T06:05:55.464 INFO:tasks.workunit.client.0.smithi072.stdout:0/293: readlink d1/d1c/d24/d27/l36 0 2024-03-19T06:05:55.468 INFO:tasks.workunit.client.0.smithi072.stdout:7/289: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f39 [0,4194304] 0 2024-03-19T06:05:55.468 INFO:tasks.workunit.client.0.smithi072.stdout:5/510: creat df/d14/d5d/f9d x:0 0 0 2024-03-19T06:05:55.471 INFO:tasks.workunit.client.0.smithi072.stdout:0/294: chown d1/f19 0 1 2024-03-19T06:05:55.473 INFO:tasks.workunit.client.0.smithi072.stdout:9/254: unlink d11/d26/f3b 0 2024-03-19T06:05:55.473 INFO:tasks.workunit.client.0.smithi072.stdout:7/290: write d2/d3/d18/d33/d1d/d2b/f4a [4003931,63865] 0 2024-03-19T06:05:55.476 INFO:tasks.workunit.client.0.smithi072.stdout:9/255: chown d11/d1f/f39 27712 1 2024-03-19T06:05:55.491 INFO:tasks.workunit.client.0.smithi072.stdout:9/256: rename d11/d1f/d43/f4e to d11/d1f/d2a/d36/f4f 0 2024-03-19T06:05:55.491 INFO:tasks.workunit.client.0.smithi072.stdout:8/279: getdents da/d27/d52/d5b/d3e/d5a 0 2024-03-19T06:05:55.494 INFO:tasks.workunit.client.0.smithi072.stdout:4/359: getdents d5/d15/d50 0 2024-03-19T06:05:55.494 INFO:tasks.workunit.client.0.smithi072.stdout:0/295: creat d1/d1c/d24/f5e x:0 0 0 2024-03-19T06:05:55.499 INFO:tasks.workunit.client.0.smithi072.stdout:8/280: unlink da/d13/l18 0 2024-03-19T06:05:55.500 INFO:tasks.workunit.client.0.smithi072.stdout:0/296: unlink d1/d1c/l22 0 2024-03-19T06:05:55.501 INFO:tasks.workunit.client.0.smithi072.stdout:9/257: mknod d11/d24/d4c/c50 0 2024-03-19T06:05:55.503 INFO:tasks.workunit.client.0.smithi072.stdout:7/291: dread d2/d3/d18/d33/d1d/d2b/d3d/f7 [0,4194304] 0 2024-03-19T06:05:55.505 INFO:tasks.workunit.client.0.smithi072.stdout:6/295: dwrite d7/d9/d1b/d33/d41/f59 [0,4194304] 0 2024-03-19T06:05:55.507 INFO:tasks.workunit.client.0.smithi072.stdout:9/258: write d11/d1f/d2a/d36/d45/f4a [402461,86520] 0 2024-03-19T06:05:55.507 INFO:tasks.workunit.client.0.smithi072.stdout:5/511: dwrite df/d13/d32/d28/d42/d59/d43/d4e/d5c/f5f [0,4194304] 0 2024-03-19T06:05:55.507 INFO:tasks.workunit.client.0.smithi072.stdout:0/297: rename d1/d1c/d24/d3e/d59 to d1/d1c/d24/d3e/d5f 0 2024-03-19T06:05:55.509 INFO:tasks.workunit.client.0.smithi072.stdout:7/292: chown d2/d3/d18/d33/d1d/d2b/f4b 311788 1 2024-03-19T06:05:55.510 INFO:tasks.workunit.client.0.smithi072.stdout:0/298: dread - d1/f4e zero size 2024-03-19T06:05:55.511 INFO:tasks.workunit.client.0.smithi072.stdout:6/296: symlink d7/d3f/l63 0 2024-03-19T06:05:55.513 INFO:tasks.workunit.client.0.smithi072.stdout:7/293: write d2/f4c [129090,119466] 0 2024-03-19T06:05:55.521 INFO:tasks.workunit.client.0.smithi072.stdout:5/512: chown df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/l8e 9 1 2024-03-19T06:05:55.523 INFO:tasks.workunit.client.0.smithi072.stdout:5/513: chown df/d13/d24/f98 5284 1 2024-03-19T06:05:55.524 INFO:tasks.workunit.client.0.smithi072.stdout:7/294: unlink d2/d3/d18/l1c 0 2024-03-19T06:05:55.528 INFO:tasks.workunit.client.0.smithi072.stdout:6/297: rename d7/d9/d30/f5a to d7/d9/d1b/d3b/d48/f64 0 2024-03-19T06:05:55.534 INFO:tasks.workunit.client.0.smithi072.stdout:9/259: link d11/d1f/d2a/c34 d11/d24/d4c/c51 0 2024-03-19T06:05:55.535 INFO:tasks.workunit.client.0.smithi072.stdout:0/299: dread d1/f58 [0,4194304] 0 2024-03-19T06:05:55.535 INFO:tasks.workunit.client.0.smithi072.stdout:6/298: truncate d7/d9/d1e/f4d 4824610 0 2024-03-19T06:05:55.535 INFO:tasks.workunit.client.0.smithi072.stdout:7/295: creat d2/d3/d18/d20/d3a/f58 x:0 0 0 2024-03-19T06:05:55.539 INFO:tasks.workunit.client.0.smithi072.stdout:9/260: rename d11/f23 to d11/d4b/f52 0 2024-03-19T06:05:55.541 INFO:tasks.workunit.client.0.smithi072.stdout:6/299: mkdir d7/d3f/d65 0 2024-03-19T06:05:55.541 INFO:tasks.workunit.client.0.smithi072.stdout:7/296: write d2/d3/d43/f4e [969353,73890] 0 2024-03-19T06:05:55.541 INFO:tasks.workunit.client.0.smithi072.stdout:0/300: unlink d1/l55 0 2024-03-19T06:05:55.545 INFO:tasks.workunit.client.0.smithi072.stdout:9/261: creat d11/d1f/d2a/d36/f53 x:0 0 0 2024-03-19T06:05:55.549 INFO:tasks.workunit.client.0.smithi072.stdout:7/297: creat d2/d3/d18/d33/d53/f59 x:0 0 0 2024-03-19T06:05:55.550 INFO:tasks.workunit.client.0.smithi072.stdout:5/514: dwrite df/d13/d32/d28/d42/d59/d43/d62/f8d [0,4194304] 0 2024-03-19T06:05:55.553 INFO:tasks.workunit.client.0.smithi072.stdout:0/301: rename d1/d1c/d24/d3f/d4a/c51 to d1/d1c/d24/c60 0 2024-03-19T06:05:55.555 INFO:tasks.workunit.client.0.smithi072.stdout:7/298: rmdir d2/d3/d18/d33/d1d/d2b/d3d/d21/d31 39 2024-03-19T06:05:55.555 INFO:tasks.workunit.client.0.smithi072.stdout:0/302: write d1/d1c/d24/d3f/d4a/f56 [156655,41476] 0 2024-03-19T06:05:55.558 INFO:tasks.workunit.client.0.smithi072.stdout:9/262: rename fe to d11/d1f/d2a/d36/d3e/f54 0 2024-03-19T06:05:55.558 INFO:tasks.workunit.client.0.smithi072.stdout:7/299: fsync d2/d3/d18/d33/d1d/d2b/d3d/f4f 0 2024-03-19T06:05:55.562 INFO:tasks.workunit.client.0.smithi072.stdout:7/300: chown d2/d3/d18/d3f 854765 1 2024-03-19T06:05:55.563 INFO:tasks.workunit.client.0.smithi072.stdout:0/303: rename l0 to d1/d1c/d24/d3e/l61 0 2024-03-19T06:05:55.569 INFO:tasks.workunit.client.0.smithi072.stdout:0/304: stat d1/d1c/d24/d3f 0 2024-03-19T06:05:55.569 INFO:tasks.workunit.client.0.smithi072.stdout:7/301: symlink d2/d3/d18/d20/l5a 0 2024-03-19T06:05:55.569 INFO:tasks.workunit.client.0.smithi072.stdout:0/305: fsync d1/d1c/f43 0 2024-03-19T06:05:55.569 INFO:tasks.workunit.client.0.smithi072.stdout:6/300: dwrite d7/d9/d1b/d33/d41/d45/f61 [0,4194304] 0 2024-03-19T06:05:55.575 INFO:tasks.workunit.client.0.smithi072.stdout:6/301: rename d7/l22 to d7/d2e/d60/l66 0 2024-03-19T06:05:55.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:55 smithi072 ceph-mon[28706]: Reconfiguring prometheus.smithi072 (dependencies changed)... 2024-03-19T06:05:55.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:55 smithi072 ceph-mon[28706]: pgmap v24: 65 pgs: 65 active+clean; 2.7 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 74 MiB/s rd, 203 MiB/s wr, 439 op/s 2024-03-19T06:05:55.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:55 smithi072 ceph-mon[28706]: Reconfiguring daemon prometheus.smithi072 on smithi072 2024-03-19T06:05:55.577 INFO:tasks.workunit.client.0.smithi072.stdout:9/263: write d11/d1f/d2a/d36/f4f [683738,104589] 0 2024-03-19T06:05:55.579 INFO:tasks.workunit.client.0.smithi072.stdout:6/302: creat d7/d9/d1b/d33/d41/d45/f67 x:0 0 0 2024-03-19T06:05:55.583 INFO:tasks.workunit.client.0.smithi072.stdout:6/303: mkdir d7/d9/d1b/d21/d68 0 2024-03-19T06:05:55.587 INFO:tasks.workunit.client.0.smithi072.stdout:6/304: chown d7/d9/d1e/l20 73545 1 2024-03-19T06:05:55.590 INFO:tasks.workunit.client.0.smithi072.stdout:0/306: dwrite d1/d1c/f23 [0,4194304] 0 2024-03-19T06:05:55.598 INFO:tasks.workunit.client.0.smithi072.stdout:6/305: link d7/d9/d1b/d3b/c3e d7/d9/d1b/d21/d68/c69 0 2024-03-19T06:05:55.602 INFO:tasks.workunit.client.0.smithi072.stdout:6/306: write d7/d9/d1b/d31/f4b [146206,111182] 0 2024-03-19T06:05:55.603 INFO:tasks.workunit.client.0.smithi072.stdout:6/307: dread - d7/d3f/f5f zero size 2024-03-19T06:05:55.608 INFO:tasks.workunit.client.0.smithi072.stdout:6/308: unlink d7/d9/d1b/d31/f4b 0 2024-03-19T06:05:55.612 INFO:tasks.workunit.client.0.smithi072.stdout:6/309: rmdir d7/d9/d1b/d21/d68 39 2024-03-19T06:05:55.614 INFO:tasks.workunit.client.0.smithi072.stdout:6/310: fsync d7/f2d 0 2024-03-19T06:05:55.615 INFO:tasks.workunit.client.0.smithi072.stdout:6/311: fdatasync d7/f11 0 2024-03-19T06:05:55.620 INFO:tasks.workunit.client.0.smithi072.stdout:6/312: link d7/d9/d1b/d3b/f62 d7/d9/d2b/f6a 0 2024-03-19T06:05:55.631 INFO:tasks.workunit.client.0.smithi072.stdout:6/313: dread d7/fc [0,4194304] 0 2024-03-19T06:05:55.634 INFO:tasks.workunit.client.0.smithi072.stdout:6/314: symlink d7/d3f/d65/l6b 0 2024-03-19T06:05:55.647 INFO:tasks.workunit.client.0.smithi072.stdout:6/315: dwrite d7/d9/d1b/d3b/d48/f4c [0,4194304] 0 2024-03-19T06:05:55.652 INFO:tasks.workunit.client.0.smithi072.stdout:6/316: truncate d7/fc 283347 0 2024-03-19T06:05:55.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:55 smithi172 ceph-mon[35716]: Reconfiguring prometheus.smithi072 (dependencies changed)... 2024-03-19T06:05:55.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:55 smithi172 ceph-mon[35716]: pgmap v24: 65 pgs: 65 active+clean; 2.7 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 74 MiB/s rd, 203 MiB/s wr, 439 op/s 2024-03-19T06:05:55.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:55 smithi172 ceph-mon[35716]: Reconfiguring daemon prometheus.smithi072 on smithi072 2024-03-19T06:05:55.656 INFO:tasks.workunit.client.0.smithi072.stdout:6/317: rename d7/d9/d1b/d33/d41/c50 to d7/d9/d1b/c6c 0 2024-03-19T06:05:55.686 INFO:tasks.workunit.client.0.smithi072.stdout:6/318: dread d7/d2e/f35 [0,4194304] 0 2024-03-19T06:05:55.689 INFO:tasks.workunit.client.0.smithi072.stdout:6/319: symlink d7/d3f/d65/l6d 0 2024-03-19T06:05:55.698 INFO:tasks.workunit.client.0.smithi072.stdout:6/320: dread d7/d9/d1b/d3b/d48/f4c [0,4194304] 0 2024-03-19T06:05:55.744 INFO:tasks.workunit.client.0.smithi072.stdout:2/409: sync 2024-03-19T06:05:55.757 INFO:tasks.workunit.client.0.smithi072.stdout:2/410: rename db/d10/d12/l3b to db/d10/d44/l92 0 2024-03-19T06:05:55.781 INFO:tasks.workunit.client.0.smithi072.stdout:2/411: dwrite db/f30 [0,4194304] 0 2024-03-19T06:05:55.784 INFO:tasks.workunit.client.0.smithi072.stdout:2/412: dread - db/d10/d59/f8d zero size 2024-03-19T06:05:55.811 INFO:tasks.workunit.client.0.smithi072.stdout:2/413: dwrite db/d10/d2b/d2d/d62/d6b/f71 [0,4194304] 0 2024-03-19T06:05:55.864 INFO:tasks.workunit.client.0.smithi072.stdout:2/414: creat db/d10/d2b/d2d/d66/f93 x:0 0 0 2024-03-19T06:05:55.895 INFO:tasks.workunit.client.0.smithi072.stdout:2/415: creat db/d10/d2b/d2d/d3f/d48/d82/f94 x:0 0 0 2024-03-19T06:05:55.899 INFO:tasks.workunit.client.0.smithi072.stdout:2/416: write db/d10/d13/d31/f3a [716981,65214] 0 2024-03-19T06:05:55.916 INFO:tasks.workunit.client.0.smithi072.stdout:2/417: rename db/d10/d44/f65 to db/d10/d13/d24/d61/d7d/f95 0 2024-03-19T06:05:55.958 INFO:tasks.workunit.client.0.smithi072.stdout:2/418: dwrite db/d10/d2b/d2d/d62/f63 [0,4194304] 0 2024-03-19T06:05:55.969 INFO:tasks.workunit.client.0.smithi072.stdout:2/419: creat db/d10/d2b/d2d/d77/f96 x:0 0 0 2024-03-19T06:05:55.971 INFO:tasks.workunit.client.0.smithi072.stdout:2/420: chown db/d10/d13/f20 5 1 2024-03-19T06:05:55.976 INFO:tasks.workunit.client.0.smithi072.stdout:2/421: fsync db/d10/d2b/f85 0 2024-03-19T06:05:55.981 INFO:tasks.workunit.client.0.smithi072.stdout:2/422: dread - db/d10/d2b/d2d/d3f/d48/f7b zero size 2024-03-19T06:05:55.993 INFO:tasks.workunit.client.0.smithi072.stdout:3/385: sync 2024-03-19T06:05:55.993 INFO:tasks.workunit.client.0.smithi072.stdout:1/320: sync 2024-03-19T06:05:55.993 INFO:tasks.workunit.client.0.smithi072.stdout:2/423: rename db/d10/d13/f51 to db/d10/d2b/d2d/d66/f97 0 2024-03-19T06:05:55.997 INFO:tasks.workunit.client.0.smithi072.stdout:1/321: read d1/f4e [133454,34825] 0 2024-03-19T06:05:55.997 INFO:tasks.workunit.client.0.smithi072.stdout:2/424: stat db/d10/d12/c23 0 2024-03-19T06:05:56.000 INFO:tasks.workunit.client.0.smithi072.stdout:3/386: read d2/d3/d26/f4a [79895,104499] 0 2024-03-19T06:05:56.007 INFO:tasks.workunit.client.0.smithi072.stdout:2/425: truncate db/d10/d2b/d2d/d62/d6b/f8a 219637 0 2024-03-19T06:05:56.007 INFO:tasks.workunit.client.0.smithi072.stdout:1/322: rmdir d1/d11/d18/d19/d1a/d25/d3c/d52 39 2024-03-19T06:05:56.011 INFO:tasks.workunit.client.0.smithi072.stdout:3/387: mknod d2/d3/d15/c71 0 2024-03-19T06:05:56.015 INFO:tasks.workunit.client.0.smithi072.stdout:1/323: mkdir d1/d5e 0 2024-03-19T06:05:56.016 INFO:tasks.workunit.client.0.smithi072.stdout:1/324: stat d1/d11/d18/d19/d1a 0 2024-03-19T06:05:56.019 INFO:tasks.workunit.client.0.smithi072.stdout:2/426: mkdir db/d10/d2b/d2d/d3f/d48/d82/d98 0 2024-03-19T06:05:56.023 INFO:tasks.workunit.client.0.smithi072.stdout:1/325: unlink d1/d11/d18/f56 0 2024-03-19T06:05:56.032 INFO:tasks.workunit.client.0.smithi072.stdout:3/388: getdents d2/d19/d1e 0 2024-03-19T06:05:56.037 INFO:tasks.workunit.client.0.smithi072.stdout:3/389: creat d2/d19/f72 x:0 0 0 2024-03-19T06:05:56.039 INFO:tasks.workunit.client.0.smithi072.stdout:1/326: link d1/d16/l4f d1/d16/l5f 0 2024-03-19T06:05:56.048 INFO:tasks.workunit.client.0.smithi072.stdout:1/327: mkdir d1/d11/d18/d19/d1a/d25/d60 0 2024-03-19T06:05:56.049 INFO:tasks.workunit.client.0.smithi072.stdout:2/427: write db/d10/d2b/f4a [960933,47244] 0 2024-03-19T06:05:56.053 INFO:tasks.workunit.client.0.smithi072.stdout:1/328: write d1/f15 [7300045,25038] 0 2024-03-19T06:05:56.058 INFO:tasks.workunit.client.0.smithi072.stdout:3/390: link d2/d3/l27 d2/d3/d15/d66/d6b/l73 0 2024-03-19T06:05:56.060 INFO:tasks.workunit.client.0.smithi072.stdout:2/428: dread db/d10/d2b/d2d/d62/d6b/f8a [0,4194304] 0 2024-03-19T06:05:56.062 INFO:tasks.workunit.client.0.smithi072.stdout:1/329: mkdir d1/d11/d18/d19/d1a/d61 0 2024-03-19T06:05:56.063 INFO:tasks.workunit.client.0.smithi072.stdout:3/391: mknod d2/d3/d15/d66/c74 0 2024-03-19T06:05:56.064 INFO:tasks.workunit.client.0.smithi072.stdout:1/330: chown d1/d11/c32 112503 1 2024-03-19T06:05:56.067 INFO:tasks.workunit.client.0.smithi072.stdout:3/392: mkdir d2/d75 0 2024-03-19T06:05:56.069 INFO:tasks.workunit.client.0.smithi072.stdout:1/331: unlink d1/d16/f5a 0 2024-03-19T06:05:56.077 INFO:tasks.workunit.client.0.smithi072.stdout:1/332: fsync d1/d11/f39 0 2024-03-19T06:05:56.087 INFO:tasks.workunit.client.0.smithi072.stdout:2/429: dwrite db/d10/d2b/d2d/d3f/d48/f53 [0,4194304] 0 2024-03-19T06:05:56.093 INFO:tasks.workunit.client.0.smithi072.stdout:3/393: truncate d2/d3/f6d 3474302 0 2024-03-19T06:05:56.103 INFO:tasks.workunit.client.0.smithi072.stdout:1/333: dwrite d1/d16/f38 [0,4194304] 0 2024-03-19T06:05:56.104 INFO:tasks.workunit.client.0.smithi072.stdout:2/430: dread db/d10/d2b/d2d/f46 [4194304,4194304] 0 2024-03-19T06:05:56.106 INFO:tasks.workunit.client.0.smithi072.stdout:3/394: unlink d2/l1f 0 2024-03-19T06:05:56.106 INFO:tasks.workunit.client.0.smithi072.stdout:2/431: chown db/d10/d2b/f4b 12280 1 2024-03-19T06:05:56.109 INFO:tasks.workunit.client.0.smithi072.stdout:2/432: dread - db/d10/d59/f8d zero size 2024-03-19T06:05:56.109 INFO:tasks.workunit.client.0.smithi072.stdout:3/395: mknod d2/d19/d1e/c76 0 2024-03-19T06:05:56.115 INFO:tasks.workunit.client.0.smithi072.stdout:1/334: rename d1/d11/f39 to d1/d11/d18/d19/d1a/d25/d3c/f62 0 2024-03-19T06:05:56.122 INFO:tasks.workunit.client.0.smithi072.stdout:1/335: read d1/d11/d18/d19/d1a/d25/d3c/f5b [3039108,30543] 0 2024-03-19T06:05:56.124 INFO:tasks.workunit.client.0.smithi072.stdout:1/336: readlink d1/d16/l47 0 2024-03-19T06:05:56.129 INFO:tasks.workunit.client.0.smithi072.stdout:1/337: read d1/d11/d18/d19/d1a/d25/d3c/f3e [335366,37729] 0 2024-03-19T06:05:56.130 INFO:tasks.workunit.client.0.smithi072.stdout:2/433: dwrite db/d10/d13/d24/f5f [0,4194304] 0 2024-03-19T06:05:56.132 INFO:tasks.workunit.client.0.smithi072.stdout:1/338: read d1/d16/f3a [234724,108086] 0 2024-03-19T06:05:56.137 INFO:tasks.workunit.client.0.smithi072.stdout:1/339: write d1/d11/d18/d19/d1a/d25/f43 [1957874,99568] 0 2024-03-19T06:05:56.138 INFO:tasks.workunit.client.0.smithi072.stdout:2/434: rename db/d10/d2b/d2d/d3f/d48/f53 to db/d10/d2b/d2d/d3f/d48/d82/f99 0 2024-03-19T06:05:56.141 INFO:tasks.workunit.client.0.smithi072.stdout:1/340: mkdir d1/d11/d18/d63 0 2024-03-19T06:05:56.142 INFO:tasks.workunit.client.0.smithi072.stdout:1/341: readlink d1/l10 0 2024-03-19T06:05:56.142 INFO:tasks.workunit.client.0.smithi072.stdout:2/435: read db/d10/d2b/f4a [411127,92463] 0 2024-03-19T06:05:56.144 INFO:tasks.workunit.client.0.smithi072.stdout:1/342: read d1/f4e [3112109,124505] 0 2024-03-19T06:05:56.145 INFO:tasks.workunit.client.0.smithi072.stdout:2/436: dread db/d10/d59/f5c [0,4194304] 0 2024-03-19T06:05:56.146 INFO:tasks.workunit.client.0.smithi072.stdout:2/437: chown db/d10/d59 0 1 2024-03-19T06:05:56.148 INFO:tasks.workunit.client.0.smithi072.stdout:2/438: rmdir db/d10/d13/d31/d35 39 2024-03-19T06:05:56.152 INFO:tasks.workunit.client.0.smithi072.stdout:2/439: unlink db/d10/f1d 0 2024-03-19T06:05:56.161 INFO:tasks.workunit.client.0.smithi072.stdout:2/440: dread db/d10/d13/d31/f5d [0,4194304] 0 2024-03-19T06:05:56.168 INFO:tasks.workunit.client.0.smithi072.stdout:2/441: dread - db/d10/d2b/d2d/d66/f93 zero size 2024-03-19T06:05:56.168 INFO:tasks.workunit.client.0.smithi072.stdout:1/343: write d1/d11/d18/d19/d1a/d25/d3c/f3e [254289,32073] 0 2024-03-19T06:05:56.168 INFO:tasks.workunit.client.0.smithi072.stdout:2/442: write db/d10/d2b/d2d/d3f/d48/f7b [931059,79211] 0 2024-03-19T06:05:56.169 INFO:tasks.workunit.client.0.smithi072.stdout:2/443: fdatasync db/d10/d2b/d2d/d77/f96 0 2024-03-19T06:05:56.177 INFO:tasks.workunit.client.0.smithi072.stdout:2/444: rename db/d10/d59/f5c to db/d10/d2b/f9a 0 2024-03-19T06:05:56.181 INFO:tasks.workunit.client.0.smithi072.stdout:2/445: getdents db/d10/d12 0 2024-03-19T06:05:56.186 INFO:tasks.workunit.client.0.smithi072.stdout:1/344: dwrite d1/d11/d18/d19/d1a/d25/d3c/f3e [0,4194304] 0 2024-03-19T06:05:56.190 INFO:tasks.workunit.client.0.smithi072.stdout:2/446: symlink db/d10/d2b/d2d/d62/l9b 0 2024-03-19T06:05:56.196 INFO:tasks.workunit.client.0.smithi072.stdout:1/345: rmdir d1/d5e 0 2024-03-19T06:05:56.199 INFO:tasks.workunit.client.0.smithi072.stdout:1/346: write d1/f4d [296000,104036] 0 2024-03-19T06:05:56.202 INFO:tasks.workunit.client.0.smithi072.stdout:1/347: chown d1/l2d 7052 1 2024-03-19T06:05:56.206 INFO:tasks.workunit.client.0.smithi072.stdout:1/348: mknod d1/d11/c64 0 2024-03-19T06:05:56.210 INFO:tasks.workunit.client.0.smithi072.stdout:1/349: unlink d1/f27 0 2024-03-19T06:05:56.213 INFO:tasks.workunit.client.0.smithi072.stdout:1/350: mkdir d1/d11/d18/d19/d1a/d61/d65 0 2024-03-19T06:05:56.217 INFO:tasks.workunit.client.0.smithi072.stdout:1/351: creat d1/d11/d18/d19/d1a/d25/d3c/d48/f66 x:0 0 0 2024-03-19T06:05:56.220 INFO:tasks.workunit.client.0.smithi072.stdout:1/352: mknod d1/d11/d18/d19/c67 0 2024-03-19T06:05:56.222 INFO:tasks.workunit.client.0.smithi072.stdout:1/353: read d1/f4e [2734084,114420] 0 2024-03-19T06:05:56.235 INFO:tasks.workunit.client.0.smithi072.stdout:1/354: truncate d1/d11/f13 2042565 0 2024-03-19T06:05:56.263 INFO:tasks.workunit.client.0.smithi072.stdout:1/355: dread d1/f15 [0,4194304] 0 2024-03-19T06:05:56.265 INFO:tasks.workunit.client.0.smithi072.stdout:1/356: chown d1/d16/f3a 3 1 2024-03-19T06:05:56.304 INFO:tasks.workunit.client.0.smithi072.stdout:1/357: dwrite d1/d11/d18/d19/d1a/d25/d3c/f62 [0,4194304] 0 2024-03-19T06:05:56.326 INFO:tasks.workunit.client.0.smithi072.stdout:1/358: dread d1/d11/d18/d19/d1a/f2a [0,4194304] 0 2024-03-19T06:05:56.333 INFO:tasks.workunit.client.0.smithi072.stdout:1/359: unlink d1/d11/d18/l21 0 2024-03-19T06:05:56.349 INFO:tasks.workunit.client.0.smithi072.stdout:1/360: dwrite d1/d11/d18/f2e [0,4194304] 0 2024-03-19T06:05:56.357 INFO:tasks.workunit.client.0.smithi072.stdout:1/361: mkdir d1/d11/d18/d19/d1a/d25/d3c/d68 0 2024-03-19T06:05:56.362 INFO:tasks.workunit.client.0.smithi072.stdout:1/362: fdatasync d1/d11/d18/d19/d1a/f34 0 2024-03-19T06:05:56.372 INFO:tasks.workunit.client.0.smithi072.stdout:1/363: mknod d1/d11/d18/d19/d1a/d25/d3c/d52/c69 0 2024-03-19T06:05:56.389 INFO:tasks.workunit.client.0.smithi072.stdout:1/364: creat d1/d11/d18/d19/d1a/d3b/f6a x:0 0 0 2024-03-19T06:05:56.399 INFO:tasks.workunit.client.0.smithi072.stdout:1/365: getdents d1/d11/d18 0 2024-03-19T06:05:56.403 INFO:tasks.workunit.client.0.smithi072.stdout:1/366: read d1/d11/d18/d19/d1a/f2a [37723,58180] 0 2024-03-19T06:05:56.441 INFO:tasks.workunit.client.0.smithi072.stdout:1/367: dread d1/f6 [0,4194304] 0 2024-03-19T06:05:56.452 INFO:tasks.workunit.client.0.smithi072.stdout:1/368: truncate d1/d11/d18/d19/d1a/d25/d3c/d48/f66 332929 0 2024-03-19T06:05:56.460 INFO:tasks.workunit.client.0.smithi072.stdout:1/369: symlink d1/d11/d18/d19/d1a/d25/d3c/d48/l6b 0 2024-03-19T06:05:56.465 INFO:tasks.workunit.client.0.smithi072.stdout:1/370: write d1/d16/f3a [553465,42533] 0 2024-03-19T06:05:56.478 INFO:tasks.workunit.client.0.smithi072.stdout:1/371: rename d1/d11/d18/d19/d1a/d25/d3c/d52/f5c to d1/d11/d18/d19/d1a/d25/f6c 0 2024-03-19T06:05:56.480 INFO:tasks.workunit.client.0.smithi072.stdout:1/372: dread - d1/d11/d18/d19/d1a/d25/f6c zero size 2024-03-19T06:05:56.484 INFO:tasks.workunit.client.0.smithi072.stdout:1/373: fsync d1/d11/d18/d19/d1a/d25/d3c/f5b 0 2024-03-19T06:05:56.487 INFO:tasks.workunit.client.0.smithi072.stdout:4/360: sync 2024-03-19T06:05:56.487 INFO:tasks.workunit.client.0.smithi072.stdout:8/281: sync 2024-03-19T06:05:56.489 INFO:tasks.workunit.client.0.smithi072.stdout:4/361: readlink d5/d15/d50/l63 0 2024-03-19T06:05:56.490 INFO:tasks.workunit.client.0.smithi072.stdout:8/282: chown da/d27/d52/d5b/d3e 9 1 2024-03-19T06:05:56.494 INFO:tasks.workunit.client.0.smithi072.stdout:4/362: symlink d5/d15/d31/l89 0 2024-03-19T06:05:56.495 INFO:tasks.workunit.client.0.smithi072.stdout:8/283: symlink da/d27/d52/d5b/d3e/l5f 0 2024-03-19T06:05:56.497 INFO:tasks.workunit.client.0.smithi072.stdout:4/363: write d5/d15/d22/d41/d61/f66 [91831,103673] 0 2024-03-19T06:05:56.498 INFO:tasks.workunit.client.0.smithi072.stdout:8/284: rmdir da/d13/d14 39 2024-03-19T06:05:56.505 INFO:tasks.workunit.client.0.smithi072.stdout:4/364: mkdir d5/d8a 0 2024-03-19T06:05:56.506 INFO:tasks.workunit.client.0.smithi072.stdout:4/365: readlink d5/d15/d50/l1e 0 2024-03-19T06:05:56.509 INFO:tasks.workunit.client.0.smithi072.stdout:1/374: dwrite d1/d11/f13 [0,4194304] 0 2024-03-19T06:05:56.513 INFO:tasks.workunit.client.0.smithi072.stdout:4/366: mknod d5/d15/d31/d7d/c8b 0 2024-03-19T06:05:56.517 INFO:tasks.workunit.client.0.smithi072.stdout:1/375: dread d1/d11/d18/d19/d1a/d25/d3c/d48/f66 [0,4194304] 0 2024-03-19T06:05:56.519 INFO:tasks.workunit.client.0.smithi072.stdout:4/367: creat d5/d15/d22/d41/d61/d71/f8c x:0 0 0 2024-03-19T06:05:56.524 INFO:tasks.workunit.client.0.smithi072.stdout:4/368: write d5/d15/d22/d41/d61/f70 [767054,15818] 0 2024-03-19T06:05:56.524 INFO:tasks.workunit.client.0.smithi072.stdout:8/285: dwrite da/d13/d14/d1b/d57/f5d [0,4194304] 0 2024-03-19T06:05:56.555 INFO:tasks.workunit.client.0.smithi072.stdout:4/369: dwrite d5/d15/d31/d4c/f6e [0,4194304] 0 2024-03-19T06:05:56.557 INFO:tasks.workunit.client.0.smithi072.stdout:4/370: stat d5/d1b/f1d 0 2024-03-19T06:05:56.559 INFO:tasks.workunit.client.0.smithi072.stdout:4/371: stat d5/d1b/d7e 0 2024-03-19T06:05:56.559 INFO:tasks.workunit.client.0.smithi072.stdout:8/286: dwrite da/d13/d14/f17 [0,4194304] 0 2024-03-19T06:05:56.561 INFO:tasks.workunit.client.0.smithi072.stdout:4/372: chown d5/d15/d22/f45 23 1 2024-03-19T06:05:56.572 INFO:tasks.workunit.client.0.smithi072.stdout:4/373: truncate d5/d11/f36 324041 0 2024-03-19T06:05:56.575 INFO:tasks.workunit.client.0.smithi072.stdout:4/374: stat d5/d15/d31/d6d 0 2024-03-19T06:05:56.579 INFO:tasks.workunit.client.0.smithi072.stdout:4/375: creat d5/d1b/f8d x:0 0 0 2024-03-19T06:05:56.583 INFO:tasks.workunit.client.0.smithi072.stdout:8/287: dwrite da/f51 [0,4194304] 0 2024-03-19T06:05:56.591 INFO:tasks.workunit.client.0.smithi072.stdout:4/376: mkdir d5/d15/d31/d6d/d7a/d8e 0 2024-03-19T06:05:56.594 INFO:tasks.workunit.client.0.smithi072.stdout:4/377: stat d5/d11/f39 0 2024-03-19T06:05:56.616 INFO:tasks.workunit.client.0.smithi072.stdout:8/288: dwrite da/f36 [0,4194304] 0 2024-03-19T06:05:56.627 INFO:tasks.workunit.client.0.smithi072.stdout:4/378: dwrite d5/d15/d31/d7d/f7f [0,4194304] 0 2024-03-19T06:05:56.629 INFO:tasks.workunit.client.0.smithi072.stdout:4/379: chown d5/d15/d31/d6d/d7a/d8e 0 1 2024-03-19T06:05:56.640 INFO:tasks.workunit.client.0.smithi072.stdout:4/380: link d5/d15/d50/l56 d5/d15/d31/d6d/l8f 0 2024-03-19T06:05:56.645 INFO:tasks.workunit.client.0.smithi072.stdout:8/289: dwrite da/d27/d52/d5b/d3e/d5a/f49 [0,4194304] 0 2024-03-19T06:05:56.651 INFO:tasks.workunit.client.0.smithi072.stdout:8/290: write da/d27/d52/d5b/d3e/d5a/f49 [3793794,57890] 0 2024-03-19T06:05:56.654 INFO:tasks.workunit.client.0.smithi072.stdout:8/291: write f8 [5514797,80479] 0 2024-03-19T06:05:56.661 INFO:tasks.workunit.client.0.smithi072.stdout:4/381: dwrite d5/d1b/f33 [0,4194304] 0 2024-03-19T06:05:56.666 INFO:tasks.workunit.client.0.smithi072.stdout:4/382: symlink d5/d15/d31/d6f/l90 0 2024-03-19T06:05:56.668 INFO:tasks.workunit.client.0.smithi072.stdout:4/383: write d5/d15/d31/d7d/f7f [752244,34419] 0 2024-03-19T06:05:56.670 INFO:tasks.workunit.client.0.smithi072.stdout:4/384: dread - d5/d1b/f8d zero size 2024-03-19T06:05:56.674 INFO:tasks.workunit.client.0.smithi072.stdout:8/292: dwrite da/d13/d14/f35 [0,4194304] 0 2024-03-19T06:05:56.676 INFO:tasks.workunit.client.0.smithi072.stdout:4/385: mkdir d5/d15/d31/d7d/d91 0 2024-03-19T06:05:56.678 INFO:tasks.workunit.client.0.smithi072.stdout:8/293: creat da/d13/d14/f60 x:0 0 0 2024-03-19T06:05:56.680 INFO:tasks.workunit.client.0.smithi072.stdout:4/386: unlink d5/d11/c38 0 2024-03-19T06:05:56.681 INFO:tasks.workunit.client.0.smithi072.stdout:5/515: sync 2024-03-19T06:05:56.688 INFO:tasks.workunit.client.0.smithi072.stdout:8/294: read da/d13/d14/f28 [2261880,2385] 0 2024-03-19T06:05:56.691 INFO:tasks.workunit.client.0.smithi072.stdout:4/387: write d5/d11/f39 [360534,4453] 0 2024-03-19T06:05:56.693 INFO:tasks.workunit.client.0.smithi072.stdout:5/516: write df/f69 [123824,44043] 0 2024-03-19T06:05:56.694 INFO:tasks.workunit.client.0.smithi072.stdout:4/388: mknod d5/d1b/c92 0 2024-03-19T06:05:56.696 INFO:tasks.workunit.client.0.smithi072.stdout:5/517: chown df/f96 67284171 1 2024-03-19T06:05:56.710 INFO:tasks.workunit.client.0.smithi072.stdout:3/396: sync 2024-03-19T06:05:56.710 INFO:tasks.workunit.client.0.smithi072.stdout:6/321: sync 2024-03-19T06:05:56.710 INFO:tasks.workunit.client.0.smithi072.stdout:0/307: sync 2024-03-19T06:05:56.710 INFO:tasks.workunit.client.0.smithi072.stdout:2/447: sync 2024-03-19T06:05:56.710 INFO:tasks.workunit.client.0.smithi072.stdout:9/264: sync 2024-03-19T06:05:56.711 INFO:tasks.workunit.client.0.smithi072.stdout:7/302: sync 2024-03-19T06:05:56.713 INFO:tasks.workunit.client.0.smithi072.stdout:6/322: stat d7/d9/ff 0 2024-03-19T06:05:56.717 INFO:tasks.workunit.client.0.smithi072.stdout:2/448: fdatasync db/d10/d2b/d2d/d3f/d48/f87 0 2024-03-19T06:05:56.718 INFO:tasks.workunit.client.0.smithi072.stdout:9/265: chown d11/c20 6 1 2024-03-19T06:05:56.718 INFO:tasks.workunit.client.0.smithi072.stdout:3/397: creat d2/d75/f77 x:0 0 0 2024-03-19T06:05:56.721 INFO:tasks.workunit.client.0.smithi072.stdout:7/303: write d2/d3/d18/d20/f47 [712472,81652] 0 2024-03-19T06:05:56.721 INFO:tasks.workunit.client.0.smithi072.stdout:4/389: dwrite d5/d32/d58/f85 [0,4194304] 0 2024-03-19T06:05:56.722 INFO:tasks.workunit.client.0.smithi072.stdout:3/398: fsync d2/d3/d25/f42 0 2024-03-19T06:05:56.722 INFO:tasks.workunit.client.0.smithi072.stdout:2/449: chown db/d10/f18 512 1 2024-03-19T06:05:56.724 INFO:tasks.workunit.client.0.smithi072.stdout:0/308: write d1/f19 [4346366,8889] 0 2024-03-19T06:05:56.727 INFO:tasks.workunit.client.0.smithi072.stdout:8/295: dread da/f2a [0,4194304] 0 2024-03-19T06:05:56.728 INFO:tasks.workunit.client.0.smithi072.stdout:6/323: creat d7/d9/d1b/d3b/f6e x:0 0 0 2024-03-19T06:05:56.729 INFO:tasks.workunit.client.0.smithi072.stdout:3/399: mkdir d2/d40/d78 0 2024-03-19T06:05:56.731 INFO:tasks.workunit.client.0.smithi072.stdout:0/309: chown d1/d1c/d24/d3e/d5f 728292 1 2024-03-19T06:05:56.736 INFO:tasks.workunit.client.0.smithi072.stdout:7/304: write d2/d3/d18/d33/d53/f59 [203406,34141] 0 2024-03-19T06:05:56.737 INFO:tasks.workunit.client.0.smithi072.stdout:4/390: chown d5/d15/d31/d4c/f6e 234 1 2024-03-19T06:05:56.738 INFO:tasks.workunit.client.0.smithi072.stdout:8/296: symlink da/d37/d5c/l61 0 2024-03-19T06:05:56.741 INFO:tasks.workunit.client.0.smithi072.stdout:5/518: dread df/d16/f60 [0,4194304] 0 2024-03-19T06:05:56.741 INFO:tasks.workunit.client.0.smithi072.stdout:0/310: creat d1/d1c/d24/d3e/f62 x:0 0 0 2024-03-19T06:05:56.741 INFO:tasks.workunit.client.0.smithi072.stdout:7/305: mknod d2/d3/d18/d20/c5b 0 2024-03-19T06:05:56.747 INFO:tasks.workunit.client.0.smithi072.stdout:9/266: link d11/d1f/d2a/d36/d45/f4a d11/f55 0 2024-03-19T06:05:56.748 INFO:tasks.workunit.client.0.smithi072.stdout:4/391: unlink d5/d15/d31/d4c/f6e 0 2024-03-19T06:05:56.755 INFO:tasks.workunit.client.0.smithi072.stdout:2/450: dread db/d10/d2b/d2d/d62/f63 [0,4194304] 0 2024-03-19T06:05:56.756 INFO:tasks.workunit.client.0.smithi072.stdout:4/392: unlink d5/d11/c49 0 2024-03-19T06:05:56.763 INFO:tasks.workunit.client.0.smithi072.stdout:7/306: truncate d2/d3/d18/d33/d1d/d2b/f45 1071005 0 2024-03-19T06:05:56.764 INFO:tasks.workunit.client.0.smithi072.stdout:3/400: dwrite d2/f30 [0,4194304] 0 2024-03-19T06:05:56.765 INFO:tasks.workunit.client.0.smithi072.stdout:5/519: dread df/d13/d32/d28/d42/d59/d43/d4e/d5c/f7c [0,4194304] 0 2024-03-19T06:05:56.765 INFO:tasks.workunit.client.0.smithi072.stdout:6/324: dwrite d7/f34 [0,4194304] 0 2024-03-19T06:05:56.769 INFO:tasks.workunit.client.0.smithi072.stdout:9/267: truncate d11/d24/f30 3445228 0 2024-03-19T06:05:56.769 INFO:tasks.workunit.client.0.smithi072.stdout:2/451: creat db/d10/d2b/d2d/d62/d6b/f9c x:0 0 0 2024-03-19T06:05:56.774 INFO:tasks.workunit.client.0.smithi072.stdout:7/307: stat d2/d3/d18/d33/d1d/c2a 0 2024-03-19T06:05:56.780 INFO:tasks.workunit.client.0.smithi072.stdout:4/393: symlink d5/d15/d22/d41/d61/d71/d72/l93 0 2024-03-19T06:05:56.780 INFO:tasks.workunit.client.0.smithi072.stdout:8/297: dwrite da/d13/d14/f35 [0,4194304] 0 2024-03-19T06:05:56.780 INFO:tasks.workunit.client.0.smithi072.stdout:5/520: write df/d14/d5d/f9d [539567,124215] 0 2024-03-19T06:05:56.784 INFO:tasks.workunit.client.0.smithi072.stdout:1/376: sync 2024-03-19T06:05:56.786 INFO:tasks.workunit.client.0.smithi072.stdout:0/311: dwrite d1/d1c/f4c [0,4194304] 0 2024-03-19T06:05:56.791 INFO:tasks.workunit.client.0.smithi072.stdout:6/325: mknod d7/d9/c6f 0 2024-03-19T06:05:56.791 INFO:tasks.workunit.client.0.smithi072.stdout:9/268: mknod d11/d26/c56 0 2024-03-19T06:05:56.792 INFO:tasks.workunit.client.0.smithi072.stdout:7/308: creat d2/d3/d18/d20/d3a/f5c x:0 0 0 2024-03-19T06:05:56.793 INFO:tasks.workunit.client.0.smithi072.stdout:3/401: fsync d2/d19/d1e/f32 0 2024-03-19T06:05:56.795 INFO:tasks.workunit.client.0.smithi072.stdout:1/377: read d1/d11/d18/d19/d1a/d25/f43 [1460064,60828] 0 2024-03-19T06:05:56.798 INFO:tasks.workunit.client.0.smithi072.stdout:5/521: unlink df/d13/d24/f4f 0 2024-03-19T06:05:56.798 INFO:tasks.workunit.client.0.smithi072.stdout:2/452: creat db/d10/d13/d31/d35/f9d x:0 0 0 2024-03-19T06:05:56.799 INFO:tasks.workunit.client.0.smithi072.stdout:4/394: creat d5/d15/d22/d41/d7b/f94 x:0 0 0 2024-03-19T06:05:56.800 INFO:tasks.workunit.client.0.smithi072.stdout:0/312: creat d1/d1c/d24/d3e/f63 x:0 0 0 2024-03-19T06:05:56.801 INFO:tasks.workunit.client.0.smithi072.stdout:4/395: fdatasync d5/d37/f62 0 2024-03-19T06:05:56.803 INFO:tasks.workunit.client.0.smithi072.stdout:9/269: mkdir d11/d4b/d57 0 2024-03-19T06:05:56.805 INFO:tasks.workunit.client.0.smithi072.stdout:3/402: chown d2/d3/d26/f22 17 1 2024-03-19T06:05:56.806 INFO:tasks.workunit.client.0.smithi072.stdout:5/522: creat df/d13/d24/f9e x:0 0 0 2024-03-19T06:05:56.808 INFO:tasks.workunit.client.0.smithi072.stdout:7/309: rename d2/d3/d18/d20/f47 to d2/d3/d18/d20/d3a/f5d 0 2024-03-19T06:05:56.811 INFO:tasks.workunit.client.0.smithi072.stdout:4/396: write d5/d15/d3f/f6b [166589,2526] 0 2024-03-19T06:05:56.812 INFO:tasks.workunit.client.0.smithi072.stdout:1/378: mkdir d1/d11/d6d 0 2024-03-19T06:05:56.816 INFO:tasks.workunit.client.0.smithi072.stdout:2/453: rename db/d10/d2b/d2d/d3f to db/d10/d2b/d2d/d9e 0 2024-03-19T06:05:56.816 INFO:tasks.workunit.client.0.smithi072.stdout:7/310: truncate d2/d3/d18/d20/d3a/f58 826160 0 2024-03-19T06:05:56.817 INFO:tasks.workunit.client.0.smithi072.stdout:3/403: dread - d2/d19/d1e/f6f zero size 2024-03-19T06:05:56.819 INFO:tasks.workunit.client.0.smithi072.stdout:8/298: getdents da/d27/d52/d5b 0 2024-03-19T06:05:56.821 INFO:tasks.workunit.client.0.smithi072.stdout:4/397: mkdir d5/d15/d22/d95 0 2024-03-19T06:05:56.821 INFO:tasks.workunit.client.0.smithi072.stdout:6/326: dwrite d7/f11 [0,4194304] 0 2024-03-19T06:05:56.824 INFO:tasks.workunit.client.0.smithi072.stdout:1/379: fdatasync d1/d11/d18/d19/d1a/d25/f6c 0 2024-03-19T06:05:56.824 INFO:tasks.workunit.client.0.smithi072.stdout:6/327: readlink d7/d3f/l63 0 2024-03-19T06:05:56.825 INFO:tasks.workunit.client.0.smithi072.stdout:2/454: mknod db/d10/d59/c9f 0 2024-03-19T06:05:56.826 INFO:tasks.workunit.client.0.smithi072.stdout:0/313: link d1/d1c/c25 d1/d1c/d24/d3f/c64 0 2024-03-19T06:05:56.828 INFO:tasks.workunit.client.0.smithi072.stdout:2/455: fsync db/d10/f2e 0 2024-03-19T06:05:56.830 INFO:tasks.workunit.client.0.smithi072.stdout:4/398: symlink d5/d15/d31/d6d/l96 0 2024-03-19T06:05:56.831 INFO:tasks.workunit.client.0.smithi072.stdout:8/299: mkdir da/d62 0 2024-03-19T06:05:56.831 INFO:tasks.workunit.client.0.smithi072.stdout:1/380: dread d1/f4d [0,4194304] 0 2024-03-19T06:05:56.833 INFO:tasks.workunit.client.0.smithi072.stdout:6/328: rmdir d7/d9/d1b/d21/d68 39 2024-03-19T06:05:56.837 INFO:tasks.workunit.client.0.smithi072.stdout:7/311: getdents d2/d3 0 2024-03-19T06:05:56.840 INFO:tasks.workunit.client.0.smithi072.stdout:2/456: rename db/d10/d12/l90 to db/la0 0 2024-03-19T06:05:56.841 INFO:tasks.workunit.client.0.smithi072.stdout:8/300: stat da/d13/c20 0 2024-03-19T06:05:56.841 INFO:tasks.workunit.client.0.smithi072.stdout:4/399: rmdir d5/d15/d50 39 2024-03-19T06:05:56.843 INFO:tasks.workunit.client.0.smithi072.stdout:9/270: dread d11/d24/f30 [0,4194304] 0 2024-03-19T06:05:56.848 INFO:tasks.workunit.client.0.smithi072.stdout:4/400: write d5/d15/d22/f45 [720378,55966] 0 2024-03-19T06:05:56.848 INFO:tasks.workunit.client.0.smithi072.stdout:0/314: rmdir d1/d1c/d24/d3f 39 2024-03-19T06:05:56.848 INFO:tasks.workunit.client.0.smithi072.stdout:9/271: chown d11/c18 7301436 1 2024-03-19T06:05:56.854 INFO:tasks.workunit.client.0.smithi072.stdout:4/401: mknod d5/d15/d31/c97 0 2024-03-19T06:05:56.857 INFO:tasks.workunit.client.0.smithi072.stdout:5/523: dread df/d13/d32/d28/f37 [0,4194304] 0 2024-03-19T06:05:56.857 INFO:tasks.workunit.client.0.smithi072.stdout:2/457: dread db/d10/f18 [0,4194304] 0 2024-03-19T06:05:56.858 INFO:tasks.workunit.client.0.smithi072.stdout:4/402: write d5/d15/d53/f6c [3203769,76201] 0 2024-03-19T06:05:56.858 INFO:tasks.workunit.client.0.smithi072.stdout:6/329: creat d7/f70 x:0 0 0 2024-03-19T06:05:56.859 INFO:tasks.workunit.client.0.smithi072.stdout:3/404: dread d2/d3/f6d [0,4194304] 0 2024-03-19T06:05:56.860 INFO:tasks.workunit.client.0.smithi072.stdout:5/524: chown df/d16/d61/d7e 1709 1 2024-03-19T06:05:56.861 INFO:tasks.workunit.client.0.smithi072.stdout:9/272: creat d11/d1f/d2a/d36/d3e/f58 x:0 0 0 2024-03-19T06:05:56.861 INFO:tasks.workunit.client.0.smithi072.stdout:7/312: truncate d2/d3/d18/d33/d1d/f46 786786 0 2024-03-19T06:05:56.862 INFO:tasks.workunit.client.0.smithi072.stdout:4/403: readlink d5/d37/l64 0 2024-03-19T06:05:56.863 INFO:tasks.workunit.client.0.smithi072.stdout:1/381: link d1/d16/c44 d1/d16/c6e 0 2024-03-19T06:05:56.865 INFO:tasks.workunit.client.0.smithi072.stdout:0/315: rmdir d1/d1c/d24/d27/d5d 0 2024-03-19T06:05:56.867 INFO:tasks.workunit.client.0.smithi072.stdout:9/273: fsync d11/f55 0 2024-03-19T06:05:56.869 INFO:tasks.workunit.client.0.smithi072.stdout:0/316: fdatasync d1/d2c/f49 0 2024-03-19T06:05:56.869 INFO:tasks.workunit.client.0.smithi072.stdout:3/405: mkdir d2/d3/d15/d66/d6b/d79 0 2024-03-19T06:05:56.870 INFO:tasks.workunit.client.0.smithi072.stdout:1/382: read - d1/d11/d18/d19/d1a/d25/f6c zero size 2024-03-19T06:05:56.872 INFO:tasks.workunit.client.0.smithi072.stdout:7/313: unlink d2/d3/d18/d33/d1d/d2b/d3d/f4f 0 2024-03-19T06:05:56.873 INFO:tasks.workunit.client.0.smithi072.stdout:0/317: fdatasync d1/f19 0 2024-03-19T06:05:56.884 INFO:tasks.workunit.client.0.smithi072.stdout:4/404: creat d5/d11/f98 x:0 0 0 2024-03-19T06:05:56.886 INFO:tasks.workunit.client.0.smithi072.stdout:5/525: dread df/d13/f56 [0,4194304] 0 2024-03-19T06:05:56.888 INFO:tasks.workunit.client.0.smithi072.stdout:7/314: fdatasync d2/d3/d18/d33/d1d/d2b/d3d/f39 0 2024-03-19T06:05:56.890 INFO:tasks.workunit.client.0.smithi072.stdout:8/301: dread da/d13/d1d/f2b [4194304,4194304] 0 2024-03-19T06:05:56.893 INFO:tasks.workunit.client.0.smithi072.stdout:2/458: dwrite db/d10/f18 [0,4194304] 0 2024-03-19T06:05:56.897 INFO:tasks.workunit.client.0.smithi072.stdout:3/406: dread d2/d3/d26/f58 [0,4194304] 0 2024-03-19T06:05:56.898 INFO:tasks.workunit.client.0.smithi072.stdout:6/330: dread d7/d3f/f42 [0,4194304] 0 2024-03-19T06:05:56.902 INFO:tasks.workunit.client.0.smithi072.stdout:4/405: write d5/d15/d22/f44 [4947058,32322] 0 2024-03-19T06:05:56.905 INFO:tasks.workunit.client.0.smithi072.stdout:7/315: fdatasync d2/d3/fd 0 2024-03-19T06:05:56.908 INFO:tasks.workunit.client.0.smithi072.stdout:4/406: write d5/d15/d31/f3c [1007874,113893] 0 2024-03-19T06:05:56.909 INFO:tasks.workunit.client.0.smithi072.stdout:8/302: write da/d27/d41/f46 [257274,66655] 0 2024-03-19T06:05:56.911 INFO:tasks.workunit.client.0.smithi072.stdout:9/274: rename d11/d26 to d11/d59 0 2024-03-19T06:05:56.913 INFO:tasks.workunit.client.0.smithi072.stdout:7/316: read d2/d3/d18/d20/d3a/f58 [76408,100952] 0 2024-03-19T06:05:56.914 INFO:tasks.workunit.client.0.smithi072.stdout:1/383: creat d1/d11/d18/d19/d1a/d61/d65/f6f x:0 0 0 2024-03-19T06:05:56.916 INFO:tasks.workunit.client.0.smithi072.stdout:5/526: symlink df/d16/d61/d9c/l9f 0 2024-03-19T06:05:56.916 INFO:tasks.workunit.client.0.smithi072.stdout:2/459: symlink db/d10/d2b/d2d/d9e/d48/d82/d98/la1 0 2024-03-19T06:05:56.922 INFO:tasks.workunit.client.0.smithi072.stdout:6/331: mknod d7/c71 0 2024-03-19T06:05:56.927 INFO:tasks.workunit.client.0.smithi072.stdout:5/527: chown df/d13/d32/d28/d42/d59/d43/d4e/d5c 526254914 1 2024-03-19T06:05:56.934 INFO:tasks.workunit.client.0.smithi072.stdout:3/407: dwrite d2/d19/f72 [0,4194304] 0 2024-03-19T06:05:56.934 INFO:tasks.workunit.client.0.smithi072.stdout:8/303: rmdir da/d13/d14/d1b/d57 39 2024-03-19T06:05:56.934 INFO:tasks.workunit.client.0.smithi072.stdout:7/317: symlink d2/d3/d18/d2f/l5e 0 2024-03-19T06:05:56.936 INFO:tasks.workunit.client.0.smithi072.stdout:0/318: dwrite d1/d1c/d24/d3f/d4a/f56 [0,4194304] 0 2024-03-19T06:05:56.937 INFO:tasks.workunit.client.0.smithi072.stdout:3/408: dread - d2/d75/f77 zero size 2024-03-19T06:05:56.938 INFO:tasks.workunit.client.0.smithi072.stdout:6/332: write d7/d9/d1b/f2a [1053248,10236] 0 2024-03-19T06:05:56.941 INFO:tasks.workunit.client.0.smithi072.stdout:1/384: rename d1/d11/d18/d19/d1a/d25/d3c/d48 to d1/d11/d18/d19/d70 0 2024-03-19T06:05:56.943 INFO:tasks.workunit.client.0.smithi072.stdout:4/407: dwrite d5/d15/d22/f44 [0,4194304] 0 2024-03-19T06:05:56.943 INFO:tasks.workunit.client.0.smithi072.stdout:5/528: fdatasync df/d3c/f35 0 2024-03-19T06:05:56.945 INFO:tasks.workunit.client.0.smithi072.stdout:0/319: mkdir d1/d1c/d24/d27/d65 0 2024-03-19T06:05:56.946 INFO:tasks.workunit.client.0.smithi072.stdout:3/409: mknod d2/d3/d15/c7a 0 2024-03-19T06:05:56.946 INFO:tasks.workunit.client.0.smithi072.stdout:6/333: truncate d7/d9/ff 4781389 0 2024-03-19T06:05:56.948 INFO:tasks.workunit.client.0.smithi072.stdout:9/275: getdents d11/d4b 0 2024-03-19T06:05:56.953 INFO:tasks.workunit.client.0.smithi072.stdout:5/529: mkdir df/d16/d61/d9c/da0 0 2024-03-19T06:05:56.953 INFO:tasks.workunit.client.0.smithi072.stdout:8/304: write da/d27/f39 [857712,56006] 0 2024-03-19T06:05:56.953 INFO:tasks.workunit.client.0.smithi072.stdout:5/530: stat df/d13/d24 0 2024-03-19T06:05:56.955 INFO:tasks.workunit.client.0.smithi072.stdout:9/276: creat d11/d1f/d43/f5a x:0 0 0 2024-03-19T06:05:56.955 INFO:tasks.workunit.client.0.smithi072.stdout:6/334: write d7/f15 [449333,97256] 0 2024-03-19T06:05:56.958 INFO:tasks.workunit.client.0.smithi072.stdout:4/408: rename d5/f6 to d5/d15/d50/f99 0 2024-03-19T06:05:56.959 INFO:tasks.workunit.client.0.smithi072.stdout:7/318: dread d2/d3/d18/d33/d1d/d2b/d3d/f7 [0,4194304] 0 2024-03-19T06:05:56.963 INFO:tasks.workunit.client.0.smithi072.stdout:1/385: unlink d1/d11/d18/d19/d1a/d25/d3c/c51 0 2024-03-19T06:05:56.968 INFO:tasks.workunit.client.0.smithi072.stdout:3/410: rename d2/d75/f77 to d2/d3/d15/d66/d70/f7b 0 2024-03-19T06:05:56.968 INFO:tasks.workunit.client.0.smithi072.stdout:8/305: creat da/d13/d14/d1b/d57/f63 x:0 0 0 2024-03-19T06:05:56.968 INFO:tasks.workunit.client.0.smithi072.stdout:9/277: chown d11/d59/f2c 37842 1 2024-03-19T06:05:56.970 INFO:tasks.workunit.client.0.smithi072.stdout:8/306: chown da/d13/d14/f60 2034 1 2024-03-19T06:05:56.973 INFO:tasks.workunit.client.0.smithi072.stdout:9/278: unlink d11/d1f/f39 0 2024-03-19T06:05:56.975 INFO:tasks.workunit.client.0.smithi072.stdout:3/411: symlink d2/d40/d78/l7c 0 2024-03-19T06:05:56.977 INFO:tasks.workunit.client.0.smithi072.stdout:8/307: creat da/d13/d14/d1b/d57/f64 x:0 0 0 2024-03-19T06:05:56.978 INFO:tasks.workunit.client.0.smithi072.stdout:3/412: mknod d2/d19/c7d 0 2024-03-19T06:05:56.980 INFO:tasks.workunit.client.0.smithi072.stdout:9/279: rename d11/d59 to d11/d1f/d2a/d36/d45/d5b 0 2024-03-19T06:05:56.983 INFO:tasks.workunit.client.0.smithi072.stdout:0/320: dwrite d1/d1c/d24/d27/f54 [0,4194304] 0 2024-03-19T06:05:56.990 INFO:tasks.workunit.client.0.smithi072.stdout:6/335: truncate d7/d9/d1b/d21/f24 2982322 0 2024-03-19T06:05:56.995 INFO:tasks.workunit.client.0.smithi072.stdout:7/319: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f7 [0,4194304] 0 2024-03-19T06:05:56.995 INFO:tasks.workunit.client.0.smithi072.stdout:0/321: rename d1/d1c/f1d to d1/d1c/d24/d3f/d4a/f66 0 2024-03-19T06:05:56.999 INFO:tasks.workunit.client.0.smithi072.stdout:3/413: truncate f1 1641661 0 2024-03-19T06:05:56.999 INFO:tasks.workunit.client.0.smithi072.stdout:8/308: write da/d27/d30/f3d [687514,79189] 0 2024-03-19T06:05:57.000 INFO:tasks.workunit.client.0.smithi072.stdout:7/320: fsync d2/d3/d18/d33/f3c 0 2024-03-19T06:05:57.002 INFO:tasks.workunit.client.0.smithi072.stdout:8/309: readlink da/d27/d41/l42 0 2024-03-19T06:05:57.003 INFO:tasks.workunit.client.0.smithi072.stdout:4/409: dwrite d5/fa [0,4194304] 0 2024-03-19T06:05:57.011 INFO:tasks.workunit.client.0.smithi072.stdout:0/322: mknod d1/d1c/d24/d3f/c67 0 2024-03-19T06:05:57.012 INFO:tasks.workunit.client.0.smithi072.stdout:4/410: creat d5/d15/d22/f9a x:0 0 0 2024-03-19T06:05:57.012 INFO:tasks.workunit.client.0.smithi072.stdout:8/310: chown da/d27/d30/c38 11 1 2024-03-19T06:05:57.012 INFO:tasks.workunit.client.0.smithi072.stdout:1/386: dread d1/d11/f1c [0,4194304] 0 2024-03-19T06:05:57.015 INFO:tasks.workunit.client.0.smithi072.stdout:6/336: getdents d7/d3f/d44 0 2024-03-19T06:05:57.017 INFO:tasks.workunit.client.0.smithi072.stdout:0/323: rmdir d1/d1c/d24/d3f/d4a 39 2024-03-19T06:05:57.019 INFO:tasks.workunit.client.0.smithi072.stdout:8/311: fsync da/d27/d52/d5b/d3e/d5a/f49 0 2024-03-19T06:05:57.019 INFO:tasks.workunit.client.0.smithi072.stdout:6/337: write d7/f34 [4795737,70759] 0 2024-03-19T06:05:57.021 INFO:tasks.workunit.client.0.smithi072.stdout:0/324: mknod d1/d2c/c68 0 2024-03-19T06:05:57.024 INFO:tasks.workunit.client.0.smithi072.stdout:7/321: dread d2/d3/d18/d33/d1d/f46 [0,4194304] 0 2024-03-19T06:05:57.025 INFO:tasks.workunit.client.0.smithi072.stdout:8/312: fsync da/d13/d14/f28 0 2024-03-19T06:05:57.026 INFO:tasks.workunit.client.0.smithi072.stdout:0/325: chown d1/c9 11 1 2024-03-19T06:05:57.029 INFO:tasks.workunit.client.0.smithi072.stdout:6/338: truncate d7/d9/fa 1227065 0 2024-03-19T06:05:57.031 INFO:tasks.workunit.client.0.smithi072.stdout:7/322: chown d2/d3/d18/d33/d1d/d2b/d3d/l1e 196 1 2024-03-19T06:05:57.034 INFO:tasks.workunit.client.0.smithi072.stdout:8/313: rename da/d37/d5c/l61 to da/d37/l65 0 2024-03-19T06:05:57.034 INFO:tasks.workunit.client.0.smithi072.stdout:9/280: dread d11/d1f/d2a/d36/f40 [0,4194304] 0 2024-03-19T06:05:57.035 INFO:tasks.workunit.client.0.smithi072.stdout:6/339: creat d7/d9/d1b/d31/f72 x:0 0 0 2024-03-19T06:05:57.040 INFO:tasks.workunit.client.0.smithi072.stdout:6/340: readlink d7/d3f/d65/l6d 0 2024-03-19T06:05:57.041 INFO:tasks.workunit.client.0.smithi072.stdout:9/281: chown d11/d24/l2f 0 1 2024-03-19T06:05:57.043 INFO:tasks.workunit.client.0.smithi072.stdout:0/326: truncate d1/d1c/d24/d3f/d4a/f66 2151725 0 2024-03-19T06:05:57.049 INFO:tasks.workunit.client.0.smithi072.stdout:1/387: dwrite d1/d11/d18/d19/d1a/d25/d3c/f62 [4194304,4194304] 0 2024-03-19T06:05:57.054 INFO:tasks.workunit.client.0.smithi072.stdout:1/388: symlink d1/l71 0 2024-03-19T06:05:57.056 INFO:tasks.workunit.client.0.smithi072.stdout:0/327: rmdir d1/d1c/d24/d3e/d5f 0 2024-03-19T06:05:57.059 INFO:tasks.workunit.client.0.smithi072.stdout:7/323: dwrite d2/d3/d18/d33/d53/f59 [0,4194304] 0 2024-03-19T06:05:57.059 INFO:tasks.workunit.client.0.smithi072.stdout:4/411: dread d5/d15/d31/d6d/f82 [0,4194304] 0 2024-03-19T06:05:57.065 INFO:tasks.workunit.client.0.smithi072.stdout:8/314: dwrite da/f50 [0,4194304] 0 2024-03-19T06:05:57.066 INFO:tasks.workunit.client.0.smithi072.stdout:9/282: dwrite d11/f37 [0,4194304] 0 2024-03-19T06:05:57.066 INFO:tasks.workunit.client.0.smithi072.stdout:4/412: fsync d5/d15/d22/d41/d61/d71/f8c 0 2024-03-19T06:05:57.070 INFO:tasks.workunit.client.0.smithi072.stdout:4/413: fsync d5/d37/f62 0 2024-03-19T06:05:57.075 INFO:tasks.workunit.client.0.smithi072.stdout:0/328: mknod d1/d1c/d24/d27/d65/c69 0 2024-03-19T06:05:57.076 INFO:tasks.workunit.client.0.smithi072.stdout:1/389: unlink d1/d16/l5f 0 2024-03-19T06:05:57.083 INFO:tasks.workunit.client.0.smithi072.stdout:9/283: write d11/f17 [3443373,11345] 0 2024-03-19T06:05:57.085 INFO:tasks.workunit.client.0.smithi072.stdout:7/324: link d2/d3/d18/d33/c1f d2/d3/d43/c5f 0 2024-03-19T06:05:57.086 INFO:tasks.workunit.client.0.smithi072.stdout:4/414: truncate d5/d11/f1a 3366569 0 2024-03-19T06:05:57.089 INFO:tasks.workunit.client.0.smithi072.stdout:8/315: dread da/f36 [0,4194304] 0 2024-03-19T06:05:57.092 INFO:tasks.workunit.client.0.smithi072.stdout:7/325: creat d2/f60 x:0 0 0 2024-03-19T06:05:57.095 INFO:tasks.workunit.client.0.smithi072.stdout:4/415: dread d5/d15/d22/d41/d61/f66 [0,4194304] 0 2024-03-19T06:05:57.098 INFO:tasks.workunit.client.0.smithi072.stdout:1/390: truncate d1/d11/f13 2358661 0 2024-03-19T06:05:57.104 INFO:tasks.workunit.client.0.smithi072.stdout:4/416: truncate d5/d15/d50/f2f 1222615 0 2024-03-19T06:05:57.114 INFO:tasks.workunit.client.0.smithi072.stdout:0/329: dwrite d1/d1c/d24/d3e/f62 [0,4194304] 0 2024-03-19T06:05:57.117 INFO:tasks.workunit.client.0.smithi072.stdout:4/417: write d5/d15/d50/f5b [449460,31820] 0 2024-03-19T06:05:57.119 INFO:tasks.workunit.client.0.smithi072.stdout:8/316: dwrite da/d13/f4f [0,4194304] 0 2024-03-19T06:05:57.121 INFO:tasks.workunit.client.0.smithi072.stdout:0/330: mkdir d1/d1c/d24/d3f/d4a/d6a 0 2024-03-19T06:05:57.122 INFO:tasks.workunit.client.0.smithi072.stdout:7/326: dwrite d2/d3/d18/d33/d53/f59 [0,4194304] 0 2024-03-19T06:05:57.123 INFO:tasks.workunit.client.0.smithi072.stdout:4/418: chown d5/d15/d31/d7d/d91 10 1 2024-03-19T06:05:57.133 INFO:tasks.workunit.client.0.smithi072.stdout:4/419: mknod d5/d15/d73/c9b 0 2024-03-19T06:05:57.134 INFO:tasks.workunit.client.0.smithi072.stdout:7/327: mknod d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/c61 0 2024-03-19T06:05:57.135 INFO:tasks.workunit.client.0.smithi072.stdout:1/391: dwrite d1/d11/d18/f2e [0,4194304] 0 2024-03-19T06:05:57.135 INFO:tasks.workunit.client.0.smithi072.stdout:0/331: creat d1/d1c/d24/d3f/f6b x:0 0 0 2024-03-19T06:05:57.141 INFO:tasks.workunit.client.0.smithi072.stdout:0/332: fdatasync d1/d1c/d24/d3f/d4a/f5a 0 2024-03-19T06:05:57.144 INFO:tasks.workunit.client.0.smithi072.stdout:7/328: link d2/d3/d18/d33/d53/f59 d2/d3/f62 0 2024-03-19T06:05:57.145 INFO:tasks.workunit.client.0.smithi072.stdout:7/329: readlink d2/d3/l10 0 2024-03-19T06:05:57.149 INFO:tasks.workunit.client.0.smithi072.stdout:4/420: write d5/d1b/f2b [1229955,93765] 0 2024-03-19T06:05:57.152 INFO:tasks.workunit.client.0.smithi072.stdout:7/330: mkdir d2/d3/d18/d33/d1d/d3b/d63 0 2024-03-19T06:05:57.154 INFO:tasks.workunit.client.0.smithi072.stdout:4/421: mknod d5/d15/d53/c9c 0 2024-03-19T06:05:57.156 INFO:tasks.workunit.client.0.smithi072.stdout:7/331: symlink d2/d3/d17/l64 0 2024-03-19T06:05:57.159 INFO:tasks.workunit.client.0.smithi072.stdout:1/392: dwrite d1/d16/f38 [0,4194304] 0 2024-03-19T06:05:57.350 INFO:tasks.workunit.client.0.smithi072.stdout:4/422: truncate d5/d15/d50/f2f 639654 0 2024-03-19T06:05:57.352 INFO:tasks.workunit.client.0.smithi072.stdout:1/393: truncate d1/d11/d18/d19/d1a/f2a 4772373 0 2024-03-19T06:05:57.357 INFO:tasks.workunit.client.0.smithi072.stdout:4/423: dread d5/d15/d22/d41/d61/f66 [0,4194304] 0 2024-03-19T06:05:57.359 INFO:tasks.workunit.client.0.smithi072.stdout:0/333: dwrite d1/d1c/d24/f32 [0,4194304] 0 2024-03-19T06:05:57.361 INFO:tasks.workunit.client.0.smithi072.stdout:1/394: mkdir d1/d11/d18/d19/d72 0 2024-03-19T06:05:57.363 INFO:tasks.workunit.client.0.smithi072.stdout:1/395: fsync d1/d16/f38 0 2024-03-19T06:05:57.367 INFO:tasks.workunit.client.0.smithi072.stdout:4/424: mkdir d5/d15/d31/d6f/d9d 0 2024-03-19T06:05:57.372 INFO:tasks.workunit.client.0.smithi072.stdout:0/334: mknod d1/d1c/d24/d27/c6c 0 2024-03-19T06:05:57.386 INFO:tasks.workunit.client.0.smithi072.stdout:4/425: unlink d5/l17 0 2024-03-19T06:05:57.391 INFO:tasks.workunit.client.0.smithi072.stdout:4/426: write d5/d15/d31/f3c [1141811,92952] 0 2024-03-19T06:05:57.399 INFO:tasks.workunit.client.0.smithi072.stdout:0/335: dwrite d1/f1a [4194304,4194304] 0 2024-03-19T06:05:57.403 INFO:tasks.workunit.client.0.smithi072.stdout:0/336: chown d1/d1c/d24/d27/f29 613721033 1 2024-03-19T06:05:57.416 INFO:tasks.workunit.client.0.smithi072.stdout:0/337: read d1/d1c/d24/d27/f29 [1580067,89410] 0 2024-03-19T06:05:57.435 INFO:tasks.workunit.client.0.smithi072.stdout:0/338: dwrite d1/f1a [0,4194304] 0 2024-03-19T06:05:57.443 INFO:tasks.workunit.client.0.smithi072.stdout:1/396: mkdir d1/d11/d18/d63/d73 0 2024-03-19T06:05:57.444 INFO:tasks.workunit.client.0.smithi072.stdout:1/397: readlink d1/l2d 0 2024-03-19T06:05:57.476 INFO:tasks.workunit.client.0.smithi072.stdout:0/339: rename d1/d1c/l20 to d1/l6d 0 2024-03-19T06:05:57.484 INFO:tasks.workunit.client.0.smithi072.stdout:1/398: getdents d1/d11/d18/d19/d1a/d25 0 2024-03-19T06:05:57.487 INFO:tasks.workunit.client.0.smithi072.stdout:0/340: symlink d1/d1c/d24/l6e 0 2024-03-19T06:05:57.488 INFO:tasks.workunit.client.0.smithi072.stdout:1/399: dread - d1/d11/d18/d19/d1a/d25/f6c zero size 2024-03-19T06:05:57.514 INFO:tasks.workunit.client.0.smithi072.stdout:0/341: dread d1/d1c/d24/d3f/d4a/f66 [0,4194304] 0 2024-03-19T06:05:57.519 INFO:tasks.workunit.client.0.smithi072.stdout:4/427: dwrite d5/d1b/f1d [0,4194304] 0 2024-03-19T06:05:57.519 INFO:tasks.workunit.client.0.smithi072.stdout:0/342: creat d1/f6f x:0 0 0 2024-03-19T06:05:57.530 INFO:tasks.workunit.client.0.smithi072.stdout:0/343: dread d1/d1c/d24/d3f/d4a/f66 [0,4194304] 0 2024-03-19T06:05:57.536 INFO:tasks.workunit.client.0.smithi072.stdout:4/428: truncate d5/d15/d22/f45 130620 0 2024-03-19T06:05:57.540 INFO:tasks.workunit.client.0.smithi072.stdout:4/429: mknod d5/d32/c9e 0 2024-03-19T06:05:57.546 INFO:tasks.workunit.client.0.smithi072.stdout:4/430: write d5/d15/d22/d41/d61/d71/f8c [736064,12077] 0 2024-03-19T06:05:57.550 INFO:tasks.workunit.client.0.smithi072.stdout:4/431: stat d5/d11/l19 0 2024-03-19T06:05:57.553 INFO:tasks.workunit.client.0.smithi072.stdout:4/432: stat d5/d15/d50 0 2024-03-19T06:05:57.553 INFO:tasks.workunit.client.0.smithi072.stdout:0/344: dwrite d1/d1c/d24/d3e/f5b [0,4194304] 0 2024-03-19T06:05:57.563 INFO:tasks.workunit.client.0.smithi072.stdout:0/345: unlink d1/d1c/d24/d27/f39 0 2024-03-19T06:05:57.568 INFO:tasks.workunit.client.0.smithi072.stdout:0/346: mknod d1/d1c/d24/d3f/d4a/c70 0 2024-03-19T06:05:57.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:57 smithi072 ceph-mon[28706]: pgmap v25: 65 pgs: 65 active+clean; 2.7 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 46 MiB/s rd, 143 MiB/s wr, 305 op/s 2024-03-19T06:05:57.580 INFO:tasks.workunit.client.0.smithi072.stdout:4/433: dwrite d5/ff [0,4194304] 0 2024-03-19T06:05:57.581 INFO:tasks.workunit.client.0.smithi072.stdout:4/434: read d5/ff [124919,14625] 0 2024-03-19T06:05:57.606 INFO:tasks.workunit.client.0.smithi072.stdout:2/460: sync 2024-03-19T06:05:57.622 INFO:tasks.workunit.client.0.smithi072.stdout:4/435: truncate d5/d1b/f33 2666600 0 2024-03-19T06:05:57.630 INFO:tasks.workunit.client.0.smithi072.stdout:4/436: creat d5/d15/d31/d7d/f9f x:0 0 0 2024-03-19T06:05:57.636 INFO:tasks.workunit.client.0.smithi072.stdout:2/461: dwrite db/d10/d13/d31/d35/f9d [0,4194304] 0 2024-03-19T06:05:57.639 INFO:tasks.workunit.client.0.smithi072.stdout:0/347: dwrite d1/f3d [0,4194304] 0 2024-03-19T06:05:57.640 INFO:tasks.workunit.client.0.smithi072.stdout:2/462: chown db/d10/d13/d31/d35/f9d 54706579 1 2024-03-19T06:05:57.643 INFO:tasks.workunit.client.0.smithi072.stdout:0/348: write d1/f3d [438631,29120] 0 2024-03-19T06:05:57.648 INFO:tasks.workunit.client.0.smithi072.stdout:2/463: creat db/d10/d2b/d2d/fa2 x:0 0 0 2024-03-19T06:05:57.651 INFO:tasks.workunit.client.0.smithi072.stdout:2/464: readlink db/d10/d2b/l56 0 2024-03-19T06:05:57.653 INFO:tasks.workunit.client.0.smithi072.stdout:0/349: rename d1/d1c/f4f to d1/d1c/d24/d3f/d4a/f71 0 2024-03-19T06:05:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:57 smithi172 ceph-mon[35716]: pgmap v25: 65 pgs: 65 active+clean; 2.7 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 46 MiB/s rd, 143 MiB/s wr, 305 op/s 2024-03-19T06:05:57.656 INFO:tasks.workunit.client.0.smithi072.stdout:4/437: dwrite d5/fa [0,4194304] 0 2024-03-19T06:05:57.663 INFO:tasks.workunit.client.0.smithi072.stdout:2/465: symlink db/d10/d2b/d2d/d62/la3 0 2024-03-19T06:05:57.666 INFO:tasks.workunit.client.0.smithi072.stdout:2/466: write db/d10/d13/d24/f5f [1357656,51820] 0 2024-03-19T06:05:57.670 INFO:tasks.workunit.client.0.smithi072.stdout:2/467: chown db/d10/d13/d24/d72/f74 22 1 2024-03-19T06:05:57.674 INFO:tasks.workunit.client.0.smithi072.stdout:2/468: mkdir db/d10/d2b/d45/da4 0 2024-03-19T06:05:57.681 INFO:tasks.workunit.client.0.smithi072.stdout:4/438: dwrite d5/d15/d50/f99 [4194304,4194304] 0 2024-03-19T06:05:57.685 INFO:tasks.workunit.client.0.smithi072.stdout:4/439: fsync d5/f10 0 2024-03-19T06:05:57.690 INFO:tasks.workunit.client.0.smithi072.stdout:4/440: dread d5/d15/d31/d6d/d7a/f88 [0,4194304] 0 2024-03-19T06:05:57.690 INFO:tasks.workunit.client.0.smithi072.stdout:2/469: write db/d10/f27 [1850586,66589] 0 2024-03-19T06:05:57.696 INFO:tasks.workunit.client.0.smithi072.stdout:4/441: creat d5/d15/d22/d41/fa0 x:0 0 0 2024-03-19T06:05:57.702 INFO:tasks.workunit.client.0.smithi072.stdout:2/470: dread db/d10/d2b/d2d/f46 [4194304,4194304] 0 2024-03-19T06:05:57.711 INFO:tasks.workunit.client.0.smithi072.stdout:4/442: dwrite d5/d32/d58/f85 [0,4194304] 0 2024-03-19T06:05:57.715 INFO:tasks.workunit.client.0.smithi072.stdout:4/443: creat d5/d37/fa1 x:0 0 0 2024-03-19T06:05:57.726 INFO:tasks.workunit.client.0.smithi072.stdout:4/444: dread d5/d1b/f1d [0,4194304] 0 2024-03-19T06:05:57.727 INFO:tasks.workunit.client.0.smithi072.stdout:4/445: chown d5/d32/l4b 122435570 1 2024-03-19T06:05:57.729 INFO:tasks.workunit.client.0.smithi072.stdout:4/446: readlink d5/d11/l59 0 2024-03-19T06:05:57.732 INFO:tasks.workunit.client.0.smithi072.stdout:4/447: rename d5/d15/d3f/c81 to d5/d15/d3f/ca2 0 2024-03-19T06:05:57.735 INFO:tasks.workunit.client.0.smithi072.stdout:4/448: creat d5/d15/d31/d6f/fa3 x:0 0 0 2024-03-19T06:05:57.739 INFO:tasks.workunit.client.0.smithi072.stdout:4/449: creat d5/d15/d31/d6d/d7a/d8e/fa4 x:0 0 0 2024-03-19T06:05:57.741 INFO:tasks.workunit.client.0.smithi072.stdout:4/450: creat d5/d15/d22/fa5 x:0 0 0 2024-03-19T06:05:57.743 INFO:tasks.workunit.client.0.smithi072.stdout:4/451: readlink d5/d15/d50/l56 0 2024-03-19T06:05:57.746 INFO:tasks.workunit.client.0.smithi072.stdout:4/452: mkdir d5/d15/da6 0 2024-03-19T06:05:57.750 INFO:tasks.workunit.client.0.smithi072.stdout:4/453: link d5/d11/f39 d5/d1b/fa7 0 2024-03-19T06:05:57.772 INFO:tasks.workunit.client.0.smithi072.stdout:4/454: dread d5/f25 [0,4194304] 0 2024-03-19T06:05:57.774 INFO:tasks.workunit.client.0.smithi072.stdout:4/455: unlink d5/d15/d22/l55 0 2024-03-19T06:05:57.776 INFO:tasks.workunit.client.0.smithi072.stdout:4/456: chown d5/d15/d22/d41/c79 1843 1 2024-03-19T06:05:57.780 INFO:tasks.workunit.client.0.smithi072.stdout:4/457: creat d5/fa8 x:0 0 0 2024-03-19T06:05:57.794 INFO:tasks.workunit.client.0.smithi072.stdout:4/458: truncate d5/d15/d31/f3c 689563 0 2024-03-19T06:05:57.797 INFO:tasks.workunit.client.0.smithi072.stdout:4/459: symlink d5/d15/d22/d95/la9 0 2024-03-19T06:05:57.802 INFO:tasks.workunit.client.0.smithi072.stdout:4/460: unlink d5/d37/l3b 0 2024-03-19T06:05:57.805 INFO:tasks.workunit.client.0.smithi072.stdout:4/461: creat d5/d37/d52/faa x:0 0 0 2024-03-19T06:05:57.811 INFO:tasks.workunit.client.0.smithi072.stdout:4/462: rename d5/f25 to d5/d15/d31/d7d/fab 0 2024-03-19T06:05:57.816 INFO:tasks.workunit.client.0.smithi072.stdout:4/463: symlink d5/d15/d22/d41/d61/d71/d72/lac 0 2024-03-19T06:05:57.817 INFO:tasks.workunit.client.0.smithi072.stdout:4/464: dread - d5/d15/d22/d41/fa0 zero size 2024-03-19T06:05:57.820 INFO:tasks.workunit.client.0.smithi072.stdout:4/465: write d5/d37/f62 [924230,127561] 0 2024-03-19T06:05:57.824 INFO:tasks.workunit.client.0.smithi072.stdout:4/466: symlink d5/d15/d31/d6d/d7a/lad 0 2024-03-19T06:05:57.825 INFO:tasks.workunit.client.0.smithi072.stdout:4/467: fsync d5/d15/d50/f5b 0 2024-03-19T06:05:57.834 INFO:tasks.workunit.client.0.smithi072.stdout:4/468: rename d5/d15/d31/c57 to d5/d15/d31/d4c/cae 0 2024-03-19T06:05:57.836 INFO:tasks.workunit.client.0.smithi072.stdout:4/469: dread - d5/d15/d31/d7d/f9f zero size 2024-03-19T06:05:57.842 INFO:tasks.workunit.client.0.smithi072.stdout:4/470: creat d5/d15/faf x:0 0 0 2024-03-19T06:05:57.849 INFO:tasks.workunit.client.0.smithi072.stdout:4/471: truncate d5/d15/d31/d4c/f75 963400 0 2024-03-19T06:05:57.852 INFO:tasks.workunit.client.0.smithi072.stdout:4/472: chown d5/d15/d22/d41/d7b/d7c 1662488 1 2024-03-19T06:05:57.863 INFO:tasks.workunit.client.0.smithi072.stdout:4/473: link d5/d15/d3f/f6b d5/d15/d31/d6d/fb0 0 2024-03-19T06:05:57.906 INFO:tasks.workunit.client.0.smithi072.stdout:4/474: dwrite d5/d15/d31/d6f/fa3 [0,4194304] 0 2024-03-19T06:05:57.971 INFO:tasks.workunit.client.0.smithi072.stdout:4/475: dwrite d5/d15/d31/d6d/d7a/f88 [0,4194304] 0 2024-03-19T06:05:58.040 INFO:tasks.workunit.client.0.smithi072.stdout:4/476: truncate d5/d15/d31/d6d/d7a/f88 3722600 0 2024-03-19T06:05:58.042 INFO:tasks.workunit.client.0.smithi072.stdout:4/477: chown d5/d1b/f2b 13861109 1 2024-03-19T06:05:58.051 INFO:tasks.workunit.client.0.smithi072.stdout:4/478: truncate d5/d15/d22/d41/d61/d71/f8c 1744015 0 2024-03-19T06:05:58.055 INFO:tasks.workunit.client.0.smithi072.stdout:4/479: read d5/f8 [2845376,4366] 0 2024-03-19T06:05:58.065 INFO:tasks.workunit.client.0.smithi072.stdout:4/480: symlink d5/d15/d22/d95/lb1 0 2024-03-19T06:05:58.072 INFO:tasks.workunit.client.0.smithi072.stdout:4/481: mknod d5/d15/cb2 0 2024-03-19T06:05:58.087 INFO:tasks.workunit.client.0.smithi072.stdout:4/482: rename d5/d15/d22/f45 to d5/d15/d22/d41/d61/d71/fb3 0 2024-03-19T06:05:58.106 INFO:tasks.workunit.client.0.smithi072.stdout:4/483: dread d5/d1b/f5a [0,4194304] 0 2024-03-19T06:05:58.150 INFO:tasks.workunit.client.0.smithi072.stdout:4/484: dwrite d5/d15/d31/f3c [0,4194304] 0 2024-03-19T06:05:58.152 INFO:tasks.workunit.client.0.smithi072.stdout:4/485: stat d5/d1b/c92 0 2024-03-19T06:05:58.164 INFO:tasks.workunit.client.0.smithi072.stdout:4/486: getdents d5/d15/d22/d95 0 2024-03-19T06:05:58.171 INFO:tasks.workunit.client.0.smithi072.stdout:4/487: mkdir d5/d15/d22/d41/d7b/d7c/db4 0 2024-03-19T06:05:58.176 INFO:tasks.workunit.client.0.smithi072.stdout:3/414: sync 2024-03-19T06:05:58.177 INFO:tasks.workunit.client.0.smithi072.stdout:5/531: sync 2024-03-19T06:05:58.187 INFO:tasks.workunit.client.0.smithi072.stdout:5/532: unlink df/d13/d32/d28/d42/d59/d43/l63 0 2024-03-19T06:05:58.188 INFO:tasks.workunit.client.0.smithi072.stdout:5/533: readlink l8 0 2024-03-19T06:05:58.192 INFO:tasks.workunit.client.0.smithi072.stdout:5/534: chown df/d13/d32/d28/l4a 411948 1 2024-03-19T06:05:58.194 INFO:tasks.workunit.client.0.smithi072.stdout:3/415: link d2/d3/d15/d66/d6b/l6e d2/d3/d15/d66/d6b/l7e 0 2024-03-19T06:05:58.197 INFO:tasks.workunit.client.0.smithi072.stdout:3/416: stat d2/d3/d26/f23 0 2024-03-19T06:05:58.205 INFO:tasks.workunit.client.0.smithi072.stdout:3/417: mknod d2/d3/d26/c7f 0 2024-03-19T06:05:58.206 INFO:tasks.workunit.client.0.smithi072.stdout:4/488: dwrite d5/d15/d22/d41/d61/d71/f8c [0,4194304] 0 2024-03-19T06:05:58.211 INFO:tasks.workunit.client.0.smithi072.stdout:5/535: getdents df/d13/d32/d28/d42 0 2024-03-19T06:05:58.217 INFO:tasks.workunit.client.0.smithi072.stdout:3/418: creat d2/d3/d15/d66/f80 x:0 0 0 2024-03-19T06:05:58.219 INFO:tasks.workunit.client.0.smithi072.stdout:4/489: read d5/d1b/f33 [98489,118201] 0 2024-03-19T06:05:58.225 INFO:tasks.workunit.client.0.smithi072.stdout:3/419: truncate d2/d3/d26/f22 805738 0 2024-03-19T06:05:58.226 INFO:tasks.workunit.client.0.smithi072.stdout:5/536: link df/c2b df/d13/d32/d28/d42/d59/d43/ca1 0 2024-03-19T06:05:58.231 INFO:tasks.workunit.client.0.smithi072.stdout:3/420: mknod d2/d3/d15/c81 0 2024-03-19T06:05:58.236 INFO:tasks.workunit.client.0.smithi072.stdout:5/537: mknod df/d13/d32/d28/d42/ca2 0 2024-03-19T06:05:58.241 INFO:tasks.workunit.client.0.smithi072.stdout:4/490: link d5/d15/d73/c9b d5/d15/d31/d7d/cb5 0 2024-03-19T06:05:58.242 INFO:tasks.workunit.client.0.smithi072.stdout:8/317: sync 2024-03-19T06:05:58.242 INFO:tasks.workunit.client.0.smithi072.stdout:7/332: sync 2024-03-19T06:05:58.242 INFO:tasks.workunit.client.0.smithi072.stdout:2/471: sync 2024-03-19T06:05:58.242 INFO:tasks.workunit.client.0.smithi072.stdout:1/400: sync 2024-03-19T06:05:58.242 INFO:tasks.workunit.client.0.smithi072.stdout:6/341: sync 2024-03-19T06:05:58.243 INFO:tasks.workunit.client.0.smithi072.stdout:9/284: sync 2024-03-19T06:05:58.243 INFO:tasks.workunit.client.0.smithi072.stdout:0/350: sync 2024-03-19T06:05:58.244 INFO:tasks.workunit.client.0.smithi072.stdout:4/491: dread - d5/d1b/f8d zero size 2024-03-19T06:05:58.249 INFO:tasks.workunit.client.0.smithi072.stdout:7/333: write d2/d3/d18/d33/f3c [2158163,100042] 0 2024-03-19T06:05:58.252 INFO:tasks.workunit.client.0.smithi072.stdout:1/401: unlink d1/l45 0 2024-03-19T06:05:58.257 INFO:tasks.workunit.client.0.smithi072.stdout:8/318: symlink da/d13/d3f/l66 0 2024-03-19T06:05:58.260 INFO:tasks.workunit.client.0.smithi072.stdout:2/472: dread db/d10/d2b/d2d/d9e/d48/f7b [0,4194304] 0 2024-03-19T06:05:58.265 INFO:tasks.workunit.client.0.smithi072.stdout:9/285: mkdir d11/d4b/d5c 0 2024-03-19T06:05:58.274 INFO:tasks.workunit.client.0.smithi072.stdout:4/492: creat d5/d15/d22/d41/d61/fb6 x:0 0 0 2024-03-19T06:05:58.278 INFO:tasks.workunit.client.0.smithi072.stdout:3/421: write d2/d3/d15/f4c [4122287,17908] 0 2024-03-19T06:05:58.281 INFO:tasks.workunit.client.0.smithi072.stdout:0/351: rename d1/d1c/d24/d3f/d4a/c70 to d1/d1c/d24/d27/c72 0 2024-03-19T06:05:58.282 INFO:tasks.workunit.client.0.smithi072.stdout:0/352: stat d1/d1c/f4c 0 2024-03-19T06:05:58.295 INFO:tasks.workunit.client.0.smithi072.stdout:1/402: mkdir d1/d11/d18/d63/d74 0 2024-03-19T06:05:58.295 INFO:tasks.workunit.client.0.smithi072.stdout:5/538: dwrite df/d13/f56 [0,4194304] 0 2024-03-19T06:05:58.299 INFO:tasks.workunit.client.0.smithi072.stdout:8/319: mknod da/d13/d3f/c67 0 2024-03-19T06:05:58.303 INFO:tasks.workunit.client.0.smithi072.stdout:6/342: dwrite d7/d2e/f47 [0,4194304] 0 2024-03-19T06:05:58.303 INFO:tasks.workunit.client.0.smithi072.stdout:2/473: creat db/d10/d13/d24/d61/d7d/fa5 x:0 0 0 2024-03-19T06:05:58.306 INFO:tasks.workunit.client.0.smithi072.stdout:2/474: chown db/d10/d2b/d2d/d66/f6f 239592 1 2024-03-19T06:05:58.310 INFO:tasks.workunit.client.0.smithi072.stdout:9/286: rmdir d11/d1f/d2a 39 2024-03-19T06:05:58.312 INFO:tasks.workunit.client.0.smithi072.stdout:9/287: dread - d11/d1f/d43/f5a zero size 2024-03-19T06:05:58.315 INFO:tasks.workunit.client.0.smithi072.stdout:4/493: rmdir d5/d32 39 2024-03-19T06:05:58.317 INFO:tasks.workunit.client.0.smithi072.stdout:1/403: dwrite d1/d16/f3a [0,4194304] 0 2024-03-19T06:05:58.317 INFO:tasks.workunit.client.0.smithi072.stdout:3/422: mknod d2/d3/d15/c82 0 2024-03-19T06:05:58.321 INFO:tasks.workunit.client.0.smithi072.stdout:0/353: unlink d1/d1c/d24/d3e/f62 0 2024-03-19T06:05:58.324 INFO:tasks.workunit.client.0.smithi072.stdout:0/354: stat d1/d1c/d24/d27 0 2024-03-19T06:05:58.326 INFO:tasks.workunit.client.0.smithi072.stdout:7/334: dwrite d2/d3/fd [0,4194304] 0 2024-03-19T06:05:58.332 INFO:tasks.workunit.client.0.smithi072.stdout:4/494: rmdir d5/d15/d31/d6d/d7a 39 2024-03-19T06:05:58.334 INFO:tasks.workunit.client.0.smithi072.stdout:7/335: write d2/d3/d18/d33/d1d/d2b/d3d/f7 [4440823,102938] 0 2024-03-19T06:05:58.336 INFO:tasks.workunit.client.0.smithi072.stdout:3/423: fsync d2/d3/d15/d66/d70/f7b 0 2024-03-19T06:05:58.339 INFO:tasks.workunit.client.0.smithi072.stdout:9/288: creat d11/d1f/d2a/d36/d3e/f5d x:0 0 0 2024-03-19T06:05:58.339 INFO:tasks.workunit.client.0.smithi072.stdout:1/404: dwrite d1/d11/d18/d19/d1a/d25/f6c [0,4194304] 0 2024-03-19T06:05:58.341 INFO:tasks.workunit.client.0.smithi072.stdout:9/289: stat d11/d1f/d2a/d36/f40 0 2024-03-19T06:05:58.349 INFO:tasks.workunit.client.0.smithi072.stdout:5/539: rename df/d13/d32/d28/f44 to df/d13/d32/fa3 0 2024-03-19T06:05:58.363 INFO:tasks.workunit.client.0.smithi072.stdout:4/495: rename d5/d15/d31/d4c/c78 to d5/d15/d31/d6d/d7a/cb7 0 2024-03-19T06:05:58.363 INFO:tasks.workunit.client.0.smithi072.stdout:4/496: readlink d5/l18 0 2024-03-19T06:05:58.366 INFO:tasks.workunit.client.0.smithi072.stdout:6/343: getdents d7/d9/d1b/d33 0 2024-03-19T06:05:58.366 INFO:tasks.workunit.client.0.smithi072.stdout:1/405: creat d1/d11/d18/d19/d1a/d25/d60/f75 x:0 0 0 2024-03-19T06:05:58.369 INFO:tasks.workunit.client.0.smithi072.stdout:6/344: chown d7/f2d 5 1 2024-03-19T06:05:58.369 INFO:tasks.workunit.client.0.smithi072.stdout:9/290: symlink d11/d4b/d57/l5e 0 2024-03-19T06:05:58.370 INFO:tasks.workunit.client.0.smithi072.stdout:4/497: chown d5/d15/d22/d41/d61/d71/fb3 6 1 2024-03-19T06:05:58.370 INFO:tasks.workunit.client.0.smithi072.stdout:9/291: readlink d11/d4b/d57/l5e 0 2024-03-19T06:05:58.372 INFO:tasks.workunit.client.0.smithi072.stdout:3/424: getdents d2/d3 0 2024-03-19T06:05:58.372 INFO:tasks.workunit.client.0.smithi072.stdout:5/540: creat df/d14/fa4 x:0 0 0 2024-03-19T06:05:58.374 INFO:tasks.workunit.client.0.smithi072.stdout:1/406: mkdir d1/d11/d76 0 2024-03-19T06:05:58.377 INFO:tasks.workunit.client.0.smithi072.stdout:9/292: rename d11/f22 to d11/d4b/d57/f5f 0 2024-03-19T06:05:58.379 INFO:tasks.workunit.client.0.smithi072.stdout:6/345: creat d7/d9/d1b/d21/f73 x:0 0 0 2024-03-19T06:05:58.380 INFO:tasks.workunit.client.0.smithi072.stdout:1/407: creat d1/d11/d18/d19/d70/f77 x:0 0 0 2024-03-19T06:05:58.381 INFO:tasks.workunit.client.0.smithi072.stdout:4/498: dread d5/d11/f36 [0,4194304] 0 2024-03-19T06:05:58.381 INFO:tasks.workunit.client.0.smithi072.stdout:3/425: creat d2/d3/d15/d66/d6b/d79/f83 x:0 0 0 2024-03-19T06:05:58.383 INFO:tasks.workunit.client.0.smithi072.stdout:9/293: symlink d11/d1f/d2a/d36/l60 0 2024-03-19T06:05:58.385 INFO:tasks.workunit.client.0.smithi072.stdout:4/499: write d5/d15/d50/f99 [9629116,48674] 0 2024-03-19T06:05:58.386 INFO:tasks.workunit.client.0.smithi072.stdout:7/336: dread d2/f4c [0,4194304] 0 2024-03-19T06:05:58.389 INFO:tasks.workunit.client.0.smithi072.stdout:4/500: creat d5/d15/d3f/fb8 x:0 0 0 2024-03-19T06:05:58.395 INFO:tasks.workunit.client.0.smithi072.stdout:1/408: dread d1/d16/f3a [0,4194304] 0 2024-03-19T06:05:58.399 INFO:tasks.workunit.client.0.smithi072.stdout:1/409: symlink d1/d11/d18/l78 0 2024-03-19T06:05:58.400 INFO:tasks.workunit.client.0.smithi072.stdout:3/426: dwrite d2/d3/d25/f39 [4194304,4194304] 0 2024-03-19T06:05:58.405 INFO:tasks.workunit.client.0.smithi072.stdout:9/294: rmdir d11/d1f/d2a/d36 39 2024-03-19T06:05:58.405 INFO:tasks.workunit.client.0.smithi072.stdout:5/541: dread df/d13/d32/d28/d42/f7a [0,4194304] 0 2024-03-19T06:05:58.407 INFO:tasks.workunit.client.0.smithi072.stdout:9/295: read - d11/d1f/d43/f5a zero size 2024-03-19T06:05:58.410 INFO:tasks.workunit.client.0.smithi072.stdout:1/410: mkdir d1/d11/d18/d19/d1a/d25/d3c/d79 0 2024-03-19T06:05:58.410 INFO:tasks.workunit.client.0.smithi072.stdout:7/337: dwrite d2/d3/d18/d20/d3a/f5d [0,4194304] 0 2024-03-19T06:05:58.413 INFO:tasks.workunit.client.0.smithi072.stdout:9/296: unlink d11/f3c 0 2024-03-19T06:05:58.418 INFO:tasks.workunit.client.0.smithi072.stdout:4/501: truncate d5/d15/d53/f6c 3158374 0 2024-03-19T06:05:58.425 INFO:tasks.workunit.client.0.smithi072.stdout:1/411: creat d1/d11/d18/d19/d1a/d61/f7a x:0 0 0 2024-03-19T06:05:58.428 INFO:tasks.workunit.client.0.smithi072.stdout:5/542: rename df/d13/d32/d28/d42/d59/d43/d4e/d5c/f91 to df/fa5 0 2024-03-19T06:05:58.429 INFO:tasks.workunit.client.0.smithi072.stdout:7/338: truncate d2/d3/d17/f48 2212648 0 2024-03-19T06:05:58.430 INFO:tasks.workunit.client.0.smithi072.stdout:1/412: symlink d1/d11/d76/l7b 0 2024-03-19T06:05:58.431 INFO:tasks.workunit.client.0.smithi072.stdout:9/297: dwrite d11/f1b [0,4194304] 0 2024-03-19T06:05:58.431 INFO:tasks.workunit.client.0.smithi072.stdout:3/427: dwrite d2/d3/fb [8388608,4194304] 0 2024-03-19T06:05:58.439 INFO:tasks.workunit.client.0.smithi072.stdout:1/413: creat d1/d11/d18/d19/d1a/d25/d3c/d52/f7c x:0 0 0 2024-03-19T06:05:58.441 INFO:tasks.workunit.client.0.smithi072.stdout:7/339: unlink d2/l2e 0 2024-03-19T06:05:58.447 INFO:tasks.workunit.client.0.smithi072.stdout:3/428: rename d2/d19/d1e/c76 to d2/d3/c84 0 2024-03-19T06:05:58.448 INFO:tasks.workunit.client.0.smithi072.stdout:9/298: dread d11/f1e [0,4194304] 0 2024-03-19T06:05:58.450 INFO:tasks.workunit.client.0.smithi072.stdout:9/299: readlink lb 0 2024-03-19T06:05:58.461 INFO:tasks.workunit.client.0.smithi072.stdout:7/340: dread d2/d3/f62 [0,4194304] 0 2024-03-19T06:05:58.468 INFO:tasks.workunit.client.0.smithi072.stdout:1/414: dwrite d1/d11/d18/d19/d1a/d61/d65/f6f [0,4194304] 0 2024-03-19T06:05:58.469 INFO:tasks.workunit.client.0.smithi072.stdout:5/543: dwrite df/d13/f5e [0,4194304] 0 2024-03-19T06:05:58.473 INFO:tasks.workunit.client.0.smithi072.stdout:7/341: read d2/d3/d18/d33/d1d/d2b/d3d/f39 [6469351,28763] 0 2024-03-19T06:05:58.486 INFO:tasks.workunit.client.0.smithi072.stdout:3/429: dwrite d2/d19/d1e/f32 [0,4194304] 0 2024-03-19T06:05:58.486 INFO:tasks.workunit.client.0.smithi072.stdout:7/342: write d2/d3/d18/d33/d1d/d2b/d3d/f11 [1875622,129759] 0 2024-03-19T06:05:58.488 INFO:tasks.workunit.client.0.smithi072.stdout:9/300: dwrite d11/f37 [4194304,4194304] 0 2024-03-19T06:05:58.493 INFO:tasks.workunit.client.0.smithi072.stdout:3/430: write d2/d19/f52 [27098,68805] 0 2024-03-19T06:05:58.496 INFO:tasks.workunit.client.0.smithi072.stdout:5/544: write df/d16/d61/f73 [111869,126673] 0 2024-03-19T06:05:58.501 INFO:tasks.workunit.client.0.smithi072.stdout:1/415: dread d1/d11/d18/d19/d1a/d61/d65/f6f [0,4194304] 0 2024-03-19T06:05:58.505 INFO:tasks.workunit.client.0.smithi072.stdout:7/343: rename d2/d3/d18/d33/d1d/d2b/d3d/cb to d2/d3/d18/d33/d1d/c65 0 2024-03-19T06:05:58.507 INFO:tasks.workunit.client.0.smithi072.stdout:3/431: creat d2/d3/d25/f85 x:0 0 0 2024-03-19T06:05:58.509 INFO:tasks.workunit.client.0.smithi072.stdout:1/416: chown d1/d11/d18/d19/d1a/d61/f7a 2781 1 2024-03-19T06:05:58.514 INFO:tasks.workunit.client.0.smithi072.stdout:3/432: write d2/d3/fb [6025699,109894] 0 2024-03-19T06:05:58.517 INFO:tasks.workunit.client.0.smithi072.stdout:3/433: write d2/d3/fb [10861706,93502] 0 2024-03-19T06:05:58.517 INFO:tasks.workunit.client.0.smithi072.stdout:9/301: dwrite d11/d1f/d2a/d36/f4f [0,4194304] 0 2024-03-19T06:05:58.522 INFO:tasks.workunit.client.0.smithi072.stdout:7/344: link d2/d3/d18/d33/d1d/d2b/f4b d2/f66 0 2024-03-19T06:05:58.527 INFO:tasks.workunit.client.0.smithi072.stdout:1/417: rename d1/d16/f3a to d1/d11/d18/d19/d1a/d25/d3c/f7d 0 2024-03-19T06:05:58.533 INFO:tasks.workunit.client.0.smithi072.stdout:5/545: dwrite df/d16/f36 [0,4194304] 0 2024-03-19T06:05:58.540 INFO:tasks.workunit.client.0.smithi072.stdout:1/418: unlink d1/f4d 0 2024-03-19T06:05:58.552 INFO:tasks.workunit.client.0.smithi072.stdout:1/419: creat d1/d11/d18/d19/d72/f7e x:0 0 0 2024-03-19T06:05:58.554 INFO:tasks.workunit.client.0.smithi072.stdout:7/345: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f7 [0,4194304] 0 2024-03-19T06:05:58.557 INFO:tasks.workunit.client.0.smithi072.stdout:3/434: dwrite d2/d3/d15/f4c [0,4194304] 0 2024-03-19T06:05:58.559 INFO:tasks.workunit.client.0.smithi072.stdout:3/435: fdatasync d2/d19/d1e/f6f 0 2024-03-19T06:05:58.563 INFO:tasks.workunit.client.0.smithi072.stdout:7/346: fdatasync d2/d3/d17/f48 0 2024-03-19T06:05:58.567 INFO:tasks.workunit.client.0.smithi072.stdout:9/302: dread d11/f25 [0,4194304] 0 2024-03-19T06:05:58.567 INFO:tasks.workunit.client.0.smithi072.stdout:3/436: chown d2/d3/f14 261897 1 2024-03-19T06:05:58.569 INFO:tasks.workunit.client.0.smithi072.stdout:7/347: mkdir d2/d3/d18/d33/d1d/d2b/d67 0 2024-03-19T06:05:58.571 INFO:tasks.workunit.client.0.smithi072.stdout:9/303: write d11/d1f/d43/f5a [6639,2176] 0 2024-03-19T06:05:58.573 INFO:tasks.workunit.client.0.smithi072.stdout:7/348: read d2/f4c [2398447,59929] 0 2024-03-19T06:05:58.576 INFO:tasks.workunit.client.0.smithi072.stdout:3/437: creat d2/d3/d25/f86 x:0 0 0 2024-03-19T06:05:58.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:58 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:05:58.577 INFO:tasks.workunit.client.0.smithi072.stdout:5/546: dread df/d13/d24/f65 [0,4194304] 0 2024-03-19T06:05:58.577 INFO:tasks.workunit.client.0.smithi072.stdout:9/304: symlink d11/d4b/l61 0 2024-03-19T06:05:58.580 INFO:tasks.workunit.client.0.smithi072.stdout:7/349: mknod d2/d3/d18/d33/d53/c68 0 2024-03-19T06:05:58.587 INFO:tasks.workunit.client.0.smithi072.stdout:3/438: mknod d2/c87 0 2024-03-19T06:05:58.588 INFO:tasks.workunit.client.0.smithi072.stdout:3/439: chown d2/d75 25 1 2024-03-19T06:05:58.589 INFO:tasks.workunit.client.0.smithi072.stdout:5/547: dread - df/f64 zero size 2024-03-19T06:05:58.589 INFO:tasks.workunit.client.0.smithi072.stdout:1/420: write d1/d11/d18/d19/d1a/d25/f43 [29526,94403] 0 2024-03-19T06:05:58.593 INFO:tasks.workunit.client.0.smithi072.stdout:7/350: fsync d2/d3/d18/d33/d1d/d2b/f49 0 2024-03-19T06:05:58.602 INFO:tasks.workunit.client.0.smithi072.stdout:1/421: creat d1/d11/d18/d19/d1a/d25/d3c/d52/f7f x:0 0 0 2024-03-19T06:05:58.604 INFO:tasks.workunit.client.0.smithi072.stdout:9/305: creat d11/d1f/d2a/d36/d45/d4d/f62 x:0 0 0 2024-03-19T06:05:58.605 INFO:tasks.workunit.client.0.smithi072.stdout:1/422: dread - d1/d11/d18/d19/d1a/d25/d60/f75 zero size 2024-03-19T06:05:58.615 INFO:tasks.workunit.client.0.smithi072.stdout:8/320: sync 2024-03-19T06:05:58.616 INFO:tasks.workunit.client.0.smithi072.stdout:9/306: link d11/d1f/d2a/d36/f53 d11/d1f/d43/f63 0 2024-03-19T06:05:58.616 INFO:tasks.workunit.client.0.smithi072.stdout:8/321: stat da/d27/f43 0 2024-03-19T06:05:58.617 INFO:tasks.workunit.client.0.smithi072.stdout:9/307: chown d11/f44 4 1 2024-03-19T06:05:58.618 INFO:tasks.workunit.client.0.smithi072.stdout:8/322: dread - da/d13/d14/f60 zero size 2024-03-19T06:05:58.618 INFO:tasks.workunit.client.0.smithi072.stdout:7/351: rename d2/d3/d18/d33/d1d/d2b/f49 to d2/d3/d17/f69 0 2024-03-19T06:05:58.620 INFO:tasks.workunit.client.0.smithi072.stdout:3/440: write f1 [855260,48550] 0 2024-03-19T06:05:58.622 INFO:tasks.workunit.client.0.smithi072.stdout:5/548: write df/d14/f15 [440521,125352] 0 2024-03-19T06:05:58.623 INFO:tasks.workunit.client.0.smithi072.stdout:9/308: write d11/d4b/f52 [8382639,106330] 0 2024-03-19T06:05:58.625 INFO:tasks.workunit.client.0.smithi072.stdout:3/441: symlink d2/d3/d15/d66/d6b/l88 0 2024-03-19T06:05:58.625 INFO:tasks.workunit.client.0.smithi072.stdout:9/309: fsync d11/f19 0 2024-03-19T06:05:58.628 INFO:tasks.workunit.client.0.smithi072.stdout:1/423: dread d1/f6 [0,4194304] 0 2024-03-19T06:05:58.628 INFO:tasks.workunit.client.0.smithi072.stdout:9/310: write d11/d1f/d2a/d36/d3e/f5d [304030,103586] 0 2024-03-19T06:05:58.629 INFO:tasks.workunit.client.0.smithi072.stdout:8/323: creat da/d13/d14/d1b/f68 x:0 0 0 2024-03-19T06:05:58.633 INFO:tasks.workunit.client.0.smithi072.stdout:7/352: creat d2/d3/d18/d33/d1d/d2b/d3d/f6a x:0 0 0 2024-03-19T06:05:58.636 INFO:tasks.workunit.client.0.smithi072.stdout:9/311: mkdir d11/d24/d4c/d64 0 2024-03-19T06:05:58.638 INFO:tasks.workunit.client.0.smithi072.stdout:8/324: unlink da/d13/d14/f35 0 2024-03-19T06:05:58.641 INFO:tasks.workunit.client.0.smithi072.stdout:8/325: write da/f51 [1167525,75681] 0 2024-03-19T06:05:58.641 INFO:tasks.workunit.client.0.smithi072.stdout:5/549: dwrite df/d13/f56 [0,4194304] 0 2024-03-19T06:05:58.643 INFO:tasks.workunit.client.0.smithi072.stdout:8/326: fdatasync da/d13/d14/d1b/d57/f63 0 2024-03-19T06:05:58.644 INFO:tasks.workunit.client.0.smithi072.stdout:3/442: rename d2/d19/c1a to d2/d40/c89 0 2024-03-19T06:05:58.646 INFO:tasks.workunit.client.0.smithi072.stdout:3/443: stat d2/d19/l5b 0 2024-03-19T06:05:58.646 INFO:tasks.workunit.client.0.smithi072.stdout:9/312: creat d11/d24/f65 x:0 0 0 2024-03-19T06:05:58.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:58 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:05:58.688 INFO:tasks.workunit.client.0.smithi072.stdout:8/327: mkdir da/d37/d69 0 2024-03-19T06:05:58.690 INFO:tasks.workunit.client.0.smithi072.stdout:3/444: readlink d2/d19/d1e/l45 0 2024-03-19T06:05:58.690 INFO:tasks.workunit.client.0.smithi072.stdout:5/550: write df/d14/f2f [883768,59418] 0 2024-03-19T06:05:58.691 INFO:tasks.workunit.client.0.smithi072.stdout:9/313: write d11/f19 [2298374,103302] 0 2024-03-19T06:05:58.691 INFO:tasks.workunit.client.0.smithi072.stdout:8/328: mknod da/d3b/c6a 0 2024-03-19T06:05:58.692 INFO:tasks.workunit.client.0.smithi072.stdout:1/424: dread d1/f15 [4194304,4194304] 0 2024-03-19T06:05:58.694 INFO:tasks.workunit.client.0.smithi072.stdout:9/314: read - d11/d1f/d43/f63 zero size 2024-03-19T06:05:58.694 INFO:tasks.workunit.client.0.smithi072.stdout:3/445: mknod d2/d3/d15/c8a 0 2024-03-19T06:05:58.698 INFO:tasks.workunit.client.0.smithi072.stdout:3/446: creat d2/d19/f8b x:0 0 0 2024-03-19T06:05:58.700 INFO:tasks.workunit.client.0.smithi072.stdout:3/447: write d2/d3/d25/f42 [535828,125053] 0 2024-03-19T06:05:58.701 INFO:tasks.workunit.client.0.smithi072.stdout:8/329: mkdir da/d13/d14/d1b/d6b 0 2024-03-19T06:05:58.703 INFO:tasks.workunit.client.0.smithi072.stdout:3/448: mknod d2/d75/c8c 0 2024-03-19T06:05:58.705 INFO:tasks.workunit.client.0.smithi072.stdout:9/315: rename d11/d24/f65 to d11/d1f/f66 0 2024-03-19T06:05:58.705 INFO:tasks.workunit.client.0.smithi072.stdout:5/551: dread df/d13/d32/d28/d42/f78 [0,4194304] 0 2024-03-19T06:05:58.707 INFO:tasks.workunit.client.0.smithi072.stdout:3/449: symlink d2/d3/d15/d66/l8d 0 2024-03-19T06:05:58.707 INFO:tasks.workunit.client.0.smithi072.stdout:5/552: readlink df/d13/d32/d28/d42/d59/d43/d4e/l74 0 2024-03-19T06:05:58.708 INFO:tasks.workunit.client.0.smithi072.stdout:8/330: link da/d13/f4f da/d37/f6c 0 2024-03-19T06:05:58.709 INFO:tasks.workunit.client.0.smithi072.stdout:5/553: chown df/d3c/l89 16284275 1 2024-03-19T06:05:58.717 INFO:tasks.workunit.client.0.smithi072.stdout:5/554: rename df/d16/f39 to df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97/fa6 0 2024-03-19T06:05:58.718 INFO:tasks.workunit.client.0.smithi072.stdout:9/316: link d11/d24/d4c/c51 d11/d1f/d2a/d36/d45/d4d/c67 0 2024-03-19T06:05:58.720 INFO:tasks.workunit.client.0.smithi072.stdout:5/555: readlink df/d13/d32/d28/d42/d59/d43/d62/l7d 0 2024-03-19T06:05:58.721 INFO:tasks.workunit.client.0.smithi072.stdout:8/331: write da/d3b/f54 [116610,100557] 0 2024-03-19T06:05:58.722 INFO:tasks.workunit.client.0.smithi072.stdout:3/450: dwrite d2/d19/f52 [0,4194304] 0 2024-03-19T06:05:58.727 INFO:tasks.workunit.client.0.smithi072.stdout:9/317: dread d11/d1f/d2a/d36/d3e/f5d [0,4194304] 0 2024-03-19T06:05:58.727 INFO:tasks.workunit.client.0.smithi072.stdout:8/332: symlink da/d27/d30/l6d 0 2024-03-19T06:05:58.730 INFO:tasks.workunit.client.0.smithi072.stdout:8/333: dread - da/d13/d14/d1b/d57/f64 zero size 2024-03-19T06:05:58.734 INFO:tasks.workunit.client.0.smithi072.stdout:9/318: write d11/d1f/d2a/d36/d3e/f58 [787844,88027] 0 2024-03-19T06:05:58.734 INFO:tasks.workunit.client.0.smithi072.stdout:5/556: write df/d13/d24/f65 [1212411,12174] 0 2024-03-19T06:05:58.736 INFO:tasks.workunit.client.0.smithi072.stdout:3/451: link d2/d19/c4f d2/d3/d26/c8e 0 2024-03-19T06:05:58.738 INFO:tasks.workunit.client.0.smithi072.stdout:5/557: mknod df/d14/d5d/ca7 0 2024-03-19T06:05:58.739 INFO:tasks.workunit.client.0.smithi072.stdout:9/319: truncate d11/f1e 943170 0 2024-03-19T06:05:58.746 INFO:tasks.workunit.client.0.smithi072.stdout:5/558: creat df/d13/d32/d28/d42/d59/d43/d62/fa8 x:0 0 0 2024-03-19T06:05:58.746 INFO:tasks.workunit.client.0.smithi072.stdout:8/334: getdents da/d27/d52/d5b/d3e 0 2024-03-19T06:05:58.747 INFO:tasks.workunit.client.0.smithi072.stdout:9/320: mkdir d11/d1f/d2a/d68 0 2024-03-19T06:05:58.747 INFO:tasks.workunit.client.0.smithi072.stdout:8/335: fsync da/d27/d41/f46 0 2024-03-19T06:05:58.749 INFO:tasks.workunit.client.0.smithi072.stdout:9/321: dread - d11/d1f/d2a/d36/f53 zero size 2024-03-19T06:05:58.751 INFO:tasks.workunit.client.0.smithi072.stdout:5/559: creat df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/fa9 x:0 0 0 2024-03-19T06:05:58.754 INFO:tasks.workunit.client.0.smithi072.stdout:3/452: write d2/d3/d26/f58 [1754817,48138] 0 2024-03-19T06:05:58.758 INFO:tasks.workunit.client.0.smithi072.stdout:9/322: mknod d11/d24/d4c/d64/c69 0 2024-03-19T06:05:58.760 INFO:tasks.workunit.client.0.smithi072.stdout:3/453: rename d2/d19/c41 to d2/d19/c8f 0 2024-03-19T06:05:58.762 INFO:tasks.workunit.client.0.smithi072.stdout:3/454: fdatasync d2/d19/f8b 0 2024-03-19T06:05:58.763 INFO:tasks.workunit.client.0.smithi072.stdout:9/323: creat d11/d4b/f6a x:0 0 0 2024-03-19T06:05:58.764 INFO:tasks.workunit.client.0.smithi072.stdout:3/455: write d2/f30 [176309,77166] 0 2024-03-19T06:05:58.765 INFO:tasks.workunit.client.0.smithi072.stdout:9/324: dread - d11/d1f/f66 zero size 2024-03-19T06:05:58.766 INFO:tasks.workunit.client.0.smithi072.stdout:5/560: write df/d13/d32/d28/d42/f79 [814926,67309] 0 2024-03-19T06:05:58.769 INFO:tasks.workunit.client.0.smithi072.stdout:9/325: write d11/d4b/f6a [745593,98661] 0 2024-03-19T06:05:58.774 INFO:tasks.workunit.client.0.smithi072.stdout:8/336: dread f8 [4194304,4194304] 0 2024-03-19T06:05:58.774 INFO:tasks.workunit.client.0.smithi072.stdout:9/326: symlink d11/d4b/d5c/l6b 0 2024-03-19T06:05:58.775 INFO:tasks.workunit.client.0.smithi072.stdout:8/337: fsync da/f51 0 2024-03-19T06:05:58.779 INFO:tasks.workunit.client.0.smithi072.stdout:8/338: creat da/d27/d52/d5b/f6e x:0 0 0 2024-03-19T06:05:58.782 INFO:tasks.workunit.client.0.smithi072.stdout:5/561: unlink df/d13/d32/d28/d42/d59/d43/d4e/d5c/l8b 0 2024-03-19T06:05:58.783 INFO:tasks.workunit.client.0.smithi072.stdout:5/562: write df/f69 [569222,32000] 0 2024-03-19T06:05:58.785 INFO:tasks.workunit.client.0.smithi072.stdout:9/327: getdents d11/d4b/d57 0 2024-03-19T06:05:58.785 INFO:tasks.workunit.client.0.smithi072.stdout:5/563: dread - df/d13/d32/d28/f99 zero size 2024-03-19T06:05:58.788 INFO:tasks.workunit.client.0.smithi072.stdout:5/564: rmdir df 39 2024-03-19T06:05:58.789 INFO:tasks.workunit.client.0.smithi072.stdout:9/328: mknod d11/d1f/c6c 0 2024-03-19T06:05:58.789 INFO:tasks.workunit.client.0.smithi072.stdout:9/329: stat lb 0 2024-03-19T06:05:58.801 INFO:tasks.workunit.client.0.smithi072.stdout:9/330: link d11/d1f/d2a/d36/d45/d4d/c67 d11/d4b/d5c/c6d 0 2024-03-19T06:05:58.802 INFO:tasks.workunit.client.0.smithi072.stdout:0/355: sync 2024-03-19T06:05:58.802 INFO:tasks.workunit.client.0.smithi072.stdout:2/475: sync 2024-03-19T06:05:58.802 INFO:tasks.workunit.client.0.smithi072.stdout:9/331: chown d11/d1f/d2a/d36/d45 1253 1 2024-03-19T06:05:58.804 INFO:tasks.workunit.client.0.smithi072.stdout:2/476: fsync db/d10/d13/f20 0 2024-03-19T06:05:58.805 INFO:tasks.workunit.client.0.smithi072.stdout:0/356: write d1/d1c/f4c [1670641,112381] 0 2024-03-19T06:05:58.811 INFO:tasks.workunit.client.0.smithi072.stdout:5/565: dwrite df/d3c/f68 [0,4194304] 0 2024-03-19T06:05:58.812 INFO:tasks.workunit.client.0.smithi072.stdout:8/339: dread da/f2d [0,4194304] 0 2024-03-19T06:05:58.949 INFO:tasks.workunit.client.0.smithi072.stdout:8/340: mkdir da/d13/d14/d6f 0 2024-03-19T06:05:58.952 INFO:tasks.workunit.client.0.smithi072.stdout:5/566: dread - df/d13/d32/d28/d42/d59/d43/d62/f71 zero size 2024-03-19T06:05:58.962 INFO:tasks.workunit.client.0.smithi072.stdout:2/477: dwrite db/d10/d12/f1b [0,4194304] 0 2024-03-19T06:05:58.962 INFO:tasks.workunit.client.0.smithi072.stdout:0/357: dread d1/fb [0,4194304] 0 2024-03-19T06:05:58.964 INFO:tasks.workunit.client.0.smithi072.stdout:5/567: fdatasync df/f64 0 2024-03-19T06:05:58.966 INFO:tasks.workunit.client.0.smithi072.stdout:8/341: write da/d3b/f5e [335938,32005] 0 2024-03-19T06:05:58.975 INFO:tasks.workunit.client.0.smithi072.stdout:2/478: symlink db/d10/d13/d24/la6 0 2024-03-19T06:05:58.976 INFO:tasks.workunit.client.0.smithi072.stdout:8/342: truncate da/f50 4715276 0 2024-03-19T06:05:58.978 INFO:tasks.workunit.client.0.smithi072.stdout:9/332: dwrite d11/f1e [0,4194304] 0 2024-03-19T06:05:58.983 INFO:tasks.workunit.client.0.smithi072.stdout:8/343: write da/d27/d52/d5b/f6e [113134,12933] 0 2024-03-19T06:05:58.985 INFO:tasks.workunit.client.0.smithi072.stdout:9/333: mkdir d11/d24/d4c/d6e 0 2024-03-19T06:05:58.990 INFO:tasks.workunit.client.0.smithi072.stdout:8/344: mknod da/d13/d14/d1b/d57/c70 0 2024-03-19T06:05:58.992 INFO:tasks.workunit.client.0.smithi072.stdout:0/358: dread d1/f3d [0,4194304] 0 2024-03-19T06:05:58.992 INFO:tasks.workunit.client.0.smithi072.stdout:8/345: chown da/d27/d30 6526 1 2024-03-19T06:05:58.992 INFO:tasks.workunit.client.0.smithi072.stdout:2/479: link db/d10/d44/f54 db/d10/d2b/d2d/fa7 0 2024-03-19T06:05:58.995 INFO:tasks.workunit.client.0.smithi072.stdout:8/346: write da/d13/d14/f17 [1304410,14546] 0 2024-03-19T06:05:58.999 INFO:tasks.workunit.client.0.smithi072.stdout:2/480: creat db/d10/d13/d24/d72/fa8 x:0 0 0 2024-03-19T06:05:59.005 INFO:tasks.workunit.client.0.smithi072.stdout:2/481: creat db/d10/d13/d24/d61/d7d/fa9 x:0 0 0 2024-03-19T06:05:59.008 INFO:tasks.workunit.client.0.smithi072.stdout:5/568: dwrite df/d13/d32/d28/d42/d59/d43/f75 [0,4194304] 0 2024-03-19T06:05:59.012 INFO:tasks.workunit.client.0.smithi072.stdout:2/482: write db/d10/d2b/d45/f58 [4897872,47278] 0 2024-03-19T06:05:59.016 INFO:tasks.workunit.client.0.smithi072.stdout:9/334: dwrite d11/d1f/d2a/d36/f4f [0,4194304] 0 2024-03-19T06:05:59.016 INFO:tasks.workunit.client.0.smithi072.stdout:6/346: sync 2024-03-19T06:05:59.016 INFO:tasks.workunit.client.0.smithi072.stdout:7/353: sync 2024-03-19T06:05:59.016 INFO:tasks.workunit.client.0.smithi072.stdout:2/483: fsync db/d10/d2b/d2d/d9e/f42 0 2024-03-19T06:05:59.016 INFO:tasks.workunit.client.0.smithi072.stdout:4/502: sync 2024-03-19T06:05:59.018 INFO:tasks.workunit.client.0.smithi072.stdout:0/359: dwrite d1/d1c/f23 [0,4194304] 0 2024-03-19T06:05:59.022 INFO:tasks.workunit.client.0.smithi072.stdout:2/484: stat db/d10/d2b/d2d/d9e/f42 0 2024-03-19T06:05:59.028 INFO:tasks.workunit.client.0.smithi072.stdout:0/360: chown d1/l11 11533881 1 2024-03-19T06:05:59.029 INFO:tasks.workunit.client.0.smithi072.stdout:0/361: readlink d1/l10 0 2024-03-19T06:05:59.032 INFO:tasks.workunit.client.0.smithi072.stdout:5/569: truncate df/d13/d32/d28/d42/d59/d43/d4e/d5c/f6f 1059162 0 2024-03-19T06:05:59.032 INFO:tasks.workunit.client.0.smithi072.stdout:6/347: creat d7/d9/d1b/d33/f74 x:0 0 0 2024-03-19T06:05:59.040 INFO:tasks.workunit.client.0.smithi072.stdout:2/485: rename db/d10/d44/c60 to db/d10/d44/caa 0 2024-03-19T06:05:59.046 INFO:tasks.workunit.client.0.smithi072.stdout:9/335: dwrite d11/f1e [0,4194304] 0 2024-03-19T06:05:59.046 INFO:tasks.workunit.client.0.smithi072.stdout:6/348: mkdir d7/d9/d1b/d21/d68/d75 0 2024-03-19T06:05:59.046 INFO:tasks.workunit.client.0.smithi072.stdout:5/570: creat df/d13/d32/faa x:0 0 0 2024-03-19T06:05:59.048 INFO:tasks.workunit.client.0.smithi072.stdout:2/486: mkdir db/d10/d2b/d2d/d9e/dab 0 2024-03-19T06:05:59.050 INFO:tasks.workunit.client.0.smithi072.stdout:9/336: rmdir d11/d4b/d57 39 2024-03-19T06:05:59.054 INFO:tasks.workunit.client.0.smithi072.stdout:7/354: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f11 [0,4194304] 0 2024-03-19T06:05:59.056 INFO:tasks.workunit.client.0.smithi072.stdout:4/503: dwrite d5/d1b/f5a [0,4194304] 0 2024-03-19T06:05:59.058 INFO:tasks.workunit.client.0.smithi072.stdout:5/571: chown df/d13/d32/d28/d42/d59/d43/l4d 3 1 2024-03-19T06:05:59.065 INFO:tasks.workunit.client.0.smithi072.stdout:4/504: read d5/d15/d22/d41/d61/f66 [97856,130168] 0 2024-03-19T06:05:59.065 INFO:tasks.workunit.client.0.smithi072.stdout:5/572: symlink df/d54/lab 0 2024-03-19T06:05:59.065 INFO:tasks.workunit.client.0.smithi072.stdout:0/362: dwrite d1/f19 [0,4194304] 0 2024-03-19T06:05:59.071 INFO:tasks.workunit.client.0.smithi072.stdout:6/349: write d7/d9/d1b/d3b/f5e [871557,109619] 0 2024-03-19T06:05:59.071 INFO:tasks.workunit.client.0.smithi072.stdout:0/363: fdatasync d1/d2c/f49 0 2024-03-19T06:05:59.071 INFO:tasks.workunit.client.0.smithi072.stdout:7/355: truncate d2/d3/d18/d33/d1d/f46 587151 0 2024-03-19T06:05:59.073 INFO:tasks.workunit.client.0.smithi072.stdout:4/505: mknod d5/d15/d3f/cb9 0 2024-03-19T06:05:59.076 INFO:tasks.workunit.client.0.smithi072.stdout:5/573: rename df/d16/d61 to df/d54/dac 0 2024-03-19T06:05:59.083 INFO:tasks.workunit.client.0.smithi072.stdout:9/337: dwrite d11/d1f/d43/f5a [0,4194304] 0 2024-03-19T06:05:59.088 INFO:tasks.workunit.client.0.smithi072.stdout:6/350: mkdir d7/d9/d2b/d5d/d76 0 2024-03-19T06:05:59.092 INFO:tasks.workunit.client.0.smithi072.stdout:2/487: dwrite db/f4f [0,4194304] 0 2024-03-19T06:05:59.095 INFO:tasks.workunit.client.0.smithi072.stdout:2/488: fdatasync db/d10/d2b/d2d/d9e/d48/f87 0 2024-03-19T06:05:59.103 INFO:tasks.workunit.client.0.smithi072.stdout:7/356: link d2/d3/d17/l64 d2/d3/d18/d33/d1d/d3b/l6b 0 2024-03-19T06:05:59.103 INFO:tasks.workunit.client.0.smithi072.stdout:9/338: mkdir d11/d1f/d2a/d6f 0 2024-03-19T06:05:59.105 INFO:tasks.workunit.client.0.smithi072.stdout:6/351: creat d7/d3f/d65/f77 x:0 0 0 2024-03-19T06:05:59.105 INFO:tasks.workunit.client.0.smithi072.stdout:4/506: getdents d5/d15/d22/d41 0 2024-03-19T06:05:59.105 INFO:tasks.workunit.client.0.smithi072.stdout:0/364: write d1/d1c/d24/d27/f29 [5458087,67156] 0 2024-03-19T06:05:59.111 INFO:tasks.workunit.client.0.smithi072.stdout:2/489: link c8 db/d10/d2b/d2d/d77/cac 0 2024-03-19T06:05:59.116 INFO:tasks.workunit.client.0.smithi072.stdout:6/352: unlink d7/d9/d1b/d3b/d48/f64 0 2024-03-19T06:05:59.117 INFO:tasks.workunit.client.0.smithi072.stdout:0/365: readlink d1/l16 0 2024-03-19T06:05:59.118 INFO:tasks.workunit.client.0.smithi072.stdout:6/353: fsync d7/f2d 0 2024-03-19T06:05:59.118 INFO:tasks.workunit.client.0.smithi072.stdout:2/490: rename db/le to db/d10/d2b/d2d/d9e/d48/lad 0 2024-03-19T06:05:59.121 INFO:tasks.workunit.client.0.smithi072.stdout:6/354: write d7/f70 [101273,23300] 0 2024-03-19T06:05:59.122 INFO:tasks.workunit.client.0.smithi072.stdout:0/366: mkdir d1/d1c/d24/d27/d73 0 2024-03-19T06:05:59.123 INFO:tasks.workunit.client.0.smithi072.stdout:5/574: dread df/d13/d32/d28/f81 [0,4194304] 0 2024-03-19T06:05:59.125 INFO:tasks.workunit.client.0.smithi072.stdout:5/575: dread - df/d14/f9a zero size 2024-03-19T06:05:59.125 INFO:tasks.workunit.client.0.smithi072.stdout:9/339: write d11/d1f/d43/f63 [498491,64705] 0 2024-03-19T06:05:59.125 INFO:tasks.workunit.client.0.smithi072.stdout:7/357: write d2/d3/d18/d20/d3a/f58 [891832,41834] 0 2024-03-19T06:05:59.127 INFO:tasks.workunit.client.0.smithi072.stdout:2/491: symlink db/d10/d13/d24/d72/lae 0 2024-03-19T06:05:59.128 INFO:tasks.workunit.client.0.smithi072.stdout:0/367: fsync d1/f58 0 2024-03-19T06:05:59.129 INFO:tasks.workunit.client.0.smithi072.stdout:9/340: write d11/d24/f48 [599614,123358] 0 2024-03-19T06:05:59.131 INFO:tasks.workunit.client.0.smithi072.stdout:2/492: fsync db/d10/d2b/d2d/d9e/d48/f87 0 2024-03-19T06:05:59.131 INFO:tasks.workunit.client.0.smithi072.stdout:4/507: getdents d5/d15/d22/d41/d61/d71/d72 0 2024-03-19T06:05:59.133 INFO:tasks.workunit.client.0.smithi072.stdout:6/355: write d7/d9/d1b/d3b/d48/f4c [1280481,52904] 0 2024-03-19T06:05:59.134 INFO:tasks.workunit.client.0.smithi072.stdout:5/576: rename df/d13/d32/d28/d42/d59/d43/d62/f71 to df/d14/d5d/fad 0 2024-03-19T06:05:59.134 INFO:tasks.workunit.client.0.smithi072.stdout:0/368: dread d1/d1c/d24/d3f/d4a/f5a [0,4194304] 0 2024-03-19T06:05:59.134 INFO:tasks.workunit.client.0.smithi072.stdout:6/356: readlink d7/d9/d2b/l57 0 2024-03-19T06:05:59.145 INFO:tasks.workunit.client.0.smithi072.stdout:7/358: truncate d2/d3/fd 2319063 0 2024-03-19T06:05:59.146 INFO:tasks.workunit.client.0.smithi072.stdout:9/341: truncate d11/f19 4773245 0 2024-03-19T06:05:59.148 INFO:tasks.workunit.client.0.smithi072.stdout:6/357: rename d7/d9/d1b/d21/d68/d75 to d7/d2e/d60/d78 0 2024-03-19T06:05:59.148 INFO:tasks.workunit.client.0.smithi072.stdout:9/342: chown d11/f37 1428 1 2024-03-19T06:05:59.152 INFO:tasks.workunit.client.0.smithi072.stdout:7/359: write d2/d3/d18/d33/d53/f59 [1996982,80639] 0 2024-03-19T06:05:59.155 INFO:tasks.workunit.client.0.smithi072.stdout:5/577: rename df/d13/d24/f98 to df/d13/d32/d28/d42/d59/d43/d4e/d5c/fae 0 2024-03-19T06:05:59.160 INFO:tasks.workunit.client.0.smithi072.stdout:0/369: link d1/d2c/f41 d1/d1c/d24/d3f/f74 0 2024-03-19T06:05:59.162 INFO:tasks.workunit.client.0.smithi072.stdout:4/508: dwrite d5/d15/d53/f6c [0,4194304] 0 2024-03-19T06:05:59.165 INFO:tasks.workunit.client.0.smithi072.stdout:7/360: creat d2/d3/d18/d33/d1d/d2b/f6c x:0 0 0 2024-03-19T06:05:59.166 INFO:tasks.workunit.client.0.smithi072.stdout:9/343: getdents d11/d4b/d57 0 2024-03-19T06:05:59.169 INFO:tasks.workunit.client.0.smithi072.stdout:4/509: creat d5/d15/d22/d95/fba x:0 0 0 2024-03-19T06:05:59.170 INFO:tasks.workunit.client.0.smithi072.stdout:5/578: dwrite df/f69 [0,4194304] 0 2024-03-19T06:05:59.171 INFO:tasks.workunit.client.0.smithi072.stdout:6/358: creat d7/d9/d1b/d3b/f79 x:0 0 0 2024-03-19T06:05:59.173 INFO:tasks.workunit.client.0.smithi072.stdout:4/510: mknod d5/d15/d22/d41/cbb 0 2024-03-19T06:05:59.176 INFO:tasks.workunit.client.0.smithi072.stdout:0/370: rename d1/d1c/d24/d27/l36 to d1/d1c/d24/l75 0 2024-03-19T06:05:59.179 INFO:tasks.workunit.client.0.smithi072.stdout:0/371: write d1/d1c/d24/d27/f29 [3923485,33556] 0 2024-03-19T06:05:59.181 INFO:tasks.workunit.client.0.smithi072.stdout:5/579: mknod df/d13/d32/d28/d42/d59/d43/d4e/d5c/caf 0 2024-03-19T06:05:59.187 INFO:tasks.workunit.client.0.smithi072.stdout:4/511: rename d5/d11/c23 to d5/d15/d22/d41/d61/cbc 0 2024-03-19T06:05:59.190 INFO:tasks.workunit.client.0.smithi072.stdout:5/580: dread - df/d14/d5d/fad zero size 2024-03-19T06:05:59.197 INFO:tasks.workunit.client.0.smithi072.stdout:0/372: rename d1/f3d to d1/d1c/d24/d3f/f76 0 2024-03-19T06:05:59.198 INFO:tasks.workunit.client.0.smithi072.stdout:5/581: creat df/d13/fb0 x:0 0 0 2024-03-19T06:05:59.200 INFO:tasks.workunit.client.0.smithi072.stdout:0/373: write d1/d1c/d24/d27/f29 [1285182,71591] 0 2024-03-19T06:05:59.205 INFO:tasks.workunit.client.0.smithi072.stdout:5/582: mkdir df/d14/db1 0 2024-03-19T06:05:59.206 INFO:tasks.workunit.client.0.smithi072.stdout:7/361: dread d2/d3/d18/d33/d1d/d2b/d3d/f39 [4194304,4194304] 0 2024-03-19T06:05:59.209 INFO:tasks.workunit.client.0.smithi072.stdout:6/359: truncate d7/d9/d1b/d3b/d48/f4c 3593135 0 2024-03-19T06:05:59.211 INFO:tasks.workunit.client.0.smithi072.stdout:4/512: write d5/f8 [4219944,128369] 0 2024-03-19T06:05:59.212 INFO:tasks.workunit.client.0.smithi072.stdout:6/360: dread - d7/d9/d2b/f6a zero size 2024-03-19T06:05:59.212 INFO:tasks.workunit.client.0.smithi072.stdout:7/362: rmdir d2/d3/d18/d3f 39 2024-03-19T06:05:59.214 INFO:tasks.workunit.client.0.smithi072.stdout:7/363: fsync d2/f60 0 2024-03-19T06:05:59.216 INFO:tasks.workunit.client.0.smithi072.stdout:0/374: link d1/d1c/d24/l40 d1/d1c/d24/d27/l77 0 2024-03-19T06:05:59.216 INFO:tasks.workunit.client.0.smithi072.stdout:4/513: chown d5/d15/d31/d7d/c8b 1928811 1 2024-03-19T06:05:59.220 INFO:tasks.workunit.client.0.smithi072.stdout:9/344: dwrite d11/f19 [4194304,4194304] 0 2024-03-19T06:05:59.223 INFO:tasks.workunit.client.0.smithi072.stdout:5/583: dread df/f69 [0,4194304] 0 2024-03-19T06:05:59.223 INFO:tasks.workunit.client.0.smithi072.stdout:7/364: read d2/d3/d18/d33/d1d/f46 [339781,107820] 0 2024-03-19T06:05:59.224 INFO:tasks.workunit.client.0.smithi072.stdout:0/375: rmdir d1/d1c/d24/d3f/d4a 39 2024-03-19T06:05:59.228 INFO:tasks.workunit.client.0.smithi072.stdout:7/365: fdatasync d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/f35 0 2024-03-19T06:05:59.229 INFO:tasks.workunit.client.0.smithi072.stdout:9/345: creat d11/d1f/f70 x:0 0 0 2024-03-19T06:05:59.240 INFO:tasks.workunit.client.0.smithi072.stdout:7/366: stat d2/d3/d18/d3f/c4d 0 2024-03-19T06:05:59.240 INFO:tasks.workunit.client.0.smithi072.stdout:6/361: dwrite d7/d9/d1b/d21/f73 [0,4194304] 0 2024-03-19T06:05:59.241 INFO:tasks.workunit.client.0.smithi072.stdout:9/346: creat d11/d4b/f71 x:0 0 0 2024-03-19T06:05:59.243 INFO:tasks.workunit.client.0.smithi072.stdout:1/425: sync 2024-03-19T06:05:59.243 INFO:tasks.workunit.client.0.smithi072.stdout:3/456: sync 2024-03-19T06:05:59.248 INFO:tasks.workunit.client.0.smithi072.stdout:3/457: creat d2/f90 x:0 0 0 2024-03-19T06:05:59.249 INFO:tasks.workunit.client.0.smithi072.stdout:5/584: dwrite df/d14/f9a [0,4194304] 0 2024-03-19T06:05:59.251 INFO:tasks.workunit.client.0.smithi072.stdout:6/362: mknod d7/d9/d1b/d21/c7a 0 2024-03-19T06:05:59.252 INFO:tasks.workunit.client.0.smithi072.stdout:9/347: creat d11/d1f/d2a/f72 x:0 0 0 2024-03-19T06:05:59.253 INFO:tasks.workunit.client.0.smithi072.stdout:5/585: stat df/d54/dac/f6d 0 2024-03-19T06:05:59.254 INFO:tasks.workunit.client.0.smithi072.stdout:0/376: dwrite d1/d1c/d24/d27/f29 [0,4194304] 0 2024-03-19T06:05:59.255 INFO:tasks.workunit.client.0.smithi072.stdout:3/458: write d2/d19/f6c [607404,96208] 0 2024-03-19T06:05:59.256 INFO:tasks.workunit.client.0.smithi072.stdout:1/426: rename d1/d11/d18/l78 to d1/d11/d18/d19/d1a/d25/l80 0 2024-03-19T06:05:59.257 INFO:tasks.workunit.client.0.smithi072.stdout:4/514: dread d5/d11/f1a [0,4194304] 0 2024-03-19T06:05:59.259 INFO:tasks.workunit.client.0.smithi072.stdout:5/586: stat df/d13/d32/fa3 0 2024-03-19T06:05:59.262 INFO:tasks.workunit.client.0.smithi072.stdout:6/363: write d7/d2e/f35 [549570,31284] 0 2024-03-19T06:05:59.263 INFO:tasks.workunit.client.0.smithi072.stdout:0/377: write d1/d1c/d24/f5e [392719,94529] 0 2024-03-19T06:05:59.270 INFO:tasks.workunit.client.0.smithi072.stdout:9/348: link d11/d1f/d2a/d36/f4f d11/d1f/d2a/d68/f73 0 2024-03-19T06:05:59.272 INFO:tasks.workunit.client.0.smithi072.stdout:3/459: creat d2/d3/d15/d66/d6b/d79/f91 x:0 0 0 2024-03-19T06:05:59.273 INFO:tasks.workunit.client.0.smithi072.stdout:7/367: dwrite d2/d3/d43/f4e [0,4194304] 0 2024-03-19T06:05:59.274 INFO:tasks.workunit.client.0.smithi072.stdout:4/515: write d5/d15/d31/f3c [4585643,31577] 0 2024-03-19T06:05:59.275 INFO:tasks.workunit.client.0.smithi072.stdout:9/349: dread - d11/d1f/f66 zero size 2024-03-19T06:05:59.277 INFO:tasks.workunit.client.0.smithi072.stdout:3/460: fsync d2/d19/f52 0 2024-03-19T06:05:59.286 INFO:tasks.workunit.client.0.smithi072.stdout:4/516: chown d5/d15/d22/d41/d61/d71/d72/c80 10517 1 2024-03-19T06:05:59.287 INFO:tasks.workunit.client.0.smithi072.stdout:6/364: fdatasync d7/d9/d1b/d3b/d48/f4c 0 2024-03-19T06:05:59.291 INFO:tasks.workunit.client.0.smithi072.stdout:3/461: mkdir d2/d3/d26/d92 0 2024-03-19T06:05:59.295 INFO:tasks.workunit.client.0.smithi072.stdout:1/427: dwrite d1/d11/d18/d19/d72/f7e [0,4194304] 0 2024-03-19T06:05:59.295 INFO:tasks.workunit.client.0.smithi072.stdout:0/378: dwrite d1/f6f [0,4194304] 0 2024-03-19T06:05:59.295 INFO:tasks.workunit.client.0.smithi072.stdout:3/462: dread - d2/d3/d25/f86 zero size 2024-03-19T06:05:59.296 INFO:tasks.workunit.client.0.smithi072.stdout:8/347: sync 2024-03-19T06:05:59.298 INFO:tasks.workunit.client.0.smithi072.stdout:8/348: read f8 [7388860,40645] 0 2024-03-19T06:05:59.301 INFO:tasks.workunit.client.0.smithi072.stdout:4/517: rmdir d5/d15/d22/d41/d7b/d7c 39 2024-03-19T06:05:59.302 INFO:tasks.workunit.client.0.smithi072.stdout:6/365: creat d7/d9/d1e/f7b x:0 0 0 2024-03-19T06:05:59.303 INFO:tasks.workunit.client.0.smithi072.stdout:5/587: getdents df/d13/d32/d28 0 2024-03-19T06:05:59.306 INFO:tasks.workunit.client.0.smithi072.stdout:8/349: symlink da/d37/l71 0 2024-03-19T06:05:59.309 INFO:tasks.workunit.client.0.smithi072.stdout:7/368: dread d2/d3/d17/f48 [0,4194304] 0 2024-03-19T06:05:59.314 INFO:tasks.workunit.client.0.smithi072.stdout:7/369: write d2/d3/d18/d33/f3c [2770044,127683] 0 2024-03-19T06:05:59.314 INFO:tasks.workunit.client.0.smithi072.stdout:3/463: mknod d2/d19/d1e/c93 0 2024-03-19T06:05:59.316 INFO:tasks.workunit.client.0.smithi072.stdout:8/350: creat da/d27/d52/d5b/d3e/f72 x:0 0 0 2024-03-19T06:05:59.318 INFO:tasks.workunit.client.0.smithi072.stdout:9/350: dwrite d11/d1f/d2a/d68/f73 [0,4194304] 0 2024-03-19T06:05:59.318 INFO:tasks.workunit.client.0.smithi072.stdout:0/379: symlink d1/d1c/d24/l78 0 2024-03-19T06:05:59.320 INFO:tasks.workunit.client.0.smithi072.stdout:1/428: read d1/d11/d18/d19/d1a/d25/f43 [73937,74507] 0 2024-03-19T06:05:59.320 INFO:tasks.workunit.client.0.smithi072.stdout:8/351: dread - da/d13/d14/f60 zero size 2024-03-19T06:05:59.323 INFO:tasks.workunit.client.0.smithi072.stdout:8/352: chown da/d13/d14/d1b/l32 5701 1 2024-03-19T06:05:59.324 INFO:tasks.workunit.client.0.smithi072.stdout:5/588: rename df/d14/l90 to df/lb2 0 2024-03-19T06:05:59.331 INFO:tasks.workunit.client.0.smithi072.stdout:6/366: write d7/d9/d1b/f37 [1221310,75419] 0 2024-03-19T06:05:59.333 INFO:tasks.workunit.client.0.smithi072.stdout:8/353: creat da/d37/f73 x:0 0 0 2024-03-19T06:05:59.335 INFO:tasks.workunit.client.0.smithi072.stdout:5/589: fdatasync df/d14/f2a 0 2024-03-19T06:05:59.336 INFO:tasks.workunit.client.0.smithi072.stdout:6/367: fdatasync d7/d9/d1e/f7b 0 2024-03-19T06:05:59.337 INFO:tasks.workunit.client.0.smithi072.stdout:9/351: rename d11/d1f/d2a/d36/d3e/c41 to d11/d1f/d2a/d36/d45/d5b/c74 0 2024-03-19T06:05:59.338 INFO:tasks.workunit.client.0.smithi072.stdout:3/464: write d2/d19/f53 [813638,31705] 0 2024-03-19T06:05:59.339 INFO:tasks.workunit.client.0.smithi072.stdout:0/380: creat d1/f79 x:0 0 0 2024-03-19T06:05:59.340 INFO:tasks.workunit.client.0.smithi072.stdout:1/429: dwrite d1/d16/f38 [0,4194304] 0 2024-03-19T06:05:59.343 INFO:tasks.workunit.client.0.smithi072.stdout:9/352: readlink d11/d4b/l61 0 2024-03-19T06:05:59.343 INFO:tasks.workunit.client.0.smithi072.stdout:4/518: dwrite d5/d1b/f33 [0,4194304] 0 2024-03-19T06:05:59.345 INFO:tasks.workunit.client.0.smithi072.stdout:5/590: creat df/d13/d32/d28/d42/fb3 x:0 0 0 2024-03-19T06:05:59.347 INFO:tasks.workunit.client.0.smithi072.stdout:8/354: mknod da/d13/d14/d1b/d6b/c74 0 2024-03-19T06:05:59.352 INFO:tasks.workunit.client.0.smithi072.stdout:6/368: dread d7/d3f/f58 [0,4194304] 0 2024-03-19T06:05:59.353 INFO:tasks.workunit.client.0.smithi072.stdout:4/519: creat d5/d15/d31/d4c/fbd x:0 0 0 2024-03-19T06:05:59.353 INFO:tasks.workunit.client.0.smithi072.stdout:3/465: chown d2/d19/d1e/l38 365 1 2024-03-19T06:05:59.355 INFO:tasks.workunit.client.0.smithi072.stdout:9/353: creat d11/d24/d4c/d64/f75 x:0 0 0 2024-03-19T06:05:59.356 INFO:tasks.workunit.client.0.smithi072.stdout:6/369: write d7/d9/d1b/f2a [2103814,48062] 0 2024-03-19T06:05:59.357 INFO:tasks.workunit.client.0.smithi072.stdout:7/370: rename d2/d3/d18/d33/d1d/d2b/d3d/l12 to d2/d3/d17/l6d 0 2024-03-19T06:05:59.358 INFO:tasks.workunit.client.0.smithi072.stdout:9/354: chown d11/d4b/d57/l5e 119 1 2024-03-19T06:05:59.360 INFO:tasks.workunit.client.0.smithi072.stdout:3/466: write d2/d19/f52 [1234865,77804] 0 2024-03-19T06:05:59.362 INFO:tasks.workunit.client.0.smithi072.stdout:0/381: creat d1/d1c/d24/d27/d73/f7a x:0 0 0 2024-03-19T06:05:59.363 INFO:tasks.workunit.client.0.smithi072.stdout:2/493: sync 2024-03-19T06:05:59.363 INFO:tasks.workunit.client.0.smithi072.stdout:1/430: mkdir d1/d11/d18/d19/d1a/d25/d3c/d68/d81 0 2024-03-19T06:05:59.365 INFO:tasks.workunit.client.0.smithi072.stdout:5/591: mknod df/d54/dac/d9c/da0/cb4 0 2024-03-19T06:05:59.367 INFO:tasks.workunit.client.0.smithi072.stdout:2/494: write db/d10/d13/d31/f3a [355197,113866] 0 2024-03-19T06:05:59.369 INFO:tasks.workunit.client.0.smithi072.stdout:1/431: mknod d1/d11/d18/c82 0 2024-03-19T06:05:59.396 INFO:tasks.workunit.client.0.smithi072.stdout:3/467: creat d2/d3/d15/d66/d6b/f94 x:0 0 0 2024-03-19T06:05:59.396 INFO:tasks.workunit.client.0.smithi072.stdout:8/355: getdents da 0 2024-03-19T06:05:59.408 INFO:tasks.workunit.client.0.smithi072.stdout:5/592: unlink df/d13/d32/d28/d42/d59/d43/l4d 0 2024-03-19T06:05:59.413 INFO:tasks.workunit.client.0.smithi072.stdout:4/520: dwrite d5/d15/d22/d95/fba [0,4194304] 0 2024-03-19T06:05:59.413 INFO:tasks.workunit.client.0.smithi072.stdout:8/356: mkdir da/d62/d75 0 2024-03-19T06:05:59.420 INFO:tasks.workunit.client.0.smithi072.stdout:1/432: truncate d1/d11/f13 2968834 0 2024-03-19T06:05:59.424 INFO:tasks.workunit.client.0.smithi072.stdout:9/355: dwrite d11/d4b/f71 [0,4194304] 0 2024-03-19T06:05:59.425 INFO:tasks.workunit.client.0.smithi072.stdout:5/593: dread - df/d13/d32/d28/f99 zero size 2024-03-19T06:05:59.427 INFO:tasks.workunit.client.0.smithi072.stdout:0/382: dwrite d1/f3c [0,4194304] 0 2024-03-19T06:05:59.430 INFO:tasks.workunit.client.0.smithi072.stdout:7/371: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f6a [0,4194304] 0 2024-03-19T06:05:59.437 INFO:tasks.workunit.client.0.smithi072.stdout:3/468: truncate d2/f30 3928148 0 2024-03-19T06:05:59.443 INFO:tasks.workunit.client.0.smithi072.stdout:8/357: symlink da/d27/d52/d5b/l76 0 2024-03-19T06:05:59.449 INFO:tasks.workunit.client.0.smithi072.stdout:3/469: mknod d2/d3/d26/c95 0 2024-03-19T06:05:59.452 INFO:tasks.workunit.client.0.smithi072.stdout:1/433: link d1/d11/d18/d19/d1a/d25/d3c/c4c d1/d11/d18/d19/d1a/d25/d3c/d68/c83 0 2024-03-19T06:05:59.457 INFO:tasks.workunit.client.0.smithi072.stdout:4/521: getdents d5/d32/d58 0 2024-03-19T06:05:59.463 INFO:tasks.workunit.client.0.smithi072.stdout:3/470: fsync d2/d3/d15/d66/d6b/f94 0 2024-03-19T06:05:59.469 INFO:tasks.workunit.client.0.smithi072.stdout:3/471: stat d2/d19/c64 0 2024-03-19T06:05:59.474 INFO:tasks.workunit.client.0.smithi072.stdout:7/372: dwrite d2/d3/d18/d33/d1d/d2b/f45 [0,4194304] 0 2024-03-19T06:05:59.476 INFO:tasks.workunit.client.0.smithi072.stdout:2/495: dwrite db/d10/d2b/d2d/fa7 [0,4194304] 0 2024-03-19T06:05:59.477 INFO:tasks.workunit.client.0.smithi072.stdout:1/434: write d1/d11/f13 [3819044,118320] 0 2024-03-19T06:05:59.483 INFO:tasks.workunit.client.0.smithi072.stdout:5/594: dwrite df/d13/d32/d28/d42/d59/d43/f75 [4194304,4194304] 0 2024-03-19T06:05:59.484 INFO:tasks.workunit.client.0.smithi072.stdout:4/522: symlink d5/d15/d22/d41/d61/d71/lbe 0 2024-03-19T06:05:59.486 INFO:tasks.workunit.client.0.smithi072.stdout:8/358: dwrite da/f50 [4194304,4194304] 0 2024-03-19T06:05:59.487 INFO:tasks.workunit.client.0.smithi072.stdout:9/356: dwrite d11/d4b/f71 [0,4194304] 0 2024-03-19T06:05:59.494 INFO:tasks.workunit.client.0.smithi072.stdout:5/595: fdatasync df/d13/f56 0 2024-03-19T06:05:59.496 INFO:tasks.workunit.client.0.smithi072.stdout:3/472: rmdir d2/d3/d15/d66/d6b/d79 39 2024-03-19T06:05:59.498 INFO:tasks.workunit.client.0.smithi072.stdout:4/523: write d5/d1b/f8d [941827,80946] 0 2024-03-19T06:05:59.499 INFO:tasks.workunit.client.0.smithi072.stdout:1/435: truncate d1/f6 2905664 0 2024-03-19T06:05:59.501 INFO:tasks.workunit.client.0.smithi072.stdout:3/473: creat d2/d3/d26/f96 x:0 0 0 2024-03-19T06:05:59.508 INFO:tasks.workunit.client.0.smithi072.stdout:5/596: write df/d13/d24/f9e [841971,34865] 0 2024-03-19T06:05:59.510 INFO:tasks.workunit.client.0.smithi072.stdout:1/436: readlink d1/ld 0 2024-03-19T06:05:59.513 INFO:tasks.workunit.client.0.smithi072.stdout:3/474: creat d2/d3/d26/f97 x:0 0 0 2024-03-19T06:05:59.523 INFO:tasks.workunit.client.0.smithi072.stdout:0/383: dread d1/f1a [4194304,4194304] 0 2024-03-19T06:05:59.524 INFO:tasks.workunit.client.0.smithi072.stdout:5/597: dread df/d14/d5d/f9d [0,4194304] 0 2024-03-19T06:05:59.526 INFO:tasks.workunit.client.0.smithi072.stdout:6/370: sync 2024-03-19T06:05:59.527 INFO:tasks.workunit.client.0.smithi072.stdout:3/475: rmdir d2/d3/d15/d66/d6b 39 2024-03-19T06:05:59.528 INFO:tasks.workunit.client.0.smithi072.stdout:1/437: unlink d1/d11/d18/d19/c67 0 2024-03-19T06:05:59.536 INFO:tasks.workunit.client.0.smithi072.stdout:2/496: truncate db/d10/d2b/d2d/fa7 1742636 0 2024-03-19T06:05:59.539 INFO:tasks.workunit.client.0.smithi072.stdout:6/371: dread - d7/d9/d1b/d3b/f79 zero size 2024-03-19T06:05:59.544 INFO:tasks.workunit.client.0.smithi072.stdout:1/438: mknod d1/d11/d18/c84 0 2024-03-19T06:05:59.552 INFO:tasks.workunit.client.0.smithi072.stdout:9/357: dwrite d11/d4b/f6a [0,4194304] 0 2024-03-19T06:05:59.557 INFO:tasks.workunit.client.0.smithi072.stdout:3/476: unlink d2/d19/d1e/c93 0 2024-03-19T06:05:59.565 INFO:tasks.workunit.client.0.smithi072.stdout:7/373: dwrite d2/f66 [0,4194304] 0 2024-03-19T06:05:59.565 INFO:tasks.workunit.client.0.smithi072.stdout:6/372: unlink d7/d9/d1e/f26 0 2024-03-19T06:05:59.565 INFO:tasks.workunit.client.0.smithi072.stdout:1/439: creat d1/d11/d18/f85 x:0 0 0 2024-03-19T06:05:59.565 INFO:tasks.workunit.client.0.smithi072.stdout:5/598: rename df/d13/d32/d28/d42/d59/d43/d62/fa8 to df/d54/fb5 0 2024-03-19T06:05:59.565 INFO:tasks.workunit.client.0.smithi072.stdout:8/359: dwrite da/f36 [4194304,4194304] 0 2024-03-19T06:05:59.571 INFO:tasks.workunit.client.0.smithi072.stdout:6/373: chown d7/d9/d1e 8256 1 2024-03-19T06:05:59.573 INFO:tasks.workunit.client.0.smithi072.stdout:2/497: mknod db/d10/caf 0 2024-03-19T06:05:59.573 INFO:tasks.workunit.client.0.smithi072.stdout:4/524: dwrite d5/d15/d31/d6d/d7a/d8e/fa4 [0,4194304] 0 2024-03-19T06:05:59.573 INFO:tasks.workunit.client.0.smithi072.stdout:3/477: mkdir d2/d3/d26/d98 0 2024-03-19T06:05:59.578 INFO:tasks.workunit.client.0.smithi072.stdout:6/374: dread - d7/d9/d1b/d31/f72 zero size 2024-03-19T06:05:59.579 INFO:tasks.workunit.client.0.smithi072.stdout:3/478: write d2/d19/f8b [147451,116804] 0 2024-03-19T06:05:59.579 INFO:tasks.workunit.client.0.smithi072.stdout:0/384: dread d1/f1a [4194304,4194304] 0 2024-03-19T06:05:59.581 INFO:tasks.workunit.client.0.smithi072.stdout:9/358: symlink d11/d1f/d2a/d68/l76 0 2024-03-19T06:05:59.585 INFO:tasks.workunit.client.0.smithi072.stdout:8/360: unlink da/d13/f4f 0 2024-03-19T06:05:59.590 INFO:tasks.workunit.client.0.smithi072.stdout:1/440: rename d1/d16 to d1/d11/d18/d19/d72/d86 0 2024-03-19T06:05:59.590 INFO:tasks.workunit.client.0.smithi072.stdout:5/599: creat df/d54/dac/d9c/da0/fb6 x:0 0 0 2024-03-19T06:05:59.592 INFO:tasks.workunit.client.0.smithi072.stdout:7/374: fsync d2/d3/fd 0 2024-03-19T06:05:59.592 INFO:tasks.workunit.client.0.smithi072.stdout:3/479: write d2/d3/d15/f4c [503105,7056] 0 2024-03-19T06:05:59.594 INFO:tasks.workunit.client.0.smithi072.stdout:2/498: creat db/d10/d13/d24/d61/fb0 x:0 0 0 2024-03-19T06:05:59.597 INFO:tasks.workunit.client.0.smithi072.stdout:9/359: rmdir d11/d4b/d5c 39 2024-03-19T06:05:59.599 INFO:tasks.workunit.client.0.smithi072.stdout:6/375: rename d7/d9/d1b/d31/f72 to d7/d9/d1b/f7c 0 2024-03-19T06:05:59.600 INFO:tasks.workunit.client.0.smithi072.stdout:5/600: readlink df/d13/d32/d28/l4a 0 2024-03-19T06:05:59.602 INFO:tasks.workunit.client.0.smithi072.stdout:9/360: readlink d11/d1f/d2a/d68/l76 0 2024-03-19T06:05:59.609 INFO:tasks.workunit.client.0.smithi072.stdout:4/525: getdents d5/d32/d58 0 2024-03-19T06:05:59.614 INFO:tasks.workunit.client.0.smithi072.stdout:8/361: dwrite da/d37/f73 [0,4194304] 0 2024-03-19T06:05:59.615 INFO:tasks.workunit.client.0.smithi072.stdout:1/441: dread d1/d11/d18/d19/d72/f7e [0,4194304] 0 2024-03-19T06:05:59.626 INFO:tasks.workunit.client.0.smithi072.stdout:3/480: rename d2/d3/f14 to d2/d3/d25/f99 0 2024-03-19T06:05:59.630 INFO:tasks.workunit.client.0.smithi072.stdout:6/376: dwrite d7/d2e/f47 [0,4194304] 0 2024-03-19T06:05:59.632 INFO:tasks.workunit.client.0.smithi072.stdout:3/481: write d2/d19/f6c [764185,7661] 0 2024-03-19T06:05:59.638 INFO:tasks.workunit.client.0.smithi072.stdout:1/442: symlink d1/l87 0 2024-03-19T06:05:59.642 INFO:tasks.workunit.client.0.smithi072.stdout:2/499: dwrite db/d10/d13/d31/f5d [0,4194304] 0 2024-03-19T06:05:59.643 INFO:tasks.workunit.client.0.smithi072.stdout:1/443: write d1/d11/f13 [3947959,11439] 0 2024-03-19T06:05:59.650 INFO:tasks.workunit.client.0.smithi072.stdout:9/361: rename c8 to d11/d24/d4c/c77 0 2024-03-19T06:05:59.654 INFO:tasks.workunit.client.0.smithi072.stdout:0/385: getdents d1/d1c/d24/d3e 0 2024-03-19T06:05:59.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:05:59 smithi172 ceph-mon[35716]: pgmap v26: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 47 MiB/s rd, 149 MiB/s wr, 324 op/s 2024-03-19T06:05:59.664 INFO:tasks.workunit.client.0.smithi072.stdout:6/377: symlink d7/d9/d30/d54/l7d 0 2024-03-19T06:05:59.665 INFO:tasks.workunit.client.0.smithi072.stdout:2/500: dwrite db/d10/d2b/d2d/d9e/d48/d82/f94 [0,4194304] 0 2024-03-19T06:05:59.666 INFO:tasks.workunit.client.0.smithi072.stdout:4/526: symlink d5/d15/d22/d41/d7b/d7c/db4/lbf 0 2024-03-19T06:05:59.668 INFO:tasks.workunit.client.0.smithi072.stdout:4/527: stat d5/d1b/f2b 0 2024-03-19T06:05:59.670 INFO:tasks.workunit.client.0.smithi072.stdout:9/362: mkdir d11/d78 0 2024-03-19T06:05:59.672 INFO:tasks.workunit.client.0.smithi072.stdout:9/363: fsync d11/d1f/d43/f63 0 2024-03-19T06:05:59.674 INFO:tasks.workunit.client.0.smithi072.stdout:1/444: link d1/d11/d18/f85 d1/d11/d18/d19/d1a/d61/d65/f88 0 2024-03-19T06:05:59.675 INFO:tasks.workunit.client.0.smithi072.stdout:7/375: truncate d2/d3/d18/d20/d3a/f58 493362 0 2024-03-19T06:05:59.683 INFO:tasks.workunit.client.0.smithi072.stdout:6/378: mknod d7/d9/d1b/d33/d41/d45/c7e 0 2024-03-19T06:05:59.686 INFO:tasks.workunit.client.0.smithi072.stdout:8/362: rename da/d27/d30/f3d to da/d13/f77 0 2024-03-19T06:05:59.690 INFO:tasks.workunit.client.0.smithi072.stdout:2/501: dwrite db/f22 [0,4194304] 0 2024-03-19T06:05:59.701 INFO:tasks.workunit.client.0.smithi072.stdout:5/601: dwrite df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97/fa6 [0,4194304] 0 2024-03-19T06:05:59.704 INFO:tasks.workunit.client.0.smithi072.stdout:3/482: getdents d2 0 2024-03-19T06:05:59.704 INFO:tasks.workunit.client.0.smithi072.stdout:8/363: truncate da/d13/d14/d1b/d57/f5d 4214759 0 2024-03-19T06:05:59.705 INFO:tasks.workunit.client.0.smithi072.stdout:1/445: dwrite d1/d11/d18/d19/d1a/d25/f6c [0,4194304] 0 2024-03-19T06:05:59.706 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:05:59 smithi072 ceph-mon[28706]: pgmap v26: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 47 MiB/s rd, 149 MiB/s wr, 324 op/s 2024-03-19T06:05:59.710 INFO:tasks.workunit.client.0.smithi072.stdout:4/528: rename d5/d37/f62 to d5/d15/da6/fc0 0 2024-03-19T06:05:59.711 INFO:tasks.workunit.client.0.smithi072.stdout:7/376: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f39 [0,4194304] 0 2024-03-19T06:05:59.713 INFO:tasks.workunit.client.0.smithi072.stdout:0/386: truncate d1/f6f 3873293 0 2024-03-19T06:05:59.714 INFO:tasks.workunit.client.0.smithi072.stdout:6/379: write d7/d3f/f42 [907778,130611] 0 2024-03-19T06:05:59.718 INFO:tasks.workunit.client.0.smithi072.stdout:2/502: mknod db/d10/d13/d31/d35/cb1 0 2024-03-19T06:05:59.727 INFO:tasks.workunit.client.0.smithi072.stdout:5/602: dread - df/d13/d32/d28/d42/fb3 zero size 2024-03-19T06:05:59.730 INFO:tasks.workunit.client.0.smithi072.stdout:3/483: rename d2/d3/d26/f58 to d2/d40/d78/f9a 0 2024-03-19T06:05:59.730 INFO:tasks.workunit.client.0.smithi072.stdout:9/364: write d11/f55 [22424,86352] 0 2024-03-19T06:05:59.733 INFO:tasks.workunit.client.0.smithi072.stdout:0/387: symlink d1/d1c/l7b 0 2024-03-19T06:05:59.733 INFO:tasks.workunit.client.0.smithi072.stdout:8/364: fsync da/d37/f73 0 2024-03-19T06:05:59.734 INFO:tasks.workunit.client.0.smithi072.stdout:6/380: mkdir d7/d2e/d60/d78/d7f 0 2024-03-19T06:05:59.739 INFO:tasks.workunit.client.0.smithi072.stdout:5/603: creat df/d13/d32/d28/fb7 x:0 0 0 2024-03-19T06:05:59.741 INFO:tasks.workunit.client.0.smithi072.stdout:4/529: rename d5/d15/d50 to d5/d15/d3f/dc1 0 2024-03-19T06:05:59.743 INFO:tasks.workunit.client.0.smithi072.stdout:3/484: mkdir d2/d40/d78/d9b 0 2024-03-19T06:05:59.744 INFO:tasks.workunit.client.0.smithi072.stdout:8/365: fsync da/d13/d14/f28 0 2024-03-19T06:05:59.750 INFO:tasks.workunit.client.0.smithi072.stdout:9/365: write d11/d1f/d2a/d36/d3e/f5d [1222185,36083] 0 2024-03-19T06:05:59.750 INFO:tasks.workunit.client.0.smithi072.stdout:2/503: rename db/d10/f18 to db/d10/d13/d24/d61/d7d/fb2 0 2024-03-19T06:05:59.750 INFO:tasks.workunit.client.0.smithi072.stdout:5/604: write df/d54/dac/d9c/da0/fb6 [974321,90687] 0 2024-03-19T06:05:59.751 INFO:tasks.workunit.client.0.smithi072.stdout:6/381: mkdir d7/d9/d1b/d21/d68/d80 0 2024-03-19T06:05:59.752 INFO:tasks.workunit.client.0.smithi072.stdout:3/485: symlink d2/d75/l9c 0 2024-03-19T06:05:59.767 INFO:tasks.workunit.client.0.smithi072.stdout:8/366: fdatasync da/d27/d52/d5b/d3e/d5a/f49 0 2024-03-19T06:05:59.768 INFO:tasks.workunit.client.0.smithi072.stdout:1/446: dwrite d1/d11/d18/d19/d1a/f34 [0,4194304] 0 2024-03-19T06:05:59.772 INFO:tasks.workunit.client.0.smithi072.stdout:7/377: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f11 [0,4194304] 0 2024-03-19T06:05:59.774 INFO:tasks.workunit.client.0.smithi072.stdout:9/366: read d11/d1f/d2a/d36/d45/f4a [399770,83101] 0 2024-03-19T06:05:59.778 INFO:tasks.workunit.client.0.smithi072.stdout:0/388: dread d1/d1c/f23 [0,4194304] 0 2024-03-19T06:05:59.778 INFO:tasks.workunit.client.0.smithi072.stdout:9/367: chown d11/d1f/f3d 102 1 2024-03-19T06:05:59.790 INFO:tasks.workunit.client.0.smithi072.stdout:2/504: dwrite db/d10/d59/f8d [0,4194304] 0 2024-03-19T06:05:59.791 INFO:tasks.workunit.client.0.smithi072.stdout:1/447: chown d1/f6 48424193 1 2024-03-19T06:05:59.795 INFO:tasks.workunit.client.0.smithi072.stdout:9/368: mkdir d11/d1f/d2a/d68/d79 0 2024-03-19T06:05:59.799 INFO:tasks.workunit.client.0.smithi072.stdout:2/505: chown db/d10/d59/f8d 61385432 1 2024-03-19T06:05:59.800 INFO:tasks.workunit.client.0.smithi072.stdout:0/389: rmdir d1/d1c/d24/d3f 39 2024-03-19T06:05:59.802 INFO:tasks.workunit.client.0.smithi072.stdout:4/530: dwrite d5/d11/f1a [0,4194304] 0 2024-03-19T06:05:59.803 INFO:tasks.workunit.client.0.smithi072.stdout:7/378: stat d2/d3/d18/d33/d1d/d3b/l6b 0 2024-03-19T06:05:59.807 INFO:tasks.workunit.client.0.smithi072.stdout:8/367: creat da/d13/d14/d1b/f78 x:0 0 0 2024-03-19T06:05:59.812 INFO:tasks.workunit.client.0.smithi072.stdout:5/605: dwrite df/d13/d32/d28/f80 [0,4194304] 0 2024-03-19T06:05:59.815 INFO:tasks.workunit.client.0.smithi072.stdout:7/379: dread - d2/d3/d18/d20/d3a/f5c zero size 2024-03-19T06:05:59.816 INFO:tasks.workunit.client.0.smithi072.stdout:9/369: rename d11/d1f/f70 to d11/d1f/d2a/d68/d79/f7a 0 2024-03-19T06:05:59.817 INFO:tasks.workunit.client.0.smithi072.stdout:9/370: chown d11/d1f/c21 31563993 1 2024-03-19T06:05:59.818 INFO:tasks.workunit.client.0.smithi072.stdout:2/506: symlink db/d10/d2b/d2d/d66/lb3 0 2024-03-19T06:05:59.822 INFO:tasks.workunit.client.0.smithi072.stdout:8/368: mknod da/d62/c79 0 2024-03-19T06:05:59.823 INFO:tasks.workunit.client.0.smithi072.stdout:3/486: link d2/d3/d15/d66/d6b/l7e d2/d40/l9d 0 2024-03-19T06:05:59.824 INFO:tasks.workunit.client.0.smithi072.stdout:4/531: symlink d5/d15/d3f/d42/lc2 0 2024-03-19T06:05:59.825 INFO:tasks.workunit.client.0.smithi072.stdout:3/487: fsync d2/d3/d25/f42 0 2024-03-19T06:05:59.827 INFO:tasks.workunit.client.0.smithi072.stdout:5/606: symlink df/d13/d32/d28/d42/lb8 0 2024-03-19T06:05:59.827 INFO:tasks.workunit.client.0.smithi072.stdout:4/532: stat d5/d15/d53/c9c 0 2024-03-19T06:05:59.829 INFO:tasks.workunit.client.0.smithi072.stdout:6/382: dread d7/d9/d1e/f4d [0,4194304] 0 2024-03-19T06:05:59.829 INFO:tasks.workunit.client.0.smithi072.stdout:7/380: unlink d2/f60 0 2024-03-19T06:05:59.829 INFO:tasks.workunit.client.0.smithi072.stdout:9/371: symlink d11/d4b/d57/l7b 0 2024-03-19T06:05:59.833 INFO:tasks.workunit.client.0.smithi072.stdout:8/369: mkdir da/d27/d52/d5b/d3e/d5a/d7a 0 2024-03-19T06:05:59.834 INFO:tasks.workunit.client.0.smithi072.stdout:5/607: chown df/d13/d32/d28/f81 48713 1 2024-03-19T06:05:59.835 INFO:tasks.workunit.client.0.smithi072.stdout:9/372: fsync d11/d1f/d2a/d68/f73 0 2024-03-19T06:05:59.835 INFO:tasks.workunit.client.0.smithi072.stdout:4/533: mknod d5/d15/d3f/cc3 0 2024-03-19T06:05:59.836 INFO:tasks.workunit.client.0.smithi072.stdout:0/390: rename d1/d1c/d24/d3f/d4a to d1/d1c/d24/d27/d7c 0 2024-03-19T06:05:59.837 INFO:tasks.workunit.client.0.smithi072.stdout:6/383: truncate d7/f3c 1435848 0 2024-03-19T06:05:59.839 INFO:tasks.workunit.client.0.smithi072.stdout:7/381: mknod d2/d3/d18/d3f/c6e 0 2024-03-19T06:05:59.839 INFO:tasks.workunit.client.0.smithi072.stdout:1/448: dwrite d1/d11/d18/d19/d1a/d25/d3c/f7d [4194304,4194304] 0 2024-03-19T06:05:59.839 INFO:tasks.workunit.client.0.smithi072.stdout:9/373: chown d11/f1b 1217990 1 2024-03-19T06:05:59.840 INFO:tasks.workunit.client.0.smithi072.stdout:3/488: mknod d2/d3/d26/d98/c9e 0 2024-03-19T06:05:59.843 INFO:tasks.workunit.client.0.smithi072.stdout:0/391: write d1/f58 [996892,71230] 0 2024-03-19T06:05:59.844 INFO:tasks.workunit.client.0.smithi072.stdout:5/608: rmdir df/d54/dac/d9c/da0 39 2024-03-19T06:05:59.846 INFO:tasks.workunit.client.0.smithi072.stdout:8/370: creat da/d13/d14/f7b x:0 0 0 2024-03-19T06:05:59.847 INFO:tasks.workunit.client.0.smithi072.stdout:2/507: dwrite db/d10/d13/d24/d61/d7d/fa5 [0,4194304] 0 2024-03-19T06:05:59.848 INFO:tasks.workunit.client.0.smithi072.stdout:9/374: write d11/d1f/d2a/d36/f53 [992896,89563] 0 2024-03-19T06:05:59.852 INFO:tasks.workunit.client.0.smithi072.stdout:6/384: creat d7/d2e/d60/f81 x:0 0 0 2024-03-19T06:05:59.854 INFO:tasks.workunit.client.0.smithi072.stdout:9/375: readlink d11/d4b/l61 0 2024-03-19T06:05:59.855 INFO:tasks.workunit.client.0.smithi072.stdout:3/489: stat d2/d3/l27 0 2024-03-19T06:05:59.856 INFO:tasks.workunit.client.0.smithi072.stdout:0/392: unlink d1/d1c/d24/d3e/f63 0 2024-03-19T06:05:59.857 INFO:tasks.workunit.client.0.smithi072.stdout:7/382: mknod d2/c6f 0 2024-03-19T06:05:59.861 INFO:tasks.workunit.client.0.smithi072.stdout:6/385: write d7/d9/d1b/d33/d41/d45/f67 [311319,121602] 0 2024-03-19T06:05:59.862 INFO:tasks.workunit.client.0.smithi072.stdout:8/371: read da/d13/f53 [753978,114793] 0 2024-03-19T06:05:59.865 INFO:tasks.workunit.client.0.smithi072.stdout:4/534: dwrite d5/d15/d3f/dc1/f5b [0,4194304] 0 2024-03-19T06:05:59.872 INFO:tasks.workunit.client.0.smithi072.stdout:3/490: creat d2/d3/d15/d66/d70/f9f x:0 0 0 2024-03-19T06:05:59.878 INFO:tasks.workunit.client.0.smithi072.stdout:0/393: dwrite d1/f19 [4194304,4194304] 0 2024-03-19T06:05:59.881 INFO:tasks.workunit.client.0.smithi072.stdout:4/535: mknod d5/d15/d22/d41/d61/cc4 0 2024-03-19T06:05:59.882 INFO:tasks.workunit.client.0.smithi072.stdout:7/383: mkdir d2/d3/d17/d70 0 2024-03-19T06:05:59.885 INFO:tasks.workunit.client.0.smithi072.stdout:1/449: rename d1/d11/d18/d19/d72/d86/l4f to d1/d11/d18/d19/d1a/d61/d65/l89 0 2024-03-19T06:05:59.888 INFO:tasks.workunit.client.0.smithi072.stdout:0/394: creat d1/d1c/f7d x:0 0 0 2024-03-19T06:05:59.890 INFO:tasks.workunit.client.0.smithi072.stdout:2/508: truncate db/d10/d13/d31/f3c 3724792 0 2024-03-19T06:05:59.892 INFO:tasks.workunit.client.0.smithi072.stdout:2/509: chown db/d10/d2b/d2d/f46 360028366 1 2024-03-19T06:05:59.894 INFO:tasks.workunit.client.0.smithi072.stdout:2/510: dread - db/d10/d2b/d2d/d9e/d48/f87 zero size 2024-03-19T06:05:59.894 INFO:tasks.workunit.client.0.smithi072.stdout:3/491: rename f1 to d2/d40/fa0 0 2024-03-19T06:05:59.897 INFO:tasks.workunit.client.0.smithi072.stdout:9/376: getdents d11/d1f/d43 0 2024-03-19T06:05:59.899 INFO:tasks.workunit.client.0.smithi072.stdout:0/395: mkdir d1/d1c/d24/d27/d7e 0 2024-03-19T06:05:59.901 INFO:tasks.workunit.client.0.smithi072.stdout:8/372: dread da/f34 [0,4194304] 0 2024-03-19T06:05:59.901 INFO:tasks.workunit.client.0.smithi072.stdout:2/511: rmdir db/d10/d2b/d2d/d9e/d48/d82 39 2024-03-19T06:05:59.903 INFO:tasks.workunit.client.0.smithi072.stdout:2/512: chown db/d10/d59 5580 1 2024-03-19T06:05:59.903 INFO:tasks.workunit.client.0.smithi072.stdout:3/492: mknod d2/d3/d15/d66/d70/ca1 0 2024-03-19T06:05:59.906 INFO:tasks.workunit.client.0.smithi072.stdout:7/384: rename d2/d3/d18/d20/d3a/f5d to d2/d3/d18/d20/f71 0 2024-03-19T06:05:59.906 INFO:tasks.workunit.client.0.smithi072.stdout:2/513: readlink db/d10/d13/d24/l91 0 2024-03-19T06:05:59.908 INFO:tasks.workunit.client.0.smithi072.stdout:6/386: write f3 [340891,49208] 0 2024-03-19T06:05:59.912 INFO:tasks.workunit.client.0.smithi072.stdout:8/373: creat da/d27/f7c x:0 0 0 2024-03-19T06:05:59.914 INFO:tasks.workunit.client.0.smithi072.stdout:5/609: dwrite df/d13/d32/d28/d42/d59/d43/d4e/d5c/f6f [0,4194304] 0 2024-03-19T06:05:59.915 INFO:tasks.workunit.client.0.smithi072.stdout:9/377: dwrite d11/f44 [0,4194304] 0 2024-03-19T06:05:59.917 INFO:tasks.workunit.client.0.smithi072.stdout:0/396: rename d1/d1c/d24/d3f/c67 to d1/d1c/d24/d27/d65/c7f 0 2024-03-19T06:05:59.917 INFO:tasks.workunit.client.0.smithi072.stdout:3/493: rmdir d2/d3/d15/d66/d70 39 2024-03-19T06:05:59.922 INFO:tasks.workunit.client.0.smithi072.stdout:2/514: mknod db/d10/d2b/d2d/d77/cb4 0 2024-03-19T06:05:59.925 INFO:tasks.workunit.client.0.smithi072.stdout:6/387: creat d7/d9/d1b/d31/f82 x:0 0 0 2024-03-19T06:05:59.928 INFO:tasks.workunit.client.0.smithi072.stdout:4/536: dwrite d5/d1b/fa7 [0,4194304] 0 2024-03-19T06:05:59.929 INFO:tasks.workunit.client.0.smithi072.stdout:6/388: fsync d7/d9/d1b/d3b/f6e 0 2024-03-19T06:05:59.929 INFO:tasks.workunit.client.0.smithi072.stdout:5/610: symlink df/d13/d32/d28/d42/d59/d43/lb9 0 2024-03-19T06:05:59.939 INFO:tasks.workunit.client.0.smithi072.stdout:1/450: getdents d1/d11/d18 0 2024-03-19T06:05:59.940 INFO:tasks.workunit.client.0.smithi072.stdout:0/397: truncate d1/d2c/f52 37584 0 2024-03-19T06:05:59.941 INFO:tasks.workunit.client.0.smithi072.stdout:7/385: creat d2/d3/d18/d20/d3a/d50/f72 x:0 0 0 2024-03-19T06:05:59.942 INFO:tasks.workunit.client.0.smithi072.stdout:2/515: creat db/d10/d13/d8e/fb5 x:0 0 0 2024-03-19T06:05:59.944 INFO:tasks.workunit.client.0.smithi072.stdout:5/611: chown df/d13/d32/d28/d42/d59/d43/d4e/l7b 0 1 2024-03-19T06:05:59.945 INFO:tasks.workunit.client.0.smithi072.stdout:5/612: stat lc 0 2024-03-19T06:05:59.947 INFO:tasks.workunit.client.0.smithi072.stdout:8/374: dwrite da/d13/d14/f7b [0,4194304] 0 2024-03-19T06:05:59.950 INFO:tasks.workunit.client.0.smithi072.stdout:8/375: truncate da/d13/d14/f60 133002 0 2024-03-19T06:05:59.951 INFO:tasks.workunit.client.0.smithi072.stdout:4/537: creat d5/d37/d52/fc5 x:0 0 0 2024-03-19T06:05:59.952 INFO:tasks.workunit.client.0.smithi072.stdout:8/376: readlink da/d27/d41/l42 0 2024-03-19T06:05:59.953 INFO:tasks.workunit.client.0.smithi072.stdout:2/516: mknod db/d10/d12/cb6 0 2024-03-19T06:05:59.953 INFO:tasks.workunit.client.0.smithi072.stdout:0/398: mkdir d1/d1c/d24/d27/d73/d80 0 2024-03-19T06:05:59.955 INFO:tasks.workunit.client.0.smithi072.stdout:7/386: unlink d2/d3/d18/d33/f3c 0 2024-03-19T06:05:59.956 INFO:tasks.workunit.client.0.smithi072.stdout:6/389: dread d7/d3f/d44/f3d [0,4194304] 0 2024-03-19T06:05:59.957 INFO:tasks.workunit.client.0.smithi072.stdout:1/451: rmdir d1/d11/d18/d19/d1a/d25/d3c/d68 39 2024-03-19T06:05:59.963 INFO:tasks.workunit.client.0.smithi072.stdout:4/538: fsync d5/d15/d3f/f6b 0 2024-03-19T06:05:59.965 INFO:tasks.workunit.client.0.smithi072.stdout:8/377: mkdir da/d27/d52/d5b/d3e/d7d 0 2024-03-19T06:05:59.968 INFO:tasks.workunit.client.0.smithi072.stdout:6/390: dread - d7/d9/d30/f51 zero size 2024-03-19T06:05:59.970 INFO:tasks.workunit.client.0.smithi072.stdout:9/378: rename d11/d1f/d2a/c34 to d11/d4b/c7c 0 2024-03-19T06:05:59.970 INFO:tasks.workunit.client.0.smithi072.stdout:3/494: link d2/d3/f10 d2/d3/d26/d92/fa2 0 2024-03-19T06:05:59.972 INFO:tasks.workunit.client.0.smithi072.stdout:3/495: readlink d2/d40/d78/l7c 0 2024-03-19T06:05:59.972 INFO:tasks.workunit.client.0.smithi072.stdout:9/379: chown d11/d24/f30 12517035 1 2024-03-19T06:05:59.973 INFO:tasks.workunit.client.0.smithi072.stdout:7/387: dwrite d2/d3/d18/d20/d3a/f5c [0,4194304] 0 2024-03-19T06:05:59.974 INFO:tasks.workunit.client.0.smithi072.stdout:2/517: dread db/f2f [0,4194304] 0 2024-03-19T06:05:59.979 INFO:tasks.workunit.client.0.smithi072.stdout:1/452: getdents d1/d11/d18/d63/d74 0 2024-03-19T06:05:59.984 INFO:tasks.workunit.client.0.smithi072.stdout:4/539: dwrite d5/d11/f39 [4194304,4194304] 0 2024-03-19T06:05:59.989 INFO:tasks.workunit.client.0.smithi072.stdout:0/399: truncate d1/d1c/f43 610500 0 2024-03-19T06:05:59.990 INFO:tasks.workunit.client.0.smithi072.stdout:6/391: dwrite d7/d9/d1b/d3b/f5e [4194304,4194304] 0 2024-03-19T06:05:59.998 INFO:tasks.workunit.client.0.smithi072.stdout:1/453: mknod d1/c8a 0 2024-03-19T06:05:59.999 INFO:tasks.workunit.client.0.smithi072.stdout:5/613: dwrite df/d13/f3e [0,4194304] 0 2024-03-19T06:06:00.002 INFO:tasks.workunit.client.0.smithi072.stdout:9/380: rmdir d11/d4b/d5c 39 2024-03-19T06:06:00.003 INFO:tasks.workunit.client.0.smithi072.stdout:9/381: chown d11/f1d 3 1 2024-03-19T06:06:00.006 INFO:tasks.workunit.client.0.smithi072.stdout:3/496: mknod d2/d3/d15/d66/d70/ca3 0 2024-03-19T06:06:00.008 INFO:tasks.workunit.client.0.smithi072.stdout:0/400: symlink d1/d1c/d24/d27/d65/l81 0 2024-03-19T06:06:00.011 INFO:tasks.workunit.client.0.smithi072.stdout:6/392: unlink d7/f2d 0 2024-03-19T06:06:00.013 INFO:tasks.workunit.client.0.smithi072.stdout:7/388: symlink d2/d3/d18/l73 0 2024-03-19T06:06:00.017 INFO:tasks.workunit.client.0.smithi072.stdout:2/518: creat db/d10/d2b/d45/da4/fb7 x:0 0 0 2024-03-19T06:06:00.018 INFO:tasks.workunit.client.0.smithi072.stdout:2/519: chown db/d10/d12/c23 13480743 1 2024-03-19T06:06:00.020 INFO:tasks.workunit.client.0.smithi072.stdout:1/454: unlink d1/d11/d18/f49 0 2024-03-19T06:06:00.020 INFO:tasks.workunit.client.0.smithi072.stdout:4/540: symlink d5/d1b/d7e/lc6 0 2024-03-19T06:06:00.021 INFO:tasks.workunit.client.0.smithi072.stdout:2/520: chown db/d10/d13/d24/d72/f74 71 1 2024-03-19T06:06:00.021 INFO:tasks.workunit.client.0.smithi072.stdout:5/614: dread df/d54/dac/f6d [0,4194304] 0 2024-03-19T06:06:00.023 INFO:tasks.workunit.client.0.smithi072.stdout:5/615: chown df/d14/f15 0 1 2024-03-19T06:06:00.024 INFO:tasks.workunit.client.0.smithi072.stdout:0/401: unlink d1/d1c/d24/d27/d7c/f66 0 2024-03-19T06:06:00.024 INFO:tasks.workunit.client.0.smithi072.stdout:6/393: mknod d7/d9/d1b/d3b/d48/c83 0 2024-03-19T06:06:00.025 INFO:tasks.workunit.client.0.smithi072.stdout:8/378: getdents da/d13/d14/d1b 0 2024-03-19T06:06:00.027 INFO:tasks.workunit.client.0.smithi072.stdout:9/382: mknod d11/d1f/d2a/d6f/c7d 0 2024-03-19T06:06:00.027 INFO:tasks.workunit.client.0.smithi072.stdout:3/497: mkdir d2/d3/da4 0 2024-03-19T06:06:00.028 INFO:tasks.workunit.client.0.smithi072.stdout:1/455: mknod d1/d11/d18/d19/d1a/c8b 0 2024-03-19T06:06:00.029 INFO:tasks.workunit.client.0.smithi072.stdout:9/383: write d11/d1f/d2a/d36/d3e/f5d [1612711,792] 0 2024-03-19T06:06:00.030 INFO:tasks.workunit.client.0.smithi072.stdout:4/541: mkdir d5/d15/d22/d41/d7b/d7c/db4/dc7 0 2024-03-19T06:06:00.031 INFO:tasks.workunit.client.0.smithi072.stdout:5/616: truncate df/f96 3134190 0 2024-03-19T06:06:00.031 INFO:tasks.workunit.client.0.smithi072.stdout:4/542: fsync d5/d32/d58/f85 0 2024-03-19T06:06:00.034 INFO:tasks.workunit.client.0.smithi072.stdout:7/389: mkdir d2/d3/d18/d33/d1d/d2b/d3d/d21/d74 0 2024-03-19T06:06:00.035 INFO:tasks.workunit.client.0.smithi072.stdout:0/402: read d1/d1c/f45 [3805817,93895] 0 2024-03-19T06:06:00.036 INFO:tasks.workunit.client.0.smithi072.stdout:7/390: write d2/d3/d18/d33/d53/f59 [3399171,59163] 0 2024-03-19T06:06:00.037 INFO:tasks.workunit.client.0.smithi072.stdout:0/403: read d1/fb [386059,72735] 0 2024-03-19T06:06:00.038 INFO:tasks.workunit.client.0.smithi072.stdout:7/391: chown d2/d3/d43/f4e 60 1 2024-03-19T06:06:00.039 INFO:tasks.workunit.client.0.smithi072.stdout:2/521: mknod db/d10/d13/d31/cb8 0 2024-03-19T06:06:00.042 INFO:tasks.workunit.client.0.smithi072.stdout:3/498: mkdir d2/d3/d25/da5 0 2024-03-19T06:06:00.046 INFO:tasks.workunit.client.0.smithi072.stdout:1/456: unlink d1/d11/d18/d19/d72/d86/f31 0 2024-03-19T06:06:00.049 INFO:tasks.workunit.client.0.smithi072.stdout:8/379: dwrite da/d13/d1d/f2b [0,4194304] 0 2024-03-19T06:06:00.052 INFO:tasks.workunit.client.0.smithi072.stdout:8/380: write da/d27/d52/d5b/d3e/d5a/f49 [893357,68881] 0 2024-03-19T06:06:00.052 INFO:tasks.workunit.client.0.smithi072.stdout:5/617: mkdir df/d13/d32/d28/d42/d59/d43/d4e/d5c/dba 0 2024-03-19T06:06:00.055 INFO:tasks.workunit.client.0.smithi072.stdout:6/394: fdatasync d7/d9/d1b/d21/f24 0 2024-03-19T06:06:00.065 INFO:tasks.workunit.client.0.smithi072.stdout:1/457: read d1/d11/d18/d19/d70/f66 [256554,109904] 0 2024-03-19T06:06:00.078 INFO:tasks.workunit.client.0.smithi072.stdout:0/404: unlink d1/d1c/c25 0 2024-03-19T06:06:00.080 INFO:tasks.workunit.client.0.smithi072.stdout:6/395: write d7/d3f/f58 [1186519,89206] 0 2024-03-19T06:06:00.081 INFO:tasks.workunit.client.0.smithi072.stdout:9/384: creat d11/d1f/f7e x:0 0 0 2024-03-19T06:06:00.083 INFO:tasks.workunit.client.0.smithi072.stdout:0/405: write d1/d1c/d24/d27/f29 [5286196,124964] 0 2024-03-19T06:06:00.084 INFO:tasks.workunit.client.0.smithi072.stdout:1/458: truncate d1/f4e 3636365 0 2024-03-19T06:06:00.085 INFO:tasks.workunit.client.0.smithi072.stdout:7/392: truncate d2/d3/d18/d33/d1d/d2b/d3d/f6a 1423708 0 2024-03-19T06:06:00.085 INFO:tasks.workunit.client.0.smithi072.stdout:0/406: readlink d1/l17 0 2024-03-19T06:06:00.086 INFO:tasks.workunit.client.0.smithi072.stdout:8/381: symlink da/d13/d14/d6f/l7e 0 2024-03-19T06:06:00.086 INFO:tasks.workunit.client.0.smithi072.stdout:9/385: stat d11/d1f/d2a/d68 0 2024-03-19T06:06:00.089 INFO:tasks.workunit.client.0.smithi072.stdout:4/543: getdents d5/d15/d3f 0 2024-03-19T06:06:00.091 INFO:tasks.workunit.client.0.smithi072.stdout:5/618: dwrite df/d13/d32/d28/d42/d59/d43/f5a [0,4194304] 0 2024-03-19T06:06:00.092 INFO:tasks.workunit.client.0.smithi072.stdout:4/544: readlink d5/d15/d22/d95/la9 0 2024-03-19T06:06:00.094 INFO:tasks.workunit.client.0.smithi072.stdout:6/396: mkdir d7/d9/d30/d54/d84 0 2024-03-19T06:06:00.096 INFO:tasks.workunit.client.0.smithi072.stdout:2/522: getdents db/d10/d59 0 2024-03-19T06:06:00.102 INFO:tasks.workunit.client.0.smithi072.stdout:8/382: mkdir da/d27/d52/d5b/d3e/d7f 0 2024-03-19T06:06:00.103 INFO:tasks.workunit.client.0.smithi072.stdout:9/386: truncate d11/d1f/d2a/d36/f40 2939474 0 2024-03-19T06:06:00.105 INFO:tasks.workunit.client.0.smithi072.stdout:4/545: symlink d5/d15/d31/d6d/d7a/lc8 0 2024-03-19T06:06:00.106 INFO:tasks.workunit.client.0.smithi072.stdout:6/397: dread d7/d9/d1e/f4d [0,4194304] 0 2024-03-19T06:06:00.109 INFO:tasks.workunit.client.0.smithi072.stdout:2/523: rmdir db/d10/d2b/d2d/d9e 39 2024-03-19T06:06:00.115 INFO:tasks.workunit.client.0.smithi072.stdout:1/459: chown d1/d11/d18/d19/d1a/d25/d3c/d68/c83 0 1 2024-03-19T06:06:00.116 INFO:tasks.workunit.client.0.smithi072.stdout:1/460: stat d1/d11/d18/c84 0 2024-03-19T06:06:00.117 INFO:tasks.workunit.client.0.smithi072.stdout:8/383: unlink da/d27/d52/d5b/d3e/f72 0 2024-03-19T06:06:00.118 INFO:tasks.workunit.client.0.smithi072.stdout:4/546: dwrite d5/d11/f39 [4194304,4194304] 0 2024-03-19T06:06:00.120 INFO:tasks.workunit.client.0.smithi072.stdout:1/461: write d1/d11/d18/d19/d72/d86/f38 [1052058,70614] 0 2024-03-19T06:06:00.122 INFO:tasks.workunit.client.0.smithi072.stdout:4/547: dread - d5/d15/d22/fa5 zero size 2024-03-19T06:06:00.122 INFO:tasks.workunit.client.0.smithi072.stdout:2/524: unlink db/d10/d13/d31/f3a 0 2024-03-19T06:06:00.127 INFO:tasks.workunit.client.0.smithi072.stdout:9/387: mknod d11/d4b/c7f 0 2024-03-19T06:06:00.138 INFO:tasks.workunit.client.0.smithi072.stdout:1/462: mknod d1/d11/c8c 0 2024-03-19T06:06:00.138 INFO:tasks.workunit.client.0.smithi072.stdout:9/388: write d11/d1f/d2a/d68/d79/f7a [841039,88072] 0 2024-03-19T06:06:00.139 INFO:tasks.workunit.client.0.smithi072.stdout:8/384: link da/d27/d52/d5b/d3e/d5a/f49 da/d27/d41/f80 0 2024-03-19T06:06:00.140 INFO:tasks.workunit.client.0.smithi072.stdout:2/525: symlink db/d10/d13/d24/d72/d86/lb9 0 2024-03-19T06:06:00.141 INFO:tasks.workunit.client.0.smithi072.stdout:8/385: chown da/d13/d1d 225680880 1 2024-03-19T06:06:00.144 INFO:tasks.workunit.client.0.smithi072.stdout:1/463: dread - d1/d11/d18/d19/d1a/d25/d3c/d52/f7c zero size 2024-03-19T06:06:00.145 INFO:tasks.workunit.client.0.smithi072.stdout:4/548: dwrite d5/d1b/f8d [0,4194304] 0 2024-03-19T06:06:00.146 INFO:tasks.workunit.client.0.smithi072.stdout:8/386: chown da/d13/d14/d6f/l7e 179 1 2024-03-19T06:06:00.146 INFO:tasks.workunit.client.0.smithi072.stdout:6/398: dread d7/d9/ff [0,4194304] 0 2024-03-19T06:06:00.147 INFO:tasks.workunit.client.0.smithi072.stdout:2/526: creat db/d10/d2b/d2d/d6a/fba x:0 0 0 2024-03-19T06:06:00.148 INFO:tasks.workunit.client.0.smithi072.stdout:6/399: dread - d7/d9/d2b/f6a zero size 2024-03-19T06:06:00.150 INFO:tasks.workunit.client.0.smithi072.stdout:9/389: dread d11/d1f/d2a/d36/d3e/f58 [0,4194304] 0 2024-03-19T06:06:00.152 INFO:tasks.workunit.client.0.smithi072.stdout:9/390: stat d11/f55 0 2024-03-19T06:06:00.152 INFO:tasks.workunit.client.0.smithi072.stdout:1/464: stat d1/d11/d18/d19/d72/d86/c57 0 2024-03-19T06:06:00.155 INFO:tasks.workunit.client.0.smithi072.stdout:9/391: write d11/d4b/f52 [8108757,126837] 0 2024-03-19T06:06:00.157 INFO:tasks.workunit.client.0.smithi072.stdout:4/549: read d5/d15/d3f/dc1/f2e [358540,76132] 0 2024-03-19T06:06:00.158 INFO:tasks.workunit.client.0.smithi072.stdout:6/400: truncate d7/fc 684899 0 2024-03-19T06:06:00.160 INFO:tasks.workunit.client.0.smithi072.stdout:1/465: rmdir d1/d11/d18/d19/d1a/d25/d3c/d52 39 2024-03-19T06:06:00.163 INFO:tasks.workunit.client.0.smithi072.stdout:9/392: symlink d11/d1f/d2a/d68/l80 0 2024-03-19T06:06:00.163 INFO:tasks.workunit.client.0.smithi072.stdout:0/407: dwrite d1/d1c/d24/d3f/f74 [0,4194304] 0 2024-03-19T06:06:00.165 INFO:tasks.workunit.client.0.smithi072.stdout:6/401: chown d7/d9/c18 5262 1 2024-03-19T06:06:00.167 INFO:tasks.workunit.client.0.smithi072.stdout:1/466: creat d1/f8d x:0 0 0 2024-03-19T06:06:00.169 INFO:tasks.workunit.client.0.smithi072.stdout:2/527: dwrite db/d10/d2b/d2d/fa2 [0,4194304] 0 2024-03-19T06:06:00.173 INFO:tasks.workunit.client.0.smithi072.stdout:0/408: mkdir d1/d1c/d82 0 2024-03-19T06:06:00.173 INFO:tasks.workunit.client.0.smithi072.stdout:8/387: truncate da/d3b/f54 107997 0 2024-03-19T06:06:00.175 INFO:tasks.workunit.client.0.smithi072.stdout:6/402: fdatasync d7/d9/d30/f51 0 2024-03-19T06:06:00.175 INFO:tasks.workunit.client.0.smithi072.stdout:1/467: unlink d1/d11/l59 0 2024-03-19T06:06:00.177 INFO:tasks.workunit.client.0.smithi072.stdout:0/409: dread - d1/f4e zero size 2024-03-19T06:06:00.178 INFO:tasks.workunit.client.0.smithi072.stdout:9/393: mknod d11/d78/c81 0 2024-03-19T06:06:00.183 INFO:tasks.workunit.client.0.smithi072.stdout:1/468: creat d1/f8e x:0 0 0 2024-03-19T06:06:00.186 INFO:tasks.workunit.client.0.smithi072.stdout:4/550: dwrite d5/d15/d22/f9a [0,4194304] 0 2024-03-19T06:06:00.188 INFO:tasks.workunit.client.0.smithi072.stdout:9/394: fdatasync d11/d1f/f27 0 2024-03-19T06:06:00.191 INFO:tasks.workunit.client.0.smithi072.stdout:9/395: write d11/d1f/d2a/d68/d79/f7a [1541839,100940] 0 2024-03-19T06:06:00.192 INFO:tasks.workunit.client.0.smithi072.stdout:2/528: rmdir db/d10/d2b/d2d/d62/d6b/d88 0 2024-03-19T06:06:00.196 INFO:tasks.workunit.client.0.smithi072.stdout:8/388: mknod da/d27/d52/d5b/d3e/d7d/c81 0 2024-03-19T06:06:00.206 INFO:tasks.workunit.client.0.smithi072.stdout:2/529: creat db/d10/d59/fbb x:0 0 0 2024-03-19T06:06:00.206 INFO:tasks.workunit.client.0.smithi072.stdout:6/403: write d7/d9/f1a [3184407,39986] 0 2024-03-19T06:06:00.206 INFO:tasks.workunit.client.0.smithi072.stdout:9/396: creat d11/d1f/d2a/d36/d45/d4d/f82 x:0 0 0 2024-03-19T06:06:00.209 INFO:tasks.workunit.client.0.smithi072.stdout:8/389: chown da/d37/d5c 1608 1 2024-03-19T06:06:00.209 INFO:tasks.workunit.client.0.smithi072.stdout:6/404: truncate d7/d9/d1e/f4d 5568832 0 2024-03-19T06:06:00.211 INFO:tasks.workunit.client.0.smithi072.stdout:8/390: dread - da/d13/d14/d1b/f78 zero size 2024-03-19T06:06:00.211 INFO:tasks.workunit.client.0.smithi072.stdout:6/405: chown d7/d9/d1b/d33 2907 1 2024-03-19T06:06:00.214 INFO:tasks.workunit.client.0.smithi072.stdout:9/397: rename d11/d1f/d2a/d36/f4f to d11/d1f/d2a/d36/d45/d4d/f83 0 2024-03-19T06:06:00.216 INFO:tasks.workunit.client.0.smithi072.stdout:2/530: creat db/d10/d2b/d2d/fbc x:0 0 0 2024-03-19T06:06:00.217 INFO:tasks.workunit.client.0.smithi072.stdout:6/406: symlink d7/d2e/d60/l85 0 2024-03-19T06:06:00.218 INFO:tasks.workunit.client.0.smithi072.stdout:6/407: stat d7/d3f/d65 0 2024-03-19T06:06:00.220 INFO:tasks.workunit.client.0.smithi072.stdout:9/398: creat d11/d1f/d2a/d36/d45/f84 x:0 0 0 2024-03-19T06:06:00.222 INFO:tasks.workunit.client.0.smithi072.stdout:2/531: mknod db/d10/d44/cbd 0 2024-03-19T06:06:00.222 INFO:tasks.workunit.client.0.smithi072.stdout:9/399: stat d11/d4b/l61 0 2024-03-19T06:06:00.223 INFO:tasks.workunit.client.0.smithi072.stdout:0/410: truncate d1/d1c/d24/f32 858101 0 2024-03-19T06:06:00.224 INFO:tasks.workunit.client.0.smithi072.stdout:2/532: chown l3 6377676 1 2024-03-19T06:06:00.226 INFO:tasks.workunit.client.0.smithi072.stdout:0/411: read d1/f1a [6810037,103350] 0 2024-03-19T06:06:00.228 INFO:tasks.workunit.client.0.smithi072.stdout:1/469: dwrite d1/d11/d18/f85 [0,4194304] 0 2024-03-19T06:06:00.231 INFO:tasks.workunit.client.0.smithi072.stdout:9/400: symlink d11/d24/d4c/d6e/l85 0 2024-03-19T06:06:00.233 INFO:tasks.workunit.client.0.smithi072.stdout:8/391: write da/d27/d52/d5b/d3e/d5a/f49 [4065781,881] 0 2024-03-19T06:06:00.234 INFO:tasks.workunit.client.0.smithi072.stdout:0/412: creat d1/d1c/d24/d27/d65/f83 x:0 0 0 2024-03-19T06:06:00.234 INFO:tasks.workunit.client.0.smithi072.stdout:4/551: dread d5/d37/f69 [0,4194304] 0 2024-03-19T06:06:00.237 INFO:tasks.workunit.client.0.smithi072.stdout:2/533: creat db/d10/d13/d80/fbe x:0 0 0 2024-03-19T06:06:00.238 INFO:tasks.workunit.client.0.smithi072.stdout:4/552: stat d5/d1b/d7e 0 2024-03-19T06:06:00.240 INFO:tasks.workunit.client.0.smithi072.stdout:1/470: creat d1/d11/d18/d63/d73/f8f x:0 0 0 2024-03-19T06:06:00.241 INFO:tasks.workunit.client.0.smithi072.stdout:9/401: mkdir d11/d1f/d2a/d36/d86 0 2024-03-19T06:06:00.241 INFO:tasks.workunit.client.0.smithi072.stdout:6/408: dwrite d7/d9/d1b/d33/f74 [0,4194304] 0 2024-03-19T06:06:00.244 INFO:tasks.workunit.client.0.smithi072.stdout:6/409: fdatasync d7/f11 0 2024-03-19T06:06:00.244 INFO:tasks.workunit.client.0.smithi072.stdout:9/402: dread - d11/d1f/d2a/d36/d45/f84 zero size 2024-03-19T06:06:00.249 INFO:tasks.workunit.client.0.smithi072.stdout:0/413: rename d1/d1c/d24/d27/f29 to d1/d1c/d24/d27/d73/d80/f84 0 2024-03-19T06:06:00.252 INFO:tasks.workunit.client.0.smithi072.stdout:0/414: write d1/d1c/d24/d27/d65/f83 [583541,59201] 0 2024-03-19T06:06:00.254 INFO:tasks.workunit.client.0.smithi072.stdout:0/415: chown d1/f58 1225505 1 2024-03-19T06:06:00.255 INFO:tasks.workunit.client.0.smithi072.stdout:1/471: creat d1/d11/d18/d19/d1a/f90 x:0 0 0 2024-03-19T06:06:00.259 INFO:tasks.workunit.client.0.smithi072.stdout:0/416: mkdir d1/d1c/d24/d27/d65/d85 0 2024-03-19T06:06:00.261 INFO:tasks.workunit.client.0.smithi072.stdout:6/410: creat d7/d9/d1b/d21/d68/d80/f86 x:0 0 0 2024-03-19T06:06:00.263 INFO:tasks.workunit.client.0.smithi072.stdout:8/392: truncate da/f51 3946055 0 2024-03-19T06:06:00.264 INFO:tasks.workunit.client.0.smithi072.stdout:8/393: chown da/d27/d52/d5b/l76 2 1 2024-03-19T06:06:00.265 INFO:tasks.workunit.client.0.smithi072.stdout:2/534: getdents db/d10/d2b 0 2024-03-19T06:06:00.267 INFO:tasks.workunit.client.0.smithi072.stdout:4/553: rename d5/d15/d31/d4c/fbd to d5/d15/d22/d41/d7b/fc9 0 2024-03-19T06:06:00.274 INFO:tasks.workunit.client.0.smithi072.stdout:8/394: rename f8 to da/d27/d52/d5b/d3e/d5a/d7a/f82 0 2024-03-19T06:06:00.274 INFO:tasks.workunit.client.0.smithi072.stdout:1/472: dwrite d1/d11/d18/d19/d1a/d61/d65/f6f [0,4194304] 0 2024-03-19T06:06:00.274 INFO:tasks.workunit.client.0.smithi072.stdout:8/395: fdatasync da/f50 0 2024-03-19T06:06:00.276 INFO:tasks.workunit.client.0.smithi072.stdout:4/554: mkdir d5/d1b/dca 0 2024-03-19T06:06:00.276 INFO:tasks.workunit.client.0.smithi072.stdout:1/473: fdatasync d1/d11/d18/d63/d73/f8f 0 2024-03-19T06:06:00.276 INFO:tasks.workunit.client.0.smithi072.stdout:8/396: read - da/d27/f7c zero size 2024-03-19T06:06:00.280 INFO:tasks.workunit.client.0.smithi072.stdout:0/417: creat d1/d1c/d24/f86 x:0 0 0 2024-03-19T06:06:00.283 INFO:tasks.workunit.client.0.smithi072.stdout:6/411: write d7/d9/d1b/d33/d41/d45/f5c [951570,20331] 0 2024-03-19T06:06:00.286 INFO:tasks.workunit.client.0.smithi072.stdout:8/397: dread da/d13/f77 [0,4194304] 0 2024-03-19T06:06:00.290 INFO:tasks.workunit.client.0.smithi072.stdout:2/535: mkdir db/d10/d2b/d2d/d9e/d48/d82/d98/dbf 0 2024-03-19T06:06:00.291 INFO:tasks.workunit.client.0.smithi072.stdout:4/555: rename d5/d32/d58/f83 to d5/d15/d31/fcb 0 2024-03-19T06:06:00.293 INFO:tasks.workunit.client.0.smithi072.stdout:8/398: creat da/d3b/f83 x:0 0 0 2024-03-19T06:06:00.294 INFO:tasks.workunit.client.0.smithi072.stdout:2/536: write db/d10/d12/f1b [3117020,83084] 0 2024-03-19T06:06:00.295 INFO:tasks.workunit.client.0.smithi072.stdout:1/474: unlink d1/d11/d18/d19/d72/d86/c6e 0 2024-03-19T06:06:00.297 INFO:tasks.workunit.client.0.smithi072.stdout:6/412: rename d7/d9/d1b/d3b/d48/f4c to d7/d9/d2b/d5d/f87 0 2024-03-19T06:06:00.298 INFO:tasks.workunit.client.0.smithi072.stdout:0/418: dwrite d1/d2c/f49 [0,4194304] 0 2024-03-19T06:06:00.299 INFO:tasks.workunit.client.0.smithi072.stdout:6/413: readlink d7/d9/l13 0 2024-03-19T06:06:00.300 INFO:tasks.workunit.client.0.smithi072.stdout:0/419: chown d1/f3c 1278729 1 2024-03-19T06:06:00.300 INFO:tasks.workunit.client.0.smithi072.stdout:1/475: write d1/d11/d18/d19/d1a/d25/d60/f75 [523556,7412] 0 2024-03-19T06:06:00.304 INFO:tasks.workunit.client.0.smithi072.stdout:0/420: write d1/d1c/d24/d27/f54 [4459302,98600] 0 2024-03-19T06:06:00.307 INFO:tasks.workunit.client.0.smithi072.stdout:2/537: mknod db/d10/d13/d24/cc0 0 2024-03-19T06:06:00.308 INFO:tasks.workunit.client.0.smithi072.stdout:6/414: mkdir d7/d9/d2b/d5d/d88 0 2024-03-19T06:06:00.309 INFO:tasks.workunit.client.0.smithi072.stdout:0/421: truncate d1/d1c/f7d 412313 0 2024-03-19T06:06:00.314 INFO:tasks.workunit.client.0.smithi072.stdout:6/415: write d7/d9/d1e/f4d [519732,968] 0 2024-03-19T06:06:00.315 INFO:tasks.workunit.client.0.smithi072.stdout:6/416: dread - d7/d9/d2b/f6a zero size 2024-03-19T06:06:00.316 INFO:tasks.workunit.client.0.smithi072.stdout:2/538: dread - db/d10/d2b/d2d/d66/f6f zero size 2024-03-19T06:06:00.317 INFO:tasks.workunit.client.0.smithi072.stdout:2/539: chown db/d10/d13/d31 238559624 1 2024-03-19T06:06:00.322 INFO:tasks.workunit.client.0.smithi072.stdout:6/417: creat d7/d3f/d65/f89 x:0 0 0 2024-03-19T06:06:00.325 INFO:tasks.workunit.client.0.smithi072.stdout:0/422: fsync d1/d1c/d24/f32 0 2024-03-19T06:06:00.326 INFO:tasks.workunit.client.0.smithi072.stdout:6/418: truncate d7/f70 1085933 0 2024-03-19T06:06:00.332 INFO:tasks.workunit.client.0.smithi072.stdout:8/399: dread da/d13/d14/f17 [0,4194304] 0 2024-03-19T06:06:00.338 INFO:tasks.workunit.client.0.smithi072.stdout:4/556: dwrite d5/d15/d3f/dc1/f2e [0,4194304] 0 2024-03-19T06:06:00.342 INFO:tasks.workunit.client.0.smithi072.stdout:1/476: dread d1/d11/d18/d19/d1a/d25/d3c/f7d [0,4194304] 0 2024-03-19T06:06:00.350 INFO:tasks.workunit.client.0.smithi072.stdout:6/419: dwrite d7/f11 [0,4194304] 0 2024-03-19T06:06:00.351 INFO:tasks.workunit.client.0.smithi072.stdout:2/540: dwrite db/d10/d13/d24/f75 [0,4194304] 0 2024-03-19T06:06:00.352 INFO:tasks.workunit.client.0.smithi072.stdout:4/557: creat d5/d15/d22/d41/d7b/d7c/db4/fcc x:0 0 0 2024-03-19T06:06:00.357 INFO:tasks.workunit.client.0.smithi072.stdout:0/423: dwrite d1/d1c/d24/d27/d73/f7a [0,4194304] 0 2024-03-19T06:06:00.367 INFO:tasks.workunit.client.0.smithi072.stdout:6/420: unlink d7/d9/d1b/d3b/f79 0 2024-03-19T06:06:00.370 INFO:tasks.workunit.client.0.smithi072.stdout:1/477: dwrite d1/d11/d18/d19/d1a/d61/d65/f88 [0,4194304] 0 2024-03-19T06:06:00.374 INFO:tasks.workunit.client.0.smithi072.stdout:4/558: rmdir d5/d1b 39 2024-03-19T06:06:00.375 INFO:tasks.workunit.client.0.smithi072.stdout:1/478: write d1/d11/d18/d19/d1a/d25/d3c/f62 [5090853,85282] 0 2024-03-19T06:06:00.378 INFO:tasks.workunit.client.0.smithi072.stdout:6/421: unlink d7/d9/ff 0 2024-03-19T06:06:00.378 INFO:tasks.workunit.client.0.smithi072.stdout:0/424: write d1/f1a [1174758,84587] 0 2024-03-19T06:06:00.378 INFO:tasks.workunit.client.0.smithi072.stdout:4/559: read d5/f8 [4425051,118185] 0 2024-03-19T06:06:00.381 INFO:tasks.workunit.client.0.smithi072.stdout:6/422: fdatasync d7/d9/d1e/f7b 0 2024-03-19T06:06:00.381 INFO:tasks.workunit.client.0.smithi072.stdout:8/400: dread da/d13/d1d/f2b [4194304,4194304] 0 2024-03-19T06:06:00.382 INFO:tasks.workunit.client.0.smithi072.stdout:1/479: symlink d1/d11/d18/d63/d73/l91 0 2024-03-19T06:06:00.384 INFO:tasks.workunit.client.0.smithi072.stdout:4/560: write d5/d32/d58/f85 [4552821,114061] 0 2024-03-19T06:06:00.386 INFO:tasks.workunit.client.0.smithi072.stdout:6/423: read d7/d9/d1b/d33/d41/d45/f5c [328274,22118] 0 2024-03-19T06:06:00.387 INFO:tasks.workunit.client.0.smithi072.stdout:2/541: getdents db/d10/d2b/d2d/d9e/d48/d82/d98 0 2024-03-19T06:06:00.389 INFO:tasks.workunit.client.0.smithi072.stdout:8/401: creat da/d13/d14/d6f/f84 x:0 0 0 2024-03-19T06:06:00.391 INFO:tasks.workunit.client.0.smithi072.stdout:8/402: chown da/d27/c55 1240464 1 2024-03-19T06:06:00.395 INFO:tasks.workunit.client.0.smithi072.stdout:6/424: mknod d7/d3f/d44/c8a 0 2024-03-19T06:06:00.396 INFO:tasks.workunit.client.0.smithi072.stdout:8/403: creat da/d27/d41/f85 x:0 0 0 2024-03-19T06:06:00.397 INFO:tasks.workunit.client.0.smithi072.stdout:1/480: dread d1/d11/d18/d19/d72/f7e [0,4194304] 0 2024-03-19T06:06:00.398 INFO:tasks.workunit.client.0.smithi072.stdout:0/425: dread d1/d1c/d24/d3f/f74 [0,4194304] 0 2024-03-19T06:06:00.400 INFO:tasks.workunit.client.0.smithi072.stdout:8/404: chown da/d27/d52/d5b/d3e/d5a/f49 235 1 2024-03-19T06:06:00.401 INFO:tasks.workunit.client.0.smithi072.stdout:6/425: getdents d7/d3f/d65 0 2024-03-19T06:06:00.404 INFO:tasks.workunit.client.0.smithi072.stdout:1/481: chown d1/d11/d18/d19/d1a/d25/l80 51420290 1 2024-03-19T06:06:00.404 INFO:tasks.workunit.client.0.smithi072.stdout:4/561: dwrite d5/d15/d31/f3c [0,4194304] 0 2024-03-19T06:06:00.405 INFO:tasks.workunit.client.0.smithi072.stdout:6/426: creat d7/d9/d1b/f8b x:0 0 0 2024-03-19T06:06:00.407 INFO:tasks.workunit.client.0.smithi072.stdout:6/427: write d7/d9/d1b/d21/d68/d80/f86 [130891,122298] 0 2024-03-19T06:06:00.409 INFO:tasks.workunit.client.0.smithi072.stdout:8/405: creat da/d27/d52/d5b/d3e/d5a/d7a/f86 x:0 0 0 2024-03-19T06:06:00.414 INFO:tasks.workunit.client.0.smithi072.stdout:1/482: mknod d1/d11/d18/d19/d1a/d61/d65/c92 0 2024-03-19T06:06:00.418 INFO:tasks.workunit.client.0.smithi072.stdout:8/406: creat da/d13/d1d/f87 x:0 0 0 2024-03-19T06:06:00.420 INFO:tasks.workunit.client.0.smithi072.stdout:1/483: creat d1/d11/d18/d19/f93 x:0 0 0 2024-03-19T06:06:00.426 INFO:tasks.workunit.client.0.smithi072.stdout:1/484: symlink d1/d11/d18/d19/d70/l94 0 2024-03-19T06:06:00.433 INFO:tasks.workunit.client.0.smithi072.stdout:6/428: dread d7/d2e/f47 [0,4194304] 0 2024-03-19T06:06:00.434 INFO:tasks.workunit.client.0.smithi072.stdout:8/407: dwrite da/d3b/f5e [0,4194304] 0 2024-03-19T06:06:00.442 INFO:tasks.workunit.client.0.smithi072.stdout:4/562: dread d5/d1b/f5a [0,4194304] 0 2024-03-19T06:06:00.446 INFO:tasks.workunit.client.0.smithi072.stdout:1/485: dwrite d1/d11/d18/d19/d1a/d25/f43 [0,4194304] 0 2024-03-19T06:06:00.448 INFO:tasks.workunit.client.0.smithi072.stdout:0/426: truncate d1/d1c/f4c 1263616 0 2024-03-19T06:06:00.460 INFO:tasks.workunit.client.0.smithi072.stdout:1/486: symlink d1/d11/d18/d19/d1a/d3b/l95 0 2024-03-19T06:06:00.460 INFO:tasks.workunit.client.0.smithi072.stdout:0/427: read d1/d1c/d24/d3e/f5b [3418455,98896] 0 2024-03-19T06:06:00.467 INFO:tasks.workunit.client.0.smithi072.stdout:4/563: dread d5/d11/f39 [4194304,4194304] 0 2024-03-19T06:06:00.470 INFO:tasks.workunit.client.0.smithi072.stdout:0/428: rename d1/d2c/f49 to d1/d1c/d24/d27/d73/f87 0 2024-03-19T06:06:00.471 INFO:tasks.workunit.client.0.smithi072.stdout:4/564: creat d5/d15/fcd x:0 0 0 2024-03-19T06:06:00.472 INFO:tasks.workunit.client.0.smithi072.stdout:0/429: creat d1/d1c/d24/d27/d65/d85/f88 x:0 0 0 2024-03-19T06:06:00.473 INFO:tasks.workunit.client.0.smithi072.stdout:1/487: dread d1/d11/d18/d19/d72/f7e [0,4194304] 0 2024-03-19T06:06:00.473 INFO:tasks.workunit.client.0.smithi072.stdout:0/430: write d1/d1c/d24/f86 [1040786,18682] 0 2024-03-19T06:06:00.474 INFO:tasks.workunit.client.0.smithi072.stdout:4/565: creat d5/d15/d73/fce x:0 0 0 2024-03-19T06:06:00.476 INFO:tasks.workunit.client.0.smithi072.stdout:0/431: truncate d1/f19 9246035 0 2024-03-19T06:06:00.476 INFO:tasks.workunit.client.0.smithi072.stdout:4/566: write d5/d15/d22/f9a [68404,103116] 0 2024-03-19T06:06:00.477 INFO:tasks.workunit.client.0.smithi072.stdout:0/432: dread - d1/f79 zero size 2024-03-19T06:06:00.480 INFO:tasks.workunit.client.0.smithi072.stdout:0/433: mkdir d1/d1c/d89 0 2024-03-19T06:06:00.482 INFO:tasks.workunit.client.0.smithi072.stdout:4/567: write d5/d15/d22/d41/d61/f66 [684141,56872] 0 2024-03-19T06:06:00.486 INFO:tasks.workunit.client.0.smithi072.stdout:4/568: fsync d5/f8 0 2024-03-19T06:06:00.486 INFO:tasks.workunit.client.0.smithi072.stdout:1/488: dread d1/d11/f1c [0,4194304] 0 2024-03-19T06:06:00.487 INFO:tasks.workunit.client.0.smithi072.stdout:4/569: read - d5/d15/d22/d41/fa0 zero size 2024-03-19T06:06:00.491 INFO:tasks.workunit.client.0.smithi072.stdout:4/570: symlink d5/d37/d52/lcf 0 2024-03-19T06:06:00.496 INFO:tasks.workunit.client.0.smithi072.stdout:4/571: symlink d5/ld0 0 2024-03-19T06:06:00.496 INFO:tasks.workunit.client.0.smithi072.stdout:1/489: getdents d1/d11/d18/d63/d73 0 2024-03-19T06:06:00.501 INFO:tasks.workunit.client.0.smithi072.stdout:4/572: rmdir d5/d15/d31/d4c 39 2024-03-19T06:06:00.503 INFO:tasks.workunit.client.0.smithi072.stdout:1/490: mkdir d1/d11/d18/d19/d1a/d25/d3c/d68/d96 0 2024-03-19T06:06:00.519 INFO:tasks.workunit.client.0.smithi072.stdout:1/491: dwrite d1/d11/d18/d19/d1a/d25/d3c/f7d [0,4194304] 0 2024-03-19T06:06:00.520 INFO:tasks.workunit.client.0.smithi072.stdout:4/573: dread d5/d1b/f1d [0,4194304] 0 2024-03-19T06:06:00.520 INFO:tasks.workunit.client.0.smithi072.stdout:1/492: chown d1/l71 3644 1 2024-03-19T06:06:00.527 INFO:tasks.workunit.client.0.smithi072.stdout:4/574: rename d5/d15/d22/d41/l4a to d5/d1b/dca/ld1 0 2024-03-19T06:06:00.543 INFO:tasks.workunit.client.0.smithi072.stdout:4/575: dwrite d5/d15/d31/d6d/d7a/d8e/fa4 [0,4194304] 0 2024-03-19T06:06:00.551 INFO:tasks.workunit.client.0.smithi072.stdout:4/576: getdents d5/d1b 0 2024-03-19T06:06:00.554 INFO:tasks.workunit.client.0.smithi072.stdout:4/577: mknod d5/d15/d3f/dc1/cd2 0 2024-03-19T06:06:00.556 INFO:tasks.workunit.client.0.smithi072.stdout:4/578: write d5/d15/d3f/dc1/f99 [3359670,20267] 0 2024-03-19T06:06:00.558 INFO:tasks.workunit.client.0.smithi072.stdout:4/579: write d5/d15/d73/fce [143401,55443] 0 2024-03-19T06:06:00.560 INFO:tasks.workunit.client.0.smithi072.stdout:4/580: write d5/d15/d31/d6f/fa3 [4995364,63659] 0 2024-03-19T06:06:00.561 INFO:tasks.workunit.client.0.smithi072.stdout:4/581: readlink d5/l35 0 2024-03-19T06:06:00.564 INFO:tasks.workunit.client.0.smithi072.stdout:4/582: mknod d5/d15/cd3 0 2024-03-19T06:06:00.582 INFO:tasks.workunit.client.0.smithi072.stdout:4/583: dwrite d5/d37/d52/fc5 [0,4194304] 0 2024-03-19T06:06:00.589 INFO:tasks.workunit.client.0.smithi072.stdout:4/584: link d5/d15/d31/d6f/c86 d5/d15/d31/d6f/cd4 0 2024-03-19T06:06:00.696 INFO:tasks.workunit.client.0.smithi072.stdout:0/434: rmdir d1/d1c 39 2024-03-19T06:06:00.708 INFO:tasks.workunit.client.0.smithi072.stdout:0/435: readlink d1/d1c/d24/d3e/l61 0 2024-03-19T06:06:00.746 INFO:tasks.workunit.client.0.smithi072.stdout:4/585: write d5/d37/f69 [1591866,38528] 0 2024-03-19T06:06:00.749 INFO:tasks.workunit.client.0.smithi072.stdout:1/493: dwrite d1/d11/d18/d19/d70/f66 [0,4194304] 0 2024-03-19T06:06:00.750 INFO:tasks.workunit.client.0.smithi072.stdout:0/436: truncate d1/d1c/d24/d3f/f74 2147993 0 2024-03-19T06:06:00.753 INFO:tasks.workunit.client.0.smithi072.stdout:4/586: symlink d5/d15/d22/ld5 0 2024-03-19T06:06:00.754 INFO:tasks.workunit.client.0.smithi072.stdout:4/587: readlink d5/ld0 0 2024-03-19T06:06:00.755 INFO:tasks.workunit.client.0.smithi072.stdout:0/437: creat d1/d2c/f8a x:0 0 0 2024-03-19T06:06:00.756 INFO:tasks.workunit.client.0.smithi072.stdout:1/494: creat d1/d11/d76/f97 x:0 0 0 2024-03-19T06:06:00.758 INFO:tasks.workunit.client.0.smithi072.stdout:1/495: fsync d1/d11/f1c 0 2024-03-19T06:06:00.762 INFO:tasks.workunit.client.0.smithi072.stdout:4/588: write d5/d15/d22/d41/d61/fb6 [636791,87458] 0 2024-03-19T06:06:00.764 INFO:tasks.workunit.client.0.smithi072.stdout:0/438: fsync d1/fb 0 2024-03-19T06:06:00.771 INFO:tasks.workunit.client.0.smithi072.stdout:0/439: rename d1/d1c/d24/d3e to d1/d1c/d24/d27/d73/d80/d8b 0 2024-03-19T06:06:00.778 INFO:tasks.workunit.client.0.smithi072.stdout:4/589: link d5/d15/d22/d41/fa0 d5/d15/d3f/dc1/fd6 0 2024-03-19T06:06:00.780 INFO:tasks.workunit.client.0.smithi072.stdout:0/440: truncate d1/d1c/f43 539319 0 2024-03-19T06:06:00.782 INFO:tasks.workunit.client.0.smithi072.stdout:4/590: creat d5/d15/d73/fd7 x:0 0 0 2024-03-19T06:06:00.784 INFO:tasks.workunit.client.0.smithi072.stdout:0/441: write d1/d1c/f23 [4687843,62305] 0 2024-03-19T06:06:00.786 INFO:tasks.workunit.client.0.smithi072.stdout:4/591: creat d5/d37/fd8 x:0 0 0 2024-03-19T06:06:00.788 INFO:tasks.workunit.client.0.smithi072.stdout:4/592: mkdir d5/d1b/dd9 0 2024-03-19T06:06:00.789 INFO:tasks.workunit.client.0.smithi072.stdout:0/442: creat d1/f8c x:0 0 0 2024-03-19T06:06:00.793 INFO:tasks.workunit.client.0.smithi072.stdout:4/593: symlink d5/d15/d31/d4c/lda 0 2024-03-19T06:06:00.794 INFO:tasks.workunit.client.0.smithi072.stdout:4/594: write d5/d1b/f33 [1727534,124294] 0 2024-03-19T06:06:00.799 INFO:tasks.workunit.client.0.smithi072.stdout:4/595: rename d5/d15/d22/d95/la9 to d5/d37/d52/ldb 0 2024-03-19T06:06:00.802 INFO:tasks.workunit.client.0.smithi072.stdout:0/443: dwrite d1/f1a [4194304,4194304] 0 2024-03-19T06:06:00.803 INFO:tasks.workunit.client.0.smithi072.stdout:0/444: dread - d1/f79 zero size 2024-03-19T06:06:00.810 INFO:tasks.workunit.client.0.smithi072.stdout:4/596: getdents d5/d15/d3f/dc1 0 2024-03-19T06:06:00.812 INFO:tasks.workunit.client.0.smithi072.stdout:4/597: chown d5/d11/f1a 23 1 2024-03-19T06:06:00.820 INFO:tasks.workunit.client.0.smithi072.stdout:0/445: dwrite d1/d1c/d24/d27/d73/f87 [0,4194304] 0 2024-03-19T06:06:00.822 INFO:tasks.workunit.client.0.smithi072.stdout:0/446: chown d1/d1c/c38 6595256 1 2024-03-19T06:06:00.823 INFO:tasks.workunit.client.0.smithi072.stdout:0/447: chown d1/f3c 22022 1 2024-03-19T06:06:00.823 INFO:tasks.workunit.client.0.smithi072.stdout:4/598: dread d5/d1b/fa7 [4194304,4194304] 0 2024-03-19T06:06:00.824 INFO:tasks.workunit.client.0.smithi072.stdout:4/599: chown d5/d1b/dca 31 1 2024-03-19T06:06:00.825 INFO:tasks.workunit.client.0.smithi072.stdout:0/448: creat d1/d1c/d24/d27/d7c/f8d x:0 0 0 2024-03-19T06:06:00.827 INFO:tasks.workunit.client.0.smithi072.stdout:0/449: chown d1/d1c/d24/l78 10858292 1 2024-03-19T06:06:00.830 INFO:tasks.workunit.client.0.smithi072.stdout:0/450: symlink d1/d1c/d24/d27/d73/l8e 0 2024-03-19T06:06:00.832 INFO:tasks.workunit.client.0.smithi072.stdout:0/451: readlink d1/l6d 0 2024-03-19T06:06:00.835 INFO:tasks.workunit.client.0.smithi072.stdout:0/452: fdatasync d1/d1c/d24/d27/d7c/f8d 0 2024-03-19T06:06:00.840 INFO:tasks.workunit.client.0.smithi072.stdout:4/600: dwrite d5/d15/d31/f3c [4194304,4194304] 0 2024-03-19T06:06:00.841 INFO:tasks.workunit.client.0.smithi072.stdout:4/601: stat d5/d15/d31/d6f/fa3 0 2024-03-19T06:06:00.845 INFO:tasks.workunit.client.0.smithi072.stdout:4/602: dread d5/d11/f36 [0,4194304] 0 2024-03-19T06:06:00.847 INFO:tasks.workunit.client.0.smithi072.stdout:4/603: rmdir d5/d32/d58 39 2024-03-19T06:06:00.849 INFO:tasks.workunit.client.0.smithi072.stdout:4/604: write d5/d1b/f8d [3179244,80478] 0 2024-03-19T06:06:00.856 INFO:tasks.workunit.client.0.smithi072.stdout:4/605: creat d5/d15/d31/d6d/fdc x:0 0 0 2024-03-19T06:06:00.905 INFO:tasks.workunit.client.0.smithi072.stdout:3/499: sync 2024-03-19T06:06:00.907 INFO:tasks.workunit.client.0.smithi072.stdout:4/606: creat d5/fdd x:0 0 0 2024-03-19T06:06:00.914 INFO:tasks.workunit.client.0.smithi072.stdout:3/500: getdents d2/d3/d25/da5 0 2024-03-19T06:06:00.919 INFO:tasks.workunit.client.0.smithi072.stdout:3/501: truncate d2/d19/d1e/f6f 77657 0 2024-03-19T06:06:00.928 INFO:tasks.workunit.client.0.smithi072.stdout:3/502: mknod d2/d3/d25/ca6 0 2024-03-19T06:06:00.945 INFO:tasks.workunit.client.0.smithi072.stdout:3/503: read d2/d3/f6d [3596651,118408] 0 2024-03-19T06:06:00.950 INFO:tasks.workunit.client.0.smithi072.stdout:3/504: chown d2/d3/d25/f39 1666915 1 2024-03-19T06:06:00.952 INFO:tasks.workunit.client.0.smithi072.stdout:4/607: dwrite d5/d15/d3f/f6b [0,4194304] 0 2024-03-19T06:06:00.956 INFO:tasks.workunit.client.0.smithi072.stdout:3/505: chown d2/d3/d15/d66/d70/f7b 108 1 2024-03-19T06:06:00.958 INFO:tasks.workunit.client.0.smithi072.stdout:4/608: write d5/d37/fd8 [680187,41666] 0 2024-03-19T06:06:00.964 INFO:tasks.workunit.client.0.smithi072.stdout:4/609: chown d5/d15/faf 585 1 2024-03-19T06:06:00.981 INFO:tasks.workunit.client.0.smithi072.stdout:4/610: write d5/d1b/f5d [267026,51906] 0 2024-03-19T06:06:00.986 INFO:tasks.workunit.client.0.smithi072.stdout:4/611: dread - d5/d11/f98 zero size 2024-03-19T06:06:00.993 INFO:tasks.workunit.client.0.smithi072.stdout:3/506: dwrite d2/f60 [0,4194304] 0 2024-03-19T06:06:00.994 INFO:tasks.workunit.client.0.smithi072.stdout:7/393: sync 2024-03-19T06:06:01.001 INFO:tasks.workunit.client.0.smithi072.stdout:3/507: rename d2/d40/l48 to d2/d40/d78/d9b/la7 0 2024-03-19T06:06:01.008 INFO:tasks.workunit.client.0.smithi072.stdout:7/394: write d2/d3/d18/d20/d3a/d50/f72 [958,81359] 0 2024-03-19T06:06:01.009 INFO:tasks.workunit.client.0.smithi072.stdout:4/612: dread d5/d37/f69 [0,4194304] 0 2024-03-19T06:06:01.012 INFO:tasks.workunit.client.0.smithi072.stdout:3/508: link d2/d3/d15/d66/d6b/l88 d2/d40/la8 0 2024-03-19T06:06:01.014 INFO:tasks.workunit.client.0.smithi072.stdout:4/613: fdatasync d5/d11/f36 0 2024-03-19T06:06:01.018 INFO:tasks.workunit.client.0.smithi072.stdout:7/395: rename d2/d3/d18/d33/d1d/d2b/d67 to d2/d3/d18/d33/d1d/d2b/d75 0 2024-03-19T06:06:01.022 INFO:tasks.workunit.client.0.smithi072.stdout:4/614: write d5/d1b/fa7 [8536456,87457] 0 2024-03-19T06:06:01.028 INFO:tasks.workunit.client.0.smithi072.stdout:7/396: creat d2/d3/d18/d20/d3a/d50/f76 x:0 0 0 2024-03-19T06:06:01.032 INFO:tasks.workunit.client.0.smithi072.stdout:7/397: fsync d2/d3/d18/d33/d1d/d2b/f45 0 2024-03-19T06:06:01.032 INFO:tasks.workunit.client.0.smithi072.stdout:3/509: link d2/d3/d15/d66/d70/ca1 d2/d40/ca9 0 2024-03-19T06:06:01.035 INFO:tasks.workunit.client.0.smithi072.stdout:3/510: rmdir d2/d3/d26/d98 39 2024-03-19T06:06:01.038 INFO:tasks.workunit.client.0.smithi072.stdout:7/398: creat d2/d3/d17/f77 x:0 0 0 2024-03-19T06:06:01.041 INFO:tasks.workunit.client.0.smithi072.stdout:3/511: symlink d2/d3/d25/da5/laa 0 2024-03-19T06:06:01.045 INFO:tasks.workunit.client.0.smithi072.stdout:7/399: creat d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/f78 x:0 0 0 2024-03-19T06:06:01.047 INFO:tasks.workunit.client.0.smithi072.stdout:9/403: sync 2024-03-19T06:06:01.047 INFO:tasks.workunit.client.0.smithi072.stdout:5/619: sync 2024-03-19T06:06:01.047 INFO:tasks.workunit.client.0.smithi072.stdout:6/429: sync 2024-03-19T06:06:01.048 INFO:tasks.workunit.client.0.smithi072.stdout:2/542: sync 2024-03-19T06:06:01.048 INFO:tasks.workunit.client.0.smithi072.stdout:0/453: sync 2024-03-19T06:06:01.048 INFO:tasks.workunit.client.0.smithi072.stdout:1/496: sync 2024-03-19T06:06:01.048 INFO:tasks.workunit.client.0.smithi072.stdout:8/408: sync 2024-03-19T06:06:01.048 INFO:tasks.workunit.client.0.smithi072.stdout:3/512: creat d2/d3/d15/d66/d70/fab x:0 0 0 2024-03-19T06:06:01.055 INFO:tasks.workunit.client.0.smithi072.stdout:2/543: mkdir db/d10/d2b/d45/dc1 0 2024-03-19T06:06:01.055 INFO:tasks.workunit.client.0.smithi072.stdout:3/513: dread d2/d19/d1e/f6f [0,4194304] 0 2024-03-19T06:06:01.059 INFO:tasks.workunit.client.0.smithi072.stdout:4/615: dwrite d5/d11/f36 [0,4194304] 0 2024-03-19T06:06:01.059 INFO:tasks.workunit.client.0.smithi072.stdout:1/497: read - d1/d11/d18/d63/d73/f8f zero size 2024-03-19T06:06:01.060 INFO:tasks.workunit.client.0.smithi072.stdout:9/404: write d11/d1f/d2a/d36/d45/d4d/f62 [790566,73499] 0 2024-03-19T06:06:01.062 INFO:tasks.workunit.client.0.smithi072.stdout:4/616: dread - d5/fa8 zero size 2024-03-19T06:06:01.063 INFO:tasks.workunit.client.0.smithi072.stdout:8/409: unlink da/d13/d3f/l66 0 2024-03-19T06:06:01.065 INFO:tasks.workunit.client.0.smithi072.stdout:3/514: rename d2/d3/d15 to d2/d3/d15/dac 22 2024-03-19T06:06:01.067 INFO:tasks.workunit.client.0.smithi072.stdout:5/620: dread df/d14/f2a [0,4194304] 0 2024-03-19T06:06:01.067 INFO:tasks.workunit.client.0.smithi072.stdout:1/498: chown d1/d11/d18/d19/d1a/d3b/l95 11 1 2024-03-19T06:06:01.069 INFO:tasks.workunit.client.0.smithi072.stdout:0/454: mkdir d1/d1c/d24/d8f 0 2024-03-19T06:06:01.072 INFO:tasks.workunit.client.0.smithi072.stdout:9/405: mkdir d11/d1f/d2a/d6f/d87 0 2024-03-19T06:06:01.073 INFO:tasks.workunit.client.0.smithi072.stdout:4/617: symlink d5/d37/lde 0 2024-03-19T06:06:01.074 INFO:tasks.workunit.client.0.smithi072.stdout:7/400: dwrite d2/f66 [0,4194304] 0 2024-03-19T06:06:01.075 INFO:tasks.workunit.client.0.smithi072.stdout:0/455: truncate d1/f4e 565730 0 2024-03-19T06:06:01.077 INFO:tasks.workunit.client.0.smithi072.stdout:9/406: truncate d11/d1f/f66 71467 0 2024-03-19T06:06:01.078 INFO:tasks.workunit.client.0.smithi072.stdout:1/499: write d1/d11/d18/d19/d1a/d25/f6c [2660735,41637] 0 2024-03-19T06:06:01.083 INFO:tasks.workunit.client.0.smithi072.stdout:8/410: getdents da/d37/d69 0 2024-03-19T06:06:01.083 INFO:tasks.workunit.client.0.smithi072.stdout:9/407: unlink d11/d1f/c21 0 2024-03-19T06:06:01.083 INFO:tasks.workunit.client.0.smithi072.stdout:7/401: rmdir d2/d3/d18 39 2024-03-19T06:06:01.088 INFO:tasks.workunit.client.0.smithi072.stdout:8/411: read da/f2a [468733,120347] 0 2024-03-19T06:06:01.095 INFO:tasks.workunit.client.0.smithi072.stdout:9/408: mkdir d11/d1f/d2a/d6f/d88 0 2024-03-19T06:06:01.099 INFO:tasks.workunit.client.0.smithi072.stdout:8/412: mkdir da/d27/d52/d88 0 2024-03-19T06:06:01.100 INFO:tasks.workunit.client.0.smithi072.stdout:7/402: read - d2/d3/d18/d33/d1d/d2b/f6c zero size 2024-03-19T06:06:01.108 INFO:tasks.workunit.client.0.smithi072.stdout:8/413: fsync da/f36 0 2024-03-19T06:06:01.110 INFO:tasks.workunit.client.0.smithi072.stdout:0/456: truncate d1/f4e 541602 0 2024-03-19T06:06:01.116 INFO:tasks.workunit.client.0.smithi072.stdout:3/515: dread d2/d3/d26/f35 [0,4194304] 0 2024-03-19T06:06:01.118 INFO:tasks.workunit.client.0.smithi072.stdout:6/430: dwrite d7/d9/d2b/f6a [0,4194304] 0 2024-03-19T06:06:01.119 INFO:tasks.workunit.client.0.smithi072.stdout:2/544: dwrite db/f2f [0,4194304] 0 2024-03-19T06:06:01.123 INFO:tasks.workunit.client.0.smithi072.stdout:8/414: creat da/d13/d3f/f89 x:0 0 0 2024-03-19T06:06:01.131 INFO:tasks.workunit.client.0.smithi072.stdout:3/516: dread - d2/d3/d15/d66/d6b/f94 zero size 2024-03-19T06:06:01.131 INFO:tasks.workunit.client.0.smithi072.stdout:5/621: dwrite df/d13/d32/d28/d42/f78 [0,4194304] 0 2024-03-19T06:06:01.132 INFO:tasks.workunit.client.0.smithi072.stdout:0/457: mkdir d1/d1c/d82/d90 0 2024-03-19T06:06:01.132 INFO:tasks.workunit.client.0.smithi072.stdout:3/517: readlink d2/l61 0 2024-03-19T06:06:01.141 INFO:tasks.workunit.client.0.smithi072.stdout:9/409: dwrite d11/d1f/f3a [0,4194304] 0 2024-03-19T06:06:01.141 INFO:tasks.workunit.client.0.smithi072.stdout:1/500: dread d1/d11/d18/d19/d1a/f34 [0,4194304] 0 2024-03-19T06:06:01.142 INFO:tasks.workunit.client.0.smithi072.stdout:3/518: symlink d2/d19/lad 0 2024-03-19T06:06:01.150 INFO:tasks.workunit.client.0.smithi072.stdout:6/431: link d7/d9/d30/f38 d7/d9/d1b/d3b/f8c 0 2024-03-19T06:06:01.152 INFO:tasks.workunit.client.0.smithi072.stdout:3/519: fsync d2/d40/d78/f9a 0 2024-03-19T06:06:01.153 INFO:tasks.workunit.client.0.smithi072.stdout:5/622: rename df/d13/d24/l72 to df/d13/lbb 0 2024-03-19T06:06:01.154 INFO:tasks.workunit.client.0.smithi072.stdout:4/618: dread d5/d1b/f2b [0,4194304] 0 2024-03-19T06:06:01.155 INFO:tasks.workunit.client.0.smithi072.stdout:6/432: chown d7/d9/c18 1801586 1 2024-03-19T06:06:01.158 INFO:tasks.workunit.client.0.smithi072.stdout:9/410: symlink d11/d1f/d2a/l89 0 2024-03-19T06:06:01.161 INFO:tasks.workunit.client.0.smithi072.stdout:2/545: dwrite db/d10/d2b/f4a [0,4194304] 0 2024-03-19T06:06:01.162 INFO:tasks.workunit.client.0.smithi072.stdout:4/619: fdatasync d5/d11/f98 0 2024-03-19T06:06:01.163 INFO:tasks.workunit.client.0.smithi072.stdout:7/403: truncate d2/d3/d18/d33/d1d/d2b/d3d/f7 4118886 0 2024-03-19T06:06:01.165 INFO:tasks.workunit.client.0.smithi072.stdout:6/433: write d7/f70 [1474629,31637] 0 2024-03-19T06:06:01.166 INFO:tasks.workunit.client.0.smithi072.stdout:8/415: dwrite da/d13/d14/f17 [4194304,4194304] 0 2024-03-19T06:06:01.174 INFO:tasks.workunit.client.0.smithi072.stdout:3/520: mknod d2/d3/d26/cae 0 2024-03-19T06:06:01.175 INFO:tasks.workunit.client.0.smithi072.stdout:2/546: write db/d10/f2e [1070154,45604] 0 2024-03-19T06:06:01.176 INFO:tasks.workunit.client.0.smithi072.stdout:0/458: dwrite d1/d1c/d24/d27/d73/f87 [0,4194304] 0 2024-03-19T06:06:01.184 INFO:tasks.workunit.client.0.smithi072.stdout:3/521: write d2/d3/d26/f96 [415499,21870] 0 2024-03-19T06:06:01.186 INFO:tasks.workunit.client.0.smithi072.stdout:4/620: write d5/d15/d3f/dc1/f5b [4574543,26380] 0 2024-03-19T06:06:01.191 INFO:tasks.workunit.client.0.smithi072.stdout:6/434: creat d7/d9/d1e/f8d x:0 0 0 2024-03-19T06:06:01.191 INFO:tasks.workunit.client.0.smithi072.stdout:9/411: truncate d11/d1f/d2a/d36/d45/d4d/f82 283727 0 2024-03-19T06:06:01.197 INFO:tasks.workunit.client.0.smithi072.stdout:1/501: dwrite d1/d11/d18/d63/d73/f8f [0,4194304] 0 2024-03-19T06:06:01.198 INFO:tasks.workunit.client.0.smithi072.stdout:5/623: rename df/d13/d24/l46 to df/d14/lbc 0 2024-03-19T06:06:01.198 INFO:tasks.workunit.client.0.smithi072.stdout:6/435: readlink d7/d2e/d60/l66 0 2024-03-19T06:06:01.201 INFO:tasks.workunit.client.0.smithi072.stdout:7/404: truncate d2/d3/d18/d33/d1d/d2b/f4a 2038685 0 2024-03-19T06:06:01.204 INFO:tasks.workunit.client.0.smithi072.stdout:4/621: write d5/d15/d31/d6d/f82 [1137469,120036] 0 2024-03-19T06:06:01.211 INFO:tasks.workunit.client.0.smithi072.stdout:1/502: creat d1/d11/d18/d19/d1a/f98 x:0 0 0 2024-03-19T06:06:01.212 INFO:tasks.workunit.client.0.smithi072.stdout:9/412: symlink d11/l8a 0 2024-03-19T06:06:01.212 INFO:tasks.workunit.client.0.smithi072.stdout:6/436: dread - d7/d3f/f5f zero size 2024-03-19T06:06:01.213 INFO:tasks.workunit.client.0.smithi072.stdout:0/459: creat d1/d1c/d24/d27/d7c/d6a/f91 x:0 0 0 2024-03-19T06:06:01.217 INFO:tasks.workunit.client.0.smithi072.stdout:4/622: fdatasync d5/d15/d22/f44 0 2024-03-19T06:06:01.217 INFO:tasks.workunit.client.0.smithi072.stdout:7/405: creat d2/d3/d18/d33/d1d/f79 x:0 0 0 2024-03-19T06:06:01.221 INFO:tasks.workunit.client.0.smithi072.stdout:8/416: dwrite da/d27/d41/f46 [0,4194304] 0 2024-03-19T06:06:01.222 INFO:tasks.workunit.client.0.smithi072.stdout:3/522: write d2/d3/f10 [1578492,123821] 0 2024-03-19T06:06:01.223 INFO:tasks.workunit.client.0.smithi072.stdout:0/460: read d1/d1c/d24/d27/d73/f87 [3048239,55580] 0 2024-03-19T06:06:01.227 INFO:tasks.workunit.client.0.smithi072.stdout:5/624: rename df/d14/db1 to df/d13/d32/d28/d42/d59/d43/d4e/dbd 0 2024-03-19T06:06:01.229 INFO:tasks.workunit.client.0.smithi072.stdout:6/437: creat d7/d2e/d60/d78/f8e x:0 0 0 2024-03-19T06:06:01.230 INFO:tasks.workunit.client.0.smithi072.stdout:8/417: write da/d3b/f83 [196509,65363] 0 2024-03-19T06:06:01.234 INFO:tasks.workunit.client.0.smithi072.stdout:4/623: write d5/d15/d31/d6d/d7a/f88 [4088169,79374] 0 2024-03-19T06:06:01.236 INFO:tasks.workunit.client.0.smithi072.stdout:0/461: write d1/d1c/d24/f5e [1331494,111014] 0 2024-03-19T06:06:01.237 INFO:tasks.workunit.client.0.smithi072.stdout:7/406: mknod d2/d3/d17/d70/c7a 0 2024-03-19T06:06:01.238 INFO:tasks.workunit.client.0.smithi072.stdout:2/547: dwrite db/d10/d12/f14 [0,4194304] 0 2024-03-19T06:06:01.241 INFO:tasks.workunit.client.0.smithi072.stdout:9/413: write d11/d1f/f27 [1107565,54581] 0 2024-03-19T06:06:01.251 INFO:tasks.workunit.client.0.smithi072.stdout:4/624: mknod d5/d15/d22/d41/d7b/cdf 0 2024-03-19T06:06:01.252 INFO:tasks.workunit.client.0.smithi072.stdout:2/548: rename db/d10/f27 to db/fc2 0 2024-03-19T06:06:01.254 INFO:tasks.workunit.client.0.smithi072.stdout:7/407: mknod d2/d3/d18/d33/d1d/d2b/c7b 0 2024-03-19T06:06:01.257 INFO:tasks.workunit.client.0.smithi072.stdout:4/625: fsync d5/d15/d22/d41/d61/f70 0 2024-03-19T06:06:01.260 INFO:tasks.workunit.client.0.smithi072.stdout:1/503: dwrite d1/d11/d18/d19/d72/f7e [4194304,4194304] 0 2024-03-19T06:06:01.261 INFO:tasks.workunit.client.0.smithi072.stdout:9/414: creat d11/d4b/d5c/f8b x:0 0 0 2024-03-19T06:06:01.264 INFO:tasks.workunit.client.0.smithi072.stdout:3/523: dwrite d2/d3/d26/f97 [0,4194304] 0 2024-03-19T06:06:01.267 INFO:tasks.workunit.client.0.smithi072.stdout:8/418: dwrite da/d13/d14/d6f/f84 [0,4194304] 0 2024-03-19T06:06:01.269 INFO:tasks.workunit.client.0.smithi072.stdout:2/549: mkdir db/d10/d2b/dc3 0 2024-03-19T06:06:01.273 INFO:tasks.workunit.client.0.smithi072.stdout:1/504: write d1/d11/d18/d19/d70/f66 [3133082,1092] 0 2024-03-19T06:06:01.273 INFO:tasks.workunit.client.0.smithi072.stdout:4/626: symlink d5/d37/d52/le0 0 2024-03-19T06:06:01.274 INFO:tasks.workunit.client.0.smithi072.stdout:5/625: truncate df/d3c/f68 3180898 0 2024-03-19T06:06:01.277 INFO:tasks.workunit.client.0.smithi072.stdout:3/524: mknod d2/d75/caf 0 2024-03-19T06:06:01.279 INFO:tasks.workunit.client.0.smithi072.stdout:7/408: rename d2/d3/d18/d33/d1d/f79 to d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/f7c 0 2024-03-19T06:06:01.279 INFO:tasks.workunit.client.0.smithi072.stdout:3/525: fdatasync d2/d40/d78/f9a 0 2024-03-19T06:06:01.283 INFO:tasks.workunit.client.0.smithi072.stdout:8/419: write da/d13/d1d/f2b [5949285,44571] 0 2024-03-19T06:06:01.289 INFO:tasks.workunit.client.0.smithi072.stdout:0/462: link d1/d1c/d24/d3f/c4d d1/d1c/d24/d27/d7c/d6a/c92 0 2024-03-19T06:06:01.291 INFO:tasks.workunit.client.0.smithi072.stdout:1/505: mknod d1/d11/d18/d19/d1a/d25/c99 0 2024-03-19T06:06:01.293 INFO:tasks.workunit.client.0.smithi072.stdout:9/415: mknod d11/c8c 0 2024-03-19T06:06:01.293 INFO:tasks.workunit.client.0.smithi072.stdout:1/506: truncate d1/f8d 711841 0 2024-03-19T06:06:01.295 INFO:tasks.workunit.client.0.smithi072.stdout:3/526: mkdir d2/d19/db0 0 2024-03-19T06:06:01.297 INFO:tasks.workunit.client.0.smithi072.stdout:6/438: dread d7/d9/d2b/f49 [0,4194304] 0 2024-03-19T06:06:01.300 INFO:tasks.workunit.client.0.smithi072.stdout:4/627: rename d5/d15/d31/d4c/l4e to d5/d32/d58/le1 0 2024-03-19T06:06:01.302 INFO:tasks.workunit.client.0.smithi072.stdout:0/463: dread d1/d2c/f41 [0,4194304] 0 2024-03-19T06:06:01.303 INFO:tasks.workunit.client.0.smithi072.stdout:4/628: write d5/d15/d22/d41/d61/fb6 [1140390,33393] 0 2024-03-19T06:06:01.305 INFO:tasks.workunit.client.0.smithi072.stdout:4/629: chown d5/d15/d31/d6d/d7a 20415 1 2024-03-19T06:06:01.305 INFO:tasks.workunit.client.0.smithi072.stdout:3/527: creat d2/fb1 x:0 0 0 2024-03-19T06:06:01.309 INFO:tasks.workunit.client.0.smithi072.stdout:8/420: mknod da/d27/d52/d5b/d3e/d7f/c8a 0 2024-03-19T06:06:01.348 INFO:tasks.workunit.client.0.smithi072.stdout:9/416: rename d11/c18 to d11/d24/d4c/c8d 0 2024-03-19T06:06:01.349 INFO:tasks.workunit.client.0.smithi072.stdout:5/626: link df/d13/d32/d28/d42/d59/c77 df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97/cbe 0 2024-03-19T06:06:01.352 INFO:tasks.workunit.client.0.smithi072.stdout:1/507: link d1/d11/d18/d19/d1a/d25/d3c/f3e d1/d11/d18/d19/d1a/f9a 0 2024-03-19T06:06:01.352 INFO:tasks.workunit.client.0.smithi072.stdout:5/627: dread - df/d14/fa4 zero size 2024-03-19T06:06:01.353 INFO:tasks.workunit.client.0.smithi072.stdout:3/528: mkdir d2/d3/d15/d66/d6b/db2 0 2024-03-19T06:06:01.354 INFO:tasks.workunit.client.0.smithi072.stdout:1/508: stat d1/l36 0 2024-03-19T06:06:01.355 INFO:tasks.workunit.client.0.smithi072.stdout:0/464: truncate d1/d1c/d24/d3f/f6b 652384 0 2024-03-19T06:06:01.355 INFO:tasks.workunit.client.0.smithi072.stdout:8/421: rename da/d27/d41/l4b to da/d27/d52/l8b 0 2024-03-19T06:06:01.361 INFO:tasks.workunit.client.0.smithi072.stdout:1/509: write d1/d11/d18/d19/d1a/d25/f43 [3889404,100517] 0 2024-03-19T06:06:01.363 INFO:tasks.workunit.client.0.smithi072.stdout:7/409: dwrite d2/d3/d18/d20/d3a/f58 [0,4194304] 0 2024-03-19T06:06:01.371 INFO:tasks.workunit.client.0.smithi072.stdout:4/630: truncate d5/d1b/f5a 2595414 0 2024-03-19T06:06:01.371 INFO:tasks.workunit.client.0.smithi072.stdout:3/529: rename d2/d3/d25/f42 to d2/fb3 0 2024-03-19T06:06:01.372 INFO:tasks.workunit.client.0.smithi072.stdout:7/410: rename d2/d3/d18/d3f to d2/d3/d18/d3f/d7d 22 2024-03-19T06:06:01.375 INFO:tasks.workunit.client.0.smithi072.stdout:7/411: chown d2/f66 31605 1 2024-03-19T06:06:01.376 INFO:tasks.workunit.client.0.smithi072.stdout:2/550: getdents db/d10/d2b/d2d 0 2024-03-19T06:06:01.376 INFO:tasks.workunit.client.0.smithi072.stdout:3/530: write d2/d3/d15/d66/f80 [611974,114435] 0 2024-03-19T06:06:01.384 INFO:tasks.workunit.client.0.smithi072.stdout:9/417: dwrite d11/d4b/d57/f5f [0,4194304] 0 2024-03-19T06:06:01.391 INFO:tasks.workunit.client.0.smithi072.stdout:4/631: creat d5/d15/d22/d95/fe2 x:0 0 0 2024-03-19T06:06:01.391 INFO:tasks.workunit.client.0.smithi072.stdout:2/551: rmdir db/d10/d2b/d2d/d77 39 2024-03-19T06:06:01.391 INFO:tasks.workunit.client.0.smithi072.stdout:8/422: write da/d3b/f54 [9235,43413] 0 2024-03-19T06:06:01.396 INFO:tasks.workunit.client.0.smithi072.stdout:4/632: write d5/d15/d31/d6f/fa3 [1666898,43696] 0 2024-03-19T06:06:01.396 INFO:tasks.workunit.client.0.smithi072.stdout:1/510: rename d1/c8a to d1/d11/d18/d19/d1a/d25/d3c/d52/c9b 0 2024-03-19T06:06:01.396 INFO:tasks.workunit.client.0.smithi072.stdout:0/465: write d1/d1c/d24/d3f/f5c [546740,64880] 0 2024-03-19T06:06:01.397 INFO:tasks.workunit.client.0.smithi072.stdout:7/412: unlink d2/d3/d18/d33/d1d/d2b/d3d/f11 0 2024-03-19T06:06:01.397 INFO:tasks.workunit.client.0.smithi072.stdout:4/633: chown d5/d15/d22/d41/d61/d71 0 1 2024-03-19T06:06:01.402 INFO:tasks.workunit.client.0.smithi072.stdout:3/531: creat d2/d3/d15/d66/d6b/db2/fb4 x:0 0 0 2024-03-19T06:06:01.404 INFO:tasks.workunit.client.0.smithi072.stdout:5/628: dwrite df/f96 [0,4194304] 0 2024-03-19T06:06:01.405 INFO:tasks.workunit.client.0.smithi072.stdout:7/413: readlink d2/d3/d18/d33/d1d/d2b/l55 0 2024-03-19T06:06:01.405 INFO:tasks.workunit.client.0.smithi072.stdout:4/634: rmdir d5/d15/da6 39 2024-03-19T06:06:01.406 INFO:tasks.workunit.client.0.smithi072.stdout:0/466: chown d1/d1c/d24/d27/d65/c7f 63 1 2024-03-19T06:06:01.410 INFO:tasks.workunit.client.0.smithi072.stdout:1/511: symlink d1/d11/d18/d19/d1a/d61/d65/l9c 0 2024-03-19T06:06:01.410 INFO:tasks.workunit.client.0.smithi072.stdout:7/414: chown d2/d3/d17/d70/c7a 30045852 1 2024-03-19T06:06:01.413 INFO:tasks.workunit.client.0.smithi072.stdout:3/532: write d2/d3/d25/f39 [7797926,88361] 0 2024-03-19T06:06:01.413 INFO:tasks.workunit.client.0.smithi072.stdout:8/423: dwrite da/d13/d14/d1b/d57/f5d [4194304,4194304] 0 2024-03-19T06:06:01.416 INFO:tasks.workunit.client.0.smithi072.stdout:9/418: truncate d11/f1e 1533271 0 2024-03-19T06:06:01.420 INFO:tasks.workunit.client.0.smithi072.stdout:4/635: mkdir d5/d37/de3 0 2024-03-19T06:06:01.425 INFO:tasks.workunit.client.0.smithi072.stdout:1/512: unlink d1/d11/d18/d19/d1a/d25/d3c/c46 0 2024-03-19T06:06:01.425 INFO:tasks.workunit.client.0.smithi072.stdout:7/415: fdatasync d2/f4c 0 2024-03-19T06:06:01.426 INFO:tasks.workunit.client.0.smithi072.stdout:1/513: read - d1/f8e zero size 2024-03-19T06:06:01.428 INFO:tasks.workunit.client.0.smithi072.stdout:9/419: creat d11/d1f/d2a/d68/f8e x:0 0 0 2024-03-19T06:06:01.428 INFO:tasks.workunit.client.0.smithi072.stdout:4/636: mknod d5/d37/d52/ce4 0 2024-03-19T06:06:01.430 INFO:tasks.workunit.client.0.smithi072.stdout:5/629: creat df/d54/dac/d9c/fbf x:0 0 0 2024-03-19T06:06:01.430 INFO:tasks.workunit.client.0.smithi072.stdout:1/514: chown d1/d11/d18/d19/d1a/f98 4348 1 2024-03-19T06:06:01.434 INFO:tasks.workunit.client.0.smithi072.stdout:4/637: creat d5/d15/d22/d41/fe5 x:0 0 0 2024-03-19T06:06:01.435 INFO:tasks.workunit.client.0.smithi072.stdout:9/420: mknod d11/d1f/d2a/d36/d45/d4d/c8f 0 2024-03-19T06:06:01.436 INFO:tasks.workunit.client.0.smithi072.stdout:2/552: dread db/d10/d2b/d2d/d62/d6b/f71 [0,4194304] 0 2024-03-19T06:06:01.436 INFO:tasks.workunit.client.0.smithi072.stdout:3/533: write d2/d3/d26/f35 [4402736,8064] 0 2024-03-19T06:06:01.437 INFO:tasks.workunit.client.0.smithi072.stdout:5/630: mknod df/d16/cc0 0 2024-03-19T06:06:01.442 INFO:tasks.workunit.client.0.smithi072.stdout:1/515: creat d1/d11/d76/f9d x:0 0 0 2024-03-19T06:06:01.442 INFO:tasks.workunit.client.0.smithi072.stdout:0/467: dwrite d1/fb [0,4194304] 0 2024-03-19T06:06:01.443 INFO:tasks.workunit.client.0.smithi072.stdout:4/638: symlink d5/d1b/le6 0 2024-03-19T06:06:01.449 INFO:tasks.workunit.client.0.smithi072.stdout:9/421: creat d11/d1f/d2a/d36/f90 x:0 0 0 2024-03-19T06:06:01.450 INFO:tasks.workunit.client.0.smithi072.stdout:7/416: rename d2/c6f to d2/c7e 0 2024-03-19T06:06:01.452 INFO:tasks.workunit.client.0.smithi072.stdout:8/424: dwrite da/f34 [0,4194304] 0 2024-03-19T06:06:01.456 INFO:tasks.workunit.client.0.smithi072.stdout:1/516: mkdir d1/d11/d18/d19/d70/d9e 0 2024-03-19T06:06:01.462 INFO:tasks.workunit.client.0.smithi072.stdout:5/631: dwrite df/d16/f36 [0,4194304] 0 2024-03-19T06:06:01.466 INFO:tasks.workunit.client.0.smithi072.stdout:9/422: creat d11/d1f/d2a/d36/d45/f91 x:0 0 0 2024-03-19T06:06:01.471 INFO:tasks.workunit.client.0.smithi072.stdout:4/639: creat d5/d15/d31/d7d/d91/fe7 x:0 0 0 2024-03-19T06:06:01.473 INFO:tasks.workunit.client.0.smithi072.stdout:3/534: rename d2/d19/lad to d2/d3/d15/d66/d6b/d79/lb5 0 2024-03-19T06:06:01.475 INFO:tasks.workunit.client.0.smithi072.stdout:8/425: dwrite da/d13/d1d/f87 [0,4194304] 0 2024-03-19T06:06:01.481 INFO:tasks.workunit.client.0.smithi072.stdout:2/553: creat db/d10/d2b/d2d/d9e/d48/d82/d98/dbf/fc4 x:0 0 0 2024-03-19T06:06:01.483 INFO:tasks.workunit.client.0.smithi072.stdout:9/423: chown d11/d24/d4c/c8d 252980461 1 2024-03-19T06:06:01.484 INFO:tasks.workunit.client.0.smithi072.stdout:4/640: stat d5/d37/d52/ldb 0 2024-03-19T06:06:01.488 INFO:tasks.workunit.client.0.smithi072.stdout:3/535: symlink d2/d3/d25/lb6 0 2024-03-19T06:06:01.493 INFO:tasks.workunit.client.0.smithi072.stdout:8/426: dwrite da/f34 [0,4194304] 0 2024-03-19T06:06:01.494 INFO:tasks.workunit.client.0.smithi072.stdout:4/641: creat d5/d15/d22/d41/d7b/d7c/fe8 x:0 0 0 2024-03-19T06:06:01.496 INFO:tasks.workunit.client.0.smithi072.stdout:2/554: dread db/f1e [0,4194304] 0 2024-03-19T06:06:01.496 INFO:tasks.workunit.client.0.smithi072.stdout:3/536: unlink d2/l61 0 2024-03-19T06:06:01.501 INFO:tasks.workunit.client.0.smithi072.stdout:1/517: getdents d1/d11/d18 0 2024-03-19T06:06:01.502 INFO:tasks.workunit.client.0.smithi072.stdout:3/537: chown d2/d19/c3f 205 1 2024-03-19T06:06:01.504 INFO:tasks.workunit.client.0.smithi072.stdout:9/424: dwrite d11/f37 [4194304,4194304] 0 2024-03-19T06:06:01.504 INFO:tasks.workunit.client.0.smithi072.stdout:8/427: rename da/d13/d3f/f89 to da/d27/d52/d5b/d3e/f8c 0 2024-03-19T06:06:01.507 INFO:tasks.workunit.client.0.smithi072.stdout:2/555: dread - db/d10/d2b/d2d/d66/f93 zero size 2024-03-19T06:06:01.508 INFO:tasks.workunit.client.0.smithi072.stdout:4/642: creat d5/d15/d31/d6f/d9d/fe9 x:0 0 0 2024-03-19T06:06:01.511 INFO:tasks.workunit.client.0.smithi072.stdout:1/518: creat d1/d11/d18/d19/d72/f9f x:0 0 0 2024-03-19T06:06:01.514 INFO:tasks.workunit.client.0.smithi072.stdout:1/519: stat d1/d11/d18/d19/d1a/f34 0 2024-03-19T06:06:01.521 INFO:tasks.workunit.client.0.smithi072.stdout:9/425: mkdir d11/d1f/d2a/d68/d92 0 2024-03-19T06:06:01.521 INFO:tasks.workunit.client.0.smithi072.stdout:4/643: creat d5/d15/d3f/fea x:0 0 0 2024-03-19T06:06:01.523 INFO:tasks.workunit.client.0.smithi072.stdout:3/538: dwrite d2/d3/d26/f97 [4194304,4194304] 0 2024-03-19T06:06:01.541 INFO:tasks.workunit.client.0.smithi072.stdout:2/556: creat db/d10/d13/d8e/fc5 x:0 0 0 2024-03-19T06:06:01.541 INFO:tasks.workunit.client.0.smithi072.stdout:5/632: dwrite df/d14/f2a [0,4194304] 0 2024-03-19T06:06:01.541 INFO:tasks.workunit.client.0.smithi072.stdout:7/417: truncate d2/d3/d18/d20/d3a/f58 85434 0 2024-03-19T06:06:01.545 INFO:tasks.workunit.client.0.smithi072.stdout:8/428: dwrite da/d3b/f83 [0,4194304] 0 2024-03-19T06:06:01.546 INFO:tasks.workunit.client.0.smithi072.stdout:7/418: readlink d2/d3/d18/d2f/l37 0 2024-03-19T06:06:01.555 INFO:tasks.workunit.client.0.smithi072.stdout:5/633: truncate df/d13/d32/d28/d42/fb3 108973 0 2024-03-19T06:06:01.562 INFO:tasks.workunit.client.0.smithi072.stdout:1/520: dwrite d1/d11/f13 [0,4194304] 0 2024-03-19T06:06:01.562 INFO:tasks.workunit.client.0.smithi072.stdout:3/539: symlink d2/d75/lb7 0 2024-03-19T06:06:01.563 INFO:tasks.workunit.client.0.smithi072.stdout:1/521: readlink d1/l2d 0 2024-03-19T06:06:01.568 INFO:tasks.workunit.client.0.smithi072.stdout:4/644: mknod d5/d15/d31/d7d/ceb 0 2024-03-19T06:06:01.577 INFO:tasks.workunit.client.0.smithi072.stdout:8/429: unlink da/d13/f77 0 2024-03-19T06:06:01.582 INFO:tasks.workunit.client.0.smithi072.stdout:9/426: mkdir d11/d1f/d2a/d68/d92/d93 0 2024-03-19T06:06:01.587 INFO:tasks.workunit.client.0.smithi072.stdout:4/645: creat d5/d15/d3f/dc1/fec x:0 0 0 2024-03-19T06:06:01.588 INFO:tasks.workunit.client.0.smithi072.stdout:7/419: mkdir d2/d3/d18/d7f 0 2024-03-19T06:06:01.591 INFO:tasks.workunit.client.0.smithi072.stdout:8/430: unlink da/d27/f7c 0 2024-03-19T06:06:01.593 INFO:tasks.workunit.client.0.smithi072.stdout:9/427: creat d11/d1f/d2a/d6f/f94 x:0 0 0 2024-03-19T06:06:01.593 INFO:tasks.workunit.client.0.smithi072.stdout:7/420: dread - d2/d3/d18/d33/d1d/d2b/f6c zero size 2024-03-19T06:06:01.597 INFO:tasks.workunit.client.0.smithi072.stdout:9/428: chown d11/d4b/d57/l5e 61877246 1 2024-03-19T06:06:01.597 INFO:tasks.workunit.client.0.smithi072.stdout:4/646: chown d5/d15/d31/d6f/cd4 622623802 1 2024-03-19T06:06:01.599 INFO:tasks.workunit.client.0.smithi072.stdout:5/634: getdents df/d14 0 2024-03-19T06:06:01.603 INFO:tasks.workunit.client.0.smithi072.stdout:9/429: write d11/d1f/d2a/d68/f8e [1035907,9658] 0 2024-03-19T06:06:01.607 INFO:tasks.workunit.client.0.smithi072.stdout:5/635: symlink df/d13/d32/d28/d42/d59/d43/d4e/lc1 0 2024-03-19T06:06:01.609 INFO:tasks.workunit.client.0.smithi072.stdout:8/431: truncate da/d37/f73 904936 0 2024-03-19T06:06:01.610 INFO:tasks.workunit.client.0.smithi072.stdout:5/636: write df/d14/f2f [1063508,43186] 0 2024-03-19T06:06:01.612 INFO:tasks.workunit.client.0.smithi072.stdout:9/430: unlink d11/d24/d4c/d64/c69 0 2024-03-19T06:06:01.623 INFO:tasks.workunit.client.0.smithi072.stdout:4/647: dwrite d5/d15/d22/fa5 [0,4194304] 0 2024-03-19T06:06:01.625 INFO:tasks.workunit.client.0.smithi072.stdout:3/540: dread d2/d19/f65 [0,4194304] 0 2024-03-19T06:06:01.627 INFO:tasks.workunit.client.0.smithi072.stdout:3/541: write d2/d19/f72 [2926481,62359] 0 2024-03-19T06:06:01.627 INFO:tasks.workunit.client.0.smithi072.stdout:9/431: fdatasync d11/d1f/d2a/d36/d3e/f54 0 2024-03-19T06:06:01.628 INFO:tasks.workunit.client.0.smithi072.stdout:4/648: truncate d5/d11/f98 989608 0 2024-03-19T06:06:01.637 INFO:tasks.workunit.client.0.smithi072.stdout:4/649: read d5/d1b/f5d [10185,54912] 0 2024-03-19T06:06:01.637 INFO:tasks.workunit.client.0.smithi072.stdout:1/522: dread d1/d11/d18/d19/d1a/d25/d3c/f3e [0,4194304] 0 2024-03-19T06:06:01.637 INFO:tasks.workunit.client.0.smithi072.stdout:5/637: link df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/fa9 df/d13/d32/d28/d42/d59/d43/d62/fc2 0 2024-03-19T06:06:01.639 INFO:tasks.workunit.client.0.smithi072.stdout:5/638: dread - df/d13/fb0 zero size 2024-03-19T06:06:01.648 INFO:tasks.workunit.client.0.smithi072.stdout:9/432: mknod d11/d1f/c95 0 2024-03-19T06:06:01.653 INFO:tasks.workunit.client.0.smithi072.stdout:3/542: dwrite d2/d40/d78/f9a [0,4194304] 0 2024-03-19T06:06:01.653 INFO:tasks.workunit.client.0.smithi072.stdout:4/650: dread d5/d1b/fa7 [4194304,4194304] 0 2024-03-19T06:06:01.655 INFO:tasks.workunit.client.0.smithi072.stdout:2/557: dwrite db/d10/d2b/d2d/d62/d6b/f8a [0,4194304] 0 2024-03-19T06:06:01.655 INFO:tasks.workunit.client.0.smithi072.stdout:8/432: write da/d27/f43 [159969,121095] 0 2024-03-19T06:06:01.659 INFO:tasks.workunit.client.0.smithi072.stdout:7/421: dread d2/d3/d18/d20/d3a/f5c [0,4194304] 0 2024-03-19T06:06:01.665 INFO:tasks.workunit.client.0.smithi072.stdout:9/433: mknod d11/d1f/d43/c96 0 2024-03-19T06:06:01.673 INFO:tasks.workunit.client.0.smithi072.stdout:5/639: creat df/d54/dac/d9c/fc3 x:0 0 0 2024-03-19T06:06:01.681 INFO:tasks.workunit.client.0.smithi072.stdout:1/523: rmdir d1/d11/d18/d19/d1a/d25/d3c/d68/d81 0 2024-03-19T06:06:01.682 INFO:tasks.workunit.client.0.smithi072.stdout:6/439: sync 2024-03-19T06:06:01.684 INFO:tasks.workunit.client.0.smithi072.stdout:7/422: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f39 [0,4194304] 0 2024-03-19T06:06:01.686 INFO:tasks.workunit.client.0.smithi072.stdout:5/640: mkdir df/d16/dc4 0 2024-03-19T06:06:01.686 INFO:tasks.workunit.client.0.smithi072.stdout:8/433: mkdir da/d62/d75/d8d 0 2024-03-19T06:06:01.688 INFO:tasks.workunit.client.0.smithi072.stdout:3/543: link d2/d3/d15/d66/d70/f9f d2/d75/fb8 0 2024-03-19T06:06:01.688 INFO:tasks.workunit.client.0.smithi072.stdout:7/423: stat d2/d3/d18/d33/d1d/d3b/l51 0 2024-03-19T06:06:01.691 INFO:tasks.workunit.client.0.smithi072.stdout:9/434: dwrite d11/d1f/d2a/d36/d45/f84 [0,4194304] 0 2024-03-19T06:06:01.695 INFO:tasks.workunit.client.0.smithi072.stdout:2/558: dread db/d10/d13/d31/f5d [0,4194304] 0 2024-03-19T06:06:01.697 INFO:tasks.workunit.client.0.smithi072.stdout:7/424: truncate d2/d3/d18/d33/d1d/d2b/f6c 742267 0 2024-03-19T06:06:01.698 INFO:tasks.workunit.client.0.smithi072.stdout:9/435: chown d11/d1f/d2a/d36/d3e/f5d 570 1 2024-03-19T06:06:01.699 INFO:tasks.workunit.client.0.smithi072.stdout:8/434: mkdir da/d37/d5c/d8e 0 2024-03-19T06:06:01.700 INFO:tasks.workunit.client.0.smithi072.stdout:8/435: readlink da/l29 0 2024-03-19T06:06:01.705 INFO:tasks.workunit.client.0.smithi072.stdout:9/436: write d11/d1f/d2a/f72 [67027,44910] 0 2024-03-19T06:06:01.707 INFO:tasks.workunit.client.0.smithi072.stdout:1/524: dwrite d1/f8e [0,4194304] 0 2024-03-19T06:06:01.710 INFO:tasks.workunit.client.0.smithi072.stdout:6/440: link d7/d9/d1e/l20 d7/d3f/l8f 0 2024-03-19T06:06:01.714 INFO:tasks.workunit.client.0.smithi072.stdout:8/436: write da/d13/d14/d1b/f78 [653622,91784] 0 2024-03-19T06:06:01.718 INFO:tasks.workunit.client.0.smithi072.stdout:2/559: readlink db/d10/d44/l92 0 2024-03-19T06:06:01.718 INFO:tasks.workunit.client.0.smithi072.stdout:9/437: symlink d11/d24/d4c/d64/l97 0 2024-03-19T06:06:01.721 INFO:tasks.workunit.client.0.smithi072.stdout:5/641: getdents df/d13 0 2024-03-19T06:06:01.725 INFO:tasks.workunit.client.0.smithi072.stdout:8/437: symlink da/d37/d5c/l8f 0 2024-03-19T06:06:01.727 INFO:tasks.workunit.client.0.smithi072.stdout:3/544: dwrite d2/d3/d25/f39 [0,4194304] 0 2024-03-19T06:06:01.729 INFO:tasks.workunit.client.0.smithi072.stdout:9/438: symlink d11/d1f/d2a/d36/l98 0 2024-03-19T06:06:01.736 INFO:tasks.workunit.client.0.smithi072.stdout:4/651: dwrite d5/d1b/f5a [0,4194304] 0 2024-03-19T06:06:01.737 INFO:tasks.workunit.client.0.smithi072.stdout:8/438: read da/d27/f47 [1958966,59701] 0 2024-03-19T06:06:01.737 INFO:tasks.workunit.client.0.smithi072.stdout:1/525: rename d1/l36 to d1/d11/d18/d19/d1a/d25/d3c/d68/d96/la0 0 2024-03-19T06:06:01.737 INFO:tasks.workunit.client.0.smithi072.stdout:2/560: write db/d10/d2b/d2d/d9e/d48/d82/f94 [3824274,49892] 0 2024-03-19T06:06:01.740 INFO:tasks.workunit.client.0.smithi072.stdout:3/545: rmdir d2/d3/d25 39 2024-03-19T06:06:01.746 INFO:tasks.workunit.client.0.smithi072.stdout:9/439: fsync d11/d1f/d2a/d36/f3f 0 2024-03-19T06:06:01.747 INFO:tasks.workunit.client.0.smithi072.stdout:7/425: dwrite d2/d3/d18/d20/d3a/d50/f76 [0,4194304] 0 2024-03-19T06:06:01.747 INFO:tasks.workunit.client.0.smithi072.stdout:2/561: rename db to db/d10/d2b/dc3/dc6 22 2024-03-19T06:06:01.753 INFO:tasks.workunit.client.0.smithi072.stdout:4/652: creat d5/d15/d31/d6f/fed x:0 0 0 2024-03-19T06:06:01.755 INFO:tasks.workunit.client.0.smithi072.stdout:0/468: sync 2024-03-19T06:06:01.757 INFO:tasks.workunit.client.0.smithi072.stdout:6/441: dwrite d7/d3f/d44/f3d [0,4194304] 0 2024-03-19T06:06:01.760 INFO:tasks.workunit.client.0.smithi072.stdout:8/439: mkdir da/d37/d5c/d8e/d90 0 2024-03-19T06:06:01.760 INFO:tasks.workunit.client.0.smithi072.stdout:5/642: dwrite df/d16/f36 [4194304,4194304] 0 2024-03-19T06:06:01.760 INFO:tasks.workunit.client.0.smithi072.stdout:4/653: chown d5/d15/d22/d41/d7b/d7c 0 1 2024-03-19T06:06:01.762 INFO:tasks.workunit.client.0.smithi072.stdout:2/562: symlink db/d10/d2b/d45/da4/lc7 0 2024-03-19T06:06:01.763 INFO:tasks.workunit.client.0.smithi072.stdout:4/654: dread - d5/d15/d31/d6d/fdc zero size 2024-03-19T06:06:01.764 INFO:tasks.workunit.client.0.smithi072.stdout:1/526: unlink d1/d11/d18/d19/d1a/d25/d3c/d68/d96/la0 0 2024-03-19T06:06:01.769 INFO:tasks.workunit.client.0.smithi072.stdout:7/426: rename d2/d3/d17/l6d to d2/d3/d43/l80 0 2024-03-19T06:06:01.771 INFO:tasks.workunit.client.0.smithi072.stdout:6/442: symlink d7/d9/d1b/d33/d41/l90 0 2024-03-19T06:06:01.772 INFO:tasks.workunit.client.0.smithi072.stdout:2/563: creat db/d10/d2b/d2d/d62/d6b/fc8 x:0 0 0 2024-03-19T06:06:01.776 INFO:tasks.workunit.client.0.smithi072.stdout:9/440: rename d11/d4b/d5c/l6b to d11/d1f/d2a/d36/d45/d4d/l99 0 2024-03-19T06:06:01.778 INFO:tasks.workunit.client.0.smithi072.stdout:9/441: chown d11/d1f/f3d 44689392 1 2024-03-19T06:06:01.779 INFO:tasks.workunit.client.0.smithi072.stdout:1/527: unlink d1/d11/d18/d19/d1a/d25/c30 0 2024-03-19T06:06:01.780 INFO:tasks.workunit.client.0.smithi072.stdout:8/440: dwrite da/d13/d14/d1b/f68 [0,4194304] 0 2024-03-19T06:06:01.782 INFO:tasks.workunit.client.0.smithi072.stdout:5/643: link df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97/fa6 df/d13/d32/d28/d42/d59/fc5 0 2024-03-19T06:06:01.782 INFO:tasks.workunit.client.0.smithi072.stdout:3/546: write d2/d3/d15/f67 [352451,10682] 0 2024-03-19T06:06:01.784 INFO:tasks.workunit.client.0.smithi072.stdout:7/427: unlink d2/d3/d18/d33/d1d/c2a 0 2024-03-19T06:06:01.785 INFO:tasks.workunit.client.0.smithi072.stdout:3/547: write d2/d3/d15/d66/d6b/d79/f83 [490027,43395] 0 2024-03-19T06:06:01.787 INFO:tasks.workunit.client.0.smithi072.stdout:6/443: fsync d7/d9/d1b/d33/d41/f59 0 2024-03-19T06:06:01.791 INFO:tasks.workunit.client.0.smithi072.stdout:0/469: rename d1/d1c/d24/f5e to d1/d1c/d24/d27/d65/f93 0 2024-03-19T06:06:01.797 INFO:tasks.workunit.client.0.smithi072.stdout:0/470: truncate d1/d1c/d24/d27/d7c/f8d 537563 0 2024-03-19T06:06:01.803 INFO:tasks.workunit.client.0.smithi072.stdout:4/655: rename d5/d15/d22/d41/d61/d71/lbe to d5/d15/d31/d4c/lee 0 2024-03-19T06:06:01.804 INFO:tasks.workunit.client.0.smithi072.stdout:5/644: rename df to df/d13/d24/dc6 22 2024-03-19T06:06:01.809 INFO:tasks.workunit.client.0.smithi072.stdout:3/548: unlink d2/d3/d25/f86 0 2024-03-19T06:06:01.811 INFO:tasks.workunit.client.0.smithi072.stdout:8/441: link da/d27/d52/d5b/d3e/d7f/c8a da/d27/d52/d5b/c91 0 2024-03-19T06:06:01.813 INFO:tasks.workunit.client.0.smithi072.stdout:8/442: stat da/d62/d75/d8d 0 2024-03-19T06:06:01.817 INFO:tasks.workunit.client.0.smithi072.stdout:9/442: dread d11/d4b/f71 [0,4194304] 0 2024-03-19T06:06:01.818 INFO:tasks.workunit.client.0.smithi072.stdout:4/656: dread d5/d1b/f2b [0,4194304] 0 2024-03-19T06:06:01.818 INFO:tasks.workunit.client.0.smithi072.stdout:6/444: rename d7/d9/d30/d54 to d7/d91 0 2024-03-19T06:06:01.819 INFO:tasks.workunit.client.0.smithi072.stdout:9/443: chown d11/d1f/d2a/d68/f8e 59197 1 2024-03-19T06:06:01.820 INFO:tasks.workunit.client.0.smithi072.stdout:3/549: creat d2/d3/d26/d98/fb9 x:0 0 0 2024-03-19T06:06:01.823 INFO:tasks.workunit.client.0.smithi072.stdout:3/550: dread - d2/d3/d26/d98/fb9 zero size 2024-03-19T06:06:01.824 INFO:tasks.workunit.client.0.smithi072.stdout:5/645: rename df/d54/dac/f66 to df/d16/dc4/fc7 0 2024-03-19T06:06:01.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:01 smithi072 ceph-mon[28706]: pgmap v27: 65 pgs: 65 active+clean; 2.5 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 46 MiB/s rd, 168 MiB/s wr, 388 op/s 2024-03-19T06:06:01.827 INFO:tasks.workunit.client.0.smithi072.stdout:8/443: symlink da/d62/d75/d8d/l92 0 2024-03-19T06:06:01.827 INFO:tasks.workunit.client.0.smithi072.stdout:2/564: truncate db/fc2 957032 0 2024-03-19T06:06:01.831 INFO:tasks.workunit.client.0.smithi072.stdout:6/445: truncate d7/d9/d2b/d5d/f87 3429131 0 2024-03-19T06:06:01.833 INFO:tasks.workunit.client.0.smithi072.stdout:7/428: dread d2/d3/d18/d33/d1d/d2b/d3d/f7 [0,4194304] 0 2024-03-19T06:06:01.834 INFO:tasks.workunit.client.0.smithi072.stdout:9/444: getdents d11/d1f/d2a/d36/d86 0 2024-03-19T06:06:01.836 INFO:tasks.workunit.client.0.smithi072.stdout:0/471: dread d1/d1c/d24/d27/d73/f7a [0,4194304] 0 2024-03-19T06:06:01.837 INFO:tasks.workunit.client.0.smithi072.stdout:6/446: write d7/d9/d1b/d33/d41/d45/f67 [786321,563] 0 2024-03-19T06:06:01.837 INFO:tasks.workunit.client.0.smithi072.stdout:2/565: chown db/d10/d2b/d2d/d77 4 1 2024-03-19T06:06:01.841 INFO:tasks.workunit.client.0.smithi072.stdout:3/551: rmdir d2/d3/da4 0 2024-03-19T06:06:01.841 INFO:tasks.workunit.client.0.smithi072.stdout:1/528: dwrite d1/f4e [0,4194304] 0 2024-03-19T06:06:01.843 INFO:tasks.workunit.client.0.smithi072.stdout:3/552: write d2/fb3 [1737325,111908] 0 2024-03-19T06:06:01.843 INFO:tasks.workunit.client.0.smithi072.stdout:4/657: dread d5/d1b/f1d [0,4194304] 0 2024-03-19T06:06:01.844 INFO:tasks.workunit.client.0.smithi072.stdout:9/445: creat d11/d24/d4c/f9a x:0 0 0 2024-03-19T06:06:01.847 INFO:tasks.workunit.client.0.smithi072.stdout:7/429: creat d2/d3/d18/d33/d1d/f81 x:0 0 0 2024-03-19T06:06:01.849 INFO:tasks.workunit.client.0.smithi072.stdout:6/447: write d7/d2e/f47 [4262488,125088] 0 2024-03-19T06:06:01.852 INFO:tasks.workunit.client.0.smithi072.stdout:5/646: link df/d54/l7f df/d13/d32/d28/d42/d59/d43/d62/lc8 0 2024-03-19T06:06:01.854 INFO:tasks.workunit.client.0.smithi072.stdout:3/553: unlink d2/f90 0 2024-03-19T06:06:01.855 INFO:tasks.workunit.client.0.smithi072.stdout:1/529: mknod d1/d11/d18/d19/d1a/d25/d3c/d52/ca1 0 2024-03-19T06:06:01.858 INFO:tasks.workunit.client.0.smithi072.stdout:0/472: dwrite d1/d1c/d24/d27/d7c/f5a [0,4194304] 0 2024-03-19T06:06:01.861 INFO:tasks.workunit.client.0.smithi072.stdout:5/647: fdatasync df/f26 0 2024-03-19T06:06:01.863 INFO:tasks.workunit.client.0.smithi072.stdout:9/446: link d11/d1f/f66 d11/d1f/d2a/d36/d45/d4d/f9b 0 2024-03-19T06:06:01.864 INFO:tasks.workunit.client.0.smithi072.stdout:8/444: dwrite da/f11 [4194304,4194304] 0 2024-03-19T06:06:01.864 INFO:tasks.workunit.client.0.smithi072.stdout:4/658: getdents d5/d32/d58 0 2024-03-19T06:06:01.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:01 smithi172 ceph-mon[35716]: pgmap v27: 65 pgs: 65 active+clean; 2.5 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 46 MiB/s rd, 168 MiB/s wr, 388 op/s 2024-03-19T06:06:02.042 INFO:tasks.workunit.client.0.smithi072.stdout:3/554: rename d2/d3/d26/f4a to d2/d3/d15/fba 0 2024-03-19T06:06:02.044 INFO:tasks.workunit.client.0.smithi072.stdout:5/648: fsync df/d13/d24/f9e 0 2024-03-19T06:06:02.046 INFO:tasks.workunit.client.0.smithi072.stdout:1/530: truncate d1/d11/d18/d19/d1a/f98 734397 0 2024-03-19T06:06:02.052 INFO:tasks.workunit.client.0.smithi072.stdout:5/649: stat df/d13/c1d 0 2024-03-19T06:06:02.056 INFO:tasks.workunit.client.0.smithi072.stdout:9/447: write d11/d1f/d2a/d36/d3e/f5d [1055253,104220] 0 2024-03-19T06:06:02.059 INFO:tasks.workunit.client.0.smithi072.stdout:2/566: dwrite db/d10/d44/f54 [0,4194304] 0 2024-03-19T06:06:02.061 INFO:tasks.workunit.client.0.smithi072.stdout:4/659: mknod d5/d8a/cef 0 2024-03-19T06:06:02.063 INFO:tasks.workunit.client.0.smithi072.stdout:3/555: mknod d2/d3/d26/cbb 0 2024-03-19T06:06:02.065 INFO:tasks.workunit.client.0.smithi072.stdout:7/430: dwrite d2/d3/d18/d20/d3a/f5c [0,4194304] 0 2024-03-19T06:06:02.066 INFO:tasks.workunit.client.0.smithi072.stdout:1/531: fsync d1/d11/d18/d19/d1a/d3b/f6a 0 2024-03-19T06:06:02.071 INFO:tasks.workunit.client.0.smithi072.stdout:5/650: creat df/d3c/fc9 x:0 0 0 2024-03-19T06:06:02.072 INFO:tasks.workunit.client.0.smithi072.stdout:9/448: fdatasync d11/d1f/f3d 0 2024-03-19T06:06:02.076 INFO:tasks.workunit.client.0.smithi072.stdout:0/473: dwrite d1/d1c/d24/d27/d7c/f71 [0,4194304] 0 2024-03-19T06:06:02.076 INFO:tasks.workunit.client.0.smithi072.stdout:9/449: stat d11/d24/l2f 0 2024-03-19T06:06:02.077 INFO:tasks.workunit.client.0.smithi072.stdout:8/445: creat da/d37/f93 x:0 0 0 2024-03-19T06:06:02.080 INFO:tasks.workunit.client.0.smithi072.stdout:0/474: dread - d1/d1c/d24/d27/d7c/d6a/f91 zero size 2024-03-19T06:06:02.083 INFO:tasks.workunit.client.0.smithi072.stdout:4/660: unlink d5/d15/d31/d6f/l90 0 2024-03-19T06:06:02.085 INFO:tasks.workunit.client.0.smithi072.stdout:7/431: mkdir d2/d3/d18/d33/d1d/d2b/d82 0 2024-03-19T06:06:02.085 INFO:tasks.workunit.client.0.smithi072.stdout:1/532: dread d1/d11/f13 [0,4194304] 0 2024-03-19T06:06:02.090 INFO:tasks.workunit.client.0.smithi072.stdout:5/651: chown df/d54/dac/c87 7300187 1 2024-03-19T06:06:02.095 INFO:tasks.workunit.client.0.smithi072.stdout:9/450: fdatasync d11/d1f/d2a/d68/f73 0 2024-03-19T06:06:02.096 INFO:tasks.workunit.client.0.smithi072.stdout:1/533: symlink d1/d11/d18/d19/d1a/d61/d65/la2 0 2024-03-19T06:06:02.098 INFO:tasks.workunit.client.0.smithi072.stdout:8/446: creat da/d37/f94 x:0 0 0 2024-03-19T06:06:02.099 INFO:tasks.workunit.client.0.smithi072.stdout:0/475: dread d1/d1c/d24/d27/d65/f93 [0,4194304] 0 2024-03-19T06:06:02.099 INFO:tasks.workunit.client.0.smithi072.stdout:3/556: getdents d2/d3/d26/d92 0 2024-03-19T06:06:02.101 INFO:tasks.workunit.client.0.smithi072.stdout:8/447: chown da/d27/d52/d88 3589 1 2024-03-19T06:06:02.102 INFO:tasks.workunit.client.0.smithi072.stdout:4/661: dread d5/d1b/f2b [0,4194304] 0 2024-03-19T06:06:02.105 INFO:tasks.workunit.client.0.smithi072.stdout:3/557: dread - d2/d19/f5c zero size 2024-03-19T06:06:02.105 INFO:tasks.workunit.client.0.smithi072.stdout:1/534: symlink d1/d11/d18/d63/la3 0 2024-03-19T06:06:02.108 INFO:tasks.workunit.client.0.smithi072.stdout:4/662: readlink d5/d15/d3f/dc1/l56 0 2024-03-19T06:06:02.108 INFO:tasks.workunit.client.0.smithi072.stdout:3/558: stat d2/d3/d26/l29 0 2024-03-19T06:06:02.110 INFO:tasks.workunit.client.0.smithi072.stdout:8/448: mknod da/d13/d14/d6f/c95 0 2024-03-19T06:06:02.111 INFO:tasks.workunit.client.0.smithi072.stdout:7/432: dread d2/d3/d18/d20/d3a/d50/f76 [0,4194304] 0 2024-03-19T06:06:02.115 INFO:tasks.workunit.client.0.smithi072.stdout:0/476: creat d1/d1c/d24/d27/d65/d85/f94 x:0 0 0 2024-03-19T06:06:02.116 INFO:tasks.workunit.client.0.smithi072.stdout:4/663: creat d5/d15/d31/d7d/d91/ff0 x:0 0 0 2024-03-19T06:06:02.122 INFO:tasks.workunit.client.0.smithi072.stdout:8/449: unlink da/d27/d52/d5b/d3e/d7d/c81 0 2024-03-19T06:06:02.124 INFO:tasks.workunit.client.0.smithi072.stdout:5/652: dwrite df/d54/dac/f6d [0,4194304] 0 2024-03-19T06:06:02.124 INFO:tasks.workunit.client.0.smithi072.stdout:1/535: creat d1/d11/d18/d19/d1a/d3b/fa4 x:0 0 0 2024-03-19T06:06:02.126 INFO:tasks.workunit.client.0.smithi072.stdout:3/559: dread d2/d40/d78/f9a [0,4194304] 0 2024-03-19T06:06:02.129 INFO:tasks.workunit.client.0.smithi072.stdout:9/451: truncate d11/d1f/d2a/d36/d45/d4d/f82 66141 0 2024-03-19T06:06:02.130 INFO:tasks.workunit.client.0.smithi072.stdout:3/560: mkdir d2/dbc 0 2024-03-19T06:06:02.134 INFO:tasks.workunit.client.0.smithi072.stdout:8/450: readlink da/d37/l71 0 2024-03-19T06:06:02.134 INFO:tasks.workunit.client.0.smithi072.stdout:5/653: rmdir df/d13/d32/d28/d42/d59/d43 39 2024-03-19T06:06:02.137 INFO:tasks.workunit.client.0.smithi072.stdout:7/433: dwrite d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/f35 [0,4194304] 0 2024-03-19T06:06:02.147 INFO:tasks.workunit.client.0.smithi072.stdout:0/477: dwrite d1/d1c/d24/d27/d65/d85/f88 [0,4194304] 0 2024-03-19T06:06:02.149 INFO:tasks.workunit.client.0.smithi072.stdout:7/434: chown d2/d3/d18/d33/c1f 1898967 1 2024-03-19T06:06:02.158 INFO:tasks.workunit.client.0.smithi072.stdout:7/435: fdatasync d2/d3/d18/d33/d1d/f81 0 2024-03-19T06:06:02.159 INFO:tasks.workunit.client.0.smithi072.stdout:1/536: dwrite d1/f8d [0,4194304] 0 2024-03-19T06:06:02.161 INFO:tasks.workunit.client.0.smithi072.stdout:9/452: dwrite d11/d24/f48 [0,4194304] 0 2024-03-19T06:06:02.162 INFO:tasks.workunit.client.0.smithi072.stdout:3/561: dwrite d2/d40/d78/f9a [0,4194304] 0 2024-03-19T06:06:02.175 INFO:tasks.workunit.client.0.smithi072.stdout:7/436: mkdir d2/d3/d18/d33/d83 0 2024-03-19T06:06:02.175 INFO:tasks.workunit.client.0.smithi072.stdout:0/478: link d1/c2d d1/d1c/d24/d27/d7e/c95 0 2024-03-19T06:06:02.181 INFO:tasks.workunit.client.0.smithi072.stdout:5/654: dread df/f26 [0,4194304] 0 2024-03-19T06:06:02.185 INFO:tasks.workunit.client.0.smithi072.stdout:9/453: truncate d11/d1f/d2a/d36/d3e/f58 758786 0 2024-03-19T06:06:02.189 INFO:tasks.workunit.client.0.smithi072.stdout:3/562: dwrite d2/d3/f6d [0,4194304] 0 2024-03-19T06:06:02.192 INFO:tasks.workunit.client.0.smithi072.stdout:9/454: read d11/f17 [2014585,73062] 0 2024-03-19T06:06:02.192 INFO:tasks.workunit.client.0.smithi072.stdout:0/479: dread d1/d1c/d24/f86 [0,4194304] 0 2024-03-19T06:06:02.193 INFO:tasks.workunit.client.0.smithi072.stdout:3/563: mkdir d2/d75/dbd 0 2024-03-19T06:06:02.194 INFO:tasks.workunit.client.0.smithi072.stdout:1/537: dwrite d1/d11/d18/d19/d1a/d3b/f6a [0,4194304] 0 2024-03-19T06:06:02.198 INFO:tasks.workunit.client.0.smithi072.stdout:5/655: rename df/d13/d32/d28/d42/d59/d43/d4e/l74 to df/d54/dac/d7e/lca 0 2024-03-19T06:06:02.213 INFO:tasks.workunit.client.0.smithi072.stdout:5/656: truncate df/d13/f5e 5218607 0 2024-03-19T06:06:02.215 INFO:tasks.workunit.client.0.smithi072.stdout:1/538: mknod d1/d11/d18/d19/d1a/d25/d3c/d68/d96/ca5 0 2024-03-19T06:06:02.222 INFO:tasks.workunit.client.0.smithi072.stdout:5/657: symlink df/d13/d32/d28/d42/d59/d43/d62/lcb 0 2024-03-19T06:06:02.222 INFO:tasks.workunit.client.0.smithi072.stdout:3/564: dwrite d2/d3/d15/f67 [0,4194304] 0 2024-03-19T06:06:02.231 INFO:tasks.workunit.client.0.smithi072.stdout:0/480: dwrite d1/d1c/d24/d27/d7c/d6a/f91 [0,4194304] 0 2024-03-19T06:06:02.231 INFO:tasks.workunit.client.0.smithi072.stdout:3/565: truncate d2/d3/d25/f85 734368 0 2024-03-19T06:06:02.232 INFO:tasks.workunit.client.0.smithi072.stdout:0/481: write d1/d1c/d24/d27/d7c/f5a [4334183,51746] 0 2024-03-19T06:06:02.233 INFO:tasks.workunit.client.0.smithi072.stdout:3/566: creat d2/d3/d26/fbe x:0 0 0 2024-03-19T06:06:02.234 INFO:tasks.workunit.client.0.smithi072.stdout:9/455: dwrite d11/d1f/d2a/d36/f40 [0,4194304] 0 2024-03-19T06:06:02.236 INFO:tasks.workunit.client.0.smithi072.stdout:0/482: fsync d1/f5 0 2024-03-19T06:06:02.238 INFO:tasks.workunit.client.0.smithi072.stdout:9/456: fdatasync d11/d1f/d43/f5a 0 2024-03-19T06:06:02.239 INFO:tasks.workunit.client.0.smithi072.stdout:1/539: link d1/d11/d18/c82 d1/d11/d18/d19/d1a/d25/d3c/d68/d96/ca6 0 2024-03-19T06:06:02.239 INFO:tasks.workunit.client.0.smithi072.stdout:3/567: chown d2/d40/c89 156465 1 2024-03-19T06:06:02.248 INFO:tasks.workunit.client.0.smithi072.stdout:3/568: stat d2/d3/d15/d66/d6b/l6e 0 2024-03-19T06:06:02.248 INFO:tasks.workunit.client.0.smithi072.stdout:5/658: dwrite df/d13/d32/d28/d42/f7a [0,4194304] 0 2024-03-19T06:06:02.249 INFO:tasks.workunit.client.0.smithi072.stdout:1/540: rename d1/d11/d18/d19/d70 to d1/d11/d76/da7 0 2024-03-19T06:06:02.253 INFO:tasks.workunit.client.0.smithi072.stdout:3/569: creat d2/d3/d15/d66/d6b/d79/fbf x:0 0 0 2024-03-19T06:06:02.254 INFO:tasks.workunit.client.0.smithi072.stdout:1/541: write d1/d11/d18/d19/d1a/d25/f43 [2758818,119392] 0 2024-03-19T06:06:02.257 INFO:tasks.workunit.client.0.smithi072.stdout:5/659: creat df/fcc x:0 0 0 2024-03-19T06:06:02.257 INFO:tasks.workunit.client.0.smithi072.stdout:3/570: truncate d2/d3/d15/d66/d6b/d79/fbf 458145 0 2024-03-19T06:06:02.257 INFO:tasks.workunit.client.0.smithi072.stdout:1/542: creat d1/fa8 x:0 0 0 2024-03-19T06:06:02.259 INFO:tasks.workunit.client.0.smithi072.stdout:5/660: symlink df/d3c/lcd 0 2024-03-19T06:06:02.260 INFO:tasks.workunit.client.0.smithi072.stdout:3/571: write d2/d3/d15/f67 [701842,68605] 0 2024-03-19T06:06:02.262 INFO:tasks.workunit.client.0.smithi072.stdout:5/661: truncate df/d54/dac/f6d 4333871 0 2024-03-19T06:06:02.265 INFO:tasks.workunit.client.0.smithi072.stdout:1/543: getdents d1/d11/d18/d19/d72 0 2024-03-19T06:06:02.267 INFO:tasks.workunit.client.0.smithi072.stdout:1/544: write d1/f8e [1113891,108312] 0 2024-03-19T06:06:02.268 INFO:tasks.workunit.client.0.smithi072.stdout:3/572: symlink d2/d19/db0/lc0 0 2024-03-19T06:06:02.269 INFO:tasks.workunit.client.0.smithi072.stdout:0/483: write d1/d1c/d24/d27/d7c/f56 [1324248,46948] 0 2024-03-19T06:06:02.276 INFO:tasks.workunit.client.0.smithi072.stdout:1/545: link d1/l87 d1/d11/d18/d19/d1a/d25/d3c/d68/d96/la9 0 2024-03-19T06:06:02.276 INFO:tasks.workunit.client.0.smithi072.stdout:5/662: dread df/d13/d32/d28/d42/f78 [0,4194304] 0 2024-03-19T06:06:02.278 INFO:tasks.workunit.client.0.smithi072.stdout:0/484: link d1/d1c/d24/d27/d7c/f5a d1/d1c/d24/d3f/f96 0 2024-03-19T06:06:02.280 INFO:tasks.workunit.client.0.smithi072.stdout:1/546: mkdir d1/daa 0 2024-03-19T06:06:02.284 INFO:tasks.workunit.client.0.smithi072.stdout:0/485: write d1/d1c/d24/d27/d7c/f5a [1408463,129105] 0 2024-03-19T06:06:02.284 INFO:tasks.workunit.client.0.smithi072.stdout:1/547: creat d1/d11/d76/fab x:0 0 0 2024-03-19T06:06:02.289 INFO:tasks.workunit.client.0.smithi072.stdout:0/486: truncate d1/f58 4739120 0 2024-03-19T06:06:02.292 INFO:tasks.workunit.client.0.smithi072.stdout:1/548: write d1/d11/d18/d63/d73/f8f [972397,108900] 0 2024-03-19T06:06:02.294 INFO:tasks.workunit.client.0.smithi072.stdout:9/457: dwrite d11/d1f/d2a/d36/d45/d4d/f82 [0,4194304] 0 2024-03-19T06:06:02.296 INFO:tasks.workunit.client.0.smithi072.stdout:0/487: creat d1/d1c/d24/f97 x:0 0 0 2024-03-19T06:06:02.297 INFO:tasks.workunit.client.0.smithi072.stdout:1/549: chown d1/d11/d18/d63/la3 59691 1 2024-03-19T06:06:02.300 INFO:tasks.workunit.client.0.smithi072.stdout:5/663: dwrite df/d16/f36 [8388608,4194304] 0 2024-03-19T06:06:02.301 INFO:tasks.workunit.client.0.smithi072.stdout:0/488: truncate d1/f79 561043 0 2024-03-19T06:06:02.307 INFO:tasks.workunit.client.0.smithi072.stdout:5/664: read df/d14/f2f [2281996,19672] 0 2024-03-19T06:06:02.308 INFO:tasks.workunit.client.0.smithi072.stdout:9/458: rename d11/d24/d4c/d6e/l85 to d11/d1f/d2a/d6f/d88/l9c 0 2024-03-19T06:06:02.310 INFO:tasks.workunit.client.0.smithi072.stdout:5/665: write df/d16/f36 [12994722,104549] 0 2024-03-19T06:06:02.313 INFO:tasks.workunit.client.0.smithi072.stdout:1/550: rename d1/d11/d18/d19/d1a/d25/f43 to d1/d11/d18/d19/d1a/d61/fac 0 2024-03-19T06:06:02.314 INFO:tasks.workunit.client.0.smithi072.stdout:1/551: chown d1/d11/c32 89 1 2024-03-19T06:06:02.316 INFO:tasks.workunit.client.0.smithi072.stdout:9/459: creat d11/d24/d4c/d6e/f9d x:0 0 0 2024-03-19T06:06:02.318 INFO:tasks.workunit.client.0.smithi072.stdout:5/666: rename df/d14/d5d/f9d to df/d13/d32/d28/d42/d59/d43/d4e/d5c/fce 0 2024-03-19T06:06:02.320 INFO:tasks.workunit.client.0.smithi072.stdout:1/552: mknod d1/d11/d18/d63/d74/cad 0 2024-03-19T06:06:02.323 INFO:tasks.workunit.client.0.smithi072.stdout:5/667: symlink df/d13/d32/d28/d42/d59/d43/d4e/d5c/lcf 0 2024-03-19T06:06:02.324 INFO:tasks.workunit.client.0.smithi072.stdout:9/460: getdents d11/d24 0 2024-03-19T06:06:02.326 INFO:tasks.workunit.client.0.smithi072.stdout:5/668: write df/d14/f2f [4060732,19242] 0 2024-03-19T06:06:02.330 INFO:tasks.workunit.client.0.smithi072.stdout:1/553: link d1/d11/d18/d19/d72/f7e d1/d11/d18/d19/d1a/d25/d3c/d52/fae 0 2024-03-19T06:06:02.330 INFO:tasks.workunit.client.0.smithi072.stdout:5/669: creat df/d54/fd0 x:0 0 0 2024-03-19T06:06:02.331 INFO:tasks.workunit.client.0.smithi072.stdout:1/554: dread - d1/d11/d18/d19/d1a/d3b/fa4 zero size 2024-03-19T06:06:02.337 INFO:tasks.workunit.client.0.smithi072.stdout:5/670: mknod df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97/cd1 0 2024-03-19T06:06:02.337 INFO:tasks.workunit.client.0.smithi072.stdout:1/555: chown d1/d11/d18/d19/d1a/d25/d3c/d52/f7c 3 1 2024-03-19T06:06:02.341 INFO:tasks.workunit.client.0.smithi072.stdout:0/489: dwrite d1/d1c/d24/d27/d73/f87 [4194304,4194304] 0 2024-03-19T06:06:02.342 INFO:tasks.workunit.client.0.smithi072.stdout:5/671: stat df/d13/d32/d28/d42/d59/d43/d4e/lc1 0 2024-03-19T06:06:02.345 INFO:tasks.workunit.client.0.smithi072.stdout:9/461: dwrite d11/d1f/f3a [4194304,4194304] 0 2024-03-19T06:06:02.346 INFO:tasks.workunit.client.0.smithi072.stdout:1/556: write d1/d11/d18/d19/d72/f7e [1116393,81103] 0 2024-03-19T06:06:02.347 INFO:tasks.workunit.client.0.smithi072.stdout:5/672: creat df/d13/d32/d28/fd2 x:0 0 0 2024-03-19T06:06:02.350 INFO:tasks.workunit.client.0.smithi072.stdout:1/557: write d1/d11/d18/f2e [1801434,68312] 0 2024-03-19T06:06:02.353 INFO:tasks.workunit.client.0.smithi072.stdout:0/490: dread d1/d1c/d24/d27/d7c/f8d [0,4194304] 0 2024-03-19T06:06:02.354 INFO:tasks.workunit.client.0.smithi072.stdout:5/673: creat df/d3c/fd3 x:0 0 0 2024-03-19T06:06:02.361 INFO:tasks.workunit.client.0.smithi072.stdout:0/491: truncate d1/d1c/f4c 872244 0 2024-03-19T06:06:02.366 INFO:tasks.workunit.client.0.smithi072.stdout:0/492: dread d1/f4e [0,4194304] 0 2024-03-19T06:06:02.367 INFO:tasks.workunit.client.0.smithi072.stdout:9/462: truncate d11/d1f/d2a/d36/d45/d4d/f82 1513098 0 2024-03-19T06:06:02.370 INFO:tasks.workunit.client.0.smithi072.stdout:9/463: mkdir d11/d9e 0 2024-03-19T06:06:02.371 INFO:tasks.workunit.client.0.smithi072.stdout:0/493: creat d1/d1c/d24/d27/f98 x:0 0 0 2024-03-19T06:06:02.373 INFO:tasks.workunit.client.0.smithi072.stdout:0/494: chown d1/d1c/d24/d27/d7e 397 1 2024-03-19T06:06:02.373 INFO:tasks.workunit.client.0.smithi072.stdout:1/558: dwrite d1/d11/d18/d19/d1a/d25/d3c/f62 [0,4194304] 0 2024-03-19T06:06:02.374 INFO:tasks.workunit.client.0.smithi072.stdout:0/495: dread - d1/f8c zero size 2024-03-19T06:06:02.376 INFO:tasks.workunit.client.0.smithi072.stdout:9/464: mkdir d11/d1f/d2a/d68/d79/d9f 0 2024-03-19T06:06:02.377 INFO:tasks.workunit.client.0.smithi072.stdout:1/559: rmdir d1/d11 39 2024-03-19T06:06:02.379 INFO:tasks.workunit.client.0.smithi072.stdout:0/496: creat d1/d1c/d24/d27/d73/d80/d8b/f99 x:0 0 0 2024-03-19T06:06:02.382 INFO:tasks.workunit.client.0.smithi072.stdout:9/465: unlink d11/d1f/d2a/d36/d45/f91 0 2024-03-19T06:06:02.383 INFO:tasks.workunit.client.0.smithi072.stdout:1/560: creat d1/d11/d18/d19/d1a/d25/faf x:0 0 0 2024-03-19T06:06:02.383 INFO:tasks.workunit.client.0.smithi072.stdout:0/497: mknod d1/d1c/d24/d27/d7c/d6a/c9a 0 2024-03-19T06:06:02.384 INFO:tasks.workunit.client.0.smithi072.stdout:9/466: symlink d11/d24/la0 0 2024-03-19T06:06:02.385 INFO:tasks.workunit.client.0.smithi072.stdout:0/498: chown d1/d1c/d24/d3f/f96 268 1 2024-03-19T06:06:02.386 INFO:tasks.workunit.client.0.smithi072.stdout:1/561: write d1/d11/d18/d19/d1a/d25/d3c/f62 [164406,74137] 0 2024-03-19T06:06:02.387 INFO:tasks.workunit.client.0.smithi072.stdout:0/499: fsync d1/d1c/d24/d27/d65/f83 0 2024-03-19T06:06:02.390 INFO:tasks.workunit.client.0.smithi072.stdout:1/562: write d1/d11/d18/d19/d1a/d25/faf [968357,12812] 0 2024-03-19T06:06:02.410 INFO:tasks.workunit.client.0.smithi072.stdout:2/567: sync 2024-03-19T06:06:02.410 INFO:tasks.workunit.client.0.smithi072.stdout:6/448: sync 2024-03-19T06:06:02.434 INFO:tasks.workunit.client.0.smithi072.stdout:1/563: mknod d1/d11/d18/d19/d1a/d25/d3c/d68/d96/cb0 0 2024-03-19T06:06:02.441 INFO:tasks.workunit.client.0.smithi072.stdout:2/568: symlink db/d10/d13/d24/d72/d86/lc9 0 2024-03-19T06:06:02.452 INFO:tasks.workunit.client.0.smithi072.stdout:2/569: fdatasync db/fc2 0 2024-03-19T06:06:02.462 INFO:tasks.workunit.client.0.smithi072.stdout:6/449: mkdir d7/d9/d1b/d33/d41/d92 0 2024-03-19T06:06:02.463 INFO:tasks.workunit.client.0.smithi072.stdout:2/570: getdents db/d10/d13/d80 0 2024-03-19T06:06:02.466 INFO:tasks.workunit.client.0.smithi072.stdout:6/450: write d7/d9/d1b/d31/f82 [627596,72447] 0 2024-03-19T06:06:02.467 INFO:tasks.workunit.client.0.smithi072.stdout:1/564: dwrite d1/d11/d18/d19/d1a/f34 [0,4194304] 0 2024-03-19T06:06:02.473 INFO:tasks.workunit.client.0.smithi072.stdout:2/571: fsync db/d10/d2b/d2d/d77/f96 0 2024-03-19T06:06:02.477 INFO:tasks.workunit.client.0.smithi072.stdout:6/451: mknod d7/d3f/d44/c93 0 2024-03-19T06:06:02.480 INFO:tasks.workunit.client.0.smithi072.stdout:6/452: chown d7/d9/d1b/d3b/d48/c83 1564 1 2024-03-19T06:06:02.487 INFO:tasks.workunit.client.0.smithi072.stdout:2/572: rename db/d10/d13/d8e to db/d10/d2b/d2d/d9e/dab/dca 0 2024-03-19T06:06:02.491 INFO:tasks.workunit.client.0.smithi072.stdout:1/565: dwrite d1/d11/d18/d19/d72/d86/f38 [0,4194304] 0 2024-03-19T06:06:02.540 INFO:tasks.workunit.client.0.smithi072.stdout:6/453: write d7/d9/d30/f38 [830455,27335] 0 2024-03-19T06:06:02.543 INFO:tasks.workunit.client.0.smithi072.stdout:6/454: chown d7/d9/d1e/f8d 41797 1 2024-03-19T06:06:02.545 INFO:tasks.workunit.client.0.smithi072.stdout:6/455: fdatasync d7/d9/d1e/f8d 0 2024-03-19T06:06:02.551 INFO:tasks.workunit.client.0.smithi072.stdout:9/467: link d11/f17 d11/d1f/d2a/fa1 0 2024-03-19T06:06:02.553 INFO:tasks.workunit.client.0.smithi072.stdout:6/456: mknod d7/d91/c94 0 2024-03-19T06:06:02.556 INFO:tasks.workunit.client.0.smithi072.stdout:9/468: readlink d11/d1f/d2a/d36/d45/d5b/l47 0 2024-03-19T06:06:02.561 INFO:tasks.workunit.client.0.smithi072.stdout:9/469: creat d11/d1f/d43/fa2 x:0 0 0 2024-03-19T06:06:02.565 INFO:tasks.workunit.client.0.smithi072.stdout:6/457: creat d7/d9/d1b/d3b/f95 x:0 0 0 2024-03-19T06:06:02.575 INFO:tasks.workunit.client.0.smithi072.stdout:6/458: mkdir d7/d9/d1b/d31/d96 0 2024-03-19T06:06:02.581 INFO:tasks.workunit.client.0.smithi072.stdout:6/459: readlink d7/d9/d1e/l20 0 2024-03-19T06:06:02.583 INFO:tasks.workunit.client.0.smithi072.stdout:9/470: dwrite d11/f37 [0,4194304] 0 2024-03-19T06:06:02.586 INFO:tasks.workunit.client.0.smithi072.stdout:6/460: mkdir d7/d2e/d97 0 2024-03-19T06:06:02.607 INFO:tasks.workunit.client.0.smithi072.stdout:6/461: getdents d7/d2e 0 2024-03-19T06:06:02.608 INFO:tasks.workunit.client.0.smithi072.stdout:9/471: truncate d11/d1f/d43/f63 699012 0 2024-03-19T06:06:02.609 INFO:tasks.workunit.client.0.smithi072.stdout:6/462: stat d7/d9/d1b/d31/d96 0 2024-03-19T06:06:02.618 INFO:tasks.workunit.client.0.smithi072.stdout:6/463: unlink d7/d9/d1b/d33/d41/d45/f67 0 2024-03-19T06:06:02.633 INFO:tasks.workunit.client.0.smithi072.stdout:9/472: dwrite d11/d1f/d2a/d36/d45/f4a [0,4194304] 0 2024-03-19T06:06:02.638 INFO:tasks.workunit.client.0.smithi072.stdout:9/473: unlink d11/l8a 0 2024-03-19T06:06:02.644 INFO:tasks.workunit.client.0.smithi072.stdout:9/474: rename d11/d1f/f3a to d11/d4b/d57/fa3 0 2024-03-19T06:06:02.648 INFO:tasks.workunit.client.0.smithi072.stdout:9/475: mkdir d11/d1f/d2a/d6f/d87/da4 0 2024-03-19T06:06:02.649 INFO:tasks.workunit.client.0.smithi072.stdout:9/476: chown d11/d1f/d2a/d68/d92 1373 1 2024-03-19T06:06:02.651 INFO:tasks.workunit.client.0.smithi072.stdout:6/464: dread d7/d9/d1b/d21/f24 [0,4194304] 0 2024-03-19T06:06:02.653 INFO:tasks.workunit.client.0.smithi072.stdout:6/465: mknod d7/d91/d84/c98 0 2024-03-19T06:06:02.655 INFO:tasks.workunit.client.0.smithi072.stdout:6/466: rmdir d7 39 2024-03-19T06:06:02.661 INFO:tasks.workunit.client.0.smithi072.stdout:6/467: rename d7/d2e to d7/d99 0 2024-03-19T06:06:02.672 INFO:tasks.workunit.client.0.smithi072.stdout:9/477: dread d11/d4b/f6a [0,4194304] 0 2024-03-19T06:06:02.674 INFO:tasks.workunit.client.0.smithi072.stdout:6/468: dwrite d7/d3f/f42 [0,4194304] 0 2024-03-19T06:06:02.676 INFO:tasks.workunit.client.0.smithi072.stdout:6/469: write d7/d9/d1b/d33/f74 [4909944,15950] 0 2024-03-19T06:06:02.679 INFO:tasks.workunit.client.0.smithi072.stdout:6/470: fdatasync d7/f1d 0 2024-03-19T06:06:02.682 INFO:tasks.workunit.client.0.smithi072.stdout:6/471: read d7/d9/d1b/f37 [802879,98612] 0 2024-03-19T06:06:02.709 INFO:tasks.workunit.client.0.smithi072.stdout:4/664: sync 2024-03-19T06:06:02.716 INFO:tasks.workunit.client.0.smithi072.stdout:9/478: truncate d11/d1f/d2a/d36/d45/f4a 2239582 0 2024-03-19T06:06:02.725 INFO:tasks.workunit.client.0.smithi072.stdout:4/665: rename d5/d15/d22/d41/d7b/d7c/fe8 to d5/d15/d31/d6f/d9d/ff1 0 2024-03-19T06:06:02.727 INFO:tasks.workunit.client.0.smithi072.stdout:6/472: dwrite d7/d9/d1b/d3b/f95 [0,4194304] 0 2024-03-19T06:06:02.729 INFO:tasks.workunit.client.0.smithi072.stdout:6/473: readlink d7/d91/l7d 0 2024-03-19T06:06:02.730 INFO:tasks.workunit.client.0.smithi072.stdout:9/479: write d11/d1f/d2a/d36/d45/f4a [2245666,89071] 0 2024-03-19T06:06:02.732 INFO:tasks.workunit.client.0.smithi072.stdout:6/474: rmdir d7/d3f 39 2024-03-19T06:06:02.736 INFO:tasks.workunit.client.0.smithi072.stdout:9/480: truncate d11/f1e 2099703 0 2024-03-19T06:06:02.737 INFO:tasks.workunit.client.0.smithi072.stdout:6/475: symlink d7/d3f/d65/l9a 0 2024-03-19T06:06:02.738 INFO:tasks.workunit.client.0.smithi072.stdout:9/481: fsync d11/d1f/d2a/d68/f73 0 2024-03-19T06:06:02.741 INFO:tasks.workunit.client.0.smithi072.stdout:6/476: mkdir d7/d9/d1b/d3b/d9b 0 2024-03-19T06:06:02.743 INFO:tasks.workunit.client.0.smithi072.stdout:9/482: truncate d11/d1f/d2a/fa1 1288241 0 2024-03-19T06:06:02.744 INFO:tasks.workunit.client.0.smithi072.stdout:4/666: truncate d5/d15/d22/d41/d61/fb6 757981 0 2024-03-19T06:06:02.745 INFO:tasks.workunit.client.0.smithi072.stdout:6/477: rmdir d7/d99/d60/d78 39 2024-03-19T06:06:02.746 INFO:tasks.workunit.client.0.smithi072.stdout:4/667: dread - d5/d15/d22/d41/fe5 zero size 2024-03-19T06:06:02.748 INFO:tasks.workunit.client.0.smithi072.stdout:4/668: rmdir d5 39 2024-03-19T06:06:02.752 INFO:tasks.workunit.client.0.smithi072.stdout:4/669: rmdir d5/d15/d31/d6f 39 2024-03-19T06:06:02.754 INFO:tasks.workunit.client.0.smithi072.stdout:6/478: dread d7/d9/d1b/d33/d41/d45/f5c [0,4194304] 0 2024-03-19T06:06:02.755 INFO:tasks.workunit.client.0.smithi072.stdout:4/670: mkdir d5/d15/d3f/df2 0 2024-03-19T06:06:02.759 INFO:tasks.workunit.client.0.smithi072.stdout:9/483: write d11/d1f/d2a/d36/d45/d4d/f9b [843379,2578] 0 2024-03-19T06:06:02.760 INFO:tasks.workunit.client.0.smithi072.stdout:6/479: symlink d7/d9/d1b/d31/d96/l9c 0 2024-03-19T06:06:02.763 INFO:tasks.workunit.client.0.smithi072.stdout:9/484: mkdir d11/d4b/d5c/da5 0 2024-03-19T06:06:02.765 INFO:tasks.workunit.client.0.smithi072.stdout:6/480: creat d7/d9/d2b/d5d/d88/f9d x:0 0 0 2024-03-19T06:06:02.767 INFO:tasks.workunit.client.0.smithi072.stdout:9/485: fdatasync d11/d1f/d2a/d36/f53 0 2024-03-19T06:06:02.775 INFO:tasks.workunit.client.0.smithi072.stdout:6/481: write d7/f15 [502172,99405] 0 2024-03-19T06:06:02.776 INFO:tasks.workunit.client.0.smithi072.stdout:9/486: truncate d11/f44 1821162 0 2024-03-19T06:06:02.780 INFO:tasks.workunit.client.0.smithi072.stdout:9/487: mkdir d11/d1f/d2a/d68/d92/da6 0 2024-03-19T06:06:02.782 INFO:tasks.workunit.client.0.smithi072.stdout:4/671: dread d5/d15/d22/d95/fba [0,4194304] 0 2024-03-19T06:06:02.783 INFO:tasks.workunit.client.0.smithi072.stdout:9/488: fsync d11/d1f/f27 0 2024-03-19T06:06:02.790 INFO:tasks.workunit.client.0.smithi072.stdout:6/482: dread d7/d3f/d44/f3d [0,4194304] 0 2024-03-19T06:06:02.790 INFO:tasks.workunit.client.0.smithi072.stdout:6/483: stat l5 0 2024-03-19T06:06:02.791 INFO:tasks.workunit.client.0.smithi072.stdout:9/489: write d11/f12 [1554289,79610] 0 2024-03-19T06:06:02.793 INFO:tasks.workunit.client.0.smithi072.stdout:6/484: chown d7/d9/d1b/d31/d96/l9c 1 1 2024-03-19T06:06:02.796 INFO:tasks.workunit.client.0.smithi072.stdout:9/490: rename d11/d1f/d2a/d36/l60 to d11/d1f/d2a/d68/d92/la7 0 2024-03-19T06:06:02.797 INFO:tasks.workunit.client.0.smithi072.stdout:6/485: creat d7/d9/d1b/d31/d96/f9e x:0 0 0 2024-03-19T06:06:02.798 INFO:tasks.workunit.client.0.smithi072.stdout:6/486: rename d7 to d7/d3f/d65/d9f 22 2024-03-19T06:06:02.799 INFO:tasks.workunit.client.0.smithi072.stdout:9/491: symlink d11/d1f/d2a/d36/la8 0 2024-03-19T06:06:02.801 INFO:tasks.workunit.client.0.smithi072.stdout:6/487: mknod d7/d9/d1b/d31/ca0 0 2024-03-19T06:06:02.801 INFO:tasks.workunit.client.0.smithi072.stdout:9/492: fsync d11/d1f/d2a/d68/f8e 0 2024-03-19T06:06:02.802 INFO:tasks.workunit.client.0.smithi072.stdout:4/672: dwrite d5/d15/d22/d41/d61/fb6 [0,4194304] 0 2024-03-19T06:06:02.806 INFO:tasks.workunit.client.0.smithi072.stdout:6/488: creat d7/d9/d1b/fa1 x:0 0 0 2024-03-19T06:06:02.807 INFO:tasks.workunit.client.0.smithi072.stdout:6/489: dread - d7/d9/d1e/f7b zero size 2024-03-19T06:06:02.808 INFO:tasks.workunit.client.0.smithi072.stdout:4/673: creat d5/d15/d3f/d42/ff3 x:0 0 0 2024-03-19T06:06:02.810 INFO:tasks.workunit.client.0.smithi072.stdout:6/490: creat d7/d3f/d65/fa2 x:0 0 0 2024-03-19T06:06:02.815 INFO:tasks.workunit.client.0.smithi072.stdout:4/674: rmdir d5/d15/d31/d6f/d9d 39 2024-03-19T06:06:02.815 INFO:tasks.workunit.client.0.smithi072.stdout:6/491: stat d7/d9/fa 0 2024-03-19T06:06:02.818 INFO:tasks.workunit.client.0.smithi072.stdout:4/675: creat d5/d15/d31/d6d/d7a/d8e/ff4 x:0 0 0 2024-03-19T06:06:02.823 INFO:tasks.workunit.client.0.smithi072.stdout:6/492: getdents d7/d9/d1b/d31 0 2024-03-19T06:06:02.825 INFO:tasks.workunit.client.0.smithi072.stdout:6/493: write d7/d9/d2b/f6a [969638,48347] 0 2024-03-19T06:06:02.834 INFO:tasks.workunit.client.0.smithi072.stdout:9/493: dread d11/d4b/d57/f5f [0,4194304] 0 2024-03-19T06:06:02.835 INFO:tasks.workunit.client.0.smithi072.stdout:6/494: dread d7/d9/d1b/d21/f24 [0,4194304] 0 2024-03-19T06:06:02.838 INFO:tasks.workunit.client.0.smithi072.stdout:9/494: creat d11/d9e/fa9 x:0 0 0 2024-03-19T06:06:02.840 INFO:tasks.workunit.client.0.smithi072.stdout:9/495: chown d11/d1f/d43/c96 5 1 2024-03-19T06:06:02.843 INFO:tasks.workunit.client.0.smithi072.stdout:6/495: rename d7/d9/d1b/c6c to d7/d9/d1b/d21/d68/ca3 0 2024-03-19T06:06:02.847 INFO:tasks.workunit.client.0.smithi072.stdout:6/496: write d7/d9/d1e/f8d [59082,129361] 0 2024-03-19T06:06:02.849 INFO:tasks.workunit.client.0.smithi072.stdout:9/496: write d11/d1f/d2a/d36/d45/d4d/f82 [898731,55278] 0 2024-03-19T06:06:02.850 INFO:tasks.workunit.client.0.smithi072.stdout:6/497: mkdir d7/d9/d1b/d3b/d9b/da4 0 2024-03-19T06:06:02.853 INFO:tasks.workunit.client.0.smithi072.stdout:6/498: rmdir d7/d9/d1b/d3b/d9b 39 2024-03-19T06:06:02.853 INFO:tasks.workunit.client.0.smithi072.stdout:4/676: dread d5/d1b/fa7 [0,4194304] 0 2024-03-19T06:06:02.855 INFO:tasks.workunit.client.0.smithi072.stdout:9/497: link d11/d4b/f6a d11/d24/d4c/d64/faa 0 2024-03-19T06:06:02.858 INFO:tasks.workunit.client.0.smithi072.stdout:4/677: rename d5/fa8 to d5/d15/d22/d41/d7b/d7c/db4/dc7/ff5 0 2024-03-19T06:06:02.861 INFO:tasks.workunit.client.0.smithi072.stdout:9/498: creat d11/d1f/d2a/fab x:0 0 0 2024-03-19T06:06:02.867 INFO:tasks.workunit.client.0.smithi072.stdout:4/678: dread d5/d15/d22/d41/d61/f66 [0,4194304] 0 2024-03-19T06:06:02.868 INFO:tasks.workunit.client.0.smithi072.stdout:6/499: dwrite d7/d99/f35 [0,4194304] 0 2024-03-19T06:06:02.870 INFO:tasks.workunit.client.0.smithi072.stdout:4/679: dread - d5/d15/d22/d95/fe2 zero size 2024-03-19T06:06:02.871 INFO:tasks.workunit.client.0.smithi072.stdout:9/499: write d11/f17 [42070,102923] 0 2024-03-19T06:06:02.874 INFO:tasks.workunit.client.0.smithi072.stdout:6/500: rename d7/d9/d2b/d5d to d7/d9/d1b/d3b/d48/da5 0 2024-03-19T06:06:02.875 INFO:tasks.workunit.client.0.smithi072.stdout:6/501: chown d7/d9/c18 79179971 1 2024-03-19T06:06:02.878 INFO:tasks.workunit.client.0.smithi072.stdout:6/502: unlink d7/d91/c94 0 2024-03-19T06:06:02.887 INFO:tasks.workunit.client.0.smithi072.stdout:9/500: write d11/d1f/d2a/d36/f3f [1039886,128156] 0 2024-03-19T06:06:02.889 INFO:tasks.workunit.client.0.smithi072.stdout:6/503: truncate d7/d99/f47 3775128 0 2024-03-19T06:06:02.889 INFO:tasks.workunit.client.0.smithi072.stdout:9/501: chown d11/d24/f30 123067 1 2024-03-19T06:06:02.891 INFO:tasks.workunit.client.0.smithi072.stdout:6/504: truncate d7/f15 1059401 0 2024-03-19T06:06:02.892 INFO:tasks.workunit.client.0.smithi072.stdout:9/502: mkdir d11/d1f/d2a/d6f/dac 0 2024-03-19T06:06:02.894 INFO:tasks.workunit.client.0.smithi072.stdout:6/505: mkdir d7/d9/d1b/d31/da6 0 2024-03-19T06:06:02.894 INFO:tasks.workunit.client.0.smithi072.stdout:9/503: dread - d11/d1f/d2a/d36/f90 zero size 2024-03-19T06:06:02.896 INFO:tasks.workunit.client.0.smithi072.stdout:6/506: creat d7/d9/d2b/fa7 x:0 0 0 2024-03-19T06:06:02.899 INFO:tasks.workunit.client.0.smithi072.stdout:9/504: read d11/d1f/d2a/d36/f3f [504142,112113] 0 2024-03-19T06:06:02.901 INFO:tasks.workunit.client.0.smithi072.stdout:9/505: mknod d11/d4b/d5c/da5/cad 0 2024-03-19T06:06:02.903 INFO:tasks.workunit.client.0.smithi072.stdout:9/506: readlink d11/d1f/d2a/d36/d45/d5b/l47 0 2024-03-19T06:06:02.912 INFO:tasks.workunit.client.0.smithi072.stdout:4/680: dread d5/d15/d31/d6f/fa3 [0,4194304] 0 2024-03-19T06:06:02.912 INFO:tasks.workunit.client.0.smithi072.stdout:6/507: dwrite d7/d3f/d65/f89 [0,4194304] 0 2024-03-19T06:06:02.916 INFO:tasks.workunit.client.0.smithi072.stdout:4/681: write d5/d15/d22/f44 [2946614,42113] 0 2024-03-19T06:06:02.917 INFO:tasks.workunit.client.0.smithi072.stdout:6/508: write d7/d3f/d65/f89 [1342161,63528] 0 2024-03-19T06:06:02.922 INFO:tasks.workunit.client.0.smithi072.stdout:4/682: rename d5/d15/d53 to d5/d15/d3f/d42/df6 0 2024-03-19T06:06:02.924 INFO:tasks.workunit.client.0.smithi072.stdout:9/507: dwrite d11/d1f/d2a/d36/d45/f4a [0,4194304] 0 2024-03-19T06:06:02.924 INFO:tasks.workunit.client.0.smithi072.stdout:8/451: sync 2024-03-19T06:06:02.926 INFO:tasks.workunit.client.0.smithi072.stdout:7/437: sync 2024-03-19T06:06:02.927 INFO:tasks.workunit.client.0.smithi072.stdout:4/683: creat d5/d15/d22/d41/d61/ff7 x:0 0 0 2024-03-19T06:06:02.933 INFO:tasks.workunit.client.0.smithi072.stdout:4/684: stat d5/d1b/dca/ld1 0 2024-03-19T06:06:02.939 INFO:tasks.workunit.client.0.smithi072.stdout:7/438: mkdir d2/d3/d18/d33/d1d/d3b/d63/d84 0 2024-03-19T06:06:02.941 INFO:tasks.workunit.client.0.smithi072.stdout:4/685: write d5/d15/da6/fc0 [1706945,41541] 0 2024-03-19T06:06:02.981 INFO:tasks.workunit.client.0.smithi072.stdout:7/439: unlink d2/d3/d18/d33/d53/f59 0 2024-03-19T06:06:02.981 INFO:tasks.workunit.client.0.smithi072.stdout:6/509: dread d7/d9/d1e/f4d [0,4194304] 0 2024-03-19T06:06:02.983 INFO:tasks.workunit.client.0.smithi072.stdout:4/686: read d5/d15/da6/fc0 [1071553,39112] 0 2024-03-19T06:06:02.985 INFO:tasks.workunit.client.0.smithi072.stdout:7/440: readlink d2/d3/d18/d33/d1d/d2b/d3d/lf 0 2024-03-19T06:06:02.985 INFO:tasks.workunit.client.0.smithi072.stdout:4/687: write d5/d15/d22/fa5 [712618,66678] 0 2024-03-19T06:06:02.988 INFO:tasks.workunit.client.0.smithi072.stdout:7/441: stat d2/d3/d18/d33/d1d/f81 0 2024-03-19T06:06:02.989 INFO:tasks.workunit.client.0.smithi072.stdout:6/510: symlink d7/d9/d1b/d21/la8 0 2024-03-19T06:06:02.991 INFO:tasks.workunit.client.0.smithi072.stdout:6/511: fdatasync d7/d9/d1b/f2a 0 2024-03-19T06:06:02.993 INFO:tasks.workunit.client.0.smithi072.stdout:7/442: mkdir d2/d3/d18/d7f/d85 0 2024-03-19T06:06:02.996 INFO:tasks.workunit.client.0.smithi072.stdout:9/508: dread d11/d24/f30 [0,4194304] 0 2024-03-19T06:06:02.998 INFO:tasks.workunit.client.0.smithi072.stdout:4/688: getdents d5/d15 0 2024-03-19T06:06:02.998 INFO:tasks.workunit.client.0.smithi072.stdout:9/509: read d11/d24/d4c/d64/faa [2200921,83419] 0 2024-03-19T06:06:02.999 INFO:tasks.workunit.client.0.smithi072.stdout:7/443: rmdir d2/d3/d18/d33/d1d/d3b/d63 39 2024-03-19T06:06:03.005 INFO:tasks.workunit.client.0.smithi072.stdout:4/689: creat d5/d15/d31/d4c/ff8 x:0 0 0 2024-03-19T06:06:03.007 INFO:tasks.workunit.client.0.smithi072.stdout:4/690: write d5/d1b/f8d [2435631,109989] 0 2024-03-19T06:06:03.011 INFO:tasks.workunit.client.0.smithi072.stdout:7/444: mkdir d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/d86 0 2024-03-19T06:06:03.013 INFO:tasks.workunit.client.0.smithi072.stdout:6/512: getdents d7/d9/d30 0 2024-03-19T06:06:03.014 INFO:tasks.workunit.client.0.smithi072.stdout:4/691: write d5/d15/d31/d6f/d9d/fe9 [160444,75111] 0 2024-03-19T06:06:03.015 INFO:tasks.workunit.client.0.smithi072.stdout:4/692: fsync d5/fdd 0 2024-03-19T06:06:03.016 INFO:tasks.workunit.client.0.smithi072.stdout:9/510: link d11/d1f/d2a/d36/f3f d11/d78/fae 0 2024-03-19T06:06:03.017 INFO:tasks.workunit.client.0.smithi072.stdout:6/513: write d7/d9/d1b/d3b/f62 [3353320,47920] 0 2024-03-19T06:06:03.019 INFO:tasks.workunit.client.0.smithi072.stdout:6/514: dread - d7/d9/d1b/f7c zero size 2024-03-19T06:06:03.019 INFO:tasks.workunit.client.0.smithi072.stdout:9/511: write d11/d1f/d2a/d36/d45/d4d/f62 [1519493,26147] 0 2024-03-19T06:06:03.023 INFO:tasks.workunit.client.0.smithi072.stdout:4/693: symlink d5/d1b/lf9 0 2024-03-19T06:06:03.026 INFO:tasks.workunit.client.0.smithi072.stdout:6/515: rmdir d7/d9/d1b/d3b 39 2024-03-19T06:06:03.028 INFO:tasks.workunit.client.0.smithi072.stdout:4/694: fdatasync d5/d11/f39 0 2024-03-19T06:06:03.029 INFO:tasks.workunit.client.0.smithi072.stdout:7/445: mknod d2/d3/d18/d20/c87 0 2024-03-19T06:06:03.038 INFO:tasks.workunit.client.0.smithi072.stdout:7/446: mkdir d2/d3/d18/d88 0 2024-03-19T06:06:03.038 INFO:tasks.workunit.client.0.smithi072.stdout:9/512: dwrite d11/d1f/f27 [0,4194304] 0 2024-03-19T06:06:03.046 INFO:tasks.workunit.client.0.smithi072.stdout:9/513: write d11/d24/f48 [772107,81492] 0 2024-03-19T06:06:03.053 INFO:tasks.workunit.client.0.smithi072.stdout:7/447: write d2/d3/d43/f4e [3182988,106577] 0 2024-03-19T06:06:03.054 INFO:tasks.workunit.client.0.smithi072.stdout:4/695: dwrite d5/f8 [0,4194304] 0 2024-03-19T06:06:03.055 INFO:tasks.workunit.client.0.smithi072.stdout:6/516: dwrite d7/d99/f47 [0,4194304] 0 2024-03-19T06:06:03.055 INFO:tasks.workunit.client.0.smithi072.stdout:9/514: rename d11/d1f/d2a/d68/f8e to d11/d24/d4c/d64/faf 0 2024-03-19T06:06:03.059 INFO:tasks.workunit.client.0.smithi072.stdout:4/696: chown d5/d15/d22/d41/d61/f70 13 1 2024-03-19T06:06:03.064 INFO:tasks.workunit.client.0.smithi072.stdout:9/515: write d11/d1f/d2a/d36/d45/d4d/f83 [3358082,90537] 0 2024-03-19T06:06:03.070 INFO:tasks.workunit.client.0.smithi072.stdout:6/517: creat d7/d9/d1b/d3b/d48/fa9 x:0 0 0 2024-03-19T06:06:03.072 INFO:tasks.workunit.client.0.smithi072.stdout:9/516: truncate d11/d1f/d2a/d36/f3f 104476 0 2024-03-19T06:06:03.072 INFO:tasks.workunit.client.0.smithi072.stdout:4/697: getdents d5/d8a 0 2024-03-19T06:06:03.076 INFO:tasks.workunit.client.0.smithi072.stdout:4/698: dread - d5/d15/faf zero size 2024-03-19T06:06:03.078 INFO:tasks.workunit.client.0.smithi072.stdout:6/518: rename d7/d9/d1b/d3b/d48/da5 to d7/d9/d1b/d21/d68/daa 0 2024-03-19T06:06:03.080 INFO:tasks.workunit.client.0.smithi072.stdout:4/699: mkdir d5/d37/de3/dfa 0 2024-03-19T06:06:03.080 INFO:tasks.workunit.client.0.smithi072.stdout:9/517: link d11/d4b/d5c/da5/cad d11/d1f/d2a/d68/d92/cb0 0 2024-03-19T06:06:03.082 INFO:tasks.workunit.client.0.smithi072.stdout:4/700: readlink d5/le 0 2024-03-19T06:06:03.082 INFO:tasks.workunit.client.0.smithi072.stdout:6/519: write d7/d3f/d65/fa2 [921740,127027] 0 2024-03-19T06:06:03.085 INFO:tasks.workunit.client.0.smithi072.stdout:4/701: stat d5/d15/d3f/d42/df6/c9c 0 2024-03-19T06:06:03.086 INFO:tasks.workunit.client.0.smithi072.stdout:7/448: dwrite d2/d3/fd [0,4194304] 0 2024-03-19T06:06:03.089 INFO:tasks.workunit.client.0.smithi072.stdout:4/702: symlink d5/d32/lfb 0 2024-03-19T06:06:03.091 INFO:tasks.workunit.client.0.smithi072.stdout:6/520: mkdir d7/d9/d1b/d3b/d9b/dab 0 2024-03-19T06:06:03.096 INFO:tasks.workunit.client.0.smithi072.stdout:7/449: creat d2/d3/d18/d33/d83/f89 x:0 0 0 2024-03-19T06:06:03.097 INFO:tasks.workunit.client.0.smithi072.stdout:9/518: write d11/f1e [1275006,121918] 0 2024-03-19T06:06:03.098 INFO:tasks.workunit.client.0.smithi072.stdout:6/521: rename d7/d9/d1b/d21/d68/d80/f86 to d7/d9/d1b/d3b/d9b/fac 0 2024-03-19T06:06:03.105 INFO:tasks.workunit.client.0.smithi072.stdout:9/519: symlink d11/d1f/lb1 0 2024-03-19T06:06:03.105 INFO:tasks.workunit.client.0.smithi072.stdout:6/522: creat d7/d99/fad x:0 0 0 2024-03-19T06:06:03.106 INFO:tasks.workunit.client.0.smithi072.stdout:9/520: chown d11/d4b/d57 11917989 1 2024-03-19T06:06:03.108 INFO:tasks.workunit.client.0.smithi072.stdout:9/521: fsync d11/f1b 0 2024-03-19T06:06:03.110 INFO:tasks.workunit.client.0.smithi072.stdout:6/523: symlink d7/d3f/lae 0 2024-03-19T06:06:03.110 INFO:tasks.workunit.client.0.smithi072.stdout:4/703: dwrite d5/d15/d22/d41/d7b/fc9 [0,4194304] 0 2024-03-19T06:06:03.111 INFO:tasks.workunit.client.0.smithi072.stdout:9/522: readlink d11/d4b/d57/l5e 0 2024-03-19T06:06:03.114 INFO:tasks.workunit.client.0.smithi072.stdout:6/524: chown d7/d9/d1b/d3b/d48/fa9 56740 1 2024-03-19T06:06:03.116 INFO:tasks.workunit.client.0.smithi072.stdout:4/704: write d5/d15/d3f/f6b [3071140,32899] 0 2024-03-19T06:06:03.117 INFO:tasks.workunit.client.0.smithi072.stdout:9/523: write d11/d1f/d2a/d36/d45/d5b/f2c [2357762,48307] 0 2024-03-19T06:06:03.117 INFO:tasks.workunit.client.0.smithi072.stdout:6/525: creat d7/d9/d1b/d3b/d48/faf x:0 0 0 2024-03-19T06:06:03.120 INFO:tasks.workunit.client.0.smithi072.stdout:4/705: creat d5/d15/d3f/ffc x:0 0 0 2024-03-19T06:06:03.121 INFO:tasks.workunit.client.0.smithi072.stdout:9/524: creat d11/d78/fb2 x:0 0 0 2024-03-19T06:06:03.123 INFO:tasks.workunit.client.0.smithi072.stdout:6/526: creat d7/d99/fb0 x:0 0 0 2024-03-19T06:06:03.125 INFO:tasks.workunit.client.0.smithi072.stdout:7/450: dread d2/d3/d18/d33/d1d/d2b/d3d/f6a [0,4194304] 0 2024-03-19T06:06:03.127 INFO:tasks.workunit.client.0.smithi072.stdout:9/525: write d11/d1f/d2a/d36/d45/d4d/f83 [1752179,6036] 0 2024-03-19T06:06:03.130 INFO:tasks.workunit.client.0.smithi072.stdout:4/706: rename d5/d1b/f1d to d5/d15/d22/d41/d7b/d7c/db4/ffd 0 2024-03-19T06:06:03.132 INFO:tasks.workunit.client.0.smithi072.stdout:6/527: symlink d7/d9/d1b/d21/d68/daa/d88/lb1 0 2024-03-19T06:06:03.133 INFO:tasks.workunit.client.0.smithi072.stdout:4/707: chown d5/d15/d3f/cb9 3846537 1 2024-03-19T06:06:03.133 INFO:tasks.workunit.client.0.smithi072.stdout:7/451: dread d2/d3/d18/d33/d1d/f46 [0,4194304] 0 2024-03-19T06:06:03.135 INFO:tasks.workunit.client.0.smithi072.stdout:6/528: write d7/d9/d2b/fa7 [956294,107517] 0 2024-03-19T06:06:03.136 INFO:tasks.workunit.client.0.smithi072.stdout:7/452: readlink d2/d3/d18/d33/d1d/d2b/d3d/lf 0 2024-03-19T06:06:03.146 INFO:tasks.workunit.client.0.smithi072.stdout:6/529: mknod d7/d99/d60/d78/d7f/cb2 0 2024-03-19T06:06:03.148 INFO:tasks.workunit.client.0.smithi072.stdout:9/526: dwrite d11/d4b/f52 [4194304,4194304] 0 2024-03-19T06:06:03.154 INFO:tasks.workunit.client.0.smithi072.stdout:6/530: getdents d7/d9/d1b/d31/da6 0 2024-03-19T06:06:03.154 INFO:tasks.workunit.client.0.smithi072.stdout:9/527: chown d11/d24/d4c/c8d 11 1 2024-03-19T06:06:03.158 INFO:tasks.workunit.client.0.smithi072.stdout:4/708: dwrite d5/d11/f1a [4194304,4194304] 0 2024-03-19T06:06:03.162 INFO:tasks.workunit.client.0.smithi072.stdout:9/528: rmdir d11/d1f/d2a/d6f/d88 39 2024-03-19T06:06:03.162 INFO:tasks.workunit.client.0.smithi072.stdout:7/453: dwrite d2/d3/f62 [0,4194304] 0 2024-03-19T06:06:03.166 INFO:tasks.workunit.client.0.smithi072.stdout:6/531: creat d7/d9/d1b/d33/d41/d92/fb3 x:0 0 0 2024-03-19T06:06:03.167 INFO:tasks.workunit.client.0.smithi072.stdout:3/573: sync 2024-03-19T06:06:03.168 INFO:tasks.workunit.client.0.smithi072.stdout:0/500: sync 2024-03-19T06:06:03.168 INFO:tasks.workunit.client.0.smithi072.stdout:5/674: sync 2024-03-19T06:06:03.168 INFO:tasks.workunit.client.0.smithi072.stdout:8/452: sync 2024-03-19T06:06:03.168 INFO:tasks.workunit.client.0.smithi072.stdout:2/573: sync 2024-03-19T06:06:03.168 INFO:tasks.workunit.client.0.smithi072.stdout:1/566: sync 2024-03-19T06:06:03.174 INFO:tasks.workunit.client.0.smithi072.stdout:9/529: mknod d11/d1f/d2a/d68/d79/d9f/cb3 0 2024-03-19T06:06:03.177 INFO:tasks.workunit.client.0.smithi072.stdout:1/567: chown d1/d11/d76 12 1 2024-03-19T06:06:03.180 INFO:tasks.workunit.client.0.smithi072.stdout:0/501: chown d1/l4b 4 1 2024-03-19T06:06:03.184 INFO:tasks.workunit.client.0.smithi072.stdout:4/709: dwrite d5/d11/f39 [0,4194304] 0 2024-03-19T06:06:03.184 INFO:tasks.workunit.client.0.smithi072.stdout:2/574: rmdir db/d10/d13/d24 39 2024-03-19T06:06:03.187 INFO:tasks.workunit.client.0.smithi072.stdout:7/454: rename d2/f4c to d2/d3/d18/d33/d1d/d3b/d63/f8a 0 2024-03-19T06:06:03.188 INFO:tasks.workunit.client.0.smithi072.stdout:0/502: dread - d1/d1c/d24/f97 zero size 2024-03-19T06:06:03.189 INFO:tasks.workunit.client.0.smithi072.stdout:5/675: write df/d13/d32/d28/d42/d59/d43/f5a [5143750,73418] 0 2024-03-19T06:06:03.197 INFO:tasks.workunit.client.0.smithi072.stdout:0/503: mknod d1/d1c/d24/d27/d65/c9b 0 2024-03-19T06:06:03.199 INFO:tasks.workunit.client.0.smithi072.stdout:5/676: write df/d54/dac/f73 [873796,116107] 0 2024-03-19T06:06:03.202 INFO:tasks.workunit.client.0.smithi072.stdout:3/574: write d2/d3/d15/fba [1233740,118889] 0 2024-03-19T06:06:03.208 INFO:tasks.workunit.client.0.smithi072.stdout:9/530: rename d11/d4b/d57/f5f to d11/d1f/d2a/d6f/dac/fb4 0 2024-03-19T06:06:03.212 INFO:tasks.workunit.client.0.smithi072.stdout:4/710: creat d5/d15/d31/d6d/ffe x:0 0 0 2024-03-19T06:06:03.213 INFO:tasks.workunit.client.0.smithi072.stdout:0/504: read d1/d1c/d24/d3f/f96 [1942771,94160] 0 2024-03-19T06:06:03.216 INFO:tasks.workunit.client.0.smithi072.stdout:9/531: rmdir d11/d1f/d2a/d68/d92 39 2024-03-19T06:06:03.222 INFO:tasks.workunit.client.0.smithi072.stdout:6/532: dwrite d7/d9/d1b/d33/d41/f59 [4194304,4194304] 0 2024-03-19T06:06:03.226 INFO:tasks.workunit.client.0.smithi072.stdout:3/575: write d2/d3/d25/f85 [684499,50137] 0 2024-03-19T06:06:03.228 INFO:tasks.workunit.client.0.smithi072.stdout:8/453: dwrite f4 [4194304,4194304] 0 2024-03-19T06:06:03.231 INFO:tasks.workunit.client.0.smithi072.stdout:5/677: write df/d13/d32/d28/d42/f79 [3720,46037] 0 2024-03-19T06:06:03.231 INFO:tasks.workunit.client.0.smithi072.stdout:0/505: dread - d1/d2c/f37 zero size 2024-03-19T06:06:03.233 INFO:tasks.workunit.client.0.smithi072.stdout:4/711: fsync d5/d37/f69 0 2024-03-19T06:06:03.243 INFO:tasks.workunit.client.0.smithi072.stdout:1/568: dwrite d1/d11/d18/d63/d73/f8f [0,4194304] 0 2024-03-19T06:06:03.243 INFO:tasks.workunit.client.0.smithi072.stdout:8/454: stat da/d27/d30/c38 0 2024-03-19T06:06:03.245 INFO:tasks.workunit.client.0.smithi072.stdout:9/532: stat d11/d1f/d2a/d68/d92/la7 0 2024-03-19T06:06:03.247 INFO:tasks.workunit.client.0.smithi072.stdout:7/455: dwrite d2/d3/d43/f4e [0,4194304] 0 2024-03-19T06:06:03.247 INFO:tasks.workunit.client.0.smithi072.stdout:4/712: write d5/d11/f36 [4448264,88612] 0 2024-03-19T06:06:03.255 INFO:tasks.workunit.client.0.smithi072.stdout:2/575: dwrite db/d10/d13/d31/d35/f43 [0,4194304] 0 2024-03-19T06:06:03.260 INFO:tasks.workunit.client.0.smithi072.stdout:0/506: mkdir d1/d1c/d89/d9c 0 2024-03-19T06:06:03.261 INFO:tasks.workunit.client.0.smithi072.stdout:3/576: creat d2/d3/d15/d66/d6b/fc1 x:0 0 0 2024-03-19T06:06:03.266 INFO:tasks.workunit.client.0.smithi072.stdout:1/569: symlink d1/d11/d76/da7/lb1 0 2024-03-19T06:06:03.271 INFO:tasks.workunit.client.0.smithi072.stdout:0/507: mkdir d1/d1c/d89/d9d 0 2024-03-19T06:06:03.271 INFO:tasks.workunit.client.0.smithi072.stdout:4/713: mknod d5/d1b/dd9/cff 0 2024-03-19T06:06:03.275 INFO:tasks.workunit.client.0.smithi072.stdout:9/533: rename d11/d24/d4c/c77 to d11/d1f/d2a/d36/d45/cb5 0 2024-03-19T06:06:03.275 INFO:tasks.workunit.client.0.smithi072.stdout:6/533: dwrite d7/d9/d1b/fa1 [0,4194304] 0 2024-03-19T06:06:03.276 INFO:tasks.workunit.client.0.smithi072.stdout:5/678: getdents df/d54/dac/d7e 0 2024-03-19T06:06:03.279 INFO:tasks.workunit.client.0.smithi072.stdout:1/570: fsync d1/d11/d18/d19/d1a/d61/fac 0 2024-03-19T06:06:03.284 INFO:tasks.workunit.client.0.smithi072.stdout:1/571: read - d1/d11/d76/fab zero size 2024-03-19T06:06:03.287 INFO:tasks.workunit.client.0.smithi072.stdout:6/534: creat d7/d9/d1b/d33/d41/d92/fb4 x:0 0 0 2024-03-19T06:06:03.288 INFO:tasks.workunit.client.0.smithi072.stdout:9/534: mknod d11/d1f/d2a/d36/d3e/cb6 0 2024-03-19T06:06:03.289 INFO:tasks.workunit.client.0.smithi072.stdout:5/679: chown df/d54/dac/d9c/da0/fb6 1140 1 2024-03-19T06:06:03.297 INFO:tasks.workunit.client.0.smithi072.stdout:5/680: truncate df/d13/d32/fa3 4581479 0 2024-03-19T06:06:03.299 INFO:tasks.workunit.client.0.smithi072.stdout:6/535: mkdir d7/d9/d1b/d3b/d9b/da4/db5 0 2024-03-19T06:06:03.302 INFO:tasks.workunit.client.0.smithi072.stdout:1/572: getdents d1/d11 0 2024-03-19T06:06:03.306 INFO:tasks.workunit.client.0.smithi072.stdout:0/508: dwrite d1/f1a [0,4194304] 0 2024-03-19T06:06:03.308 INFO:tasks.workunit.client.0.smithi072.stdout:4/714: truncate d5/d15/da6/fc0 787842 0 2024-03-19T06:06:03.309 INFO:tasks.workunit.client.0.smithi072.stdout:8/455: dread da/f11 [4194304,4194304] 0 2024-03-19T06:06:03.310 INFO:tasks.workunit.client.0.smithi072.stdout:4/715: fsync d5/fdd 0 2024-03-19T06:06:03.321 INFO:tasks.workunit.client.0.smithi072.stdout:6/536: creat d7/d9/fb6 x:0 0 0 2024-03-19T06:06:03.321 INFO:tasks.workunit.client.0.smithi072.stdout:7/456: dread d2/d3/d18/d33/d1d/d2b/f4b [0,4194304] 0 2024-03-19T06:06:03.321 INFO:tasks.workunit.client.0.smithi072.stdout:1/573: write d1/d11/d18/d19/d1a/d25/d3c/f3e [1286558,118511] 0 2024-03-19T06:06:03.322 INFO:tasks.workunit.client.0.smithi072.stdout:4/716: dread - d5/d37/fa1 zero size 2024-03-19T06:06:03.322 INFO:tasks.workunit.client.0.smithi072.stdout:3/577: dread d2/f60 [0,4194304] 0 2024-03-19T06:06:03.324 INFO:tasks.workunit.client.0.smithi072.stdout:8/456: symlink da/d13/d14/d6f/l96 0 2024-03-19T06:06:03.325 INFO:tasks.workunit.client.0.smithi072.stdout:2/576: dwrite db/d10/d2b/d2d/d62/d6b/f9c [0,4194304] 0 2024-03-19T06:06:03.330 INFO:tasks.workunit.client.0.smithi072.stdout:5/681: truncate df/d13/d24/f65 252317 0 2024-03-19T06:06:03.330 INFO:tasks.workunit.client.0.smithi072.stdout:4/717: creat d5/d15/d22/d41/f100 x:0 0 0 2024-03-19T06:06:03.331 INFO:tasks.workunit.client.0.smithi072.stdout:7/457: chown d2/d3/d18/d33/d1d/d2b/f45 161636 1 2024-03-19T06:06:03.336 INFO:tasks.workunit.client.0.smithi072.stdout:0/509: truncate d1/f1a 4917289 0 2024-03-19T06:06:03.340 INFO:tasks.workunit.client.0.smithi072.stdout:7/458: fsync d2/d3/d18/d33/d1d/d2b/d3d/f39 0 2024-03-19T06:06:03.340 INFO:tasks.workunit.client.0.smithi072.stdout:8/457: rename da/d27/d41 to da/d27/d52/d5b/d3e/d7d/d97 0 2024-03-19T06:06:03.342 INFO:tasks.workunit.client.0.smithi072.stdout:9/535: dread d11/f19 [0,4194304] 0 2024-03-19T06:06:03.346 INFO:tasks.workunit.client.0.smithi072.stdout:7/459: chown d2/d3/d18/d3f/c4d 5772374 1 2024-03-19T06:06:03.346 INFO:tasks.workunit.client.0.smithi072.stdout:0/510: mknod d1/d1c/d24/d27/d7c/c9e 0 2024-03-19T06:06:03.346 INFO:tasks.workunit.client.0.smithi072.stdout:2/577: mkdir db/d10/d13/d24/d72/dcb 0 2024-03-19T06:06:03.348 INFO:tasks.workunit.client.0.smithi072.stdout:1/574: getdents d1/d11/d18 0 2024-03-19T06:06:03.350 INFO:tasks.workunit.client.0.smithi072.stdout:4/718: fsync d5/d15/d31/d4c/f75 0 2024-03-19T06:06:03.355 INFO:tasks.workunit.client.0.smithi072.stdout:8/458: chown da/d37/c4d 233 1 2024-03-19T06:06:03.364 INFO:tasks.workunit.client.0.smithi072.stdout:9/536: mknod d11/d1f/d2a/d6f/d88/cb7 0 2024-03-19T06:06:03.364 INFO:tasks.workunit.client.0.smithi072.stdout:8/459: chown da/d13/d14/d1b/c31 52199 1 2024-03-19T06:06:03.366 INFO:tasks.workunit.client.0.smithi072.stdout:2/578: read - db/d10/d2b/d2d/fbc zero size 2024-03-19T06:06:03.366 INFO:tasks.workunit.client.0.smithi072.stdout:5/682: dwrite df/d54/dac/f73 [0,4194304] 0 2024-03-19T06:06:03.367 INFO:tasks.workunit.client.0.smithi072.stdout:0/511: mknod d1/d1c/d24/d27/d73/d80/d8b/c9f 0 2024-03-19T06:06:03.370 INFO:tasks.workunit.client.0.smithi072.stdout:0/512: chown d1/d2c/f41 6208391 1 2024-03-19T06:06:03.371 INFO:tasks.workunit.client.0.smithi072.stdout:2/579: write db/d10/d12/f1b [2706846,5388] 0 2024-03-19T06:06:03.373 INFO:tasks.workunit.client.0.smithi072.stdout:8/460: chown da/d13/d14/d6f/l7e 65 1 2024-03-19T06:06:03.376 INFO:tasks.workunit.client.0.smithi072.stdout:3/578: dwrite d2/d3/d26/f59 [0,4194304] 0 2024-03-19T06:06:03.377 INFO:tasks.workunit.client.0.smithi072.stdout:4/719: getdents d5/d15/d31/d6f/d9d 0 2024-03-19T06:06:03.383 INFO:tasks.workunit.client.0.smithi072.stdout:3/579: chown d2/d3/d26/l5d 24238 1 2024-03-19T06:06:03.384 INFO:tasks.workunit.client.0.smithi072.stdout:1/575: rename d1/d11/d18/d19/d1a/d25/d3c/d52/ca1 to d1/d11/d18/d19/d1a/d25/d3c/d68/d96/cb2 0 2024-03-19T06:06:03.386 INFO:tasks.workunit.client.0.smithi072.stdout:5/683: truncate df/d3c/f35 3556137 0 2024-03-19T06:06:03.387 INFO:tasks.workunit.client.0.smithi072.stdout:8/461: mknod da/d13/d1d/c98 0 2024-03-19T06:06:03.387 INFO:tasks.workunit.client.0.smithi072.stdout:0/513: chown d1/f6f 9565222 1 2024-03-19T06:06:03.393 INFO:tasks.workunit.client.0.smithi072.stdout:3/580: rename d2/d40/c89 to d2/d19/db0/cc2 0 2024-03-19T06:06:03.395 INFO:tasks.workunit.client.0.smithi072.stdout:0/514: write d1/d1c/d24/d27/f98 [353147,91673] 0 2024-03-19T06:06:03.398 INFO:tasks.workunit.client.0.smithi072.stdout:1/576: mknod d1/d11/d18/d19/d72/d86/cb3 0 2024-03-19T06:06:03.400 INFO:tasks.workunit.client.0.smithi072.stdout:8/462: mknod da/d37/c99 0 2024-03-19T06:06:03.401 INFO:tasks.workunit.client.0.smithi072.stdout:8/463: stat da/d27/d52/d5b/d3e/d5a/l59 0 2024-03-19T06:06:03.406 INFO:tasks.workunit.client.0.smithi072.stdout:5/684: write df/d54/dac/d9c/fc3 [373961,43722] 0 2024-03-19T06:06:03.407 INFO:tasks.workunit.client.0.smithi072.stdout:7/460: dread d2/d3/d18/d33/d1d/d2b/d3d/f39 [0,4194304] 0 2024-03-19T06:06:03.407 INFO:tasks.workunit.client.0.smithi072.stdout:0/515: write d1/f79 [117284,10820] 0 2024-03-19T06:06:03.411 INFO:tasks.workunit.client.0.smithi072.stdout:1/577: write d1/d11/d18/d19/d1a/d61/d65/f88 [235099,39397] 0 2024-03-19T06:06:03.411 INFO:tasks.workunit.client.0.smithi072.stdout:8/464: mknod da/d27/d52/d5b/d3e/c9a 0 2024-03-19T06:06:03.413 INFO:tasks.workunit.client.0.smithi072.stdout:2/580: dwrite db/d10/d2b/d2d/d9e/f42 [0,4194304] 0 2024-03-19T06:06:03.417 INFO:tasks.workunit.client.0.smithi072.stdout:8/465: fsync da/f36 0 2024-03-19T06:06:03.422 INFO:tasks.workunit.client.0.smithi072.stdout:3/581: link d2/d40/fa0 d2/d19/d1e/fc3 0 2024-03-19T06:06:03.422 INFO:tasks.workunit.client.0.smithi072.stdout:4/720: dwrite d5/d15/d31/d4c/f75 [0,4194304] 0 2024-03-19T06:06:03.425 INFO:tasks.workunit.client.0.smithi072.stdout:5/685: fdatasync df/d13/d32/d28/d42/d59/d43/d4e/d5c/f7c 0 2024-03-19T06:06:03.425 INFO:tasks.workunit.client.0.smithi072.stdout:1/578: write d1/d11/d18/d19/d1a/d61/f7a [419589,22124] 0 2024-03-19T06:06:03.430 INFO:tasks.workunit.client.0.smithi072.stdout:0/516: read d1/d1c/d24/d27/d7c/f8d [458414,28518] 0 2024-03-19T06:06:03.432 INFO:tasks.workunit.client.0.smithi072.stdout:2/581: creat db/d10/d2b/d2d/d62/d6b/fcc x:0 0 0 2024-03-19T06:06:03.432 INFO:tasks.workunit.client.0.smithi072.stdout:3/582: symlink d2/d3/d15/lc4 0 2024-03-19T06:06:03.433 INFO:tasks.workunit.client.0.smithi072.stdout:4/721: chown d5/d15/d22/d41/d7b/d7c/db4/fcc 696082 1 2024-03-19T06:06:03.435 INFO:tasks.workunit.client.0.smithi072.stdout:1/579: mknod d1/d11/d18/d19/d1a/cb4 0 2024-03-19T06:06:03.437 INFO:tasks.workunit.client.0.smithi072.stdout:9/537: dread d11/d4b/d57/fa3 [0,4194304] 0 2024-03-19T06:06:03.438 INFO:tasks.workunit.client.0.smithi072.stdout:1/580: dread - d1/d11/d76/fab zero size 2024-03-19T06:06:03.439 INFO:tasks.workunit.client.0.smithi072.stdout:3/583: write d2/d3/f6d [2830362,127444] 0 2024-03-19T06:06:03.441 INFO:tasks.workunit.client.0.smithi072.stdout:0/517: unlink d1/d1c/d24/d27/d7c/f71 0 2024-03-19T06:06:03.442 INFO:tasks.workunit.client.0.smithi072.stdout:2/582: mkdir db/d10/d13/d24/d72/d86/dcd 0 2024-03-19T06:06:03.443 INFO:tasks.workunit.client.0.smithi072.stdout:3/584: dread - d2/d3/d26/fbe zero size 2024-03-19T06:06:03.443 INFO:tasks.workunit.client.0.smithi072.stdout:4/722: chown d5/d15/d22/d41/d7b/d7c/db4/lbf 1754869 1 2024-03-19T06:06:03.443 INFO:tasks.workunit.client.0.smithi072.stdout:1/581: fdatasync d1/d11/d18/d19/d1a/d25/d3c/f62 0 2024-03-19T06:06:03.446 INFO:tasks.workunit.client.0.smithi072.stdout:3/585: readlink d2/d3/d15/l54 0 2024-03-19T06:06:03.448 INFO:tasks.workunit.client.0.smithi072.stdout:5/686: write df/d13/f6b [1619795,85093] 0 2024-03-19T06:06:03.450 INFO:tasks.workunit.client.0.smithi072.stdout:4/723: chown d5/d15/d3f/d42/df6/c9c 253 1 2024-03-19T06:06:03.450 INFO:tasks.workunit.client.0.smithi072.stdout:0/518: read d1/d1c/d24/d27/d65/f93 [205084,8356] 0 2024-03-19T06:06:03.452 INFO:tasks.workunit.client.0.smithi072.stdout:3/586: mkdir d2/d40/d78/d9b/dc5 0 2024-03-19T06:06:03.452 INFO:tasks.workunit.client.0.smithi072.stdout:1/582: getdents d1/d11/d18/d63/d73 0 2024-03-19T06:06:03.454 INFO:tasks.workunit.client.0.smithi072.stdout:4/724: chown d5/d15/d3f/ca2 318 1 2024-03-19T06:06:03.459 INFO:tasks.workunit.client.0.smithi072.stdout:9/538: dread d11/d4b/d57/fa3 [4194304,4194304] 0 2024-03-19T06:06:03.461 INFO:tasks.workunit.client.0.smithi072.stdout:9/539: chown d11/f37 1 1 2024-03-19T06:06:03.462 INFO:tasks.workunit.client.0.smithi072.stdout:0/519: link d1/f79 d1/fa0 0 2024-03-19T06:06:03.462 INFO:tasks.workunit.client.0.smithi072.stdout:8/466: dread da/f34 [0,4194304] 0 2024-03-19T06:06:03.464 INFO:tasks.workunit.client.0.smithi072.stdout:4/725: creat d5/d15/d22/d41/d7b/d7c/f101 x:0 0 0 2024-03-19T06:06:03.464 INFO:tasks.workunit.client.0.smithi072.stdout:0/520: fdatasync d1/f5 0 2024-03-19T06:06:03.465 INFO:tasks.workunit.client.0.smithi072.stdout:5/687: truncate df/d13/d32/d28/d42/d59/fc5 601403 0 2024-03-19T06:06:03.466 INFO:tasks.workunit.client.0.smithi072.stdout:2/583: dwrite db/d10/d13/d24/d61/d7d/fb2 [0,4194304] 0 2024-03-19T06:06:03.467 INFO:tasks.workunit.client.0.smithi072.stdout:1/583: getdents d1/d11/d76 0 2024-03-19T06:06:03.468 INFO:tasks.workunit.client.0.smithi072.stdout:8/467: creat da/d3b/f9b x:0 0 0 2024-03-19T06:06:03.472 INFO:tasks.workunit.client.0.smithi072.stdout:5/688: chown df/d13/d32/d28/d42/d59 14549 1 2024-03-19T06:06:03.478 INFO:tasks.workunit.client.0.smithi072.stdout:3/587: dwrite d2/d3/d26/f96 [0,4194304] 0 2024-03-19T06:06:03.479 INFO:tasks.workunit.client.0.smithi072.stdout:1/584: symlink d1/d11/d76/da7/lb5 0 2024-03-19T06:06:03.479 INFO:tasks.workunit.client.0.smithi072.stdout:4/726: mkdir d5/d15/d22/d41/d7b/d7c/db4/dc7/d102 0 2024-03-19T06:06:03.481 INFO:tasks.workunit.client.0.smithi072.stdout:9/540: creat d11/d1f/d2a/d68/d92/d93/fb8 x:0 0 0 2024-03-19T06:06:03.483 INFO:tasks.workunit.client.0.smithi072.stdout:8/468: creat da/d13/d14/d1b/f9c x:0 0 0 2024-03-19T06:06:03.484 INFO:tasks.workunit.client.0.smithi072.stdout:5/689: mknod df/d13/d32/d28/d42/d59/d43/cd4 0 2024-03-19T06:06:03.485 INFO:tasks.workunit.client.0.smithi072.stdout:2/584: truncate db/d10/d13/d24/f5f 2117357 0 2024-03-19T06:06:03.489 INFO:tasks.workunit.client.0.smithi072.stdout:1/585: mkdir d1/d11/d18/d19/d1a/db6 0 2024-03-19T06:06:03.492 INFO:tasks.workunit.client.0.smithi072.stdout:9/541: unlink d11/d1f/d2a/d36/d3e/cb6 0 2024-03-19T06:06:03.495 INFO:tasks.workunit.client.0.smithi072.stdout:8/469: rename da/d13/d1d/c1f to da/d3b/c9d 0 2024-03-19T06:06:03.496 INFO:tasks.workunit.client.0.smithi072.stdout:1/586: write d1/d11/d18/d19/d1a/f90 [617117,89577] 0 2024-03-19T06:06:03.500 INFO:tasks.workunit.client.0.smithi072.stdout:2/585: creat db/d10/d2b/d2d/d9e/d48/d82/d98/fce x:0 0 0 2024-03-19T06:06:03.501 INFO:tasks.workunit.client.0.smithi072.stdout:8/470: write da/d27/f43 [164927,1746] 0 2024-03-19T06:06:03.506 INFO:tasks.workunit.client.0.smithi072.stdout:3/588: link d2/d3/d25/da5/laa d2/d3/d25/lc6 0 2024-03-19T06:06:03.509 INFO:tasks.workunit.client.0.smithi072.stdout:2/586: dread - db/d10/d2b/d2d/d62/d6b/fc8 zero size 2024-03-19T06:06:03.511 INFO:tasks.workunit.client.0.smithi072.stdout:1/587: unlink d1/d11/d18/d19/d1a/d61/d65/l89 0 2024-03-19T06:06:03.511 INFO:tasks.workunit.client.0.smithi072.stdout:3/589: fdatasync d2/d3/d26/f22 0 2024-03-19T06:06:03.515 INFO:tasks.workunit.client.0.smithi072.stdout:8/471: mknod da/d27/c9e 0 2024-03-19T06:06:03.515 INFO:tasks.workunit.client.0.smithi072.stdout:0/521: write d1/d1c/d24/d27/d7c/f8d [661732,100566] 0 2024-03-19T06:06:03.518 INFO:tasks.workunit.client.0.smithi072.stdout:9/542: creat d11/d1f/d2a/d68/fb9 x:0 0 0 2024-03-19T06:06:03.518 INFO:tasks.workunit.client.0.smithi072.stdout:3/590: fsync d2/d19/f52 0 2024-03-19T06:06:03.519 INFO:tasks.workunit.client.0.smithi072.stdout:5/690: dwrite df/d14/f2a [0,4194304] 0 2024-03-19T06:06:03.523 INFO:tasks.workunit.client.0.smithi072.stdout:0/522: truncate d1/d1c/d24/f97 973513 0 2024-03-19T06:06:03.528 INFO:tasks.workunit.client.0.smithi072.stdout:5/691: read df/d14/f15 [1077252,11056] 0 2024-03-19T06:06:03.531 INFO:tasks.workunit.client.0.smithi072.stdout:8/472: rename da/d13/d14/c2c to da/d37/d5c/c9f 0 2024-03-19T06:06:03.532 INFO:tasks.workunit.client.0.smithi072.stdout:1/588: symlink d1/d11/d18/d19/d1a/d3b/lb7 0 2024-03-19T06:06:03.534 INFO:tasks.workunit.client.0.smithi072.stdout:3/591: mknod d2/d40/d78/d9b/cc7 0 2024-03-19T06:06:03.537 INFO:tasks.workunit.client.0.smithi072.stdout:0/523: rename d1/d1c/d24/d27/d65 to d1/d2c/da1 0 2024-03-19T06:06:03.540 INFO:tasks.workunit.client.0.smithi072.stdout:3/592: write d2/d3/d26/f59 [1172497,111962] 0 2024-03-19T06:06:03.544 INFO:tasks.workunit.client.0.smithi072.stdout:4/727: dwrite d5/fa [0,4194304] 0 2024-03-19T06:06:03.547 INFO:tasks.workunit.client.0.smithi072.stdout:9/543: write d11/d1f/d2a/d36/f3f [724292,33247] 0 2024-03-19T06:06:03.547 INFO:tasks.workunit.client.0.smithi072.stdout:3/593: write d2/d3/d26/f59 [3646036,4871] 0 2024-03-19T06:06:03.547 INFO:tasks.workunit.client.0.smithi072.stdout:2/587: dwrite db/d10/d13/d31/f5d [0,4194304] 0 2024-03-19T06:06:03.550 INFO:tasks.workunit.client.0.smithi072.stdout:0/524: creat d1/d1c/d24/d27/fa2 x:0 0 0 2024-03-19T06:06:03.550 INFO:tasks.workunit.client.0.smithi072.stdout:1/589: mkdir d1/d11/d18/d19/d1a/d25/d3c/db8 0 2024-03-19T06:06:03.668 INFO:tasks.workunit.client.0.smithi072.stdout:5/692: truncate df/d13/d32/d28/d42/f7a 1685453 0 2024-03-19T06:06:03.669 INFO:tasks.workunit.client.0.smithi072.stdout:8/473: write da/f36 [5206054,99894] 0 2024-03-19T06:06:03.673 INFO:tasks.workunit.client.0.smithi072.stdout:8/474: chown da/d13/d14/d6f/l96 24648425 1 2024-03-19T06:06:03.683 INFO:tasks.workunit.client.0.smithi072.stdout:5/693: unlink df/lb2 0 2024-03-19T06:06:03.684 INFO:tasks.workunit.client.0.smithi072.stdout:5/694: stat fb 0 2024-03-19T06:06:03.691 INFO:tasks.workunit.client.0.smithi072.stdout:2/588: dread db/d10/f2e [0,4194304] 0 2024-03-19T06:06:03.693 INFO:tasks.workunit.client.0.smithi072.stdout:9/544: dwrite d11/d1f/d43/fa2 [0,4194304] 0 2024-03-19T06:06:03.697 INFO:tasks.workunit.client.0.smithi072.stdout:3/594: dwrite d2/d3/f10 [4194304,4194304] 0 2024-03-19T06:06:03.699 INFO:tasks.workunit.client.0.smithi072.stdout:4/728: dwrite d5/d15/d22/d41/d61/ff7 [0,4194304] 0 2024-03-19T06:06:03.699 INFO:tasks.workunit.client.0.smithi072.stdout:8/475: unlink da/d27/d52/l8b 0 2024-03-19T06:06:03.705 INFO:tasks.workunit.client.0.smithi072.stdout:2/589: write db/d10/d2b/d2d/fbc [678095,67500] 0 2024-03-19T06:06:03.711 INFO:tasks.workunit.client.0.smithi072.stdout:3/595: mkdir d2/dc8 0 2024-03-19T06:06:03.712 INFO:tasks.workunit.client.0.smithi072.stdout:8/476: mknod da/d62/ca0 0 2024-03-19T06:06:03.713 INFO:tasks.workunit.client.0.smithi072.stdout:4/729: symlink d5/d32/d58/l103 0 2024-03-19T06:06:03.716 INFO:tasks.workunit.client.0.smithi072.stdout:9/545: mknod d11/d1f/d2a/cba 0 2024-03-19T06:06:03.723 INFO:tasks.workunit.client.0.smithi072.stdout:3/596: chown d2/d3/d15/d66/d6b/l88 7377999 1 2024-03-19T06:06:03.724 INFO:tasks.workunit.client.0.smithi072.stdout:4/730: mkdir d5/d15/d22/d95/d104 0 2024-03-19T06:06:03.724 INFO:tasks.workunit.client.0.smithi072.stdout:5/695: write df/d13/d32/d28/f81 [3755099,104546] 0 2024-03-19T06:06:03.724 INFO:tasks.workunit.client.0.smithi072.stdout:0/525: dwrite d1/f1b [0,4194304] 0 2024-03-19T06:06:03.727 INFO:tasks.workunit.client.0.smithi072.stdout:1/590: dread d1/d11/d18/f85 [0,4194304] 0 2024-03-19T06:06:03.727 INFO:tasks.workunit.client.0.smithi072.stdout:5/696: dread - df/d13/fb0 zero size 2024-03-19T06:06:03.727 INFO:tasks.workunit.client.0.smithi072.stdout:9/546: creat d11/d4b/d57/fbb x:0 0 0 2024-03-19T06:06:03.737 INFO:tasks.workunit.client.0.smithi072.stdout:5/697: creat df/d54/dac/fd5 x:0 0 0 2024-03-19T06:06:03.737 INFO:tasks.workunit.client.0.smithi072.stdout:0/526: write d1/d1c/d24/f86 [841555,47489] 0 2024-03-19T06:06:03.743 INFO:tasks.workunit.client.0.smithi072.stdout:9/547: read d11/d1f/d2a/d36/d3e/f5d [385689,31817] 0 2024-03-19T06:06:03.750 INFO:tasks.workunit.client.0.smithi072.stdout:3/597: dwrite d2/d3/d26/f59 [0,4194304] 0 2024-03-19T06:06:03.752 INFO:tasks.workunit.client.0.smithi072.stdout:1/591: dread d1/d11/d18/d63/d73/f8f [0,4194304] 0 2024-03-19T06:06:03.753 INFO:tasks.workunit.client.0.smithi072.stdout:4/731: dwrite d5/d15/d3f/fea [0,4194304] 0 2024-03-19T06:06:03.755 INFO:tasks.workunit.client.0.smithi072.stdout:9/548: symlink d11/d1f/d2a/d36/d45/lbc 0 2024-03-19T06:06:03.761 INFO:tasks.workunit.client.0.smithi072.stdout:9/549: write d11/d1f/d2a/d36/d45/d4d/f62 [2250275,129733] 0 2024-03-19T06:06:03.762 INFO:tasks.workunit.client.0.smithi072.stdout:3/598: creat d2/dbc/fc9 x:0 0 0 2024-03-19T06:06:03.763 INFO:tasks.workunit.client.0.smithi072.stdout:4/732: dread - d5/d15/d3f/d42/f67 zero size 2024-03-19T06:06:03.763 INFO:tasks.workunit.client.0.smithi072.stdout:5/698: dwrite df/d13/d32/fa3 [4194304,4194304] 0 2024-03-19T06:06:03.765 INFO:tasks.workunit.client.0.smithi072.stdout:8/477: dread da/d13/d14/f17 [4194304,4194304] 0 2024-03-19T06:06:03.771 INFO:tasks.workunit.client.0.smithi072.stdout:9/550: truncate d11/d1f/d2a/d6f/f94 66538 0 2024-03-19T06:06:03.773 INFO:tasks.workunit.client.0.smithi072.stdout:8/478: write da/d13/d14/f28 [1201031,74541] 0 2024-03-19T06:06:03.775 INFO:tasks.workunit.client.0.smithi072.stdout:3/599: getdents d2/d40/d78/d9b 0 2024-03-19T06:06:03.776 INFO:tasks.workunit.client.0.smithi072.stdout:4/733: truncate d5/d15/d31/d7d/d91/ff0 619214 0 2024-03-19T06:06:03.780 INFO:tasks.workunit.client.0.smithi072.stdout:4/734: chown d5/d15/fcd 60262 1 2024-03-19T06:06:03.784 INFO:tasks.workunit.client.0.smithi072.stdout:3/600: chown d2/d3/c68 40697 1 2024-03-19T06:06:03.784 INFO:tasks.workunit.client.0.smithi072.stdout:1/592: dwrite d1/d11/d18/d19/d1a/f98 [0,4194304] 0 2024-03-19T06:06:03.787 INFO:tasks.workunit.client.0.smithi072.stdout:0/527: dread d1/f5 [0,4194304] 0 2024-03-19T06:06:03.788 INFO:tasks.workunit.client.0.smithi072.stdout:3/601: mknod d2/d3/d25/da5/cca 0 2024-03-19T06:06:03.790 INFO:tasks.workunit.client.0.smithi072.stdout:8/479: mknod da/d13/d14/d1b/ca1 0 2024-03-19T06:06:03.791 INFO:tasks.workunit.client.0.smithi072.stdout:0/528: truncate d1/d1c/d24/f86 1979855 0 2024-03-19T06:06:03.792 INFO:tasks.workunit.client.0.smithi072.stdout:8/480: chown da/d27/f43 19642 1 2024-03-19T06:06:03.792 INFO:tasks.workunit.client.0.smithi072.stdout:1/593: symlink d1/d11/d18/d19/d1a/d25/d3c/db8/lb9 0 2024-03-19T06:06:03.794 INFO:tasks.workunit.client.0.smithi072.stdout:3/602: rename d2/d75/dbd to d2/d19/db0/dcb 0 2024-03-19T06:06:03.794 INFO:tasks.workunit.client.0.smithi072.stdout:0/529: write d1/d2c/da1/d85/f94 [816656,111056] 0 2024-03-19T06:06:03.795 INFO:tasks.workunit.client.0.smithi072.stdout:8/481: write da/d37/f93 [890269,58273] 0 2024-03-19T06:06:03.798 INFO:tasks.workunit.client.0.smithi072.stdout:3/603: dread - d2/d3/d15/d66/d6b/fc1 zero size 2024-03-19T06:06:03.800 INFO:tasks.workunit.client.0.smithi072.stdout:9/551: getdents d11/d1f/d2a/d36/d45 0 2024-03-19T06:06:03.802 INFO:tasks.workunit.client.0.smithi072.stdout:9/552: write d11/f12 [2495350,25305] 0 2024-03-19T06:06:03.803 INFO:tasks.workunit.client.0.smithi072.stdout:8/482: mknod da/d27/d52/d5b/d3e/d7f/ca2 0 2024-03-19T06:06:03.805 INFO:tasks.workunit.client.0.smithi072.stdout:1/594: rename d1/d11/d18/d19/d1a/d25/d3c/f7d to d1/d11/d18/d19/d1a/d25/d3c/d68/d96/fba 0 2024-03-19T06:06:03.807 INFO:tasks.workunit.client.0.smithi072.stdout:9/553: chown d11/d1f/d2a/d36/f3f 543 1 2024-03-19T06:06:03.808 INFO:tasks.workunit.client.0.smithi072.stdout:1/595: fsync d1/d11/d18/d19/f93 0 2024-03-19T06:06:03.815 INFO:tasks.workunit.client.0.smithi072.stdout:8/483: symlink da/d27/d52/d5b/d3e/d5a/d7a/la3 0 2024-03-19T06:06:03.817 INFO:tasks.workunit.client.0.smithi072.stdout:9/554: mknod d11/d24/cbd 0 2024-03-19T06:06:03.819 INFO:tasks.workunit.client.0.smithi072.stdout:1/596: unlink d1/d11/d76/da7/f66 0 2024-03-19T06:06:03.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:03 smithi072 ceph-mon[28706]: pgmap v28: 65 pgs: 65 active+clean; 2.5 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 23 MiB/s rd, 89 MiB/s wr, 218 op/s 2024-03-19T06:06:03.828 INFO:tasks.workunit.client.0.smithi072.stdout:1/597: truncate d1/d11/d76/da7/f77 768329 0 2024-03-19T06:06:03.829 INFO:tasks.workunit.client.0.smithi072.stdout:1/598: truncate d1/f8e 4982535 0 2024-03-19T06:06:03.831 INFO:tasks.workunit.client.0.smithi072.stdout:9/555: creat d11/d1f/d2a/d36/d45/d5b/fbe x:0 0 0 2024-03-19T06:06:03.834 INFO:tasks.workunit.client.0.smithi072.stdout:9/556: stat d11/d78 0 2024-03-19T06:06:03.839 INFO:tasks.workunit.client.0.smithi072.stdout:9/557: readlink d11/d1f/d2a/d36/d45/d5b/l47 0 2024-03-19T06:06:03.841 INFO:tasks.workunit.client.0.smithi072.stdout:3/604: dwrite d2/d3/d26/f23 [8388608,4194304] 0 2024-03-19T06:06:03.841 INFO:tasks.workunit.client.0.smithi072.stdout:0/530: dread d1/d1c/f23 [0,4194304] 0 2024-03-19T06:06:03.842 INFO:tasks.workunit.client.0.smithi072.stdout:8/484: truncate da/d13/d14/f7b 4083610 0 2024-03-19T06:06:03.844 INFO:tasks.workunit.client.0.smithi072.stdout:3/605: chown d2/d3 1 1 2024-03-19T06:06:03.846 INFO:tasks.workunit.client.0.smithi072.stdout:0/531: rmdir d1/d2c/da1/d85 39 2024-03-19T06:06:03.849 INFO:tasks.workunit.client.0.smithi072.stdout:8/485: rmdir da/d37/d5c/d8e/d90 0 2024-03-19T06:06:03.853 INFO:tasks.workunit.client.0.smithi072.stdout:4/735: dread d5/d15/d3f/dc1/f2e [0,4194304] 0 2024-03-19T06:06:03.853 INFO:tasks.workunit.client.0.smithi072.stdout:3/606: mknod d2/d40/d78/ccc 0 2024-03-19T06:06:03.857 INFO:tasks.workunit.client.0.smithi072.stdout:8/486: truncate da/d37/f93 1953891 0 2024-03-19T06:06:03.857 INFO:tasks.workunit.client.0.smithi072.stdout:5/699: dread df/d13/d32/d28/d42/d59/d43/f75 [0,4194304] 0 2024-03-19T06:06:03.859 INFO:tasks.workunit.client.0.smithi072.stdout:8/487: stat da/d37/f94 0 2024-03-19T06:06:03.859 INFO:tasks.workunit.client.0.smithi072.stdout:5/700: chown df/d13/lbb 66613513 1 2024-03-19T06:06:03.861 INFO:tasks.workunit.client.0.smithi072.stdout:3/607: mknod d2/d19/ccd 0 2024-03-19T06:06:03.861 INFO:tasks.workunit.client.0.smithi072.stdout:9/558: write d11/d24/f28 [281515,122117] 0 2024-03-19T06:06:03.862 INFO:tasks.workunit.client.0.smithi072.stdout:0/532: dread d1/d1c/d24/d27/d7c/f8d [0,4194304] 0 2024-03-19T06:06:03.869 INFO:tasks.workunit.client.0.smithi072.stdout:8/488: creat da/d62/d75/d8d/fa4 x:0 0 0 2024-03-19T06:06:03.870 INFO:tasks.workunit.client.0.smithi072.stdout:5/701: mkdir df/d13/d32/d28/dd6 0 2024-03-19T06:06:03.873 INFO:tasks.workunit.client.0.smithi072.stdout:4/736: dwrite d5/d15/d22/d41/d7b/fc9 [0,4194304] 0 2024-03-19T06:06:03.879 INFO:tasks.workunit.client.0.smithi072.stdout:0/533: dread d1/d2c/da1/f83 [0,4194304] 0 2024-03-19T06:06:03.879 INFO:tasks.workunit.client.0.smithi072.stdout:9/559: dread d11/d1f/d2a/d36/f3f [0,4194304] 0 2024-03-19T06:06:03.883 INFO:tasks.workunit.client.0.smithi072.stdout:5/702: rename df/l8c to df/d13/d32/d28/d42/ld7 0 2024-03-19T06:06:03.887 INFO:tasks.workunit.client.0.smithi072.stdout:9/560: creat d11/fbf x:0 0 0 2024-03-19T06:06:03.888 INFO:tasks.workunit.client.0.smithi072.stdout:0/534: symlink d1/d1c/d24/la3 0 2024-03-19T06:06:03.888 INFO:tasks.workunit.client.0.smithi072.stdout:1/599: dread d1/f8e [0,4194304] 0 2024-03-19T06:06:03.890 INFO:tasks.workunit.client.0.smithi072.stdout:3/608: dwrite d2/d3/d25/f39 [4194304,4194304] 0 2024-03-19T06:06:03.891 INFO:tasks.workunit.client.0.smithi072.stdout:5/703: rename df/d3c/fd3 to df/fd8 0 2024-03-19T06:06:03.892 INFO:tasks.workunit.client.0.smithi072.stdout:9/561: fsync d11/d24/d4c/f9a 0 2024-03-19T06:06:03.897 INFO:tasks.workunit.client.0.smithi072.stdout:0/535: creat d1/d1c/d82/d90/fa4 x:0 0 0 2024-03-19T06:06:03.898 INFO:tasks.workunit.client.0.smithi072.stdout:5/704: readlink df/d13/d32/d28/d42/d59/d43/d62/lcb 0 2024-03-19T06:06:03.899 INFO:tasks.workunit.client.0.smithi072.stdout:8/489: dwrite da/d27/d52/d5b/d3e/d7d/d97/f80 [4194304,4194304] 0 2024-03-19T06:06:03.899 INFO:tasks.workunit.client.0.smithi072.stdout:3/609: creat d2/d40/d78/d9b/fce x:0 0 0 2024-03-19T06:06:03.901 INFO:tasks.workunit.client.0.smithi072.stdout:8/490: dread - da/d13/d14/d1b/f9c zero size 2024-03-19T06:06:03.902 INFO:tasks.workunit.client.0.smithi072.stdout:3/610: write d2/d19/f72 [4904281,52030] 0 2024-03-19T06:06:03.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:03 smithi172 ceph-mon[35716]: pgmap v28: 65 pgs: 65 active+clean; 2.5 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 23 MiB/s rd, 89 MiB/s wr, 218 op/s 2024-03-19T06:06:03.906 INFO:tasks.workunit.client.0.smithi072.stdout:9/562: mkdir d11/d1f/d2a/d68/d92/dc0 0 2024-03-19T06:06:03.907 INFO:tasks.workunit.client.0.smithi072.stdout:4/737: truncate d5/d15/d31/d4c/f75 227149 0 2024-03-19T06:06:03.908 INFO:tasks.workunit.client.0.smithi072.stdout:8/491: dread da/d3b/f54 [0,4194304] 0 2024-03-19T06:06:03.908 INFO:tasks.workunit.client.0.smithi072.stdout:3/611: write d2/d19/f6c [1033529,64191] 0 2024-03-19T06:06:03.912 INFO:tasks.workunit.client.0.smithi072.stdout:0/536: mknod d1/d1c/d24/d27/d73/ca5 0 2024-03-19T06:06:03.916 INFO:tasks.workunit.client.0.smithi072.stdout:4/738: write d5/d15/d31/d4c/ff8 [166409,94335] 0 2024-03-19T06:06:03.916 INFO:tasks.workunit.client.0.smithi072.stdout:9/563: symlink d11/d4b/d5c/lc1 0 2024-03-19T06:06:03.919 INFO:tasks.workunit.client.0.smithi072.stdout:1/600: dwrite d1/d11/d76/da7/f77 [0,4194304] 0 2024-03-19T06:06:03.919 INFO:tasks.workunit.client.0.smithi072.stdout:8/492: rename da/l29 to da/d13/d1d/la5 0 2024-03-19T06:06:03.921 INFO:tasks.workunit.client.0.smithi072.stdout:3/612: creat d2/d19/db0/dcb/fcf x:0 0 0 2024-03-19T06:06:03.921 INFO:tasks.workunit.client.0.smithi072.stdout:0/537: write d1/f8c [102480,44546] 0 2024-03-19T06:06:03.926 INFO:tasks.workunit.client.0.smithi072.stdout:9/564: mknod d11/cc2 0 2024-03-19T06:06:03.926 INFO:tasks.workunit.client.0.smithi072.stdout:0/538: read d1/d1c/d24/d27/d7c/f8d [47097,91886] 0 2024-03-19T06:06:03.928 INFO:tasks.workunit.client.0.smithi072.stdout:8/493: mknod da/d27/d52/d5b/d3e/d7f/ca6 0 2024-03-19T06:06:03.928 INFO:tasks.workunit.client.0.smithi072.stdout:9/565: write d11/f37 [9410816,65967] 0 2024-03-19T06:06:03.929 INFO:tasks.workunit.client.0.smithi072.stdout:4/739: dread d5/d15/d31/d6f/d9d/fe9 [0,4194304] 0 2024-03-19T06:06:03.929 INFO:tasks.workunit.client.0.smithi072.stdout:1/601: mknod d1/d11/d18/d19/d1a/d61/d65/cbb 0 2024-03-19T06:06:03.930 INFO:tasks.workunit.client.0.smithi072.stdout:3/613: chown d2/d3/d25/lc6 5154 1 2024-03-19T06:06:03.934 INFO:tasks.workunit.client.0.smithi072.stdout:8/494: write da/d27/d52/d5b/d3e/d7d/d97/f80 [4995637,65034] 0 2024-03-19T06:06:03.934 INFO:tasks.workunit.client.0.smithi072.stdout:3/614: stat d2/d3/d15/d66/d6b/db2/fb4 0 2024-03-19T06:06:03.939 INFO:tasks.workunit.client.0.smithi072.stdout:8/495: readlink da/d13/d14/d1b/l56 0 2024-03-19T06:06:03.939 INFO:tasks.workunit.client.0.smithi072.stdout:1/602: rename d1/d11/d18/d19/d1a/f90 to d1/d11/d76/da7/d9e/fbc 0 2024-03-19T06:06:03.941 INFO:tasks.workunit.client.0.smithi072.stdout:1/603: dread - d1/fa8 zero size 2024-03-19T06:06:03.945 INFO:tasks.workunit.client.0.smithi072.stdout:5/705: dread df/d13/d32/d28/d42/f7a [0,4194304] 0 2024-03-19T06:06:03.945 INFO:tasks.workunit.client.0.smithi072.stdout:1/604: readlink d1/d11/d18/l5d 0 2024-03-19T06:06:03.945 INFO:tasks.workunit.client.0.smithi072.stdout:8/496: mkdir da/d3b/da7 0 2024-03-19T06:06:03.947 INFO:tasks.workunit.client.0.smithi072.stdout:4/740: getdents d5/d15/d31/d4c 0 2024-03-19T06:06:03.951 INFO:tasks.workunit.client.0.smithi072.stdout:8/497: symlink da/d13/d14/d6f/la8 0 2024-03-19T06:06:03.953 INFO:tasks.workunit.client.0.smithi072.stdout:0/539: dread d1/d2c/f41 [0,4194304] 0 2024-03-19T06:06:03.954 INFO:tasks.workunit.client.0.smithi072.stdout:1/605: truncate d1/f6 904132 0 2024-03-19T06:06:03.957 INFO:tasks.workunit.client.0.smithi072.stdout:9/566: dwrite d11/d1f/f66 [0,4194304] 0 2024-03-19T06:06:03.958 INFO:tasks.workunit.client.0.smithi072.stdout:5/706: write df/d13/d32/d28/d42/d59/d43/d4e/d5c/fce [1044202,71687] 0 2024-03-19T06:06:03.959 INFO:tasks.workunit.client.0.smithi072.stdout:8/498: write da/d13/d14/d1b/f9c [297240,57372] 0 2024-03-19T06:06:03.960 INFO:tasks.workunit.client.0.smithi072.stdout:1/606: fsync d1/d11/d76/f9d 0 2024-03-19T06:06:03.961 INFO:tasks.workunit.client.0.smithi072.stdout:3/615: dwrite d2/d3/f6d [0,4194304] 0 2024-03-19T06:06:03.966 INFO:tasks.workunit.client.0.smithi072.stdout:0/540: mkdir d1/d1c/d89/d9c/da6 0 2024-03-19T06:06:03.969 INFO:tasks.workunit.client.0.smithi072.stdout:9/567: write d11/d1f/d2a/d6f/dac/fb4 [3192900,72799] 0 2024-03-19T06:06:03.975 INFO:tasks.workunit.client.0.smithi072.stdout:0/541: creat d1/d1c/d89/d9c/fa7 x:0 0 0 2024-03-19T06:06:03.977 INFO:tasks.workunit.client.0.smithi072.stdout:9/568: mknod d11/d78/cc3 0 2024-03-19T06:06:03.981 INFO:tasks.workunit.client.0.smithi072.stdout:3/616: write d2/d19/d1e/f6f [868816,90645] 0 2024-03-19T06:06:03.982 INFO:tasks.workunit.client.0.smithi072.stdout:0/542: fdatasync d1/d1c/f43 0 2024-03-19T06:06:03.983 INFO:tasks.workunit.client.0.smithi072.stdout:9/569: truncate d11/d1f/d2a/f72 269025 0 2024-03-19T06:06:03.987 INFO:tasks.workunit.client.0.smithi072.stdout:3/617: unlink d2/d3/d15/c7a 0 2024-03-19T06:06:03.989 INFO:tasks.workunit.client.0.smithi072.stdout:9/570: readlink d11/d1f/d2a/d68/d92/la7 0 2024-03-19T06:06:03.994 INFO:tasks.workunit.client.0.smithi072.stdout:0/543: mkdir d1/d1c/d24/d27/d73/d80/da8 0 2024-03-19T06:06:03.995 INFO:tasks.workunit.client.0.smithi072.stdout:3/618: symlink d2/d3/d26/d98/ld0 0 2024-03-19T06:06:03.998 INFO:tasks.workunit.client.0.smithi072.stdout:5/707: dwrite df/d14/d5d/f51 [0,4194304] 0 2024-03-19T06:06:03.998 INFO:tasks.workunit.client.0.smithi072.stdout:1/607: dwrite d1/f8e [0,4194304] 0 2024-03-19T06:06:03.999 INFO:tasks.workunit.client.0.smithi072.stdout:8/499: dwrite da/f51 [0,4194304] 0 2024-03-19T06:06:04.004 INFO:tasks.workunit.client.0.smithi072.stdout:0/544: symlink d1/d1c/d89/d9d/la9 0 2024-03-19T06:06:04.008 INFO:tasks.workunit.client.0.smithi072.stdout:8/500: rmdir da/d27/d52/d5b/d3e/d5a 39 2024-03-19T06:06:04.008 INFO:tasks.workunit.client.0.smithi072.stdout:4/741: dread d5/ff [0,4194304] 0 2024-03-19T06:06:04.009 INFO:tasks.workunit.client.0.smithi072.stdout:3/619: link d2/d3/d15/l17 d2/d40/d78/ld1 0 2024-03-19T06:06:04.011 INFO:tasks.workunit.client.0.smithi072.stdout:0/545: mkdir d1/d1c/d24/d27/d7c/daa 0 2024-03-19T06:06:04.012 INFO:tasks.workunit.client.0.smithi072.stdout:5/708: truncate df/d13/d32/d28/d42/d59/d43/d4e/d5c/fae 349559 0 2024-03-19T06:06:04.016 INFO:tasks.workunit.client.0.smithi072.stdout:4/742: chown d5/d15/d22/d41/c79 438091017 1 2024-03-19T06:06:04.016 INFO:tasks.workunit.client.0.smithi072.stdout:3/620: fdatasync d2/fb1 0 2024-03-19T06:06:04.017 INFO:tasks.workunit.client.0.smithi072.stdout:8/501: chown da/d27/d52/d5b/d3e/d5a/f49 366 1 2024-03-19T06:06:04.021 INFO:tasks.workunit.client.0.smithi072.stdout:0/546: creat d1/d1c/d24/d27/d73/d80/d8b/fab x:0 0 0 2024-03-19T06:06:04.021 INFO:tasks.workunit.client.0.smithi072.stdout:7/461: sync 2024-03-19T06:06:04.021 INFO:tasks.workunit.client.0.smithi072.stdout:6/537: sync 2024-03-19T06:06:04.023 INFO:tasks.workunit.client.0.smithi072.stdout:1/608: dwrite d1/d11/f1c [0,4194304] 0 2024-03-19T06:06:04.024 INFO:tasks.workunit.client.0.smithi072.stdout:9/571: dwrite d11/d1f/d43/f5a [0,4194304] 0 2024-03-19T06:06:04.025 INFO:tasks.workunit.client.0.smithi072.stdout:8/502: truncate da/f2d 777741 0 2024-03-19T06:06:04.025 INFO:tasks.workunit.client.0.smithi072.stdout:0/547: dread - d1/d2c/f37 zero size 2024-03-19T06:06:04.028 INFO:tasks.workunit.client.0.smithi072.stdout:3/621: truncate d2/d3/d15/d66/d70/f9f 117432 0 2024-03-19T06:06:04.032 INFO:tasks.workunit.client.0.smithi072.stdout:3/622: stat d2/l1d 0 2024-03-19T06:06:04.032 INFO:tasks.workunit.client.0.smithi072.stdout:4/743: creat d5/f105 x:0 0 0 2024-03-19T06:06:04.032 INFO:tasks.workunit.client.0.smithi072.stdout:8/503: stat da/d27/d52/d5b/l4c 0 2024-03-19T06:06:04.032 INFO:tasks.workunit.client.0.smithi072.stdout:5/709: getdents df/d54/dac/d9c/da0 0 2024-03-19T06:06:04.035 INFO:tasks.workunit.client.0.smithi072.stdout:3/623: stat d2/d19/c3f 0 2024-03-19T06:06:04.037 INFO:tasks.workunit.client.0.smithi072.stdout:9/572: creat d11/d1f/d2a/d36/d45/fc4 x:0 0 0 2024-03-19T06:06:04.040 INFO:tasks.workunit.client.0.smithi072.stdout:8/504: write da/d27/d52/d5b/f6e [359920,102130] 0 2024-03-19T06:06:04.052 INFO:tasks.workunit.client.0.smithi072.stdout:0/548: mknod d1/d1c/d24/d27/d7c/daa/cac 0 2024-03-19T06:06:04.052 INFO:tasks.workunit.client.0.smithi072.stdout:9/573: mkdir d11/d1f/d2a/d6f/d88/dc5 0 2024-03-19T06:06:04.053 INFO:tasks.workunit.client.0.smithi072.stdout:7/462: dread d2/d3/d17/f69 [0,4194304] 0 2024-03-19T06:06:04.056 INFO:tasks.workunit.client.0.smithi072.stdout:9/574: chown d11/d1f/f3d 224886 1 2024-03-19T06:06:04.057 INFO:tasks.workunit.client.0.smithi072.stdout:0/549: chown d1/d1c/d24/d27/d73/d80/d8b/l61 808 1 2024-03-19T06:06:04.057 INFO:tasks.workunit.client.0.smithi072.stdout:7/463: chown d2/d3/d18/d33/d1d/d2b/c7b 1055 1 2024-03-19T06:06:04.058 INFO:tasks.workunit.client.0.smithi072.stdout:6/538: dwrite d7/d9/d1b/fa1 [0,4194304] 0 2024-03-19T06:06:04.063 INFO:tasks.workunit.client.0.smithi072.stdout:9/575: chown d11/d1f/d2a/d36/d45/d5b/l33 43022 1 2024-03-19T06:06:04.064 INFO:tasks.workunit.client.0.smithi072.stdout:1/609: link d1/d11/d18/d19/d1a/d61/d65/la2 d1/d11/d18/d63/d73/lbd 0 2024-03-19T06:06:04.065 INFO:tasks.workunit.client.0.smithi072.stdout:3/624: dread d2/d3/d15/f4c [0,4194304] 0 2024-03-19T06:06:04.066 INFO:tasks.workunit.client.0.smithi072.stdout:0/550: creat d1/d1c/fad x:0 0 0 2024-03-19T06:06:04.067 INFO:tasks.workunit.client.0.smithi072.stdout:6/539: creat d7/d9/d30/fb7 x:0 0 0 2024-03-19T06:06:04.072 INFO:tasks.workunit.client.0.smithi072.stdout:6/540: rmdir d7/d99/d60 39 2024-03-19T06:06:04.073 INFO:tasks.workunit.client.0.smithi072.stdout:0/551: write d1/d2c/da1/f83 [1528186,23981] 0 2024-03-19T06:06:04.073 INFO:tasks.workunit.client.0.smithi072.stdout:8/505: dwrite da/f50 [4194304,4194304] 0 2024-03-19T06:06:04.078 INFO:tasks.workunit.client.0.smithi072.stdout:7/464: mkdir d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/d8b 0 2024-03-19T06:06:04.079 INFO:tasks.workunit.client.0.smithi072.stdout:8/506: chown da/d13/d14/d1b/d57 5 1 2024-03-19T06:06:04.081 INFO:tasks.workunit.client.0.smithi072.stdout:8/507: write f4 [4296889,82890] 0 2024-03-19T06:06:04.085 INFO:tasks.workunit.client.0.smithi072.stdout:7/465: read d2/d3/d18/d20/d3a/f5c [330316,94817] 0 2024-03-19T06:06:04.085 INFO:tasks.workunit.client.0.smithi072.stdout:6/541: mknod d7/d9/d1b/d21/cb8 0 2024-03-19T06:06:04.085 INFO:tasks.workunit.client.0.smithi072.stdout:4/744: truncate d5/d15/d31/d6d/f82 3526543 0 2024-03-19T06:06:04.090 INFO:tasks.workunit.client.0.smithi072.stdout:8/508: symlink da/d62/la9 0 2024-03-19T06:06:04.092 INFO:tasks.workunit.client.0.smithi072.stdout:7/466: mkdir d2/d8c 0 2024-03-19T06:06:04.092 INFO:tasks.workunit.client.0.smithi072.stdout:9/576: dread d11/d1f/d2a/d36/d45/d4d/f82 [0,4194304] 0 2024-03-19T06:06:04.094 INFO:tasks.workunit.client.0.smithi072.stdout:1/610: rename d1/d11/d18/d19/d1a/d25/d3c/d68/d96/fba to d1/d11/d18/d19/d1a/d25/d3c/fbe 0 2024-03-19T06:06:04.095 INFO:tasks.workunit.client.0.smithi072.stdout:6/542: write d7/d9/d1b/d33/d41/f59 [9355776,28060] 0 2024-03-19T06:06:04.099 INFO:tasks.workunit.client.0.smithi072.stdout:7/467: unlink d2/d3/d18/d3f/c6e 0 2024-03-19T06:06:04.101 INFO:tasks.workunit.client.0.smithi072.stdout:6/543: unlink d7/d9/c6f 0 2024-03-19T06:06:04.106 INFO:tasks.workunit.client.0.smithi072.stdout:2/590: sync 2024-03-19T06:06:04.107 INFO:tasks.workunit.client.0.smithi072.stdout:8/509: mkdir da/d13/d14/d1b/d6b/daa 0 2024-03-19T06:06:04.111 INFO:tasks.workunit.client.0.smithi072.stdout:1/611: write d1/d11/d18/d63/d73/f8f [4742715,63750] 0 2024-03-19T06:06:04.112 INFO:tasks.workunit.client.0.smithi072.stdout:3/625: dwrite d2/d19/d1e/fc3 [0,4194304] 0 2024-03-19T06:06:04.117 INFO:tasks.workunit.client.0.smithi072.stdout:5/710: dwrite df/d13/d24/f65 [0,4194304] 0 2024-03-19T06:06:04.119 INFO:tasks.workunit.client.0.smithi072.stdout:0/552: dwrite d1/d1c/d24/d3f/f74 [0,4194304] 0 2024-03-19T06:06:04.120 INFO:tasks.workunit.client.0.smithi072.stdout:9/577: creat d11/d1f/d2a/d36/d45/d4d/fc6 x:0 0 0 2024-03-19T06:06:04.124 INFO:tasks.workunit.client.0.smithi072.stdout:7/468: write d2/f66 [4093389,81219] 0 2024-03-19T06:06:04.124 INFO:tasks.workunit.client.0.smithi072.stdout:2/591: chown db/d10/d2b/d2d/d9e/f42 15505 1 2024-03-19T06:06:04.127 INFO:tasks.workunit.client.0.smithi072.stdout:6/544: mknod d7/d9/d1b/d31/cb9 0 2024-03-19T06:06:04.133 INFO:tasks.workunit.client.0.smithi072.stdout:9/578: chown d11/d1f/d2a/d36/d45/d4d/c8f 33205 1 2024-03-19T06:06:04.136 INFO:tasks.workunit.client.0.smithi072.stdout:2/592: dread - db/d10/d2b/d2d/d9e/dab/dca/fc5 zero size 2024-03-19T06:06:04.136 INFO:tasks.workunit.client.0.smithi072.stdout:4/745: dwrite d5/fdd [0,4194304] 0 2024-03-19T06:06:04.139 INFO:tasks.workunit.client.0.smithi072.stdout:3/626: creat d2/d3/d15/d66/d6b/db2/fd2 x:0 0 0 2024-03-19T06:06:04.141 INFO:tasks.workunit.client.0.smithi072.stdout:5/711: creat df/d54/dac/fd9 x:0 0 0 2024-03-19T06:06:04.142 INFO:tasks.workunit.client.0.smithi072.stdout:1/612: creat d1/daa/fbf x:0 0 0 2024-03-19T06:06:04.142 INFO:tasks.workunit.client.0.smithi072.stdout:0/553: dread d1/d1c/f43 [0,4194304] 0 2024-03-19T06:06:04.145 INFO:tasks.workunit.client.0.smithi072.stdout:5/712: stat df/l4b 0 2024-03-19T06:06:04.147 INFO:tasks.workunit.client.0.smithi072.stdout:8/510: getdents da/d13/d14 0 2024-03-19T06:06:04.151 INFO:tasks.workunit.client.0.smithi072.stdout:7/469: rename d2/d3/d18/d33/d1d/d2b/d3d/l54 to d2/d3/d17/l8d 0 2024-03-19T06:06:04.151 INFO:tasks.workunit.client.0.smithi072.stdout:4/746: getdents d5/d37/de3/dfa 0 2024-03-19T06:06:04.154 INFO:tasks.workunit.client.0.smithi072.stdout:2/593: creat db/d10/d2b/fcf x:0 0 0 2024-03-19T06:06:04.154 INFO:tasks.workunit.client.0.smithi072.stdout:0/554: dread d1/d1c/f7d [0,4194304] 0 2024-03-19T06:06:04.155 INFO:tasks.workunit.client.0.smithi072.stdout:7/470: readlink d2/d3/d18/l73 0 2024-03-19T06:06:04.156 INFO:tasks.workunit.client.0.smithi072.stdout:4/747: dread - d5/d15/d22/d41/fe5 zero size 2024-03-19T06:06:04.156 INFO:tasks.workunit.client.0.smithi072.stdout:5/713: rename df/d13/d32/d28/dd6 to df/d13/d32/d28/dda 0 2024-03-19T06:06:04.157 INFO:tasks.workunit.client.0.smithi072.stdout:7/471: write d2/d3/f62 [3221335,18270] 0 2024-03-19T06:06:04.159 INFO:tasks.workunit.client.0.smithi072.stdout:3/627: link d2/d19/f53 d2/d19/db0/dcb/fd3 0 2024-03-19T06:06:04.163 INFO:tasks.workunit.client.0.smithi072.stdout:5/714: fsync df/d54/fb5 0 2024-03-19T06:06:04.163 INFO:tasks.workunit.client.0.smithi072.stdout:3/628: dread - d2/d3/d26/fbe zero size 2024-03-19T06:06:04.167 INFO:tasks.workunit.client.0.smithi072.stdout:5/715: chown df/d13/fb0 86700328 1 2024-03-19T06:06:04.167 INFO:tasks.workunit.client.0.smithi072.stdout:9/579: dwrite d11/f37 [0,4194304] 0 2024-03-19T06:06:04.168 INFO:tasks.workunit.client.0.smithi072.stdout:7/472: mknod d2/d3/d18/d20/d3a/c8e 0 2024-03-19T06:06:04.170 INFO:tasks.workunit.client.0.smithi072.stdout:9/580: readlink d11/d1f/d2a/d68/l80 0 2024-03-19T06:06:04.171 INFO:tasks.workunit.client.0.smithi072.stdout:0/555: rmdir d1/d2c/da1/d85 39 2024-03-19T06:06:04.172 INFO:tasks.workunit.client.0.smithi072.stdout:1/613: truncate d1/d11/d18/d19/d1a/d61/fac 2056271 0 2024-03-19T06:06:04.172 INFO:tasks.workunit.client.0.smithi072.stdout:8/511: truncate da/f50 3354389 0 2024-03-19T06:06:04.175 INFO:tasks.workunit.client.0.smithi072.stdout:3/629: truncate d2/f5 1914273 0 2024-03-19T06:06:04.177 INFO:tasks.workunit.client.0.smithi072.stdout:5/716: creat df/d16/dc4/fdb x:0 0 0 2024-03-19T06:06:04.178 INFO:tasks.workunit.client.0.smithi072.stdout:7/473: mknod d2/d3/d18/d33/c8f 0 2024-03-19T06:06:04.183 INFO:tasks.workunit.client.0.smithi072.stdout:0/556: creat d1/d1c/d24/d27/d7c/daa/fae x:0 0 0 2024-03-19T06:06:04.184 INFO:tasks.workunit.client.0.smithi072.stdout:8/512: symlink da/d37/d5c/d8e/lab 0 2024-03-19T06:06:04.187 INFO:tasks.workunit.client.0.smithi072.stdout:9/581: rename d11/d4b/d5c/da5 to d11/d1f/d2a/d68/d79/d9f/dc7 0 2024-03-19T06:06:04.188 INFO:tasks.workunit.client.0.smithi072.stdout:4/748: getdents d5/d15/d3f/dc1 0 2024-03-19T06:06:04.190 INFO:tasks.workunit.client.0.smithi072.stdout:3/630: truncate d2/d3/d15/d66/d6b/db2/fd2 847369 0 2024-03-19T06:06:04.190 INFO:tasks.workunit.client.0.smithi072.stdout:7/474: symlink d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/l90 0 2024-03-19T06:06:04.191 INFO:tasks.workunit.client.0.smithi072.stdout:2/594: dwrite db/d10/d2b/d2d/d9e/dab/dca/fb5 [0,4194304] 0 2024-03-19T06:06:04.193 INFO:tasks.workunit.client.0.smithi072.stdout:7/475: chown d2/d3/d18/d7f 4090231 1 2024-03-19T06:06:04.194 INFO:tasks.workunit.client.0.smithi072.stdout:8/513: fdatasync da/d13/d14/d1b/f9c 0 2024-03-19T06:06:04.194 INFO:tasks.workunit.client.0.smithi072.stdout:4/749: chown d5/d15/d73/l77 3 1 2024-03-19T06:06:04.199 INFO:tasks.workunit.client.0.smithi072.stdout:3/631: creat d2/d40/d78/fd4 x:0 0 0 2024-03-19T06:06:04.201 INFO:tasks.workunit.client.0.smithi072.stdout:2/595: chown db/d10/d2b/d2d/d62 1426 1 2024-03-19T06:06:04.201 INFO:tasks.workunit.client.0.smithi072.stdout:9/582: write d11/d1f/d2a/d36/d45/d4d/f9b [5024161,33578] 0 2024-03-19T06:06:04.202 INFO:tasks.workunit.client.0.smithi072.stdout:0/557: write d1/fa0 [1178852,2957] 0 2024-03-19T06:06:04.202 INFO:tasks.workunit.client.0.smithi072.stdout:8/514: mkdir da/d13/d3f/dac 0 2024-03-19T06:06:04.206 INFO:tasks.workunit.client.0.smithi072.stdout:4/750: creat d5/d15/d22/d41/d7b/d7c/db4/dc7/d102/f106 x:0 0 0 2024-03-19T06:06:04.207 INFO:tasks.workunit.client.0.smithi072.stdout:5/717: dwrite df/fcc [0,4194304] 0 2024-03-19T06:06:04.210 INFO:tasks.workunit.client.0.smithi072.stdout:8/515: creat da/d13/d3f/fad x:0 0 0 2024-03-19T06:06:04.211 INFO:tasks.workunit.client.0.smithi072.stdout:2/596: dread - db/d10/d2b/d45/da4/fb7 zero size 2024-03-19T06:06:04.213 INFO:tasks.workunit.client.0.smithi072.stdout:3/632: rename d2/d3/d26/l29 to d2/d75/ld5 0 2024-03-19T06:06:04.215 INFO:tasks.workunit.client.0.smithi072.stdout:9/583: creat d11/d1f/d2a/d36/fc8 x:0 0 0 2024-03-19T06:06:04.216 INFO:tasks.workunit.client.0.smithi072.stdout:0/558: write d1/d2c/da1/f93 [286935,31784] 0 2024-03-19T06:06:04.217 INFO:tasks.workunit.client.0.smithi072.stdout:2/597: readlink db/d10/d2b/d2d/d62/la3 0 2024-03-19T06:06:04.222 INFO:tasks.workunit.client.0.smithi072.stdout:8/516: read da/d3b/f54 [23703,119229] 0 2024-03-19T06:06:04.223 INFO:tasks.workunit.client.0.smithi072.stdout:2/598: unlink db/d10/d12/f14 0 2024-03-19T06:06:04.225 INFO:tasks.workunit.client.0.smithi072.stdout:9/584: creat d11/d24/fc9 x:0 0 0 2024-03-19T06:06:04.225 INFO:tasks.workunit.client.0.smithi072.stdout:5/718: mknod df/d54/dac/d9c/cdc 0 2024-03-19T06:06:04.226 INFO:tasks.workunit.client.0.smithi072.stdout:0/559: unlink d1/d1c/d24/d27/c30 0 2024-03-19T06:06:04.228 INFO:tasks.workunit.client.0.smithi072.stdout:3/633: link d2/d3/d26/cae d2/d3/d15/d66/d70/cd6 0 2024-03-19T06:06:04.232 INFO:tasks.workunit.client.0.smithi072.stdout:8/517: creat da/d13/d3f/fae x:0 0 0 2024-03-19T06:06:04.237 INFO:tasks.workunit.client.0.smithi072.stdout:7/476: dwrite d2/d3/d18/d33/d1d/d2b/d3d/f6a [0,4194304] 0 2024-03-19T06:06:04.237 INFO:tasks.workunit.client.0.smithi072.stdout:4/751: dwrite d5/d15/d31/d7d/d91/fe7 [0,4194304] 0 2024-03-19T06:06:04.240 INFO:tasks.workunit.client.0.smithi072.stdout:3/634: fdatasync d2/d19/f5c 0 2024-03-19T06:06:04.240 INFO:tasks.workunit.client.0.smithi072.stdout:0/560: creat d1/d1c/d24/d27/d7c/faf x:0 0 0 2024-03-19T06:06:04.241 INFO:tasks.workunit.client.0.smithi072.stdout:7/477: dread - d2/d3/d17/f77 zero size 2024-03-19T06:06:04.245 INFO:tasks.workunit.client.0.smithi072.stdout:5/719: write df/f17 [2868556,127723] 0 2024-03-19T06:06:04.250 INFO:tasks.workunit.client.0.smithi072.stdout:4/752: fdatasync d5/d15/d22/d95/fba 0 2024-03-19T06:06:04.252 INFO:tasks.workunit.client.0.smithi072.stdout:2/599: rename db/d10/d13/d31/c73 to db/d10/d2b/d2d/d62/cd0 0 2024-03-19T06:06:04.255 INFO:tasks.workunit.client.0.smithi072.stdout:8/518: truncate da/d13/d14/d1b/f78 959004 0 2024-03-19T06:06:04.255 INFO:tasks.workunit.client.0.smithi072.stdout:7/478: write d2/d3/d18/d33/d1d/d2b/f4b [2016201,102447] 0 2024-03-19T06:06:04.257 INFO:tasks.workunit.client.0.smithi072.stdout:0/561: mknod d1/d1c/d24/d27/d73/d80/d8b/cb0 0 2024-03-19T06:06:04.258 INFO:tasks.workunit.client.0.smithi072.stdout:2/600: fdatasync db/d10/d2b/d2d/d62/d6b/f9c 0 2024-03-19T06:06:04.259 INFO:tasks.workunit.client.0.smithi072.stdout:4/753: creat d5/d15/d73/f107 x:0 0 0 2024-03-19T06:06:04.261 INFO:tasks.workunit.client.0.smithi072.stdout:8/519: chown da/d27/d52/d5b/d3e/d5a 3602 1 2024-03-19T06:06:04.263 INFO:tasks.workunit.client.0.smithi072.stdout:2/601: stat db/d10/d13/f26 0 2024-03-19T06:06:04.266 INFO:tasks.workunit.client.0.smithi072.stdout:0/562: getdents d1 0 2024-03-19T06:06:04.270 INFO:tasks.workunit.client.0.smithi072.stdout:3/635: dread d2/d3/d26/f59 [0,4194304] 0 2024-03-19T06:06:04.273 INFO:tasks.workunit.client.0.smithi072.stdout:8/520: truncate da/d13/d14/f7b 2337627 0 2024-03-19T06:06:04.273 INFO:tasks.workunit.client.0.smithi072.stdout:0/563: write d1/f4e [761252,65477] 0 2024-03-19T06:06:04.275 INFO:tasks.workunit.client.0.smithi072.stdout:8/521: fdatasync da/d3b/f9b 0 2024-03-19T06:06:04.275 INFO:tasks.workunit.client.0.smithi072.stdout:4/754: truncate d5/d15/d22/d41/d7b/d7c/db4/dc7/ff5 404015 0 2024-03-19T06:06:04.278 INFO:tasks.workunit.client.0.smithi072.stdout:8/522: write f4 [3498398,24831] 0 2024-03-19T06:06:04.278 INFO:tasks.workunit.client.0.smithi072.stdout:4/755: fsync d5/d15/d22/d95/fe2 0 2024-03-19T06:06:04.281 INFO:tasks.workunit.client.0.smithi072.stdout:5/720: truncate df/d13/d32/d28/d42/d59/d43/f5a 1514575 0 2024-03-19T06:06:04.282 INFO:tasks.workunit.client.0.smithi072.stdout:8/523: write da/d13/d14/d6f/f84 [3072916,78736] 0 2024-03-19T06:06:04.286 INFO:tasks.workunit.client.0.smithi072.stdout:4/756: mknod d5/d15/d31/d6f/d9d/c108 0 2024-03-19T06:06:04.287 INFO:tasks.workunit.client.0.smithi072.stdout:8/524: chown da/d13/d3f/fae 16040240 1 2024-03-19T06:06:04.288 INFO:tasks.workunit.client.0.smithi072.stdout:7/479: dwrite d2/d3/d18/d20/d3a/f5c [0,4194304] 0 2024-03-19T06:06:04.288 INFO:tasks.workunit.client.0.smithi072.stdout:0/564: write d1/d1c/d24/d3f/f76 [3982797,120611] 0 2024-03-19T06:06:04.293 INFO:tasks.workunit.client.0.smithi072.stdout:0/565: fsync d1/f5 0 2024-03-19T06:06:04.296 INFO:tasks.workunit.client.0.smithi072.stdout:8/525: chown da/d27/d52/d5b/c91 2700 1 2024-03-19T06:06:04.298 INFO:tasks.workunit.client.0.smithi072.stdout:8/526: chown da/f2d 1 1 2024-03-19T06:06:04.299 INFO:tasks.workunit.client.0.smithi072.stdout:8/527: fdatasync da/d3b/f83 0 2024-03-19T06:06:04.300 INFO:tasks.workunit.client.0.smithi072.stdout:4/757: rename d5/d15/d31/d6d/d7a/d8e/ff4 to d5/d15/d22/d41/d7b/d7c/db4/f109 0 2024-03-19T06:06:04.302 INFO:tasks.workunit.client.0.smithi072.stdout:8/528: chown da/d13/d14/d1b/d6b 996348272 1 2024-03-19T06:06:04.302 INFO:tasks.workunit.client.0.smithi072.stdout:2/602: dread db/d10/d13/d31/f70 [0,4194304] 0 2024-03-19T06:06:04.303 INFO:tasks.workunit.client.0.smithi072.stdout:4/758: readlink d5/d32/d58/l103 0 2024-03-19T06:06:04.304 INFO:tasks.workunit.client.0.smithi072.stdout:5/721: dread df/d14/d5d/f51 [0,4194304] 0 2024-03-19T06:06:04.306 INFO:tasks.workunit.client.0.smithi072.stdout:5/722: fsync df/d13/d32/d28/fb7 0 2024-03-19T06:06:04.307 INFO:tasks.workunit.client.0.smithi072.stdout:2/603: write db/d10/d2b/d45/da4/fb7 [810772,15329] 0 2024-03-19T06:06:04.307 INFO:tasks.workunit.client.0.smithi072.stdout:8/529: rename da/d13/d14/f60 to da/d27/faf 0 2024-03-19T06:06:04.313 INFO:tasks.workunit.client.0.smithi072.stdout:2/604: mkdir db/d10/d2b/d45/da4/dd1 0 2024-03-19T06:06:04.319 INFO:tasks.workunit.client.0.smithi072.stdout:5/723: write df/d13/d32/d28/f37 [3319502,28004] 0 2024-03-19T06:06:04.319 INFO:tasks.workunit.client.0.smithi072.stdout:0/566: dwrite d1/d1c/d24/d27/d7c/f8d [0,4194304] 0 2024-03-19T06:06:04.327 INFO:tasks.workunit.client.0.smithi072.stdout:0/567: rmdir d1/d1c/d82 39 2024-03-19T06:06:04.330 INFO:tasks.workunit.client.0.smithi072.stdout:0/568: write d1/f8c [359162,129414] 0 2024-03-19T06:06:04.341 INFO:tasks.workunit.client.0.smithi072.stdout:8/530: dwrite da/d27/d52/d5b/d3e/d5a/d7a/f86 [0,4194304] 0 2024-03-19T06:06:04.344 INFO:tasks.workunit.client.0.smithi072.stdout:2/605: dwrite db/d10/d2b/f4a [0,4194304] 0 2024-03-19T06:06:04.345 INFO:tasks.workunit.client.0.smithi072.stdout:4/759: dread d5/d1b/f33 [0,4194304] 0 2024-03-19T06:06:04.345 INFO:tasks.workunit.client.0.smithi072.stdout:0/569: write d1/d1c/d24/d27/d7c/d6a/f91 [1481590,58702] 0 2024-03-19T06:06:04.350 INFO:tasks.workunit.client.0.smithi072.stdout:8/531: write da/d37/f93 [1868141,76917] 0 2024-03-19T06:06:04.350 INFO:tasks.workunit.client.0.smithi072.stdout:0/570: rmdir d1 39 2024-03-19T06:06:04.351 INFO:tasks.workunit.client.0.smithi072.stdout:5/724: dwrite df/d13/d32/d28/d42/d59/d43/d4e/d5c/fce [0,4194304] 0 2024-03-19T06:06:04.352 INFO:tasks.workunit.client.0.smithi072.stdout:4/760: chown d5/d15/d31/d4c/f75 902249255 1 2024-03-19T06:06:04.355 INFO:tasks.workunit.client.0.smithi072.stdout:2/606: creat db/d10/d13/fd2 x:0 0 0 2024-03-19T06:06:04.358 INFO:tasks.workunit.client.0.smithi072.stdout:8/532: mkdir da/d37/db0 0 2024-03-19T06:06:04.364 INFO:tasks.workunit.client.0.smithi072.stdout:5/725: rmdir df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85 39 2024-03-19T06:06:04.366 INFO:tasks.workunit.client.0.smithi072.stdout:8/533: unlink da/d3b/f83 0 2024-03-19T06:06:04.367 INFO:tasks.workunit.client.0.smithi072.stdout:2/607: chown db/d10/d2b/c4e 88536 1 2024-03-19T06:06:04.373 INFO:tasks.workunit.client.0.smithi072.stdout:5/726: creat df/d13/d32/d28/d42/d59/d43/d4e/fdd x:0 0 0 2024-03-19T06:06:04.373 INFO:tasks.workunit.client.0.smithi072.stdout:8/534: fdatasync da/d37/f6c 0 2024-03-19T06:06:04.378 INFO:tasks.workunit.client.0.smithi072.stdout:0/571: dwrite d1/fb [0,4194304] 0 2024-03-19T06:06:04.381 INFO:tasks.workunit.client.0.smithi072.stdout:8/535: readlink da/d27/d52/d5b/d3e/l5f 0 2024-03-19T06:06:04.384 INFO:tasks.workunit.client.0.smithi072.stdout:0/572: creat d1/fb1 x:0 0 0 2024-03-19T06:06:04.388 INFO:tasks.workunit.client.0.smithi072.stdout:8/536: rename da/d13/d3f/fae to da/d27/d52/d5b/d3e/d7d/fb1 0 2024-03-19T06:06:04.390 INFO:tasks.workunit.client.0.smithi072.stdout:5/727: rmdir df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97 39 2024-03-19T06:06:04.392 INFO:tasks.workunit.client.0.smithi072.stdout:5/728: chown df/d13/d32/d28/f37 65244687 1 2024-03-19T06:06:04.393 INFO:tasks.workunit.client.0.smithi072.stdout:8/537: creat da/d27/fb2 x:0 0 0 2024-03-19T06:06:04.397 INFO:tasks.workunit.client.0.smithi072.stdout:8/538: creat da/d27/d52/d5b/fb3 x:0 0 0 2024-03-19T06:06:04.397 INFO:tasks.workunit.client.0.smithi072.stdout:4/761: dread d5/d15/d22/d41/d61/fb6 [0,4194304] 0 2024-03-19T06:06:04.400 INFO:tasks.workunit.client.0.smithi072.stdout:8/539: symlink da/d62/d75/lb4 0 2024-03-19T06:06:04.400 INFO:tasks.workunit.client.0.smithi072.stdout:4/762: chown d5/d37/d52/ldb 1593361909 1 2024-03-19T06:06:04.402 INFO:tasks.workunit.client.0.smithi072.stdout:2/608: dread db/d10/d13/d24/d61/d7d/fa5 [0,4194304] 0 2024-03-19T06:06:04.403 INFO:tasks.workunit.client.0.smithi072.stdout:0/573: rename d1/fa0 to d1/d1c/d24/d27/d73/fb2 0 2024-03-19T06:06:04.404 INFO:tasks.workunit.client.0.smithi072.stdout:8/540: fdatasync da/d27/d52/d5b/fb3 0 2024-03-19T06:06:04.405 INFO:tasks.workunit.client.0.smithi072.stdout:5/729: dread df/d16/dc4/fc7 [0,4194304] 0 2024-03-19T06:06:04.409 INFO:tasks.workunit.client.0.smithi072.stdout:2/609: unlink db/d10/d2b/d2d/d62/d6b/c83 0 2024-03-19T06:06:04.410 INFO:tasks.workunit.client.0.smithi072.stdout:4/763: link d5/d15/d3f/dc1/cd2 d5/d32/d58/c10a 0 2024-03-19T06:06:04.411 INFO:tasks.workunit.client.0.smithi072.stdout:2/610: write db/d10/d59/f8d [3055952,72538] 0 2024-03-19T06:06:04.412 INFO:tasks.workunit.client.0.smithi072.stdout:4/764: write d5/d11/f36 [4137905,10428] 0 2024-03-19T06:06:04.417 INFO:tasks.workunit.client.0.smithi072.stdout:8/541: rename da/d13/d14/d1b/l32 to da/d13/d14/d1b/d57/lb5 0 2024-03-19T06:06:04.418 INFO:tasks.workunit.client.0.smithi072.stdout:8/542: readlink da/d13/d14/d6f/la8 0 2024-03-19T06:06:04.421 INFO:tasks.workunit.client.0.smithi072.stdout:5/730: creat df/d13/d32/d28/d42/d59/d43/d4e/d5c/fde x:0 0 0 2024-03-19T06:06:04.422 INFO:tasks.workunit.client.0.smithi072.stdout:5/731: stat df/d54/fb5 0 2024-03-19T06:06:04.422 INFO:tasks.workunit.client.0.smithi072.stdout:0/574: creat d1/d1c/d24/d27/d73/d80/fb3 x:0 0 0 2024-03-19T06:06:04.425 INFO:tasks.workunit.client.0.smithi072.stdout:8/543: creat da/d13/d3f/dac/fb6 x:0 0 0 2024-03-19T06:06:04.429 INFO:tasks.workunit.client.0.smithi072.stdout:5/732: creat df/d13/d32/d28/d42/d59/d43/d4e/dbd/fdf x:0 0 0 2024-03-19T06:06:04.431 INFO:tasks.workunit.client.0.smithi072.stdout:5/733: dread - df/d13/d32/d28/f99 zero size 2024-03-19T06:06:04.436 INFO:tasks.workunit.client.0.smithi072.stdout:0/575: write d1/d2c/f52 [756100,8072] 0 2024-03-19T06:06:04.439 INFO:tasks.workunit.client.0.smithi072.stdout:5/734: mknod df/d13/d32/d28/d42/d59/d43/d4e/d5c/ce0 0 2024-03-19T06:06:04.440 INFO:tasks.workunit.client.0.smithi072.stdout:4/765: dread d5/d1b/fa7 [0,4194304] 0 2024-03-19T06:06:04.441 INFO:tasks.workunit.client.0.smithi072.stdout:2/611: dread db/d10/d13/f26 [0,4194304] 0 2024-03-19T06:06:04.447 INFO:tasks.workunit.client.0.smithi072.stdout:4/766: unlink d5/d15/d22/d41/fe5 0 2024-03-19T06:06:04.449 INFO:tasks.workunit.client.0.smithi072.stdout:2/612: creat db/d10/d13/d24/d61/d7d/fd3 x:0 0 0 2024-03-19T06:06:04.451 INFO:tasks.workunit.client.0.smithi072.stdout:8/544: dwrite da/d27/faf [0,4194304] 0 2024-03-19T06:06:04.453 INFO:tasks.workunit.client.0.smithi072.stdout:8/545: readlink da/l15 0 2024-03-19T06:06:04.459 INFO:tasks.workunit.client.0.smithi072.stdout:0/576: dwrite d1/d1c/fad [0,4194304] 0 2024-03-19T06:06:04.465 INFO:tasks.workunit.client.0.smithi072.stdout:0/577: fdatasync d1/d1c/d24/d27/d7c/f56 0 2024-03-19T06:06:04.465 INFO:tasks.workunit.client.0.smithi072.stdout:5/735: dwrite df/d13/f5e [0,4194304] 0 2024-03-19T06:06:04.474 INFO:tasks.workunit.client.0.smithi072.stdout:0/578: stat d1/f5 0 2024-03-19T06:06:04.474 INFO:tasks.workunit.client.0.smithi072.stdout:4/767: dwrite d5/d15/d73/f107 [0,4194304] 0 2024-03-19T06:06:04.474 INFO:tasks.workunit.client.0.smithi072.stdout:5/736: readlink df/d13/l83 0 2024-03-19T06:06:04.477 INFO:tasks.workunit.client.0.smithi072.stdout:5/737: chown df/d13/f56 15050709 1 2024-03-19T06:06:04.481 INFO:tasks.workunit.client.0.smithi072.stdout:0/579: fsync d1/d2c/f37 0 2024-03-19T06:06:04.484 INFO:tasks.workunit.client.0.smithi072.stdout:4/768: creat d5/d37/de3/f10b x:0 0 0 2024-03-19T06:06:04.491 INFO:tasks.workunit.client.0.smithi072.stdout:0/580: symlink d1/d1c/d24/d27/d73/d80/lb4 0 2024-03-19T06:06:04.492 INFO:tasks.workunit.client.0.smithi072.stdout:2/613: dwrite db/d10/d2b/d2d/d9e/d48/f7b [0,4194304] 0 2024-03-19T06:06:04.496 INFO:tasks.workunit.client.0.smithi072.stdout:0/581: chown d1/d1c/d24/d27/d7c/d6a 0 1 2024-03-19T06:06:04.499 INFO:tasks.workunit.client.0.smithi072.stdout:4/769: rename d5/d15/d3f/d42/df6 to d5/d15/d31/d7d/d91/d10c 0 2024-03-19T06:06:04.501 INFO:tasks.workunit.client.0.smithi072.stdout:2/614: write db/d10/f2e [1948667,52926] 0 2024-03-19T06:06:04.503 INFO:tasks.workunit.client.0.smithi072.stdout:0/582: read d1/d1c/f7d [93427,60657] 0 2024-03-19T06:06:04.504 INFO:tasks.workunit.client.0.smithi072.stdout:4/770: fsync d5/d15/d22/d41/d61/f70 0 2024-03-19T06:06:04.505 INFO:tasks.workunit.client.0.smithi072.stdout:5/738: dwrite df/d13/d32/d28/d42/f6a [0,4194304] 0 2024-03-19T06:06:04.507 INFO:tasks.workunit.client.0.smithi072.stdout:4/771: chown d5/d1b/f2b 21674 1 2024-03-19T06:06:04.509 INFO:tasks.workunit.client.0.smithi072.stdout:8/546: dread da/d13/d1d/f2b [0,4194304] 0 2024-03-19T06:06:04.511 INFO:tasks.workunit.client.0.smithi072.stdout:5/739: fsync df/f64 0 2024-03-19T06:06:04.513 INFO:tasks.workunit.client.0.smithi072.stdout:4/772: mkdir d5/d15/d3f/d10d 0 2024-03-19T06:06:04.518 INFO:tasks.workunit.client.0.smithi072.stdout:4/773: mknod d5/d15/d22/c10e 0 2024-03-19T06:06:04.518 INFO:tasks.workunit.client.0.smithi072.stdout:5/740: creat df/d14/d5d/fe1 x:0 0 0 2024-03-19T06:06:04.522 INFO:tasks.workunit.client.0.smithi072.stdout:2/615: write db/d10/d2b/d2d/d77/f96 [638747,28603] 0 2024-03-19T06:06:04.522 INFO:tasks.workunit.client.0.smithi072.stdout:4/774: write d5/d37/f69 [1341028,107081] 0 2024-03-19T06:06:04.524 INFO:tasks.workunit.client.0.smithi072.stdout:4/775: chown d5/d15/d31/d7d 1484098 1 2024-03-19T06:06:04.524 INFO:tasks.workunit.client.0.smithi072.stdout:8/547: write da/d37/f6c [523207,66511] 0 2024-03-19T06:06:04.528 INFO:tasks.workunit.client.0.smithi072.stdout:4/776: readlink d5/d37/d52/l5f 0 2024-03-19T06:06:04.528 INFO:tasks.workunit.client.0.smithi072.stdout:8/548: chown da/d37/f93 265326248 1 2024-03-19T06:06:04.530 INFO:tasks.workunit.client.0.smithi072.stdout:2/616: mknod db/d10/d13/d24/d61/d7d/cd4 0 2024-03-19T06:06:04.531 INFO:tasks.workunit.client.0.smithi072.stdout:8/549: stat da/d13/d3f/c67 0 2024-03-19T06:06:04.536 INFO:tasks.workunit.client.0.smithi072.stdout:8/550: write da/d13/d14/f17 [5515699,54335] 0 2024-03-19T06:06:04.542 INFO:tasks.workunit.client.0.smithi072.stdout:4/777: link d5/d15/d31/d7d/cb5 d5/d15/d73/c10f 0 2024-03-19T06:06:04.544 INFO:tasks.workunit.client.0.smithi072.stdout:8/551: mkdir da/d27/d52/d5b/d3e/d7d/db7 0 2024-03-19T06:06:04.551 INFO:tasks.workunit.client.0.smithi072.stdout:2/617: write db/d10/d13/f20 [2169774,97300] 0 2024-03-19T06:06:04.554 INFO:tasks.workunit.client.0.smithi072.stdout:0/583: dread d1/d1c/d24/d3f/f96 [0,4194304] 0 2024-03-19T06:06:04.557 INFO:tasks.workunit.client.0.smithi072.stdout:0/584: symlink d1/d1c/d24/d27/d7c/daa/lb5 0 2024-03-19T06:06:04.558 INFO:tasks.workunit.client.0.smithi072.stdout:0/585: chown d1/d1c/d24/d27/d7c/daa 9278 1 2024-03-19T06:06:04.735 INFO:tasks.workunit.client.0.smithi072.stdout:0/586: chown d1/d1c/d24/d27/l33 1332 1 2024-03-19T06:06:04.746 INFO:tasks.workunit.client.0.smithi072.stdout:8/552: dread da/d13/d14/d6f/f84 [0,4194304] 0 2024-03-19T06:06:04.748 INFO:tasks.workunit.client.0.smithi072.stdout:2/618: dwrite db/d10/d2b/d2d/fa2 [0,4194304] 0 2024-03-19T06:06:04.758 INFO:tasks.workunit.client.0.smithi072.stdout:8/553: chown da/f50 988349 1 2024-03-19T06:06:04.763 INFO:tasks.workunit.client.0.smithi072.stdout:0/587: dwrite d1/d2c/da1/d85/f88 [0,4194304] 0 2024-03-19T06:06:04.768 INFO:tasks.workunit.client.0.smithi072.stdout:8/554: dread da/d13/d14/d1b/f9c [0,4194304] 0 2024-03-19T06:06:04.769 INFO:tasks.workunit.client.0.smithi072.stdout:8/555: chown da/d13/d14/d1b/ca1 23442 1 2024-03-19T06:06:04.770 INFO:tasks.workunit.client.0.smithi072.stdout:0/588: creat d1/d1c/d24/d27/fb6 x:0 0 0 2024-03-19T06:06:04.775 INFO:tasks.workunit.client.0.smithi072.stdout:0/589: mknod d1/d1c/d24/d27/d73/d80/cb7 0 2024-03-19T06:06:04.778 INFO:tasks.workunit.client.0.smithi072.stdout:8/556: symlink da/d27/d52/d5b/d3e/lb8 0 2024-03-19T06:06:04.782 INFO:tasks.workunit.client.0.smithi072.stdout:0/590: symlink d1/d1c/d89/lb8 0 2024-03-19T06:06:04.789 INFO:tasks.workunit.client.0.smithi072.stdout:0/591: creat d1/d2c/da1/fb9 x:0 0 0 2024-03-19T06:06:04.807 INFO:tasks.workunit.client.0.smithi072.stdout:0/592: dwrite d1/d2c/da1/d85/f88 [0,4194304] 0 2024-03-19T06:06:04.813 INFO:tasks.workunit.client.0.smithi072.stdout:0/593: creat d1/d1c/d89/d9c/da6/fba x:0 0 0 2024-03-19T06:06:04.814 INFO:tasks.workunit.client.0.smithi072.stdout:8/557: dread da/d3b/f5e [0,4194304] 0 2024-03-19T06:06:04.820 INFO:tasks.workunit.client.0.smithi072.stdout:8/558: getdents da/d13/d14/d1b/d6b/daa 0 2024-03-19T06:06:04.826 INFO:tasks.workunit.client.0.smithi072.stdout:8/559: mkdir da/d13/d3f/db9 0 2024-03-19T06:06:04.833 INFO:tasks.workunit.client.0.smithi072.stdout:0/594: dwrite d1/d2c/f52 [0,4194304] 0 2024-03-19T06:06:04.838 INFO:tasks.workunit.client.0.smithi072.stdout:8/560: mknod da/d13/d14/d1b/cba 0 2024-03-19T06:06:04.889 INFO:tasks.workunit.client.0.smithi072.stdout:0/595: dwrite d1/d1c/f7d [0,4194304] 0 2024-03-19T06:06:04.892 INFO:tasks.workunit.client.0.smithi072.stdout:0/596: dread - d1/d1c/d24/d27/fa2 zero size 2024-03-19T06:06:04.895 INFO:tasks.workunit.client.0.smithi072.stdout:8/561: dread da/d37/f6c [0,4194304] 0 2024-03-19T06:06:04.897 INFO:tasks.workunit.client.0.smithi072.stdout:0/597: mkdir d1/d1c/d24/d27/d73/dbb 0 2024-03-19T06:06:04.903 INFO:tasks.workunit.client.0.smithi072.stdout:8/562: creat da/d13/d14/d1b/fbb x:0 0 0 2024-03-19T06:06:04.908 INFO:tasks.workunit.client.0.smithi072.stdout:2/619: dread db/d10/d13/d31/d35/f43 [0,4194304] 0 2024-03-19T06:06:04.915 INFO:tasks.workunit.client.0.smithi072.stdout:2/620: rename db/d10/d2b/d45/dc1 to db/d10/d2b/d2d/d9e/d48/d82/d98/dbf/dd5 0 2024-03-19T06:06:04.918 INFO:tasks.workunit.client.0.smithi072.stdout:2/621: write db/d10/d2b/d2d/d77/f96 [544519,85316] 0 2024-03-19T06:06:04.921 INFO:tasks.workunit.client.0.smithi072.stdout:2/622: fsync db/d10/d2b/f4a 0 2024-03-19T06:06:04.923 INFO:tasks.workunit.client.0.smithi072.stdout:2/623: chown db/l57 36 1 2024-03-19T06:06:04.927 INFO:tasks.workunit.client.0.smithi072.stdout:8/563: dwrite da/d37/f73 [0,4194304] 0 2024-03-19T06:06:04.930 INFO:tasks.workunit.client.0.smithi072.stdout:8/564: write da/d13/d14/d1b/fbb [111919,101156] 0 2024-03-19T06:06:04.934 INFO:tasks.workunit.client.0.smithi072.stdout:0/598: dread d1/f58 [0,4194304] 0 2024-03-19T06:06:04.939 INFO:tasks.workunit.client.0.smithi072.stdout:0/599: write d1/d1c/d24/d27/d73/fb2 [517638,35316] 0 2024-03-19T06:06:04.956 INFO:tasks.workunit.client.0.smithi072.stdout:0/600: chown d1/d1c/l34 4208941 1 2024-03-19T06:06:04.959 INFO:tasks.workunit.client.0.smithi072.stdout:2/624: dwrite db/d10/d13/d24/d61/d7d/fd3 [0,4194304] 0 2024-03-19T06:06:04.961 INFO:tasks.workunit.client.0.smithi072.stdout:8/565: dwrite da/d37/f93 [0,4194304] 0 2024-03-19T06:06:04.966 INFO:tasks.workunit.client.0.smithi072.stdout:0/601: creat d1/d1c/d82/d90/fbc x:0 0 0 2024-03-19T06:06:04.969 INFO:tasks.workunit.client.0.smithi072.stdout:2/625: write db/d10/d13/d24/d72/f74 [382581,98353] 0 2024-03-19T06:06:04.970 INFO:tasks.workunit.client.0.smithi072.stdout:2/626: readlink l2 0 2024-03-19T06:06:04.972 INFO:tasks.workunit.client.0.smithi072.stdout:0/602: creat d1/d1c/d24/d27/fbd x:0 0 0 2024-03-19T06:06:04.972 INFO:tasks.workunit.client.0.smithi072.stdout:8/566: getdents da/d13/d14 0 2024-03-19T06:06:04.978 INFO:tasks.workunit.client.0.smithi072.stdout:0/603: mkdir d1/d1c/d82/d90/dbe 0 2024-03-19T06:06:04.979 INFO:tasks.workunit.client.0.smithi072.stdout:2/627: creat db/d10/d59/fd6 x:0 0 0 2024-03-19T06:06:04.982 INFO:tasks.workunit.client.0.smithi072.stdout:0/604: mkdir d1/d1c/d82/dbf 0 2024-03-19T06:06:04.983 INFO:tasks.workunit.client.0.smithi072.stdout:8/567: link da/d13/d14/d1b/l24 da/d13/d1d/lbc 0 2024-03-19T06:06:04.987 INFO:tasks.workunit.client.0.smithi072.stdout:8/568: rmdir da/d27/d52/d5b/d3e/d7f 39 2024-03-19T06:06:04.987 INFO:tasks.workunit.client.0.smithi072.stdout:0/605: creat d1/d1c/d89/d9c/fc0 x:0 0 0 2024-03-19T06:06:04.990 INFO:tasks.workunit.client.0.smithi072.stdout:0/606: write d1/d1c/d24/d27/fbd [631831,120273] 0 2024-03-19T06:06:04.992 INFO:tasks.workunit.client.0.smithi072.stdout:0/607: dread - d1/d1c/d82/d90/fa4 zero size 2024-03-19T06:06:04.993 INFO:tasks.workunit.client.0.smithi072.stdout:0/608: readlink d1/d2c/l3b 0 2024-03-19T06:06:05.012 INFO:tasks.workunit.client.0.smithi072.stdout:8/569: dread da/f51 [0,4194304] 0 2024-03-19T06:06:05.041 INFO:tasks.workunit.client.0.smithi072.stdout:8/570: dread da/f34 [0,4194304] 0 2024-03-19T06:06:05.045 INFO:tasks.workunit.client.0.smithi072.stdout:8/571: mkdir da/d27/d52/dbd 0 2024-03-19T06:06:05.048 INFO:tasks.workunit.client.0.smithi072.stdout:8/572: fdatasync da/f2d 0 2024-03-19T06:06:05.053 INFO:tasks.workunit.client.0.smithi072.stdout:8/573: creat da/d62/d75/d8d/fbe x:0 0 0 2024-03-19T06:06:05.081 INFO:tasks.workunit.client.0.smithi072.stdout:8/574: chown da/d27/d52/d5b/d3e/d7f/c8a 50602 1 2024-03-19T06:06:05.087 INFO:tasks.workunit.client.0.smithi072.stdout:8/575: creat da/d13/d14/d1b/d6b/daa/fbf x:0 0 0 2024-03-19T06:06:05.089 INFO:tasks.workunit.client.0.smithi072.stdout:8/576: chown da/c26 3984 1 2024-03-19T06:06:05.095 INFO:tasks.workunit.client.0.smithi072.stdout:8/577: write da/d27/d52/d5b/d3e/d5a/d7a/f82 [1170589,12321] 0 2024-03-19T06:06:05.098 INFO:tasks.workunit.client.0.smithi072.stdout:8/578: read - da/d13/d3f/dac/fb6 zero size 2024-03-19T06:06:05.103 INFO:tasks.workunit.client.0.smithi072.stdout:8/579: mknod da/d13/d14/cc0 0 2024-03-19T06:06:05.107 INFO:tasks.workunit.client.0.smithi072.stdout:8/580: stat da/d27/d52/d5b/d3e/l5f 0 2024-03-19T06:06:05.111 INFO:tasks.workunit.client.0.smithi072.stdout:2/628: dwrite db/d10/d13/d24/f3d [4194304,4194304] 0 2024-03-19T06:06:05.114 INFO:tasks.workunit.client.0.smithi072.stdout:8/581: mkdir da/d13/d3f/db9/dc1 0 2024-03-19T06:06:05.118 INFO:tasks.workunit.client.0.smithi072.stdout:8/582: truncate da/f11 8943668 0 2024-03-19T06:06:05.118 INFO:tasks.workunit.client.0.smithi072.stdout:2/629: write db/d10/d2b/d2d/d9e/dab/dca/fb5 [40182,4485] 0 2024-03-19T06:06:05.137 INFO:tasks.workunit.client.0.smithi072.stdout:8/583: dwrite da/d37/f73 [0,4194304] 0 2024-03-19T06:06:05.138 INFO:tasks.workunit.client.0.smithi072.stdout:2/630: dwrite db/d10/d2b/d2d/fbc [0,4194304] 0 2024-03-19T06:06:05.140 INFO:tasks.workunit.client.0.smithi072.stdout:2/631: write db/d10/d13/f20 [98833,2563] 0 2024-03-19T06:06:05.141 INFO:tasks.workunit.client.0.smithi072.stdout:8/584: read da/d13/d14/d1b/f9c [103225,62834] 0 2024-03-19T06:06:05.143 INFO:tasks.workunit.client.0.smithi072.stdout:8/585: dread - da/d62/d75/d8d/fa4 zero size 2024-03-19T06:06:05.146 INFO:tasks.workunit.client.0.smithi072.stdout:2/632: symlink db/d10/d13/d80/ld7 0 2024-03-19T06:06:05.204 INFO:tasks.workunit.client.0.smithi072.stdout:6/545: sync 2024-03-19T06:06:05.204 INFO:tasks.workunit.client.0.smithi072.stdout:1/614: sync 2024-03-19T06:06:05.209 INFO:tasks.workunit.client.0.smithi072.stdout:6/546: chown d7/d9/d2b/l57 398695682 1 2024-03-19T06:06:05.226 INFO:tasks.workunit.client.0.smithi072.stdout:1/615: mkdir d1/d11/d18/d19/d1a/d25/d3c/d68/d96/dc0 0 2024-03-19T06:06:05.232 INFO:tasks.workunit.client.0.smithi072.stdout:6/547: mkdir d7/d9/d1b/d21/d68/d80/dba 0 2024-03-19T06:06:05.235 INFO:tasks.workunit.client.0.smithi072.stdout:6/548: readlink d7/d9/d1b/d31/d96/l9c 0 2024-03-19T06:06:05.246 INFO:tasks.workunit.client.0.smithi072.stdout:6/549: symlink d7/d99/d60/d78/d7f/lbb 0 2024-03-19T06:06:05.250 INFO:tasks.workunit.client.0.smithi072.stdout:1/616: getdents d1/d11 0 2024-03-19T06:06:05.259 INFO:tasks.workunit.client.0.smithi072.stdout:1/617: write d1/d11/d18/d19/d1a/d61/d65/f88 [2927636,1500] 0 2024-03-19T06:06:05.261 INFO:tasks.workunit.client.0.smithi072.stdout:6/550: dread d7/d9/d1b/d3b/f8c [0,4194304] 0 2024-03-19T06:06:05.266 INFO:tasks.workunit.client.0.smithi072.stdout:6/551: fsync d7/d9/d1b/d21/f24 0 2024-03-19T06:06:05.271 INFO:tasks.workunit.client.0.smithi072.stdout:8/586: truncate da/d13/d14/f28 267692 0 2024-03-19T06:06:05.273 INFO:tasks.workunit.client.0.smithi072.stdout:2/633: write db/fc2 [1551730,92146] 0 2024-03-19T06:06:05.282 INFO:tasks.workunit.client.0.smithi072.stdout:2/634: truncate db/d10/d2b/d2d/d9e/d48/d82/d98/fce 998285 0 2024-03-19T06:06:05.282 INFO:tasks.workunit.client.0.smithi072.stdout:6/552: rename d7/d9/d1b/d31/c39 to d7/d9/d1b/d21/d68/daa/d76/cbc 0 2024-03-19T06:06:05.286 INFO:tasks.workunit.client.0.smithi072.stdout:6/553: read d7/d9/d1b/f2a [1880640,28861] 0 2024-03-19T06:06:05.286 INFO:tasks.workunit.client.0.smithi072.stdout:8/587: mkdir da/d27/dc2 0 2024-03-19T06:06:05.289 INFO:tasks.workunit.client.0.smithi072.stdout:6/554: read d7/d9/d1b/f2a [824809,18552] 0 2024-03-19T06:06:05.289 INFO:tasks.workunit.client.0.smithi072.stdout:1/618: link d1/d11/d18/d19/d1a/d25/d3c/f5b d1/d11/d76/da7/d9e/fc1 0 2024-03-19T06:06:05.294 INFO:tasks.workunit.client.0.smithi072.stdout:6/555: read d7/f15 [748857,51898] 0 2024-03-19T06:06:05.299 INFO:tasks.workunit.client.0.smithi072.stdout:6/556: mknod d7/d9/d2b/cbd 0 2024-03-19T06:06:05.299 INFO:tasks.workunit.client.0.smithi072.stdout:9/585: sync 2024-03-19T06:06:05.299 INFO:tasks.workunit.client.0.smithi072.stdout:3/636: sync 2024-03-19T06:06:05.301 INFO:tasks.workunit.client.0.smithi072.stdout:6/557: chown d7/f70 8 1 2024-03-19T06:06:05.302 INFO:tasks.workunit.client.0.smithi072.stdout:1/619: rename d1/d11/d18/d19/d1a/db6 to d1/d11/d18/d19/dc2 0 2024-03-19T06:06:05.313 INFO:tasks.workunit.client.0.smithi072.stdout:2/635: truncate db/d10/f2e 1879918 0 2024-03-19T06:06:05.317 INFO:tasks.workunit.client.0.smithi072.stdout:9/586: creat d11/d1f/d2a/d68/d92/da6/fca x:0 0 0 2024-03-19T06:06:05.318 INFO:tasks.workunit.client.0.smithi072.stdout:8/588: dread da/d27/f47 [0,4194304] 0 2024-03-19T06:06:05.319 INFO:tasks.workunit.client.0.smithi072.stdout:3/637: getdents d2/d40/d78/d9b/dc5 0 2024-03-19T06:06:05.324 INFO:tasks.workunit.client.0.smithi072.stdout:9/587: rename d11/d1f/d2a/d36/d86 to d11/d1f/d2a/d36/d45/dcb 0 2024-03-19T06:06:05.326 INFO:tasks.workunit.client.0.smithi072.stdout:2/636: mknod db/d10/d13/d31/cd8 0 2024-03-19T06:06:05.328 INFO:tasks.workunit.client.0.smithi072.stdout:8/589: mknod da/d27/d52/d5b/cc3 0 2024-03-19T06:06:05.330 INFO:tasks.workunit.client.0.smithi072.stdout:6/558: dwrite d7/f34 [0,4194304] 0 2024-03-19T06:06:05.334 INFO:tasks.workunit.client.0.smithi072.stdout:8/590: fdatasync da/d27/f39 0 2024-03-19T06:06:05.334 INFO:tasks.workunit.client.0.smithi072.stdout:9/588: mkdir d11/d1f/dcc 0 2024-03-19T06:06:05.335 INFO:tasks.workunit.client.0.smithi072.stdout:2/637: mkdir db/d10/d2b/d2d/d9e/d48/dd9 0 2024-03-19T06:06:05.336 INFO:tasks.workunit.client.0.smithi072.stdout:6/559: fdatasync d7/d9/d2b/f53 0 2024-03-19T06:06:05.342 INFO:tasks.workunit.client.0.smithi072.stdout:7/480: sync 2024-03-19T06:06:05.342 INFO:tasks.workunit.client.0.smithi072.stdout:4/778: sync 2024-03-19T06:06:05.342 INFO:tasks.workunit.client.0.smithi072.stdout:0/609: sync 2024-03-19T06:06:05.342 INFO:tasks.workunit.client.0.smithi072.stdout:5/741: sync 2024-03-19T06:06:05.345 INFO:tasks.workunit.client.0.smithi072.stdout:1/620: dwrite d1/f6 [0,4194304] 0 2024-03-19T06:06:05.346 INFO:tasks.workunit.client.0.smithi072.stdout:2/638: rmdir db/d10/d13/d31/d35 39 2024-03-19T06:06:05.351 INFO:tasks.workunit.client.0.smithi072.stdout:7/481: write d2/d3/d18/d33/d1d/f81 [391883,31669] 0 2024-03-19T06:06:05.354 INFO:tasks.workunit.client.0.smithi072.stdout:4/779: mknod d5/d8a/c110 0 2024-03-19T06:06:05.356 INFO:tasks.workunit.client.0.smithi072.stdout:9/589: read d11/d1f/d2a/d36/d3e/f58 [679786,128640] 0 2024-03-19T06:06:05.356 INFO:tasks.workunit.client.0.smithi072.stdout:6/560: mknod d7/d9/d1b/d33/d41/d92/cbe 0 2024-03-19T06:06:05.359 INFO:tasks.workunit.client.0.smithi072.stdout:7/482: rmdir d2/d3/d18 39 2024-03-19T06:06:05.360 INFO:tasks.workunit.client.0.smithi072.stdout:0/610: creat d1/d1c/d24/d8f/fc1 x:0 0 0 2024-03-19T06:06:05.362 INFO:tasks.workunit.client.0.smithi072.stdout:1/621: symlink d1/d11/d18/d19/d1a/d25/d3c/d79/lc3 0 2024-03-19T06:06:05.364 INFO:tasks.workunit.client.0.smithi072.stdout:8/591: getdents da/d13/d14 0 2024-03-19T06:06:05.364 INFO:tasks.workunit.client.0.smithi072.stdout:2/639: creat db/d10/d13/d31/fda x:0 0 0 2024-03-19T06:06:05.369 INFO:tasks.workunit.client.0.smithi072.stdout:8/592: fsync da/d37/f94 0 2024-03-19T06:06:05.369 INFO:tasks.workunit.client.0.smithi072.stdout:5/742: rmdir df/d13/d32/d28/d42/d59/d43/d4e/d5c/dba 0 2024-03-19T06:06:05.370 INFO:tasks.workunit.client.0.smithi072.stdout:2/640: write db/d10/d2b/d2d/d9e/dab/dca/fc5 [868766,26508] 0 2024-03-19T06:06:05.371 INFO:tasks.workunit.client.0.smithi072.stdout:7/483: symlink d2/l91 0 2024-03-19T06:06:05.373 INFO:tasks.workunit.client.0.smithi072.stdout:5/743: dread - df/d13/d32/d28/fd2 zero size 2024-03-19T06:06:05.376 INFO:tasks.workunit.client.0.smithi072.stdout:6/561: link d7/d9/d1e/f4d d7/d9/d1b/d21/d68/daa/fbf 0 2024-03-19T06:06:05.376 INFO:tasks.workunit.client.0.smithi072.stdout:0/611: creat d1/d2c/da1/fc2 x:0 0 0 2024-03-19T06:06:05.377 INFO:tasks.workunit.client.0.smithi072.stdout:1/622: unlink d1/d11/d18/d19/d1a/f2a 0 2024-03-19T06:06:05.381 INFO:tasks.workunit.client.0.smithi072.stdout:8/593: rename da/d27/d52/d5b/c91 to da/d13/d1d/cc4 0 2024-03-19T06:06:05.385 INFO:tasks.workunit.client.0.smithi072.stdout:0/612: creat d1/d1c/d24/d27/d7c/daa/fc3 x:0 0 0 2024-03-19T06:06:05.386 INFO:tasks.workunit.client.0.smithi072.stdout:2/641: mkdir db/d10/d2b/d2d/d9e/d48/ddb 0 2024-03-19T06:06:05.387 INFO:tasks.workunit.client.0.smithi072.stdout:8/594: mkdir da/d13/d14/d1b/d57/dc5 0 2024-03-19T06:06:05.390 INFO:tasks.workunit.client.0.smithi072.stdout:8/595: dread - da/d37/f94 zero size 2024-03-19T06:06:05.395 INFO:tasks.workunit.client.0.smithi072.stdout:0/613: mkdir d1/d1c/d24/d27/d73/d80/da8/dc4 0 2024-03-19T06:06:05.395 INFO:tasks.workunit.client.0.smithi072.stdout:4/780: dread d5/d1b/f5a [0,4194304] 0 2024-03-19T06:06:05.401 INFO:tasks.workunit.client.0.smithi072.stdout:8/596: mkdir da/d27/dc2/dc6 0 2024-03-19T06:06:05.411 INFO:tasks.workunit.client.0.smithi072.stdout:4/781: truncate d5/d1b/f8d 4235646 0 2024-03-19T06:06:05.411 INFO:tasks.workunit.client.0.smithi072.stdout:9/590: dwrite d11/d1f/d2a/d68/d92/d93/fb8 [0,4194304] 0 2024-03-19T06:06:05.412 INFO:tasks.workunit.client.0.smithi072.stdout:0/614: rename d1/d1c/d24/d3f/f74 to d1/d1c/d24/d27/d73/fc5 0 2024-03-19T06:06:05.413 INFO:tasks.workunit.client.0.smithi072.stdout:8/597: mkdir da/d37/d5c/d8e/dc7 0 2024-03-19T06:06:05.416 INFO:tasks.workunit.client.0.smithi072.stdout:6/562: dwrite d7/d9/d30/f38 [0,4194304] 0 2024-03-19T06:06:05.419 INFO:tasks.workunit.client.0.smithi072.stdout:7/484: dwrite d2/d3/d18/d33/d1d/d2b/f45 [0,4194304] 0 2024-03-19T06:06:05.420 INFO:tasks.workunit.client.0.smithi072.stdout:9/591: readlink d11/d1f/lb1 0 2024-03-19T06:06:05.432 INFO:tasks.workunit.client.0.smithi072.stdout:5/744: dread df/d13/f3e [0,4194304] 0 2024-03-19T06:06:05.434 INFO:tasks.workunit.client.0.smithi072.stdout:9/592: mkdir d11/d24/d4c/dcd 0 2024-03-19T06:06:05.438 INFO:tasks.workunit.client.0.smithi072.stdout:4/782: write d5/d15/da6/fc0 [137695,77996] 0 2024-03-19T06:06:05.439 INFO:tasks.workunit.client.0.smithi072.stdout:0/615: link d1/d1c/d89/lb8 d1/d2c/da1/lc6 0 2024-03-19T06:06:05.445 INFO:tasks.workunit.client.0.smithi072.stdout:9/593: write d11/d1f/d2a/fab [507073,36235] 0 2024-03-19T06:06:05.446 INFO:tasks.workunit.client.0.smithi072.stdout:7/485: creat d2/d3/d18/d33/d1d/d3b/d63/d84/f92 x:0 0 0 2024-03-19T06:06:05.448 INFO:tasks.workunit.client.0.smithi072.stdout:2/642: dread db/d10/d12/f1b [0,4194304] 0 2024-03-19T06:06:05.450 INFO:tasks.workunit.client.0.smithi072.stdout:9/594: write d11/d1f/d2a/d36/f90 [920779,21270] 0 2024-03-19T06:06:05.450 INFO:tasks.workunit.client.0.smithi072.stdout:0/616: rmdir d1/d1c/d82/dbf 0 2024-03-19T06:06:05.451 INFO:tasks.workunit.client.0.smithi072.stdout:7/486: chown d2/d3/d17/f69 2849007 1 2024-03-19T06:06:05.457 INFO:tasks.workunit.client.0.smithi072.stdout:7/487: fsync d2/d3/d18/d33/d1d/d3b/d63/f8a 0 2024-03-19T06:06:05.458 INFO:tasks.workunit.client.0.smithi072.stdout:9/595: write d11/d24/d4c/d6e/f9d [375261,21940] 0 2024-03-19T06:06:05.459 INFO:tasks.workunit.client.0.smithi072.stdout:0/617: rename d1/d1c/d24/l75 to d1/d1c/d82/lc7 0 2024-03-19T06:06:05.464 INFO:tasks.workunit.client.0.smithi072.stdout:0/618: mknod d1/d1c/d24/d27/cc8 0 2024-03-19T06:06:05.465 INFO:tasks.workunit.client.0.smithi072.stdout:9/596: symlink d11/d1f/d2a/d36/d45/dcb/lce 0 2024-03-19T06:06:05.472 INFO:tasks.workunit.client.0.smithi072.stdout:0/619: write d1/d1c/f23 [4402598,49828] 0 2024-03-19T06:06:05.476 INFO:tasks.workunit.client.0.smithi072.stdout:9/597: truncate d11/d1f/d2a/d68/fb9 254981 0 2024-03-19T06:06:05.478 INFO:tasks.workunit.client.0.smithi072.stdout:7/488: dread d2/d3/d17/f48 [0,4194304] 0 2024-03-19T06:06:05.484 INFO:tasks.workunit.client.0.smithi072.stdout:2/643: dwrite db/d10/d2b/d2d/d6a/fba [0,4194304] 0 2024-03-19T06:06:05.488 INFO:tasks.workunit.client.0.smithi072.stdout:0/620: rename d1/d1c/d24/d27/f98 to d1/d1c/d24/d27/d73/d80/da8/dc4/fc9 0 2024-03-19T06:06:05.489 INFO:tasks.workunit.client.0.smithi072.stdout:2/644: stat c9 0 2024-03-19T06:06:05.491 INFO:tasks.workunit.client.0.smithi072.stdout:8/598: dread da/d27/d52/d5b/d3e/d7d/d97/f46 [0,4194304] 0 2024-03-19T06:06:05.498 INFO:tasks.workunit.client.0.smithi072.stdout:8/599: chown da/d27/d52/d5b/d3e/d7d/db7 1627211138 1 2024-03-19T06:06:05.500 INFO:tasks.workunit.client.0.smithi072.stdout:2/645: unlink db/d10/d2b/d2d/f46 0 2024-03-19T06:06:05.501 INFO:tasks.workunit.client.0.smithi072.stdout:7/489: getdents d2/d3/d18/d33/d1d/d3b/d63/d84 0 2024-03-19T06:06:05.505 INFO:tasks.workunit.client.0.smithi072.stdout:4/783: dread d5/d15/d22/d41/d7b/fc9 [0,4194304] 0 2024-03-19T06:06:05.506 INFO:tasks.workunit.client.0.smithi072.stdout:7/490: creat d2/f93 x:0 0 0 2024-03-19T06:06:05.510 INFO:tasks.workunit.client.0.smithi072.stdout:6/563: dread d7/d9/d1b/d3b/f5e [4194304,4194304] 0 2024-03-19T06:06:05.512 INFO:tasks.workunit.client.0.smithi072.stdout:7/491: write d2/d3/d18/d33/d1d/d2b/f4b [4313388,79064] 0 2024-03-19T06:06:05.515 INFO:tasks.workunit.client.0.smithi072.stdout:6/564: mkdir d7/d91/d84/dc0 0 2024-03-19T06:06:05.517 INFO:tasks.workunit.client.0.smithi072.stdout:2/646: write db/d10/d2b/d2d/d66/f6f [277488,71675] 0 2024-03-19T06:06:05.519 INFO:tasks.workunit.client.0.smithi072.stdout:0/621: dread d1/d2c/da1/d85/f88 [0,4194304] 0 2024-03-19T06:06:05.522 INFO:tasks.workunit.client.0.smithi072.stdout:7/492: getdents d2/d3/d18/d2f 0 2024-03-19T06:06:05.522 INFO:tasks.workunit.client.0.smithi072.stdout:2/647: readlink db/d10/d2b/d2d/d6a/l89 0 2024-03-19T06:06:05.525 INFO:tasks.workunit.client.0.smithi072.stdout:0/622: mknod d1/d1c/d89/cca 0 2024-03-19T06:06:05.527 INFO:tasks.workunit.client.0.smithi072.stdout:6/565: getdents d7/d9/d1b/d21/d68/daa/d76 0 2024-03-19T06:06:05.527 INFO:tasks.workunit.client.0.smithi072.stdout:2/648: dread - db/d10/d13/d31/fda zero size 2024-03-19T06:06:05.530 INFO:tasks.workunit.client.0.smithi072.stdout:0/623: chown d1/d1c/d24/d27/d7c/daa 998478 1 2024-03-19T06:06:05.530 INFO:tasks.workunit.client.0.smithi072.stdout:2/649: chown db/d10/d13/d24 4697 1 2024-03-19T06:06:05.534 INFO:tasks.workunit.client.0.smithi072.stdout:6/566: rmdir d7/d9/d1b/d33/d41/d92 39 2024-03-19T06:06:05.535 INFO:tasks.workunit.client.0.smithi072.stdout:2/650: write db/d10/d2b/d2d/fa2 [53880,119979] 0 2024-03-19T06:06:05.537 INFO:tasks.workunit.client.0.smithi072.stdout:0/624: write d1/d1c/d24/d27/d7c/f5a [25498,60346] 0 2024-03-19T06:06:05.538 INFO:tasks.workunit.client.0.smithi072.stdout:8/600: dread da/f50 [0,4194304] 0 2024-03-19T06:06:05.545 INFO:tasks.workunit.client.0.smithi072.stdout:4/784: dwrite d5/d15/d22/d41/d7b/d7c/f101 [0,4194304] 0 2024-03-19T06:06:05.546 INFO:tasks.workunit.client.0.smithi072.stdout:8/601: unlink da/d27/d52/d5b/d3e/d5a/d7a/f82 0 2024-03-19T06:06:05.546 INFO:tasks.workunit.client.0.smithi072.stdout:6/567: fsync d7/d9/d1b/d3b/d9b/fac 0 2024-03-19T06:06:05.549 INFO:tasks.workunit.client.0.smithi072.stdout:0/625: read d1/d1c/d24/d27/d73/f7a [2024788,85347] 0 2024-03-19T06:06:05.550 INFO:tasks.workunit.client.0.smithi072.stdout:4/785: write d5/d15/d3f/dc1/f5b [1008291,85380] 0 2024-03-19T06:06:05.551 INFO:tasks.workunit.client.0.smithi072.stdout:6/568: stat d7/d9/d1b/d3b/c3e 0 2024-03-19T06:06:05.554 INFO:tasks.workunit.client.0.smithi072.stdout:0/626: dread - d1/d1c/d82/d90/fa4 zero size 2024-03-19T06:06:05.555 INFO:tasks.workunit.client.0.smithi072.stdout:8/602: symlink da/d27/d52/dbd/lc8 0 2024-03-19T06:06:05.558 INFO:tasks.workunit.client.0.smithi072.stdout:4/786: symlink d5/d11/l111 0 2024-03-19T06:06:05.558 INFO:tasks.workunit.client.0.smithi072.stdout:6/569: symlink d7/d91/lc1 0 2024-03-19T06:06:05.562 INFO:tasks.workunit.client.0.smithi072.stdout:6/570: fsync d7/d99/f35 0 2024-03-19T06:06:05.564 INFO:tasks.workunit.client.0.smithi072.stdout:4/787: rmdir d5/d37/de3 39 2024-03-19T06:06:05.564 INFO:tasks.workunit.client.0.smithi072.stdout:8/603: read da/f2a [1088280,129616] 0 2024-03-19T06:06:05.565 INFO:tasks.workunit.client.0.smithi072.stdout:7/493: dread d2/d3/d18/d20/d3a/d50/f76 [0,4194304] 0 2024-03-19T06:06:05.566 INFO:tasks.workunit.client.0.smithi072.stdout:2/651: dwrite db/f4f [0,4194304] 0 2024-03-19T06:06:05.569 INFO:tasks.workunit.client.0.smithi072.stdout:6/571: rmdir d7/d9/d1b/d3b/d48 39 2024-03-19T06:06:05.570 INFO:tasks.workunit.client.0.smithi072.stdout:2/652: rmdir db/d10/d2b/d2d/d9e/dab/dca 39 2024-03-19T06:06:05.571 INFO:tasks.workunit.client.0.smithi072.stdout:4/788: write d5/d15/d3f/d42/ff3 [44707,115695] 0 2024-03-19T06:06:05.574 INFO:tasks.workunit.client.0.smithi072.stdout:6/572: creat d7/d3f/fc2 x:0 0 0 2024-03-19T06:06:05.574 INFO:tasks.workunit.client.0.smithi072.stdout:7/494: rmdir d2/d3/d18/d33/d1d/d3b/d63 39 2024-03-19T06:06:05.576 INFO:tasks.workunit.client.0.smithi072.stdout:0/627: dread d1/d1c/fad [0,4194304] 0 2024-03-19T06:06:05.578 INFO:tasks.workunit.client.0.smithi072.stdout:4/789: mkdir d5/d15/d31/d4c/d112 0 2024-03-19T06:06:05.581 INFO:tasks.workunit.client.0.smithi072.stdout:4/790: chown d5/d8a/c110 48422479 1 2024-03-19T06:06:05.581 INFO:tasks.workunit.client.0.smithi072.stdout:0/628: write d1/d1c/d24/d27/d7c/f5a [3235356,56439] 0 2024-03-19T06:06:05.584 INFO:tasks.workunit.client.0.smithi072.stdout:2/653: rename db/d10/d13/d80 to db/d10/d13/d31/d35/ddc 0 2024-03-19T06:06:05.586 INFO:tasks.workunit.client.0.smithi072.stdout:6/573: truncate d7/d99/d60/f81 484751 0 2024-03-19T06:06:05.589 INFO:tasks.workunit.client.0.smithi072.stdout:2/654: creat db/d10/d2b/d45/da4/fdd x:0 0 0 2024-03-19T06:06:05.590 INFO:tasks.workunit.client.0.smithi072.stdout:0/629: write d1/f79 [1580664,112559] 0 2024-03-19T06:06:05.594 INFO:tasks.workunit.client.0.smithi072.stdout:4/791: rename d5/d15/d31/d7d/d91/d10c/f6c to d5/d15/d31/d6f/d9d/f113 0 2024-03-19T06:06:05.597 INFO:tasks.workunit.client.0.smithi072.stdout:0/630: symlink d1/d1c/d24/d27/lcb 0 2024-03-19T06:06:05.597 INFO:tasks.workunit.client.0.smithi072.stdout:2/655: dread - db/d10/d2b/f85 zero size 2024-03-19T06:06:05.598 INFO:tasks.workunit.client.0.smithi072.stdout:4/792: write d5/d15/d22/fa5 [2734710,117379] 0 2024-03-19T06:06:05.602 INFO:tasks.workunit.client.0.smithi072.stdout:0/631: creat d1/d1c/d82/d90/fcc x:0 0 0 2024-03-19T06:06:05.602 INFO:tasks.workunit.client.0.smithi072.stdout:7/495: dwrite d2/d3/d18/d20/f71 [0,4194304] 0 2024-03-19T06:06:05.603 INFO:tasks.workunit.client.0.smithi072.stdout:6/574: rmdir d7/d9/d1b/d21/d68/d80/dba 0 2024-03-19T06:06:05.604 INFO:tasks.workunit.client.0.smithi072.stdout:2/656: mkdir db/d10/d13/d24/d72/d86/dde 0 2024-03-19T06:06:05.606 INFO:tasks.workunit.client.0.smithi072.stdout:0/632: fdatasync d1/d2c/f8a 0 2024-03-19T06:06:05.608 INFO:tasks.workunit.client.0.smithi072.stdout:6/575: chown d7/d9/d1b/d21/d68/daa/d88 1838183184 1 2024-03-19T06:06:05.610 INFO:tasks.workunit.client.0.smithi072.stdout:7/496: dread - d2/d3/d18/d33/d1d/d3b/d63/d84/f92 zero size 2024-03-19T06:06:05.616 INFO:tasks.workunit.client.0.smithi072.stdout:4/793: getdents d5/d15/d31/d6d/d7a/d8e 0 2024-03-19T06:06:05.624 INFO:tasks.workunit.client.0.smithi072.stdout:0/633: link d1/d1c/d24/d27/d73/f7a d1/d1c/d24/d27/d73/d80/d8b/fcd 0 2024-03-19T06:06:05.625 INFO:tasks.workunit.client.0.smithi072.stdout:4/794: mkdir d5/d15/d22/d41/d114 0 2024-03-19T06:06:05.626 INFO:tasks.workunit.client.0.smithi072.stdout:6/576: truncate d7/d9/d1b/f2a 598272 0 2024-03-19T06:06:05.630 INFO:tasks.workunit.client.0.smithi072.stdout:4/795: creat d5/d15/d22/d41/f115 x:0 0 0 2024-03-19T06:06:05.630 INFO:tasks.workunit.client.0.smithi072.stdout:6/577: mknod d7/d9/cc3 0 2024-03-19T06:06:05.634 INFO:tasks.workunit.client.0.smithi072.stdout:0/634: rename d1/d2c/da1/l81 to d1/d2c/da1/lce 0 2024-03-19T06:06:05.636 INFO:tasks.workunit.client.0.smithi072.stdout:4/796: write d5/d32/d58/f85 [164301,26520] 0 2024-03-19T06:06:05.636 INFO:tasks.workunit.client.0.smithi072.stdout:6/578: chown d7/d9/d1b/d21/d68/d80 0 1 2024-03-19T06:06:05.639 INFO:tasks.workunit.client.0.smithi072.stdout:0/635: dread - d1/d1c/d24/d27/fa2 zero size 2024-03-19T06:06:05.639 INFO:tasks.workunit.client.0.smithi072.stdout:2/657: dwrite db/d10/d2b/d2d/d9e/d48/f87 [0,4194304] 0 2024-03-19T06:06:05.642 INFO:tasks.workunit.client.0.smithi072.stdout:4/797: mknod d5/d1b/d7e/c116 0 2024-03-19T06:06:05.643 INFO:tasks.workunit.client.0.smithi072.stdout:0/636: stat d1/d2c/da1/c69 0 2024-03-19T06:06:05.643 INFO:tasks.workunit.client.0.smithi072.stdout:7/497: dwrite d2/d3/d17/f48 [0,4194304] 0 2024-03-19T06:06:05.646 INFO:tasks.workunit.client.0.smithi072.stdout:6/579: creat d7/d9/d1b/d3b/d9b/da4/db5/fc4 x:0 0 0 2024-03-19T06:06:05.649 INFO:tasks.workunit.client.0.smithi072.stdout:2/658: truncate db/d10/d2b/d2d/d9e/d48/d82/d98/dbf/fc4 38520 0 2024-03-19T06:06:05.650 INFO:tasks.workunit.client.0.smithi072.stdout:0/637: creat d1/d1c/d24/d27/d73/dbb/fcf x:0 0 0 2024-03-19T06:06:05.650 INFO:tasks.workunit.client.0.smithi072.stdout:7/498: read d2/d3/f62 [2302159,68356] 0 2024-03-19T06:06:05.651 INFO:tasks.workunit.client.0.smithi072.stdout:1/623: sync 2024-03-19T06:06:05.654 INFO:tasks.workunit.client.0.smithi072.stdout:4/798: symlink d5/d15/d3f/dc1/l117 0 2024-03-19T06:06:05.655 INFO:tasks.workunit.client.0.smithi072.stdout:1/624: write d1/d11/d18/d19/d1a/f9a [2752240,18098] 0 2024-03-19T06:06:05.657 INFO:tasks.workunit.client.0.smithi072.stdout:2/659: fdatasync db/d10/d13/d24/d61/d7d/fa5 0 2024-03-19T06:06:05.659 INFO:tasks.workunit.client.0.smithi072.stdout:2/660: chown db/d10/d13/d24/d72/dcb 14 1 2024-03-19T06:06:05.676 INFO:tasks.workunit.client.0.smithi072.stdout:0/638: rename d1/d2c/da1/d85/f88 to d1/d1c/d24/d3f/fd0 0 2024-03-19T06:06:05.677 INFO:tasks.workunit.client.0.smithi072.stdout:6/580: link d7/d9/d1b/d21/d68/ca3 d7/d9/d1b/cc5 0 2024-03-19T06:06:05.680 INFO:tasks.workunit.client.0.smithi072.stdout:1/625: rename d1/d11/d76/f9d to d1/d11/d18/d63/d73/fc4 0 2024-03-19T06:06:05.681 INFO:tasks.workunit.client.0.smithi072.stdout:2/661: creat db/d10/d2b/d2d/d62/d6b/fdf x:0 0 0 2024-03-19T06:06:05.681 INFO:tasks.workunit.client.0.smithi072.stdout:0/639: creat d1/d1c/d89/d9c/fd1 x:0 0 0 2024-03-19T06:06:05.685 INFO:tasks.workunit.client.0.smithi072.stdout:2/662: stat db/d10/d2b/d45/f55 0 2024-03-19T06:06:05.685 INFO:tasks.workunit.client.0.smithi072.stdout:6/581: unlink d7/d9/d1b/d33/d41/c4e 0 2024-03-19T06:06:05.685 INFO:tasks.workunit.client.0.smithi072.stdout:7/499: dwrite d2/f66 [0,4194304] 0 2024-03-19T06:06:05.685 INFO:tasks.workunit.client.0.smithi072.stdout:1/626: mknod d1/d11/d76/cc5 0 2024-03-19T06:06:05.689 INFO:tasks.workunit.client.0.smithi072.stdout:0/640: write d1/d1c/d24/d27/d7c/f8d [311613,21352] 0 2024-03-19T06:06:05.693 INFO:tasks.workunit.client.0.smithi072.stdout:6/582: creat d7/d91/d84/fc6 x:0 0 0 2024-03-19T06:06:05.694 INFO:tasks.workunit.client.0.smithi072.stdout:0/641: chown d1/d1c/d24/d27/d73/fc5 6810 1 2024-03-19T06:06:05.697 INFO:tasks.workunit.client.0.smithi072.stdout:7/500: write d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/f78 [84414,70401] 0 2024-03-19T06:06:05.700 INFO:tasks.workunit.client.0.smithi072.stdout:6/583: creat d7/d99/d60/d78/fc7 x:0 0 0 2024-03-19T06:06:05.702 INFO:tasks.workunit.client.0.smithi072.stdout:6/584: fsync d7/d9/d1e/f7b 0 2024-03-19T06:06:05.702 INFO:tasks.workunit.client.0.smithi072.stdout:0/642: write d1/d1c/d24/d27/d7c/f56 [4182332,120738] 0 2024-03-19T06:06:05.704 INFO:tasks.workunit.client.0.smithi072.stdout:2/663: write db/d10/d2b/d45/f55 [278181,11090] 0 2024-03-19T06:06:05.712 INFO:tasks.workunit.client.0.smithi072.stdout:2/664: fsync db/d10/d13/d31/d35/f43 0 2024-03-19T06:06:05.714 INFO:tasks.workunit.client.0.smithi072.stdout:6/585: rename d7/d9/d1b/d21/f73 to d7/d9/d1b/d21/d68/daa/d88/fc8 0 2024-03-19T06:06:05.714 INFO:tasks.workunit.client.0.smithi072.stdout:1/627: dwrite d1/d11/d18/d19/d1a/d61/d65/f88 [0,4194304] 0 2024-03-19T06:06:05.717 INFO:tasks.workunit.client.0.smithi072.stdout:1/628: fsync d1/d11/d18/d19/d1a/d3b/f6a 0 2024-03-19T06:06:05.719 INFO:tasks.workunit.client.0.smithi072.stdout:2/665: mkdir db/d10/d13/d24/d61/d7d/de0 0 2024-03-19T06:06:05.719 INFO:tasks.workunit.client.0.smithi072.stdout:4/799: dread d5/d15/d22/d95/fba [0,4194304] 0 2024-03-19T06:06:05.722 INFO:tasks.workunit.client.0.smithi072.stdout:7/501: link d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/c57 d2/d3/d17/d70/c94 0 2024-03-19T06:06:05.722 INFO:tasks.workunit.client.0.smithi072.stdout:6/586: chown d7/d9/d1b/d3b/d48/fa9 1133273599 1 2024-03-19T06:06:05.727 INFO:tasks.workunit.client.0.smithi072.stdout:2/666: write db/d10/d13/d24/f75 [1233311,34599] 0 2024-03-19T06:06:05.730 INFO:tasks.workunit.client.0.smithi072.stdout:7/502: symlink d2/d3/d17/l95 0 2024-03-19T06:06:05.732 INFO:tasks.workunit.client.0.smithi072.stdout:6/587: truncate d7/d3f/fc2 324332 0 2024-03-19T06:06:05.735 INFO:tasks.workunit.client.0.smithi072.stdout:4/800: dread d5/d1b/f5d [0,4194304] 0 2024-03-19T06:06:05.735 INFO:tasks.workunit.client.0.smithi072.stdout:0/643: dwrite d1/d1c/d24/d27/d7c/daa/fae [0,4194304] 0 2024-03-19T06:06:05.736 INFO:tasks.workunit.client.0.smithi072.stdout:2/667: chown db/d10/d13/d24/d61/d7d/fd3 9 1 2024-03-19T06:06:05.736 INFO:tasks.workunit.client.0.smithi072.stdout:7/503: chown d2/d3/l10 14 1 2024-03-19T06:06:05.739 INFO:tasks.workunit.client.0.smithi072.stdout:6/588: mknod d7/d91/d84/cc9 0 2024-03-19T06:06:05.741 INFO:tasks.workunit.client.0.smithi072.stdout:0/644: write d1/f19 [1492379,33465] 0 2024-03-19T06:06:05.741 INFO:tasks.workunit.client.0.smithi072.stdout:2/668: rmdir db/d10/d2b/d2d 39 2024-03-19T06:06:05.743 INFO:tasks.workunit.client.0.smithi072.stdout:0/645: stat d1/d2c/l50 0 2024-03-19T06:06:05.744 INFO:tasks.workunit.client.0.smithi072.stdout:4/801: rename d5/d15/d22/d41/d114 to d5/d15/d3f/dc1/d118 0 2024-03-19T06:06:05.745 INFO:tasks.workunit.client.0.smithi072.stdout:7/504: truncate d2/d3/d18/d33/d1d/d2b/f6c 1704602 0 2024-03-19T06:06:05.752 INFO:tasks.workunit.client.0.smithi072.stdout:7/505: chown d2/d3/d43 6943 1 2024-03-19T06:06:05.754 INFO:tasks.workunit.client.0.smithi072.stdout:6/589: write d7/d9/d1b/d3b/d9b/da4/db5/fc4 [915299,77551] 0 2024-03-19T06:06:05.757 INFO:tasks.workunit.client.0.smithi072.stdout:0/646: truncate d1/d2c/da1/f93 1509951 0 2024-03-19T06:06:05.760 INFO:tasks.workunit.client.0.smithi072.stdout:7/506: symlink d2/d3/d18/d33/d1d/l96 0 2024-03-19T06:06:05.761 INFO:tasks.workunit.client.0.smithi072.stdout:4/802: write d5/d1b/f5d [1004894,91207] 0 2024-03-19T06:06:05.762 INFO:tasks.workunit.client.0.smithi072.stdout:0/647: unlink d1/d1c/d24/d27/l28 0 2024-03-19T06:06:05.765 INFO:tasks.workunit.client.0.smithi072.stdout:6/590: symlink d7/d99/d60/lca 0 2024-03-19T06:06:05.765 INFO:tasks.workunit.client.0.smithi072.stdout:4/803: dread - d5/d15/d31/d6d/ffe zero size 2024-03-19T06:06:05.766 INFO:tasks.workunit.client.0.smithi072.stdout:7/507: creat d2/d3/d18/d7f/f97 x:0 0 0 2024-03-19T06:06:05.767 INFO:tasks.workunit.client.0.smithi072.stdout:6/591: readlink d7/d91/l7d 0 2024-03-19T06:06:05.768 INFO:tasks.workunit.client.0.smithi072.stdout:0/648: readlink d1/d1c/d82/lc7 0 2024-03-19T06:06:05.773 INFO:tasks.workunit.client.0.smithi072.stdout:0/649: mkdir d1/d1c/d24/d27/d73/d80/dd2 0 2024-03-19T06:06:05.775 INFO:tasks.workunit.client.0.smithi072.stdout:0/650: fdatasync d1/d1c/d82/d90/fbc 0 2024-03-19T06:06:05.776 INFO:tasks.workunit.client.0.smithi072.stdout:6/592: rename d7/d91 to d7/d99/d60/d78/d7f/dcb 0 2024-03-19T06:06:05.778 INFO:tasks.workunit.client.0.smithi072.stdout:0/651: chown d1/d1c/f45 63 1 2024-03-19T06:06:05.778 INFO:tasks.workunit.client.0.smithi072.stdout:2/669: truncate db/d10/d2b/d2d/d9e/d48/d82/d98/fce 168569 0 2024-03-19T06:06:05.782 INFO:tasks.workunit.client.0.smithi072.stdout:4/804: getdents d5/d15/d31/d6f 0 2024-03-19T06:06:05.784 INFO:tasks.workunit.client.0.smithi072.stdout:0/652: symlink d1/d1c/d24/d27/d73/d80/d8b/ld3 0 2024-03-19T06:06:05.789 INFO:tasks.workunit.client.0.smithi072.stdout:0/653: creat d1/d1c/d24/d8f/fd4 x:0 0 0 2024-03-19T06:06:05.790 INFO:tasks.workunit.client.0.smithi072.stdout:4/805: fsync d5/d15/d31/d6d/f82 0 2024-03-19T06:06:05.796 INFO:tasks.workunit.client.0.smithi072.stdout:0/654: mkdir d1/d1c/d89/dd5 0 2024-03-19T06:06:05.802 INFO:tasks.workunit.client.0.smithi072.stdout:4/806: creat d5/d15/d3f/f119 x:0 0 0 2024-03-19T06:06:05.802 INFO:tasks.workunit.client.0.smithi072.stdout:0/655: fdatasync d1/d1c/d24/d8f/fd4 0 2024-03-19T06:06:05.802 INFO:tasks.workunit.client.0.smithi072.stdout:2/670: unlink db/d10/d2b/d2d/d9e/d48/d82/d98/fce 0 2024-03-19T06:06:05.805 INFO:tasks.workunit.client.0.smithi072.stdout:0/656: truncate d1/d1c/d24/f97 1829412 0 2024-03-19T06:06:05.806 INFO:tasks.workunit.client.0.smithi072.stdout:2/671: chown db/d10/d13/c7e 16 1 2024-03-19T06:06:05.807 INFO:tasks.workunit.client.0.smithi072.stdout:4/807: getdents d5/d15/d22/d41/d7b/d7c/db4/dc7 0 2024-03-19T06:06:05.812 INFO:tasks.workunit.client.0.smithi072.stdout:0/657: rmdir d1/d1c/d24/d27/d7e 39 2024-03-19T06:06:05.822 INFO:tasks.workunit.client.0.smithi072.stdout:6/593: dread d7/d9/f1a [0,4194304] 0 2024-03-19T06:06:05.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:05 smithi072 ceph-mon[28706]: pgmap v29: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 156 MiB/s wr, 361 op/s 2024-03-19T06:06:05.829 INFO:tasks.workunit.client.0.smithi072.stdout:6/594: symlink d7/d9/d1b/d31/lcc 0 2024-03-19T06:06:05.834 INFO:tasks.workunit.client.0.smithi072.stdout:6/595: symlink d7/d9/d1b/d21/d68/lcd 0 2024-03-19T06:06:05.839 INFO:tasks.workunit.client.0.smithi072.stdout:2/672: dwrite db/d10/d13/d31/f70 [0,4194304] 0 2024-03-19T06:06:05.848 INFO:tasks.workunit.client.0.smithi072.stdout:2/673: mkdir db/d10/d13/d31/d35/ddc/de1 0 2024-03-19T06:06:05.854 INFO:tasks.workunit.client.0.smithi072.stdout:2/674: mknod db/d10/d13/d24/d61/ce2 0 2024-03-19T06:06:05.856 INFO:tasks.workunit.client.0.smithi072.stdout:4/808: dread d5/d15/d22/f9a [0,4194304] 0 2024-03-19T06:06:05.859 INFO:tasks.workunit.client.0.smithi072.stdout:4/809: write d5/d37/f69 [4010810,105392] 0 2024-03-19T06:06:05.863 INFO:tasks.workunit.client.0.smithi072.stdout:6/596: dwrite d7/d9/d1b/d33/d41/d45/f5c [0,4194304] 0 2024-03-19T06:06:05.871 INFO:tasks.workunit.client.0.smithi072.stdout:4/810: rename d5/d15/d31/d4c/c5c to d5/d32/d58/c11a 0 2024-03-19T06:06:05.872 INFO:tasks.workunit.client.0.smithi072.stdout:6/597: creat d7/d9/d1b/fce x:0 0 0 2024-03-19T06:06:05.873 INFO:tasks.workunit.client.0.smithi072.stdout:4/811: chown d5/d15/d31/f3c 4891266 1 2024-03-19T06:06:05.877 INFO:tasks.workunit.client.0.smithi072.stdout:4/812: rmdir d5/d15/d22/d41/d7b/d7c/db4/dc7 39 2024-03-19T06:06:05.880 INFO:tasks.workunit.client.0.smithi072.stdout:6/598: creat d7/d9/d1b/d21/fcf x:0 0 0 2024-03-19T06:06:05.880 INFO:tasks.workunit.client.0.smithi072.stdout:4/813: symlink d5/d8a/l11b 0 2024-03-19T06:06:05.884 INFO:tasks.workunit.client.0.smithi072.stdout:6/599: creat d7/d3f/d44/fd0 x:0 0 0 2024-03-19T06:06:05.885 INFO:tasks.workunit.client.0.smithi072.stdout:4/814: read d5/d15/d31/fcb [272812,83223] 0 2024-03-19T06:06:05.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:05 smithi172 ceph-mon[35716]: pgmap v29: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 156 MiB/s wr, 361 op/s 2024-03-19T06:06:05.913 INFO:tasks.workunit.client.0.smithi072.stdout:4/815: dread d5/d1b/fa7 [4194304,4194304] 0 2024-03-19T06:06:05.926 INFO:tasks.workunit.client.0.smithi072.stdout:4/816: dwrite d5/d11/f98 [0,4194304] 0 2024-03-19T06:06:05.933 INFO:tasks.workunit.client.0.smithi072.stdout:4/817: dread d5/d1b/f5d [0,4194304] 0 2024-03-19T06:06:05.940 INFO:tasks.workunit.client.0.smithi072.stdout:4/818: creat d5/d15/d22/d41/d7b/d7c/db4/f11c x:0 0 0 2024-03-19T06:06:05.944 INFO:tasks.workunit.client.0.smithi072.stdout:4/819: mkdir d5/d15/d22/d11d 0 2024-03-19T06:06:05.948 INFO:tasks.workunit.client.0.smithi072.stdout:4/820: getdents d5/d15/d73 0 2024-03-19T06:06:05.950 INFO:tasks.workunit.client.0.smithi072.stdout:4/821: mknod d5/d15/da6/c11e 0 2024-03-19T06:06:05.997 INFO:tasks.workunit.client.0.smithi072.stdout:3/638: sync 2024-03-19T06:06:06.013 INFO:tasks.workunit.client.0.smithi072.stdout:3/639: dread d2/d3/d15/d66/d6b/d79/f83 [0,4194304] 0 2024-03-19T06:06:06.016 INFO:tasks.workunit.client.0.smithi072.stdout:4/822: write d5/d15/d31/d7d/f7f [4127949,97105] 0 2024-03-19T06:06:06.020 INFO:tasks.workunit.client.0.smithi072.stdout:2/675: dwrite db/f30 [0,4194304] 0 2024-03-19T06:06:06.023 INFO:tasks.workunit.client.0.smithi072.stdout:2/676: chown db/d10/d13/d24/d61/ce2 114 1 2024-03-19T06:06:06.025 INFO:tasks.workunit.client.0.smithi072.stdout:4/823: creat d5/d15/d22/d41/d61/f11f x:0 0 0 2024-03-19T06:06:06.030 INFO:tasks.workunit.client.0.smithi072.stdout:3/640: link d2/c24 d2/d3/d15/d66/d6b/db2/cd7 0 2024-03-19T06:06:06.031 INFO:tasks.workunit.client.0.smithi072.stdout:2/677: creat db/d10/d2b/d2d/d9e/fe3 x:0 0 0 2024-03-19T06:06:06.033 INFO:tasks.workunit.client.0.smithi072.stdout:4/824: creat d5/d15/d22/d41/f120 x:0 0 0 2024-03-19T06:06:06.037 INFO:tasks.workunit.client.0.smithi072.stdout:3/641: getdents d2/d3/d26/d92 0 2024-03-19T06:06:06.038 INFO:tasks.workunit.client.0.smithi072.stdout:4/825: creat d5/d15/d31/d7d/d91/f121 x:0 0 0 2024-03-19T06:06:06.039 INFO:tasks.workunit.client.0.smithi072.stdout:2/678: symlink db/d10/d2b/d2d/d9e/dab/dca/le4 0 2024-03-19T06:06:06.040 INFO:tasks.workunit.client.0.smithi072.stdout:3/642: write d2/d40/d78/f9a [548387,63467] 0 2024-03-19T06:06:06.046 INFO:tasks.workunit.client.0.smithi072.stdout:2/679: chown db/d10/d13/d24/d61/ce2 39070 1 2024-03-19T06:06:06.046 INFO:tasks.workunit.client.0.smithi072.stdout:3/643: write d2/d19/d1e/fc3 [3668205,29418] 0 2024-03-19T06:06:06.046 INFO:tasks.workunit.client.0.smithi072.stdout:3/644: write d2/d19/f52 [835824,8558] 0 2024-03-19T06:06:06.050 INFO:tasks.workunit.client.0.smithi072.stdout:2/680: creat db/d10/d2b/d45/da4/dd1/fe5 x:0 0 0 2024-03-19T06:06:06.051 INFO:tasks.workunit.client.0.smithi072.stdout:3/645: symlink d2/d40/d78/d9b/ld8 0 2024-03-19T06:06:06.059 INFO:tasks.workunit.client.0.smithi072.stdout:3/646: chown d2/d19/d1e/l33 1974 1 2024-03-19T06:06:06.065 INFO:tasks.workunit.client.0.smithi072.stdout:4/826: dwrite d5/d15/d31/d4c/f75 [0,4194304] 0 2024-03-19T06:06:06.075 INFO:tasks.workunit.client.0.smithi072.stdout:2/681: truncate db/f38 3052461 0 2024-03-19T06:06:06.076 INFO:tasks.workunit.client.0.smithi072.stdout:3/647: symlink d2/d19/db0/ld9 0 2024-03-19T06:06:06.078 INFO:tasks.workunit.client.0.smithi072.stdout:4/827: fdatasync d5/d15/d3f/dc1/f99 0 2024-03-19T06:06:06.080 INFO:tasks.workunit.client.0.smithi072.stdout:3/648: mknod d2/d3/d15/cda 0 2024-03-19T06:06:06.082 INFO:tasks.workunit.client.0.smithi072.stdout:4/828: mkdir d5/d15/d22/d95/d104/d122 0 2024-03-19T06:06:06.083 INFO:tasks.workunit.client.0.smithi072.stdout:3/649: unlink d2/d3/d26/d98/ld0 0 2024-03-19T06:06:06.085 INFO:tasks.workunit.client.0.smithi072.stdout:4/829: symlink d5/d15/d22/d41/d7b/d7c/l123 0 2024-03-19T06:06:06.085 INFO:tasks.workunit.client.0.smithi072.stdout:3/650: write d2/d19/d1e/fc3 [702148,104700] 0 2024-03-19T06:06:06.088 INFO:tasks.workunit.client.0.smithi072.stdout:4/830: write d5/d15/d3f/dc1/fec [1027461,6076] 0 2024-03-19T06:06:06.089 INFO:tasks.workunit.client.0.smithi072.stdout:3/651: creat d2/d3/d26/d98/fdb x:0 0 0 2024-03-19T06:06:06.092 INFO:tasks.workunit.client.0.smithi072.stdout:4/831: creat d5/d8a/f124 x:0 0 0 2024-03-19T06:06:06.096 INFO:tasks.workunit.client.0.smithi072.stdout:3/652: creat d2/d3/d15/d66/fdc x:0 0 0 2024-03-19T06:06:06.098 INFO:tasks.workunit.client.0.smithi072.stdout:3/653: chown d2/d3/d25/lb6 1 1 2024-03-19T06:06:06.103 INFO:tasks.workunit.client.0.smithi072.stdout:3/654: creat d2/d40/d78/d9b/dc5/fdd x:0 0 0 2024-03-19T06:06:06.105 INFO:tasks.workunit.client.0.smithi072.stdout:3/655: symlink d2/d3/d26/d98/lde 0 2024-03-19T06:06:06.108 INFO:tasks.workunit.client.0.smithi072.stdout:4/832: write d5/d15/faf [655649,8746] 0 2024-03-19T06:06:06.110 INFO:tasks.workunit.client.0.smithi072.stdout:3/656: mknod d2/d3/d15/d66/d6b/d79/cdf 0 2024-03-19T06:06:06.113 INFO:tasks.workunit.client.0.smithi072.stdout:3/657: read d2/d3/d26/f59 [2446208,46268] 0 2024-03-19T06:06:06.114 INFO:tasks.workunit.client.0.smithi072.stdout:2/682: dread db/d10/d2b/d2d/d9e/d48/f7b [0,4194304] 0 2024-03-19T06:06:06.126 INFO:tasks.workunit.client.0.smithi072.stdout:3/658: dwrite d2/d3/d26/f35 [0,4194304] 0 2024-03-19T06:06:06.128 INFO:tasks.workunit.client.0.smithi072.stdout:3/659: fsync d2/d3/d26/d98/fdb 0 2024-03-19T06:06:06.131 INFO:tasks.workunit.client.0.smithi072.stdout:3/660: read - d2/d3/d15/d66/fdc zero size 2024-03-19T06:06:06.132 INFO:tasks.workunit.client.0.smithi072.stdout:2/683: dwrite db/d10/d13/d31/d35/ddc/fbe [0,4194304] 0 2024-03-19T06:06:06.150 INFO:tasks.workunit.client.0.smithi072.stdout:2/684: dwrite db/d10/d2b/d2d/fa2 [4194304,4194304] 0 2024-03-19T06:06:06.154 INFO:tasks.workunit.client.0.smithi072.stdout:2/685: unlink db/d10/d2b/d2d/d9e/d48/f87 0 2024-03-19T06:06:06.162 INFO:tasks.workunit.client.0.smithi072.stdout:2/686: rename db/d10/d44/l92 to db/d10/d2b/d2d/d62/le6 0 2024-03-19T06:06:06.165 INFO:tasks.workunit.client.0.smithi072.stdout:2/687: unlink db/d10/d2b/d2d/d6a/fba 0 2024-03-19T06:06:06.175 INFO:tasks.workunit.client.0.smithi072.stdout:2/688: rmdir db/d10/d44 39 2024-03-19T06:06:06.177 INFO:tasks.workunit.client.0.smithi072.stdout:2/689: chown db/d10/d13/d31/d35/ddc/de1 316828608 1 2024-03-19T06:06:06.191 INFO:tasks.workunit.client.0.smithi072.stdout:2/690: dwrite db/d10/d2b/d2d/d66/f97 [0,4194304] 0 2024-03-19T06:06:06.200 INFO:tasks.workunit.client.0.smithi072.stdout:2/691: write db/d10/f2e [1724076,122317] 0 2024-03-19T06:06:06.205 INFO:tasks.workunit.client.0.smithi072.stdout:2/692: creat db/d10/d2b/d2d/d9e/d48/d82/d98/dbf/fe7 x:0 0 0 2024-03-19T06:06:06.211 INFO:tasks.workunit.client.0.smithi072.stdout:2/693: dread db/d10/d13/d24/d72/f74 [0,4194304] 0 2024-03-19T06:06:06.213 INFO:tasks.workunit.client.0.smithi072.stdout:2/694: stat db/d10/d13/d24/d72/f74 0 2024-03-19T06:06:06.216 INFO:tasks.workunit.client.0.smithi072.stdout:2/695: readlink db/d10/d2b/l56 0 2024-03-19T06:06:06.219 INFO:tasks.workunit.client.0.smithi072.stdout:2/696: mknod db/d10/d2b/d2d/d77/ce8 0 2024-03-19T06:06:06.221 INFO:tasks.workunit.client.0.smithi072.stdout:2/697: write db/d10/d2b/d45/da4/fdd [867935,96146] 0 2024-03-19T06:06:06.226 INFO:tasks.workunit.client.0.smithi072.stdout:2/698: mkdir db/d10/d2b/d2d/d9e/d48/dd9/de9 0 2024-03-19T06:06:06.236 INFO:tasks.workunit.client.0.smithi072.stdout:2/699: write db/d10/d2b/f9a [1147161,103091] 0 2024-03-19T06:06:06.238 INFO:tasks.workunit.client.0.smithi072.stdout:2/700: readlink db/d10/d2b/d2d/d9e/d48/l84 0 2024-03-19T06:06:06.245 INFO:tasks.workunit.client.0.smithi072.stdout:2/701: write db/d10/d2b/d2d/d62/d6b/f71 [2101495,38880] 0 2024-03-19T06:06:06.247 INFO:tasks.workunit.client.0.smithi072.stdout:2/702: chown db/d10/d13/d24/f75 5469217 1 2024-03-19T06:06:06.252 INFO:tasks.workunit.client.0.smithi072.stdout:2/703: creat db/d10/d2b/dc3/fea x:0 0 0 2024-03-19T06:06:06.266 INFO:tasks.workunit.client.0.smithi072.stdout:2/704: dread db/f4f [0,4194304] 0 2024-03-19T06:06:06.270 INFO:tasks.workunit.client.0.smithi072.stdout:2/705: read db/d10/d2b/d2d/d9e/d48/d82/d98/dbf/fc4 [1131,97892] 0 2024-03-19T06:06:06.277 INFO:tasks.workunit.client.0.smithi072.stdout:2/706: creat db/d10/d2b/d2d/d9e/d48/d82/d98/dbf/dd5/feb x:0 0 0 2024-03-19T06:06:06.280 INFO:tasks.workunit.client.0.smithi072.stdout:2/707: read - db/d10/d2b/d2d/d9e/d48/d82/d98/dbf/fe7 zero size 2024-03-19T06:06:06.285 INFO:tasks.workunit.client.0.smithi072.stdout:2/708: symlink db/d10/d2b/d2d/d9e/d48/dd9/de9/lec 0 2024-03-19T06:06:06.290 INFO:tasks.workunit.client.0.smithi072.stdout:2/709: chown db/d10/d44/caa 1646 1 2024-03-19T06:06:06.318 INFO:tasks.workunit.client.0.smithi072.stdout:2/710: dwrite db/d10/d2b/d45/f58 [4194304,4194304] 0 2024-03-19T06:06:06.324 INFO:tasks.workunit.client.0.smithi072.stdout:2/711: fsync db/d10/d13/d24/d72/f81 0 2024-03-19T06:06:06.348 INFO:tasks.workunit.client.0.smithi072.stdout:2/712: dwrite db/d10/d2b/d2d/d66/f6f [0,4194304] 0 2024-03-19T06:06:06.373 INFO:tasks.workunit.client.0.smithi072.stdout:2/713: dwrite db/d10/d13/d24/f5f [0,4194304] 0 2024-03-19T06:06:06.375 INFO:tasks.workunit.client.0.smithi072.stdout:2/714: fdatasync db/d10/d2b/d2d/d77/f96 0 2024-03-19T06:06:06.378 INFO:tasks.workunit.client.0.smithi072.stdout:2/715: write db/d10/d2b/d2d/d9e/f42 [153124,95256] 0 2024-03-19T06:06:06.382 INFO:tasks.workunit.client.0.smithi072.stdout:2/716: write db/d10/d2b/d2d/d66/f93 [892013,37299] 0 2024-03-19T06:06:06.387 INFO:tasks.workunit.client.0.smithi072.stdout:2/717: creat db/d10/d2b/dc3/fed x:0 0 0 2024-03-19T06:06:06.389 INFO:tasks.workunit.client.0.smithi072.stdout:2/718: write db/f30 [4255112,37367] 0 2024-03-19T06:06:06.394 INFO:tasks.workunit.client.0.smithi072.stdout:2/719: symlink db/d10/d44/lee 0 2024-03-19T06:06:06.400 INFO:tasks.workunit.client.0.smithi072.stdout:2/720: symlink db/d10/d2b/d2d/d6a/lef 0 2024-03-19T06:06:06.422 INFO:tasks.workunit.client.0.smithi072.stdout:2/721: dwrite db/d10/d2b/d2d/d62/d6b/f71 [0,4194304] 0 2024-03-19T06:06:06.434 INFO:tasks.workunit.client.0.smithi072.stdout:2/722: dread db/d10/d2b/d2d/d77/f96 [0,4194304] 0 2024-03-19T06:06:06.447 INFO:tasks.workunit.client.0.smithi072.stdout:5/745: sync 2024-03-19T06:06:06.454 INFO:tasks.workunit.client.0.smithi072.stdout:5/746: rmdir df/d54 39 2024-03-19T06:06:06.459 INFO:tasks.workunit.client.0.smithi072.stdout:2/723: rmdir db/d10/d2b/dc3 39 2024-03-19T06:06:06.473 INFO:tasks.workunit.client.0.smithi072.stdout:2/724: truncate db/f22 579529 0 2024-03-19T06:06:06.475 INFO:tasks.workunit.client.0.smithi072.stdout:2/725: chown l3 11 1 2024-03-19T06:06:06.483 INFO:tasks.workunit.client.0.smithi072.stdout:2/726: creat db/d10/d2b/d2d/d66/ff0 x:0 0 0 2024-03-19T06:06:06.488 INFO:tasks.workunit.client.0.smithi072.stdout:5/747: dread df/d13/d32/f3a [0,4194304] 0 2024-03-19T06:06:06.490 INFO:tasks.workunit.client.0.smithi072.stdout:2/727: creat db/d10/d12/ff1 x:0 0 0 2024-03-19T06:06:06.493 INFO:tasks.workunit.client.0.smithi072.stdout:5/748: readlink df/d13/d32/d28/d42/d59/d43/d62/l7d 0 2024-03-19T06:06:06.498 INFO:tasks.workunit.client.0.smithi072.stdout:5/749: mknod df/d14/ce2 0 2024-03-19T06:06:06.525 INFO:tasks.workunit.client.0.smithi072.stdout:2/728: dwrite db/d10/d13/d24/d61/d7d/f95 [0,4194304] 0 2024-03-19T06:06:06.532 INFO:tasks.workunit.client.0.smithi072.stdout:2/729: write db/d10/d2b/d45/da4/dd1/fe5 [568198,3420] 0 2024-03-19T06:06:06.545 INFO:tasks.workunit.client.0.smithi072.stdout:2/730: rename db/d10/d2b/d2d/d66/lb3 to db/d10/d13/d24/d72/d86/dde/lf2 0 2024-03-19T06:06:06.550 INFO:tasks.workunit.client.0.smithi072.stdout:2/731: chown db/d10/d13/d31/f70 361 1 2024-03-19T06:06:06.553 INFO:tasks.workunit.client.0.smithi072.stdout:2/732: read db/d10/d13/d24/d72/f74 [91223,129677] 0 2024-03-19T06:06:06.559 INFO:tasks.workunit.client.0.smithi072.stdout:2/733: unlink db/d10/d13/d24/l91 0 2024-03-19T06:06:06.563 INFO:tasks.workunit.client.0.smithi072.stdout:2/734: chown db/d10/d13/d31/d35/ddc/fbe 2001 1 2024-03-19T06:06:06.565 INFO:tasks.workunit.client.0.smithi072.stdout:2/735: fdatasync db/d10/f2e 0 2024-03-19T06:06:06.573 INFO:tasks.workunit.client.0.smithi072.stdout:2/736: creat db/d10/d13/d31/d35/ff3 x:0 0 0 2024-03-19T06:06:06.577 INFO:tasks.workunit.client.0.smithi072.stdout:2/737: readlink db/d10/d44/lee 0 2024-03-19T06:06:06.590 INFO:tasks.workunit.client.0.smithi072.stdout:5/750: truncate df/d14/f9a 2109528 0 2024-03-19T06:06:06.596 INFO:tasks.workunit.client.0.smithi072.stdout:5/751: write df/d13/d32/d28/d42/d59/d43/f75 [3964116,14336] 0 2024-03-19T06:06:06.645 INFO:tasks.workunit.client.0.smithi072.stdout:9/598: sync 2024-03-19T06:06:06.661 INFO:tasks.workunit.client.0.smithi072.stdout:9/599: link d11/f44 d11/d78/fcf 0 2024-03-19T06:06:06.676 INFO:tasks.workunit.client.0.smithi072.stdout:9/600: creat d11/d24/d4c/dcd/fd0 x:0 0 0 2024-03-19T06:06:06.685 INFO:tasks.workunit.client.0.smithi072.stdout:9/601: creat d11/d1f/d2a/d36/fd1 x:0 0 0 2024-03-19T06:06:06.687 INFO:tasks.workunit.client.0.smithi072.stdout:2/738: truncate db/d10/d2b/d2d/d62/d6b/f8a 3308700 0 2024-03-19T06:06:06.688 INFO:tasks.workunit.client.0.smithi072.stdout:9/602: dread - d11/d24/d4c/dcd/fd0 zero size 2024-03-19T06:06:06.691 INFO:tasks.workunit.client.0.smithi072.stdout:2/739: chown db/d10/d2b/d2d/d9e/d48 27822584 1 2024-03-19T06:06:06.692 INFO:tasks.workunit.client.0.smithi072.stdout:5/752: write df/f69 [3272305,11445] 0 2024-03-19T06:06:06.694 INFO:tasks.workunit.client.0.smithi072.stdout:9/603: readlink d11/d24/d4c/d64/l97 0 2024-03-19T06:06:06.696 INFO:tasks.workunit.client.0.smithi072.stdout:2/740: chown db/d10/d13/l69 612 1 2024-03-19T06:06:06.697 INFO:tasks.workunit.client.0.smithi072.stdout:5/753: chown df/d13/d24/c50 231503 1 2024-03-19T06:06:06.699 INFO:tasks.workunit.client.0.smithi072.stdout:9/604: symlink d11/d4b/ld2 0 2024-03-19T06:06:06.703 INFO:tasks.workunit.client.0.smithi072.stdout:5/754: chown df/d54/dac/d9c/fbf 229332619 1 2024-03-19T06:06:06.705 INFO:tasks.workunit.client.0.smithi072.stdout:9/605: mknod d11/d1f/d2a/d68/d79/cd3 0 2024-03-19T06:06:06.706 INFO:tasks.workunit.client.0.smithi072.stdout:2/741: mkdir db/d10/d13/df4 0 2024-03-19T06:06:06.713 INFO:tasks.workunit.client.0.smithi072.stdout:5/755: mkdir df/d13/d32/d28/d42/d59/d43/d4e/d5c/de3 0 2024-03-19T06:06:06.714 INFO:tasks.workunit.client.0.smithi072.stdout:2/742: mkdir db/d10/d2b/d2d/d9e/dab/dca/df5 0 2024-03-19T06:06:06.717 INFO:tasks.workunit.client.0.smithi072.stdout:9/606: link d11/d1f/d2a/d6f/f94 d11/d1f/d2a/d68/d92/dc0/fd4 0 2024-03-19T06:06:06.718 INFO:tasks.workunit.client.0.smithi072.stdout:5/756: symlink df/d54/dac/d7e/le4 0 2024-03-19T06:06:06.720 INFO:tasks.workunit.client.0.smithi072.stdout:9/607: fsync d11/d1f/d2a/d36/d45/d4d/fc6 0 2024-03-19T06:06:06.722 INFO:tasks.workunit.client.0.smithi072.stdout:2/743: rename db/d10/d13/d24/d61/d7d/fa9 to db/d10/d2b/d2d/d9e/dab/dca/ff6 0 2024-03-19T06:06:06.723 INFO:tasks.workunit.client.0.smithi072.stdout:9/608: chown d11/d1f/d2a/d36/d3e/f5d 2 1 2024-03-19T06:06:06.726 INFO:tasks.workunit.client.0.smithi072.stdout:9/609: symlink d11/d1f/d43/ld5 0 2024-03-19T06:06:06.735 INFO:tasks.workunit.client.0.smithi072.stdout:9/610: dread d11/d1f/d2a/d36/f53 [0,4194304] 0 2024-03-19T06:06:06.743 INFO:tasks.workunit.client.0.smithi072.stdout:5/757: dwrite df/d13/d32/d28/d42/d59/d43/f75 [0,4194304] 0 2024-03-19T06:06:06.745 INFO:tasks.workunit.client.0.smithi072.stdout:5/758: read - df/d13/d32/d28/fd2 zero size 2024-03-19T06:06:06.747 INFO:tasks.workunit.client.0.smithi072.stdout:2/744: dread db/d10/d59/f8d [0,4194304] 0 2024-03-19T06:06:06.755 INFO:tasks.workunit.client.0.smithi072.stdout:5/759: write df/d3c/f68 [3015262,121160] 0 2024-03-19T06:06:06.759 INFO:tasks.workunit.client.0.smithi072.stdout:2/745: dread db/d10/d59/f8d [0,4194304] 0 2024-03-19T06:06:06.761 INFO:tasks.workunit.client.0.smithi072.stdout:5/760: mknod df/d13/d32/d28/d42/ce5 0 2024-03-19T06:06:06.765 INFO:tasks.workunit.client.0.smithi072.stdout:2/746: mknod db/d10/d13/d31/cf7 0 2024-03-19T06:06:06.768 INFO:tasks.workunit.client.0.smithi072.stdout:5/761: mknod df/d54/dac/d9c/da0/ce6 0 2024-03-19T06:06:06.768 INFO:tasks.workunit.client.0.smithi072.stdout:2/747: stat db/d10/d13/d31/f70 0 2024-03-19T06:06:06.769 INFO:tasks.workunit.client.0.smithi072.stdout:9/611: dwrite d11/f25 [0,4194304] 0 2024-03-19T06:06:06.772 INFO:tasks.workunit.client.0.smithi072.stdout:5/762: fdatasync df/f5b 0 2024-03-19T06:06:06.774 INFO:tasks.workunit.client.0.smithi072.stdout:9/612: rename c4 to d11/d24/d4c/d64/cd6 0 2024-03-19T06:06:06.777 INFO:tasks.workunit.client.0.smithi072.stdout:2/748: creat db/d10/d2b/d2d/d9e/dab/dca/df5/ff8 x:0 0 0 2024-03-19T06:06:06.780 INFO:tasks.workunit.client.0.smithi072.stdout:2/749: dread - db/d10/d2b/d2d/d9e/fe3 zero size 2024-03-19T06:06:06.785 INFO:tasks.workunit.client.0.smithi072.stdout:9/613: creat d11/d1f/d2a/d6f/d87/da4/fd7 x:0 0 0 2024-03-19T06:06:06.787 INFO:tasks.workunit.client.0.smithi072.stdout:2/750: read - db/d10/d2b/d2d/d9e/d48/d82/d98/dbf/dd5/feb zero size 2024-03-19T06:06:06.787 INFO:tasks.workunit.client.0.smithi072.stdout:5/763: fdatasync df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97/fa6 0 2024-03-19T06:06:06.791 INFO:tasks.workunit.client.0.smithi072.stdout:8/604: sync 2024-03-19T06:06:06.793 INFO:tasks.workunit.client.0.smithi072.stdout:5/764: write df/d13/d32/d28/f81 [280257,24963] 0 2024-03-19T06:06:06.798 INFO:tasks.workunit.client.0.smithi072.stdout:9/614: link d11/d1f/d2a/cba d11/cd8 0 2024-03-19T06:06:06.815 INFO:tasks.workunit.client.0.smithi072.stdout:5/765: dread df/d13/d32/d28/d42/d59/fc5 [0,4194304] 0 2024-03-19T06:06:06.818 INFO:tasks.workunit.client.0.smithi072.stdout:2/751: dwrite db/d10/d2b/d2d/d9e/d48/d82/f99 [4194304,4194304] 0 2024-03-19T06:06:06.822 INFO:tasks.workunit.client.0.smithi072.stdout:8/605: dwrite da/d13/d3f/dac/fb6 [0,4194304] 0 2024-03-19T06:06:06.837 INFO:tasks.workunit.client.0.smithi072.stdout:8/606: rmdir da/d13/d14/d1b/d6b 39 2024-03-19T06:06:06.842 INFO:tasks.workunit.client.0.smithi072.stdout:7/508: sync 2024-03-19T06:06:06.842 INFO:tasks.workunit.client.0.smithi072.stdout:0/658: sync 2024-03-19T06:06:06.842 INFO:tasks.workunit.client.0.smithi072.stdout:4/833: sync 2024-03-19T06:06:06.842 INFO:tasks.workunit.client.0.smithi072.stdout:6/600: sync 2024-03-19T06:06:06.842 INFO:tasks.workunit.client.0.smithi072.stdout:3/661: sync 2024-03-19T06:06:06.842 INFO:tasks.workunit.client.0.smithi072.stdout:1/629: sync 2024-03-19T06:06:06.848 INFO:tasks.workunit.client.0.smithi072.stdout:8/607: mknod da/d13/cc9 0 2024-03-19T06:06:06.849 INFO:tasks.workunit.client.0.smithi072.stdout:6/601: chown d7/d9/d2b/c43 1 1 2024-03-19T06:06:06.849 INFO:tasks.workunit.client.0.smithi072.stdout:0/659: read - d1/d1c/d89/d9c/fd1 zero size 2024-03-19T06:06:06.850 INFO:tasks.workunit.client.0.smithi072.stdout:9/615: dread d11/f12 [0,4194304] 0 2024-03-19T06:06:06.851 INFO:tasks.workunit.client.0.smithi072.stdout:4/834: creat d5/d8a/f125 x:0 0 0 2024-03-19T06:06:06.853 INFO:tasks.workunit.client.0.smithi072.stdout:7/509: mknod d2/d3/d18/c98 0 2024-03-19T06:06:06.855 INFO:tasks.workunit.client.0.smithi072.stdout:8/608: unlink da/d27/f47 0 2024-03-19T06:06:06.858 INFO:tasks.workunit.client.0.smithi072.stdout:5/766: dwrite fb [0,4194304] 0 2024-03-19T06:06:06.860 INFO:tasks.workunit.client.0.smithi072.stdout:2/752: write db/f38 [996762,11759] 0 2024-03-19T06:06:06.861 INFO:tasks.workunit.client.0.smithi072.stdout:0/660: symlink d1/d1c/d24/d27/d73/ld6 0 2024-03-19T06:06:06.864 INFO:tasks.workunit.client.0.smithi072.stdout:3/662: read d2/d19/f53 [431003,25351] 0 2024-03-19T06:06:06.868 INFO:tasks.workunit.client.0.smithi072.stdout:8/609: dread - da/d62/d75/d8d/fbe zero size 2024-03-19T06:06:06.870 INFO:tasks.workunit.client.0.smithi072.stdout:7/510: write d2/d3/d43/f4e [2355591,114263] 0 2024-03-19T06:06:06.872 INFO:tasks.workunit.client.0.smithi072.stdout:5/767: write df/d13/d32/d28/d42/fb3 [1072797,47462] 0 2024-03-19T06:06:06.875 INFO:tasks.workunit.client.0.smithi072.stdout:4/835: getdents d5/d37/de3/dfa 0 2024-03-19T06:06:06.878 INFO:tasks.workunit.client.0.smithi072.stdout:6/602: write d7/d9/d1b/d21/d68/daa/f87 [3127607,128672] 0 2024-03-19T06:06:06.878 INFO:tasks.workunit.client.0.smithi072.stdout:4/836: dread - d5/d8a/f125 zero size 2024-03-19T06:06:06.879 INFO:tasks.workunit.client.0.smithi072.stdout:2/753: getdents db/d10/d13/df4 0 2024-03-19T06:06:06.881 INFO:tasks.workunit.client.0.smithi072.stdout:7/511: readlink d2/d3/d18/d33/d1d/l96 0 2024-03-19T06:06:06.883 INFO:tasks.workunit.client.0.smithi072.stdout:8/610: unlink da/d13/d14/f28 0 2024-03-19T06:06:06.885 INFO:tasks.workunit.client.0.smithi072.stdout:9/616: dread d11/f12 [0,4194304] 0 2024-03-19T06:06:06.885 INFO:tasks.workunit.client.0.smithi072.stdout:0/661: creat d1/d1c/fd7 x:0 0 0 2024-03-19T06:06:06.890 INFO:tasks.workunit.client.0.smithi072.stdout:4/837: mkdir d5/d15/d22/d95/d104/d126 0 2024-03-19T06:06:06.892 INFO:tasks.workunit.client.0.smithi072.stdout:5/768: chown df/d14/lbc 4 1 2024-03-19T06:06:06.894 INFO:tasks.workunit.client.0.smithi072.stdout:3/663: write d2/d3/d15/d66/d70/f7b [403030,18866] 0 2024-03-19T06:06:06.896 INFO:tasks.workunit.client.0.smithi072.stdout:2/754: symlink db/d10/d13/d24/d61/d7d/de0/lf9 0 2024-03-19T06:06:06.898 INFO:tasks.workunit.client.0.smithi072.stdout:5/769: dread - df/f64 zero size 2024-03-19T06:06:06.899 INFO:tasks.workunit.client.0.smithi072.stdout:0/662: creat d1/d1c/d82/fd8 x:0 0 0 2024-03-19T06:06:06.901 INFO:tasks.workunit.client.0.smithi072.stdout:8/611: creat da/d13/d14/d1b/d6b/fca x:0 0 0 2024-03-19T06:06:06.905 INFO:tasks.workunit.client.0.smithi072.stdout:1/630: dread d1/d11/d18/d19/d1a/d61/fac [0,4194304] 0 2024-03-19T06:06:06.905 INFO:tasks.workunit.client.0.smithi072.stdout:3/664: fdatasync d2/d40/d78/d9b/dc5/fdd 0 2024-03-19T06:06:06.907 INFO:tasks.workunit.client.0.smithi072.stdout:5/770: rmdir df/d16/dc4 39 2024-03-19T06:06:06.907 INFO:tasks.workunit.client.0.smithi072.stdout:8/612: read da/d27/faf [933048,24240] 0 2024-03-19T06:06:06.914 INFO:tasks.workunit.client.0.smithi072.stdout:0/663: creat d1/d2c/fd9 x:0 0 0 2024-03-19T06:06:06.915 INFO:tasks.workunit.client.0.smithi072.stdout:6/603: dwrite d7/d99/d60/d78/f8e [0,4194304] 0 2024-03-19T06:06:06.917 INFO:tasks.workunit.client.0.smithi072.stdout:3/665: creat d2/d19/d1e/fe0 x:0 0 0 2024-03-19T06:06:06.924 INFO:tasks.workunit.client.0.smithi072.stdout:8/613: unlink da/d27/d52/dbd/lc8 0 2024-03-19T06:06:06.926 INFO:tasks.workunit.client.0.smithi072.stdout:1/631: write d1/d11/d18/d19/d1a/d25/d3c/f3e [3745099,15923] 0 2024-03-19T06:06:06.927 INFO:tasks.workunit.client.0.smithi072.stdout:0/664: creat d1/d1c/d24/d27/d73/fda x:0 0 0 2024-03-19T06:06:06.930 INFO:tasks.workunit.client.0.smithi072.stdout:5/771: symlink df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97/le7 0 2024-03-19T06:06:06.930 INFO:tasks.workunit.client.0.smithi072.stdout:6/604: creat d7/d9/d1b/d21/d68/daa/d76/fd1 x:0 0 0 2024-03-19T06:06:06.934 INFO:tasks.workunit.client.0.smithi072.stdout:1/632: chown d1/d11/d18/d19/d1a/d25/faf 6554 1 2024-03-19T06:06:06.942 INFO:tasks.workunit.client.0.smithi072.stdout:2/755: dwrite db/d10/d2b/d2d/d9e/d48/d82/f94 [0,4194304] 0 2024-03-19T06:06:06.946 INFO:tasks.workunit.client.0.smithi072.stdout:5/772: getdents df/d14 0 2024-03-19T06:06:06.947 INFO:tasks.workunit.client.0.smithi072.stdout:7/512: dread d2/d3/d18/d33/d1d/d3b/d63/f8a [0,4194304] 0 2024-03-19T06:06:06.948 INFO:tasks.workunit.client.0.smithi072.stdout:1/633: creat d1/d11/d18/d19/d1a/d61/d65/fc6 x:0 0 0 2024-03-19T06:06:06.951 INFO:tasks.workunit.client.0.smithi072.stdout:6/605: rename d7/d9/d2b/l57 to d7/d99/d60/d78/d7f/ld2 0 2024-03-19T06:06:06.954 INFO:tasks.workunit.client.0.smithi072.stdout:9/617: dwrite d11/f1d [0,4194304] 0 2024-03-19T06:06:06.958 INFO:tasks.workunit.client.0.smithi072.stdout:0/665: write d1/d1c/d24/d27/d73/d80/d8b/f5b [4732298,41519] 0 2024-03-19T06:06:06.958 INFO:tasks.workunit.client.0.smithi072.stdout:6/606: unlink d7/d9/f1a 0 2024-03-19T06:06:06.961 INFO:tasks.workunit.client.0.smithi072.stdout:9/618: symlink d11/d9e/ld9 0 2024-03-19T06:06:06.968 INFO:tasks.workunit.client.0.smithi072.stdout:8/614: truncate da/d13/d14/d1b/f68 347365 0 2024-03-19T06:06:06.968 INFO:tasks.workunit.client.0.smithi072.stdout:5/773: rename df/d54/dac/d9c/da0/fb6 to df/d13/d32/d28/d42/d59/d43/d4e/dbd/fe8 0 2024-03-19T06:06:06.972 INFO:tasks.workunit.client.0.smithi072.stdout:6/607: write d7/d9/d1b/d3b/d9b/da4/db5/fc4 [998982,69229] 0 2024-03-19T06:06:06.973 INFO:tasks.workunit.client.0.smithi072.stdout:7/513: creat d2/d3/d18/d33/d1d/d2b/d3d/d21/f99 x:0 0 0 2024-03-19T06:06:06.977 INFO:tasks.workunit.client.0.smithi072.stdout:5/774: mknod df/d14/ce9 0 2024-03-19T06:06:06.977 INFO:tasks.workunit.client.0.smithi072.stdout:0/666: truncate d1/d2c/da1/d85/f94 1327059 0 2024-03-19T06:06:06.979 INFO:tasks.workunit.client.0.smithi072.stdout:8/615: mknod da/d62/d75/d8d/ccb 0 2024-03-19T06:06:06.980 INFO:tasks.workunit.client.0.smithi072.stdout:9/619: truncate d11/d78/fb2 251224 0 2024-03-19T06:06:06.983 INFO:tasks.workunit.client.0.smithi072.stdout:0/667: readlink d1/d2c/l3b 0 2024-03-19T06:06:06.987 INFO:tasks.workunit.client.0.smithi072.stdout:5/775: creat df/d54/fea x:0 0 0 2024-03-19T06:06:06.987 INFO:tasks.workunit.client.0.smithi072.stdout:1/634: dwrite d1/d11/d18/d19/d72/f7e [0,4194304] 0 2024-03-19T06:06:06.989 INFO:tasks.workunit.client.0.smithi072.stdout:7/514: truncate d2/d3/d18/d20/f71 4507722 0 2024-03-19T06:06:06.990 INFO:tasks.workunit.client.0.smithi072.stdout:2/756: dwrite db/d10/d2b/d2d/d66/ff0 [0,4194304] 0 2024-03-19T06:06:06.991 INFO:tasks.workunit.client.0.smithi072.stdout:8/616: write da/d13/d14/d6f/f84 [1422981,9691] 0 2024-03-19T06:06:06.994 INFO:tasks.workunit.client.0.smithi072.stdout:7/515: stat d2/d3/d18/d2f/l37 0 2024-03-19T06:06:06.996 INFO:tasks.workunit.client.0.smithi072.stdout:7/516: dread - d2/f93 zero size 2024-03-19T06:06:06.997 INFO:tasks.workunit.client.0.smithi072.stdout:3/666: dread d2/d3/fb [4194304,4194304] 0 2024-03-19T06:06:06.999 INFO:tasks.workunit.client.0.smithi072.stdout:6/608: getdents d7/d99/d60/d78/d7f 0 2024-03-19T06:06:07.002 INFO:tasks.workunit.client.0.smithi072.stdout:8/617: mknod da/d27/ccc 0 2024-03-19T06:06:07.002 INFO:tasks.workunit.client.0.smithi072.stdout:1/635: mkdir d1/d11/d18/d19/dc2/dc7 0 2024-03-19T06:06:07.002 INFO:tasks.workunit.client.0.smithi072.stdout:3/667: dread - d2/dbc/fc9 zero size 2024-03-19T06:06:07.007 INFO:tasks.workunit.client.0.smithi072.stdout:9/620: getdents d11/d1f/d2a/d6f/d87 0 2024-03-19T06:06:07.007 INFO:tasks.workunit.client.0.smithi072.stdout:2/757: write db/d10/d2b/d2d/d62/d6b/fcc [614672,65279] 0 2024-03-19T06:06:07.007 INFO:tasks.workunit.client.0.smithi072.stdout:8/618: chown da/d13/d14/d1b/ca1 1403934 1 2024-03-19T06:06:07.009 INFO:tasks.workunit.client.0.smithi072.stdout:6/609: creat d7/d99/d60/fd3 x:0 0 0 2024-03-19T06:06:07.013 INFO:tasks.workunit.client.0.smithi072.stdout:6/610: readlink d7/d3f/l63 0 2024-03-19T06:06:07.016 INFO:tasks.workunit.client.0.smithi072.stdout:8/619: creat da/d27/d52/d5b/d3e/d5a/fcd x:0 0 0 2024-03-19T06:06:07.016 INFO:tasks.workunit.client.0.smithi072.stdout:3/668: getdents d2/d40 0 2024-03-19T06:06:07.017 INFO:tasks.workunit.client.0.smithi072.stdout:1/636: unlink d1/d11/d18/d19/d1a/d61/d65/f6f 0 2024-03-19T06:06:07.021 INFO:tasks.workunit.client.0.smithi072.stdout:9/621: getdents d11/d24/d4c 0 2024-03-19T06:06:07.024 INFO:tasks.workunit.client.0.smithi072.stdout:6/611: mkdir d7/d99/d60/d78/d7f/dcb/d84/dc0/dd4 0 2024-03-19T06:06:07.024 INFO:tasks.workunit.client.0.smithi072.stdout:8/620: chown da/d13/d14/d1b/l24 5233 1 2024-03-19T06:06:07.026 INFO:tasks.workunit.client.0.smithi072.stdout:5/776: write df/d13/f23 [448844,120605] 0 2024-03-19T06:06:07.028 INFO:tasks.workunit.client.0.smithi072.stdout:6/612: write d7/f70 [1557621,122769] 0 2024-03-19T06:06:07.028 INFO:tasks.workunit.client.0.smithi072.stdout:3/669: write d2/f2f [2863984,27485] 0 2024-03-19T06:06:07.034 INFO:tasks.workunit.client.0.smithi072.stdout:9/622: rename d11/d1f/d2a to d11/d24/d4c/dda 0 2024-03-19T06:06:07.038 INFO:tasks.workunit.client.0.smithi072.stdout:1/637: rename d1/d11/d18 to d1/d11/d18/d19/d72/dc8 22 2024-03-19T06:06:07.038 INFO:tasks.workunit.client.0.smithi072.stdout:8/621: creat da/d13/d14/d1b/d6b/daa/fce x:0 0 0 2024-03-19T06:06:07.039 INFO:tasks.workunit.client.0.smithi072.stdout:5/777: rmdir df/d16/dc4 39 2024-03-19T06:06:07.040 INFO:tasks.workunit.client.0.smithi072.stdout:0/668: dread d1/f5 [4194304,4194304] 0 2024-03-19T06:06:07.040 INFO:tasks.workunit.client.0.smithi072.stdout:1/638: mknod d1/d11/cc9 0 2024-03-19T06:06:07.041 INFO:tasks.workunit.client.0.smithi072.stdout:7/517: dread d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/f35 [0,4194304] 0 2024-03-19T06:06:07.043 INFO:tasks.workunit.client.0.smithi072.stdout:3/670: mknod d2/d3/ce1 0 2024-03-19T06:06:07.044 INFO:tasks.workunit.client.0.smithi072.stdout:8/622: unlink da/f34 0 2024-03-19T06:06:07.047 INFO:tasks.workunit.client.0.smithi072.stdout:0/669: unlink d1/d1c/d24/c48 0 2024-03-19T06:06:07.049 INFO:tasks.workunit.client.0.smithi072.stdout:1/639: unlink d1/d11/d18/d19/d1a/d25/d3c/db8/lb9 0 2024-03-19T06:06:07.050 INFO:tasks.workunit.client.0.smithi072.stdout:9/623: link d11/d24/d4c/dda/d68/f73 d11/d1f/d43/fdb 0 2024-03-19T06:06:07.051 INFO:tasks.workunit.client.0.smithi072.stdout:6/613: truncate d7/d9/d30/f38 1161254 0 2024-03-19T06:06:07.053 INFO:tasks.workunit.client.0.smithi072.stdout:9/624: stat d11/d4b/d57/l5e 0 2024-03-19T06:06:07.055 INFO:tasks.workunit.client.0.smithi072.stdout:3/671: creat d2/d3/d15/d66/d70/fe2 x:0 0 0 2024-03-19T06:06:07.057 INFO:tasks.workunit.client.0.smithi072.stdout:7/518: mkdir d2/d3/d18/d33/d1d/d3b/d9a 0 2024-03-19T06:06:07.058 INFO:tasks.workunit.client.0.smithi072.stdout:7/519: dread - d2/f93 zero size 2024-03-19T06:06:07.064 INFO:tasks.workunit.client.0.smithi072.stdout:3/672: creat d2/d40/fe3 x:0 0 0 2024-03-19T06:06:07.066 INFO:tasks.workunit.client.0.smithi072.stdout:8/623: write da/f2d [818072,90499] 0 2024-03-19T06:06:07.068 INFO:tasks.workunit.client.0.smithi072.stdout:8/624: fdatasync da/d37/f73 0 2024-03-19T06:06:07.069 INFO:tasks.workunit.client.0.smithi072.stdout:9/625: dread d11/d24/d4c/dda/fab [0,4194304] 0 2024-03-19T06:06:07.071 INFO:tasks.workunit.client.0.smithi072.stdout:9/626: readlink d11/d4b/ld2 0 2024-03-19T06:06:07.078 INFO:tasks.workunit.client.0.smithi072.stdout:0/670: creat d1/fdb x:0 0 0 2024-03-19T06:06:07.079 INFO:tasks.workunit.client.0.smithi072.stdout:6/614: getdents d7/d99/d60/d78/d7f/dcb/d84/dc0/dd4 0 2024-03-19T06:06:07.079 INFO:tasks.workunit.client.0.smithi072.stdout:1/640: dread d1/f6 [0,4194304] 0 2024-03-19T06:06:07.080 INFO:tasks.workunit.client.0.smithi072.stdout:3/673: dread - d2/d3/d15/d66/d6b/f94 zero size 2024-03-19T06:06:07.081 INFO:tasks.workunit.client.0.smithi072.stdout:9/627: rmdir d11/d4b/d5c 39 2024-03-19T06:06:07.085 INFO:tasks.workunit.client.0.smithi072.stdout:0/671: dread - d1/d2c/f8a zero size 2024-03-19T06:06:07.086 INFO:tasks.workunit.client.0.smithi072.stdout:3/674: symlink d2/d40/le4 0 2024-03-19T06:06:07.086 INFO:tasks.workunit.client.0.smithi072.stdout:7/520: dwrite d2/f93 [0,4194304] 0 2024-03-19T06:06:07.086 INFO:tasks.workunit.client.0.smithi072.stdout:9/628: write d11/d24/f48 [2152560,88403] 0 2024-03-19T06:06:07.087 INFO:tasks.workunit.client.0.smithi072.stdout:8/625: getdents da/d37/d5c/d8e 0 2024-03-19T06:06:07.097 INFO:tasks.workunit.client.0.smithi072.stdout:3/675: symlink d2/d3/d15/d66/d6b/db2/le5 0 2024-03-19T06:06:07.098 INFO:tasks.workunit.client.0.smithi072.stdout:0/672: dread - d1/d1c/d82/d90/fbc zero size 2024-03-19T06:06:07.100 INFO:tasks.workunit.client.0.smithi072.stdout:8/626: link da/d13/d14/d1b/f78 da/d13/d3f/fcf 0 2024-03-19T06:06:07.100 INFO:tasks.workunit.client.0.smithi072.stdout:3/676: fsync d2/f60 0 2024-03-19T06:06:07.102 INFO:tasks.workunit.client.0.smithi072.stdout:7/521: mkdir d2/d3/d18/d33/d1d/d3b/d9a/d9b 0 2024-03-19T06:06:07.102 INFO:tasks.workunit.client.0.smithi072.stdout:8/627: dread - da/d27/d52/d5b/d3e/f8c zero size 2024-03-19T06:06:07.103 INFO:tasks.workunit.client.0.smithi072.stdout:0/673: symlink d1/d1c/d82/d90/ldc 0 2024-03-19T06:06:07.106 INFO:tasks.workunit.client.0.smithi072.stdout:7/522: write d2/d3/d17/f69 [934544,44319] 0 2024-03-19T06:06:07.106 INFO:tasks.workunit.client.0.smithi072.stdout:3/677: dread - d2/d3/d15/d66/d6b/d79/f91 zero size 2024-03-19T06:06:07.108 INFO:tasks.workunit.client.0.smithi072.stdout:1/641: write d1/d11/d18/d19/d1a/d25/d3c/d52/f7c [991697,53198] 0 2024-03-19T06:06:07.112 INFO:tasks.workunit.client.0.smithi072.stdout:8/628: rename da/d37/d5c/d8e/lab to da/d37/ld0 0 2024-03-19T06:06:07.113 INFO:tasks.workunit.client.0.smithi072.stdout:7/523: chown d2/d3/d17/l64 674974 1 2024-03-19T06:06:07.114 INFO:tasks.workunit.client.0.smithi072.stdout:0/674: read d1/d1c/d24/d27/d73/d80/d8b/f5b [3458216,89444] 0 2024-03-19T06:06:07.114 INFO:tasks.workunit.client.0.smithi072.stdout:3/678: mkdir d2/d3/d25/da5/de6 0 2024-03-19T06:06:07.115 INFO:tasks.workunit.client.0.smithi072.stdout:6/615: dread d7/d99/f35 [0,4194304] 0 2024-03-19T06:06:07.126 INFO:tasks.workunit.client.0.smithi072.stdout:1/642: creat d1/d11/d18/d19/d1a/d25/d3c/d79/fca x:0 0 0 2024-03-19T06:06:07.126 INFO:tasks.workunit.client.0.smithi072.stdout:8/629: stat da/d13/d3f/db9/dc1 0 2024-03-19T06:06:07.127 INFO:tasks.workunit.client.0.smithi072.stdout:9/629: dwrite d11/d24/d4c/dda/fab [0,4194304] 0 2024-03-19T06:06:07.129 INFO:tasks.workunit.client.0.smithi072.stdout:7/524: chown d2/d3/d18/d33/d1d/d2b/f6c 27646541 1 2024-03-19T06:06:07.130 INFO:tasks.workunit.client.0.smithi072.stdout:3/679: creat d2/d19/db0/fe7 x:0 0 0 2024-03-19T06:06:07.132 INFO:tasks.workunit.client.0.smithi072.stdout:7/525: chown d2/d3/fd 1248 1 2024-03-19T06:06:07.132 INFO:tasks.workunit.client.0.smithi072.stdout:8/630: chown da/d27/d52/d5b/d3e/d7f/ca2 574 1 2024-03-19T06:06:07.136 INFO:tasks.workunit.client.0.smithi072.stdout:6/616: rename d7/d9/d1b/d3b/f5e to d7/d9/d1b/d21/fd5 0 2024-03-19T06:06:07.136 INFO:tasks.workunit.client.0.smithi072.stdout:3/680: symlink d2/dc8/le8 0 2024-03-19T06:06:07.138 INFO:tasks.workunit.client.0.smithi072.stdout:7/526: read d2/d3/d18/d20/d3a/d50/f76 [3751828,111536] 0 2024-03-19T06:06:07.140 INFO:tasks.workunit.client.0.smithi072.stdout:9/630: rename d11/f1e to d11/d24/d4c/dda/d36/d45/dcb/fdc 0 2024-03-19T06:06:07.141 INFO:tasks.workunit.client.0.smithi072.stdout:3/681: stat d2/d40/ca9 0 2024-03-19T06:06:07.142 INFO:tasks.workunit.client.0.smithi072.stdout:9/631: stat d11/d4b/d57/fbb 0 2024-03-19T06:06:07.142 INFO:tasks.workunit.client.0.smithi072.stdout:7/527: dread - d2/d3/d18/d33/d83/f89 zero size 2024-03-19T06:06:07.145 INFO:tasks.workunit.client.0.smithi072.stdout:9/632: chown d11/d24/d4c/dcd 2216209 1 2024-03-19T06:06:07.146 INFO:tasks.workunit.client.0.smithi072.stdout:6/617: rename d7/d3f/l8f to d7/d3f/d65/ld6 0 2024-03-19T06:06:07.150 INFO:tasks.workunit.client.0.smithi072.stdout:1/643: truncate d1/d11/d18/f85 36633 0 2024-03-19T06:06:07.151 INFO:tasks.workunit.client.0.smithi072.stdout:3/682: getdents d2/d40 0 2024-03-19T06:06:07.156 INFO:tasks.workunit.client.0.smithi072.stdout:3/683: write d2/d3/d15/fba [1096379,22609] 0 2024-03-19T06:06:07.157 INFO:tasks.workunit.client.0.smithi072.stdout:8/631: dwrite da/f11 [4194304,4194304] 0 2024-03-19T06:06:07.157 INFO:tasks.workunit.client.0.smithi072.stdout:9/633: getdents d11/d24/d4c/dda/d6f 0 2024-03-19T06:06:07.162 INFO:tasks.workunit.client.0.smithi072.stdout:1/644: symlink d1/d11/d18/d19/d1a/d25/lcb 0 2024-03-19T06:06:07.163 INFO:tasks.workunit.client.0.smithi072.stdout:6/618: getdents d7/d9/d1b/d33/d41 0 2024-03-19T06:06:07.164 INFO:tasks.workunit.client.0.smithi072.stdout:7/528: truncate d2/d3/d18/d33/d1d/d2b/f4b 4185550 0 2024-03-19T06:06:07.168 INFO:tasks.workunit.client.0.smithi072.stdout:0/675: dread d1/f1b [0,4194304] 0 2024-03-19T06:06:07.172 INFO:tasks.workunit.client.0.smithi072.stdout:1/645: truncate d1/d11/d18/d19/d1a/f34 4941522 0 2024-03-19T06:06:07.172 INFO:tasks.workunit.client.0.smithi072.stdout:9/634: chown d11/d24/d4c/dda/d6f/d88/l9c 86732 1 2024-03-19T06:06:07.173 INFO:tasks.workunit.client.0.smithi072.stdout:7/529: mknod d2/d3/d17/d70/c9c 0 2024-03-19T06:06:07.175 INFO:tasks.workunit.client.0.smithi072.stdout:8/632: mkdir da/d27/dc2/dc6/dd1 0 2024-03-19T06:06:07.175 INFO:tasks.workunit.client.0.smithi072.stdout:0/676: rmdir d1/d1c/d24/d27/d73/d80/da8 39 2024-03-19T06:06:07.176 INFO:tasks.workunit.client.0.smithi072.stdout:7/530: chown d2/d3/d18/c98 74620 1 2024-03-19T06:06:07.177 INFO:tasks.workunit.client.0.smithi072.stdout:9/635: dread d11/d78/fb2 [0,4194304] 0 2024-03-19T06:06:07.181 INFO:tasks.workunit.client.0.smithi072.stdout:1/646: mknod d1/d11/d18/d19/d1a/d25/d3c/ccc 0 2024-03-19T06:06:07.183 INFO:tasks.workunit.client.0.smithi072.stdout:0/677: read - d1/d1c/d24/d8f/fd4 zero size 2024-03-19T06:06:07.185 INFO:tasks.workunit.client.0.smithi072.stdout:9/636: rename d11/d4b to d11/d24/ddd 0 2024-03-19T06:06:07.189 INFO:tasks.workunit.client.0.smithi072.stdout:0/678: mkdir d1/d1c/d82/ddd 0 2024-03-19T06:06:07.190 INFO:tasks.workunit.client.0.smithi072.stdout:3/684: dwrite d2/d3/d26/f96 [0,4194304] 0 2024-03-19T06:06:07.194 INFO:tasks.workunit.client.0.smithi072.stdout:6/619: dwrite d7/f11 [0,4194304] 0 2024-03-19T06:06:07.195 INFO:tasks.workunit.client.0.smithi072.stdout:7/531: fdatasync d2/d3/d18/d33/d1d/d2b/f4b 0 2024-03-19T06:06:07.196 INFO:tasks.workunit.client.0.smithi072.stdout:0/679: fsync d1/d1c/d24/d27/d73/d80/fb3 0 2024-03-19T06:06:07.198 INFO:tasks.workunit.client.0.smithi072.stdout:8/633: truncate da/d13/f53 3158017 0 2024-03-19T06:06:07.199 INFO:tasks.workunit.client.0.smithi072.stdout:6/620: chown d7/d9/d1e/f7b 0 1 2024-03-19T06:06:07.199 INFO:tasks.workunit.client.0.smithi072.stdout:3/685: mkdir d2/d40/d78/de9 0 2024-03-19T06:06:07.207 INFO:tasks.workunit.client.0.smithi072.stdout:7/532: chown d2/d3/d18/d33/d1d/d2b/d3d/l42 170794297 1 2024-03-19T06:06:07.209 INFO:tasks.workunit.client.0.smithi072.stdout:0/680: creat d1/d1c/fde x:0 0 0 2024-03-19T06:06:07.209 INFO:tasks.workunit.client.0.smithi072.stdout:3/686: creat d2/d75/fea x:0 0 0 2024-03-19T06:06:07.211 INFO:tasks.workunit.client.0.smithi072.stdout:8/634: symlink da/d27/dc2/dc6/dd1/ld2 0 2024-03-19T06:06:07.213 INFO:tasks.workunit.client.0.smithi072.stdout:7/533: chown d2/d3/d18/d33/d1d/d2b/l55 17034 1 2024-03-19T06:06:07.213 INFO:tasks.workunit.client.0.smithi072.stdout:1/647: dwrite d1/d11/d18/d19/d1a/d25/d3c/fbe [0,4194304] 0 2024-03-19T06:06:07.213 INFO:tasks.workunit.client.0.smithi072.stdout:8/635: stat da/f50 0 2024-03-19T06:06:07.215 INFO:tasks.workunit.client.0.smithi072.stdout:7/534: chown d2/d3/d18/d7f 1 1 2024-03-19T06:06:07.217 INFO:tasks.workunit.client.0.smithi072.stdout:0/681: creat d1/d1c/d24/d27/d7c/fdf x:0 0 0 2024-03-19T06:06:07.218 INFO:tasks.workunit.client.0.smithi072.stdout:7/535: mknod d2/d3/d43/c9d 0 2024-03-19T06:06:07.219 INFO:tasks.workunit.client.0.smithi072.stdout:9/637: dread d11/f44 [0,4194304] 0 2024-03-19T06:06:07.220 INFO:tasks.workunit.client.0.smithi072.stdout:8/636: mkdir da/d37/dd3 0 2024-03-19T06:06:07.224 INFO:tasks.workunit.client.0.smithi072.stdout:1/648: chown d1/d11/d18/d63/d73/f8f 5 1 2024-03-19T06:06:07.229 INFO:tasks.workunit.client.0.smithi072.stdout:6/621: dread d7/d9/d1b/d3b/f8c [0,4194304] 0 2024-03-19T06:06:07.231 INFO:tasks.workunit.client.0.smithi072.stdout:7/536: creat d2/d3/d18/d33/d83/f9e x:0 0 0 2024-03-19T06:06:07.236 INFO:tasks.workunit.client.0.smithi072.stdout:0/682: rmdir d1/d1c/d24 39 2024-03-19T06:06:07.236 INFO:tasks.workunit.client.0.smithi072.stdout:1/649: read d1/d11/d18/d19/d1a/f34 [770850,110530] 0 2024-03-19T06:06:07.236 INFO:tasks.workunit.client.0.smithi072.stdout:9/638: write d11/d24/d4c/dda/d36/d45/d4d/f83 [4077814,120613] 0 2024-03-19T06:06:07.240 INFO:tasks.workunit.client.0.smithi072.stdout:7/537: chown d2/d3/d18/d20/f71 3 1 2024-03-19T06:06:07.241 INFO:tasks.workunit.client.0.smithi072.stdout:6/622: creat d7/d9/d1b/d21/d68/daa/d88/fd7 x:0 0 0 2024-03-19T06:06:07.242 INFO:tasks.workunit.client.0.smithi072.stdout:0/683: truncate d1/d2c/da1/fc2 930062 0 2024-03-19T06:06:07.242 INFO:tasks.workunit.client.0.smithi072.stdout:3/687: dwrite d2/d19/db0/dcb/fd3 [0,4194304] 0 2024-03-19T06:06:07.243 INFO:tasks.workunit.client.0.smithi072.stdout:1/650: stat d1/d11/d76/da7/l6b 0 2024-03-19T06:06:07.243 INFO:tasks.workunit.client.0.smithi072.stdout:0/684: stat d1/d2c/c68 0 2024-03-19T06:06:07.249 INFO:tasks.workunit.client.0.smithi072.stdout:6/623: creat d7/d9/d1b/d31/da6/fd8 x:0 0 0 2024-03-19T06:06:07.251 INFO:tasks.workunit.client.0.smithi072.stdout:8/637: truncate da/d27/d52/d5b/d3e/d5a/d7a/f86 2373115 0 2024-03-19T06:06:07.251 INFO:tasks.workunit.client.0.smithi072.stdout:7/538: unlink d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/f35 0 2024-03-19T06:06:07.253 INFO:tasks.workunit.client.0.smithi072.stdout:0/685: mkdir d1/d1c/d82/d90/de0 0 2024-03-19T06:06:07.255 INFO:tasks.workunit.client.0.smithi072.stdout:1/651: mknod d1/d11/d18/d19/d1a/d25/d3c/d68/d96/ccd 0 2024-03-19T06:06:07.255 INFO:tasks.workunit.client.0.smithi072.stdout:7/539: write d2/f93 [2491839,114292] 0 2024-03-19T06:06:07.258 INFO:tasks.workunit.client.0.smithi072.stdout:3/688: link d2/d3/d15/d66/d70/fe2 d2/d3/d26/d92/feb 0 2024-03-19T06:06:07.263 INFO:tasks.workunit.client.0.smithi072.stdout:7/540: read d2/d3/d18/d33/d1d/d2b/f45 [2146824,25754] 0 2024-03-19T06:06:07.264 INFO:tasks.workunit.client.0.smithi072.stdout:6/624: rename d7/d9/d1b/d21/d68/daa/d88/lb1 to d7/d9/d1b/d21/d68/daa/ld9 0 2024-03-19T06:06:07.269 INFO:tasks.workunit.client.0.smithi072.stdout:0/686: mknod d1/d1c/d24/d27/d7c/d6a/ce1 0 2024-03-19T06:06:07.270 INFO:tasks.workunit.client.0.smithi072.stdout:6/625: chown d7/d9/d1b/d21/d68/daa/d76/cbc 26589 1 2024-03-19T06:06:07.272 INFO:tasks.workunit.client.0.smithi072.stdout:1/652: rename d1/d11/d18/d19/d1a/f34 to d1/d11/d18/d63/d73/fce 0 2024-03-19T06:06:07.274 INFO:tasks.workunit.client.0.smithi072.stdout:8/638: getdents da/d27/d52/dbd 0 2024-03-19T06:06:07.276 INFO:tasks.workunit.client.0.smithi072.stdout:7/541: link d2/d3/d18/d20/c5b d2/d3/d18/d33/d1d/d3b/d63/d84/c9f 0 2024-03-19T06:06:07.278 INFO:tasks.workunit.client.0.smithi072.stdout:1/653: mknod d1/d11/d18/d19/dc2/ccf 0 2024-03-19T06:06:07.279 INFO:tasks.workunit.client.0.smithi072.stdout:9/639: dread d11/d24/ddd/f71 [0,4194304] 0 2024-03-19T06:06:07.280 INFO:tasks.workunit.client.0.smithi072.stdout:0/687: mkdir d1/d1c/d24/d3f/de2 0 2024-03-19T06:06:07.283 INFO:tasks.workunit.client.0.smithi072.stdout:6/626: link d7/d9/d2b/cbd d7/d99/d60/cda 0 2024-03-19T06:06:07.288 INFO:tasks.workunit.client.0.smithi072.stdout:0/688: dread - d1/d1c/d82/fd8 zero size 2024-03-19T06:06:07.288 INFO:tasks.workunit.client.0.smithi072.stdout:1/654: symlink d1/d11/d18/d19/d1a/d61/d65/ld0 0 2024-03-19T06:06:07.288 INFO:tasks.workunit.client.0.smithi072.stdout:3/689: dwrite d2/d3/d15/d66/d6b/db2/fb4 [0,4194304] 0 2024-03-19T06:06:07.290 INFO:tasks.workunit.client.0.smithi072.stdout:6/627: creat d7/d9/d30/fdb x:0 0 0 2024-03-19T06:06:07.295 INFO:tasks.workunit.client.0.smithi072.stdout:6/628: unlink c1 0 2024-03-19T06:06:07.302 INFO:tasks.workunit.client.0.smithi072.stdout:1/655: creat d1/d11/d18/d19/d1a/d61/fd1 x:0 0 0 2024-03-19T06:06:07.302 INFO:tasks.workunit.client.0.smithi072.stdout:7/542: link d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/l90 d2/d3/d18/d33/d1d/d2b/d75/la0 0 2024-03-19T06:06:07.307 INFO:tasks.workunit.client.0.smithi072.stdout:9/640: dwrite d11/d24/d4c/d6e/f9d [0,4194304] 0 2024-03-19T06:06:07.320 INFO:tasks.workunit.client.0.smithi072.stdout:9/641: chown d11/d24/d4c/dda/d36/f90 1239445340 1 2024-03-19T06:06:07.324 INFO:tasks.workunit.client.0.smithi072.stdout:8/639: dwrite da/d27/d52/d5b/d3e/d5a/d7a/f86 [0,4194304] 0 2024-03-19T06:06:07.328 INFO:tasks.workunit.client.0.smithi072.stdout:0/689: dwrite d1/d1c/d24/d27/d7c/d6a/f91 [0,4194304] 0 2024-03-19T06:06:07.328 INFO:tasks.workunit.client.0.smithi072.stdout:6/629: dwrite d7/d9/d1b/d21/d68/daa/d76/fd1 [0,4194304] 0 2024-03-19T06:06:07.328 INFO:tasks.workunit.client.0.smithi072.stdout:7/543: rename d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/d8b to d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/d86/da1 0 2024-03-19T06:06:07.335 INFO:tasks.workunit.client.0.smithi072.stdout:9/642: mkdir d11/d24/ddd/dde 0 2024-03-19T06:06:07.335 INFO:tasks.workunit.client.0.smithi072.stdout:8/640: fdatasync da/f50 0 2024-03-19T06:06:07.339 INFO:tasks.workunit.client.0.smithi072.stdout:0/690: mknod d1/d1c/d89/d9d/ce3 0 2024-03-19T06:06:07.341 INFO:tasks.workunit.client.0.smithi072.stdout:7/544: write d2/d3/d18/d33/d1d/d2b/f6c [2744323,127071] 0 2024-03-19T06:06:07.344 INFO:tasks.workunit.client.0.smithi072.stdout:3/690: dwrite d2/d19/f5c [0,4194304] 0 2024-03-19T06:06:07.348 INFO:tasks.workunit.client.0.smithi072.stdout:6/630: dread d7/f3c [0,4194304] 0 2024-03-19T06:06:07.351 INFO:tasks.workunit.client.0.smithi072.stdout:1/656: dwrite d1/d11/d18/d63/d73/f8f [0,4194304] 0 2024-03-19T06:06:07.355 INFO:tasks.workunit.client.0.smithi072.stdout:7/545: write d2/d3/d18/d33/d1d/d2b/d3d/d21/f99 [65363,61332] 0 2024-03-19T06:06:07.355 INFO:tasks.workunit.client.0.smithi072.stdout:1/657: stat d1/d11/d18/d19/d1a/d3b/lb7 0 2024-03-19T06:06:07.357 INFO:tasks.workunit.client.0.smithi072.stdout:1/658: write d1/f8e [5387441,84345] 0 2024-03-19T06:06:07.362 INFO:tasks.workunit.client.0.smithi072.stdout:3/691: rmdir d2/d3/d15/d66/d6b 39 2024-03-19T06:06:07.366 INFO:tasks.workunit.client.0.smithi072.stdout:7/546: mknod d2/d3/d18/d33/d1d/d2b/d75/ca2 0 2024-03-19T06:06:07.367 INFO:tasks.workunit.client.0.smithi072.stdout:1/659: creat d1/d11/d18/d19/d1a/d61/d65/fd2 x:0 0 0 2024-03-19T06:06:07.369 INFO:tasks.workunit.client.0.smithi072.stdout:7/547: fdatasync d2/d3/fd 0 2024-03-19T06:06:07.374 INFO:tasks.workunit.client.0.smithi072.stdout:6/631: getdents d7/d9/d30 0 2024-03-19T06:06:07.375 INFO:tasks.workunit.client.0.smithi072.stdout:1/660: creat d1/d11/d18/d63/d73/fd3 x:0 0 0 2024-03-19T06:06:07.375 INFO:tasks.workunit.client.0.smithi072.stdout:9/643: link d11/d24/d4c/dda/d36/d45/d5b/c74 d11/d24/ddd/cdf 0 2024-03-19T06:06:07.379 INFO:tasks.workunit.client.0.smithi072.stdout:6/632: write d7/d9/d2b/f6a [3529123,10414] 0 2024-03-19T06:06:07.379 INFO:tasks.workunit.client.0.smithi072.stdout:4/838: sync 2024-03-19T06:06:07.379 INFO:tasks.workunit.client.0.smithi072.stdout:7/548: link d2/l41 d2/d3/d18/d33/la3 0 2024-03-19T06:06:07.381 INFO:tasks.workunit.client.0.smithi072.stdout:9/644: readlink d11/d24/d4c/dda/d6f/d88/l9c 0 2024-03-19T06:06:07.383 INFO:tasks.workunit.client.0.smithi072.stdout:4/839: creat d5/d37/d52/f127 x:0 0 0 2024-03-19T06:06:07.386 INFO:tasks.workunit.client.0.smithi072.stdout:6/633: truncate d7/d9/d30/f38 73456 0 2024-03-19T06:06:07.387 INFO:tasks.workunit.client.0.smithi072.stdout:4/840: symlink d5/d15/l128 0 2024-03-19T06:06:07.388 INFO:tasks.workunit.client.0.smithi072.stdout:7/549: symlink d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/d86/da1/la4 0 2024-03-19T06:06:07.390 INFO:tasks.workunit.client.0.smithi072.stdout:6/634: truncate d7/d9/d30/fdb 739547 0 2024-03-19T06:06:07.406 INFO:tasks.workunit.client.0.smithi072.stdout:0/691: dread d1/d1c/d24/d27/d73/d80/d8b/f5b [0,4194304] 0 2024-03-19T06:06:07.406 INFO:tasks.workunit.client.0.smithi072.stdout:9/645: mknod d11/d24/ddd/d5c/ce0 0 2024-03-19T06:06:07.410 INFO:tasks.workunit.client.0.smithi072.stdout:9/646: dread - d11/d24/d4c/f9a zero size 2024-03-19T06:06:07.410 INFO:tasks.workunit.client.0.smithi072.stdout:3/692: dread d2/d19/f52 [0,4194304] 0 2024-03-19T06:06:07.410 INFO:tasks.workunit.client.0.smithi072.stdout:0/692: chown d1/d2c/f37 89948 1 2024-03-19T06:06:07.413 INFO:tasks.workunit.client.0.smithi072.stdout:9/647: write d11/f37 [8703087,129406] 0 2024-03-19T06:06:07.414 INFO:tasks.workunit.client.0.smithi072.stdout:0/693: truncate d1/d2c/da1/fb9 231846 0 2024-03-19T06:06:07.419 INFO:tasks.workunit.client.0.smithi072.stdout:0/694: write d1/d1c/d24/d27/d73/d80/d8b/f99 [593905,38618] 0 2024-03-19T06:06:07.434 INFO:tasks.workunit.client.0.smithi072.stdout:9/648: dread d11/d24/d4c/dda/d36/d45/d4d/f82 [0,4194304] 0 2024-03-19T06:06:07.439 INFO:tasks.workunit.client.0.smithi072.stdout:1/661: link d1/d11/d18/d63/d73/fd3 d1/d11/d18/d19/d1a/d25/d3c/d68/fd4 0 2024-03-19T06:06:07.440 INFO:tasks.workunit.client.0.smithi072.stdout:9/649: fdatasync d11/d24/d4c/dda/d36/d45/d5b/f2c 0 2024-03-19T06:06:07.441 INFO:tasks.workunit.client.0.smithi072.stdout:4/841: stat d5/d15/d22/d41/d7b/d7c/db4/dc7 0 2024-03-19T06:06:07.442 INFO:tasks.workunit.client.0.smithi072.stdout:1/662: chown d1/ca 0 1 2024-03-19T06:06:07.446 INFO:tasks.workunit.client.0.smithi072.stdout:7/550: mknod d2/d3/d18/d33/d1d/d2b/d75/ca5 0 2024-03-19T06:06:07.447 INFO:tasks.workunit.client.0.smithi072.stdout:9/650: write d11/d24/ddd/f52 [3021137,103082] 0 2024-03-19T06:06:07.448 INFO:tasks.workunit.client.0.smithi072.stdout:0/695: dwrite d1/d1c/d24/d27/d73/dbb/fcf [0,4194304] 0 2024-03-19T06:06:07.448 INFO:tasks.workunit.client.0.smithi072.stdout:4/842: write d5/d15/d22/fa5 [369681,113360] 0 2024-03-19T06:06:07.453 INFO:tasks.workunit.client.0.smithi072.stdout:3/693: symlink d2/d3/d15/d66/d70/lec 0 2024-03-19T06:06:07.461 INFO:tasks.workunit.client.0.smithi072.stdout:3/694: write d2/fb1 [108361,48749] 0 2024-03-19T06:06:07.461 INFO:tasks.workunit.client.0.smithi072.stdout:0/696: stat d1/d1c/d24/d27/d73/d80/cb7 0 2024-03-19T06:06:07.463 INFO:tasks.workunit.client.0.smithi072.stdout:8/641: dwrite da/d13/d1d/f2b [0,4194304] 0 2024-03-19T06:06:07.468 INFO:tasks.workunit.client.0.smithi072.stdout:0/697: write d1/d1c/d24/d27/d73/fda [590625,106485] 0 2024-03-19T06:06:07.476 INFO:tasks.workunit.client.0.smithi072.stdout:7/551: creat d2/d3/d18/d33/fa6 x:0 0 0 2024-03-19T06:06:07.476 INFO:tasks.workunit.client.0.smithi072.stdout:1/663: truncate d1/d11/d18/d19/d1a/d25/f6c 2774761 0 2024-03-19T06:06:07.479 INFO:tasks.workunit.client.0.smithi072.stdout:3/695: rename d2/d40/fa0 to d2/d40/d78/d9b/fed 0 2024-03-19T06:06:07.479 INFO:tasks.workunit.client.0.smithi072.stdout:9/651: dwrite d11/d24/d4c/dda/d68/d92/d93/fb8 [0,4194304] 0 2024-03-19T06:06:07.484 INFO:tasks.workunit.client.0.smithi072.stdout:4/843: mknod d5/d15/d3f/df2/c129 0 2024-03-19T06:06:07.486 INFO:tasks.workunit.client.0.smithi072.stdout:8/642: creat da/d3b/da7/fd4 x:0 0 0 2024-03-19T06:06:07.491 INFO:tasks.workunit.client.0.smithi072.stdout:9/652: fsync d11/d24/d4c/dda/d36/f3f 0 2024-03-19T06:06:07.491 INFO:tasks.workunit.client.0.smithi072.stdout:3/696: creat d2/dc8/fee x:0 0 0 2024-03-19T06:06:07.498 INFO:tasks.workunit.client.0.smithi072.stdout:0/698: dwrite d1/d1c/d24/f86 [0,4194304] 0 2024-03-19T06:06:07.510 INFO:tasks.workunit.client.0.smithi072.stdout:3/697: getdents d2/d3/d26 0 2024-03-19T06:06:07.517 INFO:tasks.workunit.client.0.smithi072.stdout:1/664: dwrite d1/d11/d18/f2e [0,4194304] 0 2024-03-19T06:06:07.520 INFO:tasks.workunit.client.0.smithi072.stdout:3/698: creat d2/d40/d78/fef x:0 0 0 2024-03-19T06:06:07.523 INFO:tasks.workunit.client.0.smithi072.stdout:0/699: getdents d1/d1c/d89/d9c/da6 0 2024-03-19T06:06:07.523 INFO:tasks.workunit.client.0.smithi072.stdout:7/552: dwrite d2/d3/d18/d33/d1d/d3b/d63/f8a [0,4194304] 0 2024-03-19T06:06:07.526 INFO:tasks.workunit.client.0.smithi072.stdout:8/643: dwrite da/d3b/f9b [0,4194304] 0 2024-03-19T06:06:07.530 INFO:tasks.workunit.client.0.smithi072.stdout:1/665: creat d1/daa/fd5 x:0 0 0 2024-03-19T06:06:07.531 INFO:tasks.workunit.client.0.smithi072.stdout:8/644: chown da/d13/d14/c23 42836152 1 2024-03-19T06:06:07.531 INFO:tasks.workunit.client.0.smithi072.stdout:9/653: dwrite d11/d24/ddd/f52 [0,4194304] 0 2024-03-19T06:06:07.533 INFO:tasks.workunit.client.0.smithi072.stdout:0/700: readlink d1/l10 0 2024-03-19T06:06:07.535 INFO:tasks.workunit.client.0.smithi072.stdout:1/666: write d1/d11/d76/da7/f77 [3387669,5744] 0 2024-03-19T06:06:07.538 INFO:tasks.workunit.client.0.smithi072.stdout:7/553: symlink d2/d3/d18/d33/d1d/d3b/d63/d84/la7 0 2024-03-19T06:06:07.543 INFO:tasks.workunit.client.0.smithi072.stdout:8/645: write da/d3b/da7/fd4 [85526,7032] 0 2024-03-19T06:06:07.544 INFO:tasks.workunit.client.0.smithi072.stdout:9/654: dread - d11/d24/d4c/d64/f75 zero size 2024-03-19T06:06:07.552 INFO:tasks.workunit.client.0.smithi072.stdout:9/655: write d11/d24/d4c/dda/d36/d45/d4d/fc6 [828278,63038] 0 2024-03-19T06:06:07.556 INFO:tasks.workunit.client.0.smithi072.stdout:0/701: rename d1/d1c/d89/d9c to d1/d1c/d82/de4 0 2024-03-19T06:06:07.558 INFO:tasks.workunit.client.0.smithi072.stdout:1/667: symlink d1/d11/d18/d19/d1a/d3b/ld6 0 2024-03-19T06:06:07.560 INFO:tasks.workunit.client.0.smithi072.stdout:3/699: creat d2/d3/d15/d66/d6b/ff0 x:0 0 0 2024-03-19T06:06:07.561 INFO:tasks.workunit.client.0.smithi072.stdout:7/554: mknod d2/d3/ca8 0 2024-03-19T06:06:07.562 INFO:tasks.workunit.client.0.smithi072.stdout:0/702: chown d1/d1c/d24/d27/d7c/fdf 27429365 1 2024-03-19T06:06:07.562 INFO:tasks.workunit.client.0.smithi072.stdout:3/700: dread - d2/d19/d1e/fe0 zero size 2024-03-19T06:06:07.563 INFO:tasks.workunit.client.0.smithi072.stdout:8/646: creat da/d37/d69/fd5 x:0 0 0 2024-03-19T06:06:07.564 INFO:tasks.workunit.client.0.smithi072.stdout:7/555: dread - d2/d3/d18/d33/fa6 zero size 2024-03-19T06:06:07.564 INFO:tasks.workunit.client.0.smithi072.stdout:1/668: symlink d1/d11/d18/d19/d1a/d25/d60/ld7 0 2024-03-19T06:06:07.570 INFO:tasks.workunit.client.0.smithi072.stdout:1/669: write d1/d11/d18/d19/d72/f7e [7562136,66788] 0 2024-03-19T06:06:07.570 INFO:tasks.workunit.client.0.smithi072.stdout:8/647: creat da/d13/d3f/db9/fd6 x:0 0 0 2024-03-19T06:06:07.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:07 smithi072 ceph-mon[28706]: pgmap v30: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 28 MiB/s rd, 109 MiB/s wr, 253 op/s 2024-03-19T06:06:07.581 INFO:tasks.workunit.client.0.smithi072.stdout:0/703: link d1/f19 d1/d1c/d24/d27/d7c/d6a/fe5 0 2024-03-19T06:06:07.584 INFO:tasks.workunit.client.0.smithi072.stdout:0/704: symlink d1/d1c/d89/d9d/le6 0 2024-03-19T06:06:07.586 INFO:tasks.workunit.client.0.smithi072.stdout:8/648: getdents da/d27/d30 0 2024-03-19T06:06:07.594 INFO:tasks.workunit.client.0.smithi072.stdout:9/656: dread d11/d24/ddd/d57/fa3 [4194304,4194304] 0 2024-03-19T06:06:07.601 INFO:tasks.workunit.client.0.smithi072.stdout:7/556: dread d2/d3/d18/d33/d1d/d2b/d3d/f39 [4194304,4194304] 0 2024-03-19T06:06:07.603 INFO:tasks.workunit.client.0.smithi072.stdout:7/557: write d2/d3/d18/d7f/f97 [1036001,115929] 0 2024-03-19T06:06:07.606 INFO:tasks.workunit.client.0.smithi072.stdout:7/558: mkdir d2/d8c/da9 0 2024-03-19T06:06:07.609 INFO:tasks.workunit.client.0.smithi072.stdout:7/559: chown d2/d3/d43/c9d 52898451 1 2024-03-19T06:06:07.609 INFO:tasks.workunit.client.0.smithi072.stdout:9/657: dwrite d11/f55 [0,4194304] 0 2024-03-19T06:06:07.609 INFO:tasks.workunit.client.0.smithi072.stdout:4/844: mkdir d5/d15/d22/d41/d7b/d12a 0 2024-03-19T06:06:07.615 INFO:tasks.workunit.client.0.smithi072.stdout:4/845: symlink d5/d15/d73/l12b 0 2024-03-19T06:06:07.618 INFO:tasks.workunit.client.0.smithi072.stdout:1/670: rename d1/d11/d18 to d1/daa/dd8 0 2024-03-19T06:06:07.618 INFO:tasks.workunit.client.0.smithi072.stdout:1/671: chown d1 1712 1 2024-03-19T06:06:07.620 INFO:tasks.workunit.client.0.smithi072.stdout:4/846: mknod d5/c12c 0 2024-03-19T06:06:07.622 INFO:tasks.workunit.client.0.smithi072.stdout:3/701: truncate d2/d19/f6c 795970 0 2024-03-19T06:06:07.623 INFO:tasks.workunit.client.0.smithi072.stdout:1/672: write d1/daa/dd8/d19/d1a/d25/d3c/f3e [1967443,116448] 0 2024-03-19T06:06:07.624 INFO:tasks.workunit.client.0.smithi072.stdout:1/673: readlink d1/l10 0 2024-03-19T06:06:07.628 INFO:tasks.workunit.client.0.smithi072.stdout:8/649: write da/d13/d1d/f87 [2969306,29783] 0 2024-03-19T06:06:07.628 INFO:tasks.workunit.client.0.smithi072.stdout:0/705: truncate d1/d1c/d24/d27/d73/f87 6841082 0 2024-03-19T06:06:07.630 INFO:tasks.workunit.client.0.smithi072.stdout:1/674: mkdir d1/daa/dd8/d19/d1a/d25/d3c/d79/dd9 0 2024-03-19T06:06:07.630 INFO:tasks.workunit.client.0.smithi072.stdout:0/706: dread - d1/d2c/f37 zero size 2024-03-19T06:06:07.632 INFO:tasks.workunit.client.0.smithi072.stdout:8/650: mkdir da/d13/d14/d1b/d57/dd7 0 2024-03-19T06:06:07.634 INFO:tasks.workunit.client.0.smithi072.stdout:7/560: write d2/d3/d18/d33/d1d/d2b/f4b [563801,104884] 0 2024-03-19T06:06:07.635 INFO:tasks.workunit.client.0.smithi072.stdout:0/707: mkdir d1/de7 0 2024-03-19T06:06:07.640 INFO:tasks.workunit.client.0.smithi072.stdout:1/675: getdents d1/d11/d76/da7/d9e 0 2024-03-19T06:06:07.640 INFO:tasks.workunit.client.0.smithi072.stdout:8/651: write da/d27/d52/d5b/d3e/d7d/d97/f80 [7796305,22139] 0 2024-03-19T06:06:07.642 INFO:tasks.workunit.client.0.smithi072.stdout:0/708: fsync d1/d1c/d82/de4/da6/fba 0 2024-03-19T06:06:07.644 INFO:tasks.workunit.client.0.smithi072.stdout:8/652: symlink da/ld8 0 2024-03-19T06:06:07.644 INFO:tasks.workunit.client.0.smithi072.stdout:3/702: dwrite d2/d3/d26/f22 [0,4194304] 0 2024-03-19T06:06:07.647 INFO:tasks.workunit.client.0.smithi072.stdout:4/847: dwrite d5/d1b/f33 [0,4194304] 0 2024-03-19T06:06:07.652 INFO:tasks.workunit.client.0.smithi072.stdout:3/703: write d2/d40/d78/d9b/dc5/fdd [994048,24388] 0 2024-03-19T06:06:07.653 INFO:tasks.workunit.client.0.smithi072.stdout:8/653: mknod da/d13/d14/d1b/d57/cd9 0 2024-03-19T06:06:07.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:07 smithi172 ceph-mon[35716]: pgmap v30: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 28 MiB/s rd, 109 MiB/s wr, 253 op/s 2024-03-19T06:06:07.657 INFO:tasks.workunit.client.0.smithi072.stdout:1/676: mkdir d1/daa/dd8/d19/d1a/d25/d3c/d68/d96/dc0/dda 0 2024-03-19T06:06:07.664 INFO:tasks.workunit.client.0.smithi072.stdout:8/654: creat da/d37/d5c/fda x:0 0 0 2024-03-19T06:06:07.669 INFO:tasks.workunit.client.0.smithi072.stdout:3/704: unlink d2/d3/d26/c2d 0 2024-03-19T06:06:07.669 INFO:tasks.workunit.client.0.smithi072.stdout:1/677: mkdir d1/daa/dd8/ddb 0 2024-03-19T06:06:07.672 INFO:tasks.workunit.client.0.smithi072.stdout:3/705: creat d2/d19/ff1 x:0 0 0 2024-03-19T06:06:07.672 INFO:tasks.workunit.client.0.smithi072.stdout:8/655: mknod da/d13/d14/d1b/cdb 0 2024-03-19T06:06:07.673 INFO:tasks.workunit.client.0.smithi072.stdout:3/706: dread - d2/d19/ff1 zero size 2024-03-19T06:06:07.673 INFO:tasks.workunit.client.0.smithi072.stdout:1/678: mkdir d1/daa/dd8/d19/d1a/d25/d3c/db8/ddc 0 2024-03-19T06:06:07.675 INFO:tasks.workunit.client.0.smithi072.stdout:8/656: read da/d13/d14/f17 [5297413,54036] 0 2024-03-19T06:06:07.676 INFO:tasks.workunit.client.0.smithi072.stdout:0/709: dwrite d1/f6f [0,4194304] 0 2024-03-19T06:06:07.677 INFO:tasks.workunit.client.0.smithi072.stdout:3/707: creat d2/d3/d25/ff2 x:0 0 0 2024-03-19T06:06:07.678 INFO:tasks.workunit.client.0.smithi072.stdout:1/679: creat d1/d11/d76/da7/fdd x:0 0 0 2024-03-19T06:06:07.682 INFO:tasks.workunit.client.0.smithi072.stdout:3/708: mknod d2/d40/d78/de9/cf3 0 2024-03-19T06:06:07.682 INFO:tasks.workunit.client.0.smithi072.stdout:0/710: mkdir d1/d1c/d24/d3f/de8 0 2024-03-19T06:06:07.684 INFO:tasks.workunit.client.0.smithi072.stdout:1/680: truncate d1/d11/d76/da7/fdd 910746 0 2024-03-19T06:06:07.688 INFO:tasks.workunit.client.0.smithi072.stdout:0/711: link d1/f1b d1/d1c/d82/fe9 0 2024-03-19T06:06:07.690 INFO:tasks.workunit.client.0.smithi072.stdout:0/712: write d1/d2c/f52 [2781439,100732] 0 2024-03-19T06:06:07.693 INFO:tasks.workunit.client.0.smithi072.stdout:0/713: chown d1/d1c/d24/d3f/c64 0 1 2024-03-19T06:06:07.693 INFO:tasks.workunit.client.0.smithi072.stdout:1/681: link d1/daa/dd8/d19/d1a/d25/d3c/d52/c69 d1/daa/dd8/d19/d1a/d25/d3c/cde 0 2024-03-19T06:06:07.696 INFO:tasks.workunit.client.0.smithi072.stdout:0/714: write d1/d1c/d24/d27/d73/dbb/fcf [1792584,79843] 0 2024-03-19T06:06:07.698 INFO:tasks.workunit.client.0.smithi072.stdout:1/682: creat d1/daa/dd8/d19/d1a/d25/d3c/d68/d96/fdf x:0 0 0 2024-03-19T06:06:07.701 INFO:tasks.workunit.client.0.smithi072.stdout:1/683: mknod d1/daa/dd8/d19/d1a/d61/ce0 0 2024-03-19T06:06:07.703 INFO:tasks.workunit.client.0.smithi072.stdout:1/684: creat d1/daa/fe1 x:0 0 0 2024-03-19T06:06:07.706 INFO:tasks.workunit.client.0.smithi072.stdout:1/685: mknod d1/daa/dd8/d19/dc2/dc7/ce2 0 2024-03-19T06:06:07.708 INFO:tasks.workunit.client.0.smithi072.stdout:1/686: mkdir d1/daa/dd8/d19/de3 0 2024-03-19T06:06:07.712 INFO:tasks.workunit.client.0.smithi072.stdout:1/687: mkdir d1/daa/dd8/d19/d1a/d25/d3c/d68/de4 0 2024-03-19T06:06:07.716 INFO:tasks.workunit.client.0.smithi072.stdout:1/688: symlink d1/daa/dd8/d19/d1a/d61/d65/le5 0 2024-03-19T06:06:07.718 INFO:tasks.workunit.client.0.smithi072.stdout:1/689: mknod d1/ce6 0 2024-03-19T06:06:07.720 INFO:tasks.workunit.client.0.smithi072.stdout:1/690: write d1/d11/d76/da7/f77 [3764070,107918] 0 2024-03-19T06:06:07.723 INFO:tasks.workunit.client.0.smithi072.stdout:0/715: dread d1/d1c/d24/d27/d7c/d6a/fe5 [4194304,4194304] 0 2024-03-19T06:06:07.726 INFO:tasks.workunit.client.0.smithi072.stdout:1/691: creat d1/daa/dd8/d19/d1a/d25/d3c/fe7 x:0 0 0 2024-03-19T06:06:07.728 INFO:tasks.workunit.client.0.smithi072.stdout:0/716: symlink d1/d1c/d24/d27/d73/d80/lea 0 2024-03-19T06:06:07.730 INFO:tasks.workunit.client.0.smithi072.stdout:1/692: mknod d1/daa/dd8/d19/d1a/d61/d65/ce8 0 2024-03-19T06:06:07.730 INFO:tasks.workunit.client.0.smithi072.stdout:0/717: fsync d1/d1c/d24/d3f/fd0 0 2024-03-19T06:06:07.733 INFO:tasks.workunit.client.0.smithi072.stdout:1/693: truncate d1/d11/d76/da7/fdd 1561450 0 2024-03-19T06:06:07.734 INFO:tasks.workunit.client.0.smithi072.stdout:1/694: readlink d1/daa/dd8/d19/d1a/d3b/l54 0 2024-03-19T06:06:07.735 INFO:tasks.workunit.client.0.smithi072.stdout:0/718: mkdir d1/d1c/d24/d27/d73/d80/da8/dc4/deb 0 2024-03-19T06:06:07.749 INFO:tasks.workunit.client.0.smithi072.stdout:7/561: truncate d2/d3/d18/d20/d3a/d50/f76 398111 0 2024-03-19T06:06:07.755 INFO:tasks.workunit.client.0.smithi072.stdout:8/657: write da/d13/d14/d1b/f68 [1180530,16954] 0 2024-03-19T06:06:07.762 INFO:tasks.workunit.client.0.smithi072.stdout:4/848: dwrite d5/d15/d31/d6d/fdc [0,4194304] 0 2024-03-19T06:06:07.765 INFO:tasks.workunit.client.0.smithi072.stdout:0/719: dread d1/d1c/d24/d27/d73/f7a [0,4194304] 0 2024-03-19T06:06:07.765 INFO:tasks.workunit.client.0.smithi072.stdout:8/658: mknod da/d27/d52/d5b/d3e/d7d/d97/cdc 0 2024-03-19T06:06:07.773 INFO:tasks.workunit.client.0.smithi072.stdout:1/695: write d1/f15 [4112153,62471] 0 2024-03-19T06:06:07.777 INFO:tasks.workunit.client.0.smithi072.stdout:3/709: dread d2/d19/d1e/fc3 [0,4194304] 0 2024-03-19T06:06:07.779 INFO:tasks.workunit.client.0.smithi072.stdout:0/720: mknod d1/d1c/d24/d27/cec 0 2024-03-19T06:06:07.782 INFO:tasks.workunit.client.0.smithi072.stdout:2/758: sync 2024-03-19T06:06:07.782 INFO:tasks.workunit.client.0.smithi072.stdout:5/778: sync 2024-03-19T06:06:07.790 INFO:tasks.workunit.client.0.smithi072.stdout:2/759: mknod db/d10/d59/cfa 0 2024-03-19T06:06:07.790 INFO:tasks.workunit.client.0.smithi072.stdout:5/779: write df/d13/d32/d28/d42/d59/d43/d4e/fdd [1034319,32800] 0 2024-03-19T06:06:07.797 INFO:tasks.workunit.client.0.smithi072.stdout:7/562: dwrite d2/d3/d18/d20/d3a/d50/f76 [0,4194304] 0 2024-03-19T06:06:07.809 INFO:tasks.workunit.client.0.smithi072.stdout:2/760: creat db/d10/d2b/d2d/d9e/d48/dd9/ffb x:0 0 0 2024-03-19T06:06:07.810 INFO:tasks.workunit.client.0.smithi072.stdout:7/563: mknod d2/d3/d18/d33/d1d/caa 0 2024-03-19T06:06:07.813 INFO:tasks.workunit.client.0.smithi072.stdout:4/849: dread d5/d15/d3f/f6b [0,4194304] 0 2024-03-19T06:06:07.818 INFO:tasks.workunit.client.0.smithi072.stdout:8/659: dread f4 [4194304,4194304] 0 2024-03-19T06:06:07.820 INFO:tasks.workunit.client.0.smithi072.stdout:2/761: mknod db/d10/d13/cfc 0 2024-03-19T06:06:07.820 INFO:tasks.workunit.client.0.smithi072.stdout:7/564: dread - d2/d3/d18/d33/d83/f9e zero size 2024-03-19T06:06:07.823 INFO:tasks.workunit.client.0.smithi072.stdout:3/710: dwrite d2/d40/d78/f9a [4194304,4194304] 0 2024-03-19T06:06:07.823 INFO:tasks.workunit.client.0.smithi072.stdout:1/696: dwrite d1/daa/dd8/d19/d1a/d61/d65/f88 [0,4194304] 0 2024-03-19T06:06:07.827 INFO:tasks.workunit.client.0.smithi072.stdout:5/780: dread df/d13/d32/d28/d42/fb3 [0,4194304] 0 2024-03-19T06:06:07.829 INFO:tasks.workunit.client.0.smithi072.stdout:3/711: fsync d2/d19/d1e/fc3 0 2024-03-19T06:06:07.829 INFO:tasks.workunit.client.0.smithi072.stdout:7/565: dread - d2/d3/d18/d33/d1d/d3b/d63/d84/f92 zero size 2024-03-19T06:06:07.832 INFO:tasks.workunit.client.0.smithi072.stdout:3/712: mkdir d2/df4 0 2024-03-19T06:06:07.833 INFO:tasks.workunit.client.0.smithi072.stdout:5/781: readlink df/d13/d32/d28/d42/d59/d43/d62/l7d 0 2024-03-19T06:06:07.833 INFO:tasks.workunit.client.0.smithi072.stdout:7/566: read - d2/d3/d18/d33/d83/f9e zero size 2024-03-19T06:06:07.833 INFO:tasks.workunit.client.0.smithi072.stdout:1/697: truncate d1/daa/dd8/d19/d1a/d25/d3c/d79/fca 613595 0 2024-03-19T06:06:07.836 INFO:tasks.workunit.client.0.smithi072.stdout:5/782: chown df/d13/d32/d28/f80 198681 1 2024-03-19T06:06:07.839 INFO:tasks.workunit.client.0.smithi072.stdout:7/567: chown d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/f78 1753561829 1 2024-03-19T06:06:07.839 INFO:tasks.workunit.client.0.smithi072.stdout:3/713: creat d2/d3/d15/d66/d6b/db2/ff5 x:0 0 0 2024-03-19T06:06:07.841 INFO:tasks.workunit.client.0.smithi072.stdout:8/660: write da/d13/d14/d1b/f78 [84351,121081] 0 2024-03-19T06:06:07.843 INFO:tasks.workunit.client.0.smithi072.stdout:5/783: creat df/d13/d32/d28/feb x:0 0 0 2024-03-19T06:06:07.843 INFO:tasks.workunit.client.0.smithi072.stdout:7/568: mkdir d2/d8c/dab 0 2024-03-19T06:06:07.845 INFO:tasks.workunit.client.0.smithi072.stdout:2/762: read db/f2f [3780228,103743] 0 2024-03-19T06:06:07.850 INFO:tasks.workunit.client.0.smithi072.stdout:7/569: fsync d2/d3/d18/d33/d1d/d2b/f6c 0 2024-03-19T06:06:07.854 INFO:tasks.workunit.client.0.smithi072.stdout:3/714: chown d2/d3/d26/cbb 13545568 1 2024-03-19T06:06:07.856 INFO:tasks.workunit.client.0.smithi072.stdout:5/784: write df/d14/f15 [413732,43391] 0 2024-03-19T06:06:07.857 INFO:tasks.workunit.client.0.smithi072.stdout:8/661: truncate da/d13/d14/d1b/d57/f5d 4885357 0 2024-03-19T06:06:07.859 INFO:tasks.workunit.client.0.smithi072.stdout:2/763: unlink db/d10/d13/d24/d72/lae 0 2024-03-19T06:06:07.860 INFO:tasks.workunit.client.0.smithi072.stdout:0/721: dread d1/d1c/f23 [0,4194304] 0 2024-03-19T06:06:07.861 INFO:tasks.workunit.client.0.smithi072.stdout:7/570: creat d2/d3/d18/d33/d1d/d3b/d63/fac x:0 0 0 2024-03-19T06:06:07.862 INFO:tasks.workunit.client.0.smithi072.stdout:5/785: stat df/d14/d5d 0 2024-03-19T06:06:07.864 INFO:tasks.workunit.client.0.smithi072.stdout:8/662: write da/d27/faf [110221,64020] 0 2024-03-19T06:06:07.866 INFO:tasks.workunit.client.0.smithi072.stdout:2/764: write db/d10/d2b/d45/da4/fb7 [1645014,32044] 0 2024-03-19T06:06:07.872 INFO:tasks.workunit.client.0.smithi072.stdout:0/722: creat d1/d1c/d24/fed x:0 0 0 2024-03-19T06:06:07.872 INFO:tasks.workunit.client.0.smithi072.stdout:1/698: write d1/daa/dd8/d19/d1a/d25/d3c/d68/fd4 [451831,100921] 0 2024-03-19T06:06:07.873 INFO:tasks.workunit.client.0.smithi072.stdout:8/663: dread da/d3b/da7/fd4 [0,4194304] 0 2024-03-19T06:06:07.874 INFO:tasks.workunit.client.0.smithi072.stdout:5/786: mknod df/d13/d32/d28/dda/cec 0 2024-03-19T06:06:07.878 INFO:tasks.workunit.client.0.smithi072.stdout:5/787: dread - df/d54/fd0 zero size 2024-03-19T06:06:07.880 INFO:tasks.workunit.client.0.smithi072.stdout:8/664: readlink da/d27/d52/d5b/d3e/lb8 0 2024-03-19T06:06:07.881 INFO:tasks.workunit.client.0.smithi072.stdout:7/571: mkdir d2/d3/d18/d33/d1d/d2b/d3d/d21/dad 0 2024-03-19T06:06:07.887 INFO:tasks.workunit.client.0.smithi072.stdout:4/850: dread d5/d1b/f2b [0,4194304] 0 2024-03-19T06:06:07.896 INFO:tasks.workunit.client.0.smithi072.stdout:3/715: truncate d2/d3/d15/d66/d6b/db2/fb4 3789562 0 2024-03-19T06:06:07.897 INFO:tasks.workunit.client.0.smithi072.stdout:0/723: link d1/d2c/f37 d1/d1c/d82/d90/de0/fee 0 2024-03-19T06:06:07.900 INFO:tasks.workunit.client.0.smithi072.stdout:7/572: creat d2/d3/d18/d88/fae x:0 0 0 2024-03-19T06:06:07.903 INFO:tasks.workunit.client.0.smithi072.stdout:5/788: fsync df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97/fa6 0 2024-03-19T06:06:07.906 INFO:tasks.workunit.client.0.smithi072.stdout:2/765: link db/d10/d2b/c4e db/d10/d13/d31/cfd 0 2024-03-19T06:06:07.906 INFO:tasks.workunit.client.0.smithi072.stdout:8/665: write da/d13/d14/d1b/d57/f64 [652112,32517] 0 2024-03-19T06:06:07.912 INFO:tasks.workunit.client.0.smithi072.stdout:5/789: truncate df/d16/f60 4726761 0 2024-03-19T06:06:07.913 INFO:tasks.workunit.client.0.smithi072.stdout:1/699: getdents d1/daa/dd8/d19/d1a/d25/d3c/d68 0 2024-03-19T06:06:07.918 INFO:tasks.workunit.client.0.smithi072.stdout:0/724: rmdir d1/d1c/d89/dd5 0 2024-03-19T06:06:07.919 INFO:tasks.workunit.client.0.smithi072.stdout:7/573: creat d2/d3/d17/faf x:0 0 0 2024-03-19T06:06:07.920 INFO:tasks.workunit.client.0.smithi072.stdout:5/790: symlink df/d54/dac/d9c/led 0 2024-03-19T06:06:07.921 INFO:tasks.workunit.client.0.smithi072.stdout:3/716: truncate d2/d3/d25/f85 567215 0 2024-03-19T06:06:07.922 INFO:tasks.workunit.client.0.smithi072.stdout:1/700: creat d1/daa/dd8/d19/de3/fe9 x:0 0 0 2024-03-19T06:06:07.923 INFO:tasks.workunit.client.0.smithi072.stdout:7/574: write d2/d3/d17/faf [1000662,35693] 0 2024-03-19T06:06:07.924 INFO:tasks.workunit.client.0.smithi072.stdout:1/701: stat d1/f8e 0 2024-03-19T06:06:07.924 INFO:tasks.workunit.client.0.smithi072.stdout:8/666: dwrite da/d37/f93 [0,4194304] 0 2024-03-19T06:06:07.926 INFO:tasks.workunit.client.0.smithi072.stdout:5/791: readlink df/d13/d32/d28/d42/d59/d43/d4e/l76 0 2024-03-19T06:06:07.926 INFO:tasks.workunit.client.0.smithi072.stdout:3/717: write d2/d40/d78/d9b/dc5/fdd [1965569,25791] 0 2024-03-19T06:06:07.927 INFO:tasks.workunit.client.0.smithi072.stdout:0/725: rename d1/d2c/c68 to d1/d1c/d24/d27/d73/d80/da8/dc4/deb/cef 0 2024-03-19T06:06:07.931 INFO:tasks.workunit.client.0.smithi072.stdout:5/792: dread - df/d13/d32/d28/fb7 zero size 2024-03-19T06:06:07.932 INFO:tasks.workunit.client.0.smithi072.stdout:1/702: mknod d1/daa/dd8/d19/d1a/d25/d3c/d68/de4/cea 0 2024-03-19T06:06:07.936 INFO:tasks.workunit.client.0.smithi072.stdout:7/575: unlink d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/d86/da1/la4 0 2024-03-19T06:06:07.937 INFO:tasks.workunit.client.0.smithi072.stdout:0/726: creat d1/d1c/d24/d3f/de2/ff0 x:0 0 0 2024-03-19T06:06:07.939 INFO:tasks.workunit.client.0.smithi072.stdout:5/793: mknod df/d13/d32/d28/d42/d59/d43/d4e/dbd/cee 0 2024-03-19T06:06:07.942 INFO:tasks.workunit.client.0.smithi072.stdout:7/576: symlink d2/d3/d18/d33/d53/lb0 0 2024-03-19T06:06:07.944 INFO:tasks.workunit.client.0.smithi072.stdout:0/727: unlink d1/d1c/d24/d27/c6c 0 2024-03-19T06:06:07.946 INFO:tasks.workunit.client.0.smithi072.stdout:7/577: fdatasync d2/d3/d17/faf 0 2024-03-19T06:06:07.946 INFO:tasks.workunit.client.0.smithi072.stdout:5/794: chown df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97/fa6 390314703 1 2024-03-19T06:06:07.949 INFO:tasks.workunit.client.0.smithi072.stdout:5/795: dread - df/d13/d32/d28/fd2 zero size 2024-03-19T06:06:07.952 INFO:tasks.workunit.client.0.smithi072.stdout:8/667: truncate da/d27/d52/d5b/d3e/d7d/d97/f46 2666102 0 2024-03-19T06:06:07.955 INFO:tasks.workunit.client.0.smithi072.stdout:5/796: mkdir df/d3c/def 0 2024-03-19T06:06:07.958 INFO:tasks.workunit.client.0.smithi072.stdout:8/668: symlink da/d13/d14/d1b/ldd 0 2024-03-19T06:06:07.961 INFO:tasks.workunit.client.0.smithi072.stdout:0/728: dread d1/d2c/da1/f83 [0,4194304] 0 2024-03-19T06:06:07.965 INFO:tasks.workunit.client.0.smithi072.stdout:3/718: dwrite d2/f5 [0,4194304] 0 2024-03-19T06:06:07.965 INFO:tasks.workunit.client.0.smithi072.stdout:8/669: mkdir da/d27/d30/dde 0 2024-03-19T06:06:07.966 INFO:tasks.workunit.client.0.smithi072.stdout:1/703: dwrite d1/daa/dd8/d19/f93 [0,4194304] 0 2024-03-19T06:06:07.976 INFO:tasks.workunit.client.0.smithi072.stdout:7/578: dwrite d2/d3/d17/faf [0,4194304] 0 2024-03-19T06:06:07.980 INFO:tasks.workunit.client.0.smithi072.stdout:3/719: symlink d2/d3/d26/lf6 0 2024-03-19T06:06:07.982 INFO:tasks.workunit.client.0.smithi072.stdout:1/704: mknod d1/daa/dd8/d19/d1a/d25/d3c/d68/de4/ceb 0 2024-03-19T06:06:07.988 INFO:tasks.workunit.client.0.smithi072.stdout:5/797: truncate df/d13/d24/f82 929174 0 2024-03-19T06:06:07.999 INFO:tasks.workunit.client.0.smithi072.stdout:1/705: truncate d1/daa/dd8/d19/d1a/d25/d60/f75 18880 0 2024-03-19T06:06:08.003 INFO:tasks.workunit.client.0.smithi072.stdout:7/579: dwrite d2/d3/d18/d33/d1d/d3b/d63/d84/f92 [0,4194304] 0 2024-03-19T06:06:08.004 INFO:tasks.workunit.client.0.smithi072.stdout:1/706: fdatasync d1/daa/dd8/d63/d73/fd3 0 2024-03-19T06:06:08.005 INFO:tasks.workunit.client.0.smithi072.stdout:5/798: rename df/d13/d32/d28/d42/d59/d43/c52 to df/d13/d32/d28/cf0 0 2024-03-19T06:06:08.007 INFO:tasks.workunit.client.0.smithi072.stdout:8/670: dwrite da/d27/d52/d5b/d3e/f8c [0,4194304] 0 2024-03-19T06:06:08.011 INFO:tasks.workunit.client.0.smithi072.stdout:7/580: fsync d2/d3/d18/d33/d1d/d3b/d63/fac 0 2024-03-19T06:06:08.012 INFO:tasks.workunit.client.0.smithi072.stdout:8/671: write da/d27/d52/d5b/fb3 [527502,42684] 0 2024-03-19T06:06:08.020 INFO:tasks.workunit.client.0.smithi072.stdout:7/581: read d2/d3/d17/faf [295853,111770] 0 2024-03-19T06:06:08.023 INFO:tasks.workunit.client.0.smithi072.stdout:8/672: creat da/d37/d5c/d8e/fdf x:0 0 0 2024-03-19T06:06:08.025 INFO:tasks.workunit.client.0.smithi072.stdout:3/720: dread d2/f30 [0,4194304] 0 2024-03-19T06:06:08.026 INFO:tasks.workunit.client.0.smithi072.stdout:7/582: creat d2/d3/d18/fb1 x:0 0 0 2024-03-19T06:06:08.028 INFO:tasks.workunit.client.0.smithi072.stdout:8/673: creat da/d37/fe0 x:0 0 0 2024-03-19T06:06:08.030 INFO:tasks.workunit.client.0.smithi072.stdout:5/799: dwrite df/d13/f6b [0,4194304] 0 2024-03-19T06:06:08.031 INFO:tasks.workunit.client.0.smithi072.stdout:3/721: creat d2/d3/d26/d98/ff7 x:0 0 0 2024-03-19T06:06:08.032 INFO:tasks.workunit.client.0.smithi072.stdout:8/674: write da/d13/d14/d1b/d6b/fca [746230,118662] 0 2024-03-19T06:06:08.036 INFO:tasks.workunit.client.0.smithi072.stdout:5/800: chown df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/l8e 92603 1 2024-03-19T06:06:08.036 INFO:tasks.workunit.client.0.smithi072.stdout:3/722: mkdir d2/d19/db0/dcb/df8 0 2024-03-19T06:06:08.038 INFO:tasks.workunit.client.0.smithi072.stdout:8/675: unlink da/d13/d14/d1b/ldd 0 2024-03-19T06:06:08.045 INFO:tasks.workunit.client.0.smithi072.stdout:3/723: rename d2/d3/d25/f39 to d2/d40/d78/d9b/dc5/ff9 0 2024-03-19T06:06:08.047 INFO:tasks.workunit.client.0.smithi072.stdout:8/676: mkdir da/d37/de1 0 2024-03-19T06:06:08.048 INFO:tasks.workunit.client.0.smithi072.stdout:7/583: dread d2/d3/d17/faf [0,4194304] 0 2024-03-19T06:06:08.049 INFO:tasks.workunit.client.0.smithi072.stdout:5/801: getdents df/d13/d32/d28/d42/d59/d43/d4e 0 2024-03-19T06:06:08.050 INFO:tasks.workunit.client.0.smithi072.stdout:3/724: mknod d2/d75/cfa 0 2024-03-19T06:06:08.058 INFO:tasks.workunit.client.0.smithi072.stdout:3/725: write d2/d40/d78/d9b/fce [142732,103912] 0 2024-03-19T06:06:08.058 INFO:tasks.workunit.client.0.smithi072.stdout:7/584: creat d2/d3/d18/d7f/fb2 x:0 0 0 2024-03-19T06:06:08.058 INFO:tasks.workunit.client.0.smithi072.stdout:5/802: rmdir df/d14/d5d 39 2024-03-19T06:06:08.060 INFO:tasks.workunit.client.0.smithi072.stdout:3/726: dread - d2/d3/d15/d66/d6b/fc1 zero size 2024-03-19T06:06:08.065 INFO:tasks.workunit.client.0.smithi072.stdout:3/727: fdatasync d2/f2f 0 2024-03-19T06:06:08.073 INFO:tasks.workunit.client.0.smithi072.stdout:5/803: dread df/d13/d32/d28/d42/fb3 [0,4194304] 0 2024-03-19T06:06:08.074 INFO:tasks.workunit.client.0.smithi072.stdout:8/677: dread da/d27/d52/d5b/f6e [0,4194304] 0 2024-03-19T06:06:08.076 INFO:tasks.workunit.client.0.smithi072.stdout:8/678: read da/d13/d3f/fcf [273612,3137] 0 2024-03-19T06:06:08.083 INFO:tasks.workunit.client.0.smithi072.stdout:2/766: dread db/d10/d13/d24/d61/d7d/fd3 [0,4194304] 0 2024-03-19T06:06:08.085 INFO:tasks.workunit.client.0.smithi072.stdout:5/804: read - df/d16/dc4/fdb zero size 2024-03-19T06:06:08.087 INFO:tasks.workunit.client.0.smithi072.stdout:2/767: mknod db/d10/d2b/d45/da4/dd1/cfe 0 2024-03-19T06:06:08.088 INFO:tasks.workunit.client.0.smithi072.stdout:7/585: getdents d2/d3/d18/d33/d1d/d2b/d75 0 2024-03-19T06:06:08.089 INFO:tasks.workunit.client.0.smithi072.stdout:5/805: dread df/d13/d32/d28/d42/d59/d43/d4e/d5c/fae [0,4194304] 0 2024-03-19T06:06:08.095 INFO:tasks.workunit.client.0.smithi072.stdout:7/586: rename d2/d3/d18/d20/d3a/d50 to d2/d3/d18/d7f/db3 0 2024-03-19T06:06:08.097 INFO:tasks.workunit.client.0.smithi072.stdout:5/806: creat df/d13/d32/d28/d42/d59/d43/d4e/dbd/ff1 x:0 0 0 2024-03-19T06:06:08.098 INFO:tasks.workunit.client.0.smithi072.stdout:2/768: rename db/d10/d2b/d2d/d62/d6b/fdf to db/d10/d2b/d2d/d9e/d48/ddb/fff 0 2024-03-19T06:06:08.098 INFO:tasks.workunit.client.0.smithi072.stdout:7/587: chown d2/d3/d18/d33/d1d/d2b/d3d/l42 117 1 2024-03-19T06:06:08.099 INFO:tasks.workunit.client.0.smithi072.stdout:7/588: readlink d2/d3/d18/l73 0 2024-03-19T06:06:08.100 INFO:tasks.workunit.client.0.smithi072.stdout:5/807: truncate df/d13/f49 891138 0 2024-03-19T06:06:08.101 INFO:tasks.workunit.client.0.smithi072.stdout:7/589: fsync d2/d3/d18/d33/d1d/d2b/d3d/f6a 0 2024-03-19T06:06:08.103 INFO:tasks.workunit.client.0.smithi072.stdout:7/590: fdatasync d2/d3/d17/f48 0 2024-03-19T06:06:08.104 INFO:tasks.workunit.client.0.smithi072.stdout:5/808: symlink df/d54/dac/d9c/lf2 0 2024-03-19T06:06:08.107 INFO:tasks.workunit.client.0.smithi072.stdout:7/591: creat d2/d3/d43/fb4 x:0 0 0 2024-03-19T06:06:08.111 INFO:tasks.workunit.client.0.smithi072.stdout:7/592: mkdir d2/d3/d18/d33/d1d/d2b/db5 0 2024-03-19T06:06:08.117 INFO:tasks.workunit.client.0.smithi072.stdout:8/679: truncate da/f11 297704 0 2024-03-19T06:06:08.121 INFO:tasks.workunit.client.0.smithi072.stdout:8/680: creat da/d13/d14/fe2 x:0 0 0 2024-03-19T06:06:08.123 INFO:tasks.workunit.client.0.smithi072.stdout:2/769: dread db/d10/d13/d31/f3c [0,4194304] 0 2024-03-19T06:06:08.123 INFO:tasks.workunit.client.0.smithi072.stdout:5/809: write df/d13/d24/f82 [853648,60696] 0 2024-03-19T06:06:08.124 INFO:tasks.workunit.client.0.smithi072.stdout:8/681: read da/d13/d14/d1b/d6b/fca [584013,25516] 0 2024-03-19T06:06:08.126 INFO:tasks.workunit.client.0.smithi072.stdout:5/810: mknod df/cf3 0 2024-03-19T06:06:08.126 INFO:tasks.workunit.client.0.smithi072.stdout:2/770: chown db/d10/d2b/d2d/d9e/dab/dca 19 1 2024-03-19T06:06:08.128 INFO:tasks.workunit.client.0.smithi072.stdout:8/682: rmdir da/d27/d52/d5b/d3e/d7d 39 2024-03-19T06:06:08.130 INFO:tasks.workunit.client.0.smithi072.stdout:5/811: rmdir df/d13/d32/d28 39 2024-03-19T06:06:08.130 INFO:tasks.workunit.client.0.smithi072.stdout:2/771: write db/d10/f2e [118381,103907] 0 2024-03-19T06:06:08.130 INFO:tasks.workunit.client.0.smithi072.stdout:8/683: chown f4 296771088 1 2024-03-19T06:06:08.132 INFO:tasks.workunit.client.0.smithi072.stdout:7/593: dread d2/d3/d18/d33/d1d/d2b/f4a [0,4194304] 0 2024-03-19T06:06:08.134 INFO:tasks.workunit.client.0.smithi072.stdout:8/684: write da/d13/d14/d6f/f84 [1482004,126688] 0 2024-03-19T06:06:08.136 INFO:tasks.workunit.client.0.smithi072.stdout:5/812: fdatasync df/d16/dc4/fc7 0 2024-03-19T06:06:08.139 INFO:tasks.workunit.client.0.smithi072.stdout:2/772: rename db/d10/d13/d24/d72/fa8 to db/d10/d13/d31/d35/ddc/de1/f100 0 2024-03-19T06:06:08.141 INFO:tasks.workunit.client.0.smithi072.stdout:7/594: creat d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/fb6 x:0 0 0 2024-03-19T06:06:08.145 INFO:tasks.workunit.client.0.smithi072.stdout:7/595: write d2/d3/d18/d33/d1d/d3b/d63/d84/f92 [2815762,108047] 0 2024-03-19T06:06:08.150 INFO:tasks.workunit.client.0.smithi072.stdout:2/773: truncate db/d10/d12/f1b 671731 0 2024-03-19T06:06:08.155 INFO:tasks.workunit.client.0.smithi072.stdout:7/596: link d2/d3/d17/d70/c94 d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/cb7 0 2024-03-19T06:06:08.156 INFO:tasks.workunit.client.0.smithi072.stdout:2/774: dread db/f1e [0,4194304] 0 2024-03-19T06:06:08.163 INFO:tasks.workunit.client.0.smithi072.stdout:2/775: link db/d10/d2b/c4e db/d10/d2b/d2d/c101 0 2024-03-19T06:06:08.165 INFO:tasks.workunit.client.0.smithi072.stdout:5/813: dread df/d13/d32/d28/d42/d59/d43/d4e/d5c/f5f [0,4194304] 0 2024-03-19T06:06:08.167 INFO:tasks.workunit.client.0.smithi072.stdout:2/776: mknod db/d10/d13/d31/d35/ddc/c102 0 2024-03-19T06:06:08.170 INFO:tasks.workunit.client.0.smithi072.stdout:7/597: dwrite d2/d3/d43/fb4 [0,4194304] 0 2024-03-19T06:06:08.177 INFO:tasks.workunit.client.0.smithi072.stdout:5/814: rmdir df/d54 39 2024-03-19T06:06:08.180 INFO:tasks.workunit.client.0.smithi072.stdout:2/777: rename db/d10/d2b/d2d/d9e/d48 to db/d10/d13/df4/d103 0 2024-03-19T06:06:08.206 INFO:tasks.workunit.client.0.smithi072.stdout:6/635: sync 2024-03-19T06:06:08.206 INFO:tasks.workunit.client.0.smithi072.stdout:5/815: mknod df/d13/cf4 0 2024-03-19T06:06:08.210 INFO:tasks.workunit.client.0.smithi072.stdout:6/636: truncate f3 3011933 0 2024-03-19T06:06:08.211 INFO:tasks.workunit.client.0.smithi072.stdout:5/816: chown df/d13/d32/d28/d42/d59/d43/d4e/l76 918813 1 2024-03-19T06:06:08.214 INFO:tasks.workunit.client.0.smithi072.stdout:6/637: unlink d7/d9/c18 0 2024-03-19T06:06:08.215 INFO:tasks.workunit.client.0.smithi072.stdout:5/817: mkdir df/d54/df5 0 2024-03-19T06:06:08.216 INFO:tasks.workunit.client.0.smithi072.stdout:6/638: rmdir d7/d9/d1b 39 2024-03-19T06:06:08.223 INFO:tasks.workunit.client.0.smithi072.stdout:6/639: getdents d7/d9/d1b/d31/da6 0 2024-03-19T06:06:08.225 INFO:tasks.workunit.client.0.smithi072.stdout:6/640: chown d7/d3f/d65/f89 1 1 2024-03-19T06:06:08.232 INFO:tasks.workunit.client.0.smithi072.stdout:5/818: dread df/d13/d32/d28/d42/f79 [0,4194304] 0 2024-03-19T06:06:08.233 INFO:tasks.workunit.client.0.smithi072.stdout:6/641: rename d7/d9/d1b/d21/d68/daa/d76 to d7/d9/d1b/d33/ddc 0 2024-03-19T06:06:08.238 INFO:tasks.workunit.client.0.smithi072.stdout:5/819: fdatasync df/d3c/fc9 0 2024-03-19T06:06:08.241 INFO:tasks.workunit.client.0.smithi072.stdout:7/598: dread d2/d3/d18/d33/d1d/d2b/f4b [0,4194304] 0 2024-03-19T06:06:08.246 INFO:tasks.workunit.client.0.smithi072.stdout:7/599: dread d2/d3/d18/d33/d1d/d2b/f4a [0,4194304] 0 2024-03-19T06:06:08.247 INFO:tasks.workunit.client.0.smithi072.stdout:5/820: creat df/d13/d32/d28/d42/d59/d43/d4e/ff6 x:0 0 0 2024-03-19T06:06:08.249 INFO:tasks.workunit.client.0.smithi072.stdout:7/600: creat d2/d3/d43/fb8 x:0 0 0 2024-03-19T06:06:08.250 INFO:tasks.workunit.client.0.smithi072.stdout:6/642: write d7/d99/d60/f81 [362259,6625] 0 2024-03-19T06:06:08.251 INFO:tasks.workunit.client.0.smithi072.stdout:6/643: readlink d7/d99/d60/l85 0 2024-03-19T06:06:08.252 INFO:tasks.workunit.client.0.smithi072.stdout:5/821: creat df/d13/d32/d28/d42/d59/d43/d4e/dbd/ff7 x:0 0 0 2024-03-19T06:06:08.255 INFO:tasks.workunit.client.0.smithi072.stdout:7/601: rename d2/d3/d43/c9d to d2/d3/d18/d88/cb9 0 2024-03-19T06:06:08.256 INFO:tasks.workunit.client.0.smithi072.stdout:6/644: dread - d7/d9/d1b/f7c zero size 2024-03-19T06:06:08.258 INFO:tasks.workunit.client.0.smithi072.stdout:7/602: chown d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/f78 482 1 2024-03-19T06:06:08.259 INFO:tasks.workunit.client.0.smithi072.stdout:7/603: fsync d2/d3/d18/fb1 0 2024-03-19T06:06:08.261 INFO:tasks.workunit.client.0.smithi072.stdout:5/822: dread df/d14/f2f [4194304,4194304] 0 2024-03-19T06:06:08.262 INFO:tasks.workunit.client.0.smithi072.stdout:5/823: read - df/d54/fb5 zero size 2024-03-19T06:06:08.263 INFO:tasks.workunit.client.0.smithi072.stdout:7/604: fsync d2/d3/d18/d33/d1d/d2b/f45 0 2024-03-19T06:06:08.277 INFO:tasks.workunit.client.0.smithi072.stdout:7/605: dwrite d2/d3/d17/f69 [0,4194304] 0 2024-03-19T06:06:08.280 INFO:tasks.workunit.client.0.smithi072.stdout:7/606: chown d2/d3/d18/d3f/c4d 43153349 1 2024-03-19T06:06:08.282 INFO:tasks.workunit.client.0.smithi072.stdout:5/824: dwrite df/d13/d32/d28/d42/d59/d43/d4e/d5c/f7c [0,4194304] 0 2024-03-19T06:06:08.283 INFO:tasks.workunit.client.0.smithi072.stdout:7/607: mkdir d2/d8c/dba 0 2024-03-19T06:06:08.284 INFO:tasks.workunit.client.0.smithi072.stdout:5/825: dread - df/d13/fb0 zero size 2024-03-19T06:06:08.287 INFO:tasks.workunit.client.0.smithi072.stdout:7/608: write d2/d3/d18/d33/d1d/d2b/d3d/f39 [4366187,81268] 0 2024-03-19T06:06:08.290 INFO:tasks.workunit.client.0.smithi072.stdout:5/826: creat df/d13/d32/d28/d42/ff8 x:0 0 0 2024-03-19T06:06:08.293 INFO:tasks.workunit.client.0.smithi072.stdout:5/827: write df/d13/d32/d28/f81 [1349577,27875] 0 2024-03-19T06:06:08.304 INFO:tasks.workunit.client.0.smithi072.stdout:7/609: dwrite d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/fb6 [0,4194304] 0 2024-03-19T06:06:08.309 INFO:tasks.workunit.client.0.smithi072.stdout:7/610: rename d2/d3/d18/d33/d1d/d2b/d3d/d21 to d2/d3/d18/d33/d1d/d2b/d3d/d21/dbb 22 2024-03-19T06:06:08.309 INFO:tasks.workunit.client.0.smithi072.stdout:5/828: dread df/f26 [0,4194304] 0 2024-03-19T06:06:08.313 INFO:tasks.workunit.client.0.smithi072.stdout:7/611: rename d2/d3/d43 to d2/d8c/dba/dbc 0 2024-03-19T06:06:08.315 INFO:tasks.workunit.client.0.smithi072.stdout:7/612: chown d2/d3/d18/d33/d1d/d2b/f4b 209 1 2024-03-19T06:06:08.318 INFO:tasks.workunit.client.0.smithi072.stdout:7/613: mkdir d2/d3/d18/d33/d53/dbd 0 2024-03-19T06:06:08.325 INFO:tasks.workunit.client.0.smithi072.stdout:7/614: unlink d2/d3/d17/c29 0 2024-03-19T06:06:08.325 INFO:tasks.workunit.client.0.smithi072.stdout:5/829: dwrite df/d13/d32/d28/d42/d59/d43/d4e/ff6 [0,4194304] 0 2024-03-19T06:06:08.328 INFO:tasks.workunit.client.0.smithi072.stdout:5/830: chown df/fcc 528516 1 2024-03-19T06:06:08.333 INFO:tasks.workunit.client.0.smithi072.stdout:7/615: rename d2/d3/d18/d33/d1d/d2b/d3d to d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/dbe 22 2024-03-19T06:06:08.336 INFO:tasks.workunit.client.0.smithi072.stdout:7/616: symlink d2/d3/d18/d33/d1d/lbf 0 2024-03-19T06:06:08.339 INFO:tasks.workunit.client.0.smithi072.stdout:5/831: truncate df/d16/f36 175005 0 2024-03-19T06:06:08.344 INFO:tasks.workunit.client.0.smithi072.stdout:7/617: rename d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/cb7 to d2/d8c/da9/cc0 0 2024-03-19T06:06:08.348 INFO:tasks.workunit.client.0.smithi072.stdout:7/618: mknod d2/d3/d18/d88/cc1 0 2024-03-19T06:06:08.352 INFO:tasks.workunit.client.0.smithi072.stdout:5/832: dread df/d13/d32/d28/d42/f6a [0,4194304] 0 2024-03-19T06:06:08.356 INFO:tasks.workunit.client.0.smithi072.stdout:5/833: creat df/d54/dac/ff9 x:0 0 0 2024-03-19T06:06:08.361 INFO:tasks.workunit.client.0.smithi072.stdout:5/834: creat df/d13/d32/d28/d42/d59/d43/ffa x:0 0 0 2024-03-19T06:06:08.362 INFO:tasks.workunit.client.0.smithi072.stdout:7/619: dwrite d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/f78 [0,4194304] 0 2024-03-19T06:06:08.363 INFO:tasks.workunit.client.0.smithi072.stdout:7/620: stat d2/d3/d18/d33/d1d/d2b/l55 0 2024-03-19T06:06:08.367 INFO:tasks.workunit.client.0.smithi072.stdout:5/835: creat df/d16/dc4/ffb x:0 0 0 2024-03-19T06:06:08.386 INFO:tasks.workunit.client.0.smithi072.stdout:5/836: write df/d14/d5d/fad [749661,72197] 0 2024-03-19T06:06:08.391 INFO:tasks.workunit.client.0.smithi072.stdout:5/837: mknod df/d3c/def/cfc 0 2024-03-19T06:06:08.395 INFO:tasks.workunit.client.0.smithi072.stdout:5/838: truncate df/d14/fa4 247948 0 2024-03-19T06:06:08.398 INFO:tasks.workunit.client.0.smithi072.stdout:5/839: unlink df/d13/d24/f82 0 2024-03-19T06:06:08.398 INFO:tasks.workunit.client.0.smithi072.stdout:5/840: stat df/d14/ce2 0 2024-03-19T06:06:08.401 INFO:tasks.workunit.client.0.smithi072.stdout:5/841: rmdir df/d54/dac/d7e 39 2024-03-19T06:06:08.403 INFO:tasks.workunit.client.0.smithi072.stdout:5/842: write df/d14/d5d/fad [615866,13898] 0 2024-03-19T06:06:08.406 INFO:tasks.workunit.client.0.smithi072.stdout:5/843: chown df/d13/d32/d28/d42/d59/d43/d4e/l95 109972 1 2024-03-19T06:06:08.408 INFO:tasks.workunit.client.0.smithi072.stdout:5/844: write df/d54/dac/fd9 [416981,119533] 0 2024-03-19T06:06:08.546 INFO:tasks.workunit.client.0.smithi072.stdout:9/658: sync 2024-03-19T06:06:08.551 INFO:tasks.workunit.client.0.smithi072.stdout:9/659: write d11/d24/d4c/dda/d36/d45/f4a [2199834,103365] 0 2024-03-19T06:06:08.555 INFO:tasks.workunit.client.0.smithi072.stdout:9/660: fsync d11/d24/d4c/dda/d36/fc8 0 2024-03-19T06:06:08.560 INFO:tasks.workunit.client.0.smithi072.stdout:9/661: mknod d11/d78/ce1 0 2024-03-19T06:06:08.578 INFO:tasks.workunit.client.0.smithi072.stdout:9/662: write d11/f44 [1690626,117410] 0 2024-03-19T06:06:08.611 INFO:tasks.workunit.client.0.smithi072.stdout:9/663: dwrite d11/d24/d4c/dda/d68/d92/da6/fca [0,4194304] 0 2024-03-19T06:06:08.615 INFO:tasks.workunit.client.0.smithi072.stdout:9/664: chown d11/d24/d4c/dda/d36/d45/d4d/fc6 3285490 1 2024-03-19T06:06:08.626 INFO:tasks.workunit.client.0.smithi072.stdout:9/665: creat d11/d24/d4c/dda/d6f/d88/fe2 x:0 0 0 2024-03-19T06:06:08.634 INFO:tasks.workunit.client.0.smithi072.stdout:9/666: creat d11/d24/d4c/dda/d36/fe3 x:0 0 0 2024-03-19T06:06:08.644 INFO:tasks.workunit.client.0.smithi072.stdout:9/667: mknod d11/d24/d4c/dda/ce4 0 2024-03-19T06:06:08.651 INFO:tasks.workunit.client.0.smithi072.stdout:9/668: mknod d11/d24/ddd/d5c/ce5 0 2024-03-19T06:06:08.664 INFO:tasks.workunit.client.0.smithi072.stdout:9/669: link d11/d24/d4c/dda/d68/f73 d11/d24/d4c/dda/d68/d79/fe6 0 2024-03-19T06:06:08.668 INFO:tasks.workunit.client.0.smithi072.stdout:9/670: stat d11/d24/ddd/d57/fbb 0 2024-03-19T06:06:09.036 INFO:tasks.workunit.client.0.smithi072.stdout:0/729: sync 2024-03-19T06:06:09.036 INFO:tasks.workunit.client.0.smithi072.stdout:4/851: sync 2024-03-19T06:06:09.042 INFO:tasks.workunit.client.0.smithi072.stdout:0/730: creat d1/d1c/d24/d27/d7c/daa/ff1 x:0 0 0 2024-03-19T06:06:09.047 INFO:tasks.workunit.client.0.smithi072.stdout:4/852: rename d5/d15/d22/d41/d7b/d7c/db4/fcc to d5/d15/d31/d6d/f12d 0 2024-03-19T06:06:09.049 INFO:tasks.workunit.client.0.smithi072.stdout:4/853: chown d5/d37/d52/fc5 28931 1 2024-03-19T06:06:09.049 INFO:tasks.workunit.client.0.smithi072.stdout:0/731: unlink d1/f5 0 2024-03-19T06:06:09.053 INFO:tasks.workunit.client.0.smithi072.stdout:0/732: creat d1/d1c/d24/d27/d7e/ff2 x:0 0 0 2024-03-19T06:06:09.067 INFO:tasks.workunit.client.0.smithi072.stdout:4/854: write d5/d15/d73/fd7 [934863,124758] 0 2024-03-19T06:06:09.070 INFO:tasks.workunit.client.0.smithi072.stdout:4/855: write d5/d15/d3f/f119 [558956,85698] 0 2024-03-19T06:06:09.086 INFO:tasks.workunit.client.0.smithi072.stdout:0/733: dread d1/d1c/d24/d27/d7c/f5a [0,4194304] 0 2024-03-19T06:06:09.120 INFO:tasks.workunit.client.0.smithi072.stdout:4/856: fdatasync d5/d15/d3f/dc1/f2e 0 2024-03-19T06:06:09.132 INFO:tasks.workunit.client.0.smithi072.stdout:3/728: sync 2024-03-19T06:06:09.133 INFO:tasks.workunit.client.0.smithi072.stdout:1/707: sync 2024-03-19T06:06:09.135 INFO:tasks.workunit.client.0.smithi072.stdout:3/729: stat d2/d3/d15/d66/d6b/d79/f83 0 2024-03-19T06:06:09.137 INFO:tasks.workunit.client.0.smithi072.stdout:1/708: write d1/daa/dd8/d19/d1a/d61/d65/fd2 [362575,83068] 0 2024-03-19T06:06:09.144 INFO:tasks.workunit.client.0.smithi072.stdout:4/857: dwrite d5/fa [0,4194304] 0 2024-03-19T06:06:09.145 INFO:tasks.workunit.client.0.smithi072.stdout:1/709: write d1/daa/dd8/d19/d1a/d25/d3c/fe7 [1044929,63436] 0 2024-03-19T06:06:09.157 INFO:tasks.workunit.client.0.smithi072.stdout:4/858: creat d5/d37/f12e x:0 0 0 2024-03-19T06:06:09.158 INFO:tasks.workunit.client.0.smithi072.stdout:3/730: dwrite d2/fb3 [0,4194304] 0 2024-03-19T06:06:09.160 INFO:tasks.workunit.client.0.smithi072.stdout:4/859: unlink d5/d15/d73/f107 0 2024-03-19T06:06:09.166 INFO:tasks.workunit.client.0.smithi072.stdout:1/710: dwrite d1/f15 [0,4194304] 0 2024-03-19T06:06:09.167 INFO:tasks.workunit.client.0.smithi072.stdout:4/860: creat d5/d15/d22/d41/f12f x:0 0 0 2024-03-19T06:06:09.171 INFO:tasks.workunit.client.0.smithi072.stdout:0/734: truncate d1/d1c/d24/d27/d73/fb2 721535 0 2024-03-19T06:06:09.176 INFO:tasks.workunit.client.0.smithi072.stdout:3/731: rename d2/d40/d78/ld1 to d2/d40/d78/d9b/lfb 0 2024-03-19T06:06:09.178 INFO:tasks.workunit.client.0.smithi072.stdout:0/735: mknod d1/d1c/d82/d90/cf3 0 2024-03-19T06:06:09.183 INFO:tasks.workunit.client.0.smithi072.stdout:3/732: rmdir d2/d40/d78/d9b/dc5 39 2024-03-19T06:06:09.186 INFO:tasks.workunit.client.0.smithi072.stdout:0/736: fdatasync d1/d1c/d24/d27/d73/d80/d8b/f5b 0 2024-03-19T06:06:09.189 INFO:tasks.workunit.client.0.smithi072.stdout:0/737: chown d1/d1c/d24/d27/d7c/d6a/c9a 7 1 2024-03-19T06:06:09.192 INFO:tasks.workunit.client.0.smithi072.stdout:6/645: sync 2024-03-19T06:06:09.192 INFO:tasks.workunit.client.0.smithi072.stdout:5/845: sync 2024-03-19T06:06:09.192 INFO:tasks.workunit.client.0.smithi072.stdout:8/685: sync 2024-03-19T06:06:09.192 INFO:tasks.workunit.client.0.smithi072.stdout:2/778: sync 2024-03-19T06:06:09.192 INFO:tasks.workunit.client.0.smithi072.stdout:7/621: sync 2024-03-19T06:06:09.194 INFO:tasks.workunit.client.0.smithi072.stdout:0/738: chown d1/d1c/d24/d27/d73/d80/dd2 86212 1 2024-03-19T06:06:09.195 INFO:tasks.workunit.client.0.smithi072.stdout:9/671: sync 2024-03-19T06:06:09.196 INFO:tasks.workunit.client.0.smithi072.stdout:5/846: creat df/d3c/ffd x:0 0 0 2024-03-19T06:06:09.200 INFO:tasks.workunit.client.0.smithi072.stdout:8/686: mkdir da/d37/de1/de3 0 2024-03-19T06:06:09.202 INFO:tasks.workunit.client.0.smithi072.stdout:7/622: rmdir d2/d3/d18/d33/d1d/d2b/d3d/d21/d31 39 2024-03-19T06:06:09.202 INFO:tasks.workunit.client.0.smithi072.stdout:8/687: read - da/d37/fe0 zero size 2024-03-19T06:06:09.205 INFO:tasks.workunit.client.0.smithi072.stdout:8/688: stat da/d27/d30/dde 0 2024-03-19T06:06:09.211 INFO:tasks.workunit.client.0.smithi072.stdout:2/779: creat db/d10/d2b/d2d/d9e/dab/f104 x:0 0 0 2024-03-19T06:06:09.211 INFO:tasks.workunit.client.0.smithi072.stdout:9/672: dread d11/d24/d4c/dda/d36/d45/d4d/fc6 [0,4194304] 0 2024-03-19T06:06:09.211 INFO:tasks.workunit.client.0.smithi072.stdout:1/711: write d1/d11/d76/f97 [210979,42379] 0 2024-03-19T06:06:09.214 INFO:tasks.workunit.client.0.smithi072.stdout:0/739: link d1/d1c/d82/d90/fbc d1/d1c/d24/d3f/de8/ff4 0 2024-03-19T06:06:09.216 INFO:tasks.workunit.client.0.smithi072.stdout:8/689: unlink da/c26 0 2024-03-19T06:06:09.217 INFO:tasks.workunit.client.0.smithi072.stdout:4/861: truncate d5/d1b/fa7 6885578 0 2024-03-19T06:06:09.217 INFO:tasks.workunit.client.0.smithi072.stdout:6/646: link d7/d9/d2b/cbd d7/d3f/d44/cdd 0 2024-03-19T06:06:09.218 INFO:tasks.workunit.client.0.smithi072.stdout:3/733: write d2/d19/d1e/f6f [1757892,124852] 0 2024-03-19T06:06:09.220 INFO:tasks.workunit.client.0.smithi072.stdout:2/780: creat db/d10/d12/f105 x:0 0 0 2024-03-19T06:06:09.222 INFO:tasks.workunit.client.0.smithi072.stdout:1/712: creat d1/daa/dd8/d63/d73/fec x:0 0 0 2024-03-19T06:06:09.224 INFO:tasks.workunit.client.0.smithi072.stdout:7/623: dwrite d2/d3/d18/d33/d1d/d2b/f6c [0,4194304] 0 2024-03-19T06:06:09.225 INFO:tasks.workunit.client.0.smithi072.stdout:5/847: rename df/d13/l20 to df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/lfe 0 2024-03-19T06:06:09.228 INFO:tasks.workunit.client.0.smithi072.stdout:2/781: truncate db/d10/d13/d31/d35/f43 5175033 0 2024-03-19T06:06:09.230 INFO:tasks.workunit.client.0.smithi072.stdout:8/690: mknod da/d13/d3f/db9/dc1/ce4 0 2024-03-19T06:06:09.230 INFO:tasks.workunit.client.0.smithi072.stdout:5/848: mkdir df/d13/dff 0 2024-03-19T06:06:09.232 INFO:tasks.workunit.client.0.smithi072.stdout:8/691: stat da/d13/d3f 0 2024-03-19T06:06:09.232 INFO:tasks.workunit.client.0.smithi072.stdout:3/734: write d2/d3/d26/f59 [969387,95244] 0 2024-03-19T06:06:09.233 INFO:tasks.workunit.client.0.smithi072.stdout:5/849: dread - df/d54/dac/ff9 zero size 2024-03-19T06:06:09.236 INFO:tasks.workunit.client.0.smithi072.stdout:7/624: symlink d2/d3/d18/d33/d83/lc2 0 2024-03-19T06:06:09.239 INFO:tasks.workunit.client.0.smithi072.stdout:2/782: symlink db/d10/d2b/d2d/d66/l106 0 2024-03-19T06:06:09.239 INFO:tasks.workunit.client.0.smithi072.stdout:7/625: readlink d2/d3/d17/l95 0 2024-03-19T06:06:09.240 INFO:tasks.workunit.client.0.smithi072.stdout:4/862: link d5/d15/d31/l89 d5/d15/d3f/dc1/l130 0 2024-03-19T06:06:09.240 INFO:tasks.workunit.client.0.smithi072.stdout:5/850: chown df/d54/dac/d9c/fc3 30111 1 2024-03-19T06:06:09.242 INFO:tasks.workunit.client.0.smithi072.stdout:0/740: rmdir d1/d1c/d82 39 2024-03-19T06:06:09.247 INFO:tasks.workunit.client.0.smithi072.stdout:5/851: dread - df/d54/fb5 zero size 2024-03-19T06:06:09.248 INFO:tasks.workunit.client.0.smithi072.stdout:3/735: stat d2/d3/c51 0 2024-03-19T06:06:09.248 INFO:tasks.workunit.client.0.smithi072.stdout:0/741: chown d1/d2c/l50 943 1 2024-03-19T06:06:09.249 INFO:tasks.workunit.client.0.smithi072.stdout:6/647: dwrite d7/f11 [0,4194304] 0 2024-03-19T06:06:09.250 INFO:tasks.workunit.client.0.smithi072.stdout:9/673: dread d11/d24/d4c/dda/fa1 [0,4194304] 0 2024-03-19T06:06:09.253 INFO:tasks.workunit.client.0.smithi072.stdout:8/692: mknod da/d37/de1/de3/ce5 0 2024-03-19T06:06:09.254 INFO:tasks.workunit.client.0.smithi072.stdout:7/626: dread - d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/f7c zero size 2024-03-19T06:06:09.254 INFO:tasks.workunit.client.0.smithi072.stdout:9/674: dread - d11/d24/fc9 zero size 2024-03-19T06:06:09.255 INFO:tasks.workunit.client.0.smithi072.stdout:6/648: chown d7/d9/d2b/f53 1 1 2024-03-19T06:06:09.256 INFO:tasks.workunit.client.0.smithi072.stdout:4/863: symlink d5/d11/l131 0 2024-03-19T06:06:09.263 INFO:tasks.workunit.client.0.smithi072.stdout:9/675: rmdir d11/d24/d4c/dda/d68/d79 39 2024-03-19T06:06:09.266 INFO:tasks.workunit.client.0.smithi072.stdout:2/783: dread db/d10/d13/d24/d61/d7d/fd3 [0,4194304] 0 2024-03-19T06:06:09.267 INFO:tasks.workunit.client.0.smithi072.stdout:7/627: symlink d2/d3/d17/lc3 0 2024-03-19T06:06:09.268 INFO:tasks.workunit.client.0.smithi072.stdout:4/864: rename d5/d15/d31/d4c/lee to d5/d15/d22/d41/d61/l132 0 2024-03-19T06:06:09.270 INFO:tasks.workunit.client.0.smithi072.stdout:9/676: symlink d11/d24/le7 0 2024-03-19T06:06:09.278 INFO:tasks.workunit.client.0.smithi072.stdout:2/784: read db/d10/d13/d24/d72/f81 [104405,19826] 0 2024-03-19T06:06:09.285 INFO:tasks.workunit.client.0.smithi072.stdout:7/628: fsync d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/fb6 0 2024-03-19T06:06:09.294 INFO:tasks.workunit.client.0.smithi072.stdout:5/852: dwrite df/d54/dac/f6d [4194304,4194304] 0 2024-03-19T06:06:09.297 INFO:tasks.workunit.client.0.smithi072.stdout:6/649: dwrite d7/d3f/fc2 [0,4194304] 0 2024-03-19T06:06:09.298 INFO:tasks.workunit.client.0.smithi072.stdout:9/677: write d11/d24/d4c/dda/d36/d45/d4d/fc6 [1815930,51597] 0 2024-03-19T06:06:09.302 INFO:tasks.workunit.client.0.smithi072.stdout:2/785: dread - db/d10/d13/df4/d103/d82/d98/dbf/fe7 zero size 2024-03-19T06:06:09.302 INFO:tasks.workunit.client.0.smithi072.stdout:8/693: dwrite da/d37/fe0 [0,4194304] 0 2024-03-19T06:06:09.311 INFO:tasks.workunit.client.0.smithi072.stdout:1/713: dread d1/d11/d76/da7/d9e/fc1 [0,4194304] 0 2024-03-19T06:06:09.316 INFO:tasks.workunit.client.0.smithi072.stdout:0/742: dwrite d1/d1c/d24/d27/d7c/daa/fc3 [0,4194304] 0 2024-03-19T06:06:09.319 INFO:tasks.workunit.client.0.smithi072.stdout:4/865: dwrite d5/fdd [0,4194304] 0 2024-03-19T06:06:09.324 INFO:tasks.workunit.client.0.smithi072.stdout:3/736: dread d2/d19/f53 [0,4194304] 0 2024-03-19T06:06:09.324 INFO:tasks.workunit.client.0.smithi072.stdout:2/786: mknod db/d10/d2b/d2d/d62/d6b/c107 0 2024-03-19T06:06:09.325 INFO:tasks.workunit.client.0.smithi072.stdout:7/629: getdents d2 0 2024-03-19T06:06:09.326 INFO:tasks.workunit.client.0.smithi072.stdout:8/694: dread da/d27/d52/d5b/fb3 [0,4194304] 0 2024-03-19T06:06:09.332 INFO:tasks.workunit.client.0.smithi072.stdout:4/866: creat d5/d15/d22/d95/d104/f133 x:0 0 0 2024-03-19T06:06:09.333 INFO:tasks.workunit.client.0.smithi072.stdout:6/650: truncate d7/d9/d1b/d21/fd5 2414232 0 2024-03-19T06:06:09.335 INFO:tasks.workunit.client.0.smithi072.stdout:5/853: getdents df/d13/d32/d28/d42/d59/d43 0 2024-03-19T06:06:09.336 INFO:tasks.workunit.client.0.smithi072.stdout:7/630: fdatasync d2/d3/d18/d33/fa6 0 2024-03-19T06:06:09.336 INFO:tasks.workunit.client.0.smithi072.stdout:8/695: chown da/d37/d5c/d8e/fdf 21853 1 2024-03-19T06:06:09.338 INFO:tasks.workunit.client.0.smithi072.stdout:1/714: rename d1/daa/dd8/d19/d72/f7e to d1/daa/dd8/d19/d1a/d25/d3c/d68/d96/dc0/fed 0 2024-03-19T06:06:09.340 INFO:tasks.workunit.client.0.smithi072.stdout:0/743: creat d1/de7/ff5 x:0 0 0 2024-03-19T06:06:09.342 INFO:tasks.workunit.client.0.smithi072.stdout:8/696: fsync da/d37/d5c/fda 0 2024-03-19T06:06:09.343 INFO:tasks.workunit.client.0.smithi072.stdout:3/737: link d2/d19/db0/dcb/fcf d2/dc8/ffc 0 2024-03-19T06:06:09.343 INFO:tasks.workunit.client.0.smithi072.stdout:4/867: mknod d5/d15/d22/d95/c134 0 2024-03-19T06:06:09.345 INFO:tasks.workunit.client.0.smithi072.stdout:5/854: creat df/d13/dff/f100 x:0 0 0 2024-03-19T06:06:09.346 INFO:tasks.workunit.client.0.smithi072.stdout:8/697: creat da/d27/fe6 x:0 0 0 2024-03-19T06:06:09.348 INFO:tasks.workunit.client.0.smithi072.stdout:3/738: fdatasync d2/d19/f6c 0 2024-03-19T06:06:09.349 INFO:tasks.workunit.client.0.smithi072.stdout:0/744: dread - d1/d1c/d82/d90/de0/fee zero size 2024-03-19T06:06:09.351 INFO:tasks.workunit.client.0.smithi072.stdout:8/698: mknod da/d37/db0/ce7 0 2024-03-19T06:06:09.355 INFO:tasks.workunit.client.0.smithi072.stdout:1/715: rename d1/daa/dd8/d19/d1a/d25/d3c/d68/de4/ceb to d1/cee 0 2024-03-19T06:06:09.357 INFO:tasks.workunit.client.0.smithi072.stdout:0/745: fdatasync d1/d1c/d24/d27/d7c/f5a 0 2024-03-19T06:06:09.361 INFO:tasks.workunit.client.0.smithi072.stdout:3/739: creat d2/d19/db0/dcb/df8/ffd x:0 0 0 2024-03-19T06:06:09.362 INFO:tasks.workunit.client.0.smithi072.stdout:8/699: chown da/d27/dc2/dc6/dd1 313 1 2024-03-19T06:06:09.364 INFO:tasks.workunit.client.0.smithi072.stdout:4/868: rename d5/d8a/l11b to d5/d15/d22/d41/d61/l135 0 2024-03-19T06:06:09.368 INFO:tasks.workunit.client.0.smithi072.stdout:3/740: symlink d2/lfe 0 2024-03-19T06:06:09.378 INFO:tasks.workunit.client.0.smithi072.stdout:7/631: dwrite d2/d3/d18/d33/d1d/d3b/d63/fac [0,4194304] 0 2024-03-19T06:06:09.379 INFO:tasks.workunit.client.0.smithi072.stdout:8/700: dread - da/d27/fe6 zero size 2024-03-19T06:06:09.382 INFO:tasks.workunit.client.0.smithi072.stdout:2/787: dread db/d10/d13/d24/d61/d7d/fb2 [0,4194304] 0 2024-03-19T06:06:09.385 INFO:tasks.workunit.client.0.smithi072.stdout:6/651: dread d7/d9/d1b/d3b/f95 [0,4194304] 0 2024-03-19T06:06:09.387 INFO:tasks.workunit.client.0.smithi072.stdout:4/869: link d5/f8 d5/d15/d22/d41/d7b/d7c/f136 0 2024-03-19T06:06:09.391 INFO:tasks.workunit.client.0.smithi072.stdout:8/701: mknod da/d37/dd3/ce8 0 2024-03-19T06:06:09.397 INFO:tasks.workunit.client.0.smithi072.stdout:5/855: dwrite df/d13/d32/d28/d42/d59/d43/d4e/ff6 [0,4194304] 0 2024-03-19T06:06:09.407 INFO:tasks.workunit.client.0.smithi072.stdout:4/870: chown d5/d15/d31/d6f/fa3 673 1 2024-03-19T06:06:09.407 INFO:tasks.workunit.client.0.smithi072.stdout:3/741: truncate d2/d3/d26/f35 3719217 0 2024-03-19T06:06:09.408 INFO:tasks.workunit.client.0.smithi072.stdout:1/716: dwrite d1/daa/dd8/d63/d73/fd3 [0,4194304] 0 2024-03-19T06:06:09.409 INFO:tasks.workunit.client.0.smithi072.stdout:2/788: rename db/d10/d13/d24/l36 to db/d10/d13/df4/d103/dd9/l108 0 2024-03-19T06:06:09.412 INFO:tasks.workunit.client.0.smithi072.stdout:5/856: rmdir df/d13/dff 39 2024-03-19T06:06:09.416 INFO:tasks.workunit.client.0.smithi072.stdout:0/746: dwrite d1/d1c/d24/d3f/f76 [0,4194304] 0 2024-03-19T06:06:09.427 INFO:tasks.workunit.client.0.smithi072.stdout:8/702: rmdir da/d27/d52/d5b/d3e/d7d 39 2024-03-19T06:06:09.435 INFO:tasks.workunit.client.0.smithi072.stdout:3/742: creat d2/d3/d26/fff x:0 0 0 2024-03-19T06:06:09.437 INFO:tasks.workunit.client.0.smithi072.stdout:3/743: write d2/fb1 [71267,46878] 0 2024-03-19T06:06:09.438 INFO:tasks.workunit.client.0.smithi072.stdout:6/652: dwrite d7/d9/d1b/d3b/f95 [0,4194304] 0 2024-03-19T06:06:09.439 INFO:tasks.workunit.client.0.smithi072.stdout:7/632: dread d2/d3/d18/d33/d1d/d2b/d3d/d21/d74/fb6 [0,4194304] 0 2024-03-19T06:06:09.440 INFO:tasks.workunit.client.0.smithi072.stdout:3/744: write d2/d3/d26/f59 [2692761,8983] 0 2024-03-19T06:06:09.440 INFO:tasks.workunit.client.0.smithi072.stdout:2/789: link db/d10/d59/fd6 db/d10/d13/df4/d103/d82/d98/dbf/f109 0 2024-03-19T06:06:09.444 INFO:tasks.workunit.client.0.smithi072.stdout:8/703: symlink da/d13/d14/d1b/d57/dd7/le9 0 2024-03-19T06:06:09.444 INFO:tasks.workunit.client.0.smithi072.stdout:5/857: dread df/d14/d5d/fad [0,4194304] 0 2024-03-19T06:06:09.445 INFO:tasks.workunit.client.0.smithi072.stdout:4/871: link d5/d15/d22/d41/d7b/d7c/l123 d5/d15/d22/d41/d61/l137 0 2024-03-19T06:06:09.446 INFO:tasks.workunit.client.0.smithi072.stdout:2/790: fsync db/d10/d13/d31/fda 0 2024-03-19T06:06:09.448 INFO:tasks.workunit.client.0.smithi072.stdout:3/745: creat d2/d3/d25/f100 x:0 0 0 2024-03-19T06:06:09.452 INFO:tasks.workunit.client.0.smithi072.stdout:4/872: write d5/d15/d3f/dc1/f2e [290858,118411] 0 2024-03-19T06:06:09.453 INFO:tasks.workunit.client.0.smithi072.stdout:6/653: creat d7/d99/d60/d78/d7f/fde x:0 0 0 2024-03-19T06:06:09.457 INFO:tasks.workunit.client.0.smithi072.stdout:8/704: unlink da/d13/d14/d1b/d6b/c74 0 2024-03-19T06:06:09.459 INFO:tasks.workunit.client.0.smithi072.stdout:5/858: truncate df/d13/d32/f3a 764452 0 2024-03-19T06:06:09.461 INFO:tasks.workunit.client.0.smithi072.stdout:2/791: creat db/d10/d2b/dc3/f10a x:0 0 0 2024-03-19T06:06:09.462 INFO:tasks.workunit.client.0.smithi072.stdout:5/859: fdatasync df/d13/f5e 0 2024-03-19T06:06:09.464 INFO:tasks.workunit.client.0.smithi072.stdout:8/705: mkdir da/d27/dc2/dc6/dea 0 2024-03-19T06:06:09.469 INFO:tasks.workunit.client.0.smithi072.stdout:1/717: dwrite d1/daa/dd8/d19/d1a/d25/d3c/f62 [0,4194304] 0 2024-03-19T06:06:09.471 INFO:tasks.workunit.client.0.smithi072.stdout:7/633: dwrite d2/d3/fd [0,4194304] 0 2024-03-19T06:06:09.471 INFO:tasks.workunit.client.0.smithi072.stdout:8/706: write da/d3b/f9b [4538273,17730] 0 2024-03-19T06:06:09.481 INFO:tasks.workunit.client.0.smithi072.stdout:7/634: chown d2/f66 13213662 1 2024-03-19T06:06:09.483 INFO:tasks.workunit.client.0.smithi072.stdout:0/747: dread d1/d1c/d24/f86 [0,4194304] 0 2024-03-19T06:06:09.485 INFO:tasks.workunit.client.0.smithi072.stdout:1/718: chown d1/d11/d76/da7/l94 100797949 1 2024-03-19T06:06:09.490 INFO:tasks.workunit.client.0.smithi072.stdout:2/792: creat db/d10/d2b/d2d/d9e/f10b x:0 0 0 2024-03-19T06:06:09.496 INFO:tasks.workunit.client.0.smithi072.stdout:4/873: truncate d5/d15/d22/d41/d7b/d7c/f136 1904694 0 2024-03-19T06:06:09.496 INFO:tasks.workunit.client.0.smithi072.stdout:3/746: link d2/d3/d25/lb6 d2/d40/d78/d9b/dc5/l101 0 2024-03-19T06:06:09.499 INFO:tasks.workunit.client.0.smithi072.stdout:1/719: chown d1/daa/dd8/d63/d73/fec 1946206 1 2024-03-19T06:06:09.502 INFO:tasks.workunit.client.0.smithi072.stdout:7/635: creat d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/fc4 x:0 0 0 2024-03-19T06:06:09.505 INFO:tasks.workunit.client.0.smithi072.stdout:5/860: creat df/d13/d32/d28/d42/d59/d43/d4e/d5c/f101 x:0 0 0 2024-03-19T06:06:09.505 INFO:tasks.workunit.client.0.smithi072.stdout:2/793: creat db/d10/d13/d31/d35/ddc/f10c x:0 0 0 2024-03-19T06:06:09.505 INFO:tasks.workunit.client.0.smithi072.stdout:0/748: mknod d1/d1c/d24/d27/d73/d80/dd2/cf6 0 2024-03-19T06:06:09.508 INFO:tasks.workunit.client.0.smithi072.stdout:3/747: write d2/d3/d26/fff [871971,9318] 0 2024-03-19T06:06:09.509 INFO:tasks.workunit.client.0.smithi072.stdout:6/654: dwrite d7/f3c [0,4194304] 0 2024-03-19T06:06:09.517 INFO:tasks.workunit.client.0.smithi072.stdout:7/636: mkdir d2/d3/d18/d33/d1d/d2b/d82/dc5 0 2024-03-19T06:06:09.519 INFO:tasks.workunit.client.0.smithi072.stdout:0/749: mkdir d1/d1c/d24/d27/d73/df7 0 2024-03-19T06:06:09.520 INFO:tasks.workunit.client.0.smithi072.stdout:2/794: creat db/d10/d13/df4/d103/d82/d98/f10d x:0 0 0 2024-03-19T06:06:09.524 INFO:tasks.workunit.client.0.smithi072.stdout:8/707: dwrite da/d62/d75/d8d/fbe [0,4194304] 0 2024-03-19T06:06:09.526 INFO:tasks.workunit.client.0.smithi072.stdout:3/748: rename d2/d40/d78/d9b/fed to d2/d3/d15/d66/f102 0 2024-03-19T06:06:09.527 INFO:tasks.workunit.client.0.smithi072.stdout:6/655: mknod d7/d9/d1b/d3b/d9b/da4/cdf 0 2024-03-19T06:06:09.533 INFO:tasks.workunit.client.0.smithi072.stdout:0/750: creat d1/d1c/d89/ff8 x:0 0 0 2024-03-19T06:06:09.534 INFO:tasks.workunit.client.0.smithi072.stdout:7/637: write d2/f66 [1672218,62954] 0 2024-03-19T06:06:09.534 INFO:tasks.workunit.client.0.smithi072.stdout:1/720: rename d1/daa/dd8/d19/d1a/d25/d3c/d68/de4 to d1/daa/dd8/d19/d1a/def 0 2024-03-19T06:06:09.543 INFO:tasks.workunit.client.0.smithi072.stdout:4/874: dwrite d5/d1b/f5d [0,4194304] 0 2024-03-19T06:06:09.544 INFO:tasks.workunit.client.0.smithi072.stdout:2/795: rename db/d10/d2b/d2d/d77/cb4 to db/d10/d13/df4/c10e 0 2024-03-19T06:06:09.547 INFO:tasks.workunit.client.0.smithi072.stdout:1/721: creat d1/daa/dd8/d19/d1a/d25/d3c/db8/ff0 x:0 0 0 2024-03-19T06:06:09.548 INFO:tasks.workunit.client.0.smithi072.stdout:7/638: symlink d2/d3/d18/d20/d3a/lc6 0 2024-03-19T06:06:09.549 INFO:tasks.workunit.client.0.smithi072.stdout:8/708: rename da/d27/d52/d5b/d3e/f8c to da/d62/feb 0 2024-03-19T06:06:09.550 INFO:tasks.workunit.client.0.smithi072.stdout:4/875: mkdir d5/d1b/d7e/d138 0 2024-03-19T06:06:09.553 INFO:tasks.workunit.client.0.smithi072.stdout:8/709: truncate da/d13/d14/d1b/d6b/daa/fbf 53467 0 2024-03-19T06:06:09.556 INFO:tasks.workunit.client.0.smithi072.stdout:7/639: creat d2/d8c/dba/dbc/fc7 x:0 0 0 2024-03-19T06:06:09.557 INFO:tasks.workunit.client.0.smithi072.stdout:0/751: rmdir d1/d1c/d24 39 2024-03-19T06:06:09.558 INFO:tasks.workunit.client.0.smithi072.stdout:1/722: truncate d1/daa/dd8/d19/d1a/d61/f7a 840180 0 2024-03-19T06:06:09.561 INFO:tasks.workunit.client.0.smithi072.stdout:4/876: mkdir d5/d15/d31/d6d/d7a/d8e/d139 0 2024-03-19T06:06:09.562 INFO:tasks.workunit.client.0.smithi072.stdout:8/710: symlink da/d27/d52/dbd/lec 0 2024-03-19T06:06:09.567 INFO:tasks.workunit.client.0.smithi072.stdout:6/656: write d7/d9/d1b/fa1 [246512,3314] 0 2024-03-19T06:06:09.567 INFO:tasks.workunit.client.0.smithi072.stdout:0/752: fsync d1/d1c/fad 0 2024-03-19T06:06:09.568 INFO:tasks.workunit.client.0.smithi072.stdout:3/749: write d2/d19/d1e/f6a [575097,39326] 0 2024-03-19T06:06:09.569 INFO:tasks.workunit.client.0.smithi072.stdout:6/657: readlink d7/d3f/l63 0 2024-03-19T06:06:09.570 INFO:tasks.workunit.client.0.smithi072.stdout:4/877: creat d5/d1b/d7e/f13a x:0 0 0 2024-03-19T06:06:09.572 INFO:tasks.workunit.client.0.smithi072.stdout:2/796: getdents db/d10/d13/d24/d72 0 2024-03-19T06:06:09.572 INFO:tasks.workunit.client.0.smithi072.stdout:7/640: unlink d2/d3/d18/d3f/c52 0 2024-03-19T06:06:09.581 INFO:tasks.workunit.client.0.smithi072.stdout:7/641: chown d2/d3/d18/d33/d1d/d2b/d3d/d21/d31/fc4 1 1 2024-03-19T06:06:09.581 INFO:tasks.workunit.client.0.smithi072.stdout:6/658: write d7/d9/d1b/d21/d68/daa/d88/fd7 [450427,46109] 0 2024-03-19T06:06:09.581 INFO:tasks.workunit.client.0.smithi072.stdout:3/750: getdents d2/d3/d25 0 2024-03-19T06:06:09.581 INFO:tasks.workunit.client.0.smithi072.stdout:1/723: write d1/daa/dd8/d19/d1a/d25/d3c/f5b [2324041,50815] 0 2024-03-19T06:06:09.583 INFO:tasks.workunit.client.0.smithi072.stdout:1/724: readlink d1/daa/dd8/l5d 0 2024-03-19T06:06:09.585 INFO:tasks.workunit.client.0.smithi072.stdout:2/797: link db/d10/d2b/d2d/d62/l9b db/d10/d13/d7c/l10f 0 2024-03-19T06:06:09.593 INFO:tasks.workunit.client.0.smithi072.stdout:3/751: chown d2/d3/d15/d66/d70/lec 1463124 1 2024-03-19T06:06:09.593 INFO:tasks.workunit.client.0.smithi072.stdout:2/798: chown db/d10/d13/c21 4 1 2024-03-19T06:06:09.593 INFO:tasks.workunit.client.0.smithi072.stdout:8/711: dwrite da/d13/d3f/dac/fb6 [0,4194304] 0 2024-03-19T06:06:09.601 INFO:tasks.workunit.client.0.smithi072.stdout:8/712: chown da/d27/dc2/dc6 1105 1 2024-03-19T06:06:09.602 INFO:tasks.workunit.client.0.smithi072.stdout:3/752: readlink d2/d40/d78/d9b/lfb 0 2024-03-19T06:06:09.602 INFO:tasks.workunit.client.0.smithi072.stdout:7/642: rename d2/d3/d18/d33 to d2/d3/d17/dc8 0 2024-03-19T06:06:09.602 INFO:tasks.workunit.client.0.smithi072.stdout:2/799: rmdir db/d10/d13/d24/d61 39 2024-03-19T06:06:09.603 INFO:tasks.workunit.client.0.smithi072.stdout:4/878: dwrite d5/d11/f36 [0,4194304] 0 2024-03-19T06:06:09.607 INFO:tasks.workunit.client.0.smithi072.stdout:1/725: link d1/daa/dd8/d19/d1a/d3b/f6a d1/daa/dd8/d19/d1a/ff1 0 2024-03-19T06:06:09.616 INFO:tasks.workunit.client.0.smithi072.stdout:1/726: mkdir d1/daa/dd8/d63/df2 0 2024-03-19T06:06:09.616 INFO:tasks.workunit.client.0.smithi072.stdout:6/659: dwrite d7/d3f/f58 [0,4194304] 0 2024-03-19T06:06:09.618 INFO:tasks.workunit.client.0.smithi072.stdout:1/727: fsync d1/d11/d76/da7/fdd 0 2024-03-19T06:06:09.620 INFO:tasks.workunit.client.0.smithi072.stdout:2/800: getdents db/d10/d13/df4/d103/ddb 0 2024-03-19T06:06:09.625 INFO:tasks.workunit.client.0.smithi072.stdout:1/728: mknod d1/d11/d6d/cf3 0 2024-03-19T06:06:09.625 INFO:tasks.workunit.client.0.smithi072.stdout:7/643: link d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/l90 d2/d3/d17/dc8/d1d/d2b/lc9 0 2024-03-19T06:06:09.630 INFO:tasks.workunit.client.0.smithi072.stdout:2/801: symlink db/d10/d13/df4/d103/ddb/l110 0 2024-03-19T06:06:09.633 INFO:tasks.workunit.client.0.smithi072.stdout:1/729: stat d1/ld 0 2024-03-19T06:06:09.636 INFO:tasks.workunit.client.0.smithi072.stdout:6/660: link d7/fc d7/d9/d1e/fe0 0 2024-03-19T06:06:09.638 INFO:tasks.workunit.client.0.smithi072.stdout:4/879: dwrite d5/d15/d22/d41/d7b/d7c/db4/f109 [0,4194304] 0 2024-03-19T06:06:09.638 INFO:tasks.workunit.client.0.smithi072.stdout:8/713: truncate da/d27/d52/d5b/d3e/d5a/d7a/f86 1898260 0 2024-03-19T06:06:09.643 INFO:tasks.workunit.client.0.smithi072.stdout:2/802: truncate db/d10/d13/df4/d103/d82/d98/dbf/fc4 491509 0 2024-03-19T06:06:09.645 INFO:tasks.workunit.client.0.smithi072.stdout:8/714: symlink da/d27/dc2/dc6/dd1/led 0 2024-03-19T06:06:09.648 INFO:tasks.workunit.client.0.smithi072.stdout:4/880: unlink d5/d15/d22/d41/d61/f11f 0 2024-03-19T06:06:09.650 INFO:tasks.workunit.client.0.smithi072.stdout:7/644: dread d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/fb6 [0,4194304] 0 2024-03-19T06:06:09.653 INFO:tasks.workunit.client.0.smithi072.stdout:8/715: creat da/d27/d52/d5b/d3e/d7f/fee x:0 0 0 2024-03-19T06:06:09.659 INFO:tasks.workunit.client.0.smithi072.stdout:2/803: rename db/d10/d2b/d2d/d62/l9b to db/d10/d13/df4/d103/ddb/l111 0 2024-03-19T06:06:09.665 INFO:tasks.workunit.client.0.smithi072.stdout:1/730: dwrite d1/daa/dd8/d63/d73/fd3 [4194304,4194304] 0 2024-03-19T06:06:09.668 INFO:tasks.workunit.client.0.smithi072.stdout:2/804: mkdir db/d10/d2b/d2d/d9e/dab/d112 0 2024-03-19T06:06:09.674 INFO:tasks.workunit.client.0.smithi072.stdout:1/731: read - d1/daa/dd8/d19/d1a/d61/fd1 zero size 2024-03-19T06:06:09.675 INFO:tasks.workunit.client.0.smithi072.stdout:6/661: dwrite d7/d9/d2b/f49 [0,4194304] 0 2024-03-19T06:06:09.679 INFO:tasks.workunit.client.0.smithi072.stdout:1/732: symlink d1/d11/d76/lf4 0 2024-03-19T06:06:09.683 INFO:tasks.workunit.client.0.smithi072.stdout:6/662: creat d7/d9/d1b/d21/d68/d80/fe1 x:0 0 0 2024-03-19T06:06:09.686 INFO:tasks.workunit.client.0.smithi072.stdout:8/716: truncate da/d13/d3f/dac/fb6 1292428 0 2024-03-19T06:06:09.686 INFO:tasks.workunit.client.0.smithi072.stdout:4/881: dwrite d5/d15/d22/d41/d61/fb6 [0,4194304] 0 2024-03-19T06:06:09.690 INFO:tasks.workunit.client.0.smithi072.stdout:1/733: write d1/daa/dd8/d19/de3/fe9 [259720,126671] 0 2024-03-19T06:06:09.695 INFO:tasks.workunit.client.0.smithi072.stdout:7/645: dwrite d2/d3/d17/dc8/d1d/d2b/f4a [0,4194304] 0 2024-03-19T06:06:09.698 INFO:tasks.workunit.client.0.smithi072.stdout:6/663: creat d7/d9/d1b/d33/ddc/fe2 x:0 0 0 2024-03-19T06:06:09.701 INFO:tasks.workunit.client.0.smithi072.stdout:6/664: fdatasync d7/f34 0 2024-03-19T06:06:09.709 INFO:tasks.workunit.client.0.smithi072.stdout:1/734: symlink d1/daa/dd8/d19/d1a/d25/d3c/d52/lf5 0 2024-03-19T06:06:09.710 INFO:tasks.workunit.client.0.smithi072.stdout:6/665: creat d7/d9/d30/fe3 x:0 0 0 2024-03-19T06:06:09.711 INFO:tasks.workunit.client.0.smithi072.stdout:2/805: dwrite db/d10/d2b/d2d/fa2 [4194304,4194304] 0 2024-03-19T06:06:09.713 INFO:tasks.workunit.client.0.smithi072.stdout:1/735: fdatasync d1/daa/dd8/d19/d1a/d61/d65/fd2 0 2024-03-19T06:06:09.716 INFO:tasks.workunit.client.0.smithi072.stdout:4/882: write d5/ff [348506,24932] 0 2024-03-19T06:06:09.721 INFO:tasks.workunit.client.0.smithi072.stdout:8/717: link da/d13/d1d/cc4 da/d27/d52/cef 0 2024-03-19T06:06:09.722 INFO:tasks.workunit.client.0.smithi072.stdout:1/736: creat d1/daa/dd8/d19/d1a/d25/d3c/d68/d96/ff6 x:0 0 0 2024-03-19T06:06:09.724 INFO:tasks.workunit.client.0.smithi072.stdout:4/883: unlink d5/d37/lde 0 2024-03-19T06:06:09.725 INFO:tasks.workunit.client.0.smithi072.stdout:2/806: creat db/d10/d13/d24/d61/d7d/de0/f113 x:0 0 0 2024-03-19T06:06:09.726 INFO:tasks.workunit.client.0.smithi072.stdout:7/646: dwrite d2/d3/d18/d7f/fb2 [0,4194304] 0 2024-03-19T06:06:09.728 INFO:tasks.workunit.client.0.smithi072.stdout:2/807: dread - db/d10/d13/fd2 zero size 2024-03-19T06:06:09.728 INFO:tasks.workunit.client.0.smithi072.stdout:8/718: read da/d27/f39 [123918,84811] 0 2024-03-19T06:06:09.730 INFO:tasks.workunit.client.0.smithi072.stdout:7/647: fsync d2/d3/d17/f69 0 2024-03-19T06:06:09.736 INFO:tasks.workunit.client.0.smithi072.stdout:6/666: write d7/d9/d1b/d31/f40 [887633,100333] 0 2024-03-19T06:06:09.744 INFO:tasks.workunit.client.0.smithi072.stdout:7/648: mkdir d2/d3/d17/dc8/d53/dca 0 2024-03-19T06:06:09.747 INFO:tasks.workunit.client.0.smithi072.stdout:8/719: rename da/f11 to da/d27/dc2/ff0 0 2024-03-19T06:06:09.747 INFO:tasks.workunit.client.0.smithi072.stdout:2/808: creat db/d10/d2b/d2d/d9e/dab/d112/f114 x:0 0 0 2024-03-19T06:06:09.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:09 smithi072 ceph-mon[28706]: pgmap v31: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 28 MiB/s rd, 109 MiB/s wr, 253 op/s 2024-03-19T06:06:09.829 INFO:tasks.workunit.client.0.smithi072.stdout:8/720: readlink da/d27/d52/d5b/d3e/lb8 0 2024-03-19T06:06:09.830 INFO:tasks.workunit.client.0.smithi072.stdout:7/649: link d2/d8c/dba/dbc/fc7 d2/d3/d17/dc8/d1d/d3b/d63/fcb 0 2024-03-19T06:06:09.831 INFO:tasks.workunit.client.0.smithi072.stdout:1/737: write d1/daa/dd8/d19/d1a/d25/f6c [3091200,74264] 0 2024-03-19T06:06:09.832 INFO:tasks.workunit.client.0.smithi072.stdout:6/667: dread d7/d9/d1b/d3b/d9b/da4/db5/fc4 [0,4194304] 0 2024-03-19T06:06:09.836 INFO:tasks.workunit.client.0.smithi072.stdout:2/809: read db/d10/d2b/d2d/d62/d6b/f71 [6095,25783] 0 2024-03-19T06:06:09.839 INFO:tasks.workunit.client.0.smithi072.stdout:1/738: mkdir d1/d11/d76/df7 0 2024-03-19T06:06:09.841 INFO:tasks.workunit.client.0.smithi072.stdout:6/668: creat d7/d9/d1b/d21/d68/d80/fe4 x:0 0 0 2024-03-19T06:06:09.844 INFO:tasks.workunit.client.0.smithi072.stdout:8/721: dread da/f2d [0,4194304] 0 2024-03-19T06:06:09.845 INFO:tasks.workunit.client.0.smithi072.stdout:7/650: dread d2/d3/d17/dc8/d1d/f81 [0,4194304] 0 2024-03-19T06:06:09.846 INFO:tasks.workunit.client.0.smithi072.stdout:6/669: fdatasync d7/d9/d1b/f7c 0 2024-03-19T06:06:09.847 INFO:tasks.workunit.client.0.smithi072.stdout:8/722: chown da/d27/d52/d5b/fb3 26229285 1 2024-03-19T06:06:09.851 INFO:tasks.workunit.client.0.smithi072.stdout:6/670: chown d7/d3f/d65/fa2 129613898 1 2024-03-19T06:06:09.857 INFO:tasks.workunit.client.0.smithi072.stdout:8/723: rmdir da/d13/d3f/db9 39 2024-03-19T06:06:09.862 INFO:tasks.workunit.client.0.smithi072.stdout:2/810: link db/d10/d2b/d2d/d9e/dab/f104 db/d10/d13/d24/d72/dcb/f115 0 2024-03-19T06:06:09.866 INFO:tasks.workunit.client.0.smithi072.stdout:8/724: mkdir da/d27/d52/d5b/d3e/d5a/df1 0 2024-03-19T06:06:09.868 INFO:tasks.workunit.client.0.smithi072.stdout:6/671: write d7/d9/d1b/d31/f82 [1663655,71971] 0 2024-03-19T06:06:09.873 INFO:tasks.workunit.client.0.smithi072.stdout:2/811: write db/d10/d13/df4/d103/dd9/ffb [191095,92291] 0 2024-03-19T06:06:09.873 INFO:tasks.workunit.client.0.smithi072.stdout:1/739: dwrite d1/daa/dd8/d19/d1a/d25/d3c/d52/f7c [0,4194304] 0 2024-03-19T06:06:09.878 INFO:tasks.workunit.client.0.smithi072.stdout:2/812: mknod db/c116 0 2024-03-19T06:06:09.883 INFO:tasks.workunit.client.0.smithi072.stdout:8/725: creat da/d27/d52/d5b/d3e/ff2 x:0 0 0 2024-03-19T06:06:09.890 INFO:tasks.workunit.client.0.smithi072.stdout:8/726: unlink da/d27/d52/d5b/d3e/l5f 0 2024-03-19T06:06:09.896 INFO:tasks.workunit.client.0.smithi072.stdout:1/740: dread d1/daa/dd8/d63/d73/fd3 [0,4194304] 0 2024-03-19T06:06:09.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:09 smithi172 ceph-mon[35716]: pgmap v31: 65 pgs: 65 active+clean; 2.6 GiB data, 7.9 GiB used, 529 GiB / 536 GiB avail; 28 MiB/s rd, 109 MiB/s wr, 253 op/s 2024-03-19T06:06:09.906 INFO:tasks.workunit.client.0.smithi072.stdout:1/741: mknod d1/d11/d76/df7/cf8 0 2024-03-19T06:06:09.916 INFO:tasks.workunit.client.0.smithi072.stdout:1/742: rename d1/d11/d76/da7/f77 to d1/daa/dd8/d19/d1a/d25/d3c/db8/ddc/ff9 0 2024-03-19T06:06:09.918 INFO:tasks.workunit.client.0.smithi072.stdout:1/743: write d1/f8e [4944243,60376] 0 2024-03-19T06:06:09.922 INFO:tasks.workunit.client.0.smithi072.stdout:1/744: symlink d1/daa/dd8/d19/d1a/lfa 0 2024-03-19T06:06:09.927 INFO:tasks.workunit.client.0.smithi072.stdout:8/727: dread da/d13/d14/f7b [0,4194304] 0 2024-03-19T06:06:09.928 INFO:tasks.workunit.client.0.smithi072.stdout:1/745: dread d1/daa/dd8/d19/d1a/d25/d60/f75 [0,4194304] 0 2024-03-19T06:06:09.929 INFO:tasks.workunit.client.0.smithi072.stdout:8/728: readlink da/d27/d52/dbd/lec 0 2024-03-19T06:06:09.930 INFO:tasks.workunit.client.0.smithi072.stdout:2/813: dread db/d10/d2b/d2d/d9e/dab/dca/fb5 [0,4194304] 0 2024-03-19T06:06:09.932 INFO:tasks.workunit.client.0.smithi072.stdout:1/746: fdatasync d1/daa/dd8/d19/d72/f9f 0 2024-03-19T06:06:09.934 INFO:tasks.workunit.client.0.smithi072.stdout:8/729: getdents da/d27 0 2024-03-19T06:06:09.937 INFO:tasks.workunit.client.0.smithi072.stdout:8/730: symlink da/d62/lf3 0 2024-03-19T06:06:09.937 INFO:tasks.workunit.client.0.smithi072.stdout:1/747: read d1/f4e [1724925,31100] 0 2024-03-19T06:06:09.940 INFO:tasks.workunit.client.0.smithi072.stdout:1/748: creat d1/d11/d6d/ffb x:0 0 0 2024-03-19T06:06:09.948 INFO:tasks.workunit.client.0.smithi072.stdout:2/814: dwrite db/d10/d13/d24/f5f [0,4194304] 0 2024-03-19T06:06:09.956 INFO:tasks.workunit.client.0.smithi072.stdout:8/731: dwrite da/d27/d52/d5b/d3e/d5a/f49 [0,4194304] 0 2024-03-19T06:06:09.956 INFO:tasks.workunit.client.0.smithi072.stdout:2/815: mkdir db/d10/d13/d117 0 2024-03-19T06:06:09.959 INFO:tasks.workunit.client.0.smithi072.stdout:1/749: dwrite d1/f8e [0,4194304] 0 2024-03-19T06:06:09.962 INFO:tasks.workunit.client.0.smithi072.stdout:8/732: write da/d13/d14/d1b/d6b/fca [1734634,86028] 0 2024-03-19T06:06:09.964 INFO:tasks.workunit.client.0.smithi072.stdout:1/750: mkdir d1/daa/dd8/d19/d1a/d25/d60/dfc 0 2024-03-19T06:06:09.965 INFO:tasks.workunit.client.0.smithi072.stdout:2/816: fdatasync db/d10/d13/d31/d35/ddc/de1/f100 0 2024-03-19T06:06:09.967 INFO:tasks.workunit.client.0.smithi072.stdout:2/817: stat db/f38 0 2024-03-19T06:06:09.981 INFO:tasks.workunit.client.0.smithi072.stdout:8/733: write da/d27/f39 [1717586,56417] 0 2024-03-19T06:06:09.990 INFO:tasks.workunit.client.0.smithi072.stdout:8/734: truncate da/d27/d52/d5b/d3e/ff2 212355 0 2024-03-19T06:06:09.996 INFO:tasks.workunit.client.0.smithi072.stdout:1/751: dwrite d1/daa/dd8/d19/d1a/ff1 [0,4194304] 0 2024-03-19T06:06:09.996 INFO:tasks.workunit.client.0.smithi072.stdout:2/818: dwrite db/d10/d2b/f4b [0,4194304] 0 2024-03-19T06:06:09.996 INFO:tasks.workunit.client.0.smithi072.stdout:8/735: creat da/d27/d52/ff4 x:0 0 0 2024-03-19T06:06:09.998 INFO:tasks.workunit.client.0.smithi072.stdout:1/752: chown d1/daa/dd8/d19/d1a/d25/d3c 4488 1 2024-03-19T06:06:10.000 INFO:tasks.workunit.client.0.smithi072.stdout:1/753: fsync d1/daa/dd8/d19/d1a/f9a 0 2024-03-19T06:06:10.003 INFO:tasks.workunit.client.0.smithi072.stdout:8/736: creat da/d37/dd3/ff5 x:0 0 0 2024-03-19T06:06:10.003 INFO:tasks.workunit.client.0.smithi072.stdout:1/754: mkdir d1/daa/dfd 0 2024-03-19T06:06:10.005 INFO:tasks.workunit.client.0.smithi072.stdout:2/819: symlink db/d10/l118 0 2024-03-19T06:06:10.006 INFO:tasks.workunit.client.0.smithi072.stdout:8/737: read - da/d37/d69/fd5 zero size 2024-03-19T06:06:10.007 INFO:tasks.workunit.client.0.smithi072.stdout:2/820: stat c8 0 2024-03-19T06:06:10.014 INFO:tasks.workunit.client.0.smithi072.stdout:2/821: readlink db/d10/d2b/l6d 0 2024-03-19T06:06:10.020 INFO:tasks.workunit.client.0.smithi072.stdout:1/755: dread d1/daa/dd8/d19/d1a/d61/fac [0,4194304] 0 2024-03-19T06:06:10.022 INFO:tasks.workunit.client.0.smithi072.stdout:1/756: stat d1/d11/d76/da7/lb5 0 2024-03-19T06:06:10.023 INFO:tasks.workunit.client.0.smithi072.stdout:2/822: getdents db/d10/d13/d31 0 2024-03-19T06:06:10.025 INFO:tasks.workunit.client.0.smithi072.stdout:2/823: stat db/d10/d59/c6c 0 2024-03-19T06:06:10.032 INFO:tasks.workunit.client.0.smithi072.stdout:1/757: creat d1/daa/dd8/d19/d1a/d25/d3c/d68/d96/dc0/dda/ffe x:0 0 0 2024-03-19T06:06:10.032 INFO:tasks.workunit.client.0.smithi072.stdout:8/738: dwrite da/d3b/f54 [0,4194304] 0 2024-03-19T06:06:10.035 INFO:tasks.workunit.client.0.smithi072.stdout:2/824: mkdir db/d10/d2b/d2d/d119 0 2024-03-19T06:06:10.037 INFO:tasks.workunit.client.0.smithi072.stdout:8/739: chown da/d27/d52/d5b/d3e/d5a/d7a/f86 5 1 2024-03-19T06:06:10.039 INFO:tasks.workunit.client.0.smithi072.stdout:2/825: dread - db/d10/d2b/d2d/d9e/dab/dca/ff6 zero size 2024-03-19T06:06:10.043 INFO:tasks.workunit.client.0.smithi072.stdout:8/740: unlink da/d13/d14/d1b/d6b/daa/fbf 0 2024-03-19T06:06:10.046 INFO:tasks.workunit.client.0.smithi072.stdout:8/741: dread - da/d37/d5c/fda zero size 2024-03-19T06:06:10.049 INFO:tasks.workunit.client.0.smithi072.stdout:2/826: creat db/d10/d2b/d2d/d62/f11a x:0 0 0 2024-03-19T06:06:10.050 INFO:tasks.workunit.client.0.smithi072.stdout:8/742: creat da/d37/de1/ff6 x:0 0 0 2024-03-19T06:06:10.057 INFO:tasks.workunit.client.0.smithi072.stdout:2/827: truncate db/d10/d2b/d2d/d62/f63 4153802 0 2024-03-19T06:06:10.058 INFO:tasks.workunit.client.0.smithi072.stdout:8/743: fdatasync da/d27/d52/d5b/d3e/d7d/d97/f46 0 2024-03-19T06:06:10.060 INFO:tasks.workunit.client.0.smithi072.stdout:2/828: creat db/d10/d13/d7c/f11b x:0 0 0 2024-03-19T06:06:10.062 INFO:tasks.workunit.client.0.smithi072.stdout:1/758: dread d1/daa/dd8/d19/d1a/d25/d3c/d68/d96/dc0/fed [0,4194304] 0 2024-03-19T06:06:10.063 INFO:tasks.workunit.client.0.smithi072.stdout:8/744: unlink da/f50 0 2024-03-19T06:06:10.065 INFO:tasks.workunit.client.0.smithi072.stdout:2/829: creat db/d10/d13/d7c/f11c x:0 0 0 2024-03-19T06:06:10.067 INFO:tasks.workunit.client.0.smithi072.stdout:8/745: creat da/d27/ff7 x:0 0 0 2024-03-19T06:06:10.069 INFO:tasks.workunit.client.0.smithi072.stdout:2/830: mkdir db/d11d 0 2024-03-19T06:06:10.070 INFO:tasks.workunit.client.0.smithi072.stdout:1/759: mknod d1/daa/dd8/d19/d1a/d25/d60/dfc/cff 0 2024-03-19T06:06:10.073 INFO:tasks.workunit.client.0.smithi072.stdout:2/831: creat db/d10/d13/d31/d35/ddc/f11e x:0 0 0 2024-03-19T06:06:10.075 INFO:tasks.workunit.client.0.smithi072.stdout:8/746: rename da/d37/ld0 to da/d27/d52/d88/lf8 0 2024-03-19T06:06:10.083 INFO:tasks.workunit.client.0.smithi072.stdout:8/747: mknod da/d13/d14/d6f/cf9 0 2024-03-19T06:06:10.083 INFO:tasks.workunit.client.0.smithi072.stdout:1/760: creat d1/daa/dfd/f100 x:0 0 0 2024-03-19T06:06:10.085 INFO:tasks.workunit.client.0.smithi072.stdout:8/748: dread - da/d37/d5c/fda zero size 2024-03-19T06:06:10.096 INFO:tasks.workunit.client.0.smithi072.stdout:2/832: dread db/d10/d2b/d2d/d66/f6f [0,4194304] 0 2024-03-19T06:06:10.098 INFO:tasks.workunit.client.0.smithi072.stdout:2/833: chown db/d10/d2b/d2d/d9e/f10b 1 1 2024-03-19T06:06:10.110 INFO:tasks.workunit.client.0.smithi072.stdout:2/834: creat db/d10/d13/d24/d72/d86/dde/f11f x:0 0 0 2024-03-19T06:06:10.111 INFO:tasks.workunit.client.0.smithi072.stdout:8/749: getdents da/d27/d30/dde 0 2024-03-19T06:06:10.112 INFO:tasks.workunit.client.0.smithi072.stdout:2/835: chown db/d10/d13/d31/d35/l5e 14143 1 2024-03-19T06:06:10.114 INFO:tasks.workunit.client.0.smithi072.stdout:8/750: creat da/d62/d75/ffa x:0 0 0 2024-03-19T06:06:10.119 INFO:tasks.workunit.client.0.smithi072.stdout:2/836: rename db/d10/d2b/d2d/d77 to db/d10/d13/df4/d103/ddb/d120 0 2024-03-19T06:06:10.123 INFO:tasks.workunit.client.0.smithi072.stdout:2/837: creat db/d10/d13/df4/d103/d82/d98/dbf/f121 x:0 0 0 2024-03-19T06:06:10.126 INFO:tasks.workunit.client.0.smithi072.stdout:2/838: mknod db/d10/d13/d24/d61/d7d/c122 0 2024-03-19T06:06:10.128 INFO:tasks.workunit.client.0.smithi072.stdout:8/751: dwrite da/d13/d14/f17 [4194304,4194304] 0 2024-03-19T06:06:10.134 INFO:tasks.workunit.client.0.smithi072.stdout:8/752: fdatasync da/f2d 0 2024-03-19T06:06:10.135 INFO:tasks.workunit.client.0.smithi072.stdout:8/753: chown da/d37/de1/ff6 211973 1 2024-03-19T06:06:10.190 INFO:tasks.workunit.client.0.smithi072.stdout:8/754: creat da/d27/dc2/dc6/dd1/ffb x:0 0 0 2024-03-19T06:06:10.196 INFO:tasks.workunit.client.0.smithi072.stdout:2/839: getdents db/d10/d13/d24/d72/d86/dde 0 2024-03-19T06:06:10.200 INFO:tasks.workunit.client.0.smithi072.stdout:1/761: dwrite d1/daa/dd8/d19/d1a/d25/d60/f75 [0,4194304] 0 2024-03-19T06:06:10.203 INFO:tasks.workunit.client.0.smithi072.stdout:2/840: truncate db/d10/d13/d31/d35/ddc/f10c 167481 0 2024-03-19T06:06:10.210 INFO:tasks.workunit.client.0.smithi072.stdout:1/762: symlink d1/daa/dd8/d63/l101 0 2024-03-19T06:06:10.215 INFO:tasks.workunit.client.0.smithi072.stdout:1/763: chown d1/daa/dd8/d19/d1a/d25/d3c/d79/dd9 7474906 1 2024-03-19T06:06:10.218 INFO:tasks.workunit.client.0.smithi072.stdout:2/841: fsync db/d10/d2b/d2d/fa7 0 2024-03-19T06:06:10.240 INFO:tasks.workunit.client.0.smithi072.stdout:2/842: truncate db/d10/d13/d24/d61/d7d/f95 1961176 0 2024-03-19T06:06:10.243 INFO:tasks.workunit.client.0.smithi072.stdout:1/764: dwrite d1/daa/dd8/d19/d1a/d25/d3c/d68/d96/ff6 [0,4194304] 0 2024-03-19T06:06:10.244 INFO:tasks.workunit.client.0.smithi072.stdout:2/843: fsync db/d10/d13/df4/d103/d82/f94 0 2024-03-19T06:06:10.251 INFO:tasks.workunit.client.0.smithi072.stdout:1/765: mkdir d1/d11/d76/da7/d9e/d102 0 2024-03-19T06:06:10.252 INFO:tasks.workunit.client.0.smithi072.stdout:2/844: creat db/d10/d13/df4/d103/d82/f123 x:0 0 0 2024-03-19T06:06:10.258 INFO:tasks.workunit.client.0.smithi072.stdout:2/845: mkdir db/d10/d13/df4/d103/d82/d124 0 2024-03-19T06:06:10.263 INFO:tasks.workunit.client.0.smithi072.stdout:2/846: creat db/d10/d13/d31/d35/ddc/f125 x:0 0 0 2024-03-19T06:06:10.271 INFO:tasks.workunit.client.0.smithi072.stdout:2/847: creat db/d10/d13/d24/d72/dcb/f126 x:0 0 0 2024-03-19T06:06:10.272 INFO:tasks.workunit.client.0.smithi072.stdout:1/766: write d1/daa/dd8/d19/d1a/d25/d3c/d52/f7f [937819,91417] 0 2024-03-19T06:06:10.278 INFO:tasks.workunit.client.0.smithi072.stdout:2/848: mknod db/d10/d2b/d2d/d9e/dab/dca/df5/c127 0 2024-03-19T06:06:10.279 INFO:tasks.workunit.client.0.smithi072.stdout:1/767: creat d1/daa/dd8/d19/d72/d86/f103 x:0 0 0 2024-03-19T06:06:10.282 INFO:tasks.workunit.client.0.smithi072.stdout:2/849: chown db/d10/d13/d24/d61/fb0 369357 1 2024-03-19T06:06:10.293 INFO:tasks.workunit.client.0.smithi072.stdout:1/768: link d1/daa/dd8/d19/d1a/d25/d3c/d52/c69 d1/daa/dd8/d19/de3/c104 0 2024-03-19T06:06:10.320 INFO:tasks.workunit.client.0.smithi072.stdout:2/850: dread db/d10/d13/df4/d103/d82/f99 [0,4194304] 0 2024-03-19T06:06:10.325 INFO:tasks.workunit.client.0.smithi072.stdout:2/851: symlink db/l128 0 2024-03-19T06:06:10.332 INFO:tasks.workunit.client.0.smithi072.stdout:1/769: dread d1/daa/dd8/d19/d1a/f98 [0,4194304] 0 2024-03-19T06:06:10.340 INFO:tasks.workunit.client.0.smithi072.stdout:1/770: dread d1/daa/dd8/d19/d1a/d25/d3c/d79/fca [0,4194304] 0 2024-03-19T06:06:10.346 INFO:tasks.workunit.client.0.smithi072.stdout:1/771: write d1/daa/dd8/d19/d1a/d3b/f6a [867976,130454] 0 2024-03-19T06:06:10.378 INFO:tasks.workunit.client.0.smithi072.stdout:1/772: dwrite d1/daa/dd8/d19/d1a/d61/d65/fd2 [0,4194304] 0 2024-03-19T06:06:10.385 INFO:tasks.workunit.client.0.smithi072.stdout:1/773: fsync d1/d11/d76/da7/d9e/fbc 0 2024-03-19T06:06:10.388 INFO:tasks.workunit.client.0.smithi072.stdout:1/774: fsync d1/daa/dd8/f85 0 2024-03-19T06:06:10.440 INFO:tasks.workunit.client.0.smithi072.stdout:1/775: dread d1/daa/dd8/d19/d72/d86/f38 [0,4194304] 0 2024-03-19T06:06:10.453 INFO:tasks.workunit.client.0.smithi072.stdout:1/776: getdents d1/d11 0 2024-03-19T06:06:10.459 INFO:tasks.workunit.client.0.smithi072.stdout:1/777: mkdir d1/daa/dd8/d19/d1a/d105 0 2024-03-19T06:06:10.464 INFO:tasks.workunit.client.0.smithi072.stdout:1/778: stat d1/daa/dd8/d19/d1a/d25/d3c/d68/c83 0 2024-03-19T06:06:10.506 INFO:tasks.workunit.client.0.smithi072.stdout:9/678: sync 2024-03-19T06:06:10.510 INFO:tasks.workunit.client.0.smithi072.stdout:1/779: dread d1/daa/dd8/d19/d1a/d25/d3c/db8/ddc/ff9 [0,4194304] 0 2024-03-19T06:06:10.512 INFO:tasks.workunit.client.0.smithi072.stdout:9/679: dread - d11/d24/d4c/dda/d6f/d87/da4/fd7 zero size 2024-03-19T06:06:10.515 INFO:tasks.workunit.client.0.smithi072.stdout:1/780: dread - d1/d11/d76/fab zero size 2024-03-19T06:06:10.518 INFO:tasks.workunit.client.0.smithi072.stdout:1/781: read d1/daa/dd8/d63/d73/fd3 [5208756,51527] 0 2024-03-19T06:06:10.531 INFO:tasks.workunit.client.0.smithi072.stdout:1/782: rename d1/daa/dd8/d19/d72/d86/f103 to d1/daa/f106 0 2024-03-19T06:06:10.538 INFO:tasks.workunit.client.0.smithi072.stdout:9/680: dwrite d11/d24/f48 [0,4194304] 0 2024-03-19T06:06:10.545 INFO:tasks.workunit.client.0.smithi072.stdout:1/783: mkdir d1/daa/dd8/d19/d1a/d61/d107 0 2024-03-19T06:06:10.547 INFO:tasks.workunit.client.0.smithi072.stdout:9/681: fdatasync d11/d24/d4c/dda/d36/d45/d4d/f82 0 2024-03-19T06:06:10.552 INFO:tasks.workunit.client.0.smithi072.stdout:9/682: chown d11/d78/ce1 265481 1 2024-03-19T06:06:10.557 INFO:tasks.workunit.client.0.smithi072.stdout:1/784: creat d1/daa/dd8/d19/d1a/d25/d3c/d79/f108 x:0 0 0 2024-03-19T06:06:10.564 INFO:tasks.workunit.client.0.smithi072.stdout:9/683: symlink d11/d24/d4c/dda/d36/d45/d4d/le8 0 2024-03-19T06:06:10.566 INFO:tasks.workunit.client.0.smithi072.stdout:1/785: chown d1/daa/dd8/d19/d1a/d61/f7a 916 1 2024-03-19T06:06:10.574 INFO:tasks.workunit.client.0.smithi072.stdout:9/684: fdatasync d11/d24/d4c/dda/d36/d45/d4d/f9b 0 2024-03-19T06:06:10.589 INFO:tasks.workunit.client.0.smithi072.stdout:1/786: dread d1/daa/dd8/d19/d1a/d25/d60/f75 [0,4194304] 0 2024-03-19T06:06:10.596 INFO:tasks.workunit.client.0.smithi072.stdout:5/861: sync 2024-03-19T06:06:10.598 INFO:tasks.workunit.client.0.smithi072.stdout:5/862: chown df/d13/d32/d28/c67 108961 1 2024-03-19T06:06:10.599 INFO:tasks.workunit.client.0.smithi072.stdout:1/787: creat d1/daa/dd8/d19/d1a/d25/d3c/d68/d96/f109 x:0 0 0 2024-03-19T06:06:10.606 INFO:tasks.workunit.client.0.smithi072.stdout:1/788: creat d1/daa/dd8/d19/d1a/d25/d3c/db8/ddc/f10a x:0 0 0 2024-03-19T06:06:10.609 INFO:tasks.workunit.client.0.smithi072.stdout:5/863: truncate df/d13/f49 112701 0 2024-03-19T06:06:10.614 INFO:tasks.workunit.client.0.smithi072.stdout:5/864: creat df/d3c/f102 x:0 0 0 2024-03-19T06:06:10.618 INFO:tasks.workunit.client.0.smithi072.stdout:9/685: dwrite d11/d24/d4c/d64/faa [0,4194304] 0 2024-03-19T06:06:10.618 INFO:tasks.workunit.client.0.smithi072.stdout:1/789: link d1/l7 d1/d11/d76/da7/d9e/d102/l10b 0 2024-03-19T06:06:10.627 INFO:tasks.workunit.client.0.smithi072.stdout:5/865: creat df/d13/d32/d28/d42/f103 x:0 0 0 2024-03-19T06:06:10.627 INFO:tasks.workunit.client.0.smithi072.stdout:9/686: mknod d11/d24/ce9 0 2024-03-19T06:06:10.631 INFO:tasks.workunit.client.0.smithi072.stdout:1/790: fdatasync d1/daa/dd8/d19/d1a/f98 0 2024-03-19T06:06:10.636 INFO:tasks.workunit.client.0.smithi072.stdout:9/687: fsync d11/d1f/d43/f63 0 2024-03-19T06:06:10.644 INFO:tasks.workunit.client.0.smithi072.stdout:5/866: rmdir df/d13/d32/d28/d42/d59/d43/d4e/d5c/de3 0 2024-03-19T06:06:10.647 INFO:tasks.workunit.client.0.smithi072.stdout:9/688: creat d11/d24/d4c/dda/d68/d92/d93/fea x:0 0 0 2024-03-19T06:06:10.648 INFO:tasks.workunit.client.0.smithi072.stdout:3/753: sync 2024-03-19T06:06:10.648 INFO:tasks.workunit.client.0.smithi072.stdout:7/651: sync 2024-03-19T06:06:10.648 INFO:tasks.workunit.client.0.smithi072.stdout:8/755: sync 2024-03-19T06:06:10.649 INFO:tasks.workunit.client.0.smithi072.stdout:4/884: sync 2024-03-19T06:06:10.649 INFO:tasks.workunit.client.0.smithi072.stdout:6/672: sync 2024-03-19T06:06:10.649 INFO:tasks.workunit.client.0.smithi072.stdout:0/753: sync 2024-03-19T06:06:10.649 INFO:tasks.workunit.client.0.smithi072.stdout:2/852: sync 2024-03-19T06:06:10.653 INFO:tasks.workunit.client.0.smithi072.stdout:8/756: read - da/d37/d69/fd5 zero size 2024-03-19T06:06:10.653 INFO:tasks.workunit.client.0.smithi072.stdout:6/673: readlink d7/d3f/l63 0 2024-03-19T06:06:10.655 INFO:tasks.workunit.client.0.smithi072.stdout:1/791: dread d1/daa/dd8/d19/d1a/d25/faf [0,4194304] 0 2024-03-19T06:06:10.657 INFO:tasks.workunit.client.0.smithi072.stdout:4/885: chown d5/d15/d31/d7d/f9f 273 1 2024-03-19T06:06:10.657 INFO:tasks.workunit.client.0.smithi072.stdout:2/853: readlink db/d10/d13/df4/d103/dd9/de9/lec 0 2024-03-19T06:06:10.658 INFO:tasks.workunit.client.0.smithi072.stdout:7/652: mknod d2/d3/d18/d88/ccc 0 2024-03-19T06:06:10.658 INFO:tasks.workunit.client.0.smithi072.stdout:5/867: getdents df/d13/d32/d28/d42/d59/d43 0 2024-03-19T06:06:10.663 INFO:tasks.workunit.client.0.smithi072.stdout:3/754: dread - d2/d40/d78/fd4 zero size 2024-03-19T06:06:10.667 INFO:tasks.workunit.client.0.smithi072.stdout:6/674: rmdir d7/d9/d30 39 2024-03-19T06:06:10.668 INFO:tasks.workunit.client.0.smithi072.stdout:8/757: fdatasync da/d13/d14/d1b/f78 0 2024-03-19T06:06:10.672 INFO:tasks.workunit.client.0.smithi072.stdout:9/689: dwrite d11/d24/ddd/f71 [0,4194304] 0 2024-03-19T06:06:10.673 INFO:tasks.workunit.client.0.smithi072.stdout:5/868: fsync df/fd8 0 2024-03-19T06:06:10.674 INFO:tasks.workunit.client.0.smithi072.stdout:2/854: fdatasync db/d10/d2b/d2d/fa7 0 2024-03-19T06:06:10.677 INFO:tasks.workunit.client.0.smithi072.stdout:8/758: truncate da/d27/d52/d5b/d3e/d5a/fcd 646024 0 2024-03-19T06:06:10.679 INFO:tasks.workunit.client.0.smithi072.stdout:5/869: chown df/d13/d24/f9e 21186 1 2024-03-19T06:06:10.681 INFO:tasks.workunit.client.0.smithi072.stdout:8/759: readlink da/d13/d14/d6f/l96 0 2024-03-19T06:06:10.682 INFO:tasks.workunit.client.0.smithi072.stdout:7/653: dwrite d2/d3/d17/dc8/d1d/d2b/d3d/d21/f99 [0,4194304] 0 2024-03-19T06:06:10.689 INFO:tasks.workunit.client.0.smithi072.stdout:7/654: write d2/d3/d17/dc8/d1d/d3b/d63/d84/f92 [4001526,34377] 0 2024-03-19T06:06:10.693 INFO:tasks.workunit.client.0.smithi072.stdout:1/792: dwrite d1/daa/dd8/d63/d73/fd3 [8388608,4194304] 0 2024-03-19T06:06:10.694 INFO:tasks.workunit.client.0.smithi072.stdout:6/675: creat d7/d9/d1b/d3b/d9b/da4/fe5 x:0 0 0 2024-03-19T06:06:10.698 INFO:tasks.workunit.client.0.smithi072.stdout:5/870: readlink df/d14/lbc 0 2024-03-19T06:06:10.698 INFO:tasks.workunit.client.0.smithi072.stdout:8/760: creat da/d62/d75/ffc x:0 0 0 2024-03-19T06:06:10.700 INFO:tasks.workunit.client.0.smithi072.stdout:1/793: fdatasync d1/daa/dd8/d19/d1a/d25/d3c/fbe 0 2024-03-19T06:06:10.702 INFO:tasks.workunit.client.0.smithi072.stdout:7/655: creat d2/d3/d17/d70/fcd x:0 0 0 2024-03-19T06:06:10.704 INFO:tasks.workunit.client.0.smithi072.stdout:1/794: write d1/daa/dd8/f85 [3270989,43975] 0 2024-03-19T06:06:10.705 INFO:tasks.workunit.client.0.smithi072.stdout:4/886: creat d5/d15/d22/d41/d7b/f13b x:0 0 0 2024-03-19T06:06:10.710 INFO:tasks.workunit.client.0.smithi072.stdout:0/754: link d1/f58 d1/d1c/ff9 0 2024-03-19T06:06:10.718 INFO:tasks.workunit.client.0.smithi072.stdout:8/761: dread - da/d27/fb2 zero size 2024-03-19T06:06:10.719 INFO:tasks.workunit.client.0.smithi072.stdout:4/887: fdatasync d5/d11/f1a 0 2024-03-19T06:06:10.720 INFO:tasks.workunit.client.0.smithi072.stdout:1/795: symlink d1/daa/dd8/d19/d1a/d61/l10c 0 2024-03-19T06:06:10.726 INFO:tasks.workunit.client.0.smithi072.stdout:9/690: dread d11/d1f/d43/fdb [0,4194304] 0 2024-03-19T06:06:10.729 INFO:tasks.workunit.client.0.smithi072.stdout:3/755: dwrite d2/d75/fb8 [0,4194304] 0 2024-03-19T06:06:10.731 INFO:tasks.workunit.client.0.smithi072.stdout:3/756: readlink d2/d40/le4 0 2024-03-19T06:06:10.732 INFO:tasks.workunit.client.0.smithi072.stdout:1/796: mknod d1/daa/dfd/c10d 0 2024-03-19T06:06:10.737 INFO:tasks.workunit.client.0.smithi072.stdout:5/871: write df/d13/d24/f9e [1287224,40068] 0 2024-03-19T06:06:10.738 INFO:tasks.workunit.client.0.smithi072.stdout:8/762: creat da/d27/dc2/dc6/dd1/ffd x:0 0 0 2024-03-19T06:06:10.739 INFO:tasks.workunit.client.0.smithi072.stdout:6/676: write d7/fc [797447,83175] 0 2024-03-19T06:06:10.739 INFO:tasks.workunit.client.0.smithi072.stdout:2/855: link db/d10/d13/df4/d103/lad db/d10/d13/df4/d103/d82/d98/dbf/l129 0 2024-03-19T06:06:10.744 INFO:tasks.workunit.client.0.smithi072.stdout:6/677: stat d7/d9/fb6 0 2024-03-19T06:06:10.745 INFO:tasks.workunit.client.0.smithi072.stdout:1/797: creat d1/daa/dd8/d63/df2/f10e x:0 0 0 2024-03-19T06:06:10.746 INFO:tasks.workunit.client.0.smithi072.stdout:4/888: getdents d5/d15/d22/d41/d7b 0 2024-03-19T06:06:10.752 INFO:tasks.workunit.client.0.smithi072.stdout:8/763: symlink da/d27/d52/d5b/d3e/d7f/lfe 0 2024-03-19T06:06:10.753 INFO:tasks.workunit.client.0.smithi072.stdout:5/872: write df/d13/d32/d28/d42/f103 [667245,50193] 0 2024-03-19T06:06:10.756 INFO:tasks.workunit.client.0.smithi072.stdout:2/856: read db/d10/d2b/d2d/d62/d6b/f9c [1700146,20366] 0 2024-03-19T06:06:10.757 INFO:tasks.workunit.client.0.smithi072.stdout:6/678: mknod d7/d99/d97/ce6 0 2024-03-19T06:06:10.758 INFO:tasks.workunit.client.0.smithi072.stdout:1/798: creat d1/daa/dfd/f10f x:0 0 0 2024-03-19T06:06:10.761 INFO:tasks.workunit.client.0.smithi072.stdout:0/755: dwrite d1/d1c/d82/de4/fc0 [0,4194304] 0 2024-03-19T06:06:10.761 INFO:tasks.workunit.client.0.smithi072.stdout:4/889: link d5/d15/d3f/l6a d5/d15/d31/d6f/l13c 0 2024-03-19T06:06:10.763 INFO:tasks.workunit.client.0.smithi072.stdout:5/873: chown df/d13/d32/d28/d42/d59/d43/d62/l7d 3 1 2024-03-19T06:06:10.765 INFO:tasks.workunit.client.0.smithi072.stdout:4/890: chown d5/d15/d31/d6d/l96 31132 1 2024-03-19T06:06:10.766 INFO:tasks.workunit.client.0.smithi072.stdout:8/764: creat da/d27/d52/d5b/d3e/d7f/fff x:0 0 0 2024-03-19T06:06:10.767 INFO:tasks.workunit.client.0.smithi072.stdout:2/857: rmdir db/d10/d13/d31/d35/ddc/de1 39 2024-03-19T06:06:10.767 INFO:tasks.workunit.client.0.smithi072.stdout:9/691: dwrite d11/f19 [4194304,4194304] 0 2024-03-19T06:06:10.770 INFO:tasks.workunit.client.0.smithi072.stdout:6/679: unlink d7/d9/d30/l55 0 2024-03-19T06:06:10.771 INFO:tasks.workunit.client.0.smithi072.stdout:5/874: mkdir df/d3c/d104 0 2024-03-19T06:06:10.777 INFO:tasks.workunit.client.0.smithi072.stdout:4/891: creat d5/d15/d31/d4c/f13d x:0 0 0 2024-03-19T06:06:10.781 INFO:tasks.workunit.client.0.smithi072.stdout:1/799: mknod d1/daa/dd8/d19/d1a/d3b/c110 0 2024-03-19T06:06:10.781 INFO:tasks.workunit.client.0.smithi072.stdout:6/680: rmdir d7/d9/d1b/d33/ddc 39 2024-03-19T06:06:10.785 INFO:tasks.workunit.client.0.smithi072.stdout:5/875: mknod df/d3c/def/c105 0 2024-03-19T06:06:10.787 INFO:tasks.workunit.client.0.smithi072.stdout:2/858: dwrite db/f30 [4194304,4194304] 0 2024-03-19T06:06:10.787 INFO:tasks.workunit.client.0.smithi072.stdout:0/756: mkdir d1/d1c/d24/d27/d73/d80/d8b/dfa 0 2024-03-19T06:06:10.789 INFO:tasks.workunit.client.0.smithi072.stdout:4/892: fdatasync d5/d37/fd8 0 2024-03-19T06:06:10.790 INFO:tasks.workunit.client.0.smithi072.stdout:1/800: chown d1/daa/dd8/d19/d1a/d25/d60/dfc 1 1 2024-03-19T06:06:10.796 INFO:tasks.workunit.client.0.smithi072.stdout:2/859: fdatasync db/d10/d2b/d2d/d62/d6b/fc8 0 2024-03-19T06:06:10.798 INFO:tasks.workunit.client.0.smithi072.stdout:0/757: unlink d1/d1c/d24/d27/d73/d80/lea 0 2024-03-19T06:06:10.800 INFO:tasks.workunit.client.0.smithi072.stdout:8/765: dwrite da/d13/d14/d6f/f84 [4194304,4194304] 0 2024-03-19T06:06:10.804 INFO:tasks.workunit.client.0.smithi072.stdout:2/860: write db/d10/d2b/d2d/d62/d6b/fcc [1489702,70858] 0 2024-03-19T06:06:10.806 INFO:tasks.workunit.client.0.smithi072.stdout:1/801: fdatasync d1/daa/dd8/d19/d1a/d25/d3c/d68/d96/dc0/fed 0 2024-03-19T06:06:10.808 INFO:tasks.workunit.client.0.smithi072.stdout:9/692: dread d11/d24/d4c/dda/d68/d79/fe6 [0,4194304] 0 2024-03-19T06:06:10.809 INFO:tasks.workunit.client.0.smithi072.stdout:8/766: chown da/d13/d14/d1b/fbb 12188 1 2024-03-19T06:06:10.810 INFO:tasks.workunit.client.0.smithi072.stdout:0/758: creat d1/d1c/d24/d27/d73/ffb x:0 0 0 2024-03-19T06:06:10.813 INFO:tasks.workunit.client.0.smithi072.stdout:4/893: write d5/d11/f1a [2300602,24706] 0 2024-03-19T06:06:10.816 INFO:tasks.workunit.client.0.smithi072.stdout:4/894: dread - d5/d15/d31/d7d/d91/f121 zero size 2024-03-19T06:06:10.818 INFO:tasks.workunit.client.0.smithi072.stdout:4/895: stat d5/d15/d31/d4c/ff8 0 2024-03-19T06:06:10.821 INFO:tasks.workunit.client.0.smithi072.stdout:5/876: truncate df/d13/d24/f9e 1020701 0 2024-03-19T06:06:10.823 INFO:tasks.workunit.client.0.smithi072.stdout:5/877: readlink df/d3c/l89 0 2024-03-19T06:06:10.823 INFO:tasks.workunit.client.0.smithi072.stdout:9/693: creat d11/d24/d4c/dda/d36/d45/dcb/feb x:0 0 0 2024-03-19T06:06:10.826 INFO:tasks.workunit.client.0.smithi072.stdout:4/896: dread - d5/d37/de3/f10b zero size 2024-03-19T06:06:10.826 INFO:tasks.workunit.client.0.smithi072.stdout:9/694: chown d11/d1f/f3d 0 1 2024-03-19T06:06:10.826 INFO:tasks.workunit.client.0.smithi072.stdout:1/802: dread d1/daa/dd8/d19/d1a/d3b/f6a [0,4194304] 0 2024-03-19T06:06:10.827 INFO:tasks.workunit.client.0.smithi072.stdout:6/681: dread d7/f1d [0,4194304] 0 2024-03-19T06:06:10.827 INFO:tasks.workunit.client.0.smithi072.stdout:2/861: rename db/d10/d44/cbd to db/d10/d13/d31/d35/ddc/de1/c12a 0 2024-03-19T06:06:10.831 INFO:tasks.workunit.client.0.smithi072.stdout:8/767: getdents da/d37 0 2024-03-19T06:06:10.832 INFO:tasks.workunit.client.0.smithi072.stdout:0/759: dread d1/d1c/d24/f32 [0,4194304] 0 2024-03-19T06:06:10.835 INFO:tasks.workunit.client.0.smithi072.stdout:0/760: write d1/d1c/d24/d27/d73/d80/fb3 [856390,113544] 0 2024-03-19T06:06:10.837 INFO:tasks.workunit.client.0.smithi072.stdout:5/878: rename df/d54/fd0 to df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97/f106 0 2024-03-19T06:06:10.839 INFO:tasks.workunit.client.0.smithi072.stdout:5/879: chown df/d54/dac/fd5 1 1 2024-03-19T06:06:10.841 INFO:tasks.workunit.client.0.smithi072.stdout:9/695: mkdir d11/d24/d4c/dda/d68/dec 0 2024-03-19T06:06:10.842 INFO:tasks.workunit.client.0.smithi072.stdout:3/757: sync 2024-03-19T06:06:10.842 INFO:tasks.workunit.client.0.smithi072.stdout:7/656: sync 2024-03-19T06:06:10.843 INFO:tasks.workunit.client.0.smithi072.stdout:6/682: symlink d7/d9/d1b/d3b/d9b/da4/db5/le7 0 2024-03-19T06:06:10.843 INFO:tasks.workunit.client.0.smithi072.stdout:5/880: write df/d13/f6b [1743865,34518] 0 2024-03-19T06:06:10.845 INFO:tasks.workunit.client.0.smithi072.stdout:4/897: creat d5/d15/d22/d41/d7b/d12a/f13e x:0 0 0 2024-03-19T06:06:10.847 INFO:tasks.workunit.client.0.smithi072.stdout:4/898: readlink d5/d15/d3f/dc1/l1e 0 2024-03-19T06:06:10.848 INFO:tasks.workunit.client.0.smithi072.stdout:6/683: rmdir d7/d9/d1b/d33/d41/d92 39 2024-03-19T06:06:10.848 INFO:tasks.workunit.client.0.smithi072.stdout:8/768: dread - da/d13/d3f/db9/fd6 zero size 2024-03-19T06:06:10.851 INFO:tasks.workunit.client.0.smithi072.stdout:4/899: readlink d5/d15/d73/l12b 0 2024-03-19T06:06:10.851 INFO:tasks.workunit.client.0.smithi072.stdout:2/862: link db/d10/d13/df4/d103/lad db/d10/d12/l12b 0 2024-03-19T06:06:10.852 INFO:tasks.workunit.client.0.smithi072.stdout:7/657: chown d2/d8c/dba/dbc/l80 149 1 2024-03-19T06:06:10.853 INFO:tasks.workunit.client.0.smithi072.stdout:3/758: symlink d2/d19/db0/dcb/df8/l103 0 2024-03-19T06:06:10.862 INFO:tasks.workunit.client.0.smithi072.stdout:7/658: mknod d2/d3/d17/dc8/d83/cce 0 2024-03-19T06:06:10.862 INFO:tasks.workunit.client.0.smithi072.stdout:4/900: chown d5/d8a/f125 1429784 1 2024-03-19T06:06:10.862 INFO:tasks.workunit.client.0.smithi072.stdout:1/803: dread d1/daa/dd8/f85 [0,4194304] 0 2024-03-19T06:06:10.862 INFO:tasks.workunit.client.0.smithi072.stdout:3/759: read d2/d3/d26/f59 [1662478,22055] 0 2024-03-19T06:06:10.862 INFO:tasks.workunit.client.0.smithi072.stdout:4/901: chown d5/d15/l21 10 1 2024-03-19T06:06:10.863 INFO:tasks.workunit.client.0.smithi072.stdout:5/881: link df/d54/dac/fd9 df/d13/d32/d28/d42/d59/d43/d4e/f107 0 2024-03-19T06:06:10.864 INFO:tasks.workunit.client.0.smithi072.stdout:3/760: read d2/f30 [2310747,82555] 0 2024-03-19T06:06:10.864 INFO:tasks.workunit.client.0.smithi072.stdout:4/902: creat d5/d15/f13f x:0 0 0 2024-03-19T06:06:10.868 INFO:tasks.workunit.client.0.smithi072.stdout:4/903: stat d5/d15/cd3 0 2024-03-19T06:06:10.870 INFO:tasks.workunit.client.0.smithi072.stdout:7/659: symlink d2/d3/d17/dc8/d1d/d2b/d3d/d21/dad/lcf 0 2024-03-19T06:06:10.873 INFO:tasks.workunit.client.0.smithi072.stdout:5/882: symlink df/d13/d32/d28/d42/d59/l108 0 2024-03-19T06:06:10.874 INFO:tasks.workunit.client.0.smithi072.stdout:4/904: unlink d5/d8a/c110 0 2024-03-19T06:06:10.876 INFO:tasks.workunit.client.0.smithi072.stdout:0/761: dread d1/d1c/fad [0,4194304] 0 2024-03-19T06:06:10.884 INFO:tasks.workunit.client.0.smithi072.stdout:3/761: link d2/d19/c2e d2/d19/c104 0 2024-03-19T06:06:10.887 INFO:tasks.workunit.client.0.smithi072.stdout:6/684: dwrite d7/fc [0,4194304] 0 2024-03-19T06:06:10.895 INFO:tasks.workunit.client.0.smithi072.stdout:0/762: mkdir d1/d1c/d24/dfc 0 2024-03-19T06:06:10.896 INFO:tasks.workunit.client.0.smithi072.stdout:4/905: write d5/d15/d3f/f6b [5236244,129127] 0 2024-03-19T06:06:10.896 INFO:tasks.workunit.client.0.smithi072.stdout:8/769: dwrite da/d27/d52/ff4 [0,4194304] 0 2024-03-19T06:06:10.906 INFO:tasks.workunit.client.0.smithi072.stdout:1/804: dwrite d1/daa/dd8/d63/d73/fd3 [8388608,4194304] 0 2024-03-19T06:06:10.911 INFO:tasks.workunit.client.0.smithi072.stdout:0/763: rmdir d1/d1c/d24/d27/d73 39 2024-03-19T06:06:10.913 INFO:tasks.workunit.client.0.smithi072.stdout:8/770: rename da/d37/d5c to da/d27/d52/d100 0 2024-03-19T06:06:10.919 INFO:tasks.workunit.client.0.smithi072.stdout:7/660: link d2/d3/d18/d20/d3a/f58 d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/fd0 0 2024-03-19T06:06:10.921 INFO:tasks.workunit.client.0.smithi072.stdout:5/883: dwrite df/d54/dac/fd5 [0,4194304] 0 2024-03-19T06:06:10.922 INFO:tasks.workunit.client.0.smithi072.stdout:1/805: mknod d1/d11/d76/da7/d9e/d102/c111 0 2024-03-19T06:06:10.933 INFO:tasks.workunit.client.0.smithi072.stdout:1/806: mkdir d1/daa/dd8/d19/d1a/def/d112 0 2024-03-19T06:06:10.935 INFO:tasks.workunit.client.0.smithi072.stdout:6/685: dwrite d7/d3f/d65/f77 [0,4194304] 0 2024-03-19T06:06:10.942 INFO:tasks.workunit.client.0.smithi072.stdout:6/686: unlink d7/c27 0 2024-03-19T06:06:10.944 INFO:tasks.workunit.client.0.smithi072.stdout:6/687: chown d7/d9/d1e/f7b 2 1 2024-03-19T06:06:10.946 INFO:tasks.workunit.client.0.smithi072.stdout:1/807: link d1/daa/dd8/d19/d1a/d25/d3c/d68/d96/dc0/dda/ffe d1/daa/dd8/d19/d1a/d25/d3c/db8/f113 0 2024-03-19T06:06:10.951 INFO:tasks.workunit.client.0.smithi072.stdout:6/688: read d7/d3f/d44/f3d [1497734,116661] 0 2024-03-19T06:06:10.959 INFO:tasks.workunit.client.0.smithi072.stdout:4/906: truncate d5/d1b/f33 707106 0 2024-03-19T06:06:10.960 INFO:tasks.workunit.client.0.smithi072.stdout:4/907: stat d5/d15/cd3 0 2024-03-19T06:06:10.962 INFO:tasks.workunit.client.0.smithi072.stdout:0/764: write d1/f19 [6523234,126561] 0 2024-03-19T06:06:10.969 INFO:tasks.workunit.client.0.smithi072.stdout:8/771: rename da/d62/d75/lb4 to da/d37/dd3/l101 0 2024-03-19T06:06:10.971 INFO:tasks.workunit.client.0.smithi072.stdout:0/765: mknod d1/d1c/d82/d90/dbe/cfd 0 2024-03-19T06:06:10.973 INFO:tasks.workunit.client.0.smithi072.stdout:0/766: write d1/fdb [712879,9449] 0 2024-03-19T06:06:10.974 INFO:tasks.workunit.client.0.smithi072.stdout:8/772: truncate da/d27/fb2 399717 0 2024-03-19T06:06:10.975 INFO:tasks.workunit.client.0.smithi072.stdout:8/773: chown da/d27/d52/d5b/c48 9546446 1 2024-03-19T06:06:10.975 INFO:tasks.workunit.client.0.smithi072.stdout:4/908: link d5/d1b/fa7 d5/d15/d31/d7d/d91/f140 0 2024-03-19T06:06:10.976 INFO:tasks.workunit.client.0.smithi072.stdout:0/767: dread - d1/d1c/d24/d27/d7c/faf zero size 2024-03-19T06:06:10.977 INFO:tasks.workunit.client.0.smithi072.stdout:6/689: getdents d7/d9/d1b/d33/d41/d45 0 2024-03-19T06:06:11.053 INFO:tasks.workunit.client.0.smithi072.stdout:4/909: fdatasync d5/d15/d22/d41/d7b/d7c/f101 0 2024-03-19T06:06:11.054 INFO:tasks.workunit.client.0.smithi072.stdout:8/774: creat da/f102 x:0 0 0 2024-03-19T06:06:11.054 INFO:tasks.workunit.client.0.smithi072.stdout:4/910: truncate d5/d15/d22/d41/d61/f70 86501 0 2024-03-19T06:06:11.054 INFO:tasks.workunit.client.0.smithi072.stdout:8/775: link da/d13/d14/d1b/d57/c70 da/d62/d75/d8d/c103 0 2024-03-19T06:06:11.054 INFO:tasks.workunit.client.0.smithi072.stdout:6/690: dread d7/d9/d2b/fa7 [0,4194304] 0 2024-03-19T06:06:11.054 INFO:tasks.workunit.client.0.smithi072.stdout:4/911: rename d5/d37/d52/ldb to d5/d15/d22/d41/l141 0 2024-03-19T06:06:11.054 INFO:tasks.workunit.client.0.smithi072.stdout:0/768: dwrite d1/d1c/d24/d27/d7c/daa/fae [4194304,4194304] 0 2024-03-19T06:06:11.054 INFO:tasks.workunit.client.0.smithi072.stdout:6/691: rename d7/d9/d1b/d21/d68/d80/fe4 to d7/d99/d60/fe8 0 2024-03-19T06:06:11.054 INFO:tasks.workunit.client.0.smithi072.stdout:4/912: rename d5/d15/d22/d95/d104 to d5/d15/d22/d95/d104/d142 22 2024-03-19T06:06:11.054 INFO:tasks.workunit.client.0.smithi072.stdout:0/769: dwrite d1/d1c/d24/d27/d7c/d6a/f91 [0,4194304] 0 2024-03-19T06:06:11.054 INFO:tasks.workunit.client.0.smithi072.stdout:0/770: creat d1/de7/ffe x:0 0 0 2024-03-19T06:06:11.054 INFO:tasks.workunit.client.0.smithi072.stdout:0/771: chown d1/d2c/l3b 2227829 1 2024-03-19T06:06:11.054 INFO:tasks.workunit.client.0.smithi072.stdout:0/772: creat d1/d1c/d82/d90/fff x:0 0 0 2024-03-19T06:06:11.055 INFO:tasks.workunit.client.0.smithi072.stdout:0/773: unlink d1/d1c/d24/d27/d73/d80/d8b/c42 0 2024-03-19T06:06:11.055 INFO:tasks.workunit.client.0.smithi072.stdout:0/774: chown d1/d1c/d24/d27/d73/dbb 57 1 2024-03-19T06:06:11.055 INFO:tasks.workunit.client.0.smithi072.stdout:0/775: rename d1/d1c/d82/d90/fcc to d1/d1c/d24/d27/d7c/daa/f100 0 2024-03-19T06:06:11.055 INFO:tasks.workunit.client.0.smithi072.stdout:0/776: stat d1/c26 0 2024-03-19T06:06:11.055 INFO:tasks.workunit.client.0.smithi072.stdout:0/777: dread d1/d1c/d24/d3f/f5c [0,4194304] 0 2024-03-19T06:06:11.075 INFO:tasks.workunit.client.0.smithi072.stdout:4/913: fsync d5/d1b/fa7 0 2024-03-19T06:06:11.075 INFO:tasks.workunit.client.0.smithi072.stdout:5/884: dwrite df/d13/d32/d28/d42/d59/d43/d4e/d5c/fde [0,4194304] 0 2024-03-19T06:06:11.078 INFO:tasks.workunit.client.0.smithi072.stdout:5/885: readlink df/d13/d32/d28/d42/l6e 0 2024-03-19T06:06:11.080 INFO:tasks.workunit.client.0.smithi072.stdout:1/808: dwrite d1/daa/dd8/d19/d1a/d61/f7a [0,4194304] 0 2024-03-19T06:06:11.089 INFO:tasks.workunit.client.0.smithi072.stdout:6/692: write d7/d9/d30/f38 [1026765,42283] 0 2024-03-19T06:06:11.101 INFO:tasks.workunit.client.0.smithi072.stdout:8/776: dwrite da/d13/d14/d1b/fbb [0,4194304] 0 2024-03-19T06:06:11.104 INFO:tasks.workunit.client.0.smithi072.stdout:0/778: dwrite d1/d1c/d82/fe9 [0,4194304] 0 2024-03-19T06:06:11.139 INFO:tasks.workunit.client.0.smithi072.stdout:0/779: creat d1/d2c/da1/d85/f101 x:0 0 0 2024-03-19T06:06:11.141 INFO:tasks.workunit.client.0.smithi072.stdout:5/886: rename df/d13/d32/d28/d42/d59/d43/d4e/f107 to df/d54/dac/f109 0 2024-03-19T06:06:11.145 INFO:tasks.workunit.client.0.smithi072.stdout:6/693: rename d7/d9/d1b/d3b/f62 to d7/d99/d60/d78/d7f/dcb/d84/dc0/fe9 0 2024-03-19T06:06:11.146 INFO:tasks.workunit.client.0.smithi072.stdout:5/887: symlink df/l10a 0 2024-03-19T06:06:11.148 INFO:tasks.workunit.client.0.smithi072.stdout:8/777: rename da/d27/d52/d5b/l76 to da/d27/dc2/dc6/dd1/l104 0 2024-03-19T06:06:11.152 INFO:tasks.workunit.client.0.smithi072.stdout:5/888: mknod df/d13/d32/d28/d42/d59/c10b 0 2024-03-19T06:06:11.153 INFO:tasks.workunit.client.0.smithi072.stdout:8/778: mkdir da/d3b/da7/d105 0 2024-03-19T06:06:11.155 INFO:tasks.workunit.client.0.smithi072.stdout:5/889: write df/d16/dc4/ffb [632068,31645] 0 2024-03-19T06:06:11.156 INFO:tasks.workunit.client.0.smithi072.stdout:0/780: dwrite d1/d1c/d24/d27/d73/d80/d8b/f99 [0,4194304] 0 2024-03-19T06:06:11.160 INFO:tasks.workunit.client.0.smithi072.stdout:5/890: mkdir df/d16/dc4/d10c 0 2024-03-19T06:06:11.161 INFO:tasks.workunit.client.0.smithi072.stdout:8/779: symlink da/d3b/da7/d105/l106 0 2024-03-19T06:06:11.165 INFO:tasks.workunit.client.0.smithi072.stdout:5/891: symlink df/d13/d32/d28/dda/l10d 0 2024-03-19T06:06:11.167 INFO:tasks.workunit.client.0.smithi072.stdout:5/892: readlink df/d13/d32/d28/d42/l6e 0 2024-03-19T06:06:11.172 INFO:tasks.workunit.client.0.smithi072.stdout:5/893: unlink df/d13/d24/f65 0 2024-03-19T06:06:11.173 INFO:tasks.workunit.client.0.smithi072.stdout:0/781: link d1/d1c/d24/d27/d7c/daa/lb5 d1/d2c/da1/d85/l102 0 2024-03-19T06:06:11.175 INFO:tasks.workunit.client.0.smithi072.stdout:0/782: chown d1/d1c/d24/d3f 272 1 2024-03-19T06:06:11.175 INFO:tasks.workunit.client.0.smithi072.stdout:8/780: creat da/d13/d3f/f107 x:0 0 0 2024-03-19T06:06:11.177 INFO:tasks.workunit.client.0.smithi072.stdout:4/914: write d5/d15/d22/d41/d7b/d7c/f136 [691006,81541] 0 2024-03-19T06:06:11.180 INFO:tasks.workunit.client.0.smithi072.stdout:8/781: symlink da/d13/d3f/db9/dc1/l108 0 2024-03-19T06:06:11.181 INFO:tasks.workunit.client.0.smithi072.stdout:0/783: rmdir d1/d1c/d24/d27/d73/d80/d8b 39 2024-03-19T06:06:11.182 INFO:tasks.workunit.client.0.smithi072.stdout:8/782: read da/d13/d14/f17 [1696497,23277] 0 2024-03-19T06:06:11.195 INFO:tasks.workunit.client.0.smithi072.stdout:6/694: dwrite d7/d9/d1b/d21/d68/daa/d88/f9d [0,4194304] 0 2024-03-19T06:06:11.199 INFO:tasks.workunit.client.0.smithi072.stdout:0/784: link d1/d1c/d24/d3f/de8/ff4 d1/d1c/d82/d90/f103 0 2024-03-19T06:06:11.201 INFO:tasks.workunit.client.0.smithi072.stdout:4/915: creat d5/d15/d31/d6f/f143 x:0 0 0 2024-03-19T06:06:11.202 INFO:tasks.workunit.client.0.smithi072.stdout:0/785: write d1/d1c/d24/d27/d7c/fdf [979188,72546] 0 2024-03-19T06:06:11.203 INFO:tasks.workunit.client.0.smithi072.stdout:6/695: creat d7/d9/d1b/d3b/d9b/da4/fea x:0 0 0 2024-03-19T06:06:11.216 INFO:tasks.workunit.client.0.smithi072.stdout:6/696: symlink d7/d99/d60/leb 0 2024-03-19T06:06:11.221 INFO:tasks.workunit.client.0.smithi072.stdout:6/697: chown d7/d9/d1b/d33/d41/d92 785404520 1 2024-03-19T06:06:11.223 INFO:tasks.workunit.client.0.smithi072.stdout:6/698: creat d7/d9/d1e/fec x:0 0 0 2024-03-19T06:06:11.225 INFO:tasks.workunit.client.0.smithi072.stdout:4/916: write d5/d15/d22/d41/d7b/f94 [573019,37390] 0 2024-03-19T06:06:11.225 INFO:tasks.workunit.client.0.smithi072.stdout:6/699: read d7/f70 [625035,37010] 0 2024-03-19T06:06:11.234 INFO:tasks.workunit.client.0.smithi072.stdout:4/917: rename d5/d8a to d5/d15/d22/d41/d144 0 2024-03-19T06:06:11.241 INFO:tasks.workunit.client.0.smithi072.stdout:6/700: write d7/d3f/d44/fd0 [361893,111245] 0 2024-03-19T06:06:11.241 INFO:tasks.workunit.client.0.smithi072.stdout:0/786: dwrite d1/d1c/d24/d27/d73/d80/d8b/fab [0,4194304] 0 2024-03-19T06:06:11.244 INFO:tasks.workunit.client.0.smithi072.stdout:0/787: dread - d1/d1c/fd7 zero size 2024-03-19T06:06:11.246 INFO:tasks.workunit.client.0.smithi072.stdout:0/788: chown d1/d1c/d24/f86 754762 1 2024-03-19T06:06:11.249 INFO:tasks.workunit.client.0.smithi072.stdout:6/701: write d7/d9/d1b/f37 [1419608,91889] 0 2024-03-19T06:06:11.250 INFO:tasks.workunit.client.0.smithi072.stdout:0/789: mknod d1/d1c/d24/d27/d73/dbb/c104 0 2024-03-19T06:06:11.254 INFO:tasks.workunit.client.0.smithi072.stdout:0/790: rmdir d1/d2c 39 2024-03-19T06:06:11.256 INFO:tasks.workunit.client.0.smithi072.stdout:6/702: mkdir d7/d99/d60/ded 0 2024-03-19T06:06:11.258 INFO:tasks.workunit.client.0.smithi072.stdout:4/918: dwrite d5/d15/d22/d41/d61/ff7 [0,4194304] 0 2024-03-19T06:06:11.259 INFO:tasks.workunit.client.0.smithi072.stdout:0/791: chown d1/d1c/d24/d27/d73/d80/d8b/fab 950034611 1 2024-03-19T06:06:11.261 INFO:tasks.workunit.client.0.smithi072.stdout:6/703: creat d7/d3f/fee x:0 0 0 2024-03-19T06:06:11.262 INFO:tasks.workunit.client.0.smithi072.stdout:0/792: rename d1/d1c/d24/d27 to d1/d1c/d24/d27/d73/d80/da8/dc4/d105 22 2024-03-19T06:06:11.265 INFO:tasks.workunit.client.0.smithi072.stdout:6/704: symlink d7/d9/d1b/d33/d41/d92/lef 0 2024-03-19T06:06:11.266 INFO:tasks.workunit.client.0.smithi072.stdout:4/919: creat d5/f145 x:0 0 0 2024-03-19T06:06:11.269 INFO:tasks.workunit.client.0.smithi072.stdout:4/920: readlink d5/d32/l4b 0 2024-03-19T06:06:11.271 INFO:tasks.workunit.client.0.smithi072.stdout:0/793: rename d1/d2c/f8a to d1/d1c/d24/d27/d73/d80/da8/dc4/deb/f106 0 2024-03-19T06:06:11.273 INFO:tasks.workunit.client.0.smithi072.stdout:4/921: write d5/d15/d31/d4c/f13d [965024,50696] 0 2024-03-19T06:06:11.278 INFO:tasks.workunit.client.0.smithi072.stdout:0/794: rename d1/lc to d1/d1c/d24/dfc/l107 0 2024-03-19T06:06:11.280 INFO:tasks.workunit.client.0.smithi072.stdout:0/795: dread - d1/d1c/d82/fd8 zero size 2024-03-19T06:06:11.282 INFO:tasks.workunit.client.0.smithi072.stdout:0/796: chown d1/d2c/da1/d85/f101 39112408 1 2024-03-19T06:06:11.285 INFO:tasks.workunit.client.0.smithi072.stdout:0/797: rename d1/d1c/d89/d9d/le6 to d1/de7/l108 0 2024-03-19T06:06:11.289 INFO:tasks.workunit.client.0.smithi072.stdout:0/798: dread - d1/d1c/d24/d8f/fc1 zero size 2024-03-19T06:06:11.296 INFO:tasks.workunit.client.0.smithi072.stdout:0/799: rename d1/d1c/d24/d3f/fd0 to d1/d1c/d24/d27/d73/d80/d8b/dfa/f109 0 2024-03-19T06:06:11.298 INFO:tasks.workunit.client.0.smithi072.stdout:6/705: dwrite d7/d9/d2b/f53 [0,4194304] 0 2024-03-19T06:06:11.303 INFO:tasks.workunit.client.0.smithi072.stdout:0/800: dread d1/d1c/d24/f32 [0,4194304] 0 2024-03-19T06:06:11.307 INFO:tasks.workunit.client.0.smithi072.stdout:4/922: dwrite d5/d15/d31/d7d/f7f [4194304,4194304] 0 2024-03-19T06:06:11.307 INFO:tasks.workunit.client.0.smithi072.stdout:6/706: link d7/c46 d7/d9/d1b/d21/d68/cf0 0 2024-03-19T06:06:11.313 INFO:tasks.workunit.client.0.smithi072.stdout:6/707: creat d7/d9/d1b/d21/d68/daa/ff1 x:0 0 0 2024-03-19T06:06:11.316 INFO:tasks.workunit.client.0.smithi072.stdout:4/923: rename d5/d15/d31/d4c/ff8 to d5/d1b/d7e/d138/f146 0 2024-03-19T06:06:11.317 INFO:tasks.workunit.client.0.smithi072.stdout:4/924: chown d5/d32/d58/f85 26377 1 2024-03-19T06:06:11.320 INFO:tasks.workunit.client.0.smithi072.stdout:4/925: read d5/d37/fd8 [346542,125608] 0 2024-03-19T06:06:11.321 INFO:tasks.workunit.client.0.smithi072.stdout:4/926: stat d5/d11/f98 0 2024-03-19T06:06:11.326 INFO:tasks.workunit.client.0.smithi072.stdout:0/801: truncate d1/d2c/f41 3070982 0 2024-03-19T06:06:11.329 INFO:tasks.workunit.client.0.smithi072.stdout:6/708: write d7/d9/d1b/d21/f24 [3993071,35593] 0 2024-03-19T06:06:11.330 INFO:tasks.workunit.client.0.smithi072.stdout:6/709: dread - d7/d9/d30/f51 zero size 2024-03-19T06:06:11.331 INFO:tasks.workunit.client.0.smithi072.stdout:0/802: truncate d1/d1c/f43 1022038 0 2024-03-19T06:06:11.332 INFO:tasks.workunit.client.0.smithi072.stdout:6/710: write d7/d99/f35 [1850236,65062] 0 2024-03-19T06:06:11.335 INFO:tasks.workunit.client.0.smithi072.stdout:6/711: truncate d7/d9/d1e/fec 375279 0 2024-03-19T06:06:11.337 INFO:tasks.workunit.client.0.smithi072.stdout:0/803: creat d1/d1c/d24/d27/d73/d80/da8/dc4/f10a x:0 0 0 2024-03-19T06:06:11.338 INFO:tasks.workunit.client.0.smithi072.stdout:6/712: rmdir d7/d9/d1b/d3b/d9b 39 2024-03-19T06:06:11.342 INFO:tasks.workunit.client.0.smithi072.stdout:0/804: creat d1/d1c/d82/ddd/f10b x:0 0 0 2024-03-19T06:06:11.342 INFO:tasks.workunit.client.0.smithi072.stdout:4/927: dwrite d5/d15/d22/d41/d7b/d7c/db4/dc7/ff5 [0,4194304] 0 2024-03-19T06:06:11.346 INFO:tasks.workunit.client.0.smithi072.stdout:4/928: chown d5/l35 458 1 2024-03-19T06:06:11.347 INFO:tasks.workunit.client.0.smithi072.stdout:0/805: symlink d1/d1c/d82/ddd/l10c 0 2024-03-19T06:06:11.349 INFO:tasks.workunit.client.0.smithi072.stdout:4/929: mknod d5/d15/d22/d95/d104/d122/c147 0 2024-03-19T06:06:11.349 INFO:tasks.workunit.client.0.smithi072.stdout:0/806: chown d1/d1c/d24/d27/d7c/f5a 0 1 2024-03-19T06:06:11.353 INFO:tasks.workunit.client.0.smithi072.stdout:6/713: write d7/d9/d30/fb7 [503853,128771] 0 2024-03-19T06:06:11.354 INFO:tasks.workunit.client.0.smithi072.stdout:4/930: rename d5/d37/de3/f10b to d5/d15/d31/d7d/d91/d10c/f148 0 2024-03-19T06:06:11.359 INFO:tasks.workunit.client.0.smithi072.stdout:6/714: rmdir d7/d3f/d44 39 2024-03-19T06:06:11.361 INFO:tasks.workunit.client.0.smithi072.stdout:6/715: write d7/d99/f35 [2854304,47393] 0 2024-03-19T06:06:11.362 INFO:tasks.workunit.client.0.smithi072.stdout:0/807: rename d1/d1c/d24/d3f/f96 to d1/d1c/d24/d27/d73/d80/da8/dc4/deb/f10d 0 2024-03-19T06:06:11.365 INFO:tasks.workunit.client.0.smithi072.stdout:6/716: truncate d7/d9/d1b/d3b/f8c 1936658 0 2024-03-19T06:06:11.369 INFO:tasks.workunit.client.0.smithi072.stdout:0/808: fdatasync d1/d1c/d24/d27/d7c/daa/f100 0 2024-03-19T06:06:11.371 INFO:tasks.workunit.client.0.smithi072.stdout:6/717: fdatasync d7/d9/d1b/d3b/d48/fa9 0 2024-03-19T06:06:11.372 INFO:tasks.workunit.client.0.smithi072.stdout:4/931: getdents d5/d1b/dca 0 2024-03-19T06:06:11.373 INFO:tasks.workunit.client.0.smithi072.stdout:0/809: fsync d1/d1c/d24/d27/d73/f87 0 2024-03-19T06:06:11.381 INFO:tasks.workunit.client.0.smithi072.stdout:0/810: link d1/d2c/da1/d85/f101 d1/d1c/d24/d27/d7e/f10e 0 2024-03-19T06:06:11.386 INFO:tasks.workunit.client.0.smithi072.stdout:0/811: creat d1/d1c/d24/d8f/f10f x:0 0 0 2024-03-19T06:06:11.386 INFO:tasks.workunit.client.0.smithi072.stdout:6/718: dread d7/d99/f35 [0,4194304] 0 2024-03-19T06:06:11.389 INFO:tasks.workunit.client.0.smithi072.stdout:0/812: unlink d1/d1c/d24/d27/d7c/f56 0 2024-03-19T06:06:11.444 INFO:tasks.workunit.client.0.smithi072.stdout:6/719: mknod d7/d9/d1b/d21/d68/daa/d88/cf2 0 2024-03-19T06:06:11.444 INFO:tasks.workunit.client.0.smithi072.stdout:9/696: sync 2024-03-19T06:06:11.444 INFO:tasks.workunit.client.0.smithi072.stdout:2/863: sync 2024-03-19T06:06:11.447 INFO:tasks.workunit.client.0.smithi072.stdout:0/813: stat d1/d1c/d24/d27/d7c/daa/cac 0 2024-03-19T06:06:11.448 INFO:tasks.workunit.client.0.smithi072.stdout:2/864: dread - db/d10/d13/d31/d35/ddc/f125 zero size 2024-03-19T06:06:11.451 INFO:tasks.workunit.client.0.smithi072.stdout:9/697: creat d11/d24/ddd/d5c/fed x:0 0 0 2024-03-19T06:06:11.452 INFO:tasks.workunit.client.0.smithi072.stdout:6/720: symlink d7/d9/d1b/d33/d41/lf3 0 2024-03-19T06:06:11.453 INFO:tasks.workunit.client.0.smithi072.stdout:0/814: mkdir d1/d2c/da1/d85/d110 0 2024-03-19T06:06:11.454 INFO:tasks.workunit.client.0.smithi072.stdout:9/698: chown d11/d1f/f7e 228013831 1 2024-03-19T06:06:11.459 INFO:tasks.workunit.client.0.smithi072.stdout:9/699: rmdir d11/d24/d4c/d6e 39 2024-03-19T06:06:11.464 INFO:tasks.workunit.client.0.smithi072.stdout:0/815: dread d1/d1c/d24/d27/d73/d80/da8/dc4/fc9 [0,4194304] 0 2024-03-19T06:06:11.470 INFO:tasks.workunit.client.0.smithi072.stdout:0/816: mknod d1/d1c/d24/d27/d7c/c111 0 2024-03-19T06:06:11.473 INFO:tasks.workunit.client.0.smithi072.stdout:6/721: write d7/d9/d1b/d33/d41/d92/fb4 [22418,78907] 0 2024-03-19T06:06:11.474 INFO:tasks.workunit.client.0.smithi072.stdout:0/817: mkdir d1/d2c/da1/d85/d112 0 2024-03-19T06:06:11.476 INFO:tasks.workunit.client.0.smithi072.stdout:2/865: dwrite db/d10/d2b/d45/f58 [0,4194304] 0 2024-03-19T06:06:11.477 INFO:tasks.workunit.client.0.smithi072.stdout:6/722: chown d7/d9/d1b/d31/cb9 61 1 2024-03-19T06:06:11.480 INFO:tasks.workunit.client.0.smithi072.stdout:9/700: write d11/d24/d4c/dda/d68/fb9 [499157,35508] 0 2024-03-19T06:06:11.499 INFO:tasks.workunit.client.0.smithi072.stdout:6/723: write d7/d99/f47 [4283489,87268] 0 2024-03-19T06:06:11.501 INFO:tasks.workunit.client.0.smithi072.stdout:0/818: write d1/d1c/d24/d27/d73/fb2 [169113,93031] 0 2024-03-19T06:06:11.503 INFO:tasks.workunit.client.0.smithi072.stdout:9/701: write d11/d78/fb2 [217330,14857] 0 2024-03-19T06:06:11.504 INFO:tasks.workunit.client.0.smithi072.stdout:6/724: chown d7/d99/d60/l85 235550 1 2024-03-19T06:06:11.508 INFO:tasks.workunit.client.0.smithi072.stdout:2/866: dwrite db/d10/d13/d24/d72/dcb/f126 [0,4194304] 0 2024-03-19T06:06:11.514 INFO:tasks.workunit.client.0.smithi072.stdout:2/867: unlink db/d10/d2b/fcf 0 2024-03-19T06:06:11.520 INFO:tasks.workunit.client.0.smithi072.stdout:0/819: truncate d1/fdb 106605 0 2024-03-19T06:06:11.521 INFO:tasks.workunit.client.0.smithi072.stdout:9/702: dread d11/d24/d4c/dda/d68/f73 [0,4194304] 0 2024-03-19T06:06:11.525 INFO:tasks.workunit.client.0.smithi072.stdout:2/868: rename db/d10/d2b/d2d/d62 to db/d10/d2b/d2d/d12c 0 2024-03-19T06:06:11.526 INFO:tasks.workunit.client.0.smithi072.stdout:0/820: creat d1/d1c/d82/d90/dbe/f113 x:0 0 0 2024-03-19T06:06:11.530 INFO:tasks.workunit.client.0.smithi072.stdout:0/821: truncate d1/d2c/fd9 230369 0 2024-03-19T06:06:11.531 INFO:tasks.workunit.client.0.smithi072.stdout:9/703: creat d11/d24/d4c/dda/d68/d92/fee x:0 0 0 2024-03-19T06:06:11.532 INFO:tasks.workunit.client.0.smithi072.stdout:6/725: dwrite d7/d3f/d65/f89 [0,4194304] 0 2024-03-19T06:06:11.532 INFO:tasks.workunit.client.0.smithi072.stdout:0/822: fsync d1/d1c/d24/d8f/f10f 0 2024-03-19T06:06:11.539 INFO:tasks.workunit.client.0.smithi072.stdout:2/869: truncate db/d10/d2b/d2d/d12c/d6b/f8a 3739438 0 2024-03-19T06:06:11.540 INFO:tasks.workunit.client.0.smithi072.stdout:6/726: rename d7/d9/d1b/d33 to d7/d99/d60/ded/df4 0 2024-03-19T06:06:11.546 INFO:tasks.workunit.client.0.smithi072.stdout:9/704: rename d11/d24/ddd/d5c/lc1 to d11/d24/d4c/dda/d6f/dac/lef 0 2024-03-19T06:06:11.550 INFO:tasks.workunit.client.0.smithi072.stdout:9/705: read d11/d1f/f27 [3924176,69034] 0 2024-03-19T06:06:11.554 INFO:tasks.workunit.client.0.smithi072.stdout:3/762: sync 2024-03-19T06:06:11.554 INFO:tasks.workunit.client.0.smithi072.stdout:7/661: sync 2024-03-19T06:06:11.555 INFO:tasks.workunit.client.0.smithi072.stdout:6/727: dread d7/d9/d1b/d31/f82 [0,4194304] 0 2024-03-19T06:06:11.555 INFO:tasks.workunit.client.0.smithi072.stdout:9/706: dread - d11/d24/d4c/dda/d36/fe3 zero size 2024-03-19T06:06:11.561 INFO:tasks.workunit.client.0.smithi072.stdout:6/728: chown d7/d3f/f5f 197220845 1 2024-03-19T06:06:11.561 INFO:tasks.workunit.client.0.smithi072.stdout:2/870: dwrite db/f38 [0,4194304] 0 2024-03-19T06:06:11.565 INFO:tasks.workunit.client.0.smithi072.stdout:6/729: mkdir d7/d99/d60/ded/df5 0 2024-03-19T06:06:11.565 INFO:tasks.workunit.client.0.smithi072.stdout:0/823: dwrite d1/d1c/d24/d3f/f5c [0,4194304] 0 2024-03-19T06:06:11.615 INFO:tasks.workunit.client.0.smithi072.stdout:2/871: mknod db/d10/d13/df4/d103/d82/c12d 0 2024-03-19T06:06:11.619 INFO:tasks.workunit.client.0.smithi072.stdout:6/730: fsync d7/d9/d2b/f6a 0 2024-03-19T06:06:11.620 INFO:tasks.workunit.client.0.smithi072.stdout:9/707: dread d11/d24/d4c/dda/d36/d3e/f58 [0,4194304] 0 2024-03-19T06:06:11.622 INFO:tasks.workunit.client.0.smithi072.stdout:6/731: stat d7/d9/d1b/d21/fcf 0 2024-03-19T06:06:11.623 INFO:tasks.workunit.client.0.smithi072.stdout:0/824: creat d1/d1c/d82/d90/dbe/f114 x:0 0 0 2024-03-19T06:06:11.624 INFO:tasks.workunit.client.0.smithi072.stdout:2/872: mknod db/d10/d13/d24/c12e 0 2024-03-19T06:06:11.634 INFO:tasks.workunit.client.0.smithi072.stdout:3/763: dwrite d2/d3/f6d [0,4194304] 0 2024-03-19T06:06:11.636 INFO:tasks.workunit.client.0.smithi072.stdout:6/732: creat d7/d99/ff6 x:0 0 0 2024-03-19T06:06:11.640 INFO:tasks.workunit.client.0.smithi072.stdout:9/708: dread d11/d24/ddd/f6a [0,4194304] 0 2024-03-19T06:06:11.651 INFO:tasks.workunit.client.0.smithi072.stdout:9/709: truncate d11/d1f/f27 3651862 0 2024-03-19T06:06:11.656 INFO:tasks.workunit.client.0.smithi072.stdout:9/710: mknod d11/d24/d4c/dda/d6f/dac/cf0 0 2024-03-19T06:06:11.658 INFO:tasks.workunit.client.0.smithi072.stdout:0/825: write d1/d1c/d24/d8f/fc1 [316577,120895] 0 2024-03-19T06:06:11.662 INFO:tasks.workunit.client.0.smithi072.stdout:3/764: truncate d2/d75/fb8 2197101 0 2024-03-19T06:06:11.666 INFO:tasks.workunit.client.0.smithi072.stdout:3/765: readlink d2/d3/d15/d66/d6b/l7e 0 2024-03-19T06:06:11.670 INFO:tasks.workunit.client.0.smithi072.stdout:2/873: dwrite db/d10/d13/d24/f3d [0,4194304] 0 2024-03-19T06:06:11.671 INFO:tasks.workunit.client.0.smithi072.stdout:6/733: dread d7/d9/d1b/d21/d68/daa/fbf [0,4194304] 0 2024-03-19T06:06:11.672 INFO:tasks.workunit.client.0.smithi072.stdout:3/766: creat d2/df4/f105 x:0 0 0 2024-03-19T06:06:11.678 INFO:tasks.workunit.client.0.smithi072.stdout:2/874: rename db/d10/d13/d24/d61 to db/d10/d13/d24/d61/d12f 22 2024-03-19T06:06:11.678 INFO:tasks.workunit.client.0.smithi072.stdout:9/711: dwrite d11/d24/ddd/d5c/fed [0,4194304] 0 2024-03-19T06:06:11.679 INFO:tasks.workunit.client.0.smithi072.stdout:6/734: write d7/d99/d60/ded/df4/d41/d92/fb4 [915553,46898] 0 2024-03-19T06:06:11.682 INFO:tasks.workunit.client.0.smithi072.stdout:2/875: write db/f30 [2769902,61636] 0 2024-03-19T06:06:11.688 INFO:tasks.workunit.client.0.smithi072.stdout:9/712: mknod d11/d24/d4c/dda/d68/d92/dc0/cf1 0 2024-03-19T06:06:11.688 INFO:tasks.workunit.client.0.smithi072.stdout:6/735: write d7/d3f/f58 [4436540,60092] 0 2024-03-19T06:06:11.689 INFO:tasks.workunit.client.0.smithi072.stdout:2/876: symlink db/d10/d2b/d45/da4/l130 0 2024-03-19T06:06:11.693 INFO:tasks.workunit.client.0.smithi072.stdout:0/826: dwrite d1/f58 [4194304,4194304] 0 2024-03-19T06:06:11.694 INFO:tasks.workunit.client.0.smithi072.stdout:1/809: sync 2024-03-19T06:06:11.696 INFO:tasks.workunit.client.0.smithi072.stdout:6/736: unlink d7/d3f/d65/l6d 0 2024-03-19T06:06:11.698 INFO:tasks.workunit.client.0.smithi072.stdout:4/932: sync 2024-03-19T06:06:11.698 INFO:tasks.workunit.client.0.smithi072.stdout:8/783: sync 2024-03-19T06:06:11.698 INFO:tasks.workunit.client.0.smithi072.stdout:5/894: sync 2024-03-19T06:06:11.702 INFO:tasks.workunit.client.0.smithi072.stdout:9/713: rename d11/d24/f28 to d11/d1f/ff2 0 2024-03-19T06:06:11.702 INFO:tasks.workunit.client.0.smithi072.stdout:1/810: read - d1/daa/dd8/d63/d73/fec zero size 2024-03-19T06:06:11.705 INFO:tasks.workunit.client.0.smithi072.stdout:4/933: symlink d5/d1b/dd9/l149 0 2024-03-19T06:06:11.705 INFO:tasks.workunit.client.0.smithi072.stdout:0/827: symlink d1/d1c/d24/d27/d73/d80/l115 0 2024-03-19T06:06:11.706 INFO:tasks.workunit.client.0.smithi072.stdout:6/737: symlink d7/d9/d1b/d31/da6/lf7 0 2024-03-19T06:06:11.709 INFO:tasks.workunit.client.0.smithi072.stdout:8/784: mknod da/d27/d52/dbd/c109 0 2024-03-19T06:06:11.711 INFO:tasks.workunit.client.0.smithi072.stdout:6/738: chown d7/c5b 193685 1 2024-03-19T06:06:11.714 INFO:tasks.workunit.client.0.smithi072.stdout:7/662: sync 2024-03-19T06:06:11.714 INFO:tasks.workunit.client.0.smithi072.stdout:5/895: symlink df/d13/d32/d28/d42/d59/l10e 0 2024-03-19T06:06:11.716 INFO:tasks.workunit.client.0.smithi072.stdout:0/828: dread - d1/d1c/d24/d27/d73/d80/da8/dc4/f10a zero size 2024-03-19T06:06:11.719 INFO:tasks.workunit.client.0.smithi072.stdout:9/714: truncate d11/d24/d4c/dda/d36/d45/d4d/fc6 2326932 0 2024-03-19T06:06:11.723 INFO:tasks.workunit.client.0.smithi072.stdout:3/767: dread d2/f60 [0,4194304] 0 2024-03-19T06:06:11.727 INFO:tasks.workunit.client.0.smithi072.stdout:4/934: rename d5/d15/d22/d41/fa0 to d5/d1b/dd9/f14a 0 2024-03-19T06:06:11.728 INFO:tasks.workunit.client.0.smithi072.stdout:7/663: creat d2/d3/d18/d3f/fd1 x:0 0 0 2024-03-19T06:06:11.728 INFO:tasks.workunit.client.0.smithi072.stdout:2/877: dwrite db/d10/d2b/dc3/fea [0,4194304] 0 2024-03-19T06:06:11.730 INFO:tasks.workunit.client.0.smithi072.stdout:4/935: write d5/fdd [1654840,109208] 0 2024-03-19T06:06:11.736 INFO:tasks.workunit.client.0.smithi072.stdout:9/715: creat d11/d24/ddd/d5c/ff3 x:0 0 0 2024-03-19T06:06:11.736 INFO:tasks.workunit.client.0.smithi072.stdout:5/896: creat df/d13/d32/d28/d42/d59/d43/d62/f10f x:0 0 0 2024-03-19T06:06:11.740 INFO:tasks.workunit.client.0.smithi072.stdout:8/785: mkdir da/d13/d14/d1b/d10a 0 2024-03-19T06:06:11.746 INFO:tasks.workunit.client.0.smithi072.stdout:6/739: rename d7/d99/d60/fe8 to d7/d9/d30/ff8 0 2024-03-19T06:06:11.746 INFO:tasks.workunit.client.0.smithi072.stdout:5/897: fdatasync df/d13/d32/d28/d42/ff8 0 2024-03-19T06:06:11.746 INFO:tasks.workunit.client.0.smithi072.stdout:8/786: dread - da/d27/fe6 zero size 2024-03-19T06:06:11.747 INFO:tasks.workunit.client.0.smithi072.stdout:0/829: link d1/d1c/d82/ddd/f10b d1/d1c/f116 0 2024-03-19T06:06:11.754 INFO:tasks.workunit.client.0.smithi072.stdout:0/830: chown d1/fdb 223085 1 2024-03-19T06:06:11.755 INFO:tasks.workunit.client.0.smithi072.stdout:1/811: dwrite d1/d11/f13 [0,4194304] 0 2024-03-19T06:06:11.760 INFO:tasks.workunit.client.0.smithi072.stdout:6/740: creat d7/d9/d1b/d3b/d48/ff9 x:0 0 0 2024-03-19T06:06:11.762 INFO:tasks.workunit.client.0.smithi072.stdout:8/787: creat da/d27/dc2/f10b x:0 0 0 2024-03-19T06:06:11.762 INFO:tasks.workunit.client.0.smithi072.stdout:7/664: dread d2/d3/d17/dc8/d1d/f81 [0,4194304] 0 2024-03-19T06:06:11.764 INFO:tasks.workunit.client.0.smithi072.stdout:1/812: mkdir d1/daa/dd8/d19/de3/d114 0 2024-03-19T06:06:11.764 INFO:tasks.workunit.client.0.smithi072.stdout:0/831: creat d1/d1c/d24/d3f/de2/f117 x:0 0 0 2024-03-19T06:06:11.768 INFO:tasks.workunit.client.0.smithi072.stdout:0/832: chown d1/d1c/d24/d27/d7e 3 1 2024-03-19T06:06:11.770 INFO:tasks.workunit.client.0.smithi072.stdout:8/788: symlink da/d62/l10c 0 2024-03-19T06:06:11.772 INFO:tasks.workunit.client.0.smithi072.stdout:5/898: write df/d14/f2f [5000915,79418] 0 2024-03-19T06:06:11.777 INFO:tasks.workunit.client.0.smithi072.stdout:4/936: write d5/d15/d22/d95/fe2 [798524,44539] 0 2024-03-19T06:06:11.781 INFO:tasks.workunit.client.0.smithi072.stdout:3/768: dread d2/d19/f65 [0,4194304] 0 2024-03-19T06:06:11.781 INFO:tasks.workunit.client.0.smithi072.stdout:2/878: truncate db/d10/d2b/d2d/d9e/dab/dca/fb5 3350459 0 2024-03-19T06:06:11.786 INFO:tasks.workunit.client.0.smithi072.stdout:3/769: readlink d2/d40/d78/d9b/la7 0 2024-03-19T06:06:11.795 INFO:tasks.workunit.client.0.smithi072.stdout:8/789: link da/c10 da/d27/d30/c10d 0 2024-03-19T06:06:11.797 INFO:tasks.workunit.client.0.smithi072.stdout:0/833: link d1/d1c/d24/d27/d73/d80/lb4 d1/d1c/d82/de4/da6/l118 0 2024-03-19T06:06:11.814 INFO:tasks.workunit.client.0.smithi072.stdout:9/716: dread d11/d24/d4c/dda/d6f/dac/fb4 [0,4194304] 0 2024-03-19T06:06:11.818 INFO:tasks.workunit.client.0.smithi072.stdout:7/665: dwrite d2/d3/d17/f48 [0,4194304] 0 2024-03-19T06:06:11.821 INFO:tasks.workunit.client.0.smithi072.stdout:3/770: getdents d2/d40/d78/d9b/dc5 0 2024-03-19T06:06:11.825 INFO:tasks.workunit.client.0.smithi072.stdout:1/813: dwrite d1/daa/dd8/d19/d1a/f98 [0,4194304] 0 2024-03-19T06:06:11.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:11 smithi072 ceph-mon[28706]: pgmap v32: 65 pgs: 65 active+clean; 2.5 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 54 MiB/s rd, 150 MiB/s wr, 380 op/s 2024-03-19T06:06:11.828 INFO:tasks.workunit.client.0.smithi072.stdout:6/741: dwrite d7/d9/d1b/d3b/d9b/da4/db5/fc4 [0,4194304] 0 2024-03-19T06:06:11.828 INFO:tasks.workunit.client.0.smithi072.stdout:7/666: dread - d2/d3/d17/dc8/fa6 zero size 2024-03-19T06:06:11.831 INFO:tasks.workunit.client.0.smithi072.stdout:8/790: rename da/d62/d75 to da/d13/d1d/d10e 0 2024-03-19T06:06:11.835 INFO:tasks.workunit.client.0.smithi072.stdout:5/899: dwrite df/fcc [0,4194304] 0 2024-03-19T06:06:11.840 INFO:tasks.workunit.client.0.smithi072.stdout:5/900: rmdir df/d13/d32/d28 39 2024-03-19T06:06:11.841 INFO:tasks.workunit.client.0.smithi072.stdout:9/717: write d11/d24/d4c/dda/d36/d45/f84 [3479609,26797] 0 2024-03-19T06:06:11.842 INFO:tasks.workunit.client.0.smithi072.stdout:1/814: truncate d1/daa/dd8/d19/d1a/d3b/fa4 25920 0 2024-03-19T06:06:11.847 INFO:tasks.workunit.client.0.smithi072.stdout:1/815: write d1/daa/dd8/d19/d1a/d61/d65/fd2 [4047097,9263] 0 2024-03-19T06:06:11.863 INFO:tasks.workunit.client.0.smithi072.stdout:0/834: dwrite d1/d1c/d24/d27/d73/d80/d8b/fab [4194304,4194304] 0 2024-03-19T06:06:11.865 INFO:tasks.workunit.client.0.smithi072.stdout:1/816: creat d1/daa/dd8/d19/d1a/d61/d65/f115 x:0 0 0 2024-03-19T06:06:11.866 INFO:tasks.workunit.client.0.smithi072.stdout:5/901: creat df/d13/d32/d28/d42/d59/d43/d4e/dbd/f110 x:0 0 0 2024-03-19T06:06:11.868 INFO:tasks.workunit.client.0.smithi072.stdout:6/742: truncate d7/d9/d1e/fe0 406768 0 2024-03-19T06:06:11.870 INFO:tasks.workunit.client.0.smithi072.stdout:9/718: symlink d11/d24/d4c/dda/d6f/d88/dc5/lf4 0 2024-03-19T06:06:11.876 INFO:tasks.workunit.client.0.smithi072.stdout:7/667: truncate d2/d3/d18/d7f/db3/f76 42104 0 2024-03-19T06:06:11.879 INFO:tasks.workunit.client.0.smithi072.stdout:0/835: creat d1/d1c/d82/de4/f119 x:0 0 0 2024-03-19T06:06:11.883 INFO:tasks.workunit.client.0.smithi072.stdout:4/937: dread d5/d15/d22/d41/d7b/d7c/db4/f109 [0,4194304] 0 2024-03-19T06:06:11.887 INFO:tasks.workunit.client.0.smithi072.stdout:5/902: mkdir df/d13/d32/d28/dda/d111 0 2024-03-19T06:06:11.893 INFO:tasks.workunit.client.0.smithi072.stdout:8/791: dwrite da/d27/f43 [0,4194304] 0 2024-03-19T06:06:11.894 INFO:tasks.workunit.client.0.smithi072.stdout:0/836: creat d1/d1c/d24/d27/d73/df7/f11a x:0 0 0 2024-03-19T06:06:11.895 INFO:tasks.workunit.client.0.smithi072.stdout:3/771: dread d2/d3/d26/f97 [0,4194304] 0 2024-03-19T06:06:11.896 INFO:tasks.workunit.client.0.smithi072.stdout:5/903: mknod df/d13/d32/d28/dda/c112 0 2024-03-19T06:06:11.902 INFO:tasks.workunit.client.0.smithi072.stdout:4/938: getdents d5/d32 0 2024-03-19T06:06:11.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:11 smithi172 ceph-mon[35716]: pgmap v32: 65 pgs: 65 active+clean; 2.5 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 54 MiB/s rd, 150 MiB/s wr, 380 op/s 2024-03-19T06:06:11.905 INFO:tasks.workunit.client.0.smithi072.stdout:3/772: readlink d2/l3c 0 2024-03-19T06:06:11.911 INFO:tasks.workunit.client.0.smithi072.stdout:6/743: dread d7/d3f/d65/f89 [0,4194304] 0 2024-03-19T06:06:11.913 INFO:tasks.workunit.client.0.smithi072.stdout:9/719: dwrite d11/d24/d4c/dda/d68/d92/fee [0,4194304] 0 2024-03-19T06:06:11.921 INFO:tasks.workunit.client.0.smithi072.stdout:6/744: dread - d7/d9/d1b/d3b/d9b/da4/fea zero size 2024-03-19T06:06:11.924 INFO:tasks.workunit.client.0.smithi072.stdout:3/773: write d2/d3/d15/d66/d6b/fc1 [778746,78587] 0 2024-03-19T06:06:11.930 INFO:tasks.workunit.client.0.smithi072.stdout:3/774: dread - d2/d3/d25/ff2 zero size 2024-03-19T06:06:11.930 INFO:tasks.workunit.client.0.smithi072.stdout:7/668: dwrite d2/f66 [4194304,4194304] 0 2024-03-19T06:06:11.931 INFO:tasks.workunit.client.0.smithi072.stdout:9/720: stat d11/d24/d4c/c51 0 2024-03-19T06:06:11.933 INFO:tasks.workunit.client.0.smithi072.stdout:0/837: getdents d1/d2c/da1/d85/d110 0 2024-03-19T06:06:11.934 INFO:tasks.workunit.client.0.smithi072.stdout:7/669: stat d2/d3/d17/dc8 0 2024-03-19T06:06:11.943 INFO:tasks.workunit.client.0.smithi072.stdout:6/745: fsync d7/d99/d60/d78/d7f/dcb/d84/fc6 0 2024-03-19T06:06:11.943 INFO:tasks.workunit.client.0.smithi072.stdout:3/775: fdatasync d2/d19/f6c 0 2024-03-19T06:06:11.948 INFO:tasks.workunit.client.0.smithi072.stdout:7/670: creat d2/d8c/dba/dbc/fd2 x:0 0 0 2024-03-19T06:06:11.956 INFO:tasks.workunit.client.0.smithi072.stdout:8/792: getdents da/d27/d52/d5b/d3e/d7d 0 2024-03-19T06:06:11.960 INFO:tasks.workunit.client.0.smithi072.stdout:3/776: symlink d2/d3/d15/d66/d70/l106 0 2024-03-19T06:06:11.964 INFO:tasks.workunit.client.0.smithi072.stdout:6/746: symlink d7/d99/d60/d78/d7f/dcb/lfa 0 2024-03-19T06:06:11.971 INFO:tasks.workunit.client.0.smithi072.stdout:3/777: mkdir d2/d19/db0/d107 0 2024-03-19T06:06:11.972 INFO:tasks.workunit.client.0.smithi072.stdout:5/904: dwrite df/d13/d32/d28/f80 [0,4194304] 0 2024-03-19T06:06:11.974 INFO:tasks.workunit.client.0.smithi072.stdout:1/817: dread d1/f8d [0,4194304] 0 2024-03-19T06:06:11.975 INFO:tasks.workunit.client.0.smithi072.stdout:6/747: mkdir d7/d99/d60/d78/d7f/dcb/d84/dc0/dfb 0 2024-03-19T06:06:11.978 INFO:tasks.workunit.client.0.smithi072.stdout:9/721: dwrite d11/f12 [0,4194304] 0 2024-03-19T06:06:11.981 INFO:tasks.workunit.client.0.smithi072.stdout:3/778: mknod d2/d19/db0/dcb/c108 0 2024-03-19T06:06:11.983 INFO:tasks.workunit.client.0.smithi072.stdout:6/748: write d7/d3f/fc2 [3162573,15179] 0 2024-03-19T06:06:11.983 INFO:tasks.workunit.client.0.smithi072.stdout:4/939: dread d5/d11/f1a [4194304,4194304] 0 2024-03-19T06:06:11.986 INFO:tasks.workunit.client.0.smithi072.stdout:0/838: truncate d1/d1c/d24/d27/d73/d80/da8/dc4/deb/f10d 293907 0 2024-03-19T06:06:11.990 INFO:tasks.workunit.client.0.smithi072.stdout:5/905: creat df/d16/dc4/f113 x:0 0 0 2024-03-19T06:06:11.993 INFO:tasks.workunit.client.0.smithi072.stdout:1/818: mkdir d1/daa/dd8/d19/d1a/d25/d60/dfc/d116 0 2024-03-19T06:06:12.010 INFO:tasks.workunit.client.0.smithi072.stdout:6/749: creat d7/d9/d1b/d31/d96/ffc x:0 0 0 2024-03-19T06:06:12.012 INFO:tasks.workunit.client.0.smithi072.stdout:0/839: stat d1/d1c/d24/d27/d7e/c95 0 2024-03-19T06:06:12.014 INFO:tasks.workunit.client.0.smithi072.stdout:4/940: mknod d5/d15/d22/d95/d104/d126/c14b 0 2024-03-19T06:06:12.015 INFO:tasks.workunit.client.0.smithi072.stdout:9/722: dread d11/f17 [0,4194304] 0 2024-03-19T06:06:12.020 INFO:tasks.workunit.client.0.smithi072.stdout:0/840: dread - d1/d1c/d82/fd8 zero size 2024-03-19T06:06:12.024 INFO:tasks.workunit.client.0.smithi072.stdout:8/793: dwrite da/d27/fb2 [0,4194304] 0 2024-03-19T06:06:12.027 INFO:tasks.workunit.client.0.smithi072.stdout:3/779: dwrite d2/d19/f5c [0,4194304] 0 2024-03-19T06:06:12.030 INFO:tasks.workunit.client.0.smithi072.stdout:5/906: link df/d13/d32/d28/d42/f6a df/d3c/d104/f114 0 2024-03-19T06:06:12.030 INFO:tasks.workunit.client.0.smithi072.stdout:6/750: readlink d7/d9/d1b/d21/d68/daa/ld9 0 2024-03-19T06:06:12.034 INFO:tasks.workunit.client.0.smithi072.stdout:6/751: write d7/d99/d60/d78/d7f/fde [62069,66774] 0 2024-03-19T06:06:12.036 INFO:tasks.workunit.client.0.smithi072.stdout:4/941: creat d5/d15/d22/d11d/f14c x:0 0 0 2024-03-19T06:06:12.038 INFO:tasks.workunit.client.0.smithi072.stdout:0/841: rename d1/d1c/d24/d27/d73/d80/da8 to d1/d1c/d24/d3f/de2/d11b 0 2024-03-19T06:06:12.039 INFO:tasks.workunit.client.0.smithi072.stdout:6/752: dread - d7/d9/d1b/d21/d68/d80/fe1 zero size 2024-03-19T06:06:12.044 INFO:tasks.workunit.client.0.smithi072.stdout:4/942: mknod d5/d37/de3/dfa/c14d 0 2024-03-19T06:06:12.051 INFO:tasks.workunit.client.0.smithi072.stdout:3/780: dread d2/d3/d15/fba [0,4194304] 0 2024-03-19T06:06:12.052 INFO:tasks.workunit.client.0.smithi072.stdout:9/723: rename d11/d24/d4c/dda/d68/d79/d9f/dc7/cad to d11/d24/d4c/dda/d68/cf5 0 2024-03-19T06:06:12.056 INFO:tasks.workunit.client.0.smithi072.stdout:8/794: dwrite da/d13/d14/d1b/d6b/fca [0,4194304] 0 2024-03-19T06:06:12.057 INFO:tasks.workunit.client.0.smithi072.stdout:9/724: symlink d11/d24/d4c/dda/d36/d45/dcb/lf6 0 2024-03-19T06:06:12.059 INFO:tasks.workunit.client.0.smithi072.stdout:8/795: truncate da/d27/f43 4562446 0 2024-03-19T06:06:12.060 INFO:tasks.workunit.client.0.smithi072.stdout:4/943: rename d5/d11/c65 to d5/d15/d22/d41/d7b/d7c/c14e 0 2024-03-19T06:06:12.065 INFO:tasks.workunit.client.0.smithi072.stdout:3/781: rename d2/d3/d15/c71 to d2/d19/db0/dcb/df8/c109 0 2024-03-19T06:06:12.067 INFO:tasks.workunit.client.0.smithi072.stdout:1/819: dread d1/daa/dd8/d19/d1a/d25/d3c/d68/d96/ff6 [0,4194304] 0 2024-03-19T06:06:12.069 INFO:tasks.workunit.client.0.smithi072.stdout:4/944: rename d5/d1b/f8d to d5/d15/d22/d41/d61/d71/f14f 0 2024-03-19T06:06:12.072 INFO:tasks.workunit.client.0.smithi072.stdout:9/725: rmdir d11/d24/d4c/dda/d36/d45/dcb 39 2024-03-19T06:06:12.073 INFO:tasks.workunit.client.0.smithi072.stdout:1/820: chown d1/daa/dd8/d19/d1a/d25/d60/f75 56536 1 2024-03-19T06:06:12.077 INFO:tasks.workunit.client.0.smithi072.stdout:9/726: mkdir d11/df7 0 2024-03-19T06:06:12.082 INFO:tasks.workunit.client.0.smithi072.stdout:4/945: read d5/d15/d22/d41/d7b/d7c/db4/ffd [1327923,12674] 0 2024-03-19T06:06:12.083 INFO:tasks.workunit.client.0.smithi072.stdout:1/821: unlink d1/daa/dd8/d19/d1a/d25/c37 0 2024-03-19T06:06:12.083 INFO:tasks.workunit.client.0.smithi072.stdout:8/796: dwrite da/d27/d52/d100/d8e/fdf [0,4194304] 0 2024-03-19T06:06:12.086 INFO:tasks.workunit.client.0.smithi072.stdout:6/753: dwrite d7/d9/d1b/f2a [0,4194304] 0 2024-03-19T06:06:12.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.116+0000 7f0e8f000700 1 -- 172.21.15.72:0/1712281822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e881031e0 msgr2=0x7f0e88105660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:12.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.116+0000 7f0e8f000700 1 --2- 172.21.15.72:0/1712281822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e881031e0 0x7f0e88105660 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009960 tx=0x7f0e74009c70 comp rx=0 tx=0).stop 2024-03-19T06:06:12.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.117+0000 7f0e8f000700 1 -- 172.21.15.72:0/1712281822 shutdown_connections 2024-03-19T06:06:12.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.117+0000 7f0e8f000700 1 --2- 172.21.15.72:0/1712281822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e881031e0 0x7f0e88105660 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:12.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.117+0000 7f0e8f000700 1 --2- 172.21.15.72:0/1712281822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e88069270 0x7f0e88102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:12.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.117+0000 7f0e8f000700 1 -- 172.21.15.72:0/1712281822 >> 172.21.15.72:0/1712281822 conn(0x7f0e880fa610 msgr2=0x7f0e880fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:12.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.117+0000 7f0e8f000700 1 -- 172.21.15.72:0/1712281822 shutdown_connections 2024-03-19T06:06:12.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.117+0000 7f0e8f000700 1 -- 172.21.15.72:0/1712281822 wait complete. 2024-03-19T06:06:12.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.118+0000 7f0e8f000700 1 Processor -- start 2024-03-19T06:06:12.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.118+0000 7f0e8f000700 1 -- start start 2024-03-19T06:06:12.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.119+0000 7f0e8f000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e881031e0 0x7f0e88197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:12.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.119+0000 7f0e8f000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e88198100 0x7f0e8819d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:12.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.119+0000 7f0e8f000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88198600 con 0x7f0e88198100 2024-03-19T06:06:12.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.119+0000 7f0e8f000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88198770 con 0x7f0e881031e0 2024-03-19T06:06:12.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.119+0000 7f0e87400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e88198100 0x7f0e8819d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:12.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.119+0000 7f0e87e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e881031e0 0x7f0e88197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:12.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.119+0000 7f0e87400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e88198100 0x7f0e8819d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43292/0 (socket says 172.21.15.72:43292) 2024-03-19T06:06:12.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.120+0000 7f0e87400700 1 -- 172.21.15.72:0/3262616841 learned_addr learned my addr 172.21.15.72:0/3262616841 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:12.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.120+0000 7f0e87400700 1 -- 172.21.15.72:0/3262616841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e881031e0 msgr2=0x7f0e88197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:12.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.120+0000 7f0e87400700 1 --2- 172.21.15.72:0/3262616841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e881031e0 0x7f0e88197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:12.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.120+0000 7f0e87400700 1 -- 172.21.15.72:0/3262616841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e740095f0 con 0x7f0e88198100 2024-03-19T06:06:12.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.121+0000 7f0e87400700 1 --2- 172.21.15.72:0/3262616841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e88198100 0x7f0e8819d170 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400b780 tx=0x7f0e7400bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:12.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.121+0000 7f0e84c00700 1 -- 172.21.15.72:0/3262616841 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e7401d070 con 0x7f0e88198100 2024-03-19T06:06:12.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.121+0000 7f0e84c00700 1 -- 172.21.15.72:0/3262616841 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0e7400f460 con 0x7f0e88198100 2024-03-19T06:06:12.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.121+0000 7f0e84c00700 1 -- 172.21.15.72:0/3262616841 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e74021640 con 0x7f0e88198100 2024-03-19T06:06:12.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.121+0000 7f0e8f000700 1 -- 172.21.15.72:0/3262616841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e8819d6b0 con 0x7f0e88198100 2024-03-19T06:06:12.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.121+0000 7f0e8f000700 1 -- 172.21.15.72:0/3262616841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8819db70 con 0x7f0e88198100 2024-03-19T06:06:12.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.123+0000 7f0e8f000700 1 -- 172.21.15.72:0/3262616841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e88069270 con 0x7f0e88198100 2024-03-19T06:06:12.114 INFO:tasks.workunit.client.0.smithi072.stdout:8/797: dwrite da/d13/d3f/db9/fd6 [0,4194304] 0 2024-03-19T06:06:12.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.124+0000 7f0e84c00700 1 -- 172.21.15.72:0/3262616841 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7f0e7400f5d0 con 0x7f0e88198100 2024-03-19T06:06:12.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.126+0000 7f0e84c00700 1 --2- 172.21.15.72:0/3262616841 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f0e6c06dd50 0x7f0e6c070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:12.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.126+0000 7f0e84c00700 1 -- 172.21.15.72:0/3262616841 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f0e7408ec70 con 0x7f0e88198100 2024-03-19T06:06:12.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.131+0000 7f0e87e00700 1 --2- 172.21.15.72:0/3262616841 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f0e6c06dd50 0x7f0e6c070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:12.123 INFO:tasks.workunit.client.0.smithi072.stdout:3/782: dread d2/d3/f10 [4194304,4194304] 0 2024-03-19T06:06:12.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.132+0000 7f0e87e00700 1 --2- 172.21.15.72:0/3262616841 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f0e6c06dd50 0x7f0e6c070200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0e88068fa0 tx=0x7f0e78009260 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:12.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.134+0000 7f0e84c00700 1 -- 172.21.15.72:0/3262616841 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f0e74095080 con 0x7f0e88198100 2024-03-19T06:06:12.133 INFO:tasks.workunit.client.0.smithi072.stdout:4/946: link d5/d15/d31/d7d/d91/f121 d5/d15/d22/d41/d7b/f150 0 2024-03-19T06:06:12.134 INFO:tasks.workunit.client.0.smithi072.stdout:6/754: creat d7/d9/d1b/d31/ffd x:0 0 0 2024-03-19T06:06:12.138 INFO:tasks.workunit.client.0.smithi072.stdout:6/755: write d7/d99/d60/ded/df4/d41/d92/fb4 [1973913,24239] 0 2024-03-19T06:06:12.142 INFO:tasks.workunit.client.0.smithi072.stdout:1/822: rename d1/daa to d1/d11/d76/da7/d9e/d117 0 2024-03-19T06:06:12.144 INFO:tasks.workunit.client.0.smithi072.stdout:8/798: symlink da/d3b/da7/l10f 0 2024-03-19T06:06:12.145 INFO:tasks.workunit.client.0.smithi072.stdout:1/823: dread - d1/d11/d76/da7/d9e/d117/dd8/d63/d73/fc4 zero size 2024-03-19T06:06:12.146 INFO:tasks.workunit.client.0.smithi072.stdout:9/727: creat d11/d24/d4c/dda/d68/ff8 x:0 0 0 2024-03-19T06:06:12.151 INFO:tasks.workunit.client.0.smithi072.stdout:4/947: rmdir d5/d32/d58 39 2024-03-19T06:06:12.152 INFO:tasks.workunit.client.0.smithi072.stdout:6/756: read - d7/d99/d60/fd3 zero size 2024-03-19T06:06:12.153 INFO:tasks.workunit.client.0.smithi072.stdout:8/799: creat da/d13/d14/f110 x:0 0 0 2024-03-19T06:06:12.156 INFO:tasks.workunit.client.0.smithi072.stdout:8/800: truncate da/d13/d14/fe2 400177 0 2024-03-19T06:06:12.160 INFO:tasks.workunit.client.0.smithi072.stdout:8/801: dread - da/d13/d3f/fad zero size 2024-03-19T06:06:12.160 INFO:tasks.workunit.client.0.smithi072.stdout:4/948: dread d5/d15/d3f/d42/ff3 [0,4194304] 0 2024-03-19T06:06:12.161 INFO:tasks.workunit.client.0.smithi072.stdout:6/757: unlink d7/d9/d1b/d21/d68/ca3 0 2024-03-19T06:06:12.163 INFO:tasks.workunit.client.0.smithi072.stdout:9/728: dwrite d11/d24/d4c/dda/d68/d92/d93/fb8 [4194304,4194304] 0 2024-03-19T06:06:12.163 INFO:tasks.workunit.client.0.smithi072.stdout:1/824: dwrite d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d52/fae [4194304,4194304] 0 2024-03-19T06:06:12.166 INFO:tasks.workunit.client.0.smithi072.stdout:8/802: mkdir da/d13/d14/d6f/d111 0 2024-03-19T06:06:12.166 INFO:tasks.workunit.client.0.smithi072.stdout:6/758: mknod d7/d99/d97/cfe 0 2024-03-19T06:06:12.168 INFO:tasks.workunit.client.0.smithi072.stdout:1/825: chown d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/db8/ff0 2 1 2024-03-19T06:06:12.169 INFO:tasks.workunit.client.0.smithi072.stdout:4/949: fdatasync d5/d15/d31/d7d/d91/f140 0 2024-03-19T06:06:12.172 INFO:tasks.workunit.client.0.smithi072.stdout:9/729: chown d11/d24/d4c/dda/d36/d45/d4d/l99 12413 1 2024-03-19T06:06:12.175 INFO:tasks.workunit.client.0.smithi072.stdout:8/803: creat da/d62/f112 x:0 0 0 2024-03-19T06:06:12.177 INFO:tasks.workunit.client.0.smithi072.stdout:8/804: write da/d13/d1d/d10e/ffc [437234,29649] 0 2024-03-19T06:06:12.178 INFO:tasks.workunit.client.0.smithi072.stdout:1/826: unlink d1/d11/f1c 0 2024-03-19T06:06:12.181 INFO:tasks.workunit.client.0.smithi072.stdout:6/759: mknod d7/d99/d60/cff 0 2024-03-19T06:06:12.183 INFO:tasks.workunit.client.0.smithi072.stdout:8/805: creat da/d13/d14/f113 x:0 0 0 2024-03-19T06:06:12.184 INFO:tasks.workunit.client.0.smithi072.stdout:1/827: fdatasync d1/d11/d76/da7/d9e/d117/f106 0 2024-03-19T06:06:12.185 INFO:tasks.workunit.client.0.smithi072.stdout:1/828: fdatasync d1/f15 0 2024-03-19T06:06:12.185 INFO:tasks.workunit.client.0.smithi072.stdout:8/806: chown da/d27/fb2 0 1 2024-03-19T06:06:12.188 INFO:tasks.workunit.client.0.smithi072.stdout:9/730: dread d11/d78/fae [0,4194304] 0 2024-03-19T06:06:12.190 INFO:tasks.workunit.client.0.smithi072.stdout:8/807: creat da/d37/dd3/f114 x:0 0 0 2024-03-19T06:06:12.193 INFO:tasks.workunit.client.0.smithi072.stdout:1/829: write d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/ff1 [5099984,11080] 0 2024-03-19T06:06:12.201 INFO:tasks.workunit.client.0.smithi072.stdout:1/830: fsync d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/d65/f115 0 2024-03-19T06:06:12.202 INFO:tasks.workunit.client.0.smithi072.stdout:6/760: dwrite d7/d3f/fee [0,4194304] 0 2024-03-19T06:06:12.204 INFO:tasks.workunit.client.0.smithi072.stdout:1/831: dread - d1/d11/d76/da7/d9e/d117/dfd/f10f zero size 2024-03-19T06:06:12.215 INFO:tasks.workunit.client.0.smithi072.stdout:8/808: write da/d13/d14/d1b/f9c [376585,119393] 0 2024-03-19T06:06:12.216 INFO:tasks.workunit.client.0.smithi072.stdout:9/731: link d11/d24/d4c/dda/d36/d45/dcb/lce d11/d24/d4c/dda/d36/d45/d5b/lf9 0 2024-03-19T06:06:12.219 INFO:tasks.workunit.client.0.smithi072.stdout:4/950: dwrite d5/d15/d22/f9a [0,4194304] 0 2024-03-19T06:06:12.222 INFO:tasks.workunit.client.0.smithi072.stdout:8/809: unlink da/d27/d52/d5b/d3e/lb8 0 2024-03-19T06:06:12.224 INFO:tasks.workunit.client.0.smithi072.stdout:4/951: fsync d5/d15/d3f/dc1/f5b 0 2024-03-19T06:06:12.227 INFO:tasks.workunit.client.0.smithi072.stdout:1/832: dwrite d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/ff1 [0,4194304] 0 2024-03-19T06:06:12.233 INFO:tasks.workunit.client.0.smithi072.stdout:8/810: write da/d37/f6c [182991,99313] 0 2024-03-19T06:06:12.234 INFO:tasks.workunit.client.0.smithi072.stdout:1/833: mknod d1/d11/c118 0 2024-03-19T06:06:12.239 INFO:tasks.workunit.client.0.smithi072.stdout:1/834: mknod d1/d11/d6d/c119 0 2024-03-19T06:06:12.240 INFO:tasks.workunit.client.0.smithi072.stdout:8/811: dread da/d13/d14/d1b/d57/f64 [0,4194304] 0 2024-03-19T06:06:12.241 INFO:tasks.workunit.client.0.smithi072.stdout:2/879: sync 2024-03-19T06:06:12.244 INFO:tasks.workunit.client.0.smithi072.stdout:8/812: write da/d3b/f9b [986172,126755] 0 2024-03-19T06:06:12.244 INFO:tasks.workunit.client.0.smithi072.stdout:9/732: dread d11/d24/d4c/dda/d36/f53 [0,4194304] 0 2024-03-19T06:06:12.245 INFO:tasks.workunit.client.0.smithi072.stdout:1/835: chown d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/lfa 12617 1 2024-03-19T06:06:12.246 INFO:tasks.workunit.client.0.smithi072.stdout:2/880: symlink db/d10/d13/df4/d103/dd9/l131 0 2024-03-19T06:06:12.247 INFO:tasks.workunit.client.0.smithi072.stdout:9/733: write d11/f37 [4632200,69113] 0 2024-03-19T06:06:12.247 INFO:tasks.workunit.client.0.smithi072.stdout:8/813: chown da/d27/d52/d100/d8e 71 1 2024-03-19T06:06:12.250 INFO:tasks.workunit.client.0.smithi072.stdout:1/836: readlink d1/d11/d76/da7/d9e/d117/dd8/d63/l101 0 2024-03-19T06:06:12.252 INFO:tasks.workunit.client.0.smithi072.stdout:2/881: mknod db/d10/d12/c132 0 2024-03-19T06:06:12.254 INFO:tasks.workunit.client.0.smithi072.stdout:8/814: write da/d13/d14/d1b/d57/f64 [1611424,68510] 0 2024-03-19T06:06:12.257 INFO:tasks.workunit.client.0.smithi072.stdout:1/837: write d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/dc0/fed [8094794,128742] 0 2024-03-19T06:06:12.258 INFO:tasks.workunit.client.0.smithi072.stdout:8/815: write da/d13/d14/d1b/fbb [5222262,116269] 0 2024-03-19T06:06:12.259 INFO:tasks.workunit.client.0.smithi072.stdout:9/734: truncate d11/d24/d4c/dda/d36/d45/d4d/f82 1370138 0 2024-03-19T06:06:12.263 INFO:tasks.workunit.client.0.smithi072.stdout:9/735: creat d11/d1f/d43/ffa x:0 0 0 2024-03-19T06:06:12.265 INFO:tasks.workunit.client.0.smithi072.stdout:1/838: chown d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d60/f75 7588510 1 2024-03-19T06:06:12.266 INFO:tasks.workunit.client.0.smithi072.stdout:8/816: symlink da/d13/d14/d6f/d111/l115 0 2024-03-19T06:06:12.267 INFO:tasks.workunit.client.0.smithi072.stdout:9/736: write d11/d24/d4c/dda/d68/d92/d93/fb8 [5461995,93742] 0 2024-03-19T06:06:12.272 INFO:tasks.workunit.client.0.smithi072.stdout:8/817: dread - da/d37/de1/ff6 zero size 2024-03-19T06:06:12.273 INFO:tasks.workunit.client.0.smithi072.stdout:4/952: dread d5/d15/d31/d4c/f75 [0,4194304] 0 2024-03-19T06:06:12.274 INFO:tasks.workunit.client.0.smithi072.stdout:8/818: read - da/d13/d1d/d10e/ffa zero size 2024-03-19T06:06:12.276 INFO:tasks.workunit.client.0.smithi072.stdout:1/839: rename d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/c8b to d1/d11/c11a 0 2024-03-19T06:06:12.279 INFO:tasks.workunit.client.0.smithi072.stdout:4/953: truncate d5/d15/da6/fc0 627061 0 2024-03-19T06:06:12.283 INFO:tasks.workunit.client.0.smithi072.stdout:1/840: creat d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/dc7/f11b x:0 0 0 2024-03-19T06:06:12.289 INFO:tasks.workunit.client.0.smithi072.stdout:1/841: fdatasync d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/f5b 0 2024-03-19T06:06:12.293 INFO:tasks.workunit.client.0.smithi072.stdout:4/954: truncate d5/d15/d22/d41/d7b/f13b 17920 0 2024-03-19T06:06:12.297 INFO:tasks.workunit.client.0.smithi072.stdout:8/819: dread da/d27/faf [0,4194304] 0 2024-03-19T06:06:12.297 INFO:tasks.workunit.client.0.smithi072.stdout:9/737: dread d11/f25 [0,4194304] 0 2024-03-19T06:06:12.299 INFO:tasks.workunit.client.0.smithi072.stdout:1/842: creat d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/f11c x:0 0 0 2024-03-19T06:06:12.300 INFO:tasks.workunit.client.0.smithi072.stdout:8/820: mkdir da/d37/de1/d116 0 2024-03-19T06:06:12.303 INFO:tasks.workunit.client.0.smithi072.stdout:9/738: symlink d11/d24/d4c/dda/d68/d79/d9f/lfb 0 2024-03-19T06:06:12.304 INFO:tasks.workunit.client.0.smithi072.stdout:8/821: unlink da/d27/d52/d5b/cc3 0 2024-03-19T06:06:12.305 INFO:tasks.workunit.client.0.smithi072.stdout:8/822: chown da/d27/c3a 766779016 1 2024-03-19T06:06:12.307 INFO:tasks.workunit.client.0.smithi072.stdout:4/955: write d5/d15/d31/d6f/fed [684970,48559] 0 2024-03-19T06:06:12.309 INFO:tasks.workunit.client.0.smithi072.stdout:1/843: mknod d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/def/d112/c11d 0 2024-03-19T06:06:12.310 INFO:tasks.workunit.client.0.smithi072.stdout:9/739: mknod d11/d24/d4c/d6e/cfc 0 2024-03-19T06:06:12.312 INFO:tasks.workunit.client.0.smithi072.stdout:8/823: fsync da/d27/dc2/ff0 0 2024-03-19T06:06:12.313 INFO:tasks.workunit.client.0.smithi072.stdout:9/740: rmdir d11/d24/d4c/dda/d6f 39 2024-03-19T06:06:12.319 INFO:tasks.workunit.client.0.smithi072.stdout:1/844: creat d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/f11e x:0 0 0 2024-03-19T06:06:12.321 INFO:tasks.workunit.client.0.smithi072.stdout:4/956: write d5/d15/d31/d7d/d91/f140 [5586234,103593] 0 2024-03-19T06:06:12.323 INFO:tasks.workunit.client.0.smithi072.stdout:8/824: dread da/d13/d14/d1b/f78 [0,4194304] 0 2024-03-19T06:06:12.324 INFO:tasks.workunit.client.0.smithi072.stdout:9/741: getdents d11/d24/d4c/dda/d68/d79 0 2024-03-19T06:06:12.325 INFO:tasks.workunit.client.0.smithi072.stdout:8/825: chown da/d37/f6c 467867 1 2024-03-19T06:06:12.327 INFO:tasks.workunit.client.0.smithi072.stdout:1/845: mkdir d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d79/dd9/d11f 0 2024-03-19T06:06:12.329 INFO:tasks.workunit.client.0.smithi072.stdout:4/957: read d5/d15/d31/d6f/d9d/fe9 [37960,64383] 0 2024-03-19T06:06:12.330 INFO:tasks.workunit.client.0.smithi072.stdout:1/846: read d1/d11/d76/f97 [8550,90022] 0 2024-03-19T06:06:12.332 INFO:tasks.workunit.client.0.smithi072.stdout:8/826: dread da/d27/d52/d5b/fb3 [0,4194304] 0 2024-03-19T06:06:12.333 INFO:tasks.workunit.client.0.smithi072.stdout:9/742: rename d11/d24/d4c/dda/d68/d92/dc0/cf1 to d11/d24/d4c/dda/d6f/d88/dc5/cfd 0 2024-03-19T06:06:12.336 INFO:tasks.workunit.client.0.smithi072.stdout:8/827: unlink da/d13/d14/d6f/c95 0 2024-03-19T06:06:12.339 INFO:tasks.workunit.client.0.smithi072.stdout:1/847: chown d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/la9 1 1 2024-03-19T06:06:12.340 INFO:tasks.workunit.client.0.smithi072.stdout:9/743: rename d11/d78/c81 to d11/d24/d4c/dda/d36/d45/dcb/cfe 0 2024-03-19T06:06:12.342 INFO:tasks.workunit.client.0.smithi072.stdout:1/848: chown d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d60/dfc/cff 34023 1 2024-03-19T06:06:12.342 INFO:tasks.workunit.client.0.smithi072.stdout:9/744: dread - d11/d24/d4c/d64/f75 zero size 2024-03-19T06:06:12.342 INFO:tasks.workunit.client.0.smithi072.stdout:8/828: creat da/d27/dc2/dc6/dd1/f117 x:0 0 0 2024-03-19T06:06:12.346 INFO:tasks.workunit.client.0.smithi072.stdout:8/829: chown da/d13/d1d/la5 285036217 1 2024-03-19T06:06:12.348 INFO:tasks.workunit.client.0.smithi072.stdout:4/958: write d5/d37/d52/fc5 [1563275,91580] 0 2024-03-19T06:06:12.353 INFO:tasks.workunit.client.0.smithi072.stdout:4/959: chown d5/d15/d31/d4c/lda 1163023 1 2024-03-19T06:06:12.355 INFO:tasks.workunit.client.0.smithi072.stdout:8/830: fsync da/d13/d14/d1b/d57/f5d 0 2024-03-19T06:06:12.359 INFO:tasks.workunit.client.0.smithi072.stdout:9/745: dwrite d11/d24/ddd/f52 [0,4194304] 0 2024-03-19T06:06:12.360 INFO:tasks.workunit.client.0.smithi072.stdout:1/849: dwrite d1/d11/d76/da7/d9e/d117/dd8/d63/df2/f10e [0,4194304] 0 2024-03-19T06:06:12.360 INFO:tasks.workunit.client.0.smithi072.stdout:4/960: rmdir d5/d15/d31/d6d/d7a/d8e 39 2024-03-19T06:06:12.371 INFO:tasks.workunit.client.0.smithi072.stdout:9/746: rename d11/d24/ddd/d57 to d11/d24/d4c/dda/d6f/dff 0 2024-03-19T06:06:12.373 INFO:tasks.workunit.client.0.smithi072.stdout:4/961: unlink d5/d15/d3f/dc1/l130 0 2024-03-19T06:06:12.374 INFO:tasks.workunit.client.0.smithi072.stdout:8/831: link da/d13/d1d/la5 da/d13/d14/d1b/d6b/l118 0 2024-03-19T06:06:12.377 INFO:tasks.workunit.client.0.smithi072.stdout:1/850: rename d1/l10 to d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/l120 0 2024-03-19T06:06:12.377 INFO:tasks.workunit.client.0.smithi072.stdout:8/832: write da/d13/d1d/f87 [5177385,74684] 0 2024-03-19T06:06:12.379 INFO:tasks.workunit.client.0.smithi072.stdout:4/962: creat d5/d15/d3f/d10d/f151 x:0 0 0 2024-03-19T06:06:12.385 INFO:tasks.workunit.client.0.smithi072.stdout:1/851: symlink d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/l121 0 2024-03-19T06:06:12.386 INFO:tasks.workunit.client.0.smithi072.stdout:4/963: mkdir d5/d11/d152 0 2024-03-19T06:06:12.389 INFO:tasks.workunit.client.0.smithi072.stdout:4/964: write d5/d37/d52/fc5 [632318,127249] 0 2024-03-19T06:06:12.395 INFO:tasks.workunit.client.0.smithi072.stdout:8/833: dwrite da/d13/d3f/db9/fd6 [0,4194304] 0 2024-03-19T06:06:12.399 INFO:tasks.workunit.client.0.smithi072.stdout:7/671: sync 2024-03-19T06:06:12.399 INFO:tasks.workunit.client.0.smithi072.stdout:5/907: sync 2024-03-19T06:06:12.406 INFO:tasks.workunit.client.0.smithi072.stdout:9/747: dread d11/d24/d4c/dda/d36/d45/d4d/f9b [0,4194304] 0 2024-03-19T06:06:12.455 INFO:tasks.workunit.client.0.smithi072.stdout:4/965: fsync d5/d11/f98 0 2024-03-19T06:06:12.459 INFO:tasks.workunit.client.0.smithi072.stdout:8/834: symlink da/d27/d52/d88/l119 0 2024-03-19T06:06:12.463 INFO:tasks.workunit.client.0.smithi072.stdout:5/908: creat df/d16/dc4/f115 x:0 0 0 2024-03-19T06:06:12.464 INFO:tasks.workunit.client.0.smithi072.stdout:9/748: dread - d11/d24/d4c/dda/d36/fd1 zero size 2024-03-19T06:06:12.464 INFO:tasks.workunit.client.0.smithi072.stdout:8/835: chown da/d27/dc2/dc6/dd1/led 2182957 1 2024-03-19T06:06:12.466 INFO:tasks.workunit.client.0.smithi072.stdout:8/836: read f4 [1121329,66614] 0 2024-03-19T06:06:12.470 INFO:tasks.workunit.client.0.smithi072.stdout:9/749: write d11/d24/d4c/dda/d68/d92/fee [4235075,117481] 0 2024-03-19T06:06:12.473 INFO:tasks.workunit.client.0.smithi072.stdout:8/837: chown da/d27/d52/d5b/d3e/d7d/d97/f80 0 1 2024-03-19T06:06:12.482 INFO:tasks.workunit.client.0.smithi072.stdout:8/838: chown da/d13/d14/d1b/d57/lb5 947795 1 2024-03-19T06:06:12.483 INFO:tasks.workunit.client.0.smithi072.stdout:8/839: dread - da/d37/dd3/f114 zero size 2024-03-19T06:06:12.485 INFO:tasks.workunit.client.0.smithi072.stdout:8/840: readlink da/d27/d52/d88/l119 0 2024-03-19T06:06:12.489 INFO:tasks.workunit.client.0.smithi072.stdout:5/909: getdents df/d16 0 2024-03-19T06:06:12.497 INFO:tasks.workunit.client.0.smithi072.stdout:8/841: rmdir da/d27/dc2 39 2024-03-19T06:06:12.510 INFO:tasks.workunit.client.0.smithi072.stdout:3/783: sync 2024-03-19T06:06:12.510 INFO:tasks.workunit.client.0.smithi072.stdout:0/842: sync 2024-03-19T06:06:12.510 INFO:tasks.workunit.client.0.smithi072.stdout:6/761: sync 2024-03-19T06:06:12.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.526+0000 7f0e8f000700 1 -- 172.21.15.72:0/3262616841 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e881028e0 con 0x7f0e6c06dd50 2024-03-19T06:06:12.518 INFO:tasks.workunit.client.0.smithi072.stdout:3/784: truncate d2/d3/d15/d66/d70/f9f 3235744 0 2024-03-19T06:06:12.519 INFO:tasks.workunit.client.0.smithi072.stdout:0/843: dread d1/d1c/f4c [0,4194304] 0 2024-03-19T06:06:12.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.529+0000 7f0e84c00700 1 -- 172.21.15.72:0/3262616841 <== mgr.14702 v2:172.21.15.72:6800/2640845307 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f0e881028e0 con 0x7f0e6c06dd50 2024-03-19T06:06:12.520 INFO:tasks.workunit.client.0.smithi072.stdout:6/762: mkdir d7/d9/d1b/d3b/d9b/dab/d100 0 2024-03-19T06:06:12.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.532+0000 7f0e8f000700 1 -- 172.21.15.72:0/3262616841 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f0e6c06dd50 msgr2=0x7f0e6c070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:12.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.532+0000 7f0e8f000700 1 --2- 172.21.15.72:0/3262616841 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f0e6c06dd50 0x7f0e6c070200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0e88068fa0 tx=0x7f0e78009260 comp rx=0 tx=0).stop 2024-03-19T06:06:12.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.532+0000 7f0e8f000700 1 -- 172.21.15.72:0/3262616841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e88198100 msgr2=0x7f0e8819d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:12.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.532+0000 7f0e8f000700 1 --2- 172.21.15.72:0/3262616841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e88198100 0x7f0e8819d170 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400b780 tx=0x7f0e7400bd40 comp rx=0 tx=0).stop 2024-03-19T06:06:12.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.532+0000 7f0e8f000700 1 -- 172.21.15.72:0/3262616841 shutdown_connections 2024-03-19T06:06:12.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.532+0000 7f0e8f000700 1 --2- 172.21.15.72:0/3262616841 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f0e6c06dd50 0x7f0e6c070200 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:12.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.532+0000 7f0e8f000700 1 --2- 172.21.15.72:0/3262616841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e881031e0 0x7f0e88197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:12.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.532+0000 7f0e8f000700 1 --2- 172.21.15.72:0/3262616841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e88198100 0x7f0e8819d170 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:12.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.533+0000 7f0e8f000700 1 -- 172.21.15.72:0/3262616841 >> 172.21.15.72:0/3262616841 conn(0x7f0e880fa610 msgr2=0x7f0e881021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:12.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.533+0000 7f0e8f000700 1 -- 172.21.15.72:0/3262616841 shutdown_connections 2024-03-19T06:06:12.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.533+0000 7f0e8f000700 1 -- 172.21.15.72:0/3262616841 wait complete. 2024-03-19T06:06:12.526 INFO:tasks.workunit.client.0.smithi072.stdout:0/844: chown d1/d1c/d82/d90/f103 505756 1 2024-03-19T06:06:12.527 INFO:tasks.workunit.client.0.smithi072.stdout:3/785: unlink d2/d19/d1e/l3a 0 2024-03-19T06:06:12.528 INFO:tasks.workunit.client.0.smithi072.stdout:6/763: symlink d7/d9/d1b/d3b/l101 0 2024-03-19T06:06:12.531 INFO:tasks.workunit.client.0.smithi072.stdout:6/764: chown d7/d99/d60/ded/df4/c4a 21 1 2024-03-19T06:06:12.535 INFO:tasks.workunit.client.0.smithi072.stdout:0/845: creat d1/d2c/da1/f11c x:0 0 0 2024-03-19T06:06:12.538 INFO:tasks.workunit.client.0.smithi072.stdout:6/765: mkdir d7/d99/d60/d78/d7f/dcb/d84/dc0/dfb/d102 0 2024-03-19T06:06:12.539 INFO:tasks.workunit.client.0.smithi072.stdout:6/766: chown d7/f3c 204 1 2024-03-19T06:06:12.540 INFO:tasks.workunit.client.0.smithi072.stdout:0/846: symlink d1/d1c/d24/d27/d73/l11d 0 2024-03-19T06:06:12.543 INFO:tasks.workunit.client.0.smithi072.stdout:8/842: mkdir da/d62/d11a 0 2024-03-19T06:06:12.545 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:06:12.546 INFO:tasks.workunit.client.0.smithi072.stdout:1/852: rename d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d3b/c110 to d1/d11/d76/da7/c122 0 2024-03-19T06:06:12.548 INFO:tasks.workunit.client.0.smithi072.stdout:8/843: mkdir da/d13/d14/d1b/d57/dd7/d11b 0 2024-03-19T06:06:12.551 INFO:tasks.workunit.client.0.smithi072.stdout:7/672: rename d2/d3/d17/dc8/d83/f89 to d2/d3/d17/dc8/d1d/d2b/fd3 0 2024-03-19T06:06:12.555 INFO:tasks.workunit.client.0.smithi072.stdout:1/853: truncate d1/d11/d76/da7/d9e/d117/dd8/d63/d73/fec 145359 0 2024-03-19T06:06:12.562 INFO:tasks.workunit.client.0.smithi072.stdout:2/882: sync 2024-03-19T06:06:12.564 INFO:tasks.workunit.client.0.smithi072.stdout:1/854: symlink d1/d11/d76/da7/d9e/d117/dd8/d19/de3/l123 0 2024-03-19T06:06:12.564 INFO:tasks.workunit.client.0.smithi072.stdout:7/673: dread d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/fd0 [0,4194304] 0 2024-03-19T06:06:12.569 INFO:tasks.workunit.client.0.smithi072.stdout:8/844: dwrite da/d27/f39 [0,4194304] 0 2024-03-19T06:06:12.573 INFO:tasks.workunit.client.0.smithi072.stdout:1/855: unlink d1/d11/d76/da7/d9e/d117/dfd/f10f 0 2024-03-19T06:06:12.579 INFO:tasks.workunit.client.0.smithi072.stdout:2/883: rename db/d10/d2b/d2d/d9e/fe3 to db/d10/d44/f133 0 2024-03-19T06:06:12.583 INFO:tasks.workunit.client.0.smithi072.stdout:7/674: creat d2/d8c/dab/fd4 x:0 0 0 2024-03-19T06:06:12.589 INFO:tasks.workunit.client.0.smithi072.stdout:1/856: rename d1/d11/d76/da7/d9e/d117/dd8/d19/de3/fe9 to d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/dc0/f124 0 2024-03-19T06:06:12.595 INFO:tasks.workunit.client.0.smithi072.stdout:7/675: chown d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/l90 566 1 2024-03-19T06:06:12.596 INFO:tasks.workunit.client.0.smithi072.stdout:2/884: rmdir db 39 2024-03-19T06:06:12.597 INFO:tasks.workunit.client.0.smithi072.stdout:1/857: write d1/d11/d76/da7/d9e/d117/dd8/d63/d73/fc4 [367019,84202] 0 2024-03-19T06:06:12.597 INFO:tasks.workunit.client.0.smithi072.stdout:4/966: write d5/d15/d31/d6f/fa3 [1563689,14370] 0 2024-03-19T06:06:12.602 INFO:tasks.workunit.client.0.smithi072.stdout:4/967: stat d5/d15/d22/d41/f100 0 2024-03-19T06:06:12.610 INFO:tasks.workunit.client.0.smithi072.stdout:2/885: write db/d10/d13/df4/d103/d82/f94 [1955658,21874] 0 2024-03-19T06:06:12.614 INFO:tasks.workunit.client.0.smithi072.stdout:9/750: dwrite d11/d24/d4c/dda/d36/d45/d5b/fbe [0,4194304] 0 2024-03-19T06:06:12.616 INFO:tasks.workunit.client.0.smithi072.stdout:7/676: link d2/d3/d17/f69 d2/d3/d17/dc8/d53/dbd/fd5 0 2024-03-19T06:06:12.616 INFO:tasks.workunit.client.0.smithi072.stdout:5/910: write df/d13/f23 [13220,77836] 0 2024-03-19T06:06:12.618 INFO:tasks.workunit.client.0.smithi072.stdout:1/858: symlink d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/l125 0 2024-03-19T06:06:12.619 INFO:tasks.workunit.client.0.smithi072.stdout:2/886: mkdir db/d10/d13/d31/d35/ddc/de1/d134 0 2024-03-19T06:06:12.621 INFO:tasks.workunit.client.0.smithi072.stdout:4/968: rename d5/d15/d3f/dc1/f2f to d5/d15/d31/f153 0 2024-03-19T06:06:12.623 INFO:tasks.workunit.client.0.smithi072.stdout:5/911: getdents df/d16/dc4/d10c 0 2024-03-19T06:06:12.625 INFO:tasks.workunit.client.0.smithi072.stdout:7/677: mkdir d2/d3/d17/dc8/d1d/d3b/d9a/d9b/dd6 0 2024-03-19T06:06:12.681 INFO:tasks.workunit.client.0.smithi072.stdout:4/969: mkdir d5/d15/d22/d95/d104/d122/d154 0 2024-03-19T06:06:12.683 INFO:tasks.workunit.client.0.smithi072.stdout:0/847: unlink d1/f4e 0 2024-03-19T06:06:12.684 INFO:tasks.workunit.client.0.smithi072.stdout:6/767: symlink d7/d9/d1b/d21/l103 0 2024-03-19T06:06:12.685 INFO:tasks.workunit.client.0.smithi072.stdout:3/786: mknod d2/d3/d15/c10a 0 2024-03-19T06:06:12.687 INFO:tasks.workunit.client.0.smithi072.stdout:0/848: dread d1/d2c/fd9 [0,4194304] 0 2024-03-19T06:06:12.688 INFO:tasks.workunit.client.0.smithi072.stdout:2/887: dread - db/d10/d44/f133 zero size 2024-03-19T06:06:12.688 INFO:tasks.workunit.client.0.smithi072.stdout:8/845: mkdir da/d13/d11c 0 2024-03-19T06:06:12.690 INFO:tasks.workunit.client.0.smithi072.stdout:3/787: mknod d2/d40/c10b 0 2024-03-19T06:06:12.690 INFO:tasks.workunit.client.0.smithi072.stdout:0/849: dread - d1/de7/ff5 zero size 2024-03-19T06:06:12.691 INFO:tasks.workunit.client.0.smithi072.stdout:0/850: stat d1/de7/ff5 0 2024-03-19T06:06:12.692 INFO:tasks.workunit.client.0.smithi072.stdout:8/846: write da/d13/d14/d1b/f9c [1425907,92658] 0 2024-03-19T06:06:12.693 INFO:tasks.workunit.client.0.smithi072.stdout:4/970: unlink d5/d15/d22/d11d/f14c 0 2024-03-19T06:06:12.697 INFO:tasks.workunit.client.0.smithi072.stdout:5/912: getdents df/d54 0 2024-03-19T06:06:12.702 INFO:tasks.workunit.client.0.smithi072.stdout:6/768: dwrite d7/d9/d1b/d3b/d48/ff9 [0,4194304] 0 2024-03-19T06:06:12.704 INFO:tasks.workunit.client.0.smithi072.stdout:2/888: unlink db/d10/d13/df4/d103/f7b 0 2024-03-19T06:06:12.706 INFO:tasks.workunit.client.0.smithi072.stdout:7/678: write d2/d3/d17/dc8/d1d/d2b/d3d/d21/f99 [4935105,98039] 0 2024-03-19T06:06:12.706 INFO:tasks.workunit.client.0.smithi072.stdout:2/889: chown db/d10/d13/d24/d61/d7d/fd3 94808865 1 2024-03-19T06:06:12.708 INFO:tasks.workunit.client.0.smithi072.stdout:3/788: dread - d2/d3/d26/d98/fb9 zero size 2024-03-19T06:06:12.710 INFO:tasks.workunit.client.0.smithi072.stdout:1/859: link d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/d65/le5 d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/db8/l126 0 2024-03-19T06:06:12.711 INFO:tasks.workunit.client.0.smithi072.stdout:7/679: truncate d2/d3/d18/fb1 149404 0 2024-03-19T06:06:12.712 INFO:tasks.workunit.client.0.smithi072.stdout:8/847: creat da/d3b/f11d x:0 0 0 2024-03-19T06:06:12.713 INFO:tasks.workunit.client.0.smithi072.stdout:3/789: chown d2/d3/d25/da5/de6 188267 1 2024-03-19T06:06:12.713 INFO:tasks.workunit.client.0.smithi072.stdout:0/851: rmdir d1/d1c/d24/d27/d73/d80/dd2 39 2024-03-19T06:06:12.716 INFO:tasks.workunit.client.0.smithi072.stdout:5/913: fdatasync df/d54/dac/f73 0 2024-03-19T06:06:12.717 INFO:tasks.workunit.client.0.smithi072.stdout:4/971: write d5/d15/d31/fcb [1318623,28546] 0 2024-03-19T06:06:12.719 INFO:tasks.workunit.client.0.smithi072.stdout:2/890: symlink db/d10/d13/d31/d35/ddc/de1/d134/l135 0 2024-03-19T06:06:12.719 INFO:tasks.workunit.client.0.smithi072.stdout:1/860: write d1/d11/d76/da7/d9e/d117/dfd/f100 [501209,56814] 0 2024-03-19T06:06:12.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.728+0000 7f9b30400700 1 -- 172.21.15.72:0/2654296933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b28102490 msgr2=0x7f9b281028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:12.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.728+0000 7f9b30400700 1 --2- 172.21.15.72:0/2654296933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b28102490 0x7f9b281028a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009910 tx=0x7f9b1c009c20 comp rx=0 tx=0).stop 2024-03-19T06:06:12.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.728+0000 7f9b30400700 1 -- 172.21.15.72:0/2654296933 shutdown_connections 2024-03-19T06:06:12.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.728+0000 7f9b30400700 1 --2- 172.21.15.72:0/2654296933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b28103640 0x7f9b28103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:12.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.728+0000 7f9b30400700 1 --2- 172.21.15.72:0/2654296933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b28102490 0x7f9b281028a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:12.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.728+0000 7f9b30400700 1 -- 172.21.15.72:0/2654296933 >> 172.21.15.72:0/2654296933 conn(0x7f9b280fda60 msgr2=0x7f9b280ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:12.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.729+0000 7f9b30400700 1 -- 172.21.15.72:0/2654296933 shutdown_connections 2024-03-19T06:06:12.721 INFO:tasks.workunit.client.0.smithi072.stdout:7/680: unlink d2/d3/d18/d2f/l37 0 2024-03-19T06:06:12.721 INFO:tasks.workunit.client.0.smithi072.stdout:0/852: symlink d1/l11e 0 2024-03-19T06:06:12.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.729+0000 7f9b30400700 1 -- 172.21.15.72:0/2654296933 wait complete. 2024-03-19T06:06:12.722 INFO:tasks.workunit.client.0.smithi072.stdout:5/914: chown df/d13/d32/d28/d42/f7a 3309 1 2024-03-19T06:06:12.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.730+0000 7f9b30400700 1 Processor -- start 2024-03-19T06:06:12.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.731+0000 7f9b30400700 1 -- start start 2024-03-19T06:06:12.723 INFO:tasks.workunit.client.0.smithi072.stdout:8/848: mknod da/d13/d14/d1b/c11e 0 2024-03-19T06:06:12.725 INFO:tasks.workunit.client.0.smithi072.stdout:0/853: fdatasync d1/d1c/d24/d3f/de2/ff0 0 2024-03-19T06:06:12.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.731+0000 7f9b30400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b28102490 0x7f9b2819c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:12.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.731+0000 7f9b30400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b28103640 0x7f9b2819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:12.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.731+0000 7f9b30400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2819cbd0 con 0x7f9b28102490 2024-03-19T06:06:12.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.731+0000 7f9b30400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2819cd10 con 0x7f9b28103640 2024-03-19T06:06:12.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.732+0000 7f9b2d000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b28103640 0x7f9b2819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:12.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.732+0000 7f9b2da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b28102490 0x7f9b2819c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:12.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.732+0000 7f9b2da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b28102490 0x7f9b2819c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43312/0 (socket says 172.21.15.72:43312) 2024-03-19T06:06:12.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.733+0000 7f9b2da00700 1 -- 172.21.15.72:0/2134464658 learned_addr learned my addr 172.21.15.72:0/2134464658 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:12.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.734+0000 7f9b2d000700 1 -- 172.21.15.72:0/2134464658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b28102490 msgr2=0x7f9b2819c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.734+0000 7f9b2d000700 1 --2- 172.21.15.72:0/2134464658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b28102490 0x7f9b2819c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.734+0000 7f9b2d000700 1 -- 172.21.15.72:0/2134464658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c0095f0 con 0x7f9b28103640 2024-03-19T06:06:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.734+0000 7f9b2da00700 1 --2- 172.21.15.72:0/2134464658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b28102490 0x7f9b2819c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:06:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.734+0000 7f9b2d000700 1 --2- 172.21.15.72:0/2134464658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b28103640 0x7f9b2819c5b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400e970 tx=0x7f9b1400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.735+0000 7f9b26000700 1 -- 172.21.15.72:0/2134464658 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b1400c9d0 con 0x7f9b28103640 2024-03-19T06:06:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.735+0000 7f9b30400700 1 -- 172.21.15.72:0/2134464658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b281a17c0 con 0x7f9b28103640 2024-03-19T06:06:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.735+0000 7f9b26000700 1 -- 172.21.15.72:0/2134464658 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9b14010430 con 0x7f9b28103640 2024-03-19T06:06:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.735+0000 7f9b26000700 1 -- 172.21.15.72:0/2134464658 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b1400c9d0 con 0x7f9b28103640 2024-03-19T06:06:12.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.735+0000 7f9b30400700 1 -- 172.21.15.72:0/2134464658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b281a1d10 con 0x7f9b28103640 2024-03-19T06:06:12.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.737+0000 7f9b30400700 1 -- 172.21.15.72:0/2134464658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2810f320 con 0x7f9b28103640 2024-03-19T06:06:12.729 INFO:tasks.workunit.client.0.smithi072.stdout:3/790: mkdir d2/d3/d26/d92/d10c 0 2024-03-19T06:06:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.738+0000 7f9b26000700 1 -- 172.21.15.72:0/2134464658 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7f9b140105a0 con 0x7f9b28103640 2024-03-19T06:06:12.730 INFO:tasks.workunit.client.0.smithi072.stdout:7/681: mknod d2/d8c/dba/dbc/cd7 0 2024-03-19T06:06:12.731 INFO:tasks.workunit.client.0.smithi072.stdout:7/682: chown d2/d8c 1 1 2024-03-19T06:06:12.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.740+0000 7f9b26000700 1 --2- 172.21.15.72:0/2134464658 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f9b1006de00 0x7f9b100702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:12.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.740+0000 7f9b26000700 1 -- 172.21.15.72:0/2134464658 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f9b14014070 con 0x7f9b28103640 2024-03-19T06:06:12.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.740+0000 7f9b2da00700 1 --2- 172.21.15.72:0/2134464658 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f9b1006de00 0x7f9b100702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:12.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.741+0000 7f9b2da00700 1 --2- 172.21.15.72:0/2134464658 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f9b1006de00 0x7f9b100702b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c006010 tx=0x7f9b1c005a90 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:12.733 INFO:tasks.workunit.client.0.smithi072.stdout:4/972: fsync d5/d15/d22/d41/d61/d71/f8c 0 2024-03-19T06:06:12.737 INFO:tasks.workunit.client.0.smithi072.stdout:8/849: readlink da/d13/d1d/lbc 0 2024-03-19T06:06:12.737 INFO:tasks.workunit.client.0.smithi072.stdout:0/854: creat d1/d1c/d82/de4/f11f x:0 0 0 2024-03-19T06:06:12.739 INFO:tasks.workunit.client.0.smithi072.stdout:2/891: truncate db/d10/d2b/d2d/d12c/f63 807826 0 2024-03-19T06:06:12.740 INFO:tasks.workunit.client.0.smithi072.stdout:3/791: mknod d2/d40/d78/c10d 0 2024-03-19T06:06:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:12.750+0000 7f9b26000700 1 -- 172.21.15.72:0/2134464658 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f9b14052f10 con 0x7f9b28103640 2024-03-19T06:06:12.745 INFO:tasks.workunit.client.0.smithi072.stdout:1/861: dwrite d1/f15 [8388608,4194304] 0 2024-03-19T06:06:12.750 INFO:tasks.workunit.client.0.smithi072.stdout:6/769: write d7/d99/d60/d78/f8e [1243001,24809] 0 2024-03-19T06:06:12.750 INFO:tasks.workunit.client.0.smithi072.stdout:7/683: rename d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/fc4 to d2/d3/d17/dc8/d53/dbd/fd8 0 2024-03-19T06:06:12.751 INFO:tasks.workunit.client.0.smithi072.stdout:0/855: fdatasync d1/d1c/f4c 0 2024-03-19T06:06:12.753 INFO:tasks.workunit.client.0.smithi072.stdout:6/770: fsync d7/d9/d1b/d21/d68/d80/fe1 0 2024-03-19T06:06:12.754 INFO:tasks.workunit.client.0.smithi072.stdout:2/892: creat db/d10/d59/f136 x:0 0 0 2024-03-19T06:06:12.758 INFO:tasks.workunit.client.0.smithi072.stdout:3/792: fdatasync d2/d3/d26/d92/fa2 0 2024-03-19T06:06:12.762 INFO:tasks.workunit.client.0.smithi072.stdout:8/850: mknod da/d27/dc2/c11f 0 2024-03-19T06:06:12.764 INFO:tasks.workunit.client.0.smithi072.stdout:1/862: chown d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/d65/la2 20425 1 2024-03-19T06:06:12.768 INFO:tasks.workunit.client.0.smithi072.stdout:7/684: symlink d2/d3/d17/dc8/ld9 0 2024-03-19T06:06:12.770 INFO:tasks.workunit.client.0.smithi072.stdout:6/771: creat d7/d9/d1b/d21/d68/daa/f104 x:0 0 0 2024-03-19T06:06:12.771 INFO:tasks.workunit.client.0.smithi072.stdout:2/893: rmdir db/d10/d13 39 2024-03-19T06:06:12.771 INFO:tasks.workunit.client.0.smithi072.stdout:7/685: chown d2/d8c/dba/dbc/c5f 3533 1 2024-03-19T06:06:12.773 INFO:tasks.workunit.client.0.smithi072.stdout:5/915: dwrite df/fa5 [0,4194304] 0 2024-03-19T06:06:12.774 INFO:tasks.workunit.client.0.smithi072.stdout:3/793: fsync d2/d3/d15/d66/d6b/f94 0 2024-03-19T06:06:12.775 INFO:tasks.workunit.client.0.smithi072.stdout:4/973: truncate d5/d11/f1a 2056090 0 2024-03-19T06:06:12.776 INFO:tasks.workunit.client.0.smithi072.stdout:8/851: mknod da/d62/c120 0 2024-03-19T06:06:12.779 INFO:tasks.workunit.client.0.smithi072.stdout:4/974: readlink d5/le 0 2024-03-19T06:06:12.781 INFO:tasks.workunit.client.0.smithi072.stdout:1/863: creat d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/dc0/dda/f127 x:0 0 0 2024-03-19T06:06:12.782 INFO:tasks.workunit.client.0.smithi072.stdout:0/856: link d1/d1c/d24/d27/d73/d80/d8b/f5b d1/d1c/d82/de4/da6/f120 0 2024-03-19T06:06:12.784 INFO:tasks.workunit.client.0.smithi072.stdout:8/852: truncate da/d37/dd3/f114 330569 0 2024-03-19T06:06:12.786 INFO:tasks.workunit.client.0.smithi072.stdout:8/853: fsync da/d27/dc2/dc6/dd1/ffd 0 2024-03-19T06:06:12.787 INFO:tasks.workunit.client.0.smithi072.stdout:5/916: truncate df/f96 2362824 0 2024-03-19T06:06:12.789 INFO:tasks.workunit.client.0.smithi072.stdout:8/854: chown da/d27/dc2/dc6/dd1 57943 1 2024-03-19T06:06:12.794 INFO:tasks.workunit.client.0.smithi072.stdout:6/772: dwrite d7/d9/d1b/d3b/f8c [0,4194304] 0 2024-03-19T06:06:12.797 INFO:tasks.workunit.client.0.smithi072.stdout:0/857: mkdir d1/d1c/d24/d3f/de2/d11b/d121 0 2024-03-19T06:06:12.797 INFO:tasks.workunit.client.0.smithi072.stdout:6/773: write d7/d99/ff6 [399563,25017] 0 2024-03-19T06:06:12.798 INFO:tasks.workunit.client.0.smithi072.stdout:2/894: rename db/d10/d13/df4/d103/d82/d98/dbf/f121 to db/d10/d13/d24/d61/d7d/de0/f137 0 2024-03-19T06:06:12.798 INFO:tasks.workunit.client.0.smithi072.stdout:0/858: fsync d1/f1b 0 2024-03-19T06:06:12.805 INFO:tasks.workunit.client.0.smithi072.stdout:4/975: fdatasync d5/d15/d31/d6d/f12d 0 2024-03-19T06:06:12.805 INFO:tasks.workunit.client.0.smithi072.stdout:3/794: mkdir d2/d3/d26/d92/d10c/d10e 0 2024-03-19T06:06:12.807 INFO:tasks.workunit.client.0.smithi072.stdout:3/795: fdatasync d2/d19/d1e/f6a 0 2024-03-19T06:06:12.809 INFO:tasks.workunit.client.0.smithi072.stdout:7/686: write d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/fd0 [655144,75042] 0 2024-03-19T06:06:12.811 INFO:tasks.workunit.client.0.smithi072.stdout:8/855: rename da/d27/d30/c38 to da/d27/d52/d5b/d3e/d5a/c121 0 2024-03-19T06:06:12.813 INFO:tasks.workunit.client.0.smithi072.stdout:8/856: fsync da/d3b/f9b 0 2024-03-19T06:06:12.813 INFO:tasks.workunit.client.0.smithi072.stdout:6/774: mkdir d7/d9/d1e/d105 0 2024-03-19T06:06:12.819 INFO:tasks.workunit.client.0.smithi072.stdout:2/895: fdatasync db/d10/d13/d31/d35/ddc/fbe 0 2024-03-19T06:06:12.819 INFO:tasks.workunit.client.0.smithi072.stdout:5/917: write df/d13/d32/faa [283902,80183] 0 2024-03-19T06:06:12.827 INFO:tasks.workunit.client.0.smithi072.stdout:7/687: mkdir d2/d3/d18/d7f/dda 0 2024-03-19T06:06:12.835 INFO:tasks.workunit.client.0.smithi072.stdout:4/976: creat d5/d15/d31/d4c/d112/f155 x:0 0 0 2024-03-19T06:06:12.838 INFO:tasks.workunit.client.0.smithi072.stdout:2/896: read - db/d10/d13/d31/d35/ff3 zero size 2024-03-19T06:06:12.842 INFO:tasks.workunit.client.0.smithi072.stdout:8/857: rename da/d37/d69/fd5 to da/d13/d1d/d10e/f122 0 2024-03-19T06:06:12.842 INFO:tasks.workunit.client.0.smithi072.stdout:3/796: dwrite d2/d3/d26/d92/feb [0,4194304] 0 2024-03-19T06:06:12.842 INFO:tasks.workunit.client.0.smithi072.stdout:0/859: link d1/d1c/d82/d90/ldc d1/d1c/d24/d27/d73/d80/d8b/dfa/l122 0 2024-03-19T06:06:12.843 INFO:tasks.workunit.client.0.smithi072.stdout:2/897: write db/d10/d12/f105 [818953,89932] 0 2024-03-19T06:06:12.846 INFO:tasks.workunit.client.0.smithi072.stdout:8/858: write da/d13/d14/f110 [206810,21276] 0 2024-03-19T06:06:12.851 INFO:tasks.workunit.client.0.smithi072.stdout:5/918: dread df/d54/dac/f6d [0,4194304] 0 2024-03-19T06:06:12.852 INFO:tasks.workunit.client.0.smithi072.stdout:3/797: mknod d2/d19/c10f 0 2024-03-19T06:06:12.854 INFO:tasks.workunit.client.0.smithi072.stdout:0/860: mknod d1/d1c/d82/d90/c123 0 2024-03-19T06:06:12.864 INFO:tasks.workunit.client.0.smithi072.stdout:6/775: dwrite d7/d9/d1b/d21/fd5 [0,4194304] 0 2024-03-19T06:06:12.871 INFO:tasks.workunit.client.0.smithi072.stdout:7/688: truncate d2/d3/fd 3440436 0 2024-03-19T06:06:12.876 INFO:tasks.workunit.client.0.smithi072.stdout:0/861: creat d1/d1c/d82/d90/f124 x:0 0 0 2024-03-19T06:06:12.877 INFO:tasks.workunit.client.0.smithi072.stdout:8/859: write da/d37/f73 [3290100,121993] 0 2024-03-19T06:06:12.877 INFO:tasks.workunit.client.0.smithi072.stdout:6/776: dread - d7/d9/d1e/f7b zero size 2024-03-19T06:06:12.878 INFO:tasks.workunit.client.0.smithi072.stdout:2/898: dread db/d10/d13/d24/d61/d7d/fb2 [0,4194304] 0 2024-03-19T06:06:12.878 INFO:tasks.workunit.client.0.smithi072.stdout:4/977: creat d5/d15/d31/d6d/d7a/d8e/d139/f156 x:0 0 0 2024-03-19T06:06:12.881 INFO:tasks.workunit.client.0.smithi072.stdout:7/689: creat d2/d3/d17/dc8/d1d/d3b/d9a/d9b/fdb x:0 0 0 2024-03-19T06:06:12.882 INFO:tasks.workunit.client.0.smithi072.stdout:8/860: rmdir da/d27/d52/d100 39 2024-03-19T06:06:12.884 INFO:tasks.workunit.client.0.smithi072.stdout:5/919: creat df/d13/d32/d28/d42/d59/f116 x:0 0 0 2024-03-19T06:06:12.885 INFO:tasks.workunit.client.0.smithi072.stdout:4/978: creat d5/d37/de3/f157 x:0 0 0 2024-03-19T06:06:12.886 INFO:tasks.workunit.client.0.smithi072.stdout:6/777: write d7/d9/d1b/d21/fd5 [4993243,122206] 0 2024-03-19T06:06:12.888 INFO:tasks.workunit.client.0.smithi072.stdout:7/690: dread - d2/d8c/dab/fd4 zero size 2024-03-19T06:06:12.890 INFO:tasks.workunit.client.0.smithi072.stdout:4/979: dread - d5/d15/d31/d7d/d91/f121 zero size 2024-03-19T06:06:12.891 INFO:tasks.workunit.client.0.smithi072.stdout:3/798: write d2/d3/d26/f23 [2221823,74036] 0 2024-03-19T06:06:12.892 INFO:tasks.workunit.client.0.smithi072.stdout:2/899: unlink db/d10/d12/f1b 0 2024-03-19T06:06:12.894 INFO:tasks.workunit.client.0.smithi072.stdout:4/980: chown d5/d1b/lf9 0 1 2024-03-19T06:06:12.900 INFO:tasks.workunit.client.0.smithi072.stdout:5/920: unlink df/d13/d32/d28/d42/f78 0 2024-03-19T06:06:12.902 INFO:tasks.workunit.client.0.smithi072.stdout:7/691: creat d2/d8c/fdc x:0 0 0 2024-03-19T06:06:12.903 INFO:tasks.workunit.client.0.smithi072.stdout:8/861: write da/d13/d3f/fad [28801,33964] 0 2024-03-19T06:06:12.905 INFO:tasks.workunit.client.0.smithi072.stdout:5/921: chown df/d13/d32/d28/d42/d59/d43/d62 9757 1 2024-03-19T06:06:12.907 INFO:tasks.workunit.client.0.smithi072.stdout:0/862: rename d1/d1c/d24/d3f/de2/d11b/dc4 to d1/d1c/d24/d27/d73/d80/dd2/d125 0 2024-03-19T06:06:12.908 INFO:tasks.workunit.client.0.smithi072.stdout:2/900: mknod db/d10/d2b/d2d/d12c/d6b/c138 0 2024-03-19T06:06:12.909 INFO:tasks.workunit.client.0.smithi072.stdout:4/981: truncate d5/d15/d3f/dc1/f99 9391717 0 2024-03-19T06:06:12.913 INFO:tasks.workunit.client.0.smithi072.stdout:3/799: write d2/d3/f10 [3604617,19418] 0 2024-03-19T06:06:12.914 INFO:tasks.workunit.client.0.smithi072.stdout:7/692: mkdir d2/d3/d17/dc8/d1d/d3b/d9a/d9b/dd6/ddd 0 2024-03-19T06:06:12.914 INFO:tasks.workunit.client.0.smithi072.stdout:8/862: mknod da/d27/d52/d5b/d3e/d5a/c123 0 2024-03-19T06:06:12.915 INFO:tasks.workunit.client.0.smithi072.stdout:6/778: dwrite d7/d9/d1b/d3b/d48/ff9 [4194304,4194304] 0 2024-03-19T06:06:12.918 INFO:tasks.workunit.client.0.smithi072.stdout:4/982: mknod d5/d15/c158 0 2024-03-19T06:06:12.921 INFO:tasks.workunit.client.0.smithi072.stdout:4/983: write d5/d15/d3f/d10d/f151 [403977,41897] 0 2024-03-19T06:06:12.925 INFO:tasks.workunit.client.0.smithi072.stdout:0/863: unlink d1/d1c/d24/d27/d7c/f8d 0 2024-03-19T06:06:12.927 INFO:tasks.workunit.client.0.smithi072.stdout:2/901: mknod db/d10/d2b/d2d/d9e/dab/dca/c139 0 2024-03-19T06:06:12.929 INFO:tasks.workunit.client.0.smithi072.stdout:0/864: write d1/d1c/d24/d8f/fc1 [841189,90996] 0 2024-03-19T06:06:12.930 INFO:tasks.workunit.client.0.smithi072.stdout:5/922: dwrite df/d54/dac/ff9 [0,4194304] 0 2024-03-19T06:06:12.933 INFO:tasks.workunit.client.0.smithi072.stdout:3/800: creat d2/df4/f110 x:0 0 0 2024-03-19T06:06:12.934 INFO:tasks.workunit.client.0.smithi072.stdout:2/902: dread - db/d10/d13/d31/d35/ddc/f11e zero size 2024-03-19T06:06:12.934 INFO:tasks.workunit.client.0.smithi072.stdout:6/779: dread d7/d9/d1b/d21/fd5 [0,4194304] 0 2024-03-19T06:06:12.937 INFO:tasks.workunit.client.0.smithi072.stdout:5/923: readlink df/d13/d32/d28/l4a 0 2024-03-19T06:06:12.938 INFO:tasks.workunit.client.0.smithi072.stdout:7/693: rmdir d2/d3/d18/d7f 39 2024-03-19T06:06:12.941 INFO:tasks.workunit.client.0.smithi072.stdout:7/694: chown d2/d3/d17/f69 6 1 2024-03-19T06:06:12.944 INFO:tasks.workunit.client.0.smithi072.stdout:5/924: read df/d14/d5d/fad [794587,26571] 0 2024-03-19T06:06:12.974 INFO:tasks.workunit.client.0.smithi072.stdout:8/863: mknod da/d27/c124 0 2024-03-19T06:06:12.974 INFO:tasks.workunit.client.0.smithi072.stdout:4/984: mknod d5/d37/c159 0 2024-03-19T06:06:12.974 INFO:tasks.workunit.client.0.smithi072.stdout:6/780: read - d7/d99/fb0 zero size 2024-03-19T06:06:12.974 INFO:tasks.workunit.client.0.smithi072.stdout:7/695: mknod d2/d3/d17/dc8/d1d/d3b/d63/d84/cde 0 2024-03-19T06:06:12.976 INFO:tasks.workunit.client.0.smithi072.stdout:3/801: mkdir d2/d3/d26/d92/d10c/d10e/d111 0 2024-03-19T06:06:12.978 INFO:tasks.workunit.client.0.smithi072.stdout:8/864: dread - da/d27/dc2/dc6/dd1/ffb zero size 2024-03-19T06:06:12.978 INFO:tasks.workunit.client.0.smithi072.stdout:6/781: chown d7/d9/d30/f51 2304 1 2024-03-19T06:06:12.979 INFO:tasks.workunit.client.0.smithi072.stdout:4/985: unlink d5/d15/d3f/fb8 0 2024-03-19T06:06:12.981 INFO:tasks.workunit.client.0.smithi072.stdout:3/802: truncate d2/df4/f105 170501 0 2024-03-19T06:06:12.982 INFO:tasks.workunit.client.0.smithi072.stdout:7/696: mkdir d2/d3/d17/dc8/d1d/d2b/d75/ddf 0 2024-03-19T06:06:12.982 INFO:tasks.workunit.client.0.smithi072.stdout:2/903: truncate db/d10/d13/d24/d61/d7d/f95 946856 0 2024-03-19T06:06:12.984 INFO:tasks.workunit.client.0.smithi072.stdout:3/803: read d2/fb3 [1402786,95208] 0 2024-03-19T06:06:12.984 INFO:tasks.workunit.client.0.smithi072.stdout:8/865: write da/d13/d1d/d10e/f122 [865291,47848] 0 2024-03-19T06:06:12.986 INFO:tasks.workunit.client.0.smithi072.stdout:3/804: fdatasync d2/d3/d26/fff 0 2024-03-19T06:06:12.988 INFO:tasks.workunit.client.0.smithi072.stdout:3/805: readlink d2/d19/d1e/l33 0 2024-03-19T06:06:12.988 INFO:tasks.workunit.client.0.smithi072.stdout:2/904: symlink db/d10/d13/df4/d103/ddb/l13a 0 2024-03-19T06:06:12.989 INFO:tasks.workunit.client.0.smithi072.stdout:4/986: creat d5/d11/f15a x:0 0 0 2024-03-19T06:06:12.989 INFO:tasks.workunit.client.0.smithi072.stdout:2/905: stat db/d10/d2b/d2d/d9e 0 2024-03-19T06:06:12.991 INFO:tasks.workunit.client.0.smithi072.stdout:3/806: rmdir d2/d3 39 2024-03-19T06:06:12.992 INFO:tasks.workunit.client.0.smithi072.stdout:5/925: getdents df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97 0 2024-03-19T06:06:12.993 INFO:tasks.workunit.client.0.smithi072.stdout:2/906: creat db/d10/d13/d7c/f13b x:0 0 0 2024-03-19T06:06:12.994 INFO:tasks.workunit.client.0.smithi072.stdout:4/987: creat d5/d15/d22/d95/d104/d126/f15b x:0 0 0 2024-03-19T06:06:12.994 INFO:tasks.workunit.client.0.smithi072.stdout:3/807: readlink d2/d3/d25/da5/laa 0 2024-03-19T06:06:12.997 INFO:tasks.workunit.client.0.smithi072.stdout:5/926: creat df/d13/d32/d28/dda/f117 x:0 0 0 2024-03-19T06:06:13.002 INFO:tasks.workunit.client.0.smithi072.stdout:4/988: rename d5/d37/de3/f157 to d5/d15/d31/d7d/f15c 0 2024-03-19T06:06:13.003 INFO:tasks.workunit.client.0.smithi072.stdout:7/697: dwrite d2/d8c/fdc [0,4194304] 0 2024-03-19T06:06:13.007 INFO:tasks.workunit.client.0.smithi072.stdout:8/866: dwrite da/d27/d52/d5b/d3e/d7f/fee [0,4194304] 0 2024-03-19T06:06:13.008 INFO:tasks.workunit.client.0.smithi072.stdout:5/927: symlink df/d54/df5/l118 0 2024-03-19T06:06:13.012 INFO:tasks.workunit.client.0.smithi072.stdout:4/989: creat d5/d15/d22/d41/d61/d71/d72/f15d x:0 0 0 2024-03-19T06:06:13.013 INFO:tasks.workunit.client.0.smithi072.stdout:8/867: mkdir da/d27/d52/d5b/d3e/d7d/d125 0 2024-03-19T06:06:13.015 INFO:tasks.workunit.client.0.smithi072.stdout:5/928: write df/d3c/ffd [6106,118079] 0 2024-03-19T06:06:13.018 INFO:tasks.workunit.client.0.smithi072.stdout:4/990: creat d5/d15/d31/d4c/f15e x:0 0 0 2024-03-19T06:06:13.019 INFO:tasks.workunit.client.0.smithi072.stdout:4/991: readlink d5/d15/d3f/dc1/l34 0 2024-03-19T06:06:13.020 INFO:tasks.workunit.client.0.smithi072.stdout:8/868: mknod da/d13/d14/d1b/d6b/c126 0 2024-03-19T06:06:13.022 INFO:tasks.workunit.client.0.smithi072.stdout:5/929: mknod df/d54/dac/d9c/da0/c119 0 2024-03-19T06:06:13.023 INFO:tasks.workunit.client.0.smithi072.stdout:4/992: stat d5/d15/d22/d41/d61/cc4 0 2024-03-19T06:06:13.031 INFO:tasks.workunit.client.0.smithi072.stdout:5/930: truncate df/d16/f60 5531349 0 2024-03-19T06:06:13.031 INFO:tasks.workunit.client.0.smithi072.stdout:4/993: symlink d5/d15/d22/d41/d7b/l15f 0 2024-03-19T06:06:13.034 INFO:tasks.workunit.client.0.smithi072.stdout:8/869: rename da/d13/d14/d1b/c25 to da/d27/d52/d100/d8e/dc7/c127 0 2024-03-19T06:06:13.037 INFO:tasks.workunit.client.0.smithi072.stdout:5/931: rename df/d54/dac/f86 to df/d13/d32/d28/f11a 0 2024-03-19T06:06:13.039 INFO:tasks.workunit.client.0.smithi072.stdout:8/870: creat da/d62/f128 x:0 0 0 2024-03-19T06:06:13.041 INFO:tasks.workunit.client.0.smithi072.stdout:2/907: dwrite db/d10/d2b/d2d/d66/f97 [0,4194304] 0 2024-03-19T06:06:13.042 INFO:tasks.workunit.client.0.smithi072.stdout:7/698: dread d2/d8c/dba/dbc/f4e [0,4194304] 0 2024-03-19T06:06:13.045 INFO:tasks.workunit.client.0.smithi072.stdout:5/932: creat df/d54/df5/f11b x:0 0 0 2024-03-19T06:06:13.050 INFO:tasks.workunit.client.0.smithi072.stdout:5/933: write df/fcc [1616828,46594] 0 2024-03-19T06:06:13.056 INFO:tasks.workunit.client.0.smithi072.stdout:4/994: dwrite d5/d15/d31/d6f/d9d/f113 [8388608,4194304] 0 2024-03-19T06:06:13.065 INFO:tasks.workunit.client.0.smithi072.stdout:8/871: truncate da/d37/f73 307336 0 2024-03-19T06:06:13.066 INFO:tasks.workunit.client.0.smithi072.stdout:4/995: creat d5/d15/d3f/d42/f160 x:0 0 0 2024-03-19T06:06:13.067 INFO:tasks.workunit.client.0.smithi072.stdout:5/934: write df/d16/dc4/fc7 [218737,56180] 0 2024-03-19T06:06:13.069 INFO:tasks.workunit.client.0.smithi072.stdout:4/996: fdatasync d5/d15/d31/fcb 0 2024-03-19T06:06:13.119 INFO:tasks.workunit.client.0.smithi072.stdout:9/751: sync 2024-03-19T06:06:13.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.133+0000 7f9b30400700 1 -- 172.21.15.72:0/2134464658 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b280788c0 con 0x7f9b1006de00 2024-03-19T06:06:13.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.134+0000 7f9b26000700 1 -- 172.21.15.72:0/2134464658 <== mgr.14702 v2:172.21.15.72:6800/2640845307 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f9b280788c0 con 0x7f9b1006de00 2024-03-19T06:06:13.127 INFO:tasks.workunit.client.0.smithi072.stdout:7/699: dwrite d2/d8c/dba/dbc/fd2 [0,4194304] 0 2024-03-19T06:06:13.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.137+0000 7f9b30400700 1 -- 172.21.15.72:0/2134464658 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f9b1006de00 msgr2=0x7f9b100702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:13.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.137+0000 7f9b30400700 1 --2- 172.21.15.72:0/2134464658 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f9b1006de00 0x7f9b100702b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c006010 tx=0x7f9b1c005a90 comp rx=0 tx=0).stop 2024-03-19T06:06:13.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.137+0000 7f9b30400700 1 -- 172.21.15.72:0/2134464658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b28103640 msgr2=0x7f9b2819c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:13.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.137+0000 7f9b30400700 1 --2- 172.21.15.72:0/2134464658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b28103640 0x7f9b2819c5b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400e970 tx=0x7f9b1400ec80 comp rx=0 tx=0).stop 2024-03-19T06:06:13.129 INFO:tasks.workunit.client.0.smithi072.stdout:9/752: fsync d11/f19 0 2024-03-19T06:06:13.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.138+0000 7f9b30400700 1 -- 172.21.15.72:0/2134464658 shutdown_connections 2024-03-19T06:06:13.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.138+0000 7f9b30400700 1 --2- 172.21.15.72:0/2134464658 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f9b1006de00 0x7f9b100702b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.138+0000 7f9b30400700 1 --2- 172.21.15.72:0/2134464658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b28102490 0x7f9b2819c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.138+0000 7f9b30400700 1 --2- 172.21.15.72:0/2134464658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b28103640 0x7f9b2819c5b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.138+0000 7f9b30400700 1 -- 172.21.15.72:0/2134464658 >> 172.21.15.72:0/2134464658 conn(0x7f9b280fda60 msgr2=0x7f9b280771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:13.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.138+0000 7f9b30400700 1 -- 172.21.15.72:0/2134464658 shutdown_connections 2024-03-19T06:06:13.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.138+0000 7f9b30400700 1 -- 172.21.15.72:0/2134464658 wait complete. 2024-03-19T06:06:13.131 INFO:tasks.workunit.client.0.smithi072.stdout:2/908: dwrite db/d10/d2b/dc3/fed [0,4194304] 0 2024-03-19T06:06:13.133 INFO:tasks.workunit.client.0.smithi072.stdout:2/909: chown db/d10/d2b/d45/da4/lc7 75557 1 2024-03-19T06:06:13.164 INFO:tasks.workunit.client.0.smithi072.stdout:5/935: fdatasync df/d13/f3e 0 2024-03-19T06:06:13.165 INFO:tasks.workunit.client.0.smithi072.stdout:8/872: mkdir da/d27/d52/d5b/d3e/d7d/d129 0 2024-03-19T06:06:13.171 INFO:tasks.workunit.client.0.smithi072.stdout:4/997: read d5/d1b/f2b [2363805,76194] 0 2024-03-19T06:06:13.171 INFO:tasks.workunit.client.0.smithi072.stdout:4/998: chown d5/d11/f15a 28705 1 2024-03-19T06:06:13.171 INFO:tasks.workunit.client.0.smithi072.stdout:2/910: creat db/d10/d13/d24/d72/f13c x:0 0 0 2024-03-19T06:06:13.176 INFO:tasks.workunit.client.0.smithi072.stdout:8/873: truncate da/f51 800952 0 2024-03-19T06:06:13.179 INFO:tasks.workunit.client.0.smithi072.stdout:2/911: symlink db/d10/d2b/d2d/d6a/l13d 0 2024-03-19T06:06:13.182 INFO:tasks.workunit.client.0.smithi072.stdout:8/874: symlink da/d27/d52/d5b/d3e/d7d/d97/l12a 0 2024-03-19T06:06:13.184 INFO:tasks.workunit.client.0.smithi072.stdout:4/999: rename d5/l18 to d5/d15/d22/d41/d7b/d7c/db4/dc7/l161 0 2024-03-19T06:06:13.186 INFO:tasks.workunit.client.0.smithi072.stdout:2/912: rename db/d10/d13/d24/d61/d7d/cd4 to db/c13e 0 2024-03-19T06:06:13.192 INFO:tasks.workunit.client.0.smithi072.stdout:2/913: rename db/d10/d2b/d45/da4/dd1/cfe to db/d10/d13/df4/d103/ddb/d120/c13f 0 2024-03-19T06:06:13.200 INFO:tasks.workunit.client.0.smithi072.stdout:2/914: getdents db/d10/d13/df4/d103/d82/d98/dbf/dd5 0 2024-03-19T06:06:13.202 INFO:tasks.workunit.client.0.smithi072.stdout:2/915: chown db/d10/d13/d31/c41 0 1 2024-03-19T06:06:13.204 INFO:tasks.workunit.client.0.smithi072.stdout:2/916: dread - db/d10/d2b/dc3/f10a zero size 2024-03-19T06:06:13.208 INFO:tasks.workunit.client.0.smithi072.stdout:2/917: mkdir db/d10/d13/df4/d103/dd9/d140 0 2024-03-19T06:06:13.222 INFO:tasks.workunit.client.0.smithi072.stdout:2/918: rename db/d10/d13/df4/d103/d82/d98/dbf/fc4 to db/d10/d2b/d2d/f141 0 2024-03-19T06:06:13.226 INFO:tasks.workunit.client.0.smithi072.stdout:2/919: mkdir db/d142 0 2024-03-19T06:06:13.239 INFO:tasks.workunit.client.0.smithi072.stdout:2/920: link db/d10/d2b/d2d/d9e/dab/dca/le4 db/l143 0 2024-03-19T06:06:13.247 INFO:tasks.workunit.client.0.smithi072.stdout:7/700: write d2/d8c/dba/dbc/fc7 [769561,80484] 0 2024-03-19T06:06:13.250 INFO:tasks.workunit.client.0.smithi072.stdout:5/936: write df/d54/dac/f73 [1709854,72208] 0 2024-03-19T06:06:13.259 INFO:tasks.workunit.client.0.smithi072.stdout:5/937: fsync df/d13/d32/d28/d42/d59/d43/d4e/fdd 0 2024-03-19T06:06:13.259 INFO:tasks.workunit.client.0.smithi072.stdout:9/753: dwrite d11/fbf [0,4194304] 0 2024-03-19T06:06:13.265 INFO:tasks.workunit.client.0.smithi072.stdout:5/938: creat df/d16/f11c x:0 0 0 2024-03-19T06:06:13.269 INFO:tasks.workunit.client.0.smithi072.stdout:9/754: dread d11/d24/d4c/d64/faf [0,4194304] 0 2024-03-19T06:06:13.274 INFO:tasks.workunit.client.0.smithi072.stdout:7/701: dwrite d2/d3/d17/dc8/fa6 [0,4194304] 0 2024-03-19T06:06:13.279 INFO:tasks.workunit.client.0.smithi072.stdout:1/864: sync 2024-03-19T06:06:13.281 INFO:tasks.workunit.client.0.smithi072.stdout:9/755: mknod d11/d24/ddd/d5c/c100 0 2024-03-19T06:06:13.283 INFO:tasks.workunit.client.0.smithi072.stdout:5/939: link df/d13/d24/f9e df/d54/df5/f11d 0 2024-03-19T06:06:13.283 INFO:tasks.workunit.client.0.smithi072.stdout:2/921: dwrite db/d10/d13/df4/d103/ddb/d120/f96 [0,4194304] 0 2024-03-19T06:06:13.284 INFO:tasks.workunit.client.0.smithi072.stdout:7/702: stat d2/d3/d17/dc8/d83/f9e 0 2024-03-19T06:06:13.289 INFO:tasks.workunit.client.0.smithi072.stdout:7/703: mknod d2/d8c/da9/ce0 0 2024-03-19T06:06:13.293 INFO:tasks.workunit.client.0.smithi072.stdout:9/756: creat d11/d1f/f101 x:0 0 0 2024-03-19T06:06:13.294 INFO:tasks.workunit.client.0.smithi072.stdout:5/940: mkdir df/d54/dac/d11e 0 2024-03-19T06:06:13.296 INFO:tasks.workunit.client.0.smithi072.stdout:9/757: write d11/d24/d4c/dda/d68/fb9 [1504580,130651] 0 2024-03-19T06:06:13.299 INFO:tasks.workunit.client.0.smithi072.stdout:7/704: truncate d2/d3/d17/dc8/d1d/d2b/f45 2656702 0 2024-03-19T06:06:13.300 INFO:tasks.workunit.client.0.smithi072.stdout:1/865: getdents d1/d11/d76/da7/d9e/d117/dd8/d19 0 2024-03-19T06:06:13.308 INFO:tasks.workunit.client.0.smithi072.stdout:5/941: rename df/d13/d32/d28/f37 to df/d54/dac/d9c/f11f 0 2024-03-19T06:06:13.308 INFO:tasks.workunit.client.0.smithi072.stdout:2/922: dwrite db/d10/d13/d31/d35/ddc/f125 [0,4194304] 0 2024-03-19T06:06:13.309 INFO:tasks.workunit.client.0.smithi072.stdout:9/758: symlink d11/d24/d4c/dda/d6f/d88/l102 0 2024-03-19T06:06:13.317 INFO:tasks.workunit.client.0.smithi072.stdout:5/942: symlink df/l120 0 2024-03-19T06:06:13.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.327+0000 7f8557200700 1 -- 172.21.15.72:0/3186282538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8558102280 msgr2=0x7f8558102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:13.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.327+0000 7f8557200700 1 --2- 172.21.15.72:0/3186282538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8558102280 0x7f8558102690 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f855000b0a0 tx=0x7f855000b3b0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.327+0000 7f8557200700 1 -- 172.21.15.72:0/3186282538 shutdown_connections 2024-03-19T06:06:13.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.327+0000 7f8557200700 1 --2- 172.21.15.72:0/3186282538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8558103480 0x7f85581038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.327+0000 7f8557200700 1 --2- 172.21.15.72:0/3186282538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8558102280 0x7f8558102690 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.327+0000 7f8557200700 1 -- 172.21.15.72:0/3186282538 >> 172.21.15.72:0/3186282538 conn(0x7f85580fd8d0 msgr2=0x7f85580ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:13.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.327+0000 7f8557200700 1 -- 172.21.15.72:0/3186282538 shutdown_connections 2024-03-19T06:06:13.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.327+0000 7f8557200700 1 -- 172.21.15.72:0/3186282538 wait complete. 2024-03-19T06:06:13.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.328+0000 7f8557200700 1 Processor -- start 2024-03-19T06:06:13.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.329+0000 7f8557200700 1 -- start start 2024-03-19T06:06:13.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.329+0000 7f8557200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8558102280 0x7f8558197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:13.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.329+0000 7f8557200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8558103480 0x7f8558198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:13.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.329+0000 7f8557200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8558198630 con 0x7f8558103480 2024-03-19T06:06:13.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.329+0000 7f8557200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8558198770 con 0x7f8558102280 2024-03-19T06:06:13.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.329+0000 7f8555400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8558103480 0x7f8558198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:13.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.329+0000 7f8555400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8558103480 0x7f8558198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43324/0 (socket says 172.21.15.72:43324) 2024-03-19T06:06:13.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.329+0000 7f8555400700 1 -- 172.21.15.72:0/2270368513 learned_addr learned my addr 172.21.15.72:0/2270368513 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:13.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.330+0000 7f8555e00700 1 --2- 172.21.15.72:0/2270368513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8558102280 0x7f8558197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:13.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.330+0000 7f8555400700 1 -- 172.21.15.72:0/2270368513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8558102280 msgr2=0x7f8558197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:13.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.330+0000 7f8555400700 1 --2- 172.21.15.72:0/2270368513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8558102280 0x7f8558197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.330+0000 7f8555400700 1 -- 172.21.15.72:0/2270368513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8550009d00 con 0x7f8558103480 2024-03-19T06:06:13.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.331+0000 7f8555400700 1 --2- 172.21.15.72:0/2270368513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8558103480 0x7f8558198010 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f854800e920 tx=0x7f854800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:13.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.332+0000 7f854ea00700 1 -- 172.21.15.72:0/2270368513 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8548009790 con 0x7f8558103480 2024-03-19T06:06:13.323 INFO:tasks.workunit.client.0.smithi072.stdout:2/923: mknod db/d10/d13/df4/d103/d82/d98/dbf/c144 0 2024-03-19T06:06:13.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.332+0000 7f854ea00700 1 -- 172.21.15.72:0/2270368513 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f854800cba0 con 0x7f8558103480 2024-03-19T06:06:13.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.332+0000 7f854ea00700 1 -- 172.21.15.72:0/2270368513 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8548018630 con 0x7f8558103480 2024-03-19T06:06:13.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.332+0000 7f8557200700 1 -- 172.21.15.72:0/2270368513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855819d220 con 0x7f8558103480 2024-03-19T06:06:13.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.333+0000 7f8557200700 1 -- 172.21.15.72:0/2270368513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855819d7f0 con 0x7f8558103480 2024-03-19T06:06:13.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.334+0000 7f8557200700 1 -- 172.21.15.72:0/2270368513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855810add0 con 0x7f8558103480 2024-03-19T06:06:13.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.335+0000 7f854ea00700 1 -- 172.21.15.72:0/2270368513 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7f8548010430 con 0x7f8558103480 2024-03-19T06:06:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.336+0000 7f854ea00700 1 --2- 172.21.15.72:0/2270368513 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f853c06dde0 0x7f853c070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:13.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.336+0000 7f854ea00700 1 -- 172.21.15.72:0/2270368513 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f8548014070 con 0x7f8558103480 2024-03-19T06:06:13.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.336+0000 7f8555e00700 1 --2- 172.21.15.72:0/2270368513 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f853c06dde0 0x7f853c070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:13.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.337+0000 7f8555e00700 1 --2- 172.21.15.72:0/2270368513 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f853c06dde0 0x7f853c070290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8550009fd0 tx=0x7f85500096e0 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:13.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.340+0000 7f854ea00700 1 -- 172.21.15.72:0/2270368513 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f854805ac10 con 0x7f8558103480 2024-03-19T06:06:13.422 INFO:tasks.workunit.client.0.smithi072.stdout:6/782: sync 2024-03-19T06:06:13.422 INFO:tasks.workunit.client.0.smithi072.stdout:0/865: sync 2024-03-19T06:06:13.485 INFO:tasks.workunit.client.0.smithi072.stdout:8/875: sync 2024-03-19T06:06:13.486 INFO:tasks.workunit.client.0.smithi072.stdout:3/808: sync 2024-03-19T06:06:13.486 INFO:tasks.workunit.client.0.smithi072.stdout:9/759: sync 2024-03-19T06:06:13.489 INFO:tasks.workunit.client.0.smithi072.stdout:8/876: stat da/d27/d52/d5b/d3e/d5a/d7a/f86 0 2024-03-19T06:06:13.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.568+0000 7f8557200700 1 -- 172.21.15.72:0/2270368513 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8558107dd0 con 0x7f853c06dde0 2024-03-19T06:06:13.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.590+0000 7f854ea00700 1 -- 172.21.15.72:0/2270368513 <== mgr.14702 v2:172.21.15.72:6800/2640845307 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f8558107dd0 con 0x7f853c06dde0 2024-03-19T06:06:13.582 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (10m) 50s ago 12m 14.0M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (13m) 50s ago 13m 7847k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (11m) 49s ago 11m 7704k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (12m) 50s ago 12m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (11m) 49s ago 11m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (10m) 50s ago 12m 71.8M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (5m) 50s ago 5m 14.1M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (5m) 50s ago 5m 123M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (5m) 49s ago 5m 14.1M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (5m) 49s ago 5m 114M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:06:13.583 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (83s) 50s ago 14m 475M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (2m) 49s ago 11m 72.0M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 1aabb23d2304 2024-03-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (14m) 50s ago 14m 52.9M 2048M 18.2.0 dc2bc1663786 77289e9e2b33 2024-03-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (11m) 49s ago 11m 42.1M 2048M 18.2.0 dc2bc1663786 31fba31e7d8a 2024-03-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (12m) 50s ago 12m 8208k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (11m) 49s ago 11m 7792k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (10m) 50s ago 10m 86.8M 1216M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (9m) 50s ago 9m 97.8M 1216M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (8m) 50s ago 8m 81.8M 1216M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (8m) 49s ago 8m 100M 2241M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (7m) 49s ago 7m 91.2M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:06:13.584 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (7m) 49s ago 7m 87.5M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (93s) 50s ago 11m 52.8M - 2.43.0 a07b618ecd1d 6f898c87718b 2024-03-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.593+0000 7f8557200700 1 -- 172.21.15.72:0/2270368513 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f853c06dde0 msgr2=0x7f853c070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.593+0000 7f8557200700 1 --2- 172.21.15.72:0/2270368513 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f853c06dde0 0x7f853c070290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8550009fd0 tx=0x7f85500096e0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.593+0000 7f8557200700 1 -- 172.21.15.72:0/2270368513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8558103480 msgr2=0x7f8558198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.593+0000 7f8557200700 1 --2- 172.21.15.72:0/2270368513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8558103480 0x7f8558198010 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f854800e920 tx=0x7f854800ece0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.593+0000 7f8557200700 1 -- 172.21.15.72:0/2270368513 shutdown_connections 2024-03-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.593+0000 7f8557200700 1 --2- 172.21.15.72:0/2270368513 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f853c06dde0 0x7f853c070290 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.593+0000 7f8557200700 1 --2- 172.21.15.72:0/2270368513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8558102280 0x7f8558197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.593+0000 7f8557200700 1 --2- 172.21.15.72:0/2270368513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8558103480 0x7f8558198010 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.593+0000 7f8557200700 1 -- 172.21.15.72:0/2270368513 >> 172.21.15.72:0/2270368513 conn(0x7f85580fd8d0 msgr2=0x7f85581066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.593+0000 7f8557200700 1 -- 172.21.15.72:0/2270368513 shutdown_connections 2024-03-19T06:06:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.593+0000 7f8557200700 1 -- 172.21.15.72:0/2270368513 wait complete. 2024-03-19T06:06:13.586 INFO:tasks.workunit.client.0.smithi072.stdout:5/943: mkdir df/d3c/d121 0 2024-03-19T06:06:13.588 INFO:tasks.workunit.client.0.smithi072.stdout:1/866: getdents d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/db8 0 2024-03-19T06:06:13.602 INFO:tasks.workunit.client.0.smithi072.stdout:1/867: dwrite d1/d11/d76/da7/d9e/d117/dd8/d63/d73/fec [0,4194304] 0 2024-03-19T06:06:13.607 INFO:tasks.workunit.client.0.smithi072.stdout:1/868: fdatasync d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/f11e 0 2024-03-19T06:06:13.608 INFO:tasks.workunit.client.0.smithi072.stdout:7/705: truncate d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/f78 1122022 0 2024-03-19T06:06:13.613 INFO:tasks.workunit.client.0.smithi072.stdout:3/809: fsync d2/d19/f8b 0 2024-03-19T06:06:13.624 INFO:tasks.workunit.client.0.smithi072.stdout:8/877: creat da/d27/d52/d5b/d3e/d7d/d97/f12b x:0 0 0 2024-03-19T06:06:13.638 INFO:tasks.workunit.client.0.smithi072.stdout:7/706: symlink d2/d3/d17/dc8/d83/le1 0 2024-03-19T06:06:13.652 INFO:tasks.workunit.client.0.smithi072.stdout:6/783: dwrite d7/d99/d60/ded/df4/f74 [4194304,4194304] 0 2024-03-19T06:06:13.655 INFO:tasks.workunit.client.0.smithi072.stdout:5/944: rename df/d13/d32/d28/f11a to df/d54/df5/f122 0 2024-03-19T06:06:13.657 INFO:tasks.workunit.client.0.smithi072.stdout:7/707: unlink d2/d3/d17/dc8/d1d/d2b/l34 0 2024-03-19T06:06:13.660 INFO:tasks.workunit.client.0.smithi072.stdout:6/784: truncate d7/d9/d1b/d3b/f8c 4799230 0 2024-03-19T06:06:13.664 INFO:tasks.workunit.client.0.smithi072.stdout:3/810: symlink d2/d3/d25/da5/de6/l112 0 2024-03-19T06:06:13.671 INFO:tasks.workunit.client.0.smithi072.stdout:2/924: truncate db/d10/d13/d31/d35/f43 2123008 0 2024-03-19T06:06:13.672 INFO:tasks.workunit.client.0.smithi072.stdout:8/878: mkdir da/d27/d12c 0 2024-03-19T06:06:13.674 INFO:tasks.workunit.client.0.smithi072.stdout:2/925: read db/f22 [3830740,115930] 0 2024-03-19T06:06:13.675 INFO:tasks.workunit.client.0.smithi072.stdout:0/866: getdents d1/d1c/d24/d27/d73/d80/dd2/d125 0 2024-03-19T06:06:13.678 INFO:tasks.workunit.client.0.smithi072.stdout:0/867: write d1/d1c/d82/d90/dbe/f114 [89186,54401] 0 2024-03-19T06:06:13.685 INFO:tasks.workunit.client.0.smithi072.stdout:9/760: link d11/d24/d4c/dda/d6f/d88/dc5/lf4 d11/d24/d4c/dda/d6f/d87/da4/l103 0 2024-03-19T06:06:13.685 INFO:tasks.workunit.client.0.smithi072.stdout:3/811: dread - d2/dc8/ffc zero size 2024-03-19T06:06:13.688 INFO:tasks.workunit.client.0.smithi072.stdout:2/926: creat db/d10/d2b/d45/f145 x:0 0 0 2024-03-19T06:06:13.689 INFO:tasks.workunit.client.0.smithi072.stdout:7/708: truncate d2/d3/d18/d7f/db3/f72 971460 0 2024-03-19T06:06:13.693 INFO:tasks.workunit.client.0.smithi072.stdout:1/869: dwrite d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/fac [0,4194304] 0 2024-03-19T06:06:13.695 INFO:tasks.workunit.client.0.smithi072.stdout:9/761: dread - d11/d24/d4c/dda/d36/d45/fc4 zero size 2024-03-19T06:06:13.695 INFO:tasks.workunit.client.0.smithi072.stdout:8/879: link da/d27/dc2/dc6/dd1/f117 da/d3b/da7/d105/f12d 0 2024-03-19T06:06:13.698 INFO:tasks.workunit.client.0.smithi072.stdout:2/927: read db/d10/d13/d31/d35/ddc/f125 [2761955,55967] 0 2024-03-19T06:06:13.700 INFO:tasks.workunit.client.0.smithi072.stdout:8/880: chown da/d13/d3f/db9/dc1/l108 2887638 1 2024-03-19T06:06:13.703 INFO:tasks.workunit.client.0.smithi072.stdout:6/785: dwrite d7/d9/d1b/f2a [0,4194304] 0 2024-03-19T06:06:13.706 INFO:tasks.workunit.client.0.smithi072.stdout:1/870: stat d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/dc0/fed 0 2024-03-19T06:06:13.708 INFO:tasks.workunit.client.0.smithi072.stdout:2/928: mknod db/c146 0 2024-03-19T06:06:13.708 INFO:tasks.workunit.client.0.smithi072.stdout:1/871: chown d1/d11/d6d/c119 499898298 1 2024-03-19T06:06:13.712 INFO:tasks.workunit.client.0.smithi072.stdout:9/762: creat d11/d24/d4c/dda/d68/d92/d93/f104 x:0 0 0 2024-03-19T06:06:13.715 INFO:tasks.workunit.client.0.smithi072.stdout:1/872: read - d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/dc0/dda/ffe zero size 2024-03-19T06:06:13.715 INFO:tasks.workunit.client.0.smithi072.stdout:8/881: dread da/d27/f39 [0,4194304] 0 2024-03-19T06:06:13.724 INFO:tasks.workunit.client.0.smithi072.stdout:3/812: link d2/d3/d15/c82 d2/d3/d26/d92/d10c/c113 0 2024-03-19T06:06:13.732 INFO:tasks.workunit.client.0.smithi072.stdout:9/763: dwrite d11/d24/d4c/dda/d36/d45/f84 [0,4194304] 0 2024-03-19T06:06:13.735 INFO:tasks.workunit.client.0.smithi072.stdout:5/945: write df/d13/d32/d28/d42/d59/d43/d4e/fdd [514808,11763] 0 2024-03-19T06:06:13.739 INFO:tasks.workunit.client.0.smithi072.stdout:8/882: dwrite da/d3b/f9b [0,4194304] 0 2024-03-19T06:06:13.742 INFO:tasks.workunit.client.0.smithi072.stdout:2/929: mkdir db/d10/d13/d24/d72/d86/dcd/d147 0 2024-03-19T06:06:13.742 INFO:tasks.workunit.client.0.smithi072.stdout:8/883: write da/d27/d52/ff4 [4567738,77016] 0 2024-03-19T06:06:13.745 INFO:tasks.workunit.client.0.smithi072.stdout:8/884: chown da/d13/d14/d1b/f9c 59117952 1 2024-03-19T06:06:13.754 INFO:tasks.workunit.client.0.smithi072.stdout:9/764: rename d11/d24/d4c/dda/d36/d45/d4d/le8 to d11/d24/d4c/dda/d6f/d87/l105 0 2024-03-19T06:06:13.766 INFO:tasks.workunit.client.0.smithi072.stdout:5/946: symlink df/d13/l123 0 2024-03-19T06:06:13.769 INFO:tasks.workunit.client.0.smithi072.stdout:9/765: symlink d11/d24/ddd/d5c/l106 0 2024-03-19T06:06:13.770 INFO:tasks.workunit.client.0.smithi072.stdout:9/766: readlink d11/d24/ddd/l61 0 2024-03-19T06:06:13.772 INFO:tasks.workunit.client.0.smithi072.stdout:0/868: dwrite d1/d1c/d24/d27/d73/f7a [0,4194304] 0 2024-03-19T06:06:13.772 INFO:tasks.workunit.client.0.smithi072.stdout:5/947: dread - df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/d97/f106 zero size 2024-03-19T06:06:13.778 INFO:tasks.workunit.client.0.smithi072.stdout:0/869: write d1/d1c/d24/d27/d7c/daa/ff1 [55217,66658] 0 2024-03-19T06:06:13.782 INFO:tasks.workunit.client.0.smithi072.stdout:1/873: getdents d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/def 0 2024-03-19T06:06:13.790 INFO:tasks.workunit.client.0.smithi072.stdout:5/948: creat df/d13/d32/d28/dda/f124 x:0 0 0 2024-03-19T06:06:13.794 INFO:tasks.workunit.client.0.smithi072.stdout:7/709: dwrite d2/d3/d17/faf [0,4194304] 0 2024-03-19T06:06:13.794 INFO:tasks.workunit.client.0.smithi072.stdout:0/870: unlink d1/d1c/d24/d27/d73/d80/d8b/fab 0 2024-03-19T06:06:13.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.805+0000 7f2c74800700 1 -- 172.21.15.72:0/4061349606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c071a00 msgr2=0x7f2c6c071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:13.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.805+0000 7f2c74800700 1 --2- 172.21.15.72:0/4061349606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c071a00 0x7f2c6c071e10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009910 tx=0x7f2c58009c20 comp rx=0 tx=0).stop 2024-03-19T06:06:13.797 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:13 smithi072 ceph-mon[28706]: pgmap v33: 65 pgs: 65 active+clean; 2.5 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 46 MiB/s rd, 115 MiB/s wr, 289 op/s 2024-03-19T06:06:13.797 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:13 smithi072 ceph-mon[28706]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:13.798 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:13 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:06:13.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.806+0000 7f2c74800700 1 -- 172.21.15.72:0/4061349606 shutdown_connections 2024-03-19T06:06:13.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.806+0000 7f2c74800700 1 --2- 172.21.15.72:0/4061349606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c6c0723e0 0x7f2c6c10be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.806+0000 7f2c74800700 1 --2- 172.21.15.72:0/4061349606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c071a00 0x7f2c6c071e10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.806+0000 7f2c74800700 1 -- 172.21.15.72:0/4061349606 >> 172.21.15.72:0/4061349606 conn(0x7f2c6c06d110 msgr2=0x7f2c6c06f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:13.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.807+0000 7f2c74800700 1 -- 172.21.15.72:0/4061349606 shutdown_connections 2024-03-19T06:06:13.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.807+0000 7f2c74800700 1 -- 172.21.15.72:0/4061349606 wait complete. 2024-03-19T06:06:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.808+0000 7f2c74800700 1 Processor -- start 2024-03-19T06:06:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.808+0000 7f2c74800700 1 -- start start 2024-03-19T06:06:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.809+0000 7f2c74800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c6c071a00 0x7f2c6c1a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.809+0000 7f2c74800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c0723e0 0x7f2c6c1a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:13.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.809+0000 7f2c74800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c1a53d0 con 0x7f2c6c0723e0 2024-03-19T06:06:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.809+0000 7f2c74800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c1a5510 con 0x7f2c6c071a00 2024-03-19T06:06:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.809+0000 7f2c71e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c6c071a00 0x7f2c6c1a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.809+0000 7f2c71e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c6c071a00 0x7f2c6c1a4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:47046/0 (socket says 172.21.15.72:47046) 2024-03-19T06:06:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.809+0000 7f2c71400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c0723e0 0x7f2c6c1a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.809+0000 7f2c71e00700 1 -- 172.21.15.72:0/1918094412 learned_addr learned my addr 172.21.15.72:0/1918094412 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:13.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.810+0000 7f2c71e00700 1 -- 172.21.15.72:0/1918094412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c0723e0 msgr2=0x7f2c6c1a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.810+0000 7f2c71e00700 1 --2- 172.21.15.72:0/1918094412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c0723e0 0x7f2c6c1a4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.810+0000 7f2c71e00700 1 -- 172.21.15.72:0/1918094412 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c580095f0 con 0x7f2c6c071a00 2024-03-19T06:06:13.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.810+0000 7f2c71400700 1 --2- 172.21.15.72:0/1918094412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c0723e0 0x7f2c6c1a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:06:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.810+0000 7f2c71e00700 1 --2- 172.21.15.72:0/1918094412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c6c071a00 0x7f2c6c1a4870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2c580092e0 tx=0x7f2c5800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.811+0000 7f2c66a00700 1 -- 172.21.15.72:0/1918094412 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c5801d070 con 0x7f2c6c071a00 2024-03-19T06:06:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.811+0000 7f2c74800700 1 -- 172.21.15.72:0/1918094412 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c1a9f60 con 0x7f2c6c071a00 2024-03-19T06:06:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.811+0000 7f2c66a00700 1 -- 172.21.15.72:0/1918094412 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2c58005dc0 con 0x7f2c6c071a00 2024-03-19T06:06:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.811+0000 7f2c66a00700 1 -- 172.21.15.72:0/1918094412 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c58021410 con 0x7f2c6c071a00 2024-03-19T06:06:13.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.811+0000 7f2c74800700 1 -- 172.21.15.72:0/1918094412 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c1aa3d0 con 0x7f2c6c071a00 2024-03-19T06:06:13.803 INFO:tasks.workunit.client.0.smithi072.stdout:1/874: mkdir d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/dc7/d128 0 2024-03-19T06:06:13.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.813+0000 7f2c74800700 1 -- 172.21.15.72:0/1918094412 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c19ea80 con 0x7f2c6c071a00 2024-03-19T06:06:13.812 INFO:tasks.workunit.client.0.smithi072.stdout:0/871: creat d1/d1c/d82/d90/de0/f126 x:0 0 0 2024-03-19T06:06:13.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.821+0000 7f2c66a00700 1 -- 172.21.15.72:0/1918094412 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7f2c5800f460 con 0x7f2c6c071a00 2024-03-19T06:06:13.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.823+0000 7f2c66a00700 1 --2- 172.21.15.72:0/1918094412 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f2c5406dd50 0x7f2c54070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:13.815 INFO:tasks.workunit.client.0.smithi072.stdout:0/872: chown d1/d1c/d24/d27/cec 283962 1 2024-03-19T06:06:13.815 INFO:tasks.workunit.client.0.smithi072.stdout:5/949: unlink df/d54/l7f 0 2024-03-19T06:06:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.823+0000 7f2c66a00700 1 -- 172.21.15.72:0/1918094412 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2c5808f320 con 0x7f2c6c071a00 2024-03-19T06:06:13.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.824+0000 7f2c71400700 1 --2- 172.21.15.72:0/1918094412 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f2c5406dd50 0x7f2c54070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:13.816 INFO:tasks.workunit.client.0.smithi072.stdout:5/950: stat df/d13/f6b 0 2024-03-19T06:06:13.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.827+0000 7f2c71400700 1 --2- 172.21.15.72:0/1918094412 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f2c5406dd50 0x7f2c54070200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2c60007fd0 tx=0x7f2c600073d0 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:13.828+0000 7f2c66a00700 1 -- 172.21.15.72:0/1918094412 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f2c5805c5b0 con 0x7f2c6c071a00 2024-03-19T06:06:13.823 INFO:tasks.workunit.client.0.smithi072.stdout:0/873: rmdir d1/d1c/d24/d27/d7c 39 2024-03-19T06:06:13.824 INFO:tasks.workunit.client.0.smithi072.stdout:0/874: chown d1/d2c/da1/d85 16212825 1 2024-03-19T06:06:13.825 INFO:tasks.workunit.client.0.smithi072.stdout:7/710: link d2/d3/d18/d7f/f97 d2/d3/d18/d7f/db3/fe2 0 2024-03-19T06:06:13.826 INFO:tasks.workunit.client.0.smithi072.stdout:0/875: chown d1/d1c/c38 7 1 2024-03-19T06:06:13.831 INFO:tasks.workunit.client.0.smithi072.stdout:3/813: write d2/d3/d26/d98/fdb [11357,124203] 0 2024-03-19T06:06:13.843 INFO:tasks.workunit.client.0.smithi072.stdout:6/786: truncate d7/d9/d1b/f37 139111 0 2024-03-19T06:06:13.847 INFO:tasks.workunit.client.0.smithi072.stdout:0/876: read d1/d1c/d24/f97 [984820,119316] 0 2024-03-19T06:06:13.847 INFO:tasks.workunit.client.0.smithi072.stdout:6/787: write d7/d9/d2b/f49 [3084664,108676] 0 2024-03-19T06:06:13.849 INFO:tasks.workunit.client.0.smithi072.stdout:8/885: write da/d37/f93 [2846303,942] 0 2024-03-19T06:06:13.851 INFO:tasks.workunit.client.0.smithi072.stdout:3/814: symlink d2/d3/d15/d66/d70/l114 0 2024-03-19T06:06:13.852 INFO:tasks.workunit.client.0.smithi072.stdout:9/767: write d11/d24/d4c/dda/d36/d45/d5b/f2c [399246,30703] 0 2024-03-19T06:06:13.854 INFO:tasks.workunit.client.0.smithi072.stdout:1/875: truncate d1/d11/d76/da7/d9e/fc1 3761048 0 2024-03-19T06:06:13.857 INFO:tasks.workunit.client.0.smithi072.stdout:3/815: chown d2/d19/db0/dcb/df8/ffd 9759966 1 2024-03-19T06:06:13.857 INFO:tasks.workunit.client.0.smithi072.stdout:7/711: mknod d2/d3/d17/ce3 0 2024-03-19T06:06:13.866 INFO:tasks.workunit.client.0.smithi072.stdout:0/877: rmdir d1/d1c/d82/d90/de0 39 2024-03-19T06:06:13.874 INFO:tasks.workunit.client.0.smithi072.stdout:5/951: rename df/d13/d32/d28/d42/ld7 to df/d13/d32/d28/d42/d59/d43/d4e/d5c/d85/l125 0 2024-03-19T06:06:13.875 INFO:tasks.workunit.client.0.smithi072.stdout:6/788: dwrite d7/d9/d1b/f2a [0,4194304] 0 2024-03-19T06:06:13.877 INFO:tasks.workunit.client.0.smithi072.stdout:6/789: chown d7/d9/d1b/d21/fd5 24448604 1 2024-03-19T06:06:13.879 INFO:tasks.workunit.client.0.smithi072.stdout:1/876: creat d1/d11/d76/da7/d9e/d117/dd8/d63/df2/f129 x:0 0 0 2024-03-19T06:06:13.888 INFO:tasks.workunit.client.0.smithi072.stdout:8/886: getdents da/d27/d52/d5b/d3e/d5a/df1 0 2024-03-19T06:06:13.893 INFO:tasks.workunit.client.0.smithi072.stdout:9/768: dwrite d11/f12 [4194304,4194304] 0 2024-03-19T06:06:13.900 INFO:tasks.workunit.client.0.smithi072.stdout:1/877: mknod d1/d11/d76/da7/d9e/d117/dd8/d19/c12a 0 2024-03-19T06:06:13.901 INFO:tasks.workunit.client.0.smithi072.stdout:8/887: mkdir da/d27/d52/d100/d12e 0 2024-03-19T06:06:13.901 INFO:tasks.workunit.client.0.smithi072.stdout:3/816: link d2/f5 d2/d19/db0/f115 0 2024-03-19T06:06:13.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:13 smithi172 ceph-mon[35716]: pgmap v33: 65 pgs: 65 active+clean; 2.5 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 46 MiB/s rd, 115 MiB/s wr, 289 op/s 2024-03-19T06:06:13.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:13 smithi172 ceph-mon[35716]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:13.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:06:13.904 INFO:tasks.workunit.client.0.smithi072.stdout:8/888: dread - da/f102 zero size 2024-03-19T06:06:13.907 INFO:tasks.workunit.client.0.smithi072.stdout:0/878: dwrite d1/d1c/d24/d27/d7c/daa/fae [0,4194304] 0 2024-03-19T06:06:13.914 INFO:tasks.workunit.client.0.smithi072.stdout:8/889: mkdir da/d27/d30/d12f 0 2024-03-19T06:06:13.917 INFO:tasks.workunit.client.0.smithi072.stdout:9/769: unlink d11/d24/d4c/dda/d6f/d88/dc5/cfd 0 2024-03-19T06:06:13.923 INFO:tasks.workunit.client.0.smithi072.stdout:6/790: rename d7/d9/d1b/d31/d96/ffc to d7/d9/d1b/d21/f106 0 2024-03-19T06:06:13.924 INFO:tasks.workunit.client.0.smithi072.stdout:5/952: dwrite df/d13/d32/d28/f81 [0,4194304] 0 2024-03-19T06:06:13.931 INFO:tasks.workunit.client.0.smithi072.stdout:0/879: write d1/d1c/d82/d90/fa4 [470547,26589] 0 2024-03-19T06:06:13.932 INFO:tasks.workunit.client.0.smithi072.stdout:9/770: dread d11/d24/ddd/f52 [0,4194304] 0 2024-03-19T06:06:13.933 INFO:tasks.workunit.client.0.smithi072.stdout:0/880: stat d1/d1c/d24/d27/d7e/ff2 0 2024-03-19T06:06:13.935 INFO:tasks.workunit.client.0.smithi072.stdout:8/890: rmdir da/d37/d69 0 2024-03-19T06:06:13.938 INFO:tasks.workunit.client.0.smithi072.stdout:5/953: truncate df/d14/fa4 5292 0 2024-03-19T06:06:13.944 INFO:tasks.workunit.client.0.smithi072.stdout:9/771: rename d11/d24/d4c/d64/cd6 to d11/d24/d4c/d64/c107 0 2024-03-19T06:06:13.946 INFO:tasks.workunit.client.0.smithi072.stdout:8/891: creat da/d13/d14/d1b/d57/dd7/f130 x:0 0 0 2024-03-19T06:06:13.948 INFO:tasks.workunit.client.0.smithi072.stdout:6/791: write d7/d9/d1b/f8b [1016829,95050] 0 2024-03-19T06:06:13.953 INFO:tasks.workunit.client.0.smithi072.stdout:9/772: creat d11/d24/d4c/dda/d68/d92/dc0/f108 x:0 0 0 2024-03-19T06:06:13.953 INFO:tasks.workunit.client.0.smithi072.stdout:0/881: write d1/d2c/fd9 [865441,95288] 0 2024-03-19T06:06:13.955 INFO:tasks.workunit.client.0.smithi072.stdout:5/954: chown df/d13/d32/d28/d42/d59/d43/d62/f8d 6260 1 2024-03-19T06:06:13.956 INFO:tasks.workunit.client.0.smithi072.stdout:6/792: dread - d7/d99/fad zero size 2024-03-19T06:06:13.956 INFO:tasks.workunit.client.0.smithi072.stdout:3/817: dread d2/d3/d26/f35 [0,4194304] 0 2024-03-19T06:06:13.958 INFO:tasks.workunit.client.0.smithi072.stdout:0/882: fsync d1/fb1 0 2024-03-19T06:06:13.958 INFO:tasks.workunit.client.0.smithi072.stdout:8/892: rmdir da/d13/d14/d1b/d57/dd7 39 2024-03-19T06:06:13.960 INFO:tasks.workunit.client.0.smithi072.stdout:0/883: readlink d1/d1c/d24/d27/d73/l11d 0 2024-03-19T06:06:13.960 INFO:tasks.workunit.client.0.smithi072.stdout:8/893: write da/d13/d3f/fad [4343,101172] 0 2024-03-19T06:06:13.961 INFO:tasks.workunit.client.0.smithi072.stdout:9/773: symlink d11/d24/d4c/d64/l109 0 2024-03-19T06:06:13.980 INFO:tasks.workunit.client.0.smithi072.stdout:6/793: symlink d7/d9/d1b/d31/da6/l107 0 2024-03-19T06:06:13.985 INFO:tasks.workunit.client.0.smithi072.stdout:9/774: mknod d11/d24/d4c/dda/d6f/dac/c10a 0 2024-03-19T06:06:13.986 INFO:tasks.workunit.client.0.smithi072.stdout:3/818: getdents d2/d19/d1e 0 2024-03-19T06:06:13.990 INFO:tasks.workunit.client.0.smithi072.stdout:0/884: getdents d1/d1c/d24 0 2024-03-19T06:06:13.991 INFO:tasks.workunit.client.0.smithi072.stdout:5/955: dwrite df/d13/dff/f100 [0,4194304] 0 2024-03-19T06:06:13.991 INFO:tasks.workunit.client.0.smithi072.stdout:3/819: chown d2/d3/d15/d66/d6b/l7e 1055794686 1 2024-03-19T06:06:13.994 INFO:tasks.workunit.client.0.smithi072.stdout:9/775: creat d11/d24/d4c/dda/d68/d92/d93/f10b x:0 0 0 2024-03-19T06:06:14.000 INFO:tasks.workunit.client.0.smithi072.stdout:5/956: mkdir df/d13/d32/d126 0 2024-03-19T06:06:14.000 INFO:tasks.workunit.client.0.smithi072.stdout:8/894: dwrite da/d13/d1d/f2b [0,4194304] 0 2024-03-19T06:06:14.000 INFO:tasks.workunit.client.0.smithi072.stdout:9/776: write d11/d24/d4c/dda/d6f/d88/fe2 [320748,118772] 0 2024-03-19T06:06:14.003 INFO:tasks.workunit.client.0.smithi072.stdout:8/895: fsync da/d62/f128 0 2024-03-19T06:06:14.005 INFO:tasks.workunit.client.0.smithi072.stdout:3/820: truncate d2/d3/fb 1310784 0 2024-03-19T06:06:14.009 INFO:tasks.workunit.client.0.smithi072.stdout:0/885: link d1/de7/ff5 d1/d1c/d24/d27/d73/dbb/f127 0 2024-03-19T06:06:14.011 INFO:tasks.workunit.client.0.smithi072.stdout:0/886: stat d1/d1c/d82/d90 0 2024-03-19T06:06:14.013 INFO:tasks.workunit.client.0.smithi072.stdout:3/821: dread - d2/d3/d15/d66/fdc zero size 2024-03-19T06:06:14.015 INFO:tasks.workunit.client.0.smithi072.stdout:9/777: rename d11/d24/d4c/dda/d36/d45/dcb/fdc to d11/d24/d4c/dda/d68/d92/dc0/f10c 0 2024-03-19T06:06:14.016 INFO:tasks.workunit.client.0.smithi072.stdout:0/887: chown d1/d1c/d82/ddd/f10b 330734 1 2024-03-19T06:06:14.021 INFO:tasks.workunit.client.0.smithi072.stdout:0/888: stat d1/d1c/d24/d27/d73/dbb/f127 0 2024-03-19T06:06:14.021 INFO:tasks.workunit.client.0.smithi072.stdout:6/794: dwrite d7/d9/d1b/fce [0,4194304] 0 2024-03-19T06:06:14.025 INFO:tasks.workunit.client.0.smithi072.stdout:9/778: truncate d11/d24/f30 3279075 0 2024-03-19T06:06:14.032 INFO:tasks.workunit.client.0.smithi072.stdout:6/795: rename d7/d9/d30/fdb to d7/d9/d1b/d31/d96/f108 0 2024-03-19T06:06:14.032 INFO:tasks.workunit.client.0.smithi072.stdout:0/889: creat d1/de7/f128 x:0 0 0 2024-03-19T06:06:14.038 INFO:tasks.workunit.client.0.smithi072.stdout:6/796: creat d7/d99/d60/ded/f109 x:0 0 0 2024-03-19T06:06:14.046 INFO:tasks.workunit.client.0.smithi072.stdout:8/896: write da/d13/d14/f7b [1986480,53202] 0 2024-03-19T06:06:14.051 INFO:tasks.workunit.client.0.smithi072.stdout:0/890: dwrite d1/d1c/d82/de4/fc0 [0,4194304] 0 2024-03-19T06:06:14.055 INFO:tasks.workunit.client.0.smithi072.stdout:8/897: getdents da/d62 0 2024-03-19T06:06:14.058 INFO:tasks.workunit.client.0.smithi072.stdout:8/898: readlink da/d27/d52/d5b/d3e/d7d/d97/l42 0 2024-03-19T06:06:14.059 INFO:tasks.workunit.client.0.smithi072.stdout:6/797: dwrite d7/d9/d2b/f6a [0,4194304] 0 2024-03-19T06:06:14.060 INFO:tasks.workunit.client.0.smithi072.stdout:0/891: rename d1/d1c/d24/d27/d73/d80/dd2 to d1/d1c/d82/de4/da6/d129 0 2024-03-19T06:06:14.061 INFO:tasks.workunit.client.0.smithi072.stdout:0/892: stat d1/d2c/l50 0 2024-03-19T06:06:14.066 INFO:tasks.workunit.client.0.smithi072.stdout:6/798: stat d7/d9/d1b/f37 0 2024-03-19T06:06:14.068 INFO:tasks.workunit.client.0.smithi072.stdout:6/799: chown d7/d99/d60/ded/df4 12248 1 2024-03-19T06:06:14.068 INFO:tasks.workunit.client.0.smithi072.stdout:0/893: fsync d1/de7/f128 0 2024-03-19T06:06:14.071 INFO:tasks.workunit.client.0.smithi072.stdout:9/779: write d11/d1f/f66 [4350097,33209] 0 2024-03-19T06:06:14.075 INFO:tasks.workunit.client.0.smithi072.stdout:9/780: write d11/f12 [3660801,118297] 0 2024-03-19T06:06:14.075 INFO:tasks.workunit.client.0.smithi072.stdout:3/822: dwrite d2/d3/d26/d98/fb9 [0,4194304] 0 2024-03-19T06:06:14.080 INFO:tasks.workunit.client.0.smithi072.stdout:3/823: write d2/f60 [4639963,90519] 0 2024-03-19T06:06:14.081 INFO:tasks.workunit.client.0.smithi072.stdout:0/894: creat d1/d2c/f12a x:0 0 0 2024-03-19T06:06:14.081 INFO:tasks.workunit.client.0.smithi072.stdout:6/800: fdatasync d7/d3f/d65/f89 0 2024-03-19T06:06:14.090 INFO:tasks.workunit.client.0.smithi072.stdout:9/781: creat d11/d24/d4c/d64/f10d x:0 0 0 2024-03-19T06:06:14.090 INFO:tasks.workunit.client.0.smithi072.stdout:8/899: dwrite da/d27/dc2/dc6/dd1/ffd [0,4194304] 0 2024-03-19T06:06:14.090 INFO:tasks.workunit.client.0.smithi072.stdout:3/824: read - d2/d3/d15/d66/d70/fab zero size 2024-03-19T06:06:14.095 INFO:tasks.workunit.client.0.smithi072.stdout:6/801: unlink d7/d9/d1b/d31/f82 0 2024-03-19T06:06:14.096 INFO:tasks.workunit.client.0.smithi072.stdout:8/900: dread - da/d37/dd3/ff5 zero size 2024-03-19T06:06:14.096 INFO:tasks.workunit.client.0.smithi072.stdout:3/825: stat d2/d3/d26/c7f 0 2024-03-19T06:06:14.098 INFO:tasks.workunit.client.0.smithi072.stdout:6/802: chown d7/cb 1244 1 2024-03-19T06:06:14.099 INFO:tasks.workunit.client.0.smithi072.stdout:3/826: write d2/d3/d26/d92/feb [1297987,26635] 0 2024-03-19T06:06:14.100 INFO:tasks.workunit.client.0.smithi072.stdout:0/895: getdents d1/d1c/d82/de4/da6/d129 0 2024-03-19T06:06:14.102 INFO:tasks.workunit.client.0.smithi072.stdout:9/782: creat d11/d1f/f10e x:0 0 0 2024-03-19T06:06:14.105 INFO:tasks.workunit.client.0.smithi072.stdout:6/803: rename d7/d9/d30/ff8 to d7/d9/d30/f10a 0 2024-03-19T06:06:14.108 INFO:tasks.workunit.client.0.smithi072.stdout:3/827: mkdir d2/d3/d15/d66/d116 0 2024-03-19T06:06:14.109 INFO:tasks.workunit.client.0.smithi072.stdout:6/804: read d7/f1d [2282131,68916] 0 2024-03-19T06:06:14.110 INFO:tasks.workunit.client.0.smithi072.stdout:3/828: readlink d2/d3/d15/l54 0 2024-03-19T06:06:14.113 INFO:tasks.workunit.client.0.smithi072.stdout:3/829: dread - d2/dc8/fee zero size 2024-03-19T06:06:14.124 INFO:tasks.workunit.client.0.smithi072.stdout:8/901: dwrite f4 [4194304,4194304] 0 2024-03-19T06:06:14.134 INFO:tasks.workunit.client.0.smithi072.stdout:3/830: write d2/d3/d15/d66/d70/fab [986923,118533] 0 2024-03-19T06:06:14.141 INFO:tasks.workunit.client.0.smithi072.stdout:0/896: dwrite d1/d1c/d24/d8f/fd4 [0,4194304] 0 2024-03-19T06:06:14.142 INFO:tasks.workunit.client.0.smithi072.stdout:8/902: fdatasync da/d27/dc2/ff0 0 2024-03-19T06:06:14.144 INFO:tasks.workunit.client.0.smithi072.stdout:3/831: mknod d2/d3/d15/d66/d70/c117 0 2024-03-19T06:06:14.148 INFO:tasks.workunit.client.0.smithi072.stdout:0/897: unlink d1/d1c/d24/d27/d7c/d6a/fe5 0 2024-03-19T06:06:14.151 INFO:tasks.workunit.client.0.smithi072.stdout:8/903: rename da/d27/c55 to da/d13/d1d/d10e/c131 0 2024-03-19T06:06:14.153 INFO:tasks.workunit.client.0.smithi072.stdout:9/783: dread d11/d24/d4c/dda/d36/d45/f4a [0,4194304] 0 2024-03-19T06:06:14.166 INFO:tasks.workunit.client.0.smithi072.stdout:6/805: dread d7/f11 [0,4194304] 0 2024-03-19T06:06:14.170 INFO:tasks.workunit.client.0.smithi072.stdout:3/832: write d2/d3/d26/d98/ff7 [860116,87768] 0 2024-03-19T06:06:14.170 INFO:tasks.workunit.client.0.smithi072.stdout:8/904: write da/f2a [2159149,43223] 0 2024-03-19T06:06:14.175 INFO:tasks.workunit.client.0.smithi072.stdout:0/898: truncate d1/d1c/d24/d27/d7c/d6a/f91 1339248 0 2024-03-19T06:06:14.175 INFO:tasks.workunit.client.0.smithi072.stdout:9/784: write d11/d24/d4c/dda/d6f/dac/fb4 [4760712,65358] 0 2024-03-19T06:06:14.175 INFO:tasks.workunit.client.0.smithi072.stdout:8/905: chown da/d27/d52/dbd 27471 1 2024-03-19T06:06:14.177 INFO:tasks.workunit.client.0.smithi072.stdout:0/899: symlink d1/d1c/d82/de4/l12b 0 2024-03-19T06:06:14.181 INFO:tasks.workunit.client.0.smithi072.stdout:8/906: mknod da/d13/d1d/c132 0 2024-03-19T06:06:14.185 INFO:tasks.workunit.client.0.smithi072.stdout:9/785: write d11/d1f/f27 [3227629,92702] 0 2024-03-19T06:06:14.192 INFO:tasks.workunit.client.0.smithi072.stdout:6/806: dwrite d7/d9/d1b/d21/f24 [0,4194304] 0 2024-03-19T06:06:14.192 INFO:tasks.workunit.client.0.smithi072.stdout:0/900: dread d1/d2c/fd9 [0,4194304] 0 2024-03-19T06:06:14.194 INFO:tasks.workunit.client.0.smithi072.stdout:2/930: sync 2024-03-19T06:06:14.202 INFO:tasks.workunit.client.0.smithi072.stdout:0/901: dread - d1/d1c/d82/d90/de0/fee zero size 2024-03-19T06:06:14.207 INFO:tasks.workunit.client.0.smithi072.stdout:9/786: link d11/d24/d4c/dda/d68/d79/cd3 d11/d1f/c10f 0 2024-03-19T06:06:14.208 INFO:tasks.workunit.client.0.smithi072.stdout:3/833: dread d2/d40/d78/f9a [4194304,4194304] 0 2024-03-19T06:06:14.210 INFO:tasks.workunit.client.0.smithi072.stdout:2/931: getdents db/d10/d13/df4/d103 0 2024-03-19T06:06:14.214 INFO:tasks.workunit.client.0.smithi072.stdout:0/902: rename d1/d2c/f52 to d1/d2c/da1/d85/d112/f12c 0 2024-03-19T06:06:14.216 INFO:tasks.workunit.client.0.smithi072.stdout:6/807: dwrite d7/d9/d1b/d3b/f95 [0,4194304] 0 2024-03-19T06:06:14.218 INFO:tasks.workunit.client.0.smithi072.stdout:3/834: fsync d2/d19/d1e/f32 0 2024-03-19T06:06:14.219 INFO:tasks.workunit.client.0.smithi072.stdout:2/932: creat db/d10/d13/df4/d103/f148 x:0 0 0 2024-03-19T06:06:14.220 INFO:tasks.workunit.client.0.smithi072.stdout:8/907: dwrite da/d27/fb2 [0,4194304] 0 2024-03-19T06:06:14.231 INFO:tasks.workunit.client.0.smithi072.stdout:0/903: rename d1/d1c/d24/d27/fbd to d1/d2c/da1/d85/f12d 0 2024-03-19T06:06:14.233 INFO:tasks.workunit.client.0.smithi072.stdout:6/808: getdents d7 0 2024-03-19T06:06:14.235 INFO:tasks.workunit.client.0.smithi072.stdout:3/835: creat d2/d40/d78/d9b/f118 x:0 0 0 2024-03-19T06:06:14.236 INFO:tasks.workunit.client.0.smithi072.stdout:8/908: mknod da/d13/d14/d1b/d57/dc5/c133 0 2024-03-19T06:06:14.236 INFO:tasks.workunit.client.0.smithi072.stdout:3/836: chown d2/df4 48 1 2024-03-19T06:06:14.237 INFO:tasks.workunit.client.0.smithi072.stdout:0/904: symlink d1/d1c/d82/de4/da6/d129/l12e 0 2024-03-19T06:06:14.239 INFO:tasks.workunit.client.0.smithi072.stdout:6/809: mknod d7/d99/c10b 0 2024-03-19T06:06:14.243 INFO:tasks.workunit.client.0.smithi072.stdout:6/810: write d7/d9/d30/fe3 [479464,90657] 0 2024-03-19T06:06:14.244 INFO:tasks.workunit.client.0.smithi072.stdout:8/909: fsync da/d27/d52/d5b/d3e/d7d/d97/f46 0 2024-03-19T06:06:14.247 INFO:tasks.workunit.client.0.smithi072.stdout:3/837: rename d2/c4e to d2/d19/db0/dcb/df8/c119 0 2024-03-19T06:06:14.249 INFO:tasks.workunit.client.0.smithi072.stdout:8/910: readlink da/d13/d3f/db9/dc1/l108 0 2024-03-19T06:06:14.250 INFO:tasks.workunit.client.0.smithi072.stdout:0/905: symlink d1/d1c/d24/d27/d7c/l12f 0 2024-03-19T06:06:14.251 INFO:tasks.workunit.client.0.smithi072.stdout:6/811: creat d7/d9/d1b/d31/f10c x:0 0 0 2024-03-19T06:06:14.256 INFO:tasks.workunit.client.0.smithi072.stdout:3/838: symlink d2/d40/d78/de9/l11a 0 2024-03-19T06:06:14.257 INFO:tasks.workunit.client.0.smithi072.stdout:9/787: dwrite d11/d24/d4c/dda/d36/fc8 [0,4194304] 0 2024-03-19T06:06:14.257 INFO:tasks.workunit.client.0.smithi072.stdout:8/911: mkdir da/d3b/da7/d105/d134 0 2024-03-19T06:06:14.259 INFO:tasks.workunit.client.0.smithi072.stdout:2/933: rename db/d10/d13/df4/d103/d82/d98/dbf/fe7 to db/d142/f149 0 2024-03-19T06:06:14.260 INFO:tasks.workunit.client.0.smithi072.stdout:0/906: write d1/d1c/f116 [818833,24511] 0 2024-03-19T06:06:14.263 INFO:tasks.workunit.client.0.smithi072.stdout:6/812: creat d7/d99/d60/d78/d7f/dcb/d84/dc0/dfb/f10d x:0 0 0 2024-03-19T06:06:14.263 INFO:tasks.workunit.client.0.smithi072.stdout:9/788: mknod d11/d24/d4c/dda/d6f/dac/c110 0 2024-03-19T06:06:14.264 INFO:tasks.workunit.client.0.smithi072.stdout:6/813: readlink d7/d9/l17 0 2024-03-19T06:06:14.266 INFO:tasks.workunit.client.0.smithi072.stdout:0/907: write d1/d1c/d82/fe9 [2424109,42810] 0 2024-03-19T06:06:14.268 INFO:tasks.workunit.client.0.smithi072.stdout:8/912: rename da/d27/d52/d5b/f6e to da/d27/d52/d100/d12e/f135 0 2024-03-19T06:06:14.269 INFO:tasks.workunit.client.0.smithi072.stdout:6/814: rmdir d7/d9/d1b/d21/d68/daa/d88 39 2024-03-19T06:06:14.272 INFO:tasks.workunit.client.0.smithi072.stdout:0/908: creat d1/d1c/d24/d8f/f130 x:0 0 0 2024-03-19T06:06:14.273 INFO:tasks.workunit.client.0.smithi072.stdout:8/913: symlink da/d13/d14/l136 0 2024-03-19T06:06:14.277 INFO:tasks.workunit.client.0.smithi072.stdout:8/914: write da/d13/d1d/d10e/f122 [1189480,54639] 0 2024-03-19T06:06:14.278 INFO:tasks.workunit.client.0.smithi072.stdout:3/839: getdents d2/d40/d78/de9 0 2024-03-19T06:06:14.280 INFO:tasks.workunit.client.0.smithi072.stdout:6/815: mkdir d7/d9/d1b/d21/d68/daa/d10e 0 2024-03-19T06:06:14.283 INFO:tasks.workunit.client.0.smithi072.stdout:8/915: rename da/d62/feb to da/d27/d30/f137 0 2024-03-19T06:06:14.284 INFO:tasks.workunit.client.0.smithi072.stdout:3/840: rmdir d2/d3/d15/d66/d6b 39 2024-03-19T06:06:14.286 INFO:tasks.workunit.client.0.smithi072.stdout:0/909: dread d1/d1c/d24/d27/d73/d80/d8b/f5b [4194304,4194304] 0 2024-03-19T06:06:14.286 INFO:tasks.workunit.client.0.smithi072.stdout:3/841: rename d2 to d2/d19/db0/d11b 22 2024-03-19T06:06:14.287 INFO:tasks.workunit.client.0.smithi072.stdout:2/934: write db/d10/d13/d24/d61/d7d/fb2 [3702464,65312] 0 2024-03-19T06:06:14.290 INFO:tasks.workunit.client.0.smithi072.stdout:3/842: read d2/f60 [2490527,122869] 0 2024-03-19T06:06:14.293 INFO:tasks.workunit.client.0.smithi072.stdout:0/910: chown d1/f8c 122 1 2024-03-19T06:06:14.294 INFO:tasks.workunit.client.0.smithi072.stdout:7/712: sync 2024-03-19T06:06:14.295 INFO:tasks.workunit.client.0.smithi072.stdout:3/843: creat d2/d19/db0/dcb/f11c x:0 0 0 2024-03-19T06:06:14.298 INFO:tasks.workunit.client.0.smithi072.stdout:8/916: dread da/f51 [0,4194304] 0 2024-03-19T06:06:14.300 INFO:tasks.workunit.client.0.smithi072.stdout:9/789: dread d11/d24/ddd/d5c/fed [0,4194304] 0 2024-03-19T06:06:14.302 INFO:tasks.workunit.client.0.smithi072.stdout:3/844: rename d2/d3/d15/c81 to d2/d19/db0/d107/c11d 0 2024-03-19T06:06:14.306 INFO:tasks.workunit.client.0.smithi072.stdout:8/917: creat da/d13/d3f/db9/dc1/f138 x:0 0 0 2024-03-19T06:06:14.307 INFO:tasks.workunit.client.0.smithi072.stdout:9/790: truncate d11/d24/d4c/dda/d36/fe3 252324 0 2024-03-19T06:06:14.307 INFO:tasks.workunit.client.0.smithi072.stdout:3/845: creat d2/d3/d26/d92/d10c/d10e/f11e x:0 0 0 2024-03-19T06:06:14.308 INFO:tasks.workunit.client.0.smithi072.stdout:7/713: link d2/d3/d17/dc8/d1d/d2b/l55 d2/d3/d17/dc8/d1d/d2b/le4 0 2024-03-19T06:06:14.311 INFO:tasks.workunit.client.0.smithi072.stdout:9/791: dread - d11/d24/d4c/d64/f75 zero size 2024-03-19T06:06:14.313 INFO:tasks.workunit.client.0.smithi072.stdout:8/918: fdatasync da/d27/d52/d5b/d3e/ff2 0 2024-03-19T06:06:14.313 INFO:tasks.workunit.client.0.smithi072.stdout:7/714: chown d2/d3/d17/dc8/d1d/d3b/l51 40909069 1 2024-03-19T06:06:14.314 INFO:tasks.workunit.client.0.smithi072.stdout:3/846: read d2/f5 [3123073,43191] 0 2024-03-19T06:06:14.317 INFO:tasks.workunit.client.0.smithi072.stdout:7/715: stat d2/d3/d18/d20/d3a/c8e 0 2024-03-19T06:06:14.319 INFO:tasks.workunit.client.0.smithi072.stdout:8/919: symlink da/d13/d3f/db9/dc1/l139 0 2024-03-19T06:06:14.323 INFO:tasks.workunit.client.0.smithi072.stdout:9/792: symlink d11/d24/d4c/dda/d6f/l111 0 2024-03-19T06:06:14.325 INFO:tasks.workunit.client.0.smithi072.stdout:2/935: dwrite db/d10/d2b/d2d/d12c/d6b/f71 [0,4194304] 0 2024-03-19T06:06:14.326 INFO:tasks.workunit.client.0.smithi072.stdout:6/816: dread d7/d9/d1b/d21/d68/daa/d88/f9d [0,4194304] 0 2024-03-19T06:06:14.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.343+0000 7f2c74800700 1 -- 172.21.15.72:0/1918094412 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2c6c02ce80 con 0x7f2c6c071a00 2024-03-19T06:06:14.335 INFO:tasks.workunit.client.0.smithi072.stdout:2/936: symlink db/d10/d13/df4/d103/ddb/d120/l14a 0 2024-03-19T06:06:14.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.344+0000 7f2c66a00700 1 -- 172.21.15.72:0/1918094412 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f2c5805c140 con 0x7f2c6c071a00 2024-03-19T06:06:14.336 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:06:14.336 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:06:14.336 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:06:14.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:06:14.336 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:06:14.336 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:06:14.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:06:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:06:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:06:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:06:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:06:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:06:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:06:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:06:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-03-19T06:06:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:06:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:06:14.337 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:06:14.338 INFO:tasks.workunit.client.0.smithi072.stdout:7/716: write d2/d3/d18/d7f/f97 [220272,54588] 0 2024-03-19T06:06:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.348+0000 7f2c74800700 1 -- 172.21.15.72:0/1918094412 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f2c5406dd50 msgr2=0x7f2c54070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.348+0000 7f2c74800700 1 --2- 172.21.15.72:0/1918094412 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f2c5406dd50 0x7f2c54070200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2c60007fd0 tx=0x7f2c600073d0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.348+0000 7f2c74800700 1 -- 172.21.15.72:0/1918094412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c6c071a00 msgr2=0x7f2c6c1a4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.348+0000 7f2c74800700 1 --2- 172.21.15.72:0/1918094412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c6c071a00 0x7f2c6c1a4870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2c580092e0 tx=0x7f2c5800bd70 comp rx=0 tx=0).stop 2024-03-19T06:06:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.349+0000 7f2c74800700 1 -- 172.21.15.72:0/1918094412 shutdown_connections 2024-03-19T06:06:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.349+0000 7f2c74800700 1 --2- 172.21.15.72:0/1918094412 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f2c5406dd50 0x7f2c54070200 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.349+0000 7f2c74800700 1 --2- 172.21.15.72:0/1918094412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c6c071a00 0x7f2c6c1a4870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.349+0000 7f2c74800700 1 --2- 172.21.15.72:0/1918094412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c0723e0 0x7f2c6c1a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.349+0000 7f2c74800700 1 -- 172.21.15.72:0/1918094412 >> 172.21.15.72:0/1918094412 conn(0x7f2c6c06d110 msgr2=0x7f2c6c10b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.349+0000 7f2c74800700 1 -- 172.21.15.72:0/1918094412 shutdown_connections 2024-03-19T06:06:14.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.350+0000 7f2c74800700 1 -- 172.21.15.72:0/1918094412 wait complete. 2024-03-19T06:06:14.356 INFO:tasks.workunit.client.0.smithi072.stdout:8/920: dwrite da/d27/d52/d5b/d3e/d7d/d97/f85 [0,4194304] 0 2024-03-19T06:06:14.356 INFO:tasks.workunit.client.0.smithi072.stdout:3/847: dwrite d2/d40/d78/d9b/dc5/ff9 [4194304,4194304] 0 2024-03-19T06:06:14.360 INFO:tasks.workunit.client.0.smithi072.stdout:3/848: write d2/d3/d26/fff [545868,119299] 0 2024-03-19T06:06:14.361 INFO:tasks.workunit.client.0.smithi072.stdout:7/717: write d2/d3/f62 [2786150,7106] 0 2024-03-19T06:06:14.371 INFO:tasks.workunit.client.0.smithi072.stdout:7/718: creat d2/d3/fe5 x:0 0 0 2024-03-19T06:06:14.381 INFO:tasks.workunit.client.0.smithi072.stdout:9/793: dread d11/f1b [0,4194304] 0 2024-03-19T06:06:14.381 INFO:tasks.workunit.client.0.smithi072.stdout:2/937: dwrite db/d10/d2b/f4b [0,4194304] 0 2024-03-19T06:06:14.381 INFO:tasks.workunit.client.0.smithi072.stdout:7/719: rmdir d2/d3/d17/dc8/d1d/d3b/d63/d84 39 2024-03-19T06:06:14.385 INFO:tasks.workunit.client.0.smithi072.stdout:9/794: fsync d11/f37 0 2024-03-19T06:06:14.389 INFO:tasks.workunit.client.0.smithi072.stdout:2/938: getdents db/d10/d13/df4 0 2024-03-19T06:06:14.391 INFO:tasks.workunit.client.0.smithi072.stdout:9/795: mknod d11/c112 0 2024-03-19T06:06:14.392 INFO:tasks.workunit.client.0.smithi072.stdout:7/720: unlink d2/d3/d17/dc8/d83/lc2 0 2024-03-19T06:06:14.397 INFO:tasks.workunit.client.0.smithi072.stdout:9/796: mkdir d11/d24/d4c/dda/d68/d79/d113 0 2024-03-19T06:06:14.402 INFO:tasks.workunit.client.0.smithi072.stdout:3/849: dwrite d2/d3/d15/d66/d6b/d79/fbf [0,4194304] 0 2024-03-19T06:06:14.402 INFO:tasks.workunit.client.0.smithi072.stdout:2/939: rename db/d10/d59/c6c to db/d10/d13/df4/d103/dd9/c14b 0 2024-03-19T06:06:14.459 INFO:tasks.workunit.client.0.smithi072.stdout:1/878: sync 2024-03-19T06:06:14.460 INFO:tasks.workunit.client.0.smithi072.stdout:5/957: sync 2024-03-19T06:06:14.460 INFO:tasks.workunit.client.0.smithi072.stdout:3/850: rmdir d2/d19/db0/dcb 39 2024-03-19T06:06:14.461 INFO:tasks.workunit.client.0.smithi072.stdout:9/797: symlink d11/d24/d4c/dda/d68/l114 0 2024-03-19T06:06:14.466 INFO:tasks.workunit.client.0.smithi072.stdout:8/921: dread da/d37/f6c [0,4194304] 0 2024-03-19T06:06:14.466 INFO:tasks.workunit.client.0.smithi072.stdout:2/940: link db/c52 db/d10/d2b/dc3/c14c 0 2024-03-19T06:06:14.474 INFO:tasks.workunit.client.0.smithi072.stdout:9/798: mkdir d11/d24/d4c/dda/d6f/d87/da4/d115 0 2024-03-19T06:06:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.535+0000 7efd16a00700 1 -- 172.21.15.72:0/2425284607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd10103680 msgr2=0x7efd10105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.535+0000 7efd16a00700 1 --2- 172.21.15.72:0/2425284607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd10103680 0x7efd10105a60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009910 tx=0x7efcfc009c20 comp rx=0 tx=0).stop 2024-03-19T06:06:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.535+0000 7efd16a00700 1 -- 172.21.15.72:0/2425284607 shutdown_connections 2024-03-19T06:06:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.536+0000 7efd16a00700 1 --2- 172.21.15.72:0/2425284607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd10103680 0x7efd10105a60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.536+0000 7efd16a00700 1 --2- 172.21.15.72:0/2425284607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd10100d60 0x7efd10103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.536+0000 7efd16a00700 1 -- 172.21.15.72:0/2425284607 >> 172.21.15.72:0/2425284607 conn(0x7efd100fa780 msgr2=0x7efd100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:14.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.536+0000 7efd16a00700 1 -- 172.21.15.72:0/2425284607 shutdown_connections 2024-03-19T06:06:14.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.536+0000 7efd16a00700 1 -- 172.21.15.72:0/2425284607 wait complete. 2024-03-19T06:06:14.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.537+0000 7efd16a00700 1 Processor -- start 2024-03-19T06:06:14.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.537+0000 7efd16a00700 1 -- start start 2024-03-19T06:06:14.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.537+0000 7efd16a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd10100d60 0x7efd101006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:14.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.537+0000 7efd16a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd10103680 0x7efd100fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:14.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.537+0000 7efd16a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd100ff250 con 0x7efd10103680 2024-03-19T06:06:14.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.537+0000 7efd16a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd100ff390 con 0x7efd10100d60 2024-03-19T06:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.537+0000 7efd0f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd10103680 0x7efd100fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.537+0000 7efd0f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd10103680 0x7efd100fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53992/0 (socket says 172.21.15.72:53992) 2024-03-19T06:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.537+0000 7efd0f400700 1 -- 172.21.15.72:0/806764290 learned_addr learned my addr 172.21.15.72:0/806764290 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.538+0000 7efd0fe00700 1 --2- 172.21.15.72:0/806764290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd10100d60 0x7efd101006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.538+0000 7efd0f400700 1 -- 172.21.15.72:0/806764290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd10100d60 msgr2=0x7efd101006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.538+0000 7efd0f400700 1 --2- 172.21.15.72:0/806764290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd10100d60 0x7efd101006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.538+0000 7efd0f400700 1 -- 172.21.15.72:0/806764290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc0095f0 con 0x7efd10103680 2024-03-19T06:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.538+0000 7efd0f400700 1 --2- 172.21.15.72:0/806764290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd10103680 0x7efd100fed10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efcfc005b40 tx=0x7efcfc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.538+0000 7efd0cc00700 1 -- 172.21.15.72:0/806764290 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcfc01d070 con 0x7efd10103680 2024-03-19T06:06:14.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.539+0000 7efd0cc00700 1 -- 172.21.15.72:0/806764290 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efcfc022470 con 0x7efd10103680 2024-03-19T06:06:14.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.539+0000 7efd16a00700 1 -- 172.21.15.72:0/806764290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd100ff610 con 0x7efd10103680 2024-03-19T06:06:14.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.539+0000 7efd16a00700 1 -- 172.21.15.72:0/806764290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd100ffb00 con 0x7efd10103680 2024-03-19T06:06:14.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.539+0000 7efd0cc00700 1 -- 172.21.15.72:0/806764290 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcfc00f690 con 0x7efd10103680 2024-03-19T06:06:14.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.540+0000 7efd06000700 1 -- 172.21.15.72:0/806764290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce80052f0 con 0x7efd10103680 2024-03-19T06:06:14.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.541+0000 7efd0cc00700 1 -- 172.21.15.72:0/806764290 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7efcfc00f7f0 con 0x7efd10103680 2024-03-19T06:06:14.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.542+0000 7efd0cc00700 1 --2- 172.21.15.72:0/806764290 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7efcf406dd50 0x7efcf4070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:14.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.542+0000 7efd0cc00700 1 -- 172.21.15.72:0/806764290 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7efcfc08f170 con 0x7efd10103680 2024-03-19T06:06:14.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.542+0000 7efd0fe00700 1 --2- 172.21.15.72:0/806764290 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7efcf406dd50 0x7efcf4070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:14.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.542+0000 7efd0fe00700 1 --2- 172.21.15.72:0/806764290 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7efcf406dd50 0x7efcf4070200 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd00006fd0 tx=0x7efd00008040 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:14.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.546+0000 7efd0cc00700 1 -- 172.21.15.72:0/806764290 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7efcfc05c4b0 con 0x7efd10103680 2024-03-19T06:06:14.656 INFO:tasks.workunit.client.0.smithi072.stdout:2/941: rename db/d10/d13/d31/d35/ddc to db/d10/d2b/d45/da4/d14d 0 2024-03-19T06:06:14.656 INFO:tasks.workunit.client.0.smithi072.stdout:7/721: dread d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/f78 [0,4194304] 0 2024-03-19T06:06:14.659 INFO:tasks.workunit.client.0.smithi072.stdout:5/958: creat df/d54/dac/d9c/f127 x:0 0 0 2024-03-19T06:06:14.659 INFO:tasks.workunit.client.0.smithi072.stdout:8/922: symlink da/d27/d52/d5b/d3e/d5a/df1/l13a 0 2024-03-19T06:06:14.662 INFO:tasks.workunit.client.0.smithi072.stdout:3/851: link d2/d19/c4f d2/d3/d25/da5/de6/c11f 0 2024-03-19T06:06:14.665 INFO:tasks.workunit.client.0.smithi072.stdout:9/799: rename d11/d24/d4c/dda/d36/la8 to d11/d24/d4c/l116 0 2024-03-19T06:06:14.666 INFO:tasks.workunit.client.0.smithi072.stdout:8/923: read da/d13/d14/f17 [6058190,17804] 0 2024-03-19T06:06:14.668 INFO:tasks.workunit.client.0.smithi072.stdout:1/879: dwrite d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d52/f7f [0,4194304] 0 2024-03-19T06:06:14.668 INFO:tasks.workunit.client.0.smithi072.stdout:2/942: truncate db/d10/d2b/d2d/f141 618093 0 2024-03-19T06:06:14.671 INFO:tasks.workunit.client.0.smithi072.stdout:2/943: chown db/d10/d13/d24/d72/d86/lb9 6283405 1 2024-03-19T06:06:14.672 INFO:tasks.workunit.client.0.smithi072.stdout:3/852: creat d2/d3/d25/da5/de6/f120 x:0 0 0 2024-03-19T06:06:14.672 INFO:tasks.workunit.client.0.smithi072.stdout:5/959: link df/d14/f15 df/d13/f128 0 2024-03-19T06:06:14.675 INFO:tasks.workunit.client.0.smithi072.stdout:8/924: mknod da/d62/c13b 0 2024-03-19T06:06:14.681 INFO:tasks.workunit.client.0.smithi072.stdout:8/925: stat da/d27/d52/d100/d8e/dc7 0 2024-03-19T06:06:14.683 INFO:tasks.workunit.client.0.smithi072.stdout:2/944: rename db/d10/d13/df4/d103/d82 to db/d10/d13/d24/d61/d14e 0 2024-03-19T06:06:14.690 INFO:tasks.workunit.client.0.smithi072.stdout:2/945: fdatasync db/d10/d12/ff1 0 2024-03-19T06:06:14.691 INFO:tasks.workunit.client.0.smithi072.stdout:8/926: getdents da/d13 0 2024-03-19T06:06:14.692 INFO:tasks.workunit.client.0.smithi072.stdout:7/722: dwrite d2/d8c/dba/dbc/fb8 [0,4194304] 0 2024-03-19T06:06:14.698 INFO:tasks.workunit.client.0.smithi072.stdout:9/800: truncate d11/f12 3594788 0 2024-03-19T06:06:14.704 INFO:tasks.workunit.client.0.smithi072.stdout:9/801: creat d11/d24/ddd/d5c/f117 x:0 0 0 2024-03-19T06:06:14.708 INFO:tasks.workunit.client.0.smithi072.stdout:7/723: rename d2/d3/d17/d70/c94 to d2/d3/d17/dc8/d1d/ce6 0 2024-03-19T06:06:14.710 INFO:tasks.workunit.client.0.smithi072.stdout:9/802: mknod d11/d24/d4c/dda/d68/dec/c118 0 2024-03-19T06:06:14.713 INFO:tasks.workunit.client.0.smithi072.stdout:1/880: dread d1/d11/f13 [0,4194304] 0 2024-03-19T06:06:14.713 INFO:tasks.workunit.client.0.smithi072.stdout:3/853: dwrite d2/d19/f6c [0,4194304] 0 2024-03-19T06:06:14.717 INFO:tasks.workunit.client.0.smithi072.stdout:7/724: creat d2/d3/d17/dc8/d53/dca/fe7 x:0 0 0 2024-03-19T06:06:14.718 INFO:tasks.workunit.client.0.smithi072.stdout:1/881: mknod d1/d11/d76/df7/c12b 0 2024-03-19T06:06:14.719 INFO:tasks.workunit.client.0.smithi072.stdout:3/854: fdatasync d2/d3/d15/fba 0 2024-03-19T06:06:14.724 INFO:tasks.workunit.client.0.smithi072.stdout:7/725: dread - d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/f7c zero size 2024-03-19T06:06:14.725 INFO:tasks.workunit.client.0.smithi072.stdout:1/882: symlink d1/d11/d76/da7/d9e/l12c 0 2024-03-19T06:06:14.727 INFO:tasks.workunit.client.0.smithi072.stdout:7/726: unlink d2/d3/d18/d20/l5a 0 2024-03-19T06:06:14.729 INFO:tasks.workunit.client.0.smithi072.stdout:1/883: creat d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/f12d x:0 0 0 2024-03-19T06:06:14.738 INFO:tasks.workunit.client.0.smithi072.stdout:7/727: truncate d2/d3/fd 677966 0 2024-03-19T06:06:14.739 INFO:tasks.workunit.client.0.smithi072.stdout:1/884: symlink d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/l12e 0 2024-03-19T06:06:14.739 INFO:tasks.workunit.client.0.smithi072.stdout:2/946: dread db/d10/d13/d31/f5d [0,4194304] 0 2024-03-19T06:06:14.745 INFO:tasks.workunit.client.0.smithi072.stdout:3/855: dwrite d2/d3/d15/d66/d6b/d79/f91 [0,4194304] 0 2024-03-19T06:06:14.755 INFO:tasks.workunit.client.0.smithi072.stdout:1/885: creat d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/f12f x:0 0 0 2024-03-19T06:06:14.756 INFO:tasks.workunit.client.0.smithi072.stdout:7/728: write d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/f78 [414357,23413] 0 2024-03-19T06:06:14.757 INFO:tasks.workunit.client.0.smithi072.stdout:3/856: symlink d2/d19/db0/dcb/l121 0 2024-03-19T06:06:14.759 INFO:tasks.workunit.client.0.smithi072.stdout:7/729: fsync d2/f66 0 2024-03-19T06:06:14.762 INFO:tasks.workunit.client.0.smithi072.stdout:3/857: chown d2/d40/d78/d9b/lfb 1587 1 2024-03-19T06:06:14.766 INFO:tasks.workunit.client.0.smithi072.stdout:2/947: dwrite db/d142/f149 [0,4194304] 0 2024-03-19T06:06:14.769 INFO:tasks.workunit.client.0.smithi072.stdout:1/886: rename d1/d11/d76/df7/cf8 to d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/c130 0 2024-03-19T06:06:14.770 INFO:tasks.workunit.client.0.smithi072.stdout:3/858: mkdir d2/d40/d78/d9b/d122 0 2024-03-19T06:06:14.772 INFO:tasks.workunit.client.0.smithi072.stdout:2/948: creat db/d10/d13/d24/d72/d86/dcd/d147/f14f x:0 0 0 2024-03-19T06:06:14.773 INFO:tasks.workunit.client.0.smithi072.stdout:3/859: creat d2/dbc/f123 x:0 0 0 2024-03-19T06:06:14.775 INFO:tasks.workunit.client.0.smithi072.stdout:2/949: readlink db/d10/d2b/d2d/d12c/le6 0 2024-03-19T06:06:14.776 INFO:tasks.workunit.client.0.smithi072.stdout:3/860: fdatasync d2/d19/d1e/f6a 0 2024-03-19T06:06:14.778 INFO:tasks.workunit.client.0.smithi072.stdout:2/950: read db/d10/d13/d24/d61/d7d/fa5 [3388679,31337] 0 2024-03-19T06:06:14.779 INFO:tasks.workunit.client.0.smithi072.stdout:3/861: symlink d2/d19/db0/dcb/df8/l124 0 2024-03-19T06:06:14.782 INFO:tasks.workunit.client.0.smithi072.stdout:3/862: symlink d2/d40/d78/de9/l125 0 2024-03-19T06:06:14.788 INFO:tasks.workunit.client.0.smithi072.stdout:2/951: write db/d10/d12/ff1 [820469,116034] 0 2024-03-19T06:06:14.791 INFO:tasks.workunit.client.0.smithi072.stdout:2/952: symlink db/d10/d13/d24/d72/d86/dcd/l150 0 2024-03-19T06:06:14.794 INFO:tasks.workunit.client.0.smithi072.stdout:2/953: fsync db/d10/d2b/d45/da4/fb7 0 2024-03-19T06:06:14.818 INFO:tasks.workunit.client.0.smithi072.stdout:2/954: link db/d10/d2b/d45/f58 db/d10/d13/d24/d61/d14e/d124/f151 0 2024-03-19T06:06:14.823 INFO:tasks.workunit.client.0.smithi072.stdout:2/955: rename db/d10/d2b/d2d/f141 to db/d10/d2b/d2d/d9e/dab/dca/f152 0 2024-03-19T06:06:14.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:14 smithi072 ceph-mon[28706]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:14.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:14 smithi072 ceph-mon[28706]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:14.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:14 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1918094412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:06:14.836 INFO:tasks.workunit.client.0.smithi072.stdout:2/956: dwrite db/f38 [0,4194304] 0 2024-03-19T06:06:14.849 INFO:tasks.workunit.client.0.smithi072.stdout:2/957: dread db/d10/d2b/d45/f55 [0,4194304] 0 2024-03-19T06:06:14.853 INFO:tasks.workunit.client.0.smithi072.stdout:2/958: fdatasync db/d10/d13/df4/d103/f148 0 2024-03-19T06:06:14.868 INFO:tasks.workunit.client.0.smithi072.stdout:2/959: dwrite db/d10/d2b/d2d/fa7 [0,4194304] 0 2024-03-19T06:06:14.874 INFO:tasks.workunit.client.0.smithi072.stdout:2/960: mkdir db/d10/d2b/d2d/d12c/d153 0 2024-03-19T06:06:14.885 INFO:tasks.workunit.client.0.smithi072.stdout:2/961: dread db/d10/d12/f105 [0,4194304] 0 2024-03-19T06:06:14.888 INFO:tasks.workunit.client.0.smithi072.stdout:2/962: write db/d10/d2b/dc3/f10a [940722,8994] 0 2024-03-19T06:06:14.894 INFO:tasks.workunit.client.0.smithi072.stdout:2/963: rename db/d10/d12/f105 to db/d10/d2b/f154 0 2024-03-19T06:06:14.896 INFO:tasks.workunit.client.0.smithi072.stdout:2/964: creat db/f155 x:0 0 0 2024-03-19T06:06:14.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:14 smithi172 ceph-mon[35716]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:14.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:14 smithi172 ceph-mon[35716]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:14.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:14 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1918094412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:06:14.905 INFO:tasks.workunit.client.0.smithi072.stdout:2/965: dread db/d10/d2b/dc3/f10a [0,4194304] 0 2024-03-19T06:06:14.907 INFO:tasks.workunit.client.0.smithi072.stdout:2/966: fdatasync db/d10/d59/f136 0 2024-03-19T06:06:14.910 INFO:tasks.workunit.client.0.smithi072.stdout:2/967: rmdir db/d10/d13/d24/d72/d86 39 2024-03-19T06:06:14.912 INFO:tasks.workunit.client.0.smithi072.stdout:2/968: write db/d10/d2b/dc3/fed [370175,104886] 0 2024-03-19T06:06:14.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.926+0000 7efd06000700 1 -- 172.21.15.72:0/806764290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efce8005c90 con 0x7efd10103680 2024-03-19T06:06:14.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.927+0000 7efd0cc00700 1 -- 172.21.15.72:0/806764290 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1865 (secure 0 0 0) 0x7efcfc05c040 con 0x7efd10103680 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:e15 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 15 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:04:57.207619+0000 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:06:14.919 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:06:14.920 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:06:14.921 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:06:14.921 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:06:14.921 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:06:14.921 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:06:14.921 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:06:14.921 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:06:14.921 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:06:14.921 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:06:14.921 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:06:14.921 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:06:14.921 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:06:14.922 INFO:tasks.workunit.client.0.smithi072.stdout:2/969: rename db/d10/d13/d24/d72/f74 to db/d10/d2b/d45/da4/d14d/de1/f156 0 2024-03-19T06:06:14.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.930+0000 7efd06000700 1 -- 172.21.15.72:0/806764290 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7efcf406dd50 msgr2=0x7efcf4070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:14.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.930+0000 7efd06000700 1 --2- 172.21.15.72:0/806764290 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7efcf406dd50 0x7efcf4070200 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd00006fd0 tx=0x7efd00008040 comp rx=0 tx=0).stop 2024-03-19T06:06:14.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.930+0000 7efd06000700 1 -- 172.21.15.72:0/806764290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd10103680 msgr2=0x7efd100fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:14.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.930+0000 7efd06000700 1 --2- 172.21.15.72:0/806764290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd10103680 0x7efd100fed10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efcfc005b40 tx=0x7efcfc00be20 comp rx=0 tx=0).stop 2024-03-19T06:06:14.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.930+0000 7efd06000700 1 -- 172.21.15.72:0/806764290 shutdown_connections 2024-03-19T06:06:14.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.930+0000 7efd06000700 1 --2- 172.21.15.72:0/806764290 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7efcf406dd50 0x7efcf4070200 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.930+0000 7efd06000700 1 --2- 172.21.15.72:0/806764290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd10100d60 0x7efd101006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.930+0000 7efd06000700 1 --2- 172.21.15.72:0/806764290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd10103680 0x7efd100fed10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.930+0000 7efd06000700 1 -- 172.21.15.72:0/806764290 >> 172.21.15.72:0/806764290 conn(0x7efd100fa780 msgr2=0x7efd100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:14.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.932+0000 7efd06000700 1 -- 172.21.15.72:0/806764290 shutdown_connections 2024-03-19T06:06:14.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:14.932+0000 7efd06000700 1 -- 172.21.15.72:0/806764290 wait complete. 2024-03-19T06:06:14.924 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2024-03-19T06:06:14.928 INFO:tasks.workunit.client.0.smithi072.stdout:2/970: rename db/d10/d2b/d2d/d9e/dab/f104 to db/d10/d13/df4/d103/dd9/de9/f157 0 2024-03-19T06:06:14.929 INFO:tasks.workunit.client.0.smithi072.stdout:2/971: chown db/d10/d13/d117 3 1 2024-03-19T06:06:14.931 INFO:tasks.workunit.client.0.smithi072.stdout:2/972: dread - db/d10/d13/d24/d61/d14e/d98/dbf/f109 zero size 2024-03-19T06:06:14.936 INFO:tasks.workunit.client.0.smithi072.stdout:2/973: fdatasync db/d10/d13/d24/d61/fb0 0 2024-03-19T06:06:14.941 INFO:tasks.workunit.client.0.smithi072.stdout:2/974: creat db/d10/f158 x:0 0 0 2024-03-19T06:06:14.945 INFO:tasks.workunit.client.0.smithi072.stdout:2/975: truncate db/d10/d13/df4/d103/dd9/ffb 1072413 0 2024-03-19T06:06:14.951 INFO:tasks.workunit.client.0.smithi072.stdout:2/976: rename db/d10/d13/d31/f3c to db/d10/d12/f159 0 2024-03-19T06:06:14.963 INFO:tasks.workunit.client.0.smithi072.stdout:2/977: write db/d10/d13/d24/d61/d14e/d98/dbf/f109 [837345,44741] 0 2024-03-19T06:06:14.970 INFO:tasks.workunit.client.0.smithi072.stdout:2/978: mknod db/d10/d13/df4/d103/dd9/d140/c15a 0 2024-03-19T06:06:14.994 INFO:tasks.workunit.client.0.smithi072.stdout:2/979: dread db/d10/d2b/dc3/fea [0,4194304] 0 2024-03-19T06:06:15.001 INFO:tasks.workunit.client.0.smithi072.stdout:2/980: rename db/d10/d13/f76 to db/d10/d13/d7c/f15b 0 2024-03-19T06:06:15.002 INFO:tasks.workunit.client.0.smithi072.stdout:2/981: readlink l3 0 2024-03-19T06:06:15.010 INFO:tasks.workunit.client.0.smithi072.stdout:2/982: creat db/d10/d13/df4/d103/ddb/d120/f15c x:0 0 0 2024-03-19T06:06:15.013 INFO:tasks.workunit.client.0.smithi072.stdout:2/983: dread - db/d10/d13/df4/d103/dd9/de9/f157 zero size 2024-03-19T06:06:15.028 INFO:tasks.workunit.client.0.smithi072.stdout:2/984: rename db/d10/d13/d24/d61/d14e/d98/dbf/dd5/feb to db/d10/f15d 0 2024-03-19T06:06:15.035 INFO:tasks.workunit.client.0.smithi072.stdout:2/985: dread db/d10/d13/d24/d72/f81 [0,4194304] 0 2024-03-19T06:06:15.042 INFO:tasks.workunit.client.0.smithi072.stdout:2/986: creat db/d10/d13/d24/d61/d14e/f15e x:0 0 0 2024-03-19T06:06:15.078 INFO:tasks.workunit.client.0.smithi072.stdout:2/987: dread db/d10/d2b/d2d/fa2 [0,4194304] 0 2024-03-19T06:06:15.081 INFO:tasks.workunit.client.0.smithi072.stdout:2/988: write db/d142/f149 [853132,121454] 0 2024-03-19T06:06:15.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.098+0000 7f536de00700 1 -- 172.21.15.72:0/872795988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53681012c0 msgr2=0x7f5368101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.098+0000 7f536de00700 1 --2- 172.21.15.72:0/872795988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53681012c0 0x7f5368101730 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5354009910 tx=0x7f5354009c20 comp rx=0 tx=0).stop 2024-03-19T06:06:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.098+0000 7f536de00700 1 -- 172.21.15.72:0/872795988 shutdown_connections 2024-03-19T06:06:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.098+0000 7f536de00700 1 --2- 172.21.15.72:0/872795988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53681012c0 0x7f5368101730 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.098+0000 7f536de00700 1 --2- 172.21.15.72:0/872795988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5368100020 0x7f5368100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.098+0000 7f536de00700 1 -- 172.21.15.72:0/872795988 >> 172.21.15.72:0/872795988 conn(0x7f53680fb650 msgr2=0x7f53680fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.098+0000 7f536de00700 1 -- 172.21.15.72:0/872795988 shutdown_connections 2024-03-19T06:06:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.098+0000 7f536de00700 1 -- 172.21.15.72:0/872795988 wait complete. 2024-03-19T06:06:15.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.099+0000 7f536de00700 1 Processor -- start 2024-03-19T06:06:15.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.099+0000 7f536de00700 1 -- start start 2024-03-19T06:06:15.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.100+0000 7f536de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368100020 0x7f53681958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:15.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.100+0000 7f536de00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53681012c0 0x7f5368195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:15.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.100+0000 7f536de00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5368196400 con 0x7f5368100020 2024-03-19T06:06:15.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.100+0000 7f536de00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5368196540 con 0x7f53681012c0 2024-03-19T06:06:15.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.100+0000 7f536ca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368100020 0x7f53681958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:15.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.100+0000 7f536ca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368100020 0x7f53681958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54014/0 (socket says 172.21.15.72:54014) 2024-03-19T06:06:15.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.100+0000 7f536ca00700 1 -- 172.21.15.72:0/4225532788 learned_addr learned my addr 172.21.15.72:0/4225532788 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:15.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.100+0000 7f536ca00700 1 -- 172.21.15.72:0/4225532788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53681012c0 msgr2=0x7f5368195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:15.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.100+0000 7f536ca00700 1 --2- 172.21.15.72:0/4225532788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53681012c0 0x7f5368195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.100+0000 7f536ca00700 1 -- 172.21.15.72:0/4225532788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53540095f0 con 0x7f5368100020 2024-03-19T06:06:15.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.101+0000 7f536ca00700 1 --2- 172.21.15.72:0/4225532788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368100020 0x7f53681958a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f535c00b4b0 tx=0x7f535c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.101+0000 7f5365600700 1 -- 172.21.15.72:0/4225532788 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f535c011800 con 0x7f5368100020 2024-03-19T06:06:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.101+0000 7f5365600700 1 -- 172.21.15.72:0/4225532788 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f535c011e10 con 0x7f5368100020 2024-03-19T06:06:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.101+0000 7f5365600700 1 -- 172.21.15.72:0/4225532788 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f535c00f2e0 con 0x7f5368100020 2024-03-19T06:06:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.101+0000 7f536de00700 1 -- 172.21.15.72:0/4225532788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536819aff0 con 0x7f5368100020 2024-03-19T06:06:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.101+0000 7f536de00700 1 -- 172.21.15.72:0/4225532788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536819b510 con 0x7f5368100020 2024-03-19T06:06:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.103+0000 7f536de00700 1 -- 172.21.15.72:0/4225532788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5368108b80 con 0x7f5368100020 2024-03-19T06:06:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.104+0000 7f5365600700 1 -- 172.21.15.72:0/4225532788 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7f535c010380 con 0x7f5368100020 2024-03-19T06:06:15.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.105+0000 7f5365600700 1 --2- 172.21.15.72:0/4225532788 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f535006dd50 0x7f5350070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:15.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.105+0000 7f5365600700 1 -- 172.21.15.72:0/4225532788 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f535c08d590 con 0x7f5368100020 2024-03-19T06:06:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.105+0000 7f5367e00700 1 --2- 172.21.15.72:0/4225532788 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f535006dd50 0x7f5350070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.106+0000 7f5367e00700 1 --2- 172.21.15.72:0/4225532788 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f535006dd50 0x7f5350070200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5354005090 tx=0x7f5354005fb0 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:15.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.110+0000 7f5365600700 1 -- 172.21.15.72:0/4225532788 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f535c05a950 con 0x7f5368100020 2024-03-19T06:06:15.107 INFO:tasks.workunit.client.0.smithi072.stdout:0/911: sync 2024-03-19T06:06:15.109 INFO:tasks.workunit.client.0.smithi072.stdout:0/912: chown d1/d1c/d24/d27/d7c/fdf 16756781 1 2024-03-19T06:06:15.112 INFO:tasks.workunit.client.0.smithi072.stdout:0/913: fdatasync d1/d2c/da1/f93 0 2024-03-19T06:06:15.114 INFO:tasks.workunit.client.0.smithi072.stdout:0/914: chown d1/d1c/d24/d27/d73/d80/d8b/ld3 350178820 1 2024-03-19T06:06:15.130 INFO:tasks.workunit.client.0.smithi072.stdout:0/915: dwrite d1/d1c/d82/fd8 [0,4194304] 0 2024-03-19T06:06:15.142 INFO:tasks.workunit.client.0.smithi072.stdout:0/916: creat d1/d1c/d82/de4/f131 x:0 0 0 2024-03-19T06:06:15.144 INFO:tasks.workunit.client.0.smithi072.stdout:0/917: read - d1/d1c/d24/d3f/de2/ff0 zero size 2024-03-19T06:06:15.162 INFO:tasks.workunit.client.0.smithi072.stdout:0/918: dread d1/d1c/d24/d8f/fc1 [0,4194304] 0 2024-03-19T06:06:15.283 INFO:tasks.workunit.client.0.smithi072.stdout:0/919: truncate d1/d1c/d24/d8f/fd4 3845195 0 2024-03-19T06:06:15.289 INFO:tasks.workunit.client.0.smithi072.stdout:0/920: truncate d1/d1c/f45 1977135 0 2024-03-19T06:06:15.319 INFO:tasks.workunit.client.0.smithi072.stdout:0/921: dwrite d1/de7/f128 [0,4194304] 0 2024-03-19T06:06:15.349 INFO:tasks.workunit.client.0.smithi072.stdout:0/922: dwrite d1/d1c/d24/d27/f54 [0,4194304] 0 2024-03-19T06:06:15.356 INFO:tasks.workunit.client.0.smithi072.stdout:0/923: creat d1/d1c/d24/d27/d73/dbb/f132 x:0 0 0 2024-03-19T06:06:15.369 INFO:tasks.workunit.client.0.smithi072.stdout:0/924: link d1/d1c/d82/d90/c123 d1/d1c/d82/ddd/c133 0 2024-03-19T06:06:15.370 INFO:tasks.workunit.client.0.smithi072.stdout:0/925: write d1/d1c/d24/d27/d73/fb2 [1683435,40927] 0 2024-03-19T06:06:15.376 INFO:tasks.workunit.client.0.smithi072.stdout:0/926: creat d1/d1c/d24/d27/d7c/daa/f134 x:0 0 0 2024-03-19T06:06:15.386 INFO:tasks.workunit.client.0.smithi072.stdout:0/927: write d1/d1c/fde [231506,124600] 0 2024-03-19T06:06:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.398+0000 7f536de00700 1 -- 172.21.15.72:0/4225532788 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5368105c10 con 0x7f535006dd50 2024-03-19T06:06:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.399+0000 7f5365600700 1 -- 172.21.15.72:0/4225532788 <== mgr.14702 v2:172.21.15.72:6800/2640845307 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f5368105c10 con 0x7f535006dd50 2024-03-19T06:06:15.393 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:06:15.393 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:06:15.393 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:06:15.393 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:06:15.393 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:06:15.393 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr" 2024-03-19T06:06:15.393 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:06:15.393 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "2/23 daemons upgraded", 2024-03-19T06:06:15.394 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "", 2024-03-19T06:06:15.394 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:06:15.394 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:06:15.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.402+0000 7f536de00700 1 -- 172.21.15.72:0/4225532788 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f535006dd50 msgr2=0x7f5350070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:15.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.402+0000 7f536de00700 1 --2- 172.21.15.72:0/4225532788 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f535006dd50 0x7f5350070200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5354005090 tx=0x7f5354005fb0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.402+0000 7f536de00700 1 -- 172.21.15.72:0/4225532788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368100020 msgr2=0x7f53681958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:15.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.402+0000 7f536de00700 1 --2- 172.21.15.72:0/4225532788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368100020 0x7f53681958a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f535c00b4b0 tx=0x7f535c00b870 comp rx=0 tx=0).stop 2024-03-19T06:06:15.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.402+0000 7f536de00700 1 -- 172.21.15.72:0/4225532788 shutdown_connections 2024-03-19T06:06:15.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.402+0000 7f536de00700 1 --2- 172.21.15.72:0/4225532788 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f535006dd50 0x7f5350070200 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.402+0000 7f536de00700 1 --2- 172.21.15.72:0/4225532788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368100020 0x7f53681958a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.402+0000 7f536de00700 1 --2- 172.21.15.72:0/4225532788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53681012c0 0x7f5368195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.402+0000 7f536de00700 1 -- 172.21.15.72:0/4225532788 >> 172.21.15.72:0/4225532788 conn(0x7f53680fb650 msgr2=0x7f53681044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:15.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.403+0000 7f536de00700 1 -- 172.21.15.72:0/4225532788 shutdown_connections 2024-03-19T06:06:15.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.403+0000 7f536de00700 1 -- 172.21.15.72:0/4225532788 wait complete. 2024-03-19T06:06:15.396 INFO:tasks.workunit.client.0.smithi072.stdout:0/928: truncate d1/d1c/d24/d27/d7c/daa/fae 3192919 0 2024-03-19T06:06:15.399 INFO:tasks.workunit.client.0.smithi072.stdout:0/929: symlink d1/d2c/l135 0 2024-03-19T06:06:15.402 INFO:tasks.workunit.client.0.smithi072.stdout:0/930: mkdir d1/d1c/d24/d3f/de2/d136 0 2024-03-19T06:06:15.413 INFO:tasks.workunit.client.0.smithi072.stdout:0/931: write d1/d2c/da1/d85/f12d [1222108,125810] 0 2024-03-19T06:06:15.417 INFO:tasks.workunit.client.0.smithi072.stdout:0/932: symlink d1/d1c/d82/d90/dbe/l137 0 2024-03-19T06:06:15.424 INFO:tasks.workunit.client.0.smithi072.stdout:0/933: link d1/d1c/d82/de4/da6/d129/d125/deb/f106 d1/d2c/da1/d85/f138 0 2024-03-19T06:06:15.430 INFO:tasks.workunit.client.0.smithi072.stdout:0/934: symlink d1/d1c/d24/d3f/de2/d136/l139 0 2024-03-19T06:06:15.433 INFO:tasks.workunit.client.0.smithi072.stdout:0/935: fdatasync d1/d1c/d24/f32 0 2024-03-19T06:06:15.437 INFO:tasks.workunit.client.0.smithi072.stdout:6/817: sync 2024-03-19T06:06:15.437 INFO:tasks.workunit.client.0.smithi072.stdout:5/960: sync 2024-03-19T06:06:15.442 INFO:tasks.workunit.client.0.smithi072.stdout:6/818: creat d7/d9/d1e/f10f x:0 0 0 2024-03-19T06:06:15.448 INFO:tasks.workunit.client.0.smithi072.stdout:6/819: rename d7/d99/d60/d78/d7f/dcb/d84/cc9 to d7/d99/d60/ded/df4/d41/d92/c110 0 2024-03-19T06:06:15.450 INFO:tasks.workunit.client.0.smithi072.stdout:0/936: dread d1/d1c/d24/d27/f54 [0,4194304] 0 2024-03-19T06:06:15.454 INFO:tasks.workunit.client.0.smithi072.stdout:5/961: dwrite df/fa5 [0,4194304] 0 2024-03-19T06:06:15.454 INFO:tasks.workunit.client.0.smithi072.stdout:0/937: creat d1/d1c/d24/dfc/f13a x:0 0 0 2024-03-19T06:06:15.461 INFO:tasks.workunit.client.0.smithi072.stdout:5/962: symlink df/d13/d32/d28/dda/d111/l129 0 2024-03-19T06:06:15.462 INFO:tasks.workunit.client.0.smithi072.stdout:0/938: dread d1/d1c/d24/d27/d73/d80/fb3 [0,4194304] 0 2024-03-19T06:06:15.547 INFO:tasks.workunit.client.0.smithi072.stdout:5/963: creat df/d14/f12a x:0 0 0 2024-03-19T06:06:15.555 INFO:tasks.workunit.client.0.smithi072.stdout:0/939: link d1/d1c/d24/d8f/fd4 d1/d1c/d82/f13b 0 2024-03-19T06:06:15.564 INFO:tasks.workunit.client.0.smithi072.stdout:0/940: creat d1/d1c/d24/d27/d73/df7/f13c x:0 0 0 2024-03-19T06:06:15.568 INFO:tasks.workunit.client.0.smithi072.stdout:0/941: write d1/de7/f128 [3819110,21029] 0 2024-03-19T06:06:15.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.587+0000 7facb6000700 1 -- 172.21.15.72:0/1808552431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facb01012c0 msgr2=0x7facb0101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:15.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.587+0000 7facb6000700 1 --2- 172.21.15.72:0/1808552431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facb01012c0 0x7facb0101710 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009910 tx=0x7fac9c009c20 comp rx=0 tx=0).stop 2024-03-19T06:06:15.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.587+0000 7facb6000700 1 -- 172.21.15.72:0/1808552431 shutdown_connections 2024-03-19T06:06:15.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.587+0000 7facb6000700 1 --2- 172.21.15.72:0/1808552431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facb01012c0 0x7facb0101710 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.587+0000 7facb6000700 1 --2- 172.21.15.72:0/1808552431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb00fe2e0 0x7facb00fe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.587+0000 7facb6000700 1 -- 172.21.15.72:0/1808552431 >> 172.21.15.72:0/1808552431 conn(0x7facb00f9c30 msgr2=0x7facb00fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:15.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.587+0000 7facb6000700 1 -- 172.21.15.72:0/1808552431 shutdown_connections 2024-03-19T06:06:15.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.587+0000 7facb6000700 1 -- 172.21.15.72:0/1808552431 wait complete. 2024-03-19T06:06:15.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.588+0000 7facb6000700 1 Processor -- start 2024-03-19T06:06:15.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.588+0000 7facb6000700 1 -- start start 2024-03-19T06:06:15.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.588+0000 7facb6000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb00fe2e0 0x7facb0197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:15.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.588+0000 7facb6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facb01012c0 0x7facb0198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:15.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.588+0000 7facb6000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb01986b0 con 0x7facb01012c0 2024-03-19T06:06:15.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.588+0000 7facb6000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb01987f0 con 0x7facb00fe2e0 2024-03-19T06:06:15.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.589+0000 7facafe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facb01012c0 0x7facb0198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:15.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.589+0000 7facafe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facb01012c0 0x7facb0198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54032/0 (socket says 172.21.15.72:54032) 2024-03-19T06:06:15.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.589+0000 7facafe00700 1 -- 172.21.15.72:0/2240101066 learned_addr learned my addr 172.21.15.72:0/2240101066 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:15.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.589+0000 7facb4c00700 1 --2- 172.21.15.72:0/2240101066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb00fe2e0 0x7facb0197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:15.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.589+0000 7facafe00700 1 -- 172.21.15.72:0/2240101066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb00fe2e0 msgr2=0x7facb0197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:15.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.589+0000 7facafe00700 1 --2- 172.21.15.72:0/2240101066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb00fe2e0 0x7facb0197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.589+0000 7facafe00700 1 -- 172.21.15.72:0/2240101066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0095f0 con 0x7facb01012c0 2024-03-19T06:06:15.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.589+0000 7facafe00700 1 --2- 172.21.15.72:0/2240101066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facb01012c0 0x7facb0198090 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fac9c005b40 tx=0x7fac9c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:15.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.590+0000 7facad600700 1 -- 172.21.15.72:0/2240101066 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac9c01d070 con 0x7facb01012c0 2024-03-19T06:06:15.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.590+0000 7facad600700 1 -- 172.21.15.72:0/2240101066 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fac9c022470 con 0x7facb01012c0 2024-03-19T06:06:15.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.590+0000 7facb6000700 1 -- 172.21.15.72:0/2240101066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb019d240 con 0x7facb01012c0 2024-03-19T06:06:15.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.590+0000 7facad600700 1 -- 172.21.15.72:0/2240101066 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac9c00f690 con 0x7facb01012c0 2024-03-19T06:06:15.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.590+0000 7facb6000700 1 -- 172.21.15.72:0/2240101066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb019d7b0 con 0x7facb01012c0 2024-03-19T06:06:15.583 INFO:tasks.workunit.client.0.smithi072.stdout:5/964: write df/d16/f36 [541762,15436] 0 2024-03-19T06:06:15.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.591+0000 7facb6000700 1 -- 172.21.15.72:0/2240101066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb01053a0 con 0x7facb01012c0 2024-03-19T06:06:15.584 INFO:tasks.workunit.client.0.smithi072.stdout:0/942: write d1/fdb [19389,125839] 0 2024-03-19T06:06:15.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.593+0000 7facad600700 1 -- 172.21.15.72:0/2240101066 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 30) v1 ==== 91796+0+0 (secure 0 0 0) 0x7fac9c0225e0 con 0x7facb01012c0 2024-03-19T06:06:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.594+0000 7facad600700 1 --2- 172.21.15.72:0/2240101066 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fac9806dd50 0x7fac98070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.595+0000 7facad600700 1 -- 172.21.15.72:0/2240101066 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fac9c08f210 con 0x7facb01012c0 2024-03-19T06:06:15.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.595+0000 7facb4c00700 1 --2- 172.21.15.72:0/2240101066 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fac9806dd50 0x7fac98070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:15.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.596+0000 7facb4c00700 1 --2- 172.21.15.72:0/2240101066 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fac9806dd50 0x7fac98070200 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faca4006fd0 tx=0x7faca4008040 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:15.590 INFO:tasks.workunit.client.0.smithi072.stdout:0/943: unlink d1/d1c/d82/fe9 0 2024-03-19T06:06:15.591 INFO:tasks.workunit.client.0.smithi072.stdout:5/965: mknod df/d13/d32/d28/d42/d59/d43/d62/c12b 0 2024-03-19T06:06:15.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:15.600+0000 7facad600700 1 -- 172.21.15.72:0/2240101066 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fac9c05c520 con 0x7facb01012c0 2024-03-19T06:06:15.598 INFO:tasks.workunit.client.0.smithi072.stdout:0/944: truncate d1/d1c/d24/fed 969724 0 2024-03-19T06:06:15.599 INFO:tasks.workunit.client.0.smithi072.stdout:0/945: fsync d1/d1c/ff9 0 2024-03-19T06:06:15.601 INFO:tasks.workunit.client.0.smithi072.stdout:0/946: stat d1/d1c/d82/d90/dbe/cfd 0 2024-03-19T06:06:15.602 INFO:tasks.workunit.client.0.smithi072.stdout:0/947: readlink d1/d1c/d24/d27/d7c/l12f 0 2024-03-19T06:06:15.617 INFO:tasks.workunit.client.0.smithi072.stdout:0/948: write d1/d1c/d24/d27/d73/fda [1091312,20049] 0 2024-03-19T06:06:15.621 INFO:tasks.workunit.client.0.smithi072.stdout:0/949: stat d1/d1c/d24/d3f 0 2024-03-19T06:06:15.627 INFO:tasks.workunit.client.0.smithi072.stdout:0/950: mknod d1/d1c/d24/d27/d73/d80/c13d 0 2024-03-19T06:06:15.632 INFO:tasks.workunit.client.0.smithi072.stdout:0/951: mknod d1/d1c/d82/de4/da6/c13e 0 2024-03-19T06:06:15.635 INFO:tasks.workunit.client.0.smithi072.stdout:5/966: dread df/d13/d32/d28/d42/d59/d43/d4e/d5c/fde [0,4194304] 0 2024-03-19T06:06:15.642 INFO:tasks.workunit.client.0.smithi072.stdout:5/967: read df/d54/dac/d9c/fc3 [283612,7761] 0 2024-03-19T06:06:15.649 INFO:tasks.workunit.client.0.smithi072.stdout:5/968: mkdir df/d13/d32/d12c 0 2024-03-19T06:06:15.651 INFO:tasks.workunit.client.0.smithi072.stdout:0/952: write d1/d1c/d24/d27/fa2 [373463,115586] 0 2024-03-19T06:06:15.653 INFO:tasks.workunit.client.0.smithi072.stdout:5/969: chown df/d3c/ffd 15 1 2024-03-19T06:06:15.671 INFO:tasks.workunit.client.0.smithi072.stdout:5/970: dwrite df/d14/d5d/fad [0,4194304] 0 2024-03-19T06:06:15.673 INFO:tasks.workunit.client.0.smithi072.stdout:5/971: mknod df/d54/df5/c12d 0 2024-03-19T06:06:15.678 INFO:tasks.workunit.client.0.smithi072.stdout:5/972: rename df/d3c/d104/f114 to df/d54/df5/f12e 0 2024-03-19T06:06:15.693 INFO:tasks.workunit.client.0.smithi072.stdout:5/973: write df/d13/d32/d28/d42/d59/d43/f75 [3070337,62835] 0 2024-03-19T06:06:15.696 INFO:tasks.workunit.client.0.smithi072.stdout:5/974: stat df/d13/d32/d28/d42/d59/d43/d62/fc2 0 2024-03-19T06:06:15.698 INFO:tasks.workunit.client.0.smithi072.stdout:5/975: mknod df/d13/dff/c12f 0 2024-03-19T06:06:15.700 INFO:tasks.workunit.client.0.smithi072.stdout:5/976: mknod df/d13/d24/c130 0 2024-03-19T06:06:15.703 INFO:tasks.workunit.client.0.smithi072.stdout:5/977: creat df/d13/d24/f131 x:0 0 0 2024-03-19T06:06:15.717 INFO:tasks.workunit.client.0.smithi072.stdout:5/978: dwrite df/d3c/f35 [0,4194304] 0 2024-03-19T06:06:15.730 INFO:tasks.workunit.client.0.smithi072.stdout:5/979: write df/d13/f49 [232510,11982] 0 2024-03-19T06:06:15.731 INFO:tasks.workunit.client.0.smithi072.stdout:5/980: read df/d13/d32/d28/f81 [4005378,16645] 0 2024-03-19T06:06:15.731 INFO:tasks.workunit.client.0.smithi072.stdout:8/927: sync 2024-03-19T06:06:15.731 INFO:tasks.workunit.client.0.smithi072.stdout:1/887: sync 2024-03-19T06:06:15.731 INFO:tasks.workunit.client.0.smithi072.stdout:7/730: sync 2024-03-19T06:06:15.731 INFO:tasks.workunit.client.0.smithi072.stdout:2/989: sync 2024-03-19T06:06:15.731 INFO:tasks.workunit.client.0.smithi072.stdout:9/803: sync 2024-03-19T06:06:15.731 INFO:tasks.workunit.client.0.smithi072.stdout:3/863: sync 2024-03-19T06:06:15.735 INFO:tasks.workunit.client.0.smithi072.stdout:7/731: fdatasync d2/d3/d17/f77 0 2024-03-19T06:06:15.741 INFO:tasks.workunit.client.0.smithi072.stdout:8/928: unlink da/d27/d30/c10d 0 2024-03-19T06:06:15.745 INFO:tasks.workunit.client.0.smithi072.stdout:1/888: rename d1/l2d to d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/db8/l131 0 2024-03-19T06:06:15.748 INFO:tasks.workunit.client.0.smithi072.stdout:7/732: truncate d2/d3/d17/dc8/d1d/d2b/f6c 415747 0 2024-03-19T06:06:15.749 INFO:tasks.workunit.client.0.smithi072.stdout:2/990: write db/d10/d2b/d2d/d66/ff0 [1075189,89185] 0 2024-03-19T06:06:15.751 INFO:tasks.workunit.client.0.smithi072.stdout:8/929: creat da/d27/d52/d5b/d3e/d7d/d125/f13c x:0 0 0 2024-03-19T06:06:15.752 INFO:tasks.workunit.client.0.smithi072.stdout:5/981: getdents df/d14/d5d 0 2024-03-19T06:06:15.753 INFO:tasks.workunit.client.0.smithi072.stdout:7/733: rmdir d2/d3/d17/dc8/d53 39 2024-03-19T06:06:15.755 INFO:tasks.workunit.client.0.smithi072.stdout:2/991: chown db/d10/d59/f136 212 1 2024-03-19T06:06:15.759 INFO:tasks.workunit.client.0.smithi072.stdout:9/804: dwrite d11/d24/fc9 [0,4194304] 0 2024-03-19T06:06:15.760 INFO:tasks.workunit.client.0.smithi072.stdout:3/864: dwrite d2/d3/d15/d66/d70/fab [0,4194304] 0 2024-03-19T06:06:15.766 INFO:tasks.workunit.client.0.smithi072.stdout:9/805: chown d11/d24/d4c/dda/d68/d92/dc0/f10c 22 1 2024-03-19T06:06:15.768 INFO:tasks.workunit.client.0.smithi072.stdout:3/865: mknod d2/d40/d78/de9/c126 0 2024-03-19T06:06:15.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:15 smithi072 ceph-mon[28706]: pgmap v34: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 157 MiB/s wr, 402 op/s 2024-03-19T06:06:15.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:15 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/806764290' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:06:15.865 INFO:tasks.workunit.client.0.smithi072.stdout:9/806: write d11/d24/d4c/dda/d36/d45/d5b/fbe [716789,9250] 0 2024-03-19T06:06:15.871 INFO:tasks.workunit.client.0.smithi072.stdout:8/930: link da/d27/d30/l6d da/d27/d52/d5b/d3e/l13d 0 2024-03-19T06:06:15.881 INFO:tasks.workunit.client.0.smithi072.stdout:5/982: dwrite df/d13/d32/d28/d42/d59/d43/d4e/fdd [0,4194304] 0 2024-03-19T06:06:15.885 INFO:tasks.workunit.client.0.smithi072.stdout:5/983: fdatasync df/d3c/ffd 0 2024-03-19T06:06:15.886 INFO:tasks.workunit.client.0.smithi072.stdout:8/931: creat da/d13/d3f/f13e x:0 0 0 2024-03-19T06:06:15.889 INFO:tasks.workunit.client.0.smithi072.stdout:8/932: read da/d13/d14/d1b/fbb [2750579,71298] 0 2024-03-19T06:06:15.896 INFO:tasks.workunit.client.0.smithi072.stdout:5/984: mknod df/d13/d32/d28/d42/d59/d43/d4e/dbd/c132 0 2024-03-19T06:06:15.900 INFO:tasks.workunit.client.0.smithi072.stdout:1/889: dread d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d52/f7c [0,4194304] 0 2024-03-19T06:06:15.900 INFO:tasks.workunit.client.0.smithi072.stdout:8/933: fdatasync da/d13/d14/d1b/d6b/daa/fce 0 2024-03-19T06:06:15.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:15 smithi172 ceph-mon[35716]: pgmap v34: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 157 MiB/s wr, 402 op/s 2024-03-19T06:06:15.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:15 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/806764290' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:06:15.904 INFO:tasks.workunit.client.0.smithi072.stdout:5/985: fsync df/d16/dc4/f115 0 2024-03-19T06:06:15.907 INFO:tasks.workunit.client.0.smithi072.stdout:3/866: dwrite d2/d75/fea [0,4194304] 0 2024-03-19T06:06:15.912 INFO:tasks.workunit.client.0.smithi072.stdout:8/934: write da/d37/f93 [4148108,81065] 0 2024-03-19T06:06:15.913 INFO:tasks.workunit.client.0.smithi072.stdout:1/890: stat d1/d11/d76/da7/d9e/d117/dd8/l5d 0 2024-03-19T06:06:15.919 INFO:tasks.workunit.client.0.smithi072.stdout:5/986: symlink df/d13/d32/d28/d42/d59/d43/d4e/d5c/l133 0 2024-03-19T06:06:15.920 INFO:tasks.workunit.client.0.smithi072.stdout:7/734: dread d2/d3/d17/f48 [0,4194304] 0 2024-03-19T06:06:15.922 INFO:tasks.workunit.client.0.smithi072.stdout:1/891: symlink d1/d11/d76/da7/d9e/d117/dd8/d19/l132 0 2024-03-19T06:06:15.923 INFO:tasks.workunit.client.0.smithi072.stdout:3/867: rename d2/d3/d25/ca6 to d2/d3/d26/c127 0 2024-03-19T06:06:15.925 INFO:tasks.workunit.client.0.smithi072.stdout:7/735: readlink d2/d3/d17/dc8/d1d/d2b/d3d/l42 0 2024-03-19T06:06:15.936 INFO:tasks.workunit.client.0.smithi072.stdout:7/736: write d2/d3/d17/dc8/d53/dbd/fd8 [646651,79312] 0 2024-03-19T06:06:15.941 INFO:tasks.workunit.client.0.smithi072.stdout:8/935: dwrite da/d62/f128 [0,4194304] 0 2024-03-19T06:06:15.943 INFO:tasks.workunit.client.0.smithi072.stdout:1/892: write d1/d11/d76/da7/d9e/d117/dd8/d63/d73/fce [4796771,122027] 0 2024-03-19T06:06:15.945 INFO:tasks.workunit.client.0.smithi072.stdout:7/737: read d2/d8c/dba/dbc/fd2 [1994915,49179] 0 2024-03-19T06:06:15.951 INFO:tasks.workunit.client.0.smithi072.stdout:7/738: mknod d2/d3/d17/dc8/d1d/d3b/d9a/ce8 0 2024-03-19T06:06:15.951 INFO:tasks.workunit.client.0.smithi072.stdout:8/936: link da/f51 da/d27/d52/d5b/f13f 0 2024-03-19T06:06:15.952 INFO:tasks.workunit.client.0.smithi072.stdout:1/893: creat d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/d65/f133 x:0 0 0 2024-03-19T06:06:15.956 INFO:tasks.workunit.client.0.smithi072.stdout:7/739: symlink d2/d3/d18/d7f/dda/le9 0 2024-03-19T06:06:15.970 INFO:tasks.workunit.client.0.smithi072.stdout:8/937: dwrite da/d13/d3f/db9/fd6 [0,4194304] 0 2024-03-19T06:06:15.973 INFO:tasks.workunit.client.0.smithi072.stdout:1/894: dwrite d1/d11/d76/da7/d9e/d117/fbf [0,4194304] 0 2024-03-19T06:06:15.974 INFO:tasks.workunit.client.0.smithi072.stdout:7/740: link d2/d3/d18/d20/d3a/lc6 d2/d3/d17/dc8/d1d/d3b/d9a/d9b/dd6/lea 0 2024-03-19T06:06:15.975 INFO:tasks.workunit.client.0.smithi072.stdout:7/741: chown d2/c7e 17788 1 2024-03-19T06:06:15.981 INFO:tasks.workunit.client.0.smithi072.stdout:1/895: mknod d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/dc7/c134 0 2024-03-19T06:06:15.981 INFO:tasks.workunit.client.0.smithi072.stdout:7/742: creat d2/d3/d17/dc8/d53/dca/feb x:0 0 0 2024-03-19T06:06:15.985 INFO:tasks.workunit.client.0.smithi072.stdout:8/938: creat da/d62/d11a/f140 x:0 0 0 2024-03-19T06:06:15.999 INFO:tasks.workunit.client.0.smithi072.stdout:8/939: stat da/d13/d14/d1b/ca1 0 2024-03-19T06:06:15.999 INFO:tasks.workunit.client.0.smithi072.stdout:1/896: rmdir d1/d11/d76/da7/d9e/d117/dd8/ddb 0 2024-03-19T06:06:16.003 INFO:tasks.workunit.client.0.smithi072.stdout:7/743: getdents d2/d3/d17/dc8/d1d/d2b/d75 0 2024-03-19T06:06:16.004 INFO:tasks.workunit.client.0.smithi072.stdout:1/897: creat d1/d11/d76/da7/d9e/d117/dd8/d19/d72/f135 x:0 0 0 2024-03-19T06:06:16.004 INFO:tasks.workunit.client.0.smithi072.stdout:8/940: truncate da/d27/dc2/ff0 290779 0 2024-03-19T06:06:16.005 INFO:tasks.workunit.client.0.smithi072.stdout:7/744: chown d2/d3/d17/dc8/d1d/d2b/d3d 7168 1 2024-03-19T06:06:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.041+0000 7facb6000700 1 -- 172.21.15.72:0/2240101066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7facb002cdf0 con 0x7facb01012c0 2024-03-19T06:06:16.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.042+0000 7facad600700 1 -- 172.21.15.72:0/2240101066 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fac9c0270e0 con 0x7facb01012c0 2024-03-19T06:06:16.033 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:06:16.034 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:06:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:06:16.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.045+0000 7facb6000700 1 -- 172.21.15.72:0/2240101066 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fac9806dd50 msgr2=0x7fac98070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.045+0000 7facb6000700 1 --2- 172.21.15.72:0/2240101066 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fac9806dd50 0x7fac98070200 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faca4006fd0 tx=0x7faca4008040 comp rx=0 tx=0).stop 2024-03-19T06:06:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.045+0000 7facb6000700 1 -- 172.21.15.72:0/2240101066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facb01012c0 msgr2=0x7facb0198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.045+0000 7facb6000700 1 --2- 172.21.15.72:0/2240101066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facb01012c0 0x7facb0198090 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fac9c005b40 tx=0x7fac9c00be20 comp rx=0 tx=0).stop 2024-03-19T06:06:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.045+0000 7facb6000700 1 -- 172.21.15.72:0/2240101066 shutdown_connections 2024-03-19T06:06:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.045+0000 7facb6000700 1 --2- 172.21.15.72:0/2240101066 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fac9806dd50 0x7fac98070200 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.045+0000 7facb6000700 1 --2- 172.21.15.72:0/2240101066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb00fe2e0 0x7facb0197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.045+0000 7facb6000700 1 --2- 172.21.15.72:0/2240101066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facb01012c0 0x7facb0198090 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.045+0000 7facb6000700 1 -- 172.21.15.72:0/2240101066 >> 172.21.15.72:0/2240101066 conn(0x7facb00f9c30 msgr2=0x7facb01024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.045+0000 7facb6000700 1 -- 172.21.15.72:0/2240101066 shutdown_connections 2024-03-19T06:06:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:16.045+0000 7facb6000700 1 -- 172.21.15.72:0/2240101066 wait complete. 2024-03-19T06:06:16.119 INFO:tasks.workunit.client.0.smithi072.stdout:7/745: creat d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/fec x:0 0 0 2024-03-19T06:06:16.128 INFO:tasks.workunit.client.0.smithi072.stdout:8/941: rmdir da/d27/d52/d5b/d3e/d7d/db7 0 2024-03-19T06:06:16.134 INFO:tasks.workunit.client.0.smithi072.stdout:7/746: unlink d2/d3/d17/dc8/d1d/d3b/l51 0 2024-03-19T06:06:16.139 INFO:tasks.workunit.client.0.smithi072.stdout:8/942: creat da/d62/f141 x:0 0 0 2024-03-19T06:06:16.148 INFO:tasks.workunit.client.0.smithi072.stdout:7/747: rmdir d2/d3/d18/d7f 39 2024-03-19T06:06:16.166 INFO:tasks.workunit.client.0.smithi072.stdout:1/898: dwrite d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/f3e [0,4194304] 0 2024-03-19T06:06:16.211 INFO:tasks.workunit.client.0.smithi072.stdout:8/943: symlink da/d27/d52/l142 0 2024-03-19T06:06:16.213 INFO:tasks.workunit.client.0.smithi072.stdout:1/899: symlink d1/d11/d76/da7/d9e/d102/l136 0 2024-03-19T06:06:16.215 INFO:tasks.workunit.client.0.smithi072.stdout:7/748: write d2/d3/d18/d7f/db3/fe2 [826927,14028] 0 2024-03-19T06:06:16.216 INFO:tasks.workunit.client.0.smithi072.stdout:8/944: creat da/d62/f143 x:0 0 0 2024-03-19T06:06:16.222 INFO:tasks.workunit.client.0.smithi072.stdout:0/953: sync 2024-03-19T06:06:16.222 INFO:tasks.workunit.client.0.smithi072.stdout:6/820: sync 2024-03-19T06:06:16.224 INFO:tasks.workunit.client.0.smithi072.stdout:8/945: rmdir da/d3b 39 2024-03-19T06:06:16.225 INFO:tasks.workunit.client.0.smithi072.stdout:0/954: stat d1/d1c/d82/de4/da6/d129/d125 0 2024-03-19T06:06:16.226 INFO:tasks.workunit.client.0.smithi072.stdout:7/749: fdatasync d2/d3/d17/f69 0 2024-03-19T06:06:16.230 INFO:tasks.workunit.client.0.smithi072.stdout:0/955: readlink d1/d1c/d24/d27/d73/d80/d8b/l61 0 2024-03-19T06:06:16.230 INFO:tasks.workunit.client.0.smithi072.stdout:8/946: write da/d27/d52/d5b/fb3 [944734,7785] 0 2024-03-19T06:06:16.234 INFO:tasks.workunit.client.0.smithi072.stdout:1/900: dread d1/d11/d76/da7/d9e/fbc [0,4194304] 0 2024-03-19T06:06:16.238 INFO:tasks.workunit.client.0.smithi072.stdout:0/956: rename d1/d2c/fd9 to d1/d1c/d24/d27/d7c/daa/f13f 0 2024-03-19T06:06:16.239 INFO:tasks.workunit.client.0.smithi072.stdout:6/821: dread d7/f15 [0,4194304] 0 2024-03-19T06:06:16.241 INFO:tasks.workunit.client.0.smithi072.stdout:8/947: creat da/d13/d14/d1b/d57/dd7/f144 x:0 0 0 2024-03-19T06:06:16.243 INFO:tasks.workunit.client.0.smithi072.stdout:1/901: creat d1/d11/d76/da7/d9e/d117/dfd/f137 x:0 0 0 2024-03-19T06:06:16.244 INFO:tasks.workunit.client.0.smithi072.stdout:1/902: dread - d1/d11/d76/fab zero size 2024-03-19T06:06:16.247 INFO:tasks.workunit.client.0.smithi072.stdout:8/948: write da/d13/d14/d1b/fbb [2385722,7556] 0 2024-03-19T06:06:16.252 INFO:tasks.workunit.client.0.smithi072.stdout:1/903: mknod d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/dc7/d128/c138 0 2024-03-19T06:06:16.262 INFO:tasks.workunit.client.0.smithi072.stdout:1/904: unlink d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d79/f108 0 2024-03-19T06:06:16.267 INFO:tasks.workunit.client.0.smithi072.stdout:1/905: chown d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/d65/fc6 3145 1 2024-03-19T06:06:16.270 INFO:tasks.workunit.client.0.smithi072.stdout:7/750: dwrite d2/d3/d17/f69 [0,4194304] 0 2024-03-19T06:06:16.270 INFO:tasks.workunit.client.0.smithi072.stdout:6/822: dread d7/d3f/d65/f77 [0,4194304] 0 2024-03-19T06:06:16.274 INFO:tasks.workunit.client.0.smithi072.stdout:6/823: fsync d7/d9/d1b/d3b/f8c 0 2024-03-19T06:06:16.275 INFO:tasks.workunit.client.0.smithi072.stdout:8/949: dread da/d13/d14/f17 [4194304,4194304] 0 2024-03-19T06:06:16.276 INFO:tasks.workunit.client.0.smithi072.stdout:7/751: mkdir d2/d3/d17/dc8/d1d/d3b/d9a/ded 0 2024-03-19T06:06:16.278 INFO:tasks.workunit.client.0.smithi072.stdout:1/906: rename d1/d11/d76/da7/d9e/d102/l10b to d1/d11/d76/da7/d9e/d117/dd8/d63/d73/l139 0 2024-03-19T06:06:16.279 INFO:tasks.workunit.client.0.smithi072.stdout:6/824: dread - d7/d99/d60/ded/df4/d41/d92/fb3 zero size 2024-03-19T06:06:16.287 INFO:tasks.workunit.client.0.smithi072.stdout:7/752: rename d2/d3/d18/d20/d3a/lc6 to d2/d3/d17/dc8/d1d/lee 0 2024-03-19T06:06:16.288 INFO:tasks.workunit.client.0.smithi072.stdout:6/825: creat d7/d9/d1b/d3b/d9b/dab/d100/f111 x:0 0 0 2024-03-19T06:06:16.289 INFO:tasks.workunit.client.0.smithi072.stdout:7/753: mkdir d2/d3/d18/d20/def 0 2024-03-19T06:06:16.298 INFO:tasks.workunit.client.0.smithi072.stdout:8/950: dwrite da/d13/d14/d1b/d57/dd7/f130 [0,4194304] 0 2024-03-19T06:06:16.304 INFO:tasks.workunit.client.0.smithi072.stdout:1/907: dwrite d1/d11/d76/da7/d9e/d117/dd8/d63/df2/f129 [0,4194304] 0 2024-03-19T06:06:16.309 INFO:tasks.workunit.client.0.smithi072.stdout:6/826: truncate d7/d9/d1b/f2a 2156726 0 2024-03-19T06:06:16.309 INFO:tasks.workunit.client.0.smithi072.stdout:7/754: dread d2/d3/d17/dc8/d1d/d3b/d63/fcb [0,4194304] 0 2024-03-19T06:06:16.309 INFO:tasks.workunit.client.0.smithi072.stdout:8/951: mkdir da/d27/d52/d5b/d3e/d7d/d97/d145 0 2024-03-19T06:06:16.313 INFO:tasks.workunit.client.0.smithi072.stdout:7/755: truncate d2/d3/fe5 977944 0 2024-03-19T06:06:16.314 INFO:tasks.workunit.client.0.smithi072.stdout:8/952: read da/d13/d14/d1b/d57/dd7/f130 [1950098,125885] 0 2024-03-19T06:06:16.316 INFO:tasks.workunit.client.0.smithi072.stdout:7/756: chown d2/d8c/da9/ce0 3256706 1 2024-03-19T06:06:16.317 INFO:tasks.workunit.client.0.smithi072.stdout:1/908: rename d1/d11/d76/da7/d9e/d117/dd8/d19/c4a to d1/d11/d76/da7/d9e/d117/dd8/d63/d73/c13a 0 2024-03-19T06:06:16.319 INFO:tasks.workunit.client.0.smithi072.stdout:8/953: symlink da/d13/d1d/d10e/d8d/l146 0 2024-03-19T06:06:16.320 INFO:tasks.workunit.client.0.smithi072.stdout:6/827: rename d7/d3f/f5f to d7/d3f/d65/f112 0 2024-03-19T06:06:16.325 INFO:tasks.workunit.client.0.smithi072.stdout:7/757: mkdir d2/d3/d18/d7f/d85/df0 0 2024-03-19T06:06:16.330 INFO:tasks.workunit.client.0.smithi072.stdout:7/758: fsync d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/fd0 0 2024-03-19T06:06:16.331 INFO:tasks.workunit.client.0.smithi072.stdout:8/954: dread da/d13/d1d/d10e/f122 [0,4194304] 0 2024-03-19T06:06:16.332 INFO:tasks.workunit.client.0.smithi072.stdout:1/909: getdents d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/def/d112 0 2024-03-19T06:06:16.335 INFO:tasks.workunit.client.0.smithi072.stdout:8/955: mknod da/d27/d52/d100/d12e/c147 0 2024-03-19T06:06:16.337 INFO:tasks.workunit.client.0.smithi072.stdout:8/956: stat da/d13/d14/d1b/d57/f5d 0 2024-03-19T06:06:16.340 INFO:tasks.workunit.client.0.smithi072.stdout:8/957: rmdir da/d13/d14/d6f 39 2024-03-19T06:06:16.342 INFO:tasks.workunit.client.0.smithi072.stdout:8/958: mknod da/d13/d3f/dac/c148 0 2024-03-19T06:06:16.343 INFO:tasks.workunit.client.0.smithi072.stdout:6/828: write d7/d99/d60/ded/df4/d41/f59 [8169869,85507] 0 2024-03-19T06:06:16.346 INFO:tasks.workunit.client.0.smithi072.stdout:8/959: readlink da/d13/d14/d1b/d57/dd7/le9 0 2024-03-19T06:06:16.348 INFO:tasks.workunit.client.0.smithi072.stdout:6/829: chown d7/d9/d1b/d21/d68/lcd 1845031605 1 2024-03-19T06:06:16.354 INFO:tasks.workunit.client.0.smithi072.stdout:7/759: dwrite d2/d3/d18/d88/fae [0,4194304] 0 2024-03-19T06:06:16.355 INFO:tasks.workunit.client.0.smithi072.stdout:8/960: rmdir da/d13/d14/d1b/d10a 0 2024-03-19T06:06:16.356 INFO:tasks.workunit.client.0.smithi072.stdout:1/910: dwrite d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d79/fca [0,4194304] 0 2024-03-19T06:06:16.361 INFO:tasks.workunit.client.0.smithi072.stdout:7/760: rename d2/d3 to d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/df1 22 2024-03-19T06:06:16.365 INFO:tasks.workunit.client.0.smithi072.stdout:1/911: chown d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/l125 165919 1 2024-03-19T06:06:16.365 INFO:tasks.workunit.client.0.smithi072.stdout:7/761: dread - d2/d3/d17/dc8/d53/dca/fe7 zero size 2024-03-19T06:06:16.369 INFO:tasks.workunit.client.0.smithi072.stdout:6/830: dwrite d7/d3f/d65/fa2 [0,4194304] 0 2024-03-19T06:06:16.370 INFO:tasks.workunit.client.0.smithi072.stdout:8/961: link da/d13/d14/d1b/d57/c58 da/d13/d14/d1b/d57/dd7/c149 0 2024-03-19T06:06:16.371 INFO:tasks.workunit.client.0.smithi072.stdout:7/762: fdatasync d2/d3/d17/dc8/d1d/d3b/d63/fcb 0 2024-03-19T06:06:16.372 INFO:tasks.workunit.client.0.smithi072.stdout:1/912: symlink d1/d11/d76/da7/d9e/d117/dd8/d63/d73/l13b 0 2024-03-19T06:06:16.377 INFO:tasks.workunit.client.0.smithi072.stdout:6/831: mknod d7/d9/d1b/d3b/d9b/dab/c113 0 2024-03-19T06:06:16.377 INFO:tasks.workunit.client.0.smithi072.stdout:7/763: mkdir d2/d8c/dab/df2 0 2024-03-19T06:06:16.380 INFO:tasks.workunit.client.0.smithi072.stdout:7/764: chown d2/d3/d17/dc8/d1d/d3b/d9a/d9b/fdb 408767 1 2024-03-19T06:06:16.385 INFO:tasks.workunit.client.0.smithi072.stdout:7/765: write d2/d3/d17/dc8/d53/dca/feb [859088,34133] 0 2024-03-19T06:06:16.387 INFO:tasks.workunit.client.0.smithi072.stdout:6/832: link d7/d9/d1b/d3b/c3e d7/d9/d30/c114 0 2024-03-19T06:06:16.391 INFO:tasks.workunit.client.0.smithi072.stdout:8/962: dwrite da/d13/d14/d1b/d6b/fca [0,4194304] 0 2024-03-19T06:06:16.392 INFO:tasks.workunit.client.0.smithi072.stdout:7/766: link d2/d3/d17/dc8/ld9 d2/d8c/dba/lf3 0 2024-03-19T06:06:16.393 INFO:tasks.workunit.client.0.smithi072.stdout:6/833: write d7/d9/d1b/d3b/d48/ff9 [8087758,66989] 0 2024-03-19T06:06:16.395 INFO:tasks.workunit.client.0.smithi072.stdout:6/834: stat d7/d99/d60/l66 0 2024-03-19T06:06:16.399 INFO:tasks.workunit.client.0.smithi072.stdout:8/963: dread da/d37/f73 [0,4194304] 0 2024-03-19T06:06:16.402 INFO:tasks.workunit.client.0.smithi072.stdout:1/913: dwrite d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/db8/ff0 [0,4194304] 0 2024-03-19T06:06:16.403 INFO:tasks.workunit.client.0.smithi072.stdout:7/767: getdents d2/d3/d18/d2f 0 2024-03-19T06:06:16.406 INFO:tasks.workunit.client.0.smithi072.stdout:8/964: unlink da/d13/d14/d1b/d6b/daa/fce 0 2024-03-19T06:06:16.409 INFO:tasks.workunit.client.0.smithi072.stdout:1/914: write d1/d11/d76/f97 [572768,109916] 0 2024-03-19T06:06:16.410 INFO:tasks.workunit.client.0.smithi072.stdout:7/768: unlink d2/d8c/dba/lf3 0 2024-03-19T06:06:16.411 INFO:tasks.workunit.client.0.smithi072.stdout:8/965: write da/d13/d14/d1b/d57/dd7/f144 [97056,80706] 0 2024-03-19T06:06:16.414 INFO:tasks.workunit.client.0.smithi072.stdout:8/966: readlink da/d27/d52/d88/lf8 0 2024-03-19T06:06:16.420 INFO:tasks.workunit.client.0.smithi072.stdout:6/835: write d7/d9/d1b/d31/d96/f108 [500888,128627] 0 2024-03-19T06:06:16.421 INFO:tasks.workunit.client.0.smithi072.stdout:7/769: link d2/d3/d18/d7f/f97 d2/d3/d17/dc8/d1d/d3b/d9a/d9b/dd6/ddd/ff4 0 2024-03-19T06:06:16.423 INFO:tasks.workunit.client.0.smithi072.stdout:1/915: write d1/f6 [1241401,14426] 0 2024-03-19T06:06:16.428 INFO:tasks.workunit.client.0.smithi072.stdout:6/836: creat d7/d99/d60/ded/df4/d41/d92/f115 x:0 0 0 2024-03-19T06:06:16.431 INFO:tasks.workunit.client.0.smithi072.stdout:7/770: readlink d2/d3/d17/dc8/d1d/d3b/d63/d84/la7 0 2024-03-19T06:06:16.433 INFO:tasks.workunit.client.0.smithi072.stdout:6/837: rename d7/d3f/f42 to d7/d99/d60/ded/f116 0 2024-03-19T06:06:16.434 INFO:tasks.workunit.client.0.smithi072.stdout:8/967: dwrite da/d27/faf [0,4194304] 0 2024-03-19T06:06:16.434 INFO:tasks.workunit.client.0.smithi072.stdout:1/916: write d1/f8e [1540309,38912] 0 2024-03-19T06:06:16.435 INFO:tasks.workunit.client.0.smithi072.stdout:7/771: write d2/d3/d17/dc8/fa6 [1346424,93811] 0 2024-03-19T06:06:16.438 INFO:tasks.workunit.client.0.smithi072.stdout:7/772: fsync d2/d8c/dba/dbc/fb8 0 2024-03-19T06:06:16.439 INFO:tasks.workunit.client.0.smithi072.stdout:6/838: rmdir d7/d99 39 2024-03-19T06:06:16.439 INFO:tasks.workunit.client.0.smithi072.stdout:1/917: symlink d1/d11/d76/da7/d9e/d117/dd8/d19/l13c 0 2024-03-19T06:06:16.447 INFO:tasks.workunit.client.0.smithi072.stdout:6/839: creat d7/d9/d1b/d3b/d9b/da4/f117 x:0 0 0 2024-03-19T06:06:16.447 INFO:tasks.workunit.client.0.smithi072.stdout:8/968: link da/d27/d52/d100/d8e/dc7/c127 da/d3b/da7/d105/c14a 0 2024-03-19T06:06:16.448 INFO:tasks.workunit.client.0.smithi072.stdout:1/918: symlink d1/d11/d76/da7/d9e/d117/dd8/d19/de3/d114/l13d 0 2024-03-19T06:06:16.455 INFO:tasks.workunit.client.0.smithi072.stdout:6/840: rename d7/d9/d1e/d105 to d7/d9/d1b/d31/da6/d118 0 2024-03-19T06:06:16.456 INFO:tasks.workunit.client.0.smithi072.stdout:1/919: rmdir d1/d11/d76/da7/d9e/d117/dd8/d19 39 2024-03-19T06:06:16.457 INFO:tasks.workunit.client.0.smithi072.stdout:7/773: dwrite d2/d8c/dba/dbc/fb8 [0,4194304] 0 2024-03-19T06:06:16.461 INFO:tasks.workunit.client.0.smithi072.stdout:6/841: unlink d7/d3f/d65/l9a 0 2024-03-19T06:06:16.593 INFO:tasks.workunit.client.0.smithi072.stdout:2/992: sync 2024-03-19T06:06:16.600 INFO:tasks.workunit.client.0.smithi072.stdout:6/842: chown d7/d9/d1b/d3b/d9b/da4/fea 65567987 1 2024-03-19T06:06:16.606 INFO:tasks.workunit.client.0.smithi072.stdout:2/993: fdatasync db/d10/d13/d24/d61/d7d/f95 0 2024-03-19T06:06:16.610 INFO:tasks.workunit.client.0.smithi072.stdout:6/843: mknod d7/d9/d1b/d21/c119 0 2024-03-19T06:06:16.617 INFO:tasks.workunit.client.0.smithi072.stdout:2/994: symlink db/d10/d13/d24/d72/l15f 0 2024-03-19T06:06:16.623 INFO:tasks.workunit.client.0.smithi072.stdout:6/844: symlink d7/d99/l11a 0 2024-03-19T06:06:16.624 INFO:tasks.workunit.client.0.smithi072.stdout:7/774: write d2/d3/d18/d7f/db3/f72 [1406904,18897] 0 2024-03-19T06:06:16.631 INFO:tasks.workunit.client.0.smithi072.stdout:2/995: chown db/d10/d13/d24/d61/d14e/d98/dbf/l129 632744 1 2024-03-19T06:06:16.631 INFO:tasks.workunit.client.0.smithi072.stdout:6/845: dread - d7/d9/d1b/d21/fcf zero size 2024-03-19T06:06:16.631 INFO:tasks.workunit.client.0.smithi072.stdout:1/920: dwrite d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/fdf [0,4194304] 0 2024-03-19T06:06:16.635 INFO:tasks.workunit.client.0.smithi072.stdout:6/846: readlink d7/d99/l11a 0 2024-03-19T06:06:16.637 INFO:tasks.workunit.client.0.smithi072.stdout:7/775: mknod d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/cf5 0 2024-03-19T06:06:16.644 INFO:tasks.workunit.client.0.smithi072.stdout:1/921: dread - d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/f11e zero size 2024-03-19T06:06:16.645 INFO:tasks.workunit.client.0.smithi072.stdout:6/847: mkdir d7/d9/d1b/d3b/d48/d11b 0 2024-03-19T06:06:16.648 INFO:tasks.workunit.client.0.smithi072.stdout:7/776: readlink d2/d3/d17/dc8/d1d/d2b/le4 0 2024-03-19T06:06:16.652 INFO:tasks.workunit.client.0.smithi072.stdout:7/777: chown d2/d3/d17/l64 504223094 1 2024-03-19T06:06:16.654 INFO:tasks.workunit.client.0.smithi072.stdout:7/778: readlink d2/d3/d17/dc8/d1d/d2b/le4 0 2024-03-19T06:06:16.654 INFO:tasks.workunit.client.0.smithi072.stdout:1/922: creat d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/f13e x:0 0 0 2024-03-19T06:06:16.655 INFO:tasks.workunit.client.0.smithi072.stdout:6/848: mknod d7/d9/c11c 0 2024-03-19T06:06:16.659 INFO:tasks.workunit.client.0.smithi072.stdout:6/849: mknod d7/d9/d1b/c11d 0 2024-03-19T06:06:16.662 INFO:tasks.workunit.client.0.smithi072.stdout:7/779: mkdir d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/d86/da1/df6 0 2024-03-19T06:06:16.666 INFO:tasks.workunit.client.0.smithi072.stdout:2/996: write db/d10/d13/d24/d72/d86/dde/f11f [391605,105213] 0 2024-03-19T06:06:16.672 INFO:tasks.workunit.client.0.smithi072.stdout:7/780: dread d2/d3/d18/d7f/f97 [0,4194304] 0 2024-03-19T06:06:16.674 INFO:tasks.workunit.client.0.smithi072.stdout:2/997: rmdir db/d10/d2b 39 2024-03-19T06:06:16.679 INFO:tasks.workunit.client.0.smithi072.stdout:2/998: truncate db/d10/d13/df4/d103/ddb/fff 204259 0 2024-03-19T06:06:16.685 INFO:tasks.workunit.client.0.smithi072.stdout:7/781: dread d2/d8c/dba/dbc/fb8 [0,4194304] 0 2024-03-19T06:06:16.686 INFO:tasks.workunit.client.0.smithi072.stdout:1/923: dwrite d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/d65/fc6 [0,4194304] 0 2024-03-19T06:06:16.687 INFO:tasks.workunit.client.0.smithi072.stdout:6/850: dwrite d7/d9/d1b/f2a [0,4194304] 0 2024-03-19T06:06:16.690 INFO:tasks.workunit.client.0.smithi072.stdout:0/957: sync 2024-03-19T06:06:16.690 INFO:tasks.workunit.client.0.smithi072.stdout:3/868: sync 2024-03-19T06:06:16.690 INFO:tasks.workunit.client.0.smithi072.stdout:9/807: sync 2024-03-19T06:06:16.690 INFO:tasks.workunit.client.0.smithi072.stdout:5/987: sync 2024-03-19T06:06:16.691 INFO:tasks.workunit.client.0.smithi072.stdout:2/999: write db/f4f [524501,130071] 0 2024-03-19T06:06:16.695 INFO:tasks.workunit.client.0.smithi072.stdout:7/782: rename d2/d3/d18/d7f/db3/f72 to d2/d8c/da9/ff7 0 2024-03-19T06:06:16.695 INFO:tasks.workunit.client.0.smithi072.stdout:1/924: mknod d1/d11/d76/da7/d9e/c13f 0 2024-03-19T06:06:16.697 INFO:tasks.workunit.client.0.smithi072.stdout:6/851: symlink d7/d3f/d65/l11e 0 2024-03-19T06:06:16.697 INFO:tasks.workunit.client.0.smithi072.stdout:3/869: mknod d2/d3/d25/c128 0 2024-03-19T06:06:16.699 INFO:tasks.workunit.client.0.smithi072.stdout:0/958: creat d1/d1c/d89/d9d/f140 x:0 0 0 2024-03-19T06:06:16.701 INFO:tasks.workunit.client.0.smithi072.stdout:6/852: stat d7/d99/d60/ded/f109 0 2024-03-19T06:06:16.710 INFO:tasks.workunit.client.0.smithi072.stdout:3/870: fdatasync d2/d19/db0/dcb/fcf 0 2024-03-19T06:06:16.710 INFO:tasks.workunit.client.0.smithi072.stdout:7/783: rename d2/d3/d17/dc8/d1d/d3b/d9a/d9b/dd6/ddd/ff4 to d2/d3/d18/d20/d3a/ff8 0 2024-03-19T06:06:16.712 INFO:tasks.workunit.client.0.smithi072.stdout:6/853: mknod d7/d9/d1b/d3b/d9b/c11f 0 2024-03-19T06:06:16.714 INFO:tasks.workunit.client.0.smithi072.stdout:6/854: chown d7/d9/d1b/d3b/d9b/da4/fea 609018205 1 2024-03-19T06:06:16.718 INFO:tasks.workunit.client.0.smithi072.stdout:0/959: mkdir d1/d2c/da1/d85/d110/d141 0 2024-03-19T06:06:16.724 INFO:tasks.workunit.client.0.smithi072.stdout:0/960: symlink d1/d1c/d82/de4/da6/d129/d125/deb/l142 0 2024-03-19T06:06:16.725 INFO:tasks.workunit.client.0.smithi072.stdout:5/988: write df/d13/d32/d28/d42/d59/d43/d4e/dbd/ff7 [831676,57650] 0 2024-03-19T06:06:16.731 INFO:tasks.workunit.client.0.smithi072.stdout:0/961: chown d1/d2c/da1/c69 61518 1 2024-03-19T06:06:16.733 INFO:tasks.workunit.client.0.smithi072.stdout:7/784: dwrite d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/f78 [0,4194304] 0 2024-03-19T06:06:16.740 INFO:tasks.workunit.client.0.smithi072.stdout:6/855: dwrite d7/d9/d1b/d3b/d9b/dab/d100/f111 [0,4194304] 0 2024-03-19T06:06:16.747 INFO:tasks.workunit.client.0.smithi072.stdout:9/808: dwrite d11/d24/d4c/dda/d6f/f94 [0,4194304] 0 2024-03-19T06:06:16.748 INFO:tasks.workunit.client.0.smithi072.stdout:8/969: sync 2024-03-19T06:06:16.749 INFO:tasks.workunit.client.0.smithi072.stdout:6/856: fsync d7/d9/d1b/f2a 0 2024-03-19T06:06:16.750 INFO:tasks.workunit.client.0.smithi072.stdout:5/989: rename df/d13/d32/d28/cf0 to df/d54/dac/d9c/da0/c134 0 2024-03-19T06:06:16.752 INFO:tasks.workunit.client.0.smithi072.stdout:0/962: truncate d1/d1c/d24/d27/d7c/daa/ff1 566432 0 2024-03-19T06:06:16.752 INFO:tasks.workunit.client.0.smithi072.stdout:1/925: dwrite d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/fd4 [12582912,4194304] 0 2024-03-19T06:06:16.754 INFO:tasks.workunit.client.0.smithi072.stdout:9/809: stat d11 0 2024-03-19T06:06:16.754 INFO:tasks.workunit.client.0.smithi072.stdout:3/871: dwrite d2/f60 [0,4194304] 0 2024-03-19T06:06:16.755 INFO:tasks.workunit.client.0.smithi072.stdout:8/970: stat da/d27/d52/d100/fda 0 2024-03-19T06:06:16.758 INFO:tasks.workunit.client.0.smithi072.stdout:7/785: mkdir d2/d3/d17/dc8/d1d/d3b/d9a/d9b/df9 0 2024-03-19T06:06:16.765 INFO:tasks.workunit.client.0.smithi072.stdout:0/963: mknod d1/d1c/d82/ddd/c143 0 2024-03-19T06:06:16.768 INFO:tasks.workunit.client.0.smithi072.stdout:0/964: readlink d1/d1c/d24/d27/d73/d80/d8b/l61 0 2024-03-19T06:06:16.769 INFO:tasks.workunit.client.0.smithi072.stdout:1/926: symlink d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/dc7/l140 0 2024-03-19T06:06:16.773 INFO:tasks.workunit.client.0.smithi072.stdout:9/810: truncate d11/d24/d4c/dda/d36/fd1 324047 0 2024-03-19T06:06:16.774 INFO:tasks.workunit.client.0.smithi072.stdout:6/857: rename d7/d9/l13 to d7/d9/l120 0 2024-03-19T06:06:16.777 INFO:tasks.workunit.client.0.smithi072.stdout:8/971: creat da/d27/d30/dde/f14b x:0 0 0 2024-03-19T06:06:16.778 INFO:tasks.workunit.client.0.smithi072.stdout:6/858: fsync d7/d9/d1b/d31/d96/f108 0 2024-03-19T06:06:16.778 INFO:tasks.workunit.client.0.smithi072.stdout:7/786: symlink d2/d3/d18/d7f/d85/df0/lfa 0 2024-03-19T06:06:16.782 INFO:tasks.workunit.client.0.smithi072.stdout:1/927: rename d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/dc0/f124 to d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/f141 0 2024-03-19T06:06:16.786 INFO:tasks.workunit.client.0.smithi072.stdout:9/811: getdents d11/d24/d4c/dda/d36/d45/d4d 0 2024-03-19T06:06:16.787 INFO:tasks.workunit.client.0.smithi072.stdout:7/787: fdatasync d2/d3/d17/f77 0 2024-03-19T06:06:16.791 INFO:tasks.workunit.client.0.smithi072.stdout:9/812: mknod d11/d24/d4c/dda/d6f/d88/dc5/c119 0 2024-03-19T06:06:16.794 INFO:tasks.workunit.client.0.smithi072.stdout:7/788: symlink d2/d3/d17/dc8/d1d/d3b/d9a/d9b/dd6/lfb 0 2024-03-19T06:06:16.797 INFO:tasks.workunit.client.0.smithi072.stdout:9/813: fdatasync d11/d1f/d43/f5a 0 2024-03-19T06:06:16.797 INFO:tasks.workunit.client.0.smithi072.stdout:0/965: dread d1/d1c/d24/f86 [0,4194304] 0 2024-03-19T06:06:16.799 INFO:tasks.workunit.client.0.smithi072.stdout:7/789: rmdir d2/d3/d17/dc8/d1d/d3b/d63/d84 39 2024-03-19T06:06:16.801 INFO:tasks.workunit.client.0.smithi072.stdout:5/990: write df/d13/d32/d28/d42/f7a [2038423,27043] 0 2024-03-19T06:06:16.802 INFO:tasks.workunit.client.0.smithi072.stdout:0/966: mknod d1/d1c/d24/d8f/c144 0 2024-03-19T06:06:16.805 INFO:tasks.workunit.client.0.smithi072.stdout:9/814: symlink d11/d24/d4c/dda/d6f/dac/l11a 0 2024-03-19T06:06:16.809 INFO:tasks.workunit.client.0.smithi072.stdout:8/972: dread da/d13/d1d/f2b [0,4194304] 0 2024-03-19T06:06:16.810 INFO:tasks.workunit.client.0.smithi072.stdout:3/872: dwrite d2/d40/d78/fef [0,4194304] 0 2024-03-19T06:06:16.813 INFO:tasks.workunit.client.0.smithi072.stdout:0/967: mkdir d1/d1c/d24/d27/d73/dbb/d145 0 2024-03-19T06:06:16.819 INFO:tasks.workunit.client.0.smithi072.stdout:9/815: mkdir d11/d24/d4c/dda/d36/d45/dcb/d11b 0 2024-03-19T06:06:16.823 INFO:tasks.workunit.client.0.smithi072.stdout:7/790: dwrite d2/f66 [0,4194304] 0 2024-03-19T06:06:16.824 INFO:tasks.workunit.client.0.smithi072.stdout:3/873: write d2/d3/d25/da5/de6/f120 [907227,11384] 0 2024-03-19T06:06:16.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:16 smithi072 ceph-mon[28706]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:16.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:16 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/2240101066' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:06:16.831 INFO:tasks.workunit.client.0.smithi072.stdout:6/859: dwrite d7/d99/d60/fd3 [0,4194304] 0 2024-03-19T06:06:16.831 INFO:tasks.workunit.client.0.smithi072.stdout:5/991: getdents df/d54/dac 0 2024-03-19T06:06:16.834 INFO:tasks.workunit.client.0.smithi072.stdout:9/816: truncate d11/d24/d4c/dda/fa1 774777 0 2024-03-19T06:06:16.838 INFO:tasks.workunit.client.0.smithi072.stdout:1/928: dwrite d1/d11/d76/da7/d9e/d117/dd8/f2e [4194304,4194304] 0 2024-03-19T06:06:16.838 INFO:tasks.workunit.client.0.smithi072.stdout:0/968: rename d1/d1c/d24/d27/d7c/fdf to d1/d1c/d24/d27/d7c/d6a/f146 0 2024-03-19T06:06:16.842 INFO:tasks.workunit.client.0.smithi072.stdout:5/992: creat df/d54/dac/d7e/f135 x:0 0 0 2024-03-19T06:06:16.845 INFO:tasks.workunit.client.0.smithi072.stdout:0/969: mkdir d1/de7/d147 0 2024-03-19T06:06:16.847 INFO:tasks.workunit.client.0.smithi072.stdout:1/929: unlink d1/d11/cc9 0 2024-03-19T06:06:16.848 INFO:tasks.workunit.client.0.smithi072.stdout:0/970: dread - d1/d2c/da1/d85/f138 zero size 2024-03-19T06:06:16.856 INFO:tasks.workunit.client.0.smithi072.stdout:5/993: mkdir df/d13/d32/d28/d42/d59/d43/d4e/d136 0 2024-03-19T06:06:16.858 INFO:tasks.workunit.client.0.smithi072.stdout:3/874: write d2/d3/d25/f100 [713026,4997] 0 2024-03-19T06:06:16.859 INFO:tasks.workunit.client.0.smithi072.stdout:6/860: read d7/d99/d60/ded/df4/ddc/fd1 [4155321,59256] 0 2024-03-19T06:06:16.860 INFO:tasks.workunit.client.0.smithi072.stdout:8/973: dread f4 [0,4194304] 0 2024-03-19T06:06:16.860 INFO:tasks.workunit.client.0.smithi072.stdout:1/930: mkdir d1/d11/d76/d142 0 2024-03-19T06:06:16.866 INFO:tasks.workunit.client.0.smithi072.stdout:7/791: dwrite d2/d3/d17/dc8/d1d/f81 [0,4194304] 0 2024-03-19T06:06:16.866 INFO:tasks.workunit.client.0.smithi072.stdout:3/875: creat d2/d19/d1e/f129 x:0 0 0 2024-03-19T06:06:16.869 INFO:tasks.workunit.client.0.smithi072.stdout:1/931: readlink d1/d11/d76/da7/d9e/d117/dd8/d63/d73/l13b 0 2024-03-19T06:06:16.878 INFO:tasks.workunit.client.0.smithi072.stdout:3/876: creat d2/d3/d26/d98/f12a x:0 0 0 2024-03-19T06:06:16.878 INFO:tasks.workunit.client.0.smithi072.stdout:6/861: fdatasync d7/d99/d60/ded/df4/ddc/fe2 0 2024-03-19T06:06:16.878 INFO:tasks.workunit.client.0.smithi072.stdout:1/932: chown d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d52/fae 1 1 2024-03-19T06:06:16.879 INFO:tasks.workunit.client.0.smithi072.stdout:5/994: creat df/d13/d32/d28/d42/d59/d43/d4e/d5c/f137 x:0 0 0 2024-03-19T06:06:16.879 INFO:tasks.workunit.client.0.smithi072.stdout:7/792: mknod d2/d3/d17/dc8/d1d/d3b/d63/cfc 0 2024-03-19T06:06:16.881 INFO:tasks.workunit.client.0.smithi072.stdout:6/862: dread - d7/d99/d60/d78/d7f/dcb/d84/fc6 zero size 2024-03-19T06:06:16.882 INFO:tasks.workunit.client.0.smithi072.stdout:3/877: read d2/d3/d26/d98/fb9 [206476,112471] 0 2024-03-19T06:06:16.885 INFO:tasks.workunit.client.0.smithi072.stdout:3/878: stat d2/dc8/fee 0 2024-03-19T06:06:16.886 INFO:tasks.workunit.client.0.smithi072.stdout:6/863: truncate d7/d3f/d65/f77 4086123 0 2024-03-19T06:06:16.889 INFO:tasks.workunit.client.0.smithi072.stdout:5/995: write df/d16/f60 [4699812,23296] 0 2024-03-19T06:06:16.890 INFO:tasks.workunit.client.0.smithi072.stdout:6/864: rmdir d7/d99/d60/d78/d7f/dcb/d84/dc0 39 2024-03-19T06:06:16.891 INFO:tasks.workunit.client.0.smithi072.stdout:3/879: mkdir d2/d3/d15/d66/d116/d12b 0 2024-03-19T06:06:16.892 INFO:tasks.workunit.client.0.smithi072.stdout:5/996: chown df/d13/d32/d28/feb 696102 1 2024-03-19T06:06:16.894 INFO:tasks.workunit.client.0.smithi072.stdout:6/865: creat d7/d99/d60/d78/d7f/dcb/f121 x:0 0 0 2024-03-19T06:06:16.894 INFO:tasks.workunit.client.0.smithi072.stdout:1/933: link d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d3b/l54 d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d52/l143 0 2024-03-19T06:06:16.896 INFO:tasks.workunit.client.0.smithi072.stdout:0/971: dread d1/d2c/da1/d85/d112/f12c [0,4194304] 0 2024-03-19T06:06:16.896 INFO:tasks.workunit.client.0.smithi072.stdout:5/997: creat df/d3c/d104/f138 x:0 0 0 2024-03-19T06:06:16.898 INFO:tasks.workunit.client.0.smithi072.stdout:0/972: stat d1/d1c/d82/ddd/l10c 0 2024-03-19T06:06:16.898 INFO:tasks.workunit.client.0.smithi072.stdout:6/866: mknod d7/d9/d1b/d21/d68/d80/c122 0 2024-03-19T06:06:16.899 INFO:tasks.workunit.client.0.smithi072.stdout:1/934: chown d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d79/dd9 183 1 2024-03-19T06:06:16.901 INFO:tasks.workunit.client.0.smithi072.stdout:5/998: fsync df/d13/d32/d28/d42/d59/d43/d4e/fdd 0 2024-03-19T06:06:16.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:16 smithi172 ceph-mon[35716]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:16.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:16 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2240101066' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:06:16.907 INFO:tasks.workunit.client.0.smithi072.stdout:6/867: mknod d7/d99/d60/d78/d7f/dcb/d84/dc0/dfb/d102/c123 0 2024-03-19T06:06:16.911 INFO:tasks.workunit.client.0.smithi072.stdout:6/868: truncate d7/d9/d1e/f7b 360894 0 2024-03-19T06:06:16.912 INFO:tasks.workunit.client.0.smithi072.stdout:3/880: dread d2/d19/f53 [0,4194304] 0 2024-03-19T06:06:16.913 INFO:tasks.workunit.client.0.smithi072.stdout:5/999: write df/d13/f56 [797861,61676] 0 2024-03-19T06:06:16.915 INFO:tasks.workunit.client.0.smithi072.stdout:6/869: mkdir d7/d99/d60/ded/df4/d41/d45/d124 0 2024-03-19T06:06:16.916 INFO:tasks.workunit.client.0.smithi072.stdout:1/935: truncate d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d52/fae 5914017 0 2024-03-19T06:06:16.920 INFO:tasks.workunit.client.0.smithi072.stdout:1/936: dread - d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/fd1 zero size 2024-03-19T06:06:16.922 INFO:tasks.workunit.client.0.smithi072.stdout:6/870: rename d7/d9/d1b/d3b/d9b/dab/c113 to d7/d9/d1b/d3b/d48/c125 0 2024-03-19T06:06:16.923 INFO:tasks.workunit.client.0.smithi072.stdout:1/937: chown d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/dc7 7200595 1 2024-03-19T06:06:16.926 INFO:tasks.workunit.client.0.smithi072.stdout:3/881: dwrite d2/d19/f5c [4194304,4194304] 0 2024-03-19T06:06:16.927 INFO:tasks.workunit.client.0.smithi072.stdout:1/938: dread - d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/d65/f115 zero size 2024-03-19T06:06:16.927 INFO:tasks.workunit.client.0.smithi072.stdout:3/882: dread - d2/df4/f110 zero size 2024-03-19T06:06:16.928 INFO:tasks.workunit.client.0.smithi072.stdout:6/871: truncate d7/d99/d60/ded/df4/d41/d45/f61 4394225 0 2024-03-19T06:06:16.937 INFO:tasks.workunit.client.0.smithi072.stdout:3/883: getdents d2/d3/d15/d66 0 2024-03-19T06:06:16.941 INFO:tasks.workunit.client.0.smithi072.stdout:1/939: write d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d52/fae [1191280,20761] 0 2024-03-19T06:06:16.946 INFO:tasks.workunit.client.0.smithi072.stdout:1/940: mkdir d1/d11/d76/da7/d9e/d117/dd8/d19/de3/d114/d144 0 2024-03-19T06:06:16.948 INFO:tasks.workunit.client.0.smithi072.stdout:1/941: chown d1/d11/d76/l7b 351826485 1 2024-03-19T06:06:16.950 INFO:tasks.workunit.client.0.smithi072.stdout:8/974: rmdir da/d27/d12c 0 2024-03-19T06:06:16.950 INFO:tasks.workunit.client.0.smithi072.stdout:0/973: unlink d1/d1c/d82/d90/dbe/f113 0 2024-03-19T06:06:16.955 INFO:tasks.workunit.client.0.smithi072.stdout:1/942: fsync d1/d11/d76/da7/d9e/d117/dd8/d63/df2/f129 0 2024-03-19T06:06:16.957 INFO:tasks.workunit.client.0.smithi072.stdout:0/974: truncate d1/d1c/d82/ddd/f10b 1662201 0 2024-03-19T06:06:16.958 INFO:tasks.workunit.client.0.smithi072.stdout:3/884: dwrite d2/d19/f65 [4194304,4194304] 0 2024-03-19T06:06:16.962 INFO:tasks.workunit.client.0.smithi072.stdout:8/975: fdatasync da/d13/d14/d6f/f84 0 2024-03-19T06:06:16.969 INFO:tasks.workunit.client.0.smithi072.stdout:1/943: dread - d1/fa8 zero size 2024-03-19T06:06:16.972 INFO:tasks.workunit.client.0.smithi072.stdout:1/944: fsync d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/f13e 0 2024-03-19T06:06:16.975 INFO:tasks.workunit.client.0.smithi072.stdout:8/976: creat da/d13/d14/d6f/d111/f14c x:0 0 0 2024-03-19T06:06:16.978 INFO:tasks.workunit.client.0.smithi072.stdout:0/975: write d1/de7/ffe [827228,21443] 0 2024-03-19T06:06:16.979 INFO:tasks.workunit.client.0.smithi072.stdout:3/885: stat d2/d19/d1e/fc3 0 2024-03-19T06:06:16.979 INFO:tasks.workunit.client.0.smithi072.stdout:1/945: creat d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/d65/f145 x:0 0 0 2024-03-19T06:06:16.981 INFO:tasks.workunit.client.0.smithi072.stdout:0/976: chown d1/d1c/d24/d27/d7e/ff2 257872 1 2024-03-19T06:06:16.982 INFO:tasks.workunit.client.0.smithi072.stdout:8/977: read da/d27/dc2/dc6/dd1/ffd [1050095,112090] 0 2024-03-19T06:06:16.984 INFO:tasks.workunit.client.0.smithi072.stdout:8/978: chown da/d27/d52/d100/l8f 57 1 2024-03-19T06:06:16.987 INFO:tasks.workunit.client.0.smithi072.stdout:1/946: mkdir d1/d11/d76/da7/d9e/d117/dd8/d63/df2/d146 0 2024-03-19T06:06:16.990 INFO:tasks.workunit.client.0.smithi072.stdout:1/947: chown d1/d11/d76/da7/d9e/d117/dd8/d63/d73/fce 1 1 2024-03-19T06:06:16.991 INFO:tasks.workunit.client.0.smithi072.stdout:3/886: write d2/d40/d78/d9b/dc5/fdd [2050034,48785] 0 2024-03-19T06:06:16.992 INFO:tasks.workunit.client.0.smithi072.stdout:8/979: getdents da/d37/de1/d116 0 2024-03-19T06:06:16.995 INFO:tasks.workunit.client.0.smithi072.stdout:0/977: dwrite d1/de7/f128 [0,4194304] 0 2024-03-19T06:06:16.998 INFO:tasks.workunit.client.0.smithi072.stdout:8/980: creat da/d27/d52/dbd/f14d x:0 0 0 2024-03-19T06:06:17.004 INFO:tasks.workunit.client.0.smithi072.stdout:1/948: mknod d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/d107/c147 0 2024-03-19T06:06:17.008 INFO:tasks.workunit.client.0.smithi072.stdout:0/978: fdatasync d1/d1c/d24/d27/d7c/f5a 0 2024-03-19T06:06:17.010 INFO:tasks.workunit.client.0.smithi072.stdout:1/949: mknod d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/dc7/d128/c148 0 2024-03-19T06:06:17.015 INFO:tasks.workunit.client.0.smithi072.stdout:3/887: dwrite d2/d3/d26/f96 [0,4194304] 0 2024-03-19T06:06:17.018 INFO:tasks.workunit.client.0.smithi072.stdout:3/888: fdatasync d2/d3/d26/d98/ff7 0 2024-03-19T06:06:17.021 INFO:tasks.workunit.client.0.smithi072.stdout:8/981: dwrite da/d37/f6c [0,4194304] 0 2024-03-19T06:06:17.025 INFO:tasks.workunit.client.0.smithi072.stdout:3/889: creat d2/d3/d15/d66/d70/f12c x:0 0 0 2024-03-19T06:06:17.025 INFO:tasks.workunit.client.0.smithi072.stdout:8/982: stat da/d27/d52/d5b/d3e/d7f/lfe 0 2024-03-19T06:06:17.028 INFO:tasks.workunit.client.0.smithi072.stdout:0/979: dwrite d1/d1c/d24/d27/d7c/daa/f100 [0,4194304] 0 2024-03-19T06:06:17.029 INFO:tasks.workunit.client.0.smithi072.stdout:8/983: mknod da/d13/c14e 0 2024-03-19T06:06:17.033 INFO:tasks.workunit.client.0.smithi072.stdout:0/980: dread - d1/d1c/d24/d27/d73/ffb zero size 2024-03-19T06:06:17.045 INFO:tasks.workunit.client.0.smithi072.stdout:0/981: creat d1/d1c/d24/d3f/de8/f148 x:0 0 0 2024-03-19T06:06:17.053 INFO:tasks.workunit.client.0.smithi072.stdout:3/890: dwrite d2/d3/d15/fba [0,4194304] 0 2024-03-19T06:06:17.058 INFO:tasks.workunit.client.0.smithi072.stdout:1/950: truncate d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/ff6 3344662 0 2024-03-19T06:06:17.061 INFO:tasks.workunit.client.0.smithi072.stdout:1/951: dread - d1/fa8 zero size 2024-03-19T06:06:17.064 INFO:tasks.workunit.client.0.smithi072.stdout:0/982: getdents d1/d1c/d24/d27/d7e 0 2024-03-19T06:06:17.067 INFO:tasks.workunit.client.0.smithi072.stdout:0/983: readlink d1/d1c/d82/de4/l12b 0 2024-03-19T06:06:17.069 INFO:tasks.workunit.client.0.smithi072.stdout:8/984: chown da/d13/d14/c23 15 1 2024-03-19T06:06:17.069 INFO:tasks.workunit.client.0.smithi072.stdout:0/984: stat d1/d1c/fd7 0 2024-03-19T06:06:17.070 INFO:tasks.workunit.client.0.smithi072.stdout:0/985: readlink d1/l11e 0 2024-03-19T06:06:17.072 INFO:tasks.workunit.client.0.smithi072.stdout:1/952: unlink d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/d65/fc6 0 2024-03-19T06:06:17.076 INFO:tasks.workunit.client.0.smithi072.stdout:3/891: truncate d2/d3/d15/d66/d6b/d79/fbf 3250169 0 2024-03-19T06:06:17.078 INFO:tasks.workunit.client.0.smithi072.stdout:8/985: mkdir da/d62/d11a/d14f 0 2024-03-19T06:06:17.085 INFO:tasks.workunit.client.0.smithi072.stdout:0/986: getdents d1/d1c/d24/d27/d7e 0 2024-03-19T06:06:17.099 INFO:tasks.workunit.client.0.smithi072.stdout:3/892: write d2/d19/d1e/fe0 [733793,20614] 0 2024-03-19T06:06:17.102 INFO:tasks.workunit.client.0.smithi072.stdout:8/986: truncate da/d13/d3f/dac/fb6 2336884 0 2024-03-19T06:06:17.103 INFO:tasks.workunit.client.0.smithi072.stdout:3/893: fdatasync d2/d3/d15/f4c 0 2024-03-19T06:06:17.108 INFO:tasks.workunit.client.0.smithi072.stdout:3/894: chown d2/d40/d78/d9b/lfb 0 1 2024-03-19T06:06:17.112 INFO:tasks.workunit.client.0.smithi072.stdout:1/953: dread d1/d11/d76/da7/d9e/d117/dd8/f85 [0,4194304] 0 2024-03-19T06:06:17.112 INFO:tasks.workunit.client.0.smithi072.stdout:0/987: dwrite d1/d1c/d82/ddd/f10b [0,4194304] 0 2024-03-19T06:06:17.115 INFO:tasks.workunit.client.0.smithi072.stdout:8/987: getdents da/d62/d11a 0 2024-03-19T06:06:17.116 INFO:tasks.workunit.client.0.smithi072.stdout:8/988: readlink da/d62/lf3 0 2024-03-19T06:06:17.118 INFO:tasks.workunit.client.0.smithi072.stdout:3/895: creat d2/d3/d15/d66/d116/d12b/f12d x:0 0 0 2024-03-19T06:06:17.119 INFO:tasks.workunit.client.0.smithi072.stdout:0/988: creat d1/d1c/d24/d8f/f149 x:0 0 0 2024-03-19T06:06:17.120 INFO:tasks.workunit.client.0.smithi072.stdout:0/989: chown d1/d2c/da1/d85/d112/f12c 674 1 2024-03-19T06:06:17.123 INFO:tasks.workunit.client.0.smithi072.stdout:8/989: rmdir da/d37/de1 39 2024-03-19T06:06:17.125 INFO:tasks.workunit.client.0.smithi072.stdout:1/954: creat d1/d11/d76/d142/f149 x:0 0 0 2024-03-19T06:06:17.128 INFO:tasks.workunit.client.0.smithi072.stdout:1/955: write d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/f98 [2865293,7841] 0 2024-03-19T06:06:17.132 INFO:tasks.workunit.client.0.smithi072.stdout:0/990: creat d1/d1c/d24/d27/d73/d80/d8b/f14a x:0 0 0 2024-03-19T06:06:17.136 INFO:tasks.workunit.client.0.smithi072.stdout:8/990: creat da/d27/d52/d5b/d3e/d7d/d97/d145/f150 x:0 0 0 2024-03-19T06:06:17.137 INFO:tasks.workunit.client.0.smithi072.stdout:0/991: mknod d1/d2c/c14b 0 2024-03-19T06:06:17.143 INFO:tasks.workunit.client.0.smithi072.stdout:1/956: dwrite d1/f8e [0,4194304] 0 2024-03-19T06:06:17.146 INFO:tasks.workunit.client.0.smithi072.stdout:8/991: rmdir da/d13/d14/d1b/d6b/daa 0 2024-03-19T06:06:17.158 INFO:tasks.workunit.client.0.smithi072.stdout:1/957: write d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/f141 [885731,68839] 0 2024-03-19T06:06:17.158 INFO:tasks.workunit.client.0.smithi072.stdout:3/896: dread d2/d3/d26/f59 [0,4194304] 0 2024-03-19T06:06:17.163 INFO:tasks.workunit.client.0.smithi072.stdout:0/992: dwrite d1/d1c/d82/d90/dbe/f114 [0,4194304] 0 2024-03-19T06:06:17.201 INFO:tasks.workunit.client.0.smithi072.stdout:3/897: readlink d2/d19/d1e/l33 0 2024-03-19T06:06:17.203 INFO:tasks.workunit.client.0.smithi072.stdout:0/993: symlink d1/d1c/d82/de4/l14c 0 2024-03-19T06:06:17.206 INFO:tasks.workunit.client.0.smithi072.stdout:3/898: unlink d2/d3/d26/cae 0 2024-03-19T06:06:17.208 INFO:tasks.workunit.client.0.smithi072.stdout:9/817: sync 2024-03-19T06:06:17.210 INFO:tasks.workunit.client.0.smithi072.stdout:0/994: creat d1/d1c/d24/d27/d7c/d6a/f14d x:0 0 0 2024-03-19T06:06:17.210 INFO:tasks.workunit.client.0.smithi072.stdout:9/818: chown d11/d24/d4c/dda 15 1 2024-03-19T06:06:17.211 INFO:tasks.workunit.client.0.smithi072.stdout:1/958: dread d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/fe7 [0,4194304] 0 2024-03-19T06:06:17.215 INFO:tasks.workunit.client.0.smithi072.stdout:0/995: symlink d1/d1c/d24/d27/d7e/l14e 0 2024-03-19T06:06:17.216 INFO:tasks.workunit.client.0.smithi072.stdout:9/819: mknod d11/d24/d4c/dda/d36/d3e/c11c 0 2024-03-19T06:06:17.216 INFO:tasks.workunit.client.0.smithi072.stdout:0/996: stat d1/d1c/d24/d8f/f130 0 2024-03-19T06:06:17.217 INFO:tasks.workunit.client.0.smithi072.stdout:1/959: mkdir d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/d14a 0 2024-03-19T06:06:17.220 INFO:tasks.workunit.client.0.smithi072.stdout:1/960: read - d1/d11/d76/da7/d9e/d117/dd8/d19/d72/f9f zero size 2024-03-19T06:06:17.224 INFO:tasks.workunit.client.0.smithi072.stdout:1/961: dread - d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/dc7/f11b zero size 2024-03-19T06:06:17.234 INFO:tasks.workunit.client.0.smithi072.stdout:1/962: rename d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d105 to d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/d14a/d14b 0 2024-03-19T06:06:17.238 INFO:tasks.workunit.client.0.smithi072.stdout:1/963: symlink d1/d11/d76/da7/d9e/d117/dfd/l14c 0 2024-03-19T06:06:17.242 INFO:tasks.workunit.client.0.smithi072.stdout:8/992: write da/d27/d52/d5b/d3e/d7d/d97/f46 [1109483,59729] 0 2024-03-19T06:06:17.244 INFO:tasks.workunit.client.0.smithi072.stdout:8/993: dread - da/d27/d52/d5b/d3e/d7d/fb1 zero size 2024-03-19T06:06:17.245 INFO:tasks.workunit.client.0.smithi072.stdout:1/964: unlink d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/f62 0 2024-03-19T06:06:17.256 INFO:tasks.workunit.client.0.smithi072.stdout:3/899: write d2/d19/db0/dcb/fd3 [2789761,53018] 0 2024-03-19T06:06:17.258 INFO:tasks.workunit.client.0.smithi072.stdout:9/820: write d11/f1d [1099591,89314] 0 2024-03-19T06:06:17.258 INFO:tasks.workunit.client.0.smithi072.stdout:1/965: fsync d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96/f12f 0 2024-03-19T06:06:17.260 INFO:tasks.workunit.client.0.smithi072.stdout:8/994: chown da/d37/dd3/l101 810 1 2024-03-19T06:06:17.267 INFO:tasks.workunit.client.0.smithi072.stdout:8/995: mkdir da/d13/d14/d6f/d111/d151 0 2024-03-19T06:06:17.268 INFO:tasks.workunit.client.0.smithi072.stdout:3/900: read d2/f2f [2779558,127396] 0 2024-03-19T06:06:17.270 INFO:tasks.workunit.client.0.smithi072.stdout:9/821: creat d11/d24/ddd/f11d x:0 0 0 2024-03-19T06:06:17.273 INFO:tasks.workunit.client.0.smithi072.stdout:8/996: chown da/d37/l65 22 1 2024-03-19T06:06:17.273 INFO:tasks.workunit.client.0.smithi072.stdout:0/997: dwrite d1/d1c/d82/de4/fa7 [0,4194304] 0 2024-03-19T06:06:17.274 INFO:tasks.workunit.client.0.smithi072.stdout:3/901: unlink d2/d3/d25/l34 0 2024-03-19T06:06:17.275 INFO:tasks.workunit.client.0.smithi072.stdout:3/902: readlink d2/l3c 0 2024-03-19T06:06:17.277 INFO:tasks.workunit.client.0.smithi072.stdout:8/997: symlink da/d62/l152 0 2024-03-19T06:06:17.278 INFO:tasks.workunit.client.0.smithi072.stdout:1/966: write d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/fd1 [140602,86468] 0 2024-03-19T06:06:17.282 INFO:tasks.workunit.client.0.smithi072.stdout:8/998: write da/d13/d14/d1b/f9c [233767,41957] 0 2024-03-19T06:06:17.284 INFO:tasks.workunit.client.0.smithi072.stdout:7/793: sync 2024-03-19T06:06:17.284 INFO:tasks.workunit.client.0.smithi072.stdout:6/872: sync 2024-03-19T06:06:17.284 INFO:tasks.workunit.client.0.smithi072.stdout:3/903: getdents d2/d19/db0/dcb/df8 0 2024-03-19T06:06:17.289 INFO:tasks.workunit.client.0.smithi072.stdout:1/967: creat d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d52/f14d x:0 0 0 2024-03-19T06:06:17.293 INFO:tasks.workunit.client.0.smithi072.stdout:7/794: symlink d2/d3/d18/d2f/lfd 0 2024-03-19T06:06:17.294 INFO:tasks.workunit.client.0.smithi072.stdout:0/998: write d1/d1c/d24/d27/d7c/daa/fae [83199,58888] 0 2024-03-19T06:06:17.295 INFO:tasks.workunit.client.0.smithi072.stdout:8/999: rename da/d27/d52/d5b/d3e/d5a/df1 to da/d62/d153 0 2024-03-19T06:06:17.296 INFO:tasks.workunit.client.0.smithi072.stdout:9/822: link d11/d24/d4c/dda/d6f/dff/l7b d11/d24/d4c/d64/l11e 0 2024-03-19T06:06:17.298 INFO:tasks.workunit.client.0.smithi072.stdout:9/823: chown d11/d24/d4c/d64/faf 82 1 2024-03-19T06:06:17.302 INFO:tasks.workunit.client.0.smithi072.stdout:1/968: unlink d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/ccc 0 2024-03-19T06:06:17.304 INFO:tasks.workunit.client.0.smithi072.stdout:1/969: readlink d1/d11/d76/da7/l94 0 2024-03-19T06:06:17.305 INFO:tasks.workunit.client.0.smithi072.stdout:7/795: fdatasync d2/d3/d17/dc8/d1d/d2b/f6c 0 2024-03-19T06:06:17.306 INFO:tasks.workunit.client.0.smithi072.stdout:3/904: dread d2/d3/f10 [4194304,4194304] 0 2024-03-19T06:06:17.307 INFO:tasks.workunit.client.0.smithi072.stdout:9/824: mknod d11/d24/d4c/dda/d68/d92/c11f 0 2024-03-19T06:06:17.312 INFO:tasks.workunit.client.0.smithi072.stdout:3/905: dread d2/d19/f8b [0,4194304] 0 2024-03-19T06:06:17.313 INFO:tasks.workunit.client.0.smithi072.stdout:9/825: rmdir d11/d24/ddd/d5c 39 2024-03-19T06:06:17.314 INFO:tasks.workunit.client.0.smithi072.stdout:1/970: read d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/f7a [163516,48167] 0 2024-03-19T06:06:17.315 INFO:tasks.workunit.client.0.smithi072.stdout:3/906: chown d2/d3/d15/c8a 15 1 2024-03-19T06:06:17.315 INFO:tasks.workunit.client.0.smithi072.stdout:0/999: creat d1/d1c/d24/d27/d73/d80/f14f x:0 0 0 2024-03-19T06:06:17.317 INFO:tasks.workunit.client.0.smithi072.stdout:6/873: dwrite d7/f70 [0,4194304] 0 2024-03-19T06:06:17.324 INFO:tasks.workunit.client.0.smithi072.stdout:3/907: mkdir d2/d40/d78/d9b/d12e 0 2024-03-19T06:06:17.326 INFO:tasks.workunit.client.0.smithi072.stdout:9/826: link d11/d24/ddd/c7c d11/d24/d4c/dda/d36/c120 0 2024-03-19T06:06:17.329 INFO:tasks.workunit.client.0.smithi072.stdout:7/796: truncate d2/d3/d17/dc8/d53/dbd/fd8 36561 0 2024-03-19T06:06:17.331 INFO:tasks.workunit.client.0.smithi072.stdout:3/908: write d2/d19/d1e/fc3 [1033416,34564] 0 2024-03-19T06:06:17.334 INFO:tasks.workunit.client.0.smithi072.stdout:3/909: read d2/d3/d26/f96 [3558959,26286] 0 2024-03-19T06:06:17.334 INFO:tasks.workunit.client.0.smithi072.stdout:7/797: write d2/d3/d17/dc8/d53/dbd/fd5 [1002289,102185] 0 2024-03-19T06:06:17.335 INFO:tasks.workunit.client.0.smithi072.stdout:6/874: dwrite d7/d9/d1b/d3b/f8c [0,4194304] 0 2024-03-19T06:06:17.341 INFO:tasks.workunit.client.0.smithi072.stdout:3/910: mkdir d2/d19/db0/dcb/df8/d12f 0 2024-03-19T06:06:17.341 INFO:tasks.workunit.client.0.smithi072.stdout:6/875: truncate d7/d9/d1e/f8d 771708 0 2024-03-19T06:06:17.341 INFO:tasks.workunit.client.0.smithi072.stdout:3/911: stat d2/d3/f6d 0 2024-03-19T06:06:17.343 INFO:tasks.workunit.client.0.smithi072.stdout:7/798: rename d2/d3/d17/dc8/d1d/c65 to d2/d3/d17/dc8/d1d/d2b/d75/cfe 0 2024-03-19T06:06:17.346 INFO:tasks.workunit.client.0.smithi072.stdout:7/799: chown d2/d3/d17/dc8/d1d/d2b/d75/ca2 3860323 1 2024-03-19T06:06:17.346 INFO:tasks.workunit.client.0.smithi072.stdout:1/971: dread d1/f8d [0,4194304] 0 2024-03-19T06:06:17.375 INFO:tasks.workunit.client.0.smithi072.stdout:6/876: mkdir d7/d9/d1b/d21/d126 0 2024-03-19T06:06:17.377 INFO:tasks.workunit.client.0.smithi072.stdout:7/800: mknod d2/d3/d17/dc8/d1d/d3b/d9a/cff 0 2024-03-19T06:06:17.379 INFO:tasks.workunit.client.0.smithi072.stdout:6/877: mknod d7/d9/d1b/c127 0 2024-03-19T06:06:17.381 INFO:tasks.workunit.client.0.smithi072.stdout:7/801: dread - d2/d3/d17/dc8/d1d/d3b/d9a/d9b/fdb zero size 2024-03-19T06:06:17.381 INFO:tasks.workunit.client.0.smithi072.stdout:3/912: dwrite d2/f60 [4194304,4194304] 0 2024-03-19T06:06:17.382 INFO:tasks.workunit.client.0.smithi072.stdout:3/913: readlink d2/d40/le4 0 2024-03-19T06:06:17.387 INFO:tasks.workunit.client.0.smithi072.stdout:6/878: rename d7/d99/fad to d7/d9/d1b/d21/d68/daa/d88/f128 0 2024-03-19T06:06:17.389 INFO:tasks.workunit.client.0.smithi072.stdout:7/802: write d2/d3/d17/dc8/d1d/d2b/fd3 [736666,127832] 0 2024-03-19T06:06:17.561 INFO:tasks.workunit.client.0.smithi072.stdout:6/879: truncate d7/f11 1168073 0 2024-03-19T06:06:17.576 INFO:tasks.workunit.client.0.smithi072.stdout:7/803: dwrite d2/d3/d17/dc8/d1d/d2b/f6c [0,4194304] 0 2024-03-19T06:06:17.581 INFO:tasks.workunit.client.0.smithi072.stdout:3/914: dwrite d2/d3/d15/d66/d70/f9f [0,4194304] 0 2024-03-19T06:06:17.587 INFO:tasks.workunit.client.0.smithi072.stdout:6/880: link d7/d9/d1b/f8b d7/d99/d60/f129 0 2024-03-19T06:06:17.594 INFO:tasks.workunit.client.0.smithi072.stdout:3/915: creat d2/d3/f130 x:0 0 0 2024-03-19T06:06:17.598 INFO:tasks.workunit.client.0.smithi072.stdout:6/881: stat d7/d9/d1b/d3b/d48/c125 0 2024-03-19T06:06:17.605 INFO:tasks.workunit.client.0.smithi072.stdout:6/882: stat d7/d9/d1b/d31/d96/f108 0 2024-03-19T06:06:17.606 INFO:tasks.workunit.client.0.smithi072.stdout:7/804: dread d2/d3/d17/dc8/d53/dca/feb [0,4194304] 0 2024-03-19T06:06:17.609 INFO:tasks.workunit.client.0.smithi072.stdout:3/916: link d2/l9 d2/d3/d25/da5/l131 0 2024-03-19T06:06:17.617 INFO:tasks.workunit.client.0.smithi072.stdout:3/917: creat d2/d40/f132 x:0 0 0 2024-03-19T06:06:17.622 INFO:tasks.workunit.client.0.smithi072.stdout:9/827: sync 2024-03-19T06:06:17.622 INFO:tasks.workunit.client.0.smithi072.stdout:1/972: sync 2024-03-19T06:06:17.623 INFO:tasks.workunit.client.0.smithi072.stdout:3/918: unlink d2/f5 0 2024-03-19T06:06:17.626 INFO:tasks.workunit.client.0.smithi072.stdout:3/919: chown d2/d3/d25 331803 1 2024-03-19T06:06:17.628 INFO:tasks.workunit.client.0.smithi072.stdout:1/973: symlink d1/d11/d76/da7/d9e/d117/l14e 0 2024-03-19T06:06:17.629 INFO:tasks.workunit.client.0.smithi072.stdout:3/920: chown d2/d40/c56 912055405 1 2024-03-19T06:06:17.632 INFO:tasks.workunit.client.0.smithi072.stdout:3/921: chown d2/dc8/ffc 21 1 2024-03-19T06:06:17.632 INFO:tasks.workunit.client.0.smithi072.stdout:9/828: rename d11/d24/ddd/f11d to d11/d24/d4c/dda/d68/f121 0 2024-03-19T06:06:17.637 INFO:tasks.workunit.client.0.smithi072.stdout:7/805: dwrite d2/d3/d18/d20/d3a/f5c [0,4194304] 0 2024-03-19T06:06:17.638 INFO:tasks.workunit.client.0.smithi072.stdout:9/829: write d11/d24/d4c/dda/d6f/d88/fe2 [1400479,47069] 0 2024-03-19T06:06:17.642 INFO:tasks.workunit.client.0.smithi072.stdout:9/830: dread - d11/d24/d4c/d64/f75 zero size 2024-03-19T06:06:17.646 INFO:tasks.workunit.client.0.smithi072.stdout:7/806: mknod d2/d3/d18/d7f/d85/c100 0 2024-03-19T06:06:17.652 INFO:tasks.workunit.client.0.smithi072.stdout:7/807: write d2/d3/d17/dc8/d1d/d2b/fd3 [775621,46124] 0 2024-03-19T06:06:17.653 INFO:tasks.workunit.client.0.smithi072.stdout:6/883: dread d7/d9/d1b/d21/fd5 [0,4194304] 0 2024-03-19T06:06:17.655 INFO:tasks.workunit.client.0.smithi072.stdout:7/808: fsync d2/d3/f62 0 2024-03-19T06:06:17.656 INFO:tasks.workunit.client.0.smithi072.stdout:3/922: dwrite d2/d19/ff1 [0,4194304] 0 2024-03-19T06:06:17.656 INFO:tasks.workunit.client.0.smithi072.stdout:9/831: creat d11/d24/d4c/dda/d68/d79/d113/f122 x:0 0 0 2024-03-19T06:06:17.657 INFO:tasks.workunit.client.0.smithi072.stdout:1/974: dwrite d1/d11/d76/da7/d9e/d117/dd8/d63/d73/fd3 [8388608,4194304] 0 2024-03-19T06:06:17.662 INFO:tasks.workunit.client.0.smithi072.stdout:3/923: read d2/f30 [2241014,122695] 0 2024-03-19T06:06:17.663 INFO:tasks.workunit.client.0.smithi072.stdout:6/884: truncate d7/d3f/fc2 158411 0 2024-03-19T06:06:17.666 INFO:tasks.workunit.client.0.smithi072.stdout:9/832: unlink d11/d1f/c10f 0 2024-03-19T06:06:17.669 INFO:tasks.workunit.client.0.smithi072.stdout:3/924: read d2/d3/d26/f35 [2424709,58236] 0 2024-03-19T06:06:17.671 INFO:tasks.workunit.client.0.smithi072.stdout:1/975: dread d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/ff1 [4194304,4194304] 0 2024-03-19T06:06:17.674 INFO:tasks.workunit.client.0.smithi072.stdout:1/976: chown d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/f7a 97537 1 2024-03-19T06:06:17.675 INFO:tasks.workunit.client.0.smithi072.stdout:9/833: rmdir d11/d24/d4c/dda/d36/d45/d5b 39 2024-03-19T06:06:17.678 INFO:tasks.workunit.client.0.smithi072.stdout:3/925: rmdir d2/d3/d15 39 2024-03-19T06:06:17.679 INFO:tasks.workunit.client.0.smithi072.stdout:3/926: chown d2/d19/f65 74 1 2024-03-19T06:06:17.681 INFO:tasks.workunit.client.0.smithi072.stdout:6/885: symlink d7/d9/d1b/d3b/d48/d11b/l12a 0 2024-03-19T06:06:17.683 INFO:tasks.workunit.client.0.smithi072.stdout:1/977: symlink d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/d14a/l14f 0 2024-03-19T06:06:17.685 INFO:tasks.workunit.client.0.smithi072.stdout:9/834: mkdir d11/d24/d4c/dda/d36/d3e/d123 0 2024-03-19T06:06:17.686 INFO:tasks.workunit.client.0.smithi072.stdout:3/927: mkdir d2/d3/d26/d92/d133 0 2024-03-19T06:06:17.688 INFO:tasks.workunit.client.0.smithi072.stdout:6/886: mkdir d7/d99/d60/ded/df4/d41/d92/d12b 0 2024-03-19T06:06:17.693 INFO:tasks.workunit.client.0.smithi072.stdout:1/978: rename d1/d11/d76/da7/d9e/d117/dd8/d19/dc2/f12d to d1/d11/d76/da7/d9e/d117/dd8/d19/de3/d114/f150 0 2024-03-19T06:06:17.697 INFO:tasks.workunit.client.0.smithi072.stdout:9/835: creat d11/d24/ddd/f124 x:0 0 0 2024-03-19T06:06:17.699 INFO:tasks.workunit.client.0.smithi072.stdout:7/809: dread d2/d3/d18/d7f/fb2 [0,4194304] 0 2024-03-19T06:06:17.700 INFO:tasks.workunit.client.0.smithi072.stdout:6/887: rename d7/d99/d60/ded/df4/d41/d92/c110 to d7/d99/d60/d78/d7f/dcb/d84/dc0/c12c 0 2024-03-19T06:06:17.701 INFO:tasks.workunit.client.0.smithi072.stdout:3/928: write d2/d3/d26/f97 [4779377,100160] 0 2024-03-19T06:06:17.702 INFO:tasks.workunit.client.0.smithi072.stdout:9/836: truncate d11/f44 1531963 0 2024-03-19T06:06:17.703 INFO:tasks.workunit.client.0.smithi072.stdout:9/837: chown d11/fbf 65955307 1 2024-03-19T06:06:17.708 INFO:tasks.workunit.client.0.smithi072.stdout:9/838: fsync d11/d24/ddd/f124 0 2024-03-19T06:06:17.709 INFO:tasks.workunit.client.0.smithi072.stdout:3/929: creat d2/f134 x:0 0 0 2024-03-19T06:06:17.711 INFO:tasks.workunit.client.0.smithi072.stdout:3/930: write d2/d3/f130 [126764,98487] 0 2024-03-19T06:06:17.713 INFO:tasks.workunit.client.0.smithi072.stdout:9/839: rmdir d11/d24/d4c/dda/d36/d45 39 2024-03-19T06:06:17.720 INFO:tasks.workunit.client.0.smithi072.stdout:3/931: truncate d2/d19/d1e/f32 1757739 0 2024-03-19T06:06:17.721 INFO:tasks.workunit.client.0.smithi072.stdout:9/840: write d11/d24/d4c/dda/d36/d45/d4d/f9b [4619948,1200] 0 2024-03-19T06:06:17.723 INFO:tasks.workunit.client.0.smithi072.stdout:6/888: dwrite d7/d9/fa [0,4194304] 0 2024-03-19T06:06:17.724 INFO:tasks.workunit.client.0.smithi072.stdout:3/932: mkdir d2/d3/d26/d92/d135 0 2024-03-19T06:06:17.726 INFO:tasks.workunit.client.0.smithi072.stdout:9/841: rmdir d11/d1f/d43 39 2024-03-19T06:06:17.726 INFO:tasks.workunit.client.0.smithi072.stdout:7/810: dread d2/d3/d17/dc8/d1d/d3b/d63/fac [0,4194304] 0 2024-03-19T06:06:17.726 INFO:tasks.workunit.client.0.smithi072.stdout:9/842: fsync d11/f19 0 2024-03-19T06:06:17.729 INFO:tasks.workunit.client.0.smithi072.stdout:3/933: readlink d2/d3/d15/d66/d6b/l7e 0 2024-03-19T06:06:17.732 INFO:tasks.workunit.client.0.smithi072.stdout:3/934: write d2/f60 [308345,17480] 0 2024-03-19T06:06:17.735 INFO:tasks.workunit.client.0.smithi072.stdout:9/843: chown d11/d24/ddd/d5c/ce0 62043777 1 2024-03-19T06:06:17.739 INFO:tasks.workunit.client.0.smithi072.stdout:9/844: truncate d11/d24/d4c/dda/d68/d92/dc0/f108 710909 0 2024-03-19T06:06:17.745 INFO:tasks.workunit.client.0.smithi072.stdout:9/845: dread d11/d24/d4c/d64/faf [0,4194304] 0 2024-03-19T06:06:17.748 INFO:tasks.workunit.client.0.smithi072.stdout:6/889: write d7/d9/d1e/f8d [993943,18632] 0 2024-03-19T06:06:17.751 INFO:tasks.workunit.client.0.smithi072.stdout:6/890: readlink d7/d9/d1b/d21/d68/daa/ld9 0 2024-03-19T06:06:17.751 INFO:tasks.workunit.client.0.smithi072.stdout:3/935: dwrite d2/d3/d26/d92/fa2 [8388608,4194304] 0 2024-03-19T06:06:17.752 INFO:tasks.workunit.client.0.smithi072.stdout:7/811: truncate d2/d3/d17/dc8/d1d/d2b/f6c 3451518 0 2024-03-19T06:06:17.754 INFO:tasks.workunit.client.0.smithi072.stdout:9/846: getdents d11/d24 0 2024-03-19T06:06:17.754 INFO:tasks.workunit.client.0.smithi072.stdout:7/812: chown d2/d3/d18/d88/fae 1 1 2024-03-19T06:06:17.757 INFO:tasks.workunit.client.0.smithi072.stdout:6/891: truncate d7/d9/d1b/d3b/d48/fa9 416943 0 2024-03-19T06:06:17.757 INFO:tasks.workunit.client.0.smithi072.stdout:3/936: chown d2/d19/db0/f115 6105613 1 2024-03-19T06:06:17.758 INFO:tasks.workunit.client.0.smithi072.stdout:9/847: mkdir d11/d24/d4c/dda/d6f/d88/dc5/d125 0 2024-03-19T06:06:17.759 INFO:tasks.workunit.client.0.smithi072.stdout:6/892: chown d7/d99/d60/ded/df4/d41/f59 206476273 1 2024-03-19T06:06:17.760 INFO:tasks.workunit.client.0.smithi072.stdout:7/813: mknod d2/d3/d17/dc8/d83/c101 0 2024-03-19T06:06:17.767 INFO:tasks.workunit.client.0.smithi072.stdout:9/848: mknod d11/d24/d4c/dda/d6f/d87/da4/d115/c126 0 2024-03-19T06:06:17.769 INFO:tasks.workunit.client.0.smithi072.stdout:9/849: chown d11/d78/fae 21 1 2024-03-19T06:06:17.771 INFO:tasks.workunit.client.0.smithi072.stdout:7/814: mknod d2/d3/d18/c102 0 2024-03-19T06:06:17.779 INFO:tasks.workunit.client.0.smithi072.stdout:3/937: dread d2/d40/d78/d9b/dc5/fdd [0,4194304] 0 2024-03-19T06:06:17.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:17 smithi072 ceph-mon[28706]: pgmap v35: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 90 MiB/s wr, 259 op/s 2024-03-19T06:06:17.837 INFO:tasks.workunit.client.0.smithi072.stdout:7/815: rename d2/d3/ca8 to d2/d3/d17/dc8/d1d/d3b/d63/d84/c103 0 2024-03-19T06:06:17.838 INFO:tasks.workunit.client.0.smithi072.stdout:9/850: creat d11/d24/d4c/dda/f127 x:0 0 0 2024-03-19T06:06:17.841 INFO:tasks.workunit.client.0.smithi072.stdout:3/938: creat d2/d19/db0/d107/f136 x:0 0 0 2024-03-19T06:06:17.844 INFO:tasks.workunit.client.0.smithi072.stdout:7/816: rename d2/d3/d17/dc8/d1d/f46 to d2/d3/d18/d7f/db3/f104 0 2024-03-19T06:06:17.848 INFO:tasks.workunit.client.0.smithi072.stdout:3/939: rmdir d2/d40/d78/d9b/d12e 0 2024-03-19T06:06:17.850 INFO:tasks.workunit.client.0.smithi072.stdout:3/940: dread - d2/dbc/f123 zero size 2024-03-19T06:06:17.851 INFO:tasks.workunit.client.0.smithi072.stdout:7/817: unlink d2/d3/d17/dc8/fa6 0 2024-03-19T06:06:17.868 INFO:tasks.workunit.client.0.smithi072.stdout:7/818: link d2/d3/d18/d7f/d85/df0/lfa d2/d3/d17/l105 0 2024-03-19T06:06:17.871 INFO:tasks.workunit.client.0.smithi072.stdout:9/851: dwrite d11/d1f/f101 [0,4194304] 0 2024-03-19T06:06:17.874 INFO:tasks.workunit.client.0.smithi072.stdout:7/819: fsync d2/f93 0 2024-03-19T06:06:17.876 INFO:tasks.workunit.client.0.smithi072.stdout:9/852: chown d11/d24/f48 31 1 2024-03-19T06:06:17.882 INFO:tasks.workunit.client.0.smithi072.stdout:9/853: write d11/d24/d4c/dda/d68/d92/dc0/f108 [1261065,84889] 0 2024-03-19T06:06:17.889 INFO:tasks.workunit.client.0.smithi072.stdout:7/820: rename d2/f66 to d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/d86/f106 0 2024-03-19T06:06:17.899 INFO:tasks.workunit.client.0.smithi072.stdout:3/941: dread d2/fb3 [4194304,4194304] 0 2024-03-19T06:06:17.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:17 smithi172 ceph-mon[35716]: pgmap v35: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 90 MiB/s wr, 259 op/s 2024-03-19T06:06:17.906 INFO:tasks.workunit.client.0.smithi072.stdout:7/821: mkdir d2/d3/d17/dc8/d1d/d107 0 2024-03-19T06:06:17.911 INFO:tasks.workunit.client.0.smithi072.stdout:7/822: chown d2/d8c/da9/ce0 6000418 1 2024-03-19T06:06:17.918 INFO:tasks.workunit.client.0.smithi072.stdout:7/823: creat d2/d3/d17/dc8/d1d/d2b/d75/f108 x:0 0 0 2024-03-19T06:06:17.923 INFO:tasks.workunit.client.0.smithi072.stdout:3/942: dwrite d2/f30 [0,4194304] 0 2024-03-19T06:06:17.926 INFO:tasks.workunit.client.0.smithi072.stdout:9/854: dread d11/d24/d4c/d64/faa [0,4194304] 0 2024-03-19T06:06:17.929 INFO:tasks.workunit.client.0.smithi072.stdout:9/855: readlink d11/d24/d4c/dda/d68/d79/d9f/lfb 0 2024-03-19T06:06:17.933 INFO:tasks.workunit.client.0.smithi072.stdout:3/943: truncate d2/d3/d26/f23 6625636 0 2024-03-19T06:06:17.933 INFO:tasks.workunit.client.0.smithi072.stdout:7/824: write d2/d3/d18/d7f/fb2 [4112400,68387] 0 2024-03-19T06:06:17.934 INFO:tasks.workunit.client.0.smithi072.stdout:9/856: mkdir d11/d24/d4c/dda/d68/d128 0 2024-03-19T06:06:17.938 INFO:tasks.workunit.client.0.smithi072.stdout:3/944: write d2/d19/d1e/fe0 [1634137,115908] 0 2024-03-19T06:06:17.941 INFO:tasks.workunit.client.0.smithi072.stdout:7/825: creat d2/d3/d17/dc8/d1d/f109 x:0 0 0 2024-03-19T06:06:17.951 INFO:tasks.workunit.client.0.smithi072.stdout:7/826: link d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/c61 d2/d3/d17/dc8/d1d/d3b/d9a/ded/c10a 0 2024-03-19T06:06:17.957 INFO:tasks.workunit.client.0.smithi072.stdout:7/827: creat d2/d3/d18/d7f/d85/f10b x:0 0 0 2024-03-19T06:06:17.959 INFO:tasks.workunit.client.0.smithi072.stdout:1/979: sync 2024-03-19T06:06:17.959 INFO:tasks.workunit.client.0.smithi072.stdout:6/893: sync 2024-03-19T06:06:17.961 INFO:tasks.workunit.client.0.smithi072.stdout:3/945: dwrite d2/dbc/f123 [0,4194304] 0 2024-03-19T06:06:17.962 INFO:tasks.workunit.client.0.smithi072.stdout:9/857: dwrite d11/d24/d4c/dda/d36/d45/f4a [0,4194304] 0 2024-03-19T06:06:17.964 INFO:tasks.workunit.client.0.smithi072.stdout:6/894: readlink d7/d9/d1b/d31/da6/lf7 0 2024-03-19T06:06:17.973 INFO:tasks.workunit.client.0.smithi072.stdout:6/895: symlink d7/d99/d60/d78/d7f/l12d 0 2024-03-19T06:06:17.983 INFO:tasks.workunit.client.0.smithi072.stdout:1/980: truncate d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/faf 1926568 0 2024-03-19T06:06:17.983 INFO:tasks.workunit.client.0.smithi072.stdout:9/858: rmdir d11/d24/d4c/dda/d6f/d87/da4 39 2024-03-19T06:06:17.985 INFO:tasks.workunit.client.0.smithi072.stdout:6/896: write d7/d9/d1b/d21/d68/d80/fe1 [835057,60098] 0 2024-03-19T06:06:17.988 INFO:tasks.workunit.client.0.smithi072.stdout:1/981: stat d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d68/d96 0 2024-03-19T06:06:17.988 INFO:tasks.workunit.client.0.smithi072.stdout:6/897: readlink d7/d99/d60/ded/df4/d41/d92/lef 0 2024-03-19T06:06:17.995 INFO:tasks.workunit.client.0.smithi072.stdout:1/982: write d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d52/f7f [4493037,120370] 0 2024-03-19T06:06:17.997 INFO:tasks.workunit.client.0.smithi072.stdout:9/859: rename d11/d24/d4c/dda/d68/d79 to d11/d24/d4c/dda/d36/d45/dcb/d11b/d129 0 2024-03-19T06:06:18.000 INFO:tasks.workunit.client.0.smithi072.stdout:3/946: dwrite d2/d40/d78/d9b/dc5/fdd [0,4194304] 0 2024-03-19T06:06:18.001 INFO:tasks.workunit.client.0.smithi072.stdout:6/898: creat d7/d99/d60/d78/f12e x:0 0 0 2024-03-19T06:06:18.005 INFO:tasks.workunit.client.0.smithi072.stdout:1/983: creat d1/d11/d76/da7/f151 x:0 0 0 2024-03-19T06:06:18.009 INFO:tasks.workunit.client.0.smithi072.stdout:3/947: truncate d2/d40/fe3 863336 0 2024-03-19T06:06:18.014 INFO:tasks.workunit.client.0.smithi072.stdout:3/948: creat d2/dc8/f137 x:0 0 0 2024-03-19T06:06:18.015 INFO:tasks.workunit.client.0.smithi072.stdout:7/828: dwrite d2/d3/d17/dc8/d1d/d2b/f6c [4194304,4194304] 0 2024-03-19T06:06:18.018 INFO:tasks.workunit.client.0.smithi072.stdout:3/949: rmdir d2/d3/d25/da5 39 2024-03-19T06:06:18.037 INFO:tasks.workunit.client.0.smithi072.stdout:3/950: dread d2/d40/fe3 [0,4194304] 0 2024-03-19T06:06:18.041 INFO:tasks.workunit.client.0.smithi072.stdout:1/984: write d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d61/d65/fd2 [2449902,79439] 0 2024-03-19T06:06:18.043 INFO:tasks.workunit.client.0.smithi072.stdout:6/899: dwrite d7/d99/f35 [0,4194304] 0 2024-03-19T06:06:18.051 INFO:tasks.workunit.client.0.smithi072.stdout:9/860: dread d11/d24/f48 [0,4194304] 0 2024-03-19T06:06:18.052 INFO:tasks.workunit.client.0.smithi072.stdout:3/951: rename d2/c87 to d2/d19/db0/c138 0 2024-03-19T06:06:18.054 INFO:tasks.workunit.client.0.smithi072.stdout:3/952: read - d2/dc8/ffc zero size 2024-03-19T06:06:18.057 INFO:tasks.workunit.client.0.smithi072.stdout:6/900: mkdir d7/d9/d1b/d12f 0 2024-03-19T06:06:18.060 INFO:tasks.workunit.client.0.smithi072.stdout:6/901: read - d7/d9/d1e/f10f zero size 2024-03-19T06:06:18.062 INFO:tasks.workunit.client.0.smithi072.stdout:1/985: truncate d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d60/f75 3719099 0 2024-03-19T06:06:18.064 INFO:tasks.workunit.client.0.smithi072.stdout:3/953: symlink d2/d19/db0/dcb/l139 0 2024-03-19T06:06:18.066 INFO:tasks.workunit.client.0.smithi072.stdout:1/986: truncate d1/d11/d76/f97 1629207 0 2024-03-19T06:06:18.068 INFO:tasks.workunit.client.0.smithi072.stdout:1/987: chown d1/d11/d76/da7/d9e/d117/dfd/l14c 93720 1 2024-03-19T06:06:18.070 INFO:tasks.workunit.client.0.smithi072.stdout:6/902: symlink d7/d9/d1b/d3b/d48/d11b/l130 0 2024-03-19T06:06:18.071 INFO:tasks.workunit.client.0.smithi072.stdout:7/829: dread d2/d3/d17/dc8/d1d/d2b/f45 [0,4194304] 0 2024-03-19T06:06:18.072 INFO:tasks.workunit.client.0.smithi072.stdout:6/903: fdatasync d7/d9/d1e/f8d 0 2024-03-19T06:06:18.075 INFO:tasks.workunit.client.0.smithi072.stdout:1/988: mknod d1/d11/d76/da7/d9e/d117/dd8/d63/d73/c152 0 2024-03-19T06:06:18.077 INFO:tasks.workunit.client.0.smithi072.stdout:6/904: chown d7/cb 14309457 1 2024-03-19T06:06:18.080 INFO:tasks.workunit.client.0.smithi072.stdout:3/954: truncate d2/d19/d1e/f6a 609856 0 2024-03-19T06:06:18.086 INFO:tasks.workunit.client.0.smithi072.stdout:3/955: creat d2/d75/f13a x:0 0 0 2024-03-19T06:06:18.087 INFO:tasks.workunit.client.0.smithi072.stdout:9/861: write d11/d24/d4c/dda/d68/d92/d93/fea [682721,23924] 0 2024-03-19T06:06:18.088 INFO:tasks.workunit.client.0.smithi072.stdout:1/989: symlink d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d3b/l153 0 2024-03-19T06:06:18.092 INFO:tasks.workunit.client.0.smithi072.stdout:7/830: dwrite d2/d3/d18/d20/d3a/f58 [0,4194304] 0 2024-03-19T06:06:18.103 INFO:tasks.workunit.client.0.smithi072.stdout:7/831: creat d2/d3/d17/dc8/d1d/d3b/d9a/d9b/f10c x:0 0 0 2024-03-19T06:06:18.108 INFO:tasks.workunit.client.0.smithi072.stdout:3/956: dwrite d2/d3/f6d [0,4194304] 0 2024-03-19T06:06:18.110 INFO:tasks.workunit.client.0.smithi072.stdout:9/862: dread d11/d1f/ff2 [0,4194304] 0 2024-03-19T06:06:18.116 INFO:tasks.workunit.client.0.smithi072.stdout:9/863: mknod d11/d24/d4c/dda/d36/d45/dcb/d11b/d129/d9f/c12a 0 2024-03-19T06:06:18.117 INFO:tasks.workunit.client.0.smithi072.stdout:6/905: dread d7/d99/d60/ded/df4/d41/d45/f61 [0,4194304] 0 2024-03-19T06:06:18.128 INFO:tasks.workunit.client.0.smithi072.stdout:9/864: getdents d11/d24/d4c/dda/d36/d45/dcb/d11b/d129/d113 0 2024-03-19T06:06:18.128 INFO:tasks.workunit.client.0.smithi072.stdout:3/957: write d2/f2f [2420066,10297] 0 2024-03-19T06:06:18.134 INFO:tasks.workunit.client.0.smithi072.stdout:3/958: fdatasync d2/d40/d78/d9b/f118 0 2024-03-19T06:06:18.139 INFO:tasks.workunit.client.0.smithi072.stdout:9/865: mknod d11/d24/d4c/dda/d36/d45/dcb/d11b/d129/d9f/c12b 0 2024-03-19T06:06:18.142 INFO:tasks.workunit.client.0.smithi072.stdout:1/990: dread d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/f6c [0,4194304] 0 2024-03-19T06:06:18.143 INFO:tasks.workunit.client.0.smithi072.stdout:9/866: fdatasync d11/d24/d4c/dda/d6f/dff/fa3 0 2024-03-19T06:06:18.151 INFO:tasks.workunit.client.0.smithi072.stdout:1/991: fsync d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/faf 0 2024-03-19T06:06:18.152 INFO:tasks.workunit.client.0.smithi072.stdout:7/832: dread d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/f78 [0,4194304] 0 2024-03-19T06:06:18.153 INFO:tasks.workunit.client.0.smithi072.stdout:6/906: dread d7/f1d [0,4194304] 0 2024-03-19T06:06:18.153 INFO:tasks.workunit.client.0.smithi072.stdout:3/959: dread d2/d3/fb [0,4194304] 0 2024-03-19T06:06:18.161 INFO:tasks.workunit.client.0.smithi072.stdout:9/867: link d11/d24/d4c/d6e/cfc d11/d24/d4c/d6e/c12c 0 2024-03-19T06:06:18.162 INFO:tasks.workunit.client.0.smithi072.stdout:6/907: read d7/f34 [3838952,122483] 0 2024-03-19T06:06:18.162 INFO:tasks.workunit.client.0.smithi072.stdout:7/833: mkdir d2/d3/d17/dc8/d53/dca/d10d 0 2024-03-19T06:06:18.162 INFO:tasks.workunit.client.0.smithi072.stdout:1/992: mkdir d1/d11/d76/da7/d9e/d117/dd8/d19/d1a/d25/d3c/d79/dd9/d154 0 2024-03-19T06:06:18.164 INFO:tasks.workunit.client.0.smithi072.stdout:3/960: read d2/d3/d26/f22 [242336,77641] 0 2024-03-19T06:06:18.165 INFO:tasks.workunit.client.0.smithi072.stdout:7/834: write d2/d3/d18/d7f/fb2 [180343,89153] 0 2024-03-19T06:06:18.204 INFO:tasks.workunit.client.0.smithi072.stdout:1/993: creat d1/d11/d76/da7/d9e/d117/dfd/f155 x:0 0 0 2024-03-19T06:06:18.205 INFO:tasks.workunit.client.0.smithi072.stdout:1/994: chown d1/ca 7 1 2024-03-19T06:06:18.206 INFO:tasks.workunit.client.0.smithi072.stdout:6/908: mknod d7/d99/d60/d78/d7f/dcb/d84/dc0/dfb/c131 0 2024-03-19T06:06:18.208 INFO:tasks.workunit.client.0.smithi072.stdout:1/995: symlink d1/d11/l156 0 2024-03-19T06:06:18.209 INFO:tasks.workunit.client.0.smithi072.stdout:1/996: readlink d1/l1d 0 2024-03-19T06:06:18.209 INFO:tasks.workunit.client.0.smithi072.stdout:3/961: truncate d2/d19/d1e/f6f 1786272 0 2024-03-19T06:06:18.210 INFO:tasks.workunit.client.0.smithi072.stdout:9/868: dread d11/d24/d4c/dda/fa1 [0,4194304] 0 2024-03-19T06:06:18.215 INFO:tasks.workunit.client.0.smithi072.stdout:9/869: dread - d11/d24/d4c/dcd/fd0 zero size 2024-03-19T06:06:18.215 INFO:tasks.workunit.client.0.smithi072.stdout:1/997: read d1/d11/d76/da7/d9e/d117/dd8/d63/d73/fc4 [117075,111946] 0 2024-03-19T06:06:18.217 INFO:tasks.workunit.client.0.smithi072.stdout:1/998: chown d1/f6 2129845 1 2024-03-19T06:06:18.220 INFO:tasks.workunit.client.0.smithi072.stdout:1/999: write d1/f8e [4759972,94637] 0 2024-03-19T06:06:18.221 INFO:tasks.workunit.client.0.smithi072.stdout:7/835: dwrite d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/d86/f106 [4194304,4194304] 0 2024-03-19T06:06:18.224 INFO:tasks.workunit.client.0.smithi072.stdout:7/836: chown d2/d3/d17/dc8/d1d/d3b/d63/fcb 31 1 2024-03-19T06:06:18.230 INFO:tasks.workunit.client.0.smithi072.stdout:7/837: link d2/d3/d18/d2f/l5e d2/d3/d17/dc8/d53/dca/d10d/l10e 0 2024-03-19T06:06:18.234 INFO:tasks.workunit.client.0.smithi072.stdout:7/838: mknod d2/d3/d17/dc8/d1d/d2b/d82/c10f 0 2024-03-19T06:06:18.246 INFO:tasks.workunit.client.0.smithi072.stdout:3/962: fsync d2/d19/d1e/f6f 0 2024-03-19T06:06:18.249 INFO:tasks.workunit.client.0.smithi072.stdout:9/870: truncate d11/d1f/f27 1749058 0 2024-03-19T06:06:18.255 INFO:tasks.workunit.client.0.smithi072.stdout:9/871: chown d11/d24/d4c/dda/d36/d45/dcb/d11b/d129/fe6 12 1 2024-03-19T06:06:18.259 INFO:tasks.workunit.client.0.smithi072.stdout:9/872: dread - d11/d24/d4c/dda/d36/d45/dcb/d11b/d129/d113/f122 zero size 2024-03-19T06:06:18.260 INFO:tasks.workunit.client.0.smithi072.stdout:6/909: dwrite d7/d99/d60/f81 [0,4194304] 0 2024-03-19T06:06:18.263 INFO:tasks.workunit.client.0.smithi072.stdout:3/963: dread d2/d3/f6d [0,4194304] 0 2024-03-19T06:06:18.266 INFO:tasks.workunit.client.0.smithi072.stdout:6/910: mkdir d7/d99/d60/d132 0 2024-03-19T06:06:18.267 INFO:tasks.workunit.client.0.smithi072.stdout:9/873: dread - d11/d24/d4c/dda/d36/d45/dcb/feb zero size 2024-03-19T06:06:18.273 INFO:tasks.workunit.client.0.smithi072.stdout:7/839: dread d2/d3/d17/dc8/d1d/d2b/d3d/f39 [0,4194304] 0 2024-03-19T06:06:18.275 INFO:tasks.workunit.client.0.smithi072.stdout:9/874: rmdir d11/d24/d4c/dda/d36/d45/dcb/d11b/d129/d9f/dc7 0 2024-03-19T06:06:18.282 INFO:tasks.workunit.client.0.smithi072.stdout:6/911: dread d7/d9/d1b/f8b [0,4194304] 0 2024-03-19T06:06:18.286 INFO:tasks.workunit.client.0.smithi072.stdout:7/840: write d2/d3/d17/d70/fcd [900430,49563] 0 2024-03-19T06:06:18.293 INFO:tasks.workunit.client.0.smithi072.stdout:6/912: getdents d7/d99/d60/d78/d7f/dcb 0 2024-03-19T06:06:18.294 INFO:tasks.workunit.client.0.smithi072.stdout:9/875: dwrite d11/f1d [0,4194304] 0 2024-03-19T06:06:18.297 INFO:tasks.workunit.client.0.smithi072.stdout:3/964: dwrite d2/d3/d26/fbe [0,4194304] 0 2024-03-19T06:06:18.297 INFO:tasks.workunit.client.0.smithi072.stdout:3/965: read d2/d3/f10 [4528300,37316] 0 2024-03-19T06:06:18.299 INFO:tasks.workunit.client.0.smithi072.stdout:3/966: write d2/f2f [3544165,58257] 0 2024-03-19T06:06:18.300 INFO:tasks.workunit.client.0.smithi072.stdout:9/876: dread d11/d24/d4c/d64/faf [0,4194304] 0 2024-03-19T06:06:18.301 INFO:tasks.workunit.client.0.smithi072.stdout:3/967: chown d2/d40/fe3 1015642 1 2024-03-19T06:06:18.303 INFO:tasks.workunit.client.0.smithi072.stdout:3/968: write d2/d3/d15/fba [4948006,64905] 0 2024-03-19T06:06:18.303 INFO:tasks.workunit.client.0.smithi072.stdout:6/913: symlink d7/d99/d60/d78/d7f/dcb/d84/dc0/dd4/l133 0 2024-03-19T06:06:18.307 INFO:tasks.workunit.client.0.smithi072.stdout:3/969: dread - d2/d3/d15/d66/d6b/f94 zero size 2024-03-19T06:06:18.310 INFO:tasks.workunit.client.0.smithi072.stdout:9/877: rmdir d11/df7 0 2024-03-19T06:06:18.314 INFO:tasks.workunit.client.0.smithi072.stdout:3/970: mkdir d2/d40/d78/de9/d13b 0 2024-03-19T06:06:18.314 INFO:tasks.workunit.client.0.smithi072.stdout:6/914: mkdir d7/d99/d60/ded/df4/d41/d134 0 2024-03-19T06:06:18.314 INFO:tasks.workunit.client.0.smithi072.stdout:3/971: chown d2/d3/d15/d66/d116 951 1 2024-03-19T06:06:18.316 INFO:tasks.workunit.client.0.smithi072.stdout:6/915: chown d7/d9/d1b/d31/cb9 8958 1 2024-03-19T06:06:18.321 INFO:tasks.workunit.client.0.smithi072.stdout:7/841: truncate d2/d3/d17/dc8/d53/dbd/fd5 502176 0 2024-03-19T06:06:18.326 INFO:tasks.workunit.client.0.smithi072.stdout:9/878: getdents d11/d24/d4c/dda/d6f 0 2024-03-19T06:06:18.327 INFO:tasks.workunit.client.0.smithi072.stdout:3/972: creat d2/f13c x:0 0 0 2024-03-19T06:06:18.328 INFO:tasks.workunit.client.0.smithi072.stdout:6/916: creat d7/d99/d60/ded/df4/f135 x:0 0 0 2024-03-19T06:06:18.329 INFO:tasks.workunit.client.0.smithi072.stdout:9/879: dread - d11/d24/d4c/d64/f10d zero size 2024-03-19T06:06:18.331 INFO:tasks.workunit.client.0.smithi072.stdout:3/973: creat d2/df4/f13d x:0 0 0 2024-03-19T06:06:18.331 INFO:tasks.workunit.client.0.smithi072.stdout:7/842: truncate d2/d3/d18/d7f/db3/fe2 855484 0 2024-03-19T06:06:18.332 INFO:tasks.workunit.client.0.smithi072.stdout:6/917: creat d7/d99/d60/ded/f136 x:0 0 0 2024-03-19T06:06:18.333 INFO:tasks.workunit.client.0.smithi072.stdout:9/880: write d11/d24/d4c/dda/d68/d92/d93/f104 [680972,33361] 0 2024-03-19T06:06:18.337 INFO:tasks.workunit.client.0.smithi072.stdout:6/918: unlink d7/d99/d60/d78/d7f/ld2 0 2024-03-19T06:06:18.340 INFO:tasks.workunit.client.0.smithi072.stdout:6/919: truncate d7/d99/d60/f129 2130447 0 2024-03-19T06:06:18.341 INFO:tasks.workunit.client.0.smithi072.stdout:7/843: rename d2/d8c/dab to d2/d3/d17/dc8/d1d/d110 0 2024-03-19T06:06:18.346 INFO:tasks.workunit.client.0.smithi072.stdout:9/881: mknod d11/d24/d4c/dda/d36/c12d 0 2024-03-19T06:06:18.347 INFO:tasks.workunit.client.0.smithi072.stdout:7/844: truncate d2/d3/d17/dc8/d1d/d2b/fd3 1164066 0 2024-03-19T06:06:18.356 INFO:tasks.workunit.client.0.smithi072.stdout:9/882: fsync d11/d24/d4c/dda/d6f/d87/da4/fd7 0 2024-03-19T06:06:18.357 INFO:tasks.workunit.client.0.smithi072.stdout:6/920: dwrite d7/d99/d60/ded/df4/d41/f59 [8388608,4194304] 0 2024-03-19T06:06:18.361 INFO:tasks.workunit.client.0.smithi072.stdout:9/883: creat d11/d24/f12e x:0 0 0 2024-03-19T06:06:18.363 INFO:tasks.workunit.client.0.smithi072.stdout:7/845: rename d2/d3/d17/lc3 to d2/d3/d17/dc8/d1d/d2b/d3d/d21/l111 0 2024-03-19T06:06:18.364 INFO:tasks.workunit.client.0.smithi072.stdout:3/974: dwrite d2/d19/d1e/f32 [0,4194304] 0 2024-03-19T06:06:18.365 INFO:tasks.workunit.client.0.smithi072.stdout:9/884: read d11/d24/d4c/dda/d36/d45/d4d/f62 [1234823,17328] 0 2024-03-19T06:06:18.368 INFO:tasks.workunit.client.0.smithi072.stdout:6/921: creat d7/d99/d60/d132/f137 x:0 0 0 2024-03-19T06:06:18.370 INFO:tasks.workunit.client.0.smithi072.stdout:6/922: read d7/f70 [2828425,31523] 0 2024-03-19T06:06:18.377 INFO:tasks.workunit.client.0.smithi072.stdout:6/923: rmdir d7/d99/d60/d78/d7f/dcb/d84/dc0/dd4 39 2024-03-19T06:06:18.379 INFO:tasks.workunit.client.0.smithi072.stdout:3/975: dread d2/d3/d15/d66/f80 [0,4194304] 0 2024-03-19T06:06:18.381 INFO:tasks.workunit.client.0.smithi072.stdout:3/976: dread - d2/d3/d26/d98/f12a zero size 2024-03-19T06:06:18.386 INFO:tasks.workunit.client.0.smithi072.stdout:6/924: creat d7/d9/d1b/f138 x:0 0 0 2024-03-19T06:06:18.389 INFO:tasks.workunit.client.0.smithi072.stdout:3/977: link d2/dc8/le8 d2/d3/d26/d92/d10c/d10e/d111/l13e 0 2024-03-19T06:06:18.391 INFO:tasks.workunit.client.0.smithi072.stdout:6/925: mkdir d7/d99/d60/d78/d7f/dcb/d84/dc0/dfb/d102/d139 0 2024-03-19T06:06:18.392 INFO:tasks.workunit.client.0.smithi072.stdout:7/846: dread d2/d3/d18/d7f/f97 [0,4194304] 0 2024-03-19T06:06:18.394 INFO:tasks.workunit.client.0.smithi072.stdout:3/978: fsync d2/d3/d15/d66/d70/fab 0 2024-03-19T06:06:18.395 INFO:tasks.workunit.client.0.smithi072.stdout:6/926: fsync d7/d9/d1b/d31/d96/f9e 0 2024-03-19T06:06:18.399 INFO:tasks.workunit.client.0.smithi072.stdout:3/979: mkdir d2/d19/db0/d107/d13f 0 2024-03-19T06:06:18.404 INFO:tasks.workunit.client.0.smithi072.stdout:7/847: mkdir d2/d3/d17/dc8/d1d/d3b/d9a/d9b/df9/d112 0 2024-03-19T06:06:18.406 INFO:tasks.workunit.client.0.smithi072.stdout:9/885: dread d11/d1f/d43/fa2 [0,4194304] 0 2024-03-19T06:06:18.406 INFO:tasks.workunit.client.0.smithi072.stdout:3/980: symlink d2/d40/l140 0 2024-03-19T06:06:18.409 INFO:tasks.workunit.client.0.smithi072.stdout:9/886: write d11/d1f/f10e [56343,34468] 0 2024-03-19T06:06:18.411 INFO:tasks.workunit.client.0.smithi072.stdout:6/927: dwrite d7/d99/d60/fd3 [0,4194304] 0 2024-03-19T06:06:18.413 INFO:tasks.workunit.client.0.smithi072.stdout:3/981: mkdir d2/d19/db0/d141 0 2024-03-19T06:06:18.414 INFO:tasks.workunit.client.0.smithi072.stdout:9/887: dread - d11/d24/d4c/d64/f10d zero size 2024-03-19T06:06:18.414 INFO:tasks.workunit.client.0.smithi072.stdout:7/848: write d2/d8c/dba/dbc/fb4 [3292075,70284] 0 2024-03-19T06:06:18.417 INFO:tasks.workunit.client.0.smithi072.stdout:7/849: dread - d2/d3/d18/d7f/d85/f10b zero size 2024-03-19T06:06:18.418 INFO:tasks.workunit.client.0.smithi072.stdout:3/982: symlink d2/d40/l142 0 2024-03-19T06:06:18.424 INFO:tasks.workunit.client.0.smithi072.stdout:7/850: fdatasync d2/d3/d17/f69 0 2024-03-19T06:06:18.436 INFO:tasks.workunit.client.0.smithi072.stdout:6/928: write d7/d3f/d44/fd0 [295602,95457] 0 2024-03-19T06:06:18.438 INFO:tasks.workunit.client.0.smithi072.stdout:3/983: write d2/d3/d26/d92/fa2 [8652684,44996] 0 2024-03-19T06:06:18.440 INFO:tasks.workunit.client.0.smithi072.stdout:6/929: chown d7/d9/d1b/f7c 15 1 2024-03-19T06:06:18.445 INFO:tasks.workunit.client.0.smithi072.stdout:6/930: symlink d7/d9/d1b/d3b/l13a 0 2024-03-19T06:06:18.450 INFO:tasks.workunit.client.0.smithi072.stdout:6/931: unlink d7/d9/d1b/d21/c119 0 2024-03-19T06:06:18.457 INFO:tasks.workunit.client.0.smithi072.stdout:3/984: dwrite d2/d19/db0/dcb/fcf [0,4194304] 0 2024-03-19T06:06:18.457 INFO:tasks.workunit.client.0.smithi072.stdout:9/888: dread d11/d24/d4c/dda/d36/f42 [0,4194304] 0 2024-03-19T06:06:18.458 INFO:tasks.workunit.client.0.smithi072.stdout:9/889: stat d11/d9e 0 2024-03-19T06:06:18.461 INFO:tasks.workunit.client.0.smithi072.stdout:3/985: creat d2/d40/d78/f143 x:0 0 0 2024-03-19T06:06:18.461 INFO:tasks.workunit.client.0.smithi072.stdout:6/932: write d7/d9/d1b/d3b/d9b/da4/fea [561160,103824] 0 2024-03-19T06:06:18.462 INFO:tasks.workunit.client.0.smithi072.stdout:9/890: mkdir d11/d1f/d43/d12f 0 2024-03-19T06:06:18.466 INFO:tasks.workunit.client.0.smithi072.stdout:3/986: mkdir d2/d3/d15/d66/d6b/d79/d144 0 2024-03-19T06:06:18.471 INFO:tasks.workunit.client.0.smithi072.stdout:3/987: creat d2/d3/d15/f145 x:0 0 0 2024-03-19T06:06:18.473 INFO:tasks.workunit.client.0.smithi072.stdout:6/933: dread d7/d9/d1b/d21/d68/d80/fe1 [0,4194304] 0 2024-03-19T06:06:18.474 INFO:tasks.workunit.client.0.smithi072.stdout:9/891: creat d11/d1f/f130 x:0 0 0 2024-03-19T06:06:18.475 INFO:tasks.workunit.client.0.smithi072.stdout:6/934: chown d7/d9/d1b/d3b/d48/d11b/l130 1 1 2024-03-19T06:06:18.482 INFO:tasks.workunit.client.0.smithi072.stdout:9/892: rename d11/d1f/c6c to d11/d24/d4c/dda/d36/d45/c131 0 2024-03-19T06:06:18.489 INFO:tasks.workunit.client.0.smithi072.stdout:3/988: dwrite d2/fb3 [8388608,4194304] 0 2024-03-19T06:06:18.491 INFO:tasks.workunit.client.0.smithi072.stdout:9/893: write d11/d24/d4c/d64/f75 [345102,82283] 0 2024-03-19T06:06:18.491 INFO:tasks.workunit.client.0.smithi072.stdout:6/935: write d7/d9/d1b/d21/d68/daa/f87 [3659833,17622] 0 2024-03-19T06:06:18.495 INFO:tasks.workunit.client.0.smithi072.stdout:3/989: creat d2/d3/d15/d66/f146 x:0 0 0 2024-03-19T06:06:18.497 INFO:tasks.workunit.client.0.smithi072.stdout:9/894: read d11/d24/ddd/f71 [1512220,106884] 0 2024-03-19T06:06:18.502 INFO:tasks.workunit.client.0.smithi072.stdout:9/895: fdatasync d11/d1f/d43/f5a 0 2024-03-19T06:06:18.506 INFO:tasks.workunit.client.0.smithi072.stdout:6/936: rmdir d7/d9/d1b/d21/d126 0 2024-03-19T06:06:18.511 INFO:tasks.workunit.client.0.smithi072.stdout:6/937: unlink d7/d9/d30/fb7 0 2024-03-19T06:06:18.513 INFO:tasks.workunit.client.0.smithi072.stdout:3/990: write d2/d19/db0/fe7 [11982,80825] 0 2024-03-19T06:06:18.516 INFO:tasks.workunit.client.0.smithi072.stdout:9/896: rename d11/d1f/d43/fdb to d11/d24/d4c/dda/f132 0 2024-03-19T06:06:18.517 INFO:tasks.workunit.client.0.smithi072.stdout:6/938: creat d7/d9/d1b/d31/da6/d118/f13b x:0 0 0 2024-03-19T06:06:18.520 INFO:tasks.workunit.client.0.smithi072.stdout:3/991: getdents d2/d19/db0/d107/d13f 0 2024-03-19T06:06:18.521 INFO:tasks.workunit.client.0.smithi072.stdout:9/897: read d11/d1f/f27 [1189385,70568] 0 2024-03-19T06:06:18.525 INFO:tasks.workunit.client.0.smithi072.stdout:9/898: creat d11/d1f/d43/f133 x:0 0 0 2024-03-19T06:06:18.528 INFO:tasks.workunit.client.0.smithi072.stdout:3/992: write d2/d40/d78/fd4 [447896,116233] 0 2024-03-19T06:06:18.532 INFO:tasks.workunit.client.0.smithi072.stdout:9/899: truncate d11/d24/d4c/dda/d36/d45/d4d/fc6 2704837 0 2024-03-19T06:06:18.535 INFO:tasks.workunit.client.0.smithi072.stdout:6/939: dwrite d7/d9/d1b/d21/fd5 [0,4194304] 0 2024-03-19T06:06:18.539 INFO:tasks.workunit.client.0.smithi072.stdout:9/900: unlink d11/c1a 0 2024-03-19T06:06:18.541 INFO:tasks.workunit.client.0.smithi072.stdout:6/940: creat d7/d9/d1b/d3b/d9b/dab/d100/f13c x:0 0 0 2024-03-19T06:06:18.547 INFO:tasks.workunit.client.0.smithi072.stdout:6/941: stat d7/d9/d1b/d21/d68/daa/d88/f128 0 2024-03-19T06:06:18.547 INFO:tasks.workunit.client.0.smithi072.stdout:3/993: dwrite d2/d19/f6c [4194304,4194304] 0 2024-03-19T06:06:18.549 INFO:tasks.workunit.client.0.smithi072.stdout:6/942: chown d7/d99/d60/d78/d7f/dcb/d84/dc0/dfb 3116 1 2024-03-19T06:06:18.551 INFO:tasks.workunit.client.0.smithi072.stdout:3/994: fdatasync d2/dc8/fee 0 2024-03-19T06:06:18.554 INFO:tasks.workunit.client.0.smithi072.stdout:6/943: mknod d7/d9/d1b/d21/d68/d80/c13d 0 2024-03-19T06:06:18.555 INFO:tasks.workunit.client.0.smithi072.stdout:9/901: link d11/d24/ddd/l61 d11/d24/d4c/dda/d36/d3e/l134 0 2024-03-19T06:06:18.559 INFO:tasks.workunit.client.0.smithi072.stdout:3/995: mkdir d2/d19/db0/d107/d147 0 2024-03-19T06:06:18.559 INFO:tasks.workunit.client.0.smithi072.stdout:6/944: fsync d7/d9/d1b/d3b/d48/faf 0 2024-03-19T06:06:18.564 INFO:tasks.workunit.client.0.smithi072.stdout:3/996: fsync d2/d40/d78/f9a 0 2024-03-19T06:06:18.571 INFO:tasks.workunit.client.0.smithi072.stdout:6/945: symlink d7/d99/d60/ded/df4/l13e 0 2024-03-19T06:06:18.571 INFO:tasks.workunit.client.0.smithi072.stdout:6/946: stat l5 0 2024-03-19T06:06:18.573 INFO:tasks.workunit.client.0.smithi072.stdout:3/997: symlink d2/d19/db0/l148 0 2024-03-19T06:06:18.577 INFO:tasks.workunit.client.0.smithi072.stdout:3/998: fsync d2/d40/d78/f9a 0 2024-03-19T06:06:18.581 INFO:tasks.workunit.client.0.smithi072.stdout:6/947: rename d7/d9/d1b/d31/da6/d118/f13b to d7/d9/d1b/d21/d68/daa/d88/f13f 0 2024-03-19T06:06:18.591 INFO:tasks.workunit.client.0.smithi072.stdout:9/902: dread d11/d24/d4c/dda/d36/f40 [0,4194304] 0 2024-03-19T06:06:18.593 INFO:tasks.workunit.client.0.smithi072.stdout:3/999: write d2/d3/d15/d66/d6b/db2/fd2 [1116519,28723] 0 2024-03-19T06:06:18.601 INFO:tasks.workunit.client.0.smithi072.stdout:6/948: dwrite d7/d9/d1e/fe0 [0,4194304] 0 2024-03-19T06:06:18.605 INFO:tasks.workunit.client.0.smithi072.stdout:9/903: truncate d11/d24/d4c/dda/d6f/dac/fb4 2477825 0 2024-03-19T06:06:18.609 INFO:tasks.workunit.client.0.smithi072.stdout:9/904: fsync d11/d24/d4c/dda/d68/d92/fee 0 2024-03-19T06:06:18.611 INFO:tasks.workunit.client.0.smithi072.stdout:9/905: write d11/d1f/d43/f133 [621343,69082] 0 2024-03-19T06:06:18.629 INFO:tasks.workunit.client.0.smithi072.stdout:9/906: write d11/d24/d4c/dda/d36/f53 [1275460,108434] 0 2024-03-19T06:06:18.647 INFO:tasks.workunit.client.0.smithi072.stdout:9/907: write d11/d24/d4c/dda/d68/d92/fee [3207472,48734] 0 2024-03-19T06:06:18.666 INFO:tasks.workunit.client.0.smithi072.stdout:9/908: dwrite d11/d24/d4c/dda/d68/d92/dc0/f10c [0,4194304] 0 2024-03-19T06:06:18.668 INFO:tasks.workunit.client.0.smithi072.stdout:9/909: chown d11/d24/d4c/d6e/f9d 15415 1 2024-03-19T06:06:18.676 INFO:tasks.workunit.client.0.smithi072.stdout:9/910: dread d11/d24/d4c/dda/d36/f90 [0,4194304] 0 2024-03-19T06:06:18.688 INFO:tasks.workunit.client.0.smithi072.stdout:9/911: write d11/d24/d4c/dda/d6f/dff/fbb [314114,1038] 0 2024-03-19T06:06:18.691 INFO:tasks.workunit.client.0.smithi072.stdout:9/912: rmdir d11/d24/d4c/dda/d68/d92 39 2024-03-19T06:06:18.693 INFO:tasks.workunit.client.0.smithi072.stdout:9/913: read d11/f25 [497557,65490] 0 2024-03-19T06:06:18.698 INFO:tasks.workunit.client.0.smithi072.stdout:9/914: creat d11/d24/d4c/dda/d36/d45/f135 x:0 0 0 2024-03-19T06:06:18.703 INFO:tasks.workunit.client.0.smithi072.stdout:9/915: unlink d11/d24/d4c/dda/d36/d45/d5b/fbe 0 2024-03-19T06:06:18.705 INFO:tasks.workunit.client.0.smithi072.stdout:9/916: chown d11/d1f/f7e 9 1 2024-03-19T06:06:18.708 INFO:tasks.workunit.client.0.smithi072.stdout:9/917: unlink d11/d24/d4c/dda/d68/l114 0 2024-03-19T06:06:18.710 INFO:tasks.workunit.client.0.smithi072.stdout:9/918: unlink lb 0 2024-03-19T06:06:18.715 INFO:tasks.workunit.client.0.smithi072.stdout:9/919: mkdir d11/d1f/d136 0 2024-03-19T06:06:18.740 INFO:tasks.workunit.client.0.smithi072.stdout:9/920: dwrite d11/d24/d4c/dda/d68/d92/d93/fea [0,4194304] 0 2024-03-19T06:06:18.766 INFO:tasks.workunit.client.0.smithi072.stdout:9/921: dwrite d11/d1f/d43/f133 [0,4194304] 0 2024-03-19T06:06:18.773 INFO:tasks.workunit.client.0.smithi072.stdout:9/922: symlink d11/d24/d4c/dda/d36/d45/d5b/l137 0 2024-03-19T06:06:18.792 INFO:tasks.workunit.client.0.smithi072.stdout:9/923: dwrite d11/d24/d4c/dda/d68/d92/fee [0,4194304] 0 2024-03-19T06:06:18.855 INFO:tasks.workunit.client.0.smithi072.stdout:6/949: sync 2024-03-19T06:06:18.855 INFO:tasks.workunit.client.0.smithi072.stdout:7/851: sync 2024-03-19T06:06:18.998 INFO:tasks.workunit.client.0.smithi072.stdout:9/924: mknod d11/d24/d4c/dda/d6f/c138 0 2024-03-19T06:06:19.009 INFO:tasks.workunit.client.0.smithi072.stdout:9/925: truncate d11/d24/d4c/dda/d68/f121 100647 0 2024-03-19T06:06:19.045 INFO:tasks.workunit.client.0.smithi072.stdout:6/950: dread d7/d99/d60/ded/f116 [0,4194304] 0 2024-03-19T06:06:19.049 INFO:tasks.workunit.client.0.smithi072.stdout:9/926: dread d11/d24/ddd/f6a [0,4194304] 0 2024-03-19T06:06:19.074 INFO:tasks.workunit.client.0.smithi072.stdout:6/951: dwrite d7/d99/d60/ded/df4/d41/d92/fb4 [0,4194304] 0 2024-03-19T06:06:19.075 INFO:tasks.workunit.client.0.smithi072.stdout:9/927: dwrite d11/d24/ddd/d5c/f8b [0,4194304] 0 2024-03-19T06:06:19.083 INFO:tasks.workunit.client.0.smithi072.stdout:9/928: chown d11/d24/d4c/dda/d6f/dac/c110 18 1 2024-03-19T06:06:19.088 INFO:tasks.workunit.client.0.smithi072.stdout:9/929: symlink d11/d24/d4c/dda/d36/d3e/l139 0 2024-03-19T06:06:19.101 INFO:tasks.workunit.client.0.smithi072.stdout:9/930: mkdir d11/d24/d4c/dda/d36/d45/dcb/d11b/d129/d113/d13a 0 2024-03-19T06:06:19.109 INFO:tasks.workunit.client.0.smithi072.stdout:9/931: getdents d11/d24/d4c/dda/d68/d92/da6 0 2024-03-19T06:06:19.118 INFO:tasks.workunit.client.0.smithi072.stdout:6/952: truncate d7/d99/d60/f129 145355 0 2024-03-19T06:06:19.129 INFO:tasks.workunit.client.0.smithi072.stdout:9/932: dwrite d11/d24/d4c/dda/d36/fe3 [0,4194304] 0 2024-03-19T06:06:19.151 INFO:tasks.workunit.client.0.smithi072.stdout:6/953: dread d7/f3c [0,4194304] 0 2024-03-19T06:06:19.155 INFO:tasks.workunit.client.0.smithi072.stdout:9/933: dwrite d11/d24/d4c/dda/d68/d92/dc0/fd4 [0,4194304] 0 2024-03-19T06:06:19.166 INFO:tasks.workunit.client.0.smithi072.stdout:9/934: fdatasync d11/d9e/fa9 0 2024-03-19T06:06:19.393 INFO:tasks.workunit.client.0.smithi072.stdout:9/935: sync 2024-03-19T06:06:19.453 INFO:tasks.workunit.client.0.smithi072.stdout:7/852: unlink d2/d3/d18/c102 0 2024-03-19T06:06:19.455 INFO:tasks.workunit.client.0.smithi072.stdout:6/954: unlink d7/d99/d60/d78/d7f/dcb/d84/dc0/dd4/l133 0 2024-03-19T06:06:19.456 INFO:tasks.workunit.client.0.smithi072.stdout:9/936: unlink d11/d1f/f10e 0 2024-03-19T06:06:19.462 INFO:tasks.workunit.client.0.smithi072.stdout:6/955: mkdir d7/d9/d1b/d3b/d140 0 2024-03-19T06:06:19.465 INFO:tasks.workunit.client.0.smithi072.stdout:9/937: mknod d11/d24/d4c/dda/d6f/dff/c13b 0 2024-03-19T06:06:19.468 INFO:tasks.workunit.client.0.smithi072.stdout:7/853: creat d2/d3/d17/dc8/d1d/d3b/d9a/ded/f113 x:0 0 0 2024-03-19T06:06:19.470 INFO:tasks.workunit.client.0.smithi072.stdout:6/956: creat d7/d99/d60/ded/f141 x:0 0 0 2024-03-19T06:06:19.481 INFO:tasks.workunit.client.0.smithi072.stdout:6/957: creat d7/d9/d2b/f142 x:0 0 0 2024-03-19T06:06:19.491 INFO:tasks.workunit.client.0.smithi072.stdout:6/958: creat d7/d99/d60/f143 x:0 0 0 2024-03-19T06:06:19.539 INFO:tasks.workunit.client.0.smithi072.stdout:9/938: write d11/d1f/f27 [384966,94650] 0 2024-03-19T06:06:19.542 INFO:tasks.workunit.client.0.smithi072.stdout:6/959: write d7/d99/d60/f129 [1193864,63008] 0 2024-03-19T06:06:19.555 INFO:tasks.workunit.client.0.smithi072.stdout:6/960: mkdir d7/d9/d1b/d21/d68/d144 0 2024-03-19T06:06:19.556 INFO:tasks.workunit.client.0.smithi072.stdout:7/854: dwrite d2/d3/d17/dc8/d1d/d2b/d3d/d21/f99 [4194304,4194304] 0 2024-03-19T06:06:19.563 INFO:tasks.workunit.client.0.smithi072.stdout:6/961: mkdir d7/d9/d1b/d31/d96/d145 0 2024-03-19T06:06:19.575 INFO:tasks.workunit.client.0.smithi072.stdout:6/962: unlink d7/d99/d60/d78/d7f/dcb/d84/dc0/dfb/f10d 0 2024-03-19T06:06:19.578 INFO:tasks.workunit.client.0.smithi072.stdout:6/963: write d7/d9/d1b/d3b/d9b/da4/f117 [217406,88075] 0 2024-03-19T06:06:19.584 INFO:tasks.workunit.client.0.smithi072.stdout:6/964: mknod d7/d99/d60/d78/d7f/dcb/d84/c146 0 2024-03-19T06:06:19.596 INFO:tasks.workunit.client.0.smithi072.stdout:6/965: dread d7/fc [0,4194304] 0 2024-03-19T06:06:19.603 INFO:tasks.workunit.client.0.smithi072.stdout:9/939: dread d11/d24/ddd/f52 [4194304,4194304] 0 2024-03-19T06:06:19.609 INFO:tasks.workunit.client.0.smithi072.stdout:7/855: dread d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/fb6 [0,4194304] 0 2024-03-19T06:06:19.614 INFO:tasks.workunit.client.0.smithi072.stdout:9/940: read d11/d78/fcf [715192,40995] 0 2024-03-19T06:06:19.616 INFO:tasks.workunit.client.0.smithi072.stdout:7/856: mkdir d2/d3/d17/dc8/d1d/d3b/d9a/d9b/df9/d114 0 2024-03-19T06:06:19.616 INFO:tasks.workunit.client.0.smithi072.stdout:9/941: chown d11/f17 0 1 2024-03-19T06:06:19.624 INFO:tasks.workunit.client.0.smithi072.stdout:6/966: dwrite d7/d9/d1b/d3b/d48/faf [0,4194304] 0 2024-03-19T06:06:19.636 INFO:tasks.workunit.client.0.smithi072.stdout:9/942: link d11/d24/d4c/dda/d6f/d87/da4/l103 d11/d24/d4c/dda/d36/d45/dcb/d11b/l13c 0 2024-03-19T06:06:19.640 INFO:tasks.workunit.client.0.smithi072.stdout:7/857: write d2/d3/d17/faf [1512051,92156] 0 2024-03-19T06:06:19.643 INFO:tasks.workunit.client.0.smithi072.stdout:9/943: fsync d11/d24/d4c/dda/d68/d92/d93/fb8 0 2024-03-19T06:06:19.645 INFO:tasks.workunit.client.0.smithi072.stdout:7/858: chown d2/f93 934 1 2024-03-19T06:06:19.655 INFO:tasks.workunit.client.0.smithi072.stdout:6/967: write d7/d3f/d65/f112 [414052,72952] 0 2024-03-19T06:06:19.662 INFO:tasks.workunit.client.0.smithi072.stdout:6/968: mkdir d7/d9/d1b/d31/da6/d118/d147 0 2024-03-19T06:06:19.663 INFO:tasks.workunit.client.0.smithi072.stdout:7/859: write d2/d3/d17/dc8/d1d/d3b/d63/fac [1301991,102880] 0 2024-03-19T06:06:19.669 INFO:tasks.workunit.client.0.smithi072.stdout:6/969: truncate f3 474369 0 2024-03-19T06:06:19.672 INFO:tasks.workunit.client.0.smithi072.stdout:7/860: read d2/d3/d17/dc8/d1d/d3b/d63/fcb [216817,80651] 0 2024-03-19T06:06:19.672 INFO:tasks.workunit.client.0.smithi072.stdout:9/944: dwrite d11/d9e/fa9 [0,4194304] 0 2024-03-19T06:06:19.675 INFO:tasks.workunit.client.0.smithi072.stdout:7/861: stat d2/d3/d17/dc8/c1f 0 2024-03-19T06:06:19.679 INFO:tasks.workunit.client.0.smithi072.stdout:6/970: creat d7/d99/d60/ded/df5/f148 x:0 0 0 2024-03-19T06:06:19.687 INFO:tasks.workunit.client.0.smithi072.stdout:7/862: write d2/d3/d17/dc8/d1d/d3b/d63/f8a [2246369,20903] 0 2024-03-19T06:06:19.690 INFO:tasks.workunit.client.0.smithi072.stdout:7/863: fsync d2/d3/d17/d70/fcd 0 2024-03-19T06:06:19.697 INFO:tasks.workunit.client.0.smithi072.stdout:6/971: truncate d7/d99/d60/fd3 3226505 0 2024-03-19T06:06:19.698 INFO:tasks.workunit.client.0.smithi072.stdout:7/864: write d2/d3/d17/dc8/d1d/d2b/d3d/d21/f99 [632149,86815] 0 2024-03-19T06:06:19.706 INFO:tasks.workunit.client.0.smithi072.stdout:6/972: truncate d7/d99/d60/d78/fc7 1016772 0 2024-03-19T06:06:19.711 INFO:tasks.workunit.client.0.smithi072.stdout:7/865: link d2/d3/d17/dc8/d1d/d3b/d63/fcb d2/d3/d18/d20/f115 0 2024-03-19T06:06:19.734 INFO:tasks.workunit.client.0.smithi072.stdout:6/973: dwrite d7/d9/d2b/fa7 [0,4194304] 0 2024-03-19T06:06:19.734 INFO:tasks.workunit.client.0.smithi072.stdout:7/866: dread d2/d3/d17/dc8/d1d/d2b/d3d/f39 [4194304,4194304] 0 2024-03-19T06:06:19.738 INFO:tasks.workunit.client.0.smithi072.stdout:6/974: dread - d7/d99/d60/ded/f109 zero size 2024-03-19T06:06:19.740 INFO:tasks.workunit.client.0.smithi072.stdout:7/867: chown d2/d8c/dba/dbc/fb4 45658 1 2024-03-19T06:06:19.744 INFO:tasks.workunit.client.0.smithi072.stdout:6/975: rmdir d7/d99/d60/d78 39 2024-03-19T06:06:19.745 INFO:tasks.workunit.client.0.smithi072.stdout:7/868: write d2/d3/d17/d70/fcd [1644651,121071] 0 2024-03-19T06:06:19.751 INFO:tasks.workunit.client.0.smithi072.stdout:7/869: mknod d2/d3/d17/dc8/d1d/d2b/d75/c116 0 2024-03-19T06:06:19.751 INFO:tasks.workunit.client.0.smithi072.stdout:6/976: read d7/d9/d1b/f2a [394378,60648] 0 2024-03-19T06:06:19.757 INFO:tasks.workunit.client.0.smithi072.stdout:6/977: creat d7/d99/d60/ded/f149 x:0 0 0 2024-03-19T06:06:19.772 INFO:tasks.workunit.client.0.smithi072.stdout:7/870: dwrite d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/d86/f106 [0,4194304] 0 2024-03-19T06:06:19.786 INFO:tasks.workunit.client.0.smithi072.stdout:6/978: dwrite d7/d9/d1b/d3b/f6e [0,4194304] 0 2024-03-19T06:06:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:19 smithi172 ceph-mon[35716]: pgmap v36: 65 pgs: 65 active+clean; 2.4 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 45 MiB/s rd, 94 MiB/s wr, 272 op/s 2024-03-19T06:06:20.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:19 smithi072 ceph-mon[28706]: pgmap v36: 65 pgs: 65 active+clean; 2.4 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 45 MiB/s rd, 94 MiB/s wr, 272 op/s 2024-03-19T06:06:20.326 INFO:tasks.workunit.client.0.smithi072.stdout:9/945: sync 2024-03-19T06:06:20.746 INFO:tasks.workunit.client.0.smithi072.stdout:6/979: dwrite d7/d9/fb6 [0,4194304] 0 2024-03-19T06:06:20.776 INFO:tasks.workunit.client.0.smithi072.stdout:9/946: rmdir d11/d24 39 2024-03-19T06:06:20.794 INFO:tasks.workunit.client.0.smithi072.stdout:9/947: mknod d11/d24/ddd/dde/c13d 0 2024-03-19T06:06:20.816 INFO:tasks.workunit.client.0.smithi072.stdout:9/948: dwrite d11/d24/d4c/dda/f127 [0,4194304] 0 2024-03-19T06:06:20.822 INFO:tasks.workunit.client.0.smithi072.stdout:9/949: dread - d11/d1f/d43/ffa zero size 2024-03-19T06:06:20.824 INFO:tasks.workunit.client.0.smithi072.stdout:7/871: dwrite d2/d3/d17/dc8/d53/dbd/fd8 [0,4194304] 0 2024-03-19T06:06:20.834 INFO:tasks.workunit.client.0.smithi072.stdout:7/872: creat d2/d3/d18/d20/f117 x:0 0 0 2024-03-19T06:06:20.842 INFO:tasks.workunit.client.0.smithi072.stdout:9/950: dread d11/d24/ddd/f6a [0,4194304] 0 2024-03-19T06:06:21.123 INFO:tasks.workunit.client.0.smithi072.stdout:6/980: link d7/d99/d60/d78/d7f/dcb/lfa d7/d9/d1b/d21/d68/l14a 0 2024-03-19T06:06:21.128 INFO:tasks.workunit.client.0.smithi072.stdout:6/981: rename d7/d9/d1b/d3b/d9b/da4/f117 to d7/d9/d1b/d31/f14b 0 2024-03-19T06:06:21.131 INFO:tasks.workunit.client.0.smithi072.stdout:6/982: write d7/d99/d60/ded/df4/d41/d92/f115 [784972,53264] 0 2024-03-19T06:06:21.133 INFO:tasks.workunit.client.0.smithi072.stdout:6/983: write d7/d9/d1b/f8b [1404159,41267] 0 2024-03-19T06:06:21.143 INFO:tasks.workunit.client.0.smithi072.stdout:6/984: write d7/d9/d30/f10a [971614,41932] 0 2024-03-19T06:06:21.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:21 smithi072 ceph-mon[28706]: pgmap v37: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 59 MiB/s rd, 129 MiB/s wr, 381 op/s 2024-03-19T06:06:21.893 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:21 smithi172 ceph-mon[35716]: pgmap v37: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 59 MiB/s rd, 129 MiB/s wr, 381 op/s 2024-03-19T06:06:22.070 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-19T06:06:22.070 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-03-19T06:06:22.811 INFO:tasks.workunit.client.0.smithi072.stdout:7/873: sync 2024-03-19T06:06:22.811 INFO:tasks.workunit.client.0.smithi072.stdout:6/985: sync 2024-03-19T06:06:22.811 INFO:tasks.workunit.client.0.smithi072.stdout:9/951: sync 2024-03-19T06:06:22.824 INFO:tasks.workunit.client.0.smithi072.stdout:9/952: chown d11/d24/d4c/dda/d68/f121 1013977462 1 2024-03-19T06:06:22.827 INFO:tasks.workunit.client.0.smithi072.stdout:9/953: fdatasync d11/d1f/f101 0 2024-03-19T06:06:22.830 INFO:tasks.workunit.client.0.smithi072.stdout:7/874: rename d2/d3/d17/dc8/d1d/d2b/d75/ca2 to d2/d3/d18/c118 0 2024-03-19T06:06:22.835 INFO:tasks.workunit.client.0.smithi072.stdout:9/954: mkdir d11/d9e/d13e 0 2024-03-19T06:06:22.840 INFO:tasks.workunit.client.0.smithi072.stdout:7/875: creat d2/d3/d18/d7f/db3/f119 x:0 0 0 2024-03-19T06:06:22.851 INFO:tasks.workunit.client.0.smithi072.stdout:7/876: mkdir d2/d3/d18/d7f/d85/df0/d11a 0 2024-03-19T06:06:22.858 INFO:tasks.workunit.client.0.smithi072.stdout:9/955: rename d11/d24/d4c/dda/d68/d92/d93 to d11/d24/ddd/dde/d13f 0 2024-03-19T06:06:22.860 INFO:tasks.workunit.client.0.smithi072.stdout:7/877: symlink d2/d3/d17/dc8/d1d/l11b 0 2024-03-19T06:06:22.879 INFO:tasks.workunit.client.0.smithi072.stdout:6/986: dread d7/d9/d1b/d3b/d9b/dab/d100/f111 [0,4194304] 0 2024-03-19T06:06:22.880 INFO:tasks.workunit.client.0.smithi072.stdout:7/878: getdents d2/d3/d17/dc8/d1d/d2b 0 2024-03-19T06:06:22.883 INFO:tasks.workunit.client.0.smithi072.stdout:9/956: link d11/d24/d4c/dda/d36/d45/d5b/l137 d11/d24/d4c/d64/l140 0 2024-03-19T06:06:22.885 INFO:tasks.workunit.client.0.smithi072.stdout:6/987: symlink d7/d3f/d65/l14c 0 2024-03-19T06:06:22.889 INFO:tasks.workunit.client.0.smithi072.stdout:9/957: mknod d11/d24/c141 0 2024-03-19T06:06:22.890 INFO:tasks.workunit.client.0.smithi072.stdout:9/958: readlink d11/d24/l2f 0 2024-03-19T06:06:22.892 INFO:tasks.workunit.client.0.smithi072.stdout:7/879: creat d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/d86/f11c x:0 0 0 2024-03-19T06:06:22.898 INFO:tasks.workunit.client.0.smithi072.stdout:7/880: dread - d2/d3/d17/dc8/d1d/d3b/d9a/d9b/fdb zero size 2024-03-19T06:06:22.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:22 smithi172 ceph-mon[35716]: pgmap v38: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 32 MiB/s rd, 82 MiB/s wr, 236 op/s 2024-03-19T06:06:22.905 INFO:tasks.workunit.client.0.smithi072.stdout:7/881: creat d2/d3/d18/d7f/f11d x:0 0 0 2024-03-19T06:06:22.906 INFO:tasks.workunit.client.0.smithi072.stdout:9/959: link d11/d24/l2f d11/d24/d4c/dda/d36/d45/dcb/d11b/d129/d113/d13a/l142 0 2024-03-19T06:06:22.908 INFO:tasks.workunit.client.0.smithi072.stdout:6/988: write d7/d9/d1b/f7c [287405,102886] 0 2024-03-19T06:06:22.917 INFO:tasks.workunit.client.0.smithi072.stdout:9/960: creat d11/d24/d4c/dda/d6f/d88/f143 x:0 0 0 2024-03-19T06:06:22.917 INFO:tasks.workunit.client.0.smithi072.stdout:7/882: getdents d2/d3/d17/dc8/d53/dca 0 2024-03-19T06:06:22.924 INFO:tasks.workunit.client.0.smithi072.stdout:9/961: mknod d11/d24/d4c/dda/d36/d45/dcb/d11b/d129/d9f/c144 0 2024-03-19T06:06:22.934 INFO:tasks.workunit.client.0.smithi072.stdout:6/989: dwrite d7/d3f/fee [0,4194304] 0 2024-03-19T06:06:22.935 INFO:tasks.workunit.client.0.smithi072.stdout:9/962: link d11/d24/d4c/dda/d36/d45/dcb/lce d11/d24/d4c/dda/d36/d45/d5b/l145 0 2024-03-19T06:06:22.939 INFO:tasks.workunit.client.0.smithi072.stdout:9/963: fsync d11/d24/d4c/dcd/fd0 0 2024-03-19T06:06:22.942 INFO:tasks.workunit.client.0.smithi072.stdout:9/964: fsync d11/d24/d4c/dda/d36/f40 0 2024-03-19T06:06:22.951 INFO:tasks.workunit.client.0.smithi072.stdout:9/965: creat d11/d24/d4c/dda/d68/dec/f146 x:0 0 0 2024-03-19T06:06:22.970 INFO:tasks.workunit.client.0.smithi072.stdout:7/883: dread d2/d3/d17/dc8/d1d/d2b/d3d/d21/f99 [0,4194304] 0 2024-03-19T06:06:22.971 INFO:tasks.workunit.client.0.smithi072.stdout:7/884: dread - d2/d3/d17/f77 zero size 2024-03-19T06:06:22.974 INFO:tasks.workunit.client.0.smithi072.stdout:9/966: dwrite d11/d24/d4c/dda/d68/f73 [0,4194304] 0 2024-03-19T06:06:22.974 INFO:tasks.workunit.client.0.smithi072.stdout:7/885: truncate d2/d3/d18/d20/f117 328490 0 2024-03-19T06:06:23.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:22 smithi072 ceph-mon[28706]: pgmap v38: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 32 MiB/s rd, 82 MiB/s wr, 236 op/s 2024-03-19T06:06:23.199 INFO:tasks.workunit.client.0.smithi072.stdout:9/967: creat d11/d24/d4c/d6e/f147 x:0 0 0 2024-03-19T06:06:23.207 INFO:tasks.workunit.client.0.smithi072.stdout:7/886: dwrite d2/d3/d18/d7f/f97 [0,4194304] 0 2024-03-19T06:06:23.210 INFO:tasks.workunit.client.0.smithi072.stdout:7/887: chown d2/d3/f62 4 1 2024-03-19T06:06:23.237 INFO:tasks.workunit.client.0.smithi072.stdout:7/888: rename d2/d3/d18/d88 to d2/d3/d18/d7f/db3/d11e 0 2024-03-19T06:06:23.248 INFO:tasks.workunit.client.0.smithi072.stdout:7/889: mkdir d2/d3/d17/dc8/d53/dbd/d11f 0 2024-03-19T06:06:23.261 INFO:tasks.workunit.client.0.smithi072.stdout:9/968: rmdir d11/d1f/d136 0 2024-03-19T06:06:23.262 INFO:tasks.workunit.client.0.smithi072.stdout:7/890: write d2/d3/d18/d7f/fb2 [155594,38421] 0 2024-03-19T06:06:23.273 INFO:tasks.workunit.client.0.smithi072.stdout:9/969: getdents d11/d24/d4c/d6e 0 2024-03-19T06:06:23.293 INFO:tasks.workunit.client.0.smithi072.stdout:7/891: dwrite d2/d3/d17/dc8/d1d/d2b/fd3 [0,4194304] 0 2024-03-19T06:06:23.323 INFO:tasks.workunit.client.0.smithi072.stdout:7/892: dwrite d2/d3/d18/d7f/db3/fe2 [0,4194304] 0 2024-03-19T06:06:23.330 INFO:tasks.workunit.client.0.smithi072.stdout:7/893: fdatasync d2/d3/d18/d3f/fd1 0 2024-03-19T06:06:23.339 INFO:tasks.workunit.client.0.smithi072.stdout:7/894: mkdir d2/d3/d17/dc8/d1d/d2b/d82/dc5/d120 0 2024-03-19T06:06:23.365 INFO:tasks.workunit.client.0.smithi072.stdout:7/895: dwrite d2/d3/d17/dc8/d53/dca/feb [0,4194304] 0 2024-03-19T06:06:23.369 INFO:tasks.workunit.client.0.smithi072.stdout:7/896: write d2/d3/d18/d7f/f97 [1156859,120984] 0 2024-03-19T06:06:23.374 INFO:tasks.workunit.client.0.smithi072.stdout:7/897: write d2/d3/d17/dc8/d1d/d3b/d9a/ded/f113 [652037,73757] 0 2024-03-19T06:06:23.386 INFO:tasks.workunit.client.0.smithi072.stdout:7/898: write d2/d3/d17/dc8/d53/dbd/fd5 [410252,92604] 0 2024-03-19T06:06:23.391 INFO:tasks.workunit.client.0.smithi072.stdout:7/899: read d2/d3/d17/dc8/d1d/d3b/d9a/ded/f113 [627365,88820] 0 2024-03-19T06:06:23.578 INFO:tasks.workunit.client.0.smithi072.stdout:9/970: sync 2024-03-19T06:06:23.579 INFO:tasks.workunit.client.0.smithi072.stdout:7/900: sync 2024-03-19T06:06:23.579 INFO:tasks.workunit.client.0.smithi072.stdout:6/990: sync 2024-03-19T06:06:23.582 INFO:tasks.workunit.client.0.smithi072.stdout:9/971: readlink d11/d24/d4c/dda/d36/d45/lbc 0 2024-03-19T06:06:23.589 INFO:tasks.workunit.client.0.smithi072.stdout:9/972: read d11/fbf [1994072,103031] 0 2024-03-19T06:06:23.594 INFO:tasks.workunit.client.0.smithi072.stdout:9/973: readlink d11/d24/d4c/dda/d68/l80 0 2024-03-19T06:06:23.601 INFO:tasks.workunit.client.0.smithi072.stdout:9/974: truncate d11/d1f/d43/ffa 777346 0 2024-03-19T06:06:23.601 INFO:tasks.workunit.client.0.smithi072.stdout:6/991: write d7/d9/d2b/f53 [4314871,9896] 0 2024-03-19T06:06:23.605 INFO:tasks.workunit.client.0.smithi072.stdout:9/975: chown d11/d24/d4c/dda/d36/d45/f135 2 1 2024-03-19T06:06:23.605 INFO:tasks.workunit.client.0.smithi072.stdout:7/901: dwrite d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/fb6 [0,4194304] 0 2024-03-19T06:06:23.607 INFO:tasks.workunit.client.0.smithi072.stdout:9/976: dread - d11/d24/d4c/d6e/f147 zero size 2024-03-19T06:06:23.619 INFO:tasks.workunit.client.0.smithi072.stdout:6/992: write d7/d9/d1b/f37 [84551,121769] 0 2024-03-19T06:06:23.628 INFO:tasks.workunit.client.0.smithi072.stdout:9/977: dwrite d11/d24/d4c/dda/d68/f73 [0,4194304] 0 2024-03-19T06:06:23.634 INFO:tasks.workunit.client.0.smithi072.stdout:7/902: dwrite d2/d3/d18/d20/d3a/f58 [4194304,4194304] 0 2024-03-19T06:06:23.635 INFO:tasks.workunit.client.0.smithi072.stdout:9/978: chown d11/d24/d4c/dda/d36/c120 1 1 2024-03-19T06:06:23.636 INFO:tasks.workunit.client.0.smithi072.stdout:6/993: dread d7/d99/d60/f81 [0,4194304] 0 2024-03-19T06:06:23.642 INFO:tasks.workunit.client.0.smithi072.stdout:7/903: write d2/d8c/dba/dbc/fb4 [295273,102871] 0 2024-03-19T06:06:23.642 INFO:tasks.workunit.client.0.smithi072.stdout:6/994: chown d7/d99/d60/ded/df4/d41/d92/f115 464 1 2024-03-19T06:06:23.649 INFO:tasks.workunit.client.0.smithi072.stdout:6/995: write d7/d9/d1b/d31/f14b [17821,76624] 0 2024-03-19T06:06:23.653 INFO:tasks.workunit.client.0.smithi072.stdout:6/996: read d7/f15 [688710,6279] 0 2024-03-19T06:06:23.659 INFO:tasks.workunit.client.0.smithi072.stdout:7/904: dread d2/d3/d17/dc8/d1d/d2b/d3d/f39 [4194304,4194304] 0 2024-03-19T06:06:23.669 INFO:tasks.workunit.client.0.smithi072.stdout:6/997: write d7/d9/d1b/fa1 [4700530,58052] 0 2024-03-19T06:06:23.674 INFO:tasks.workunit.client.0.smithi072.stdout:6/998: mknod d7/d9/d1b/d12f/c14d 0 2024-03-19T06:06:23.676 INFO:tasks.workunit.client.0.smithi072.stdout:6/999: write d7/d9/d2b/f142 [587224,26108] 0 2024-03-19T06:06:23.676 INFO:tasks.workunit.client.0.smithi072.stdout:7/905: dwrite d2/f93 [0,4194304] 0 2024-03-19T06:06:23.689 INFO:tasks.workunit.client.0.smithi072.stdout:7/906: rename d2/d3/d18/d7f/d85/df0/d11a to d2/d3/d18/d121 0 2024-03-19T06:06:23.695 INFO:tasks.workunit.client.0.smithi072.stdout:7/907: mknod d2/d3/d17/dc8/d1d/d3b/d9a/d9b/c122 0 2024-03-19T06:06:23.708 INFO:tasks.workunit.client.0.smithi072.stdout:7/908: dwrite d2/d3/d17/faf [0,4194304] 0 2024-03-19T06:06:23.711 INFO:tasks.workunit.client.0.smithi072.stdout:7/909: chown d2/d3/d17/dc8/d1d/lbf 55 1 2024-03-19T06:06:23.713 INFO:tasks.workunit.client.0.smithi072.stdout:7/910: chown d2/d8c/da9/cc0 42936 1 2024-03-19T06:06:23.722 INFO:tasks.workunit.client.0.smithi072.stdout:7/911: creat d2/d8c/dba/f123 x:0 0 0 2024-03-19T06:06:23.725 INFO:tasks.workunit.client.0.smithi072.stdout:7/912: read d2/d3/d18/d7f/fb2 [959521,81227] 0 2024-03-19T06:06:23.728 INFO:tasks.workunit.client.0.smithi072.stdout:7/913: rmdir d2/d8c 39 2024-03-19T06:06:23.737 INFO:tasks.workunit.client.0.smithi072.stdout:7/914: mkdir d2/d3/d17/d124 0 2024-03-19T06:06:23.739 INFO:tasks.workunit.client.0.smithi072.stdout:7/915: fsync d2/d3/d17/dc8/d1d/d3b/d9a/d9b/fdb 0 2024-03-19T06:06:23.744 INFO:tasks.workunit.client.0.smithi072.stdout:7/916: mknod d2/d3/d17/dc8/d1d/d3b/d9a/d9b/dd6/ddd/c125 0 2024-03-19T06:06:23.747 INFO:tasks.workunit.client.0.smithi072.stdout:7/917: stat d2/d3/d17/dc8/d1d/d3b/d63/d84/c9f 0 2024-03-19T06:06:23.775 INFO:tasks.workunit.client.0.smithi072.stdout:7/918: dwrite d2/d3/d17/dc8/d1d/d2b/d3d/f6a [4194304,4194304] 0 2024-03-19T06:06:23.780 INFO:tasks.workunit.client.0.smithi072.stdout:7/919: chown d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/cf5 12720 1 2024-03-19T06:06:23.790 INFO:tasks.workunit.client.0.smithi072.stdout:7/920: rename d2/d3/d17/dc8/d1d/d2b/d75/cfe to d2/d3/d18/d7f/db3/d11e/c126 0 2024-03-19T06:06:23.805 INFO:tasks.workunit.client.0.smithi072.stdout:7/921: truncate d2/d3/d17/dc8/d53/dca/feb 834278 0 2024-03-19T06:06:23.824 INFO:tasks.workunit.client.0.smithi072.stdout:7/922: dwrite d2/d3/d17/f77 [0,4194304] 0 2024-03-19T06:06:23.829 INFO:tasks.workunit.client.0.smithi072.stdout:7/923: mknod d2/d3/d17/dc8/d1d/d2b/d82/dc5/d120/c127 0 2024-03-19T06:06:23.831 INFO:tasks.workunit.client.0.smithi072.stdout:7/924: chown d2/d8c/dba/f123 27 1 2024-03-19T06:06:23.834 INFO:tasks.workunit.client.0.smithi072.stdout:7/925: write d2/d3/d18/d7f/db3/fe2 [3124753,9429] 0 2024-03-19T06:06:23.840 INFO:tasks.workunit.client.0.smithi072.stdout:7/926: creat d2/d3/d17/d124/f128 x:0 0 0 2024-03-19T06:06:23.842 INFO:tasks.workunit.client.0.smithi072.stdout:9/979: sync 2024-03-19T06:06:23.847 INFO:tasks.workunit.client.0.smithi072.stdout:7/927: creat d2/d3/d17/dc8/d1d/d110/df2/f129 x:0 0 0 2024-03-19T06:06:23.851 INFO:tasks.workunit.client.0.smithi072.stdout:7/928: mkdir d2/d3/d18/d12a 0 2024-03-19T06:06:23.873 INFO:tasks.workunit.client.0.smithi072.stdout:9/980: dread d11/d1f/f101 [0,4194304] 0 2024-03-19T06:06:24.013 INFO:tasks.workunit.client.0.smithi072.stdout:9/981: link d11/d1f/d43/c96 d11/d24/d4c/dda/d36/d45/dcb/d11b/d129/d113/d13a/c148 0 2024-03-19T06:06:24.021 INFO:tasks.workunit.client.0.smithi072.stdout:9/982: creat d11/d24/d4c/dda/d36/d45/d5b/f149 x:0 0 0 2024-03-19T06:06:24.034 INFO:tasks.workunit.client.0.smithi072.stdout:9/983: dread d11/d24/d4c/d64/f75 [0,4194304] 0 2024-03-19T06:06:24.044 INFO:tasks.workunit.client.0.smithi072.stdout:9/984: creat d11/d24/d4c/dda/d68/d128/f14a x:0 0 0 2024-03-19T06:06:24.100 INFO:tasks.workunit.client.0.smithi072.stdout:9/985: dwrite d11/d24/d4c/dda/d36/f3f [0,4194304] 0 2024-03-19T06:06:24.109 INFO:tasks.workunit.client.0.smithi072.stdout:9/986: fsync d11/fbf 0 2024-03-19T06:06:24.147 INFO:tasks.workunit.client.0.smithi072.stdout:9/987: dwrite d11/d24/d4c/dda/d36/d45/f135 [0,4194304] 0 2024-03-19T06:06:24.166 INFO:tasks.workunit.client.0.smithi072.stdout:7/929: sync 2024-03-19T06:06:24.170 INFO:tasks.workunit.client.0.smithi072.stdout:9/988: dread d11/d78/fae [0,4194304] 0 2024-03-19T06:06:24.174 INFO:tasks.workunit.client.0.smithi072.stdout:9/989: mknod d11/d24/d4c/dda/d36/d45/dcb/d11b/d129/c14b 0 2024-03-19T06:06:24.174 INFO:tasks.workunit.client.0.smithi072.stdout:7/930: truncate d2/d3/d17/dc8/d1d/f109 85641 0 2024-03-19T06:06:24.179 INFO:tasks.workunit.client.0.smithi072.stdout:7/931: rmdir d2/d3/d17/dc8/d53 39 2024-03-19T06:06:24.186 INFO:tasks.workunit.client.0.smithi072.stdout:7/932: mkdir d2/d3/d17/dc8/d1d/d2b/d75/ddf/d12b 0 2024-03-19T06:06:24.191 INFO:tasks.workunit.client.0.smithi072.stdout:9/990: dwrite d11/d24/d4c/dda/d36/f40 [0,4194304] 0 2024-03-19T06:06:24.192 INFO:tasks.workunit.client.0.smithi072.stdout:7/933: mkdir d2/d3/d17/d70/d12c 0 2024-03-19T06:06:24.194 INFO:tasks.workunit.client.0.smithi072.stdout:7/934: chown d2/d3/d17/dc8/d1d/d2b/le4 14635615 1 2024-03-19T06:06:24.207 INFO:tasks.workunit.client.0.smithi072.stdout:7/935: creat d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/f12d x:0 0 0 2024-03-19T06:06:24.216 INFO:tasks.workunit.client.0.smithi072.stdout:7/936: truncate d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/f7c 1038781 0 2024-03-19T06:06:24.221 INFO:tasks.workunit.client.0.smithi072.stdout:7/937: write d2/d3/d18/d7f/fb2 [1422508,123685] 0 2024-03-19T06:06:24.225 INFO:tasks.workunit.client.0.smithi072.stdout:7/938: dread - d2/d3/d17/dc8/d1d/d110/fd4 zero size 2024-03-19T06:06:24.233 INFO:tasks.workunit.client.0.smithi072.stdout:7/939: rename d2/d3/d18/d7f/db3/d11e to d2/d3/d17/dc8/d1d/d107/d12e 0 2024-03-19T06:06:24.245 INFO:tasks.workunit.client.0.smithi072.stdout:9/991: truncate d11/d24/d4c/dda/d36/d45/d4d/fc6 782691 0 2024-03-19T06:06:24.272 INFO:tasks.workunit.client.0.smithi072.stdout:7/940: dwrite d2/d3/d18/d3f/fd1 [0,4194304] 0 2024-03-19T06:06:24.305 INFO:tasks.workunit.client.0.smithi072.stdout:9/992: dwrite d11/d24/d4c/dda/d6f/dff/fa3 [4194304,4194304] 0 2024-03-19T06:06:24.311 INFO:tasks.workunit.client.0.smithi072.stdout:9/993: fsync d11/d24/d4c/dda/f127 0 2024-03-19T06:06:24.311 INFO:tasks.workunit.client.0.smithi072.stdout:7/941: dwrite d2/d3/d18/fb1 [0,4194304] 0 2024-03-19T06:06:24.324 INFO:tasks.workunit.client.0.smithi072.stdout:7/942: dread d2/d3/d17/dc8/d1d/d3b/d63/fcb [0,4194304] 0 2024-03-19T06:06:24.339 INFO:tasks.workunit.client.0.smithi072.stdout:7/943: unlink d2/d3/d17/dc8/d1d/d2b/d3d/f7 0 2024-03-19T06:06:24.354 INFO:tasks.workunit.client.0.smithi072.stdout:9/994: write d11/d24/d4c/dda/d36/d45/f4a [1834148,128497] 0 2024-03-19T06:06:24.363 INFO:tasks.workunit.client.0.smithi072.stdout:7/944: dwrite d2/d3/d18/d20/f115 [0,4194304] 0 2024-03-19T06:06:24.373 INFO:tasks.workunit.client.0.smithi072.stdout:9/995: dread d11/d24/d4c/dda/d68/d92/fee [0,4194304] 0 2024-03-19T06:06:24.377 INFO:tasks.workunit.client.0.smithi072.stdout:7/945: dread d2/d3/d17/dc8/d1d/d2b/d3d/f6a [4194304,4194304] 0 2024-03-19T06:06:24.378 INFO:tasks.workunit.client.0.smithi072.stdout:9/996: dread d11/d24/d4c/dda/d36/fd1 [0,4194304] 0 2024-03-19T06:06:24.391 INFO:tasks.workunit.client.0.smithi072.stdout:7/946: link d2/d3/d17/dc8/d1d/d2b/d3d/lf d2/d3/d17/d70/l12f 0 2024-03-19T06:06:24.398 INFO:tasks.workunit.client.0.smithi072.stdout:7/947: creat d2/d3/d17/dc8/d1d/d2b/d75/ddf/f130 x:0 0 0 2024-03-19T06:06:24.401 INFO:tasks.workunit.client.0.smithi072.stdout:9/997: dwrite d11/d24/d4c/d64/f10d [0,4194304] 0 2024-03-19T06:06:24.407 INFO:tasks.workunit.client.0.smithi072.stdout:7/948: link d2/l91 d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/l131 0 2024-03-19T06:06:24.411 INFO:tasks.workunit.client.0.smithi072.stdout:9/998: rename d11/d24/d4c/dda/ce4 to d11/d24/d4c/dda/d36/d45/dcb/d11b/d129/d9f/c14c 0 2024-03-19T06:06:24.425 INFO:tasks.workunit.client.0.smithi072.stdout:7/949: dread d2/d3/d18/d7f/db3/fe2 [0,4194304] 0 2024-03-19T06:06:24.431 INFO:tasks.workunit.client.0.smithi072.stdout:9/999: dwrite d11/d24/ddd/d5c/f8b [4194304,4194304] 0 2024-03-19T06:06:24.434 INFO:tasks.workunit.client.0.smithi072.stdout:7/950: creat d2/d3/d17/dc8/d1d/d3b/d63/f132 x:0 0 0 2024-03-19T06:06:24.721 INFO:tasks.workunit.client.0.smithi072.stdout:7/951: sync 2024-03-19T06:06:24.763 INFO:tasks.workunit.client.0.smithi072.stdout:7/952: dwrite d2/d3/d18/d7f/db3/fe2 [0,4194304] 0 2024-03-19T06:06:24.778 INFO:tasks.workunit.client.0.smithi072.stdout:7/953: getdents d2/d3/d18/d20/d3a 0 2024-03-19T06:06:24.787 INFO:tasks.workunit.client.0.smithi072.stdout:7/954: stat d2/l91 0 2024-03-19T06:06:24.799 INFO:tasks.workunit.client.0.smithi072.stdout:7/955: creat d2/d3/d17/dc8/d53/f133 x:0 0 0 2024-03-19T06:06:24.805 INFO:tasks.workunit.client.0.smithi072.stdout:7/956: write d2/d3/d18/d3f/fd1 [3265507,14] 0 2024-03-19T06:06:24.821 INFO:tasks.workunit.client.0.smithi072.stdout:7/957: rename d2/d3/d17/dc8/d1d/d3b/d63/fac to d2/d3/d17/dc8/d1d/d107/d12e/f134 0 2024-03-19T06:06:24.832 INFO:tasks.workunit.client.0.smithi072.stdout:7/958: truncate d2/d3/d17/dc8/d1d/d2b/fd3 4201943 0 2024-03-19T06:06:24.857 INFO:tasks.workunit.client.0.smithi072.stdout:7/959: dread d2/d3/d17/dc8/d1d/d2b/f45 [0,4194304] 0 2024-03-19T06:06:24.870 INFO:tasks.workunit.client.0.smithi072.stdout:7/960: mknod d2/d3/d17/dc8/d1d/d2b/d82/c135 0 2024-03-19T06:06:24.879 INFO:tasks.workunit.client.0.smithi072.stdout:7/961: rename d2/d3/d17/f69 to d2/d3/d17/dc8/d1d/d2b/d82/f136 0 2024-03-19T06:06:24.893 INFO:tasks.workunit.client.0.smithi072.stdout:7/962: truncate d2/d3/d17/dc8/d1d/d2b/f45 972536 0 2024-03-19T06:06:25.165 INFO:tasks.workunit.client.0.smithi072.stdout:7/963: sync 2024-03-19T06:06:25.175 INFO:tasks.workunit.client.0.smithi072.stdout:7/964: rename d2/d8c/dba/dbc/l80 to d2/d3/d18/d7f/d85/l137 0 2024-03-19T06:06:25.179 INFO:tasks.workunit.client.0.smithi072.stdout:7/965: readlink d2/d3/d17/dc8/ld9 0 2024-03-19T06:06:25.224 INFO:tasks.workunit.client.0.smithi072.stdout:7/966: dwrite d2/d3/d17/dc8/d1d/d2b/d3d/f6a [0,4194304] 0 2024-03-19T06:06:25.238 INFO:tasks.workunit.client.0.smithi072.stdout:7/967: link d2/d3/d18/d20/d3a/ff8 d2/d3/d17/dc8/d53/f138 0 2024-03-19T06:06:25.244 INFO:tasks.workunit.client.0.smithi072.stdout:7/968: stat d2/d3/d17/dc8/d1d/d2b/d82/c10f 0 2024-03-19T06:06:25.255 INFO:tasks.workunit.client.0.smithi072.stdout:7/969: link d2/d3/d18/d20/c87 d2/d3/d18/d2f/c139 0 2024-03-19T06:06:25.264 INFO:tasks.workunit.client.0.smithi072.stdout:7/970: creat d2/d3/d18/d7f/d85/df0/f13a x:0 0 0 2024-03-19T06:06:25.298 INFO:tasks.workunit.client.0.smithi072.stdout:7/971: dwrite d2/d3/d17/d70/fcd [0,4194304] 0 2024-03-19T06:06:25.301 INFO:tasks.workunit.client.0.smithi072.stdout:7/972: chown d2/d3/d18/d20/f117 0 1 2024-03-19T06:06:25.320 INFO:tasks.workunit.client.0.smithi072.stdout:7/973: dwrite d2/d8c/dba/dbc/fb4 [0,4194304] 0 2024-03-19T06:06:25.321 INFO:tasks.workunit.client.0.smithi072.stdout:7/974: chown d2/d3/d17/dc8 573535 1 2024-03-19T06:06:25.328 INFO:tasks.workunit.client.0.smithi072.stdout:7/975: symlink d2/d3/d17/dc8/d1d/d3b/d63/d84/l13b 0 2024-03-19T06:06:25.332 INFO:tasks.workunit.client.0.smithi072.stdout:7/976: write d2/d8c/dba/f123 [683969,54759] 0 2024-03-19T06:06:25.353 INFO:tasks.workunit.client.0.smithi072.stdout:7/977: dwrite d2/d3/d18/d20/d3a/ff8 [0,4194304] 0 2024-03-19T06:06:25.522 INFO:tasks.workunit.client.0.smithi072.stdout:7/978: sync 2024-03-19T06:06:25.528 INFO:tasks.workunit.client.0.smithi072.stdout:7/979: symlink d2/d3/d17/dc8/d1d/d3b/d9a/d9b/l13c 0 2024-03-19T06:06:25.532 INFO:tasks.workunit.client.0.smithi072.stdout:7/980: mknod d2/d3/d18/d7f/dda/c13d 0 2024-03-19T06:06:25.538 INFO:tasks.workunit.client.0.smithi072.stdout:7/981: unlink d2/d3/d17/l105 0 2024-03-19T06:06:25.541 INFO:tasks.workunit.client.0.smithi072.stdout:7/982: fdatasync d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/fb6 0 2024-03-19T06:06:25.543 INFO:tasks.workunit.client.0.smithi072.stdout:7/983: chown d2/d3/d17/dc8/d1d/d2b/d3d/l1e 189 1 2024-03-19T06:06:25.550 INFO:tasks.workunit.client.0.smithi072.stdout:7/984: getdents d2/d3/d17/dc8/d1d/d3b/d9a/ded 0 2024-03-19T06:06:25.558 INFO:tasks.workunit.client.0.smithi072.stdout:7/985: rename d2/d3/d17/dc8/d1d/d2b/d3d/d21/d31/d86/f11c to d2/d3/d18/f13e 0 2024-03-19T06:06:25.561 INFO:tasks.workunit.client.0.smithi072.stdout:7/986: mknod d2/d3/d18/d12a/c13f 0 2024-03-19T06:06:25.565 INFO:tasks.workunit.client.0.smithi072.stdout:7/987: mkdir d2/d3/d17/dc8/d1d/d110/df2/d140 0 2024-03-19T06:06:25.573 INFO:tasks.workunit.client.0.smithi072.stdout:7/988: write d2/d3/fe5 [961976,86586] 0 2024-03-19T06:06:25.577 INFO:tasks.workunit.client.0.smithi072.stdout:7/989: write d2/d3/d17/dc8/d1d/d2b/d75/ddf/f130 [513200,41120] 0 2024-03-19T06:06:25.581 INFO:tasks.workunit.client.0.smithi072.stdout:7/990: truncate d2/d8c/dba/dbc/fd2 1262157 0 2024-03-19T06:06:25.584 INFO:tasks.workunit.client.0.smithi072.stdout:7/991: write d2/d3/d17/dc8/d1d/d2b/d3d/d21/d74/fb6 [4701646,101466] 0 2024-03-19T06:06:25.589 INFO:tasks.workunit.client.0.smithi072.stdout:7/992: fdatasync d2/d3/d18/d20/f71 0 2024-03-19T06:06:25.594 INFO:tasks.workunit.client.0.smithi072.stdout:7/993: mknod d2/d3/d17/dc8/d1d/d3b/d9a/d9b/c141 0 2024-03-19T06:06:25.606 INFO:tasks.workunit.client.0.smithi072.stdout:7/994: dread d2/d3/d18/d20/d3a/f58 [4194304,4194304] 0 2024-03-19T06:06:25.608 INFO:tasks.workunit.client.0.smithi072.stdout:7/995: chown d2/d3/d17/dc8/d1d/d2b/d82/f136 133137664 1 2024-03-19T06:06:25.612 INFO:tasks.workunit.client.0.smithi072.stdout:7/996: mkdir d2/d3/d18/d7f/d85/d142 0 2024-03-19T06:06:25.615 INFO:tasks.workunit.client.0.smithi072.stdout:7/997: write d2/d3/d18/f13e [756098,127380] 0 2024-03-19T06:06:25.622 INFO:tasks.workunit.client.0.smithi072.stdout:7/998: symlink d2/d3/d17/dc8/d53/dca/d10d/l143 0 2024-03-19T06:06:25.627 INFO:tasks.workunit.client.0.smithi072.stdout:7/999: creat d2/d3/d17/dc8/d1d/d110/df2/f144 x:0 0 0 2024-03-19T06:06:25.636 INFO:tasks.workunit.client.0.smithi072.stderr:+ rm -rf -- ./tmp.UJvKau8PLh 2024-03-19T06:06:25.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:25 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:25.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:25 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:25.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:25 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T06:06:25.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:25 smithi172 ceph-mon[35716]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T06:06:25.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:25 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:06:25.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:25 smithi172 ceph-mon[35716]: pgmap v39: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 35 MiB/s rd, 92 MiB/s wr, 276 op/s 2024-03-19T06:06:25.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:25 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:25.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:25 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:25.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:25 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T06:06:25.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:25 smithi072 ceph-mon[28706]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T06:06:25.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:25 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:06:25.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:25 smithi072 ceph-mon[28706]: pgmap v39: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 35 MiB/s rd, 92 MiB/s wr, 276 op/s 2024-03-19T06:06:27.558 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:27 smithi172 ceph-mon[35716]: pgmap v40: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 19 MiB/s rd, 50 MiB/s wr, 163 op/s 2024-03-19T06:06:27.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:27 smithi072 ceph-mon[28706]: pgmap v40: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 19 MiB/s rd, 50 MiB/s wr, 163 op/s 2024-03-19T06:06:28.248 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:28 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:06:28.248 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:28 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.qkcahs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T06:06:28.248 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:28 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T06:06:28.248 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:28 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:06:28.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:28 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:06:28.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:28 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.qkcahs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T06:06:28.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:28 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T06:06:28.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:28 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:06:29.362 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:29 smithi172 ceph-mon[35716]: Upgrade: Updating mgr.smithi172.qkcahs 2024-03-19T06:06:29.363 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:29 smithi172 ceph-mon[35716]: Deploying daemon mgr.smithi172.qkcahs on smithi172 2024-03-19T06:06:29.363 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:29 smithi172 ceph-mon[35716]: pgmap v41: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 19 MiB/s rd, 50 MiB/s wr, 163 op/s 2024-03-19T06:06:29.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:29 smithi072 ceph-mon[28706]: Upgrade: Updating mgr.smithi172.qkcahs 2024-03-19T06:06:29.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:29 smithi072 ceph-mon[28706]: Deploying daemon mgr.smithi172.qkcahs on smithi172 2024-03-19T06:06:29.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:29 smithi072 ceph-mon[28706]: pgmap v41: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 19 MiB/s rd, 50 MiB/s wr, 163 op/s 2024-03-19T06:06:31.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:31 smithi072 ceph-mon[28706]: pgmap v42: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 53 MiB/s wr, 187 op/s 2024-03-19T06:06:31.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:31 smithi172 ceph-mon[35716]: pgmap v42: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 53 MiB/s wr, 187 op/s 2024-03-19T06:06:33.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:33 smithi172 ceph-mon[35716]: pgmap v43: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 3.1 MiB/s rd, 18 MiB/s wr, 78 op/s 2024-03-19T06:06:33.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:33 smithi072 ceph-mon[28706]: pgmap v43: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 3.1 MiB/s rd, 18 MiB/s wr, 78 op/s 2024-03-19T06:06:35.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:35 smithi072 ceph-mon[28706]: pgmap v44: 65 pgs: 65 active+clean; 1.8 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 3.1 MiB/s rd, 19 MiB/s wr, 120 op/s 2024-03-19T06:06:35.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:35 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:35.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:35 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:35.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:35 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:06:35.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:35 smithi172 ceph-mon[35716]: pgmap v44: 65 pgs: 65 active+clean; 1.8 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 3.1 MiB/s rd, 19 MiB/s wr, 120 op/s 2024-03-19T06:06:35.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:35 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:35.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:35 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:35.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:35 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:06:37.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:37 smithi072 ceph-mon[28706]: pgmap v45: 65 pgs: 65 active+clean; 1.8 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 690 KiB/s rd, 7.9 MiB/s wr, 80 op/s 2024-03-19T06:06:37.589 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:37 smithi172 ceph-mon[35716]: pgmap v45: 65 pgs: 65 active+clean; 1.8 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 690 KiB/s rd, 7.9 MiB/s wr, 80 op/s 2024-03-19T06:06:39.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:39 smithi172 ceph-mon[35716]: pgmap v46: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 692 KiB/s rd, 7.9 MiB/s wr, 85 op/s 2024-03-19T06:06:39.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:39 smithi072 ceph-mon[28706]: pgmap v46: 65 pgs: 65 active+clean; 1.8 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 692 KiB/s rd, 7.9 MiB/s wr, 85 op/s 2024-03-19T06:06:41.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:41 smithi172 ceph-mon[35716]: pgmap v47: 65 pgs: 65 active+clean; 1.4 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 700 KiB/s rd, 8.4 MiB/s wr, 125 op/s 2024-03-19T06:06:41.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:41 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:41.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:41 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:42.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:41 smithi072 ceph-mon[28706]: pgmap v47: 65 pgs: 65 active+clean; 1.4 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 700 KiB/s rd, 8.4 MiB/s wr, 125 op/s 2024-03-19T06:06:42.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:41 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:42.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:41 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:43.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:43 smithi172 ceph-mon[35716]: pgmap v48: 65 pgs: 65 active+clean; 1.4 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 20 KiB/s rd, 1.0 MiB/s wr, 87 op/s 2024-03-19T06:06:43.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:43 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:06:43.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:43 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:43.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:43 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:43.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:43 smithi072 ceph-mon[28706]: pgmap v48: 65 pgs: 65 active+clean; 1.4 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 20 KiB/s rd, 1.0 MiB/s wr, 87 op/s 2024-03-19T06:06:43.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:43 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:06:43.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:43 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:43.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:43 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:44.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:44 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:44.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:44 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:44.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:44 smithi172 ceph-mon[35716]: pgmap v49: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 133 op/s 2024-03-19T06:06:45.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:44 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:45.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:44 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:45.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:44 smithi072 ceph-mon[28706]: pgmap v49: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 133 op/s 2024-03-19T06:06:46.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:45 smithi072 ceph-mon[28706]: mgrmap e31: smithi072.jydpjk(active, since 92s), standbys: smithi172.qkcahs 2024-03-19T06:06:46.138 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:45 smithi172 ceph-mon[35716]: mgrmap e31: smithi072.jydpjk(active, since 92s), standbys: smithi172.qkcahs 2024-03-19T06:06:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.252+0000 7f87fee00700 1 -- 172.21.15.72:0/310745165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f8100240 msgr2=0x7f87f8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.252+0000 7f87fee00700 1 --2- 172.21.15.72:0/310745165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f8100240 0x7f87f8100650 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f87f000b0a0 tx=0x7f87f000b3b0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.252+0000 7f87fee00700 1 -- 172.21.15.72:0/310745165 shutdown_connections 2024-03-19T06:06:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.252+0000 7f87fee00700 1 --2- 172.21.15.72:0/310745165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f8101440 0x7f87f8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.252+0000 7f87fee00700 1 --2- 172.21.15.72:0/310745165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f8100240 0x7f87f8100650 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.252+0000 7f87fee00700 1 -- 172.21.15.72:0/310745165 >> 172.21.15.72:0/310745165 conn(0x7f87f80fb7f0 msgr2=0x7f87f80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.252+0000 7f87fee00700 1 -- 172.21.15.72:0/310745165 shutdown_connections 2024-03-19T06:06:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.253+0000 7f87fee00700 1 -- 172.21.15.72:0/310745165 wait complete. 2024-03-19T06:06:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.254+0000 7f87fee00700 1 Processor -- start 2024-03-19T06:06:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.254+0000 7f87fee00700 1 -- start start 2024-03-19T06:06:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.254+0000 7f87fee00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f8100240 0x7f87f8195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.254+0000 7f87fee00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f8101440 0x7f87f8195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.254+0000 7f87fee00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f8196610 con 0x7f87f8101440 2024-03-19T06:06:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.254+0000 7f87fee00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f8196750 con 0x7f87f8100240 2024-03-19T06:06:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.255+0000 7f87f7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f8101440 0x7f87f8195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.255+0000 7f87f7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f8101440 0x7f87f8195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54698/0 (socket says 172.21.15.72:54698) 2024-03-19T06:06:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.255+0000 7f87f7400700 1 -- 172.21.15.72:0/400063170 learned_addr learned my addr 172.21.15.72:0/400063170 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.255+0000 7f87f7e00700 1 --2- 172.21.15.72:0/400063170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f8100240 0x7f87f8195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.255+0000 7f87f7400700 1 -- 172.21.15.72:0/400063170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f8100240 msgr2=0x7f87f8195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.255+0000 7f87f7400700 1 --2- 172.21.15.72:0/400063170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f8100240 0x7f87f8195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.255+0000 7f87f7400700 1 -- 172.21.15.72:0/400063170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f0009d00 con 0x7f87f8101440 2024-03-19T06:06:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.255+0000 7f87f7e00700 1 --2- 172.21.15.72:0/400063170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f8100240 0x7f87f8195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:06:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.256+0000 7f87f7400700 1 --2- 172.21.15.72:0/400063170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f8101440 0x7f87f8195ff0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f87e800e920 tx=0x7f87e800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.256+0000 7f87f4c00700 1 -- 172.21.15.72:0/400063170 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87e800c9d0 con 0x7f87f8101440 2024-03-19T06:06:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.256+0000 7f87f4c00700 1 -- 172.21.15.72:0/400063170 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f87e8010430 con 0x7f87f8101440 2024-03-19T06:06:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.256+0000 7f87f4c00700 1 -- 172.21.15.72:0/400063170 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87e8018650 con 0x7f87f8101440 2024-03-19T06:06:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.256+0000 7f87fee00700 1 -- 172.21.15.72:0/400063170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f819b200 con 0x7f87f8101440 2024-03-19T06:06:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.256+0000 7f87fee00700 1 -- 172.21.15.72:0/400063170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f819b750 con 0x7f87f8101440 2024-03-19T06:06:46.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.258+0000 7f87fee00700 1 -- 172.21.15.72:0/400063170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f8108d90 con 0x7f87f8101440 2024-03-19T06:06:46.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.260+0000 7f87f4c00700 1 -- 172.21.15.72:0/400063170 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 31) v1 ==== 91694+0+0 (secure 0 0 0) 0x7f87e80105a0 con 0x7f87f8101440 2024-03-19T06:06:46.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.261+0000 7f87f4c00700 1 --2- 172.21.15.72:0/400063170 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f87dc06dc20 0x7f87dc0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:46.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.261+0000 7f87f4c00700 1 -- 172.21.15.72:0/400063170 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f87e8014070 con 0x7f87f8101440 2024-03-19T06:06:46.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.262+0000 7f87f7e00700 1 --2- 172.21.15.72:0/400063170 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f87dc06dc20 0x7f87dc0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:46.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.262+0000 7f87f7e00700 1 --2- 172.21.15.72:0/400063170 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f87dc06dc20 0x7f87dc0700d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f87f000b780 tx=0x7f87f00060c0 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:46.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.268+0000 7f87f4c00700 1 -- 172.21.15.72:0/400063170 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f87e8052f10 con 0x7f87f8101440 2024-03-19T06:06:46.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.581+0000 7f87fee00700 1 -- 172.21.15.72:0/400063170 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f87f819be50 con 0x7f87dc06dc20 2024-03-19T06:06:46.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.583+0000 7f87f4c00700 1 -- 172.21.15.72:0/400063170 <== mgr.14702 v2:172.21.15.72:6800/2640845307 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f87f819be50 con 0x7f87dc06dc20 2024-03-19T06:06:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.586+0000 7f87fee00700 1 -- 172.21.15.72:0/400063170 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f87dc06dc20 msgr2=0x7f87dc0700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.586+0000 7f87fee00700 1 --2- 172.21.15.72:0/400063170 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f87dc06dc20 0x7f87dc0700d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f87f000b780 tx=0x7f87f00060c0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.586+0000 7f87fee00700 1 -- 172.21.15.72:0/400063170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f8101440 msgr2=0x7f87f8195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.586+0000 7f87fee00700 1 --2- 172.21.15.72:0/400063170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f8101440 0x7f87f8195ff0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f87e800e920 tx=0x7f87e800ec30 comp rx=0 tx=0).stop 2024-03-19T06:06:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.586+0000 7f87fee00700 1 -- 172.21.15.72:0/400063170 shutdown_connections 2024-03-19T06:06:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.586+0000 7f87fee00700 1 --2- 172.21.15.72:0/400063170 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f87dc06dc20 0x7f87dc0700d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.586+0000 7f87fee00700 1 --2- 172.21.15.72:0/400063170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f8100240 0x7f87f8195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.586+0000 7f87fee00700 1 --2- 172.21.15.72:0/400063170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f8101440 0x7f87f8195ff0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.586+0000 7f87fee00700 1 -- 172.21.15.72:0/400063170 >> 172.21.15.72:0/400063170 conn(0x7f87f80fb7f0 msgr2=0x7f87f8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.586+0000 7f87fee00700 1 -- 172.21.15.72:0/400063170 shutdown_connections 2024-03-19T06:06:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.586+0000 7f87fee00700 1 -- 172.21.15.72:0/400063170 wait complete. 2024-03-19T06:06:46.596 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:06:46.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.769+0000 7f6cdb800700 1 -- 172.21.15.72:0/904476411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cd40737b0 msgr2=0x7f6cd4073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:46.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.769+0000 7f6cdb800700 1 --2- 172.21.15.72:0/904476411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cd40737b0 0x7f6cd4073c20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009940 tx=0x7f6cc0009c50 comp rx=0 tx=0).stop 2024-03-19T06:06:46.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.769+0000 7f6cdb800700 1 -- 172.21.15.72:0/904476411 shutdown_connections 2024-03-19T06:06:46.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.769+0000 7f6cdb800700 1 --2- 172.21.15.72:0/904476411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cd40737b0 0x7f6cd4073c20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.769+0000 7f6cdb800700 1 --2- 172.21.15.72:0/904476411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cd4074d80 0x7f6cd40731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.769+0000 7f6cdb800700 1 -- 172.21.15.72:0/904476411 >> 172.21.15.72:0/904476411 conn(0x7f6cd40fb7f0 msgr2=0x7f6cd40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:46.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.770+0000 7f6cdb800700 1 -- 172.21.15.72:0/904476411 shutdown_connections 2024-03-19T06:06:46.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.770+0000 7f6cdb800700 1 -- 172.21.15.72:0/904476411 wait complete. 2024-03-19T06:06:46.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.771+0000 7f6cdb800700 1 Processor -- start 2024-03-19T06:06:46.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.771+0000 7f6cdb800700 1 -- start start 2024-03-19T06:06:46.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.771+0000 7f6cdb800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cd40737b0 0x7f6cd4197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:46.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.771+0000 7f6cdb800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cd4074d80 0x7f6cd41981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:46.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.771+0000 7f6cdb800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd41987e0 con 0x7f6cd40737b0 2024-03-19T06:06:46.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.771+0000 7f6cdb800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd4198950 con 0x7f6cd4074d80 2024-03-19T06:06:46.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.772+0000 7f6cd8e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cd40737b0 0x7f6cd4197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:46.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.772+0000 7f6cd3e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cd4074d80 0x7f6cd41981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:46.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.772+0000 7f6cd3e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cd4074d80 0x7f6cd41981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:54448/0 (socket says 172.21.15.72:54448) 2024-03-19T06:06:46.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.772+0000 7f6cd8e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cd40737b0 0x7f6cd4197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54718/0 (socket says 172.21.15.72:54718) 2024-03-19T06:06:46.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.772+0000 7f6cd3e00700 1 -- 172.21.15.72:0/3473302396 learned_addr learned my addr 172.21.15.72:0/3473302396 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:46.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.773+0000 7f6cd3e00700 1 -- 172.21.15.72:0/3473302396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cd40737b0 msgr2=0x7f6cd4197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:46.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.773+0000 7f6cd3e00700 1 --2- 172.21.15.72:0/3473302396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cd40737b0 0x7f6cd4197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.773+0000 7f6cd3e00700 1 -- 172.21.15.72:0/3473302396 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc00095f0 con 0x7f6cd4074d80 2024-03-19T06:06:46.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.773+0000 7f6cd8e00700 1 --2- 172.21.15.72:0/3473302396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cd40737b0 0x7f6cd4197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:06:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.773+0000 7f6cd3e00700 1 --2- 172.21.15.72:0/3473302396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cd4074d80 0x7f6cd41981e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00055f0 tx=0x7f6cc0005620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.774+0000 7f6cd1600700 1 -- 172.21.15.72:0/3473302396 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cc001d070 con 0x7f6cd4074d80 2024-03-19T06:06:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.774+0000 7f6cd1600700 1 -- 172.21.15.72:0/3473302396 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6cc000f460 con 0x7f6cd4074d80 2024-03-19T06:06:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.774+0000 7f6cdb800700 1 -- 172.21.15.72:0/3473302396 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd419d380 con 0x7f6cd4074d80 2024-03-19T06:06:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.774+0000 7f6cd1600700 1 -- 172.21.15.72:0/3473302396 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cc0021640 con 0x7f6cd4074d80 2024-03-19T06:06:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.774+0000 7f6cdb800700 1 -- 172.21.15.72:0/3473302396 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd419d870 con 0x7f6cd4074d80 2024-03-19T06:06:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.775+0000 7f6cdb800700 1 -- 172.21.15.72:0/3473302396 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd410af80 con 0x7f6cd4074d80 2024-03-19T06:06:46.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.777+0000 7f6cd1600700 1 -- 172.21.15.72:0/3473302396 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 31) v1 ==== 91694+0+0 (secure 0 0 0) 0x7f6cc000fab0 con 0x7f6cd4074d80 2024-03-19T06:06:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.778+0000 7f6cd1600700 1 --2- 172.21.15.72:0/3473302396 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f6cbc06dc20 0x7f6cbc0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.778+0000 7f6cd1600700 1 -- 172.21.15.72:0/3473302396 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f6cc008ed90 con 0x7f6cd4074d80 2024-03-19T06:06:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.779+0000 7f6cd8e00700 1 --2- 172.21.15.72:0/3473302396 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f6cbc06dc20 0x7f6cbc0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.779+0000 7f6cd8e00700 1 --2- 172.21.15.72:0/3473302396 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f6cbc06dc20 0x7f6cbc0700d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4198b80 tx=0x7f6cc800b410 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:46.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.788+0000 7f6cd1600700 1 -- 172.21.15.72:0/3473302396 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f6cc0058830 con 0x7f6cd4074d80 2024-03-19T06:06:46.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:46.812+0000 7f6cd1600700 1 -- 172.21.15.72:0/3473302396 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mgrmap(e 32) v1 ==== 91694+0+0 (secure 0 0 0) 0x7f6cc0058c00 con 0x7f6cd4074d80 2024-03-19T06:06:46.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:46 smithi072 ceph-mon[28706]: Standby manager daemon smithi172.qkcahs restarted 2024-03-19T06:06:46.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:46 smithi072 ceph-mon[28706]: Standby manager daemon smithi172.qkcahs started 2024-03-19T06:06:46.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:46 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/1482576963' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/crt"}]: dispatch 2024-03-19T06:06:46.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:46 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/1482576963' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T06:06:46.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:46 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/1482576963' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/key"}]: dispatch 2024-03-19T06:06:46.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:46 smithi072 ceph-mon[28706]: from='mgr.? 172.21.15.172:0/1482576963' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T06:06:46.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:46 smithi072 ceph-mon[28706]: pgmap v50: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 90 op/s 2024-03-19T06:06:46.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:46 smithi072 ceph-mon[28706]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:47.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:46 smithi172 ceph-mon[35716]: Standby manager daemon smithi172.qkcahs restarted 2024-03-19T06:06:47.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:46 smithi172 ceph-mon[35716]: Standby manager daemon smithi172.qkcahs started 2024-03-19T06:06:47.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:46 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/1482576963' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/crt"}]: dispatch 2024-03-19T06:06:47.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:46 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/1482576963' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T06:06:47.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:46 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/1482576963' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/key"}]: dispatch 2024-03-19T06:06:47.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:46 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/1482576963' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T06:06:47.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:46 smithi172 ceph-mon[35716]: pgmap v50: 65 pgs: 65 active+clean; 1.0 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 90 op/s 2024-03-19T06:06:47.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:46 smithi172 ceph-mon[35716]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:47.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.174+0000 7f6cdb800700 1 -- 172.21.15.72:0/3473302396 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cd4107740 con 0x7f6cbc06dc20 2024-03-19T06:06:47.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.176+0000 7f6cd1600700 1 -- 172.21.15.72:0/3473302396 <== mgr.14702 v2:172.21.15.72:6800/2640845307 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f6cd4107740 con 0x7f6cbc06dc20 2024-03-19T06:06:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.179+0000 7f6cdb800700 1 -- 172.21.15.72:0/3473302396 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f6cbc06dc20 msgr2=0x7f6cbc0700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.179+0000 7f6cdb800700 1 --2- 172.21.15.72:0/3473302396 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f6cbc06dc20 0x7f6cbc0700d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4198b80 tx=0x7f6cc800b410 comp rx=0 tx=0).stop 2024-03-19T06:06:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.179+0000 7f6cdb800700 1 -- 172.21.15.72:0/3473302396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cd4074d80 msgr2=0x7f6cd41981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.179+0000 7f6cdb800700 1 --2- 172.21.15.72:0/3473302396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cd4074d80 0x7f6cd41981e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00055f0 tx=0x7f6cc0005620 comp rx=0 tx=0).stop 2024-03-19T06:06:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.179+0000 7f6cdb800700 1 -- 172.21.15.72:0/3473302396 shutdown_connections 2024-03-19T06:06:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.179+0000 7f6cdb800700 1 --2- 172.21.15.72:0/3473302396 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f6cbc06dc20 0x7f6cbc0700d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.179+0000 7f6cdb800700 1 --2- 172.21.15.72:0/3473302396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cd40737b0 0x7f6cd4197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.179+0000 7f6cdb800700 1 --2- 172.21.15.72:0/3473302396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cd4074d80 0x7f6cd41981e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.179+0000 7f6cdb800700 1 -- 172.21.15.72:0/3473302396 >> 172.21.15.72:0/3473302396 conn(0x7f6cd40fb7f0 msgr2=0x7f6cd4106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.179+0000 7f6cdb800700 1 -- 172.21.15.72:0/3473302396 shutdown_connections 2024-03-19T06:06:47.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.179+0000 7f6cdb800700 1 -- 172.21.15.72:0/3473302396 wait complete. 2024-03-19T06:06:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.362+0000 7fb540e00700 1 -- 172.21.15.72:0/3567330528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c074d80 msgr2=0x7fb53c0731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.362+0000 7fb540e00700 1 --2- 172.21.15.72:0/3567330528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c074d80 0x7fb53c0731e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009910 tx=0x7fb52c009c20 comp rx=0 tx=0).stop 2024-03-19T06:06:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.363+0000 7fb540e00700 1 -- 172.21.15.72:0/3567330528 shutdown_connections 2024-03-19T06:06:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.363+0000 7fb540e00700 1 --2- 172.21.15.72:0/3567330528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb53c0737b0 0x7fb53c073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.363+0000 7fb540e00700 1 --2- 172.21.15.72:0/3567330528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c074d80 0x7fb53c0731e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.363+0000 7fb540e00700 1 -- 172.21.15.72:0/3567330528 >> 172.21.15.72:0/3567330528 conn(0x7fb53c0fb7f0 msgr2=0x7fb53c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:47.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.363+0000 7fb540e00700 1 -- 172.21.15.72:0/3567330528 shutdown_connections 2024-03-19T06:06:47.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.363+0000 7fb540e00700 1 -- 172.21.15.72:0/3567330528 wait complete. 2024-03-19T06:06:47.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.364+0000 7fb540e00700 1 Processor -- start 2024-03-19T06:06:47.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.365+0000 7fb540e00700 1 -- start start 2024-03-19T06:06:47.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.365+0000 7fb540e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0737b0 0x7fb53c19c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.365+0000 7fb540e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb53c074d80 0x7fb53c19c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.365+0000 7fb540e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c19cb30 con 0x7fb53c0737b0 2024-03-19T06:06:47.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.365+0000 7fb540e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c19cc70 con 0x7fb53c074d80 2024-03-19T06:06:47.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.365+0000 7fb539e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0737b0 0x7fb53c19c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:47.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.365+0000 7fb539e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0737b0 0x7fb53c19c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54736/0 (socket says 172.21.15.72:54736) 2024-03-19T06:06:47.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.365+0000 7fb539e00700 1 -- 172.21.15.72:0/1399167564 learned_addr learned my addr 172.21.15.72:0/1399167564 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:47.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.366+0000 7fb539e00700 1 -- 172.21.15.72:0/1399167564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb53c074d80 msgr2=0x7fb53c19c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.366+0000 7fb539e00700 1 --2- 172.21.15.72:0/1399167564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb53c074d80 0x7fb53c19c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.366+0000 7fb539e00700 1 -- 172.21.15.72:0/1399167564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c0095f0 con 0x7fb53c0737b0 2024-03-19T06:06:47.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.366+0000 7fb539e00700 1 --2- 172.21.15.72:0/1399167564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0737b0 0x7fb53c19c060 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb52c005b40 tx=0x7fb52c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:47.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.367+0000 7fb532a00700 1 -- 172.21.15.72:0/1399167564 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb52c01d070 con 0x7fb53c0737b0 2024-03-19T06:06:47.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.367+0000 7fb532a00700 1 -- 172.21.15.72:0/1399167564 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb52c022470 con 0x7fb53c0737b0 2024-03-19T06:06:47.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.367+0000 7fb532a00700 1 -- 172.21.15.72:0/1399167564 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb52c00f670 con 0x7fb53c0737b0 2024-03-19T06:06:47.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.367+0000 7fb540e00700 1 -- 172.21.15.72:0/1399167564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c1a16d0 con 0x7fb53c0737b0 2024-03-19T06:06:47.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.367+0000 7fb540e00700 1 -- 172.21.15.72:0/1399167564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c1a1b40 con 0x7fb53c0737b0 2024-03-19T06:06:47.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.369+0000 7fb540e00700 1 -- 172.21.15.72:0/1399167564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c10f370 con 0x7fb53c0737b0 2024-03-19T06:06:47.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.370+0000 7fb532a00700 1 -- 172.21.15.72:0/1399167564 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 91694+0+0 (secure 0 0 0) 0x7fb52c004b70 con 0x7fb53c0737b0 2024-03-19T06:06:47.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.371+0000 7fb532a00700 1 --2- 172.21.15.72:0/1399167564 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb52006dc20 0x7fb5200700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.371+0000 7fb532a00700 1 -- 172.21.15.72:0/1399167564 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb52c08ee70 con 0x7fb53c0737b0 2024-03-19T06:06:47.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.372+0000 7fb539400700 1 --2- 172.21.15.72:0/1399167564 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb52006dc20 0x7fb5200700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.373+0000 7fb539400700 1 --2- 172.21.15.72:0/1399167564 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb52006dc20 0x7fb5200700d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb528005fd0 tx=0x7fb528005d00 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:47.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.378+0000 7fb532a00700 1 -- 172.21.15.72:0/1399167564 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fb52c05c3f0 con 0x7fb53c0737b0 2024-03-19T06:06:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.666+0000 7fb540e00700 1 -- 172.21.15.72:0/1399167564 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb53c1032f0 con 0x7fb52006dc20 2024-03-19T06:06:47.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.682+0000 7fb532a00700 1 -- 172.21.15.72:0/1399167564 <== mgr.14702 v2:172.21.15.72:6800/2640845307 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fb53c1032f0 con 0x7fb52006dc20 2024-03-19T06:06:47.674 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:06:47.674 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (11m) 3s ago 13m 14.1M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:06:47.674 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (13m) 3s ago 13m 7956k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:06:47.674 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (12m) 7s ago 12m 7818k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:06:47.674 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (13m) 3s ago 13m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:06:47.674 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (11m) 7s ago 11m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:06:47.674 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (10m) 3s ago 12m 74.3M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:06:47.674 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (5m) 3s ago 5m 14.7M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:06:47.674 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (5m) 3s ago 5m 175M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:06:47.674 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (5m) 7s ago 5m 14.6M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (5m) 7s ago 5m 194M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (117s) 3s ago 15m 492M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (13s) 7s ago 11m 63.0M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (15m) 3s ago 15m 54.9M 2048M 18.2.0 dc2bc1663786 77289e9e2b33 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (11m) 7s ago 11m 42.3M 2048M 18.2.0 dc2bc1663786 31fba31e7d8a 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (13m) 3s ago 13m 7662k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (11m) 7s ago 11m 7914k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (10m) 3s ago 10m 200M 1216M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (10m) 3s ago 10m 197M 1216M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (9m) 3s ago 9m 157M 1216M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (8m) 7s ago 8m 212M 2241M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (8m) 7s ago 8m 181M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (7m) 7s ago 7m 200M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:06:47.675 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (26s) 3s ago 12m 48.2M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:06:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.685+0000 7fb540e00700 1 -- 172.21.15.72:0/1399167564 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb52006dc20 msgr2=0x7fb5200700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.685+0000 7fb540e00700 1 --2- 172.21.15.72:0/1399167564 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb52006dc20 0x7fb5200700d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb528005fd0 tx=0x7fb528005d00 comp rx=0 tx=0).stop 2024-03-19T06:06:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.685+0000 7fb540e00700 1 -- 172.21.15.72:0/1399167564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0737b0 msgr2=0x7fb53c19c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.685+0000 7fb540e00700 1 --2- 172.21.15.72:0/1399167564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0737b0 0x7fb53c19c060 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb52c005b40 tx=0x7fb52c00be20 comp rx=0 tx=0).stop 2024-03-19T06:06:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.685+0000 7fb540e00700 1 -- 172.21.15.72:0/1399167564 shutdown_connections 2024-03-19T06:06:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.685+0000 7fb540e00700 1 --2- 172.21.15.72:0/1399167564 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb52006dc20 0x7fb5200700d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.685+0000 7fb540e00700 1 --2- 172.21.15.72:0/1399167564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0737b0 0x7fb53c19c060 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.685+0000 7fb540e00700 1 --2- 172.21.15.72:0/1399167564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb53c074d80 0x7fb53c19c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.685+0000 7fb540e00700 1 -- 172.21.15.72:0/1399167564 >> 172.21.15.72:0/1399167564 conn(0x7fb53c0fb7f0 msgr2=0x7fb53c101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.686+0000 7fb540e00700 1 -- 172.21.15.72:0/1399167564 shutdown_connections 2024-03-19T06:06:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.686+0000 7fb540e00700 1 -- 172.21.15.72:0/1399167564 wait complete. 2024-03-19T06:06:47.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.887+0000 7fbba2200700 1 -- 172.21.15.72:0/2580883483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94006f30 msgr2=0x7fbb940073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.887+0000 7fbba2200700 1 --2- 172.21.15.72:0/2580883483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94006f30 0x7fbb940073a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009910 tx=0x7fbb88009c20 comp rx=0 tx=0).stop 2024-03-19T06:06:47.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.887+0000 7fbba2200700 1 -- 172.21.15.72:0/2580883483 shutdown_connections 2024-03-19T06:06:47.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.887+0000 7fbba2200700 1 --2- 172.21.15.72:0/2580883483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94006f30 0x7fbb940073a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.887+0000 7fbba2200700 1 --2- 172.21.15.72:0/2580883483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb94008500 0x7fbb94006960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.887+0000 7fbba2200700 1 -- 172.21.15.72:0/2580883483 >> 172.21.15.72:0/2580883483 conn(0x7fbb940906c0 msgr2=0x7fbb94092b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:47.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.888+0000 7fbba2200700 1 -- 172.21.15.72:0/2580883483 shutdown_connections 2024-03-19T06:06:47.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.888+0000 7fbba2200700 1 -- 172.21.15.72:0/2580883483 wait complete. 2024-03-19T06:06:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.890+0000 7fbba2200700 1 Processor -- start 2024-03-19T06:06:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.890+0000 7fbba2200700 1 -- start start 2024-03-19T06:06:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.891+0000 7fbba2200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb94006f30 0x7fbb94130f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.891+0000 7fbba2200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94008500 0x7fbb94131450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.891+0000 7fbba2200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94131a70 con 0x7fbb94006f30 2024-03-19T06:06:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.891+0000 7fbba2200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94131bb0 con 0x7fbb94008500 2024-03-19T06:06:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.892+0000 7fbba0e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb94006f30 0x7fbb94130f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.892+0000 7fbb9be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94008500 0x7fbb94131450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.892+0000 7fbba0e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb94006f30 0x7fbb94130f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54758/0 (socket says 172.21.15.72:54758) 2024-03-19T06:06:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.892+0000 7fbba0e00700 1 -- 172.21.15.72:0/3698622884 learned_addr learned my addr 172.21.15.72:0/3698622884 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.892+0000 7fbba0e00700 1 -- 172.21.15.72:0/3698622884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94008500 msgr2=0x7fbb94131450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.892+0000 7fbba0e00700 1 --2- 172.21.15.72:0/3698622884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94008500 0x7fbb94131450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.892+0000 7fbba0e00700 1 -- 172.21.15.72:0/3698622884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb880095f0 con 0x7fbb94006f30 2024-03-19T06:06:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.893+0000 7fbba0e00700 1 --2- 172.21.15.72:0/3698622884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb94006f30 0x7fbb94130f10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000e970 tx=0x7fbb9000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.894+0000 7fbb99600700 1 -- 172.21.15.72:0/3698622884 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb9000c9d0 con 0x7fbb94006f30 2024-03-19T06:06:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.894+0000 7fbb99600700 1 -- 172.21.15.72:0/3698622884 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbb90004830 con 0x7fbb94006f30 2024-03-19T06:06:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.894+0000 7fbb99600700 1 -- 172.21.15.72:0/3698622884 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb900055c0 con 0x7fbb94006f30 2024-03-19T06:06:47.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.894+0000 7fbba2200700 1 -- 172.21.15.72:0/3698622884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb94136660 con 0x7fbb94006f30 2024-03-19T06:06:47.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.894+0000 7fbba2200700 1 -- 172.21.15.72:0/3698622884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb94136bb0 con 0x7fbb94006f30 2024-03-19T06:06:47.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.899+0000 7fbb99600700 1 -- 172.21.15.72:0/3698622884 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 91694+0+0 (secure 0 0 0) 0x7fbb900049a0 con 0x7fbb94006f30 2024-03-19T06:06:47.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.900+0000 7fbb99600700 1 --2- 172.21.15.72:0/3698622884 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fbb8406dc70 0x7fbb84070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.900+0000 7fbba2200700 1 -- 172.21.15.72:0/3698622884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb940a4280 con 0x7fbb94006f30 2024-03-19T06:06:47.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.901+0000 7fbb99600700 1 -- 172.21.15.72:0/3698622884 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fbb90025070 con 0x7fbb94006f30 2024-03-19T06:06:47.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.902+0000 7fbb9be00700 1 --2- 172.21.15.72:0/3698622884 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fbb8406dc70 0x7fbb84070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:47.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.904+0000 7fbb9be00700 1 --2- 172.21.15.72:0/3698622884 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fbb8406dc70 0x7fbb84070120 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800b6f0 tx=0x7fbb88005a90 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:47.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:47.912+0000 7fbb99600700 1 -- 172.21.15.72:0/3698622884 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fbb90068b40 con 0x7fbb94006f30 2024-03-19T06:06:48.028 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: mgrmap e32: smithi072.jydpjk(active, since 94s), standbys: smithi172.qkcahs 2024-03-19T06:06:48.028 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:48.028 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: Upgrade: Setting container_image for all mgr 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi072.jydpjk"}]: dispatch 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi072.jydpjk"}]': finished 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi172.qkcahs"}]: dispatch 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi172.qkcahs"}]': finished 2024-03-19T06:06:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:47 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-19T06:06:48.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: mgrmap e32: smithi072.jydpjk(active, since 94s), standbys: smithi172.qkcahs 2024-03-19T06:06:48.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:48.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:48.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:48.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:06:48.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:06:48.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:48.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:06:48.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:06:48.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: Upgrade: Setting container_image for all mgr 2024-03-19T06:06:48.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:48.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi072.jydpjk"}]: dispatch 2024-03-19T06:06:48.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi072.jydpjk"}]': finished 2024-03-19T06:06:48.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi172.qkcahs"}]: dispatch 2024-03-19T06:06:48.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi172.qkcahs"}]': finished 2024-03-19T06:06:48.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:47 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-19T06:06:48.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.329+0000 7fbba2200700 1 -- 172.21.15.72:0/3698622884 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbb941372b0 con 0x7fbb94006f30 2024-03-19T06:06:48.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.330+0000 7fbb99600700 1 -- 172.21.15.72:0/3698622884 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fbb90068ce0 con 0x7fbb94006f30 2024-03-19T06:06:48.321 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-03-19T06:06:48.322 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:06:48.323 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:06:48.323 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:06:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.333+0000 7fbba2200700 1 -- 172.21.15.72:0/3698622884 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fbb8406dc70 msgr2=0x7fbb84070120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.333+0000 7fbba2200700 1 --2- 172.21.15.72:0/3698622884 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fbb8406dc70 0x7fbb84070120 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800b6f0 tx=0x7fbb88005a90 comp rx=0 tx=0).stop 2024-03-19T06:06:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.333+0000 7fbba2200700 1 -- 172.21.15.72:0/3698622884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb94006f30 msgr2=0x7fbb94130f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.333+0000 7fbba2200700 1 --2- 172.21.15.72:0/3698622884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb94006f30 0x7fbb94130f10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000e970 tx=0x7fbb9000ec80 comp rx=0 tx=0).stop 2024-03-19T06:06:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.334+0000 7fbba2200700 1 -- 172.21.15.72:0/3698622884 shutdown_connections 2024-03-19T06:06:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.334+0000 7fbba2200700 1 --2- 172.21.15.72:0/3698622884 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fbb8406dc70 0x7fbb84070120 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.334+0000 7fbba2200700 1 --2- 172.21.15.72:0/3698622884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb94006f30 0x7fbb94130f10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.334+0000 7fbba2200700 1 --2- 172.21.15.72:0/3698622884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94008500 0x7fbb94131450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.334+0000 7fbba2200700 1 -- 172.21.15.72:0/3698622884 >> 172.21.15.72:0/3698622884 conn(0x7fbb940906c0 msgr2=0x7fbb940969b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:48.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.334+0000 7fbba2200700 1 -- 172.21.15.72:0/3698622884 shutdown_connections 2024-03-19T06:06:48.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.334+0000 7fbba2200700 1 -- 172.21.15.72:0/3698622884 wait complete. 2024-03-19T06:06:48.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.512+0000 7fb325400700 1 -- 172.21.15.72:0/3074785589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb320100240 msgr2=0x7fb320100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.512+0000 7fb325400700 1 --2- 172.21.15.72:0/3074785589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb320100240 0x7fb320100650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb318009f90 tx=0x7fb31800b330 comp rx=0 tx=0).stop 2024-03-19T06:06:48.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.512+0000 7fb325400700 1 -- 172.21.15.72:0/3074785589 shutdown_connections 2024-03-19T06:06:48.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.512+0000 7fb325400700 1 --2- 172.21.15.72:0/3074785589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb320101440 0x7fb320101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.512+0000 7fb325400700 1 --2- 172.21.15.72:0/3074785589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb320100240 0x7fb320100650 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.512+0000 7fb325400700 1 -- 172.21.15.72:0/3074785589 >> 172.21.15.72:0/3074785589 conn(0x7fb3200fb7f0 msgr2=0x7fb3200fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:48.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.512+0000 7fb325400700 1 -- 172.21.15.72:0/3074785589 shutdown_connections 2024-03-19T06:06:48.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.512+0000 7fb325400700 1 -- 172.21.15.72:0/3074785589 wait complete. 2024-03-19T06:06:48.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.513+0000 7fb325400700 1 Processor -- start 2024-03-19T06:06:48.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.513+0000 7fb325400700 1 -- start start 2024-03-19T06:06:48.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.514+0000 7fb325400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb320100240 0x7fb320195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:48.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.514+0000 7fb325400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb320101440 0x7fb320196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:48.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.514+0000 7fb325400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb320196620 con 0x7fb320100240 2024-03-19T06:06:48.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.514+0000 7fb325400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb320196760 con 0x7fb320101440 2024-03-19T06:06:48.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.514+0000 7fb31e800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb320100240 0x7fb320195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:48.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.514+0000 7fb31e800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb320100240 0x7fb320195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54764/0 (socket says 172.21.15.72:54764) 2024-03-19T06:06:48.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.514+0000 7fb31e800700 1 -- 172.21.15.72:0/741593694 learned_addr learned my addr 172.21.15.72:0/741593694 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:48.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.514+0000 7fb31de00700 1 --2- 172.21.15.72:0/741593694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb320101440 0x7fb320196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:48.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.515+0000 7fb31e800700 1 -- 172.21.15.72:0/741593694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb320101440 msgr2=0x7fb320196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.515+0000 7fb31e800700 1 --2- 172.21.15.72:0/741593694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb320101440 0x7fb320196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.515+0000 7fb31e800700 1 -- 172.21.15.72:0/741593694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb318009c40 con 0x7fb320100240 2024-03-19T06:06:48.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.515+0000 7fb31e800700 1 --2- 172.21.15.72:0/741593694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb320100240 0x7fb320195ac0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb318006130 tx=0x7fb31800bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:48.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.515+0000 7fb317400700 1 -- 172.21.15.72:0/741593694 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb31800e070 con 0x7fb320100240 2024-03-19T06:06:48.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.515+0000 7fb317400700 1 -- 172.21.15.72:0/741593694 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb318003de0 con 0x7fb320100240 2024-03-19T06:06:48.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.515+0000 7fb325400700 1 -- 172.21.15.72:0/741593694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3200730c0 con 0x7fb320100240 2024-03-19T06:06:48.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.515+0000 7fb317400700 1 -- 172.21.15.72:0/741593694 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3180126f0 con 0x7fb320100240 2024-03-19T06:06:48.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.516+0000 7fb325400700 1 -- 172.21.15.72:0/741593694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb320073610 con 0x7fb320100240 2024-03-19T06:06:48.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.517+0000 7fb325400700 1 -- 172.21.15.72:0/741593694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb320108d90 con 0x7fb320100240 2024-03-19T06:06:48.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.519+0000 7fb317400700 1 -- 172.21.15.72:0/741593694 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 91694+0+0 (secure 0 0 0) 0x7fb318019040 con 0x7fb320100240 2024-03-19T06:06:48.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.520+0000 7fb317400700 1 --2- 172.21.15.72:0/741593694 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb30406dc20 0x7fb3040700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:48.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.520+0000 7fb317400700 1 -- 172.21.15.72:0/741593694 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb31808ec60 con 0x7fb320100240 2024-03-19T06:06:48.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.520+0000 7fb31de00700 1 --2- 172.21.15.72:0/741593694 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb30406dc20 0x7fb3040700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:48.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.521+0000 7fb31de00700 1 --2- 172.21.15.72:0/741593694 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb30406dc20 0x7fb3040700d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb308005fd0 tx=0x7fb308009310 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:48.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.523+0000 7fb317400700 1 -- 172.21.15.72:0/741593694 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fb31805c190 con 0x7fb320100240 2024-03-19T06:06:48.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.858+0000 7fb325400700 1 -- 172.21.15.72:0/741593694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb320108f80 con 0x7fb320100240 2024-03-19T06:06:48.851 INFO:teuthology.orchestra.run.smithi072.stdout:e15 2024-03-19T06:06:48.852 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:06:48.852 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:06:48.852 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:06:48.852 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:06:48.852 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:06:48.852 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:06:48.852 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 15 2024-03-19T06:06:48.852 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:06:48.852 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:06:48.853 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:04:57.207619+0000 2024-03-19T06:06:48.853 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:06:48.853 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:06:48.853 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:06:48.853 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:06:48.853 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:06:48.853 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:06:48.853 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:06:48.853 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:06:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:06:48.855 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:06:48.855 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:06:48.855 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:06:48.855 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:06:48.855 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:06:48.855 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:06:48.855 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:06:48.855 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:06:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.858+0000 7fb317400700 1 -- 172.21.15.72:0/741593694 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1865 (secure 0 0 0) 0x7fb31805bd20 con 0x7fb320100240 2024-03-19T06:06:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.862+0000 7fb325400700 1 -- 172.21.15.72:0/741593694 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb30406dc20 msgr2=0x7fb3040700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.862+0000 7fb325400700 1 --2- 172.21.15.72:0/741593694 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb30406dc20 0x7fb3040700d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb308005fd0 tx=0x7fb308009310 comp rx=0 tx=0).stop 2024-03-19T06:06:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.862+0000 7fb325400700 1 -- 172.21.15.72:0/741593694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb320100240 msgr2=0x7fb320195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.862+0000 7fb325400700 1 --2- 172.21.15.72:0/741593694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb320100240 0x7fb320195ac0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb318006130 tx=0x7fb31800bdc0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.863+0000 7fb325400700 1 -- 172.21.15.72:0/741593694 shutdown_connections 2024-03-19T06:06:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.863+0000 7fb325400700 1 --2- 172.21.15.72:0/741593694 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fb30406dc20 0x7fb3040700d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.863+0000 7fb325400700 1 --2- 172.21.15.72:0/741593694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb320100240 0x7fb320195ac0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.863+0000 7fb325400700 1 --2- 172.21.15.72:0/741593694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb320101440 0x7fb320196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.863+0000 7fb325400700 1 -- 172.21.15.72:0/741593694 >> 172.21.15.72:0/741593694 conn(0x7fb3200fb7f0 msgr2=0x7fb320104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:48.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.864+0000 7fb325400700 1 -- 172.21.15.72:0/741593694 shutdown_connections 2024-03-19T06:06:48.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:48.864+0000 7fb325400700 1 -- 172.21.15.72:0/741593694 wait complete. 2024-03-19T06:06:48.860 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2024-03-19T06:06:48.860 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:48 smithi072 ceph-mon[28706]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:48.861 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:48 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/3698622884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:06:48.861 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:48 smithi072 ceph-mon[28706]: pgmap v51: 65 pgs: 65 active+clean; 980 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 96 op/s 2024-03-19T06:06:49.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.088+0000 7f9673400700 1 -- 172.21.15.72:0/601917208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f966c100240 msgr2=0x7f966c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.088+0000 7f9673400700 1 --2- 172.21.15.72:0/601917208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f966c100240 0x7f966c100650 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9660009910 tx=0x7f9660009c20 comp rx=0 tx=0).stop 2024-03-19T06:06:49.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.089+0000 7f9673400700 1 -- 172.21.15.72:0/601917208 shutdown_connections 2024-03-19T06:06:49.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.089+0000 7f9673400700 1 --2- 172.21.15.72:0/601917208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f966c101440 0x7f966c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.089+0000 7f9673400700 1 --2- 172.21.15.72:0/601917208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f966c100240 0x7f966c100650 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.089+0000 7f9673400700 1 -- 172.21.15.72:0/601917208 >> 172.21.15.72:0/601917208 conn(0x7f966c0fb7f0 msgr2=0x7f966c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:49.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.089+0000 7f9673400700 1 -- 172.21.15.72:0/601917208 shutdown_connections 2024-03-19T06:06:49.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.089+0000 7f9673400700 1 -- 172.21.15.72:0/601917208 wait complete. 2024-03-19T06:06:49.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.091+0000 7f9673400700 1 Processor -- start 2024-03-19T06:06:49.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.091+0000 7f9673400700 1 -- start start 2024-03-19T06:06:49.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.091+0000 7f9673400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f966c100240 0x7f966c19c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.091+0000 7f9673400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f966c101440 0x7f966c19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.091+0000 7f9673400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c19cc30 con 0x7f966c100240 2024-03-19T06:06:49.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.091+0000 7f9673400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c19cd70 con 0x7f966c101440 2024-03-19T06:06:49.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.092+0000 7f966be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f966c101440 0x7f966c19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:49.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.092+0000 7f9670a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f966c100240 0x7f966c19c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.092+0000 7f9670a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f966c100240 0x7f966c19c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54790/0 (socket says 172.21.15.72:54790) 2024-03-19T06:06:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.092+0000 7f9670a00700 1 -- 172.21.15.72:0/844325837 learned_addr learned my addr 172.21.15.72:0/844325837 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.092+0000 7f966be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f966c101440 0x7f966c19c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:54536/0 (socket says 172.21.15.72:54536) 2024-03-19T06:06:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.093+0000 7f9670a00700 1 -- 172.21.15.72:0/844325837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f966c101440 msgr2=0x7f966c19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.093+0000 7f9670a00700 1 --2- 172.21.15.72:0/844325837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f966c101440 0x7f966c19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.093+0000 7f9670a00700 1 -- 172.21.15.72:0/844325837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96600095f0 con 0x7f966c100240 2024-03-19T06:06:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.093+0000 7f9670a00700 1 --2- 172.21.15.72:0/844325837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f966c100240 0x7f966c19c0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9660000c00 tx=0x7f966000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.094+0000 7f9669600700 1 -- 172.21.15.72:0/844325837 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f966001d070 con 0x7f966c100240 2024-03-19T06:06:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.094+0000 7f9669600700 1 -- 172.21.15.72:0/844325837 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f966000f460 con 0x7f966c100240 2024-03-19T06:06:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.094+0000 7f9669600700 1 -- 172.21.15.72:0/844325837 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9660017630 con 0x7f966c100240 2024-03-19T06:06:49.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.095+0000 7f9673400700 1 -- 172.21.15.72:0/844325837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966c1a17c0 con 0x7f966c100240 2024-03-19T06:06:49.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.095+0000 7f9673400700 1 -- 172.21.15.72:0/844325837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966c1a1c80 con 0x7f966c100240 2024-03-19T06:06:49.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.096+0000 7f9673400700 1 -- 172.21.15.72:0/844325837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966c105520 con 0x7f966c100240 2024-03-19T06:06:49.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.098+0000 7f9669600700 1 -- 172.21.15.72:0/844325837 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 91694+0+0 (secure 0 0 0) 0x7f966000f5d0 con 0x7f966c100240 2024-03-19T06:06:49.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.098+0000 7f9669600700 1 --2- 172.21.15.72:0/844325837 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f965406dcc0 0x7f9654070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.099+0000 7f9669600700 1 -- 172.21.15.72:0/844325837 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f966008f2d0 con 0x7f966c100240 2024-03-19T06:06:49.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.099+0000 7f966be00700 1 --2- 172.21.15.72:0/844325837 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f965406dcc0 0x7f9654070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:49.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.100+0000 7f966be00700 1 --2- 172.21.15.72:0/844325837 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f965406dcc0 0x7f9654070170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9658005950 tx=0x7f96580058e0 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:49.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.104+0000 7f9669600700 1 -- 172.21.15.72:0/844325837 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7f966005c8c0 con 0x7f966c100240 2024-03-19T06:06:49.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:48 smithi172 ceph-mon[35716]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:49.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:48 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3698622884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:06:49.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:48 smithi172 ceph-mon[35716]: pgmap v51: 65 pgs: 65 active+clean; 980 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 96 op/s 2024-03-19T06:06:49.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.393+0000 7f9673400700 1 -- 172.21.15.72:0/844325837 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f966c108e70 con 0x7f965406dcc0 2024-03-19T06:06:49.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.395+0000 7f9669600700 1 -- 172.21.15.72:0/844325837 <== mgr.14702 v2:172.21.15.72:6800/2640845307 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f966c108e70 con 0x7f965406dcc0 2024-03-19T06:06:49.387 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:06:49.387 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:06:49.387 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:06:49.387 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:06:49.387 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:06:49.387 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr" 2024-03-19T06:06:49.388 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:06:49.388 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "2/23 daemons upgraded", 2024-03-19T06:06:49.388 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mon daemons", 2024-03-19T06:06:49.388 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:06:49.388 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:06:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.398+0000 7f9673400700 1 -- 172.21.15.72:0/844325837 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f965406dcc0 msgr2=0x7f9654070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.398+0000 7f9673400700 1 --2- 172.21.15.72:0/844325837 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f965406dcc0 0x7f9654070170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9658005950 tx=0x7f96580058e0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.398+0000 7f9673400700 1 -- 172.21.15.72:0/844325837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f966c100240 msgr2=0x7f966c19c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.398+0000 7f9673400700 1 --2- 172.21.15.72:0/844325837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f966c100240 0x7f966c19c0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9660000c00 tx=0x7f966000be20 comp rx=0 tx=0).stop 2024-03-19T06:06:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.398+0000 7f9673400700 1 -- 172.21.15.72:0/844325837 shutdown_connections 2024-03-19T06:06:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.398+0000 7f9673400700 1 --2- 172.21.15.72:0/844325837 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f965406dcc0 0x7f9654070170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.398+0000 7f9673400700 1 --2- 172.21.15.72:0/844325837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f966c100240 0x7f966c19c0d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.398+0000 7f9673400700 1 --2- 172.21.15.72:0/844325837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f966c101440 0x7f966c19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.398+0000 7f9673400700 1 -- 172.21.15.72:0/844325837 >> 172.21.15.72:0/844325837 conn(0x7f966c0fb7f0 msgr2=0x7f966c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.399+0000 7f9673400700 1 -- 172.21.15.72:0/844325837 shutdown_connections 2024-03-19T06:06:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.399+0000 7f9673400700 1 -- 172.21.15.72:0/844325837 wait complete. 2024-03-19T06:06:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.556+0000 7fcc6c400700 1 -- 172.21.15.72:0/3103106237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc64105710 msgr2=0x7fcc64107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.556+0000 7fcc6c400700 1 --2- 172.21.15.72:0/3103106237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc64105710 0x7fcc64107af0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009910 tx=0x7fcc50009c20 comp rx=0 tx=0).stop 2024-03-19T06:06:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.556+0000 7fcc6c400700 1 -- 172.21.15.72:0/3103106237 shutdown_connections 2024-03-19T06:06:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.556+0000 7fcc6c400700 1 --2- 172.21.15.72:0/3103106237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc64105710 0x7fcc64107af0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.556+0000 7fcc6c400700 1 --2- 172.21.15.72:0/3103106237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc64069270 0x7fcc641051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.556+0000 7fcc6c400700 1 -- 172.21.15.72:0/3103106237 >> 172.21.15.72:0/3103106237 conn(0x7fcc640fa780 msgr2=0x7fcc640fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:49.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.556+0000 7fcc6c400700 1 -- 172.21.15.72:0/3103106237 shutdown_connections 2024-03-19T06:06:49.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.557+0000 7fcc6c400700 1 -- 172.21.15.72:0/3103106237 wait complete. 2024-03-19T06:06:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.557+0000 7fcc6c400700 1 Processor -- start 2024-03-19T06:06:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.558+0000 7fcc6c400700 1 -- start start 2024-03-19T06:06:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.558+0000 7fcc6c400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc64105710 0x7fcc64197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.558+0000 7fcc6c400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc641982a0 0x7fcc6419d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.558+0000 7fcc6c400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc641987a0 con 0x7fcc641982a0 2024-03-19T06:06:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.558+0000 7fcc6c400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc64198910 con 0x7fcc64105710 2024-03-19T06:06:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.558+0000 7fcc69000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc641982a0 0x7fcc6419d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.558+0000 7fcc69000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc641982a0 0x7fcc6419d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54816/0 (socket says 172.21.15.72:54816) 2024-03-19T06:06:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.558+0000 7fcc69000700 1 -- 172.21.15.72:0/1470296885 learned_addr learned my addr 172.21.15.72:0/1470296885 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:06:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.559+0000 7fcc69000700 1 -- 172.21.15.72:0/1470296885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc64105710 msgr2=0x7fcc64197d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-19T06:06:49.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.559+0000 7fcc69000700 1 --2- 172.21.15.72:0/1470296885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc64105710 0x7fcc64197d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.559+0000 7fcc69000700 1 -- 172.21.15.72:0/1470296885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc500095f0 con 0x7fcc641982a0 2024-03-19T06:06:49.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.559+0000 7fcc69000700 1 --2- 172.21.15.72:0/1470296885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc641982a0 0x7fcc6419d310 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcc50000c00 tx=0x7fcc5000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:49.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.559+0000 7fcc62000700 1 -- 172.21.15.72:0/1470296885 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc5001d070 con 0x7fcc641982a0 2024-03-19T06:06:49.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.560+0000 7fcc62000700 1 -- 172.21.15.72:0/1470296885 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc50022470 con 0x7fcc641982a0 2024-03-19T06:06:49.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.560+0000 7fcc62000700 1 -- 172.21.15.72:0/1470296885 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc5000f720 con 0x7fcc641982a0 2024-03-19T06:06:49.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.560+0000 7fcc6c400700 1 -- 172.21.15.72:0/1470296885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6419d850 con 0x7fcc641982a0 2024-03-19T06:06:49.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.560+0000 7fcc6c400700 1 -- 172.21.15.72:0/1470296885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6419dcc0 con 0x7fcc641982a0 2024-03-19T06:06:49.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.561+0000 7fcc6c400700 1 -- 172.21.15.72:0/1470296885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc64191e70 con 0x7fcc641982a0 2024-03-19T06:06:49.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.563+0000 7fcc62000700 1 -- 172.21.15.72:0/1470296885 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 91694+0+0 (secure 0 0 0) 0x7fcc50004b30 con 0x7fcc641982a0 2024-03-19T06:06:49.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.564+0000 7fcc62000700 1 --2- 172.21.15.72:0/1470296885 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fcc4c06dc20 0x7fcc4c0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.564+0000 7fcc62000700 1 -- 172.21.15.72:0/1470296885 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fcc5008efe0 con 0x7fcc641982a0 2024-03-19T06:06:49.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.564+0000 7fcc69a00700 1 --2- 172.21.15.72:0/1470296885 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fcc4c06dc20 0x7fcc4c0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:49.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.565+0000 7fcc69a00700 1 --2- 172.21.15.72:0/1470296885 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fcc4c06dc20 0x7fcc4c0700d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc64068fa0 tx=0x7fcc58006c60 comp rx=0 tx=0).ready entity=mgr.14702 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:49.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.569+0000 7fcc62000700 1 -- 172.21.15.72:0/1470296885 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184062 (secure 0 0 0) 0x7fcc500c2f10 con 0x7fcc641982a0 2024-03-19T06:06:49.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.946+0000 7fcc6c400700 1 -- 172.21.15.72:0/1470296885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcc64069270 con 0x7fcc641982a0 2024-03-19T06:06:49.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.948+0000 7fcc62000700 1 -- 172.21.15.72:0/1470296885 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fcc5005c4c0 con 0x7fcc641982a0 2024-03-19T06:06:49.939 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:06:49.939 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:06:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:06:49.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.951+0000 7fcc6c400700 1 -- 172.21.15.72:0/1470296885 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fcc4c06dc20 msgr2=0x7fcc4c0700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.951+0000 7fcc6c400700 1 --2- 172.21.15.72:0/1470296885 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fcc4c06dc20 0x7fcc4c0700d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc64068fa0 tx=0x7fcc58006c60 comp rx=0 tx=0).stop 2024-03-19T06:06:49.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.951+0000 7fcc6c400700 1 -- 172.21.15.72:0/1470296885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc641982a0 msgr2=0x7fcc6419d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.951+0000 7fcc6c400700 1 --2- 172.21.15.72:0/1470296885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc641982a0 0x7fcc6419d310 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcc50000c00 tx=0x7fcc5000be20 comp rx=0 tx=0).stop 2024-03-19T06:06:49.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.952+0000 7fcc6c400700 1 -- 172.21.15.72:0/1470296885 shutdown_connections 2024-03-19T06:06:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.952+0000 7fcc6c400700 1 --2- 172.21.15.72:0/1470296885 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7fcc4c06dc20 0x7fcc4c0700d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.952+0000 7fcc6c400700 1 --2- 172.21.15.72:0/1470296885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc64105710 0x7fcc64197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.952+0000 7fcc6c400700 1 --2- 172.21.15.72:0/1470296885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc641982a0 0x7fcc6419d310 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.952+0000 7fcc6c400700 1 -- 172.21.15.72:0/1470296885 >> 172.21.15.72:0/1470296885 conn(0x7fcc640fa780 msgr2=0x7fcc640fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.952+0000 7fcc6c400700 1 -- 172.21.15.72:0/1470296885 shutdown_connections 2024-03-19T06:06:49.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:06:49.952+0000 7fcc6c400700 1 -- 172.21.15.72:0/1470296885 wait complete. 2024-03-19T06:06:50.066 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:49 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/741593694' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:06:50.066 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:49 smithi072 ceph-mon[28706]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:50.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:49 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/741593694' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:06:50.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:49 smithi172 ceph-mon[35716]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:06:50.585 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-19T06:06:50.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-19T06:06:50.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:50 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/1470296885' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:06:50.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:50 smithi172 ceph-mon[35716]: Upgrade: Updating mon.smithi072 2024-03-19T06:06:50.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:50 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:50.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:50 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T06:06:50.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:50 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-19T06:06:50.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:50 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:06:50.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:50 smithi172 ceph-mon[35716]: Deploying daemon mon.smithi072 on smithi072 2024-03-19T06:06:50.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:50 smithi172 ceph-mon[35716]: pgmap v52: 65 pgs: 65 active+clean; 734 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 133 op/s 2024-03-19T06:06:50.957 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:50 smithi072 ceph-mon[28706]: from='client.? 172.21.15.72:0/1470296885' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:06:50.957 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:50 smithi072 ceph-mon[28706]: Upgrade: Updating mon.smithi072 2024-03-19T06:06:50.957 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:50 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' 2024-03-19T06:06:50.957 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:50 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T06:06:50.957 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:50 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-19T06:06:50.957 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:50 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:06:50.957 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:50 smithi072 ceph-mon[28706]: Deploying daemon mon.smithi072 on smithi072 2024-03-19T06:06:50.957 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:50 smithi072 ceph-mon[28706]: pgmap v52: 65 pgs: 65 active+clean; 734 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 133 op/s 2024-03-19T06:06:53.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:53 smithi072 ceph-mon[28706]: pgmap v53: 65 pgs: 65 active+clean; 734 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.1 MiB/s wr, 93 op/s 2024-03-19T06:06:53.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:53 smithi172 ceph-mon[35716]: pgmap v53: 65 pgs: 65 active+clean; 734 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.1 MiB/s wr, 93 op/s 2024-03-19T06:06:55.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:55 smithi072 ceph-mon[28706]: pgmap v54: 65 pgs: 65 active+clean; 342 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 1.6 MiB/s wr, 139 op/s 2024-03-19T06:06:55.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:55 smithi172 ceph-mon[35716]: pgmap v54: 65 pgs: 65 active+clean; 342 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 1.6 MiB/s wr, 139 op/s 2024-03-19T06:06:57.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:57 smithi072 ceph-mon[28706]: pgmap v55: 65 pgs: 65 active+clean; 342 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1.0 MiB/s wr, 93 op/s 2024-03-19T06:06:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:57 smithi172 ceph-mon[35716]: pgmap v55: 65 pgs: 65 active+clean; 342 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1.0 MiB/s wr, 93 op/s 2024-03-19T06:06:58.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:58 smithi072 ceph-mon[28706]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:06:58.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:58 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:06:59.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:06:59 smithi072 ceph-mon[28706]: pgmap v56: 65 pgs: 65 active+clean; 340 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 105 op/s 2024-03-19T06:06:59.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:06:59 smithi172 ceph-mon[35716]: pgmap v56: 65 pgs: 65 active+clean; 340 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 105 op/s 2024-03-19T06:07:01.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:01 smithi072 ceph-mon[28706]: pgmap v57: 65 pgs: 65 active+clean; 339 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.5 MiB/s wr, 127 op/s 2024-03-19T06:07:01.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:01 smithi172 ceph-mon[35716]: pgmap v57: 65 pgs: 65 active+clean; 339 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.5 MiB/s wr, 127 op/s 2024-03-19T06:07:03.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:03 smithi072 ceph-mon[28706]: pgmap v58: 65 pgs: 65 active+clean; 339 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 988 KiB/s wr, 85 op/s 2024-03-19T06:07:03.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:03 smithi172 ceph-mon[35716]: pgmap v58: 65 pgs: 65 active+clean; 339 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 988 KiB/s wr, 85 op/s 2024-03-19T06:07:05.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:05 smithi072 ceph-mon[28706]: pgmap v59: 65 pgs: 65 active+clean; 338 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-03-19T06:07:05.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:05 smithi172 ceph-mon[35716]: pgmap v59: 65 pgs: 65 active+clean; 338 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-03-19T06:07:07.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:07 smithi072 ceph-mon[28706]: pgmap v60: 65 pgs: 65 active+clean; 338 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 843 KiB/s wr, 69 op/s 2024-03-19T06:07:07.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:07 smithi172 ceph-mon[35716]: pgmap v60: 65 pgs: 65 active+clean; 338 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 843 KiB/s wr, 69 op/s 2024-03-19T06:07:09.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:09 smithi072 ceph-mon[28706]: pgmap v61: 65 pgs: 65 active+clean; 338 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 843 KiB/s wr, 69 op/s 2024-03-19T06:07:09.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:09 smithi072 systemd[1]: Stopping Ceph mon.smithi072 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:07:09.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:09 smithi172 ceph-mon[35716]: pgmap v61: 65 pgs: 65 active+clean; 338 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 843 KiB/s wr, 69 op/s 2024-03-19T06:07:10.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:10 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072[28701]: 2024-03-19T06:07:10.172+0000 7f8359200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi072 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:07:10.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:10 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072[28701]: 2024-03-19T06:07:10.172+0000 7f8359200700 -1 mon.smithi072@0(leader) e2 *** Got Signal Terminated *** 2024-03-19T06:07:10.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:10 smithi072 podman[78382]: 2024-03-19 06:07:10.295481568 +0000 UTC m=+0.273850509 container died 77289e9e2b3345d69c4949dc03bc209e7fe291289093242c0729c127ab64b384 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:07:10.900 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:10 smithi072 podman[78382]: 2024-03-19 06:07:10.886694713 +0000 UTC m=+0.865063648 container cleanup 77289e9e2b3345d69c4949dc03bc209e7fe291289093242c0729c127ab64b384 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS) 2024-03-19T06:07:10.900 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:10 smithi072 bash[78382]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072 2024-03-19T06:07:11.474 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:11 smithi072 podman[78406]: 2024-03-19 06:07:11.109293457 +0000 UTC m=+0.795343895 container remove 77289e9e2b3345d69c4949dc03bc209e7fe291289093242c0729c127ab64b384 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, ceph=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS) 2024-03-19T06:07:11.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:11 smithi072 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi072.service: Deactivated successfully. 2024-03-19T06:07:11.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:11 smithi072 systemd[1]: Stopped Ceph mon.smithi072 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:07:11.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:11 smithi072 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi072.service: Consumed 27.882s CPU time. 2024-03-19T06:07:12.294 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:11 smithi072 systemd[1]: Starting Ceph mon.smithi072 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:07:12.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 podman[78527]: 2024-03-19 06:07:12.212782103 +0000 UTC m=+0.037786085 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:07:12.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 podman[78527]: 2024-03-19 06:07:12.345087717 +0000 UTC m=+0.170091680 container create f8806c6c6e84a69cb23a6e37e6d806b4c961d406ea5bbd016e57616e5c5825ec (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-19T06:07:13.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 podman[78527]: 2024-03-19 06:07:12.612736979 +0000 UTC m=+0.437741021 container init f8806c6c6e84a69cb23a6e37e6d806b4c961d406ea5bbd016e57616e5c5825ec (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, GIT_CLEAN=True, org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:07:13.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 podman[78527]: 2024-03-19 06:07:12.624175249 +0000 UTC m=+0.449179225 container start f8806c6c6e84a69cb23a6e37e6d806b4c961d406ea5bbd016e57616e5c5825ec (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.schema-version=1.0) 2024-03-19T06:07:13.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: set uid:gid to 167:167 (ceph:ceph) 2024-03-19T06:07:13.078 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev), process ceph-mon, pid 2 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: pidfile_write: ignore empty --pid-file 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: load: jerasure load: lrc 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: RocksDB version: 7.9.2 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Git sha 0 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Compile date 2024-03-07 05:32:18 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: DB SUMMARY 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: DB Session ID: PK01EVPRX02P5W0BLD7T 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: CURRENT file: CURRENT 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: IDENTITY file: IDENTITY 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1489 Bytes 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi072/store.db dir, Total Num: 1, files: 000032.sst 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi072/store.db: 000030.log size: 3572098 ; 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.error_if_exists: 0 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.create_if_missing: 0 2024-03-19T06:07:13.079 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.paranoid_checks: 1 2024-03-19T06:07:13.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-19T06:07:13.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-19T06:07:13.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-19T06:07:13.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.env: 0x55eb3a527b20 2024-03-19T06:07:13.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.fs: PosixFileSystem 2024-03-19T06:07:13.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.info_log: 0x55eb3c1b37c0 2024-03-19T06:07:13.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_file_opening_threads: 16 2024-03-19T06:07:13.080 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.statistics: (nil) 2024-03-19T06:07:13.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.use_fsync: 0 2024-03-19T06:07:13.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_log_file_size: 0 2024-03-19T06:07:13.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-19T06:07:13.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-19T06:07:13.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.keep_log_file_num: 1000 2024-03-19T06:07:13.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.recycle_log_file_num: 0 2024-03-19T06:07:13.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.allow_fallocate: 1 2024-03-19T06:07:13.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.allow_mmap_reads: 0 2024-03-19T06:07:13.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.allow_mmap_writes: 0 2024-03-19T06:07:13.081 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.use_direct_reads: 0 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.create_missing_column_families: 0 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.db_log_dir: 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.wal_dir: 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.advise_random_on_open: 1 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.db_write_buffer_size: 0 2024-03-19T06:07:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.write_buffer_manager: 0x55eb3c187400 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.rate_limiter: (nil) 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.wal_recovery_mode: 2 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.enable_thread_tracking: 0 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.enable_pipelined_write: 0 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.unordered_write: 0 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.row_cache: None 2024-03-19T06:07:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.wal_filter: None 2024-03-19T06:07:13.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-19T06:07:13.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.allow_ingest_behind: 0 2024-03-19T06:07:13.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.two_write_queues: 0 2024-03-19T06:07:13.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.manual_wal_flush: 0 2024-03-19T06:07:13.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.wal_compression: 0 2024-03-19T06:07:13.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.atomic_flush: 0 2024-03-19T06:07:13.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-19T06:07:13.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-19T06:07:13.084 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.log_readahead_size: 0 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.best_efforts_recovery: 0 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.allow_data_in_errors: 0 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.db_host_id: __hostname__ 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_background_jobs: 2 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_background_compactions: -1 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_subcompactions: 1 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-19T06:07:13.085 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_total_wal_size: 0 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_open_files: -1 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bytes_per_sync: 0 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_readahead_size: 0 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_background_flushes: -1 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Compression algorithms supported: 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-19T06:07:13.086 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: kZSTD supported: 0 2024-03-19T06:07:13.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: kXpressCompression supported: 0 2024-03-19T06:07:13.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: kLZ4HCCompression supported: 1 2024-03-19T06:07:13.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: kZlibCompression supported: 1 2024-03-19T06:07:13.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: kSnappyCompression supported: 1 2024-03-19T06:07:13.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: kLZ4Compression supported: 1 2024-03-19T06:07:13.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: kBZip2Compression supported: 0 2024-03-19T06:07:13.087 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi072/store.db/MANIFEST-000015 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.merge_operator: 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_filter: None 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_filter_factory: None 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.sst_partitioner_factory: None 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55eb3c1b38e0) 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: cache_index_and_filter_blocks: 1 2024-03-19T06:07:13.088 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: pin_top_level_index_and_filter: 1 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: index_type: 0 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: data_block_index_type: 0 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: index_shortening: 1 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: checksum: 4 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: no_block_cache: 0 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache: 0x55eb3c1b9090 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache_name: BinnedLRUCache 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache_options: 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: capacity : 536870912 2024-03-19T06:07:13.089 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: num_shard_bits : 4 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: strict_capacity_limit : 0 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: high_pri_pool_ratio: 0.000 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_cache_compressed: (nil) 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: persistent_cache: (nil) 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_size: 4096 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_size_deviation: 10 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_restart_interval: 16 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: index_block_restart_interval: 1 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: metadata_block_size: 4096 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: partition_filters: 0 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: use_delta_encoding: 1 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: filter_policy: bloomfilter 2024-03-19T06:07:13.090 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: whole_key_filtering: 1 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: verify_compression: 0 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: read_amp_bytes_per_bit: 0 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: format_version: 5 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: enable_index_compression: 1 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: block_align: 0 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: max_auto_readahead_size: 262144 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: prepopulate_block_cache: 0 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: initial_auto_readahead_size: 8192 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: num_file_reads_for_auto_readahead: 2 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.write_buffer_size: 33554432 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_write_buffer_number: 2 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compression: NoCompression 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bottommost_compression: Disabled 2024-03-19T06:07:13.091 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.prefix_extractor: nullptr 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.num_levels: 7 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-19T06:07:13.092 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compression_opts.level: 32767 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compression_opts.strategy: 0 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compression_opts.enabled: false 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.target_file_size_base: 67108864 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-19T06:07:13.093 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-19T06:07:13.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-19T06:07:13.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-19T06:07:13.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-19T06:07:13.094 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.arena_block_size: 1048576 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.disable_auto_compactions: 0 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-19T06:07:13.095 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.table_properties_collectors: 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.inplace_update_support: 0 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.bloom_locality: 0 2024-03-19T06:07:13.096 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.max_successive_merges: 0 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.paranoid_file_checks: 0 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.force_consistency_checks: 1 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.report_bg_io_stats: 0 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.ttl: 2592000 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.enable_blob_files: false 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.min_blob_size: 0 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.blob_file_size: 268435456 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-19T06:07:13.097 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.blob_file_starting_level: 0 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi072/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12872, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 94566e89-3a9b-4078-bb1c-ca08d6700264 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710828432690487, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710828432709545, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 3288436, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12873, "largest_seqno": 15297, "table_properties": {"data_size": 3278713, "index_size": 5950, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2757, "raw_key_size": 22750, "raw_average_key_size": 20, "raw_value_size": 3257627, "raw_average_value_size": 2991, "num_data_blocks": 271, "num_entries": 1089, "num_filter_entries": 1089, "num_deletions": 253, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1710828432, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "94566e89-3a9b-4078-bb1c-ca08d6700264", "db_session_id": "PK01EVPRX02P5W0BLD7T", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710828432709670, "job": 1, "event": "recovery_finished"} 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-19T06:07:13.098 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi072/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55eb3c2aa000 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: DB pointer 0x55eb3c296000 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** DB Stats ** 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T06:07:13.099 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** Compaction Stats [default] ** 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: L0 1/0 3.14 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 408.8 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: L6 1/0 5.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Sum 2/0 8.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 408.8 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 408.8 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** Compaction Stats [default] ** 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 408.8 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-19T06:07:13.100 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Cumulative compaction: 0.00 GB write, 123.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Interval compaction: 0.00 GB write, 123.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Block cache BinnedLRUCache@0x55eb3c1b9090#2 capacity: 512.00 MB usage: 8.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.2e-05 secs_since: 0 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,11.81 KB,0.00225306%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: starting mon.smithi072 rank 0 at public addrs [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] at bind addrs [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi072 fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T06:07:13.101 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: mon.smithi072@-1(???) e2 preinit fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: mon.smithi072@-1(???).mds e15 new map 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: mon.smithi072@-1(???).mds e15 print_map 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: e15 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: legacy client fscid: 1 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Filesystem 'cephfs' (1) 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: fs_name cephfs 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: epoch 15 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: modified 2024-03-19T06:04:57.207619+0000 2024-03-19T06:07:13.102 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: tableserver 0 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: root 0 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: session_timeout 60 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: session_autoclose 300 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: max_file_size 1099511627776 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: max_xattr_size 65536 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: required_client_features {} 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: last_failure 0 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: last_failure_osd_epoch 0 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: max_mds 2 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: in 0,1 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: up {0=14464,1=24227} 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: failed 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: damaged 2024-03-19T06:07:13.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: stopped 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: data_pools [3] 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: metadata_pool 2 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: inline_data enabled 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: balancer 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: bal_rank_mask -1 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: standby_count_wanted 1 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: [mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: [mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: Standby daemons: 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: [mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout: [mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:07:13.104 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: mon.smithi072@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-03-19T06:07:13.105 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: mon.smithi072@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-03-19T06:07:13.105 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: mon.smithi072@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-03-19T06:07:13.105 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: mon.smithi072@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-03-19T06:07:13.105 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 ceph-mon[78545]: mon.smithi072@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-03-19T06:07:13.105 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 bash[78527]: f8806c6c6e84a69cb23a6e37e6d806b4c961d406ea5bbd016e57616e5c5825ec 2024-03-19T06:07:13.105 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:12 smithi072 systemd[1]: Started Ceph mon.smithi072 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:07:13.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T06:07:13.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: pgmap v62: 65 pgs: 65 active+clean; 344 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 86 op/s 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: pgmap v63: 65 pgs: 65 active+clean; 344 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: mon.smithi072 calling monitor election 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: mon.smithi072 is new leader, mons smithi072,smithi172 in quorum (ranks 0,1) 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: monmap e2: 2 mons at {smithi072=[v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0],smithi172=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: osdmap e47: 6 total, 6 up, 6 in 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: mgrmap e32: smithi072.jydpjk(active, since 2m), standbys: smithi172.qkcahs 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: from='mgr.14702 ' entity='' 2024-03-19T06:07:13.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:13 smithi172 ceph-mon[35716]: mgrmap e33: smithi072.jydpjk(active, since 2m), standbys: smithi172.qkcahs 2024-03-19T06:07:13.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: pgmap v62: 65 pgs: 65 active+clean; 344 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 86 op/s 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: pgmap v63: 65 pgs: 65 active+clean; 344 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: from='mgr.14702 172.21.15.72:0/3554489168' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: mon.smithi072 calling monitor election 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: mon.smithi072 is new leader, mons smithi072,smithi172 in quorum (ranks 0,1) 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: monmap e2: 2 mons at {smithi072=[v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0],smithi172=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: osdmap e47: 6 total, 6 up, 6 in 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: mgrmap e32: smithi072.jydpjk(active, since 2m), standbys: smithi172.qkcahs 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:07:13.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:07:13.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: from='mgr.14702 ' entity='' 2024-03-19T06:07:13.828 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:13 smithi072 ceph-mon[78545]: mgrmap e33: smithi072.jydpjk(active, since 2m), standbys: smithi172.qkcahs 2024-03-19T06:07:20.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.142+0000 7f624d600700 1 -- 172.21.15.72:0/1827487090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100240 msgr2=0x7f6248100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:20.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.142+0000 7f624d600700 1 --2- 172.21.15.72:0/1827487090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100240 0x7f6248100650 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6238009910 tx=0x7f6238009c20 comp rx=0 tx=0).stop 2024-03-19T06:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.142+0000 7f624d600700 1 -- 172.21.15.72:0/1827487090 shutdown_connections 2024-03-19T06:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.142+0000 7f624d600700 1 --2- 172.21.15.72:0/1827487090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6248101440 0x7f6248101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.142+0000 7f624d600700 1 --2- 172.21.15.72:0/1827487090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100240 0x7f6248100650 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.142+0000 7f624d600700 1 -- 172.21.15.72:0/1827487090 >> 172.21.15.72:0/1827487090 conn(0x7f62480fb7f0 msgr2=0x7f62480fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.142+0000 7f624d600700 1 -- 172.21.15.72:0/1827487090 shutdown_connections 2024-03-19T06:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.142+0000 7f624d600700 1 -- 172.21.15.72:0/1827487090 wait complete. 2024-03-19T06:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.144+0000 7f624d600700 1 Processor -- start 2024-03-19T06:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.144+0000 7f624d600700 1 -- start start 2024-03-19T06:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.144+0000 7f624d600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100240 0x7f6248074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.144+0000 7f624d600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6248101440 0x7f6248073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.144+0000 7f624d600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6248073680 con 0x7f6248100240 2024-03-19T06:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.144+0000 7f624d600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62480737c0 con 0x7f6248101440 2024-03-19T06:07:20.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.145+0000 7f6246a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100240 0x7f6248074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:20.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.145+0000 7f6246a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100240 0x7f6248074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56048/0 (socket says 172.21.15.72:56048) 2024-03-19T06:07:20.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.145+0000 7f6246a00700 1 -- 172.21.15.72:0/290028720 learned_addr learned my addr 172.21.15.72:0/290028720 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:07:20.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.145+0000 7f6246000700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6248101440 0x7f6248073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:20.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.145+0000 7f6246a00700 1 -- 172.21.15.72:0/290028720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6248101440 msgr2=0x7f6248073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:20.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.145+0000 7f6246a00700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6248101440 0x7f6248073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:20.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.145+0000 7f6246a00700 1 -- 172.21.15.72:0/290028720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62380095f0 con 0x7f6248100240 2024-03-19T06:07:20.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.145+0000 7f6246a00700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100240 0x7f6248074af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f623800bd70 tx=0x7f623800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:20.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.146+0000 7f623f400700 1 -- 172.21.15.72:0/290028720 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f623801d070 con 0x7f6248100240 2024-03-19T06:07:20.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.146+0000 7f623f400700 1 -- 172.21.15.72:0/290028720 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f623800f460 con 0x7f6248100240 2024-03-19T06:07:20.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.146+0000 7f624d600700 1 -- 172.21.15.72:0/290028720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6248073a40 con 0x7f6248100240 2024-03-19T06:07:20.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.146+0000 7f623f400700 1 -- 172.21.15.72:0/290028720 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6238021620 con 0x7f6248100240 2024-03-19T06:07:20.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.146+0000 7f624d600700 1 -- 172.21.15.72:0/290028720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6248073f30 con 0x7f6248100240 2024-03-19T06:07:20.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.147+0000 7f624d600700 1 -- 172.21.15.72:0/290028720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6248108d90 con 0x7f6248100240 2024-03-19T06:07:20.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.148+0000 7f623f400700 1 -- 172.21.15.72:0/290028720 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 33) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f623800fa40 con 0x7f6248100240 2024-03-19T06:07:20.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.150+0000 7f623f400700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 0x7f622c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.150+0000 7f6246000700 1 -- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 msgr2=0x7f622c070450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2640845307 2024-03-19T06:07:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.150+0000 7f623f400700 1 -- 172.21.15.72:0/290028720 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f623808ef40 con 0x7f6248100240 2024-03-19T06:07:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.151+0000 7f6246000700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 0x7f622c070450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:07:20.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.155+0000 7f623f400700 1 -- 172.21.15.72:0/290028720 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f623805bff0 con 0x7f6248100240 2024-03-19T06:07:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.352+0000 7f6246000700 1 -- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 msgr2=0x7f622c070450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2640845307 2024-03-19T06:07:20.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.352+0000 7f6246000700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 0x7f622c070450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:07:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.473+0000 7f624d600700 1 -- 172.21.15.72:0/290028720 --> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6248105d90 con 0x7f622c06dfa0 2024-03-19T06:07:20.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.753+0000 7f6246000700 1 -- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 msgr2=0x7f622c070450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2640845307 2024-03-19T06:07:20.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:20.753+0000 7f6246000700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 0x7f622c070450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T06:07:21.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:21.554+0000 7f6246000700 1 -- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 msgr2=0x7f622c070450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2640845307 2024-03-19T06:07:21.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:21.554+0000 7f6246000700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 0x7f622c070450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T06:07:23.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:23.155+0000 7f6246000700 1 -- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 msgr2=0x7f622c070450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6800/2640845307 2024-03-19T06:07:23.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:23.155+0000 7f6246000700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 0x7f622c070450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-19T06:07:24.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:24.649+0000 7f623f400700 1 -- 172.21.15.72:0/290028720 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 34) v1 ==== 91466+0+0 (secure 0 0 0) 0x7f6238058890 con 0x7f6248100240 2024-03-19T06:07:24.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:24.649+0000 7f623f400700 1 -- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 msgr2=0x7f622c070450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-19T06:07:24.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:24.649+0000 7f623f400700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 0x7f622c070450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:24.697 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: Active manager daemon smithi072.jydpjk restarted 2024-03-19T06:07:24.697 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: Activating manager daemon smithi072.jydpjk 2024-03-19T06:07:24.697 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: osdmap e48: 6 total, 6 up, 6 in 2024-03-19T06:07:24.697 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: mgrmap e34: smithi072.jydpjk(active, starting, since 0.016044s), standbys: smithi172.qkcahs 2024-03-19T06:07:24.697 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T06:07:24.698 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T06:07:24.698 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:07:24.698 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:07:24.698 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:07:24.698 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.nparnw"}]: dispatch 2024-03-19T06:07:24.698 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi072.jydpjk", "id": "smithi072.jydpjk"}]: dispatch 2024-03-19T06:07:24.698 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi172.qkcahs", "id": "smithi172.qkcahs"}]: dispatch 2024-03-19T06:07:24.698 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T06:07:24.903 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: Active manager daemon smithi072.jydpjk restarted 2024-03-19T06:07:24.904 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: Activating manager daemon smithi072.jydpjk 2024-03-19T06:07:24.904 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: osdmap e48: 6 total, 6 up, 6 in 2024-03-19T06:07:24.904 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: mgrmap e34: smithi072.jydpjk(active, starting, since 0.016044s), standbys: smithi172.qkcahs 2024-03-19T06:07:24.904 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T06:07:24.904 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T06:07:24.904 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:07:24.904 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:07:24.904 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:07:24.904 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.nparnw"}]: dispatch 2024-03-19T06:07:24.904 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi072.jydpjk", "id": "smithi072.jydpjk"}]: dispatch 2024-03-19T06:07:24.905 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr metadata", "who": "smithi172.qkcahs", "id": "smithi172.qkcahs"}]: dispatch 2024-03-19T06:07:24.905 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T06:07:24.905 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T06:07:24.905 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T06:07:24.905 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T06:07:24.905 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T06:07:24.905 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T06:07:24.905 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-19T06:07:24.906 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-19T06:07:24.906 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-19T06:07:25.016 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T06:07:25.016 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T06:07:25.016 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T06:07:25.016 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T06:07:25.016 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T06:07:25.016 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-19T06:07:25.016 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-19T06:07:25.016 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:24 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-19T06:07:25.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.714+0000 7f623f400700 1 -- 172.21.15.72:0/290028720 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 35) v1 ==== 91593+0+0 (secure 0 0 0) 0x7f6238059870 con 0x7f6248100240 2024-03-19T06:07:25.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.714+0000 7f623f400700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f622c01d5a0 0x7f622c077950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:25.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.716+0000 7f623f400700 1 -- 172.21.15.72:0/290028720 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6248105d90 con 0x7f622c01d5a0 2024-03-19T06:07:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.718+0000 7f6246000700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f622c01d5a0 0x7f622c077950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.720+0000 7f6246000700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f622c01d5a0 0x7f622c077950 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6234005950 tx=0x7f62340058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:25.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.727+0000 7f623f400700 1 -- 172.21.15.72:0/290028720 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f6248105d90 con 0x7f622c01d5a0 2024-03-19T06:07:25.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.731+0000 7f624d600700 1 -- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f622c01d5a0 msgr2=0x7f622c077950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:25.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.731+0000 7f624d600700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f622c01d5a0 0x7f622c077950 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6234005950 tx=0x7f62340058e0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.731+0000 7f624d600700 1 -- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100240 msgr2=0x7f6248074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:25.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.731+0000 7f624d600700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100240 0x7f6248074af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f623800bd70 tx=0x7f623800be50 comp rx=0 tx=0).stop 2024-03-19T06:07:25.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.735+0000 7f624d600700 1 -- 172.21.15.72:0/290028720 shutdown_connections 2024-03-19T06:07:25.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.735+0000 7f624d600700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f622c01d5a0 0x7f622c077950 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.735+0000 7f624d600700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:6800/2640845307,v1:172.21.15.72:6801/2640845307] conn(0x7f622c06dfa0 0x7f622c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.735+0000 7f624d600700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6248100240 0x7f6248074af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.735+0000 7f624d600700 1 --2- 172.21.15.72:0/290028720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6248101440 0x7f6248073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.735+0000 7f624d600700 1 -- 172.21.15.72:0/290028720 >> 172.21.15.72:0/290028720 conn(0x7f62480fb7f0 msgr2=0x7f6248104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:25.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.735+0000 7f624d600700 1 -- 172.21.15.72:0/290028720 shutdown_connections 2024-03-19T06:07:25.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.736+0000 7f624d600700 1 -- 172.21.15.72:0/290028720 wait complete. 2024-03-19T06:07:25.758 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:07:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.930+0000 7f1991800700 1 -- 172.21.15.72:0/3999557659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f198c100240 msgr2=0x7f198c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.930+0000 7f1991800700 1 --2- 172.21.15.72:0/3999557659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f198c100240 0x7f198c100650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1978009910 tx=0x7f1978009c20 comp rx=0 tx=0).stop 2024-03-19T06:07:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.930+0000 7f1991800700 1 -- 172.21.15.72:0/3999557659 shutdown_connections 2024-03-19T06:07:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.930+0000 7f1991800700 1 --2- 172.21.15.72:0/3999557659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c101440 0x7f198c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.930+0000 7f1991800700 1 --2- 172.21.15.72:0/3999557659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f198c100240 0x7f198c100650 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.930+0000 7f1991800700 1 -- 172.21.15.72:0/3999557659 >> 172.21.15.72:0/3999557659 conn(0x7f198c0fb7f0 msgr2=0x7f198c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.931+0000 7f1991800700 1 -- 172.21.15.72:0/3999557659 shutdown_connections 2024-03-19T06:07:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.931+0000 7f1991800700 1 -- 172.21.15.72:0/3999557659 wait complete. 2024-03-19T06:07:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.932+0000 7f1991800700 1 Processor -- start 2024-03-19T06:07:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.932+0000 7f1991800700 1 -- start start 2024-03-19T06:07:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.932+0000 7f1991800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f198c100240 0x7f198c195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.932+0000 7f1991800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c101440 0x7f198c195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.932+0000 7f1991800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c196610 con 0x7f198c100240 2024-03-19T06:07:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.932+0000 7f1991800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c196750 con 0x7f198c101440 2024-03-19T06:07:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.933+0000 7f198aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f198c100240 0x7f198c195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.933+0000 7f198a000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c101440 0x7f198c195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.933+0000 7f198aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f198c100240 0x7f198c195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47988/0 (socket says 172.21.15.72:47988) 2024-03-19T06:07:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.933+0000 7f198aa00700 1 -- 172.21.15.72:0/3171023066 learned_addr learned my addr 172.21.15.72:0/3171023066 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:07:25.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.934+0000 7f198a000700 1 -- 172.21.15.72:0/3171023066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f198c100240 msgr2=0x7f198c195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:25.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.934+0000 7f198a000700 1 --2- 172.21.15.72:0/3171023066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f198c100240 0x7f198c195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.934+0000 7f198a000700 1 -- 172.21.15.72:0/3171023066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19780095f0 con 0x7f198c101440 2024-03-19T06:07:25.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.934+0000 7f198a000700 1 --2- 172.21.15.72:0/3171023066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c101440 0x7f198c195ff0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f197c00d8d0 tx=0x7f197c00dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.935+0000 7f1983400700 1 -- 172.21.15.72:0/3171023066 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f197c00f860 con 0x7f198c101440 2024-03-19T06:07:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.935+0000 7f1983400700 1 -- 172.21.15.72:0/3171023066 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f197c00fe70 con 0x7f198c101440 2024-03-19T06:07:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.935+0000 7f1983400700 1 -- 172.21.15.72:0/3171023066 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f197c00e5e0 con 0x7f198c101440 2024-03-19T06:07:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.935+0000 7f1991800700 1 -- 172.21.15.72:0/3171023066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c19b200 con 0x7f198c101440 2024-03-19T06:07:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.935+0000 7f1991800700 1 -- 172.21.15.72:0/3171023066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c19b750 con 0x7f198c101440 2024-03-19T06:07:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.936+0000 7f1991800700 1 -- 172.21.15.72:0/3171023066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c108d90 con 0x7f198c101440 2024-03-19T06:07:25.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.938+0000 7f1983400700 1 -- 172.21.15.72:0/3171023066 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 35) v1 ==== 91585+0+0 (secure 0 0 0) 0x7f197c010460 con 0x7f198c101440 2024-03-19T06:07:25.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.939+0000 7f1983400700 1 --2- 172.21.15.72:0/3171023066 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f197006dcc0 0x7f1970070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:25.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.939+0000 7f1983400700 1 -- 172.21.15.72:0/3171023066 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f197c08d400 con 0x7f198c101440 2024-03-19T06:07:25.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.940+0000 7f198aa00700 1 --2- 172.21.15.72:0/3171023066 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f197006dcc0 0x7f1970070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:25.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.941+0000 7f198aa00700 1 --2- 172.21.15.72:0/3171023066 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f197006dcc0 0x7f1970070170 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1978006010 tx=0x7f197800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:25.938 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: Manager daemon smithi072.jydpjk is now available 2024-03-19T06:07:25.938 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:07:25.938 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:07:25.938 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:07:25.939 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/mirror_snapshot_schedule"}]: dispatch 2024-03-19T06:07:25.939 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/trash_purge_schedule"}]: dispatch 2024-03-19T06:07:25.939 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: from='mgr.? 172.21.15.172:0/2627992582' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/crt"}]: dispatch 2024-03-19T06:07:25.939 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: from='mgr.? 172.21.15.172:0/2627992582' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T06:07:25.939 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: Standby manager daemon smithi172.qkcahs restarted 2024-03-19T06:07:25.939 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: Standby manager daemon smithi172.qkcahs started 2024-03-19T06:07:25.939 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: from='mgr.? 172.21.15.172:0/2627992582' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/key"}]: dispatch 2024-03-19T06:07:25.939 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: from='mgr.? 172.21.15.172:0/2627992582' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T06:07:25.939 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: [19/Mar/2024:06:07:25] ENGINE Bus STARTING 2024-03-19T06:07:25.939 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:25 smithi072 ceph-mon[78545]: [19/Mar/2024:06:07:25] ENGINE Serving on http://172.21.15.72:8765 2024-03-19T06:07:25.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:25.949+0000 7f1983400700 1 -- 172.21.15.72:0/3171023066 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f197c056c80 con 0x7f198c101440 2024-03-19T06:07:26.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: Manager daemon smithi072.jydpjk is now available 2024-03-19T06:07:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:07:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:07:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:07:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/mirror_snapshot_schedule"}]: dispatch 2024-03-19T06:07:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi072.jydpjk/trash_purge_schedule"}]: dispatch 2024-03-19T06:07:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/2627992582' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/crt"}]: dispatch 2024-03-19T06:07:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/2627992582' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-19T06:07:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: Standby manager daemon smithi172.qkcahs restarted 2024-03-19T06:07:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: Standby manager daemon smithi172.qkcahs started 2024-03-19T06:07:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/2627992582' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.qkcahs/key"}]: dispatch 2024-03-19T06:07:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: from='mgr.? 172.21.15.172:0/2627992582' entity='mgr.smithi172.qkcahs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-19T06:07:26.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: [19/Mar/2024:06:07:25] ENGINE Bus STARTING 2024-03-19T06:07:26.156 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:25 smithi172 ceph-mon[35716]: [19/Mar/2024:06:07:25] ENGINE Serving on http://172.21.15.72:8765 2024-03-19T06:07:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.290+0000 7f1991800700 1 -- 172.21.15.72:0/3171023066 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f198c19bea0 con 0x7f197006dcc0 2024-03-19T06:07:26.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.291+0000 7f1983400700 1 -- 172.21.15.72:0/3171023066 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f198c19bea0 con 0x7f197006dcc0 2024-03-19T06:07:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.294+0000 7f1991800700 1 -- 172.21.15.72:0/3171023066 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f197006dcc0 msgr2=0x7f1970070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.294+0000 7f1991800700 1 --2- 172.21.15.72:0/3171023066 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f197006dcc0 0x7f1970070170 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1978006010 tx=0x7f197800b540 comp rx=0 tx=0).stop 2024-03-19T06:07:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.294+0000 7f1991800700 1 -- 172.21.15.72:0/3171023066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c101440 msgr2=0x7f198c195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.294+0000 7f1991800700 1 --2- 172.21.15.72:0/3171023066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c101440 0x7f198c195ff0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f197c00d8d0 tx=0x7f197c00dbe0 comp rx=0 tx=0).stop 2024-03-19T06:07:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.295+0000 7f1991800700 1 -- 172.21.15.72:0/3171023066 shutdown_connections 2024-03-19T06:07:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.295+0000 7f1991800700 1 --2- 172.21.15.72:0/3171023066 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f197006dcc0 0x7f1970070170 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.295+0000 7f1991800700 1 --2- 172.21.15.72:0/3171023066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f198c100240 0x7f198c195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.295+0000 7f1991800700 1 --2- 172.21.15.72:0/3171023066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c101440 0x7f198c195ff0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.295+0000 7f1991800700 1 -- 172.21.15.72:0/3171023066 >> 172.21.15.72:0/3171023066 conn(0x7f198c0fb7f0 msgr2=0x7f198c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.295+0000 7f1991800700 1 -- 172.21.15.72:0/3171023066 shutdown_connections 2024-03-19T06:07:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.295+0000 7f1991800700 1 -- 172.21.15.72:0/3171023066 wait complete. 2024-03-19T06:07:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.474+0000 7fb0aa200700 1 -- 172.21.15.72:0/941559054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0a4101440 msgr2=0x7fb0a4101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.474+0000 7fb0aa200700 1 --2- 172.21.15.72:0/941559054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0a4101440 0x7fb0a4101890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009910 tx=0x7fb08c009c20 comp rx=0 tx=0).stop 2024-03-19T06:07:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.475+0000 7fb0aa200700 1 -- 172.21.15.72:0/941559054 shutdown_connections 2024-03-19T06:07:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.475+0000 7fb0aa200700 1 --2- 172.21.15.72:0/941559054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0a4101440 0x7fb0a4101890 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.475+0000 7fb0aa200700 1 --2- 172.21.15.72:0/941559054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a4100240 0x7fb0a4100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.475+0000 7fb0aa200700 1 -- 172.21.15.72:0/941559054 >> 172.21.15.72:0/941559054 conn(0x7fb0a40fb7f0 msgr2=0x7fb0a40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.476+0000 7fb0aa200700 1 -- 172.21.15.72:0/941559054 shutdown_connections 2024-03-19T06:07:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.476+0000 7fb0aa200700 1 -- 172.21.15.72:0/941559054 wait complete. 2024-03-19T06:07:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.477+0000 7fb0aa200700 1 Processor -- start 2024-03-19T06:07:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.477+0000 7fb0aa200700 1 -- start start 2024-03-19T06:07:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.477+0000 7fb0aa200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a4100240 0x7fb0a4197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.477+0000 7fb0aa200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0a4101440 0x7fb0a41981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.477+0000 7fb0aa200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a41987d0 con 0x7fb0a4101440 2024-03-19T06:07:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.477+0000 7fb0aa200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a4198940 con 0x7fb0a4100240 2024-03-19T06:07:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.478+0000 7fb0a2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0a4101440 0x7fb0a41981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.478+0000 7fb0a2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0a4101440 0x7fb0a41981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48006/0 (socket says 172.21.15.72:48006) 2024-03-19T06:07:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.478+0000 7fb0a3400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a4100240 0x7fb0a4197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.478+0000 7fb0a2a00700 1 -- 172.21.15.72:0/2258427265 learned_addr learned my addr 172.21.15.72:0/2258427265 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:07:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.478+0000 7fb0a2a00700 1 -- 172.21.15.72:0/2258427265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a4100240 msgr2=0x7fb0a4197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.478+0000 7fb0a2a00700 1 --2- 172.21.15.72:0/2258427265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a4100240 0x7fb0a4197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.478+0000 7fb0a2a00700 1 -- 172.21.15.72:0/2258427265 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0095f0 con 0x7fb0a4101440 2024-03-19T06:07:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.479+0000 7fb0a2a00700 1 --2- 172.21.15.72:0/2258427265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0a4101440 0x7fb0a41981d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb08c000c00 tx=0x7fb08c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.479+0000 7fb09be00700 1 -- 172.21.15.72:0/2258427265 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08c01d070 con 0x7fb0a4101440 2024-03-19T06:07:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.479+0000 7fb0aa200700 1 -- 172.21.15.72:0/2258427265 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a419d370 con 0x7fb0a4101440 2024-03-19T06:07:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.479+0000 7fb09be00700 1 -- 172.21.15.72:0/2258427265 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb08c005dc0 con 0x7fb0a4101440 2024-03-19T06:07:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.479+0000 7fb09be00700 1 -- 172.21.15.72:0/2258427265 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08c0226a0 con 0x7fb0a4101440 2024-03-19T06:07:26.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.479+0000 7fb0aa200700 1 -- 172.21.15.72:0/2258427265 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a419d860 con 0x7fb0a4101440 2024-03-19T06:07:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.482+0000 7fb0aa200700 1 -- 172.21.15.72:0/2258427265 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a4105520 con 0x7fb0a4101440 2024-03-19T06:07:26.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.483+0000 7fb09be00700 1 -- 172.21.15.72:0/2258427265 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 35) v1 ==== 91593+0+0 (secure 0 0 0) 0x7fb08c017400 con 0x7fb0a4101440 2024-03-19T06:07:26.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.484+0000 7fb09be00700 1 --2- 172.21.15.72:0/2258427265 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb08806dcc0 0x7fb088070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:26.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.484+0000 7fb09be00700 1 -- 172.21.15.72:0/2258427265 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb08c08ed10 con 0x7fb0a4101440 2024-03-19T06:07:26.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.485+0000 7fb0a3400700 1 --2- 172.21.15.72:0/2258427265 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb08806dcc0 0x7fb088070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.486+0000 7fb0a3400700 1 --2- 172.21.15.72:0/2258427265 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb08806dcc0 0x7fb088070170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4198b70 tx=0x7fb09400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:26.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.492+0000 7fb09be00700 1 -- 172.21.15.72:0/2258427265 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fb08c05c040 con 0x7fb0a4101440 2024-03-19T06:07:26.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.726+0000 7fb09be00700 1 -- 172.21.15.72:0/2258427265 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 36) v1 ==== 91887+0+0 (secure 0 0 0) 0x7fb08c0039a0 con 0x7fb0a4101440 2024-03-19T06:07:26.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.845+0000 7fb0aa200700 1 -- 172.21.15.72:0/2258427265 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0a4061190 con 0x7fb08806dcc0 2024-03-19T06:07:26.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.870+0000 7fb09be00700 1 -- 172.21.15.72:0/2258427265 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fb0a4061190 con 0x7fb08806dcc0 2024-03-19T06:07:26.863 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:07:26.863 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (11m) 43s ago 13m 14.1M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:07:26.863 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (14m) 43s ago 14m 7956k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:07:26.863 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (12m) 46s ago 12m 7818k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:07:26.863 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (14m) 43s ago 14m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:07:26.863 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (12m) 46s ago 12m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:07:26.863 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (11m) 43s ago 13m 74.3M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:07:26.863 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (6m) 43s ago 6m 14.7M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (6m) 43s ago 6m 175M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (6m) 46s ago 6m 14.6M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (6m) 46s ago 6m 194M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (2m) 43s ago 15m 492M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (52s) 46s ago 12m 63.0M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (15m) 43s ago 16m 54.9M 2048M 18.2.0 dc2bc1663786 77289e9e2b33 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (12m) 46s ago 12m 42.3M 2048M 18.2.0 dc2bc1663786 31fba31e7d8a 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (14m) 43s ago 14m 7662k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (12m) 46s ago 12m 7914k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (11m) 43s ago 11m 200M 1216M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (10m) 43s ago 10m 197M 1216M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (10m) 43s ago 10m 157M 1216M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (9m) 46s ago 9m 212M 2241M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:07:26.864 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (8m) 46s ago 8m 181M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:07:26.865 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (8m) 46s ago 8m 200M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:07:26.865 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (65s) 43s ago 13m 48.2M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:07:26.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.873+0000 7fb0aa200700 1 -- 172.21.15.72:0/2258427265 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb08806dcc0 msgr2=0x7fb088070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:26.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.873+0000 7fb0aa200700 1 --2- 172.21.15.72:0/2258427265 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb08806dcc0 0x7fb088070170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4198b70 tx=0x7fb09400b040 comp rx=0 tx=0).stop 2024-03-19T06:07:26.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.873+0000 7fb0aa200700 1 -- 172.21.15.72:0/2258427265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0a4101440 msgr2=0x7fb0a41981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:26.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.873+0000 7fb0aa200700 1 --2- 172.21.15.72:0/2258427265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0a4101440 0x7fb0a41981d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb08c000c00 tx=0x7fb08c00f690 comp rx=0 tx=0).stop 2024-03-19T06:07:26.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.874+0000 7fb0aa200700 1 -- 172.21.15.72:0/2258427265 shutdown_connections 2024-03-19T06:07:26.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.874+0000 7fb0aa200700 1 --2- 172.21.15.72:0/2258427265 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb08806dcc0 0x7fb088070170 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:26.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.874+0000 7fb0aa200700 1 --2- 172.21.15.72:0/2258427265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a4100240 0x7fb0a4197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:26.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.874+0000 7fb0aa200700 1 --2- 172.21.15.72:0/2258427265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0a4101440 0x7fb0a41981d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:26.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.874+0000 7fb0aa200700 1 -- 172.21.15.72:0/2258427265 >> 172.21.15.72:0/2258427265 conn(0x7fb0a40fb7f0 msgr2=0x7fb0a4102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:26.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.875+0000 7fb0aa200700 1 -- 172.21.15.72:0/2258427265 shutdown_connections 2024-03-19T06:07:26.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:26.875+0000 7fb0aa200700 1 -- 172.21.15.72:0/2258427265 wait complete. 2024-03-19T06:07:27.031 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:26 smithi072 ceph-mon[78545]: [19/Mar/2024:06:07:25] ENGINE Serving on https://172.21.15.72:7150 2024-03-19T06:07:27.031 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:26 smithi072 ceph-mon[78545]: [19/Mar/2024:06:07:25] ENGINE Bus STARTED 2024-03-19T06:07:27.031 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:26 smithi072 ceph-mon[78545]: mgrmap e35: smithi072.jydpjk(active, since 1.08436s), standbys: smithi172.qkcahs 2024-03-19T06:07:27.031 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:26 smithi072 ceph-mon[78545]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:07:27.031 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:26 smithi072 ceph-mon[78545]: pgmap v3: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:07:27.031 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:26 smithi072 ceph-mon[78545]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:07:27.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.044+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2622693393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc073750 msgr2=0x7fe1bc073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:27.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.044+0000 7fe1c3c00700 1 --2- 172.21.15.72:0/2622693393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc073750 0x7fe1bc073bc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009910 tx=0x7fe1a8009c20 comp rx=0 tx=0).stop 2024-03-19T06:07:27.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.045+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2622693393 shutdown_connections 2024-03-19T06:07:27.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.045+0000 7fe1c3c00700 1 --2- 172.21.15.72:0/2622693393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc073750 0x7fe1bc073bc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.045+0000 7fe1c3c00700 1 --2- 172.21.15.72:0/2622693393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc074d20 0x7fe1bc073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.045+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2622693393 >> 172.21.15.72:0/2622693393 conn(0x7fe1bc0fb7f0 msgr2=0x7fe1bc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:27.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.045+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2622693393 shutdown_connections 2024-03-19T06:07:27.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.045+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2622693393 wait complete. 2024-03-19T06:07:27.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.046+0000 7fe1c3c00700 1 Processor -- start 2024-03-19T06:07:27.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.047+0000 7fe1c3c00700 1 -- start start 2024-03-19T06:07:27.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.047+0000 7fe1c3c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc073750 0x7fe1bc197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:27.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.047+0000 7fe1c3c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc074d20 0x7fe1bc1981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:27.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.047+0000 7fe1c3c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc1987b0 con 0x7fe1bc074d20 2024-03-19T06:07:27.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.047+0000 7fe1c3c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc198920 con 0x7fe1bc073750 2024-03-19T06:07:27.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.047+0000 7fe1bbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc074d20 0x7fe1bc1981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:27.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.048+0000 7fe1bbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc074d20 0x7fe1bc1981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48030/0 (socket says 172.21.15.72:48030) 2024-03-19T06:07:27.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.048+0000 7fe1bbe00700 1 -- 172.21.15.72:0/2559171998 learned_addr learned my addr 172.21.15.72:0/2559171998 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:07:27.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.048+0000 7fe1c1200700 1 --2- 172.21.15.72:0/2559171998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc073750 0x7fe1bc197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:27.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.048+0000 7fe1bbe00700 1 -- 172.21.15.72:0/2559171998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc073750 msgr2=0x7fe1bc197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:27.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.048+0000 7fe1bbe00700 1 --2- 172.21.15.72:0/2559171998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc073750 0x7fe1bc197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.048+0000 7fe1bbe00700 1 -- 172.21.15.72:0/2559171998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a80095f0 con 0x7fe1bc074d20 2024-03-19T06:07:27.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.048+0000 7fe1c1200700 1 --2- 172.21.15.72:0/2559171998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc073750 0x7fe1bc197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:07:27.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.049+0000 7fe1bbe00700 1 --2- 172.21.15.72:0/2559171998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc074d20 0x7fe1bc1981b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8005b40 tx=0x7fe1a800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:27.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.049+0000 7fe1b9600700 1 -- 172.21.15.72:0/2559171998 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1a801d070 con 0x7fe1bc074d20 2024-03-19T06:07:27.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.049+0000 7fe1b9600700 1 -- 172.21.15.72:0/2559171998 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe1a800f460 con 0x7fe1bc074d20 2024-03-19T06:07:27.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.049+0000 7fe1b9600700 1 -- 172.21.15.72:0/2559171998 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1a8021620 con 0x7fe1bc074d20 2024-03-19T06:07:27.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.049+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2559171998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1bc19d350 con 0x7fe1bc074d20 2024-03-19T06:07:27.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.049+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2559171998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1bc19d840 con 0x7fe1bc074d20 2024-03-19T06:07:27.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.051+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2559171998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1bc10af80 con 0x7fe1bc074d20 2024-03-19T06:07:27.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.052+0000 7fe1b9600700 1 -- 172.21.15.72:0/2559171998 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 91887+0+0 (secure 0 0 0) 0x7fe1a800fa40 con 0x7fe1bc074d20 2024-03-19T06:07:27.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.053+0000 7fe1b9600700 1 --2- 172.21.15.72:0/2559171998 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe1a406e090 0x7fe1a4070540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:27.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.053+0000 7fe1b9600700 1 -- 172.21.15.72:0/2559171998 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe1a808f460 con 0x7fe1bc074d20 2024-03-19T06:07:27.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.054+0000 7fe1c1200700 1 --2- 172.21.15.72:0/2559171998 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe1a406e090 0x7fe1a4070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:27.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.055+0000 7fe1c1200700 1 --2- 172.21.15.72:0/2559171998 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe1a406e090 0x7fe1a4070540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc198b50 tx=0x7fe1b000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:27.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.060+0000 7fe1b9600700 1 -- 172.21.15.72:0/2559171998 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fe1a8058880 con 0x7fe1bc074d20 2024-03-19T06:07:27.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:26 smithi172 ceph-mon[35716]: [19/Mar/2024:06:07:25] ENGINE Serving on https://172.21.15.72:7150 2024-03-19T06:07:27.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:26 smithi172 ceph-mon[35716]: [19/Mar/2024:06:07:25] ENGINE Bus STARTED 2024-03-19T06:07:27.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:26 smithi172 ceph-mon[35716]: mgrmap e35: smithi072.jydpjk(active, since 1.08436s), standbys: smithi172.qkcahs 2024-03-19T06:07:27.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:26 smithi172 ceph-mon[35716]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:07:27.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:26 smithi172 ceph-mon[35716]: pgmap v3: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:07:27.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:26 smithi172 ceph-mon[35716]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:07:27.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.508+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2559171998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe1bc10b170 con 0x7fe1bc074d20 2024-03-19T06:07:27.500 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:07:27.500 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 1 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:07:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 11, 2024-03-19T06:07:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 3 2024-03-19T06:07:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:07:27.502 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:07:27.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.509+0000 7fe1b9600700 1 -- 172.21.15.72:0/2559171998 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+779 (secure 0 0 0) 0x7fe1a805bf40 con 0x7fe1bc074d20 2024-03-19T06:07:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.513+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2559171998 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe1a406e090 msgr2=0x7fe1a4070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.513+0000 7fe1c3c00700 1 --2- 172.21.15.72:0/2559171998 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe1a406e090 0x7fe1a4070540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc198b50 tx=0x7fe1b000b410 comp rx=0 tx=0).stop 2024-03-19T06:07:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.513+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2559171998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc074d20 msgr2=0x7fe1bc1981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.513+0000 7fe1c3c00700 1 --2- 172.21.15.72:0/2559171998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc074d20 0x7fe1bc1981b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8005b40 tx=0x7fe1a800bd70 comp rx=0 tx=0).stop 2024-03-19T06:07:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.513+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2559171998 shutdown_connections 2024-03-19T06:07:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.513+0000 7fe1c3c00700 1 --2- 172.21.15.72:0/2559171998 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe1a406e090 0x7fe1a4070540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.513+0000 7fe1c3c00700 1 --2- 172.21.15.72:0/2559171998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc073750 0x7fe1bc197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.513+0000 7fe1c3c00700 1 --2- 172.21.15.72:0/2559171998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1bc074d20 0x7fe1bc1981b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.513+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2559171998 >> 172.21.15.72:0/2559171998 conn(0x7fe1bc0fb7f0 msgr2=0x7fe1bc106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.513+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2559171998 shutdown_connections 2024-03-19T06:07:27.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.514+0000 7fe1c3c00700 1 -- 172.21.15.72:0/2559171998 wait complete. 2024-03-19T06:07:27.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.710+0000 7f9fcb600700 1 -- 172.21.15.72:0/2921258290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4100240 msgr2=0x7f9fc4100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:27.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.710+0000 7f9fcb600700 1 --2- 172.21.15.72:0/2921258290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4100240 0x7f9fc4100650 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400b0a0 tx=0x7f9fb400b3b0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.710+0000 7f9fcb600700 1 -- 172.21.15.72:0/2921258290 shutdown_connections 2024-03-19T06:07:27.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.710+0000 7f9fcb600700 1 --2- 172.21.15.72:0/2921258290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc4101440 0x7f9fc4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.710+0000 7f9fcb600700 1 --2- 172.21.15.72:0/2921258290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4100240 0x7f9fc4100650 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.710+0000 7f9fcb600700 1 -- 172.21.15.72:0/2921258290 >> 172.21.15.72:0/2921258290 conn(0x7f9fc40fb7f0 msgr2=0x7f9fc40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:27.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.711+0000 7f9fcb600700 1 -- 172.21.15.72:0/2921258290 shutdown_connections 2024-03-19T06:07:27.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.711+0000 7f9fcb600700 1 -- 172.21.15.72:0/2921258290 wait complete. 2024-03-19T06:07:27.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.712+0000 7f9fcb600700 1 Processor -- start 2024-03-19T06:07:27.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.713+0000 7f9fcb600700 1 -- start start 2024-03-19T06:07:27.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.713+0000 7f9fcb600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc4100240 0x7f9fc41938f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:27.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.713+0000 7f9fcb600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4101440 0x7f9fc4193e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:27.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.713+0000 7f9fcb600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc4194450 con 0x7f9fc4100240 2024-03-19T06:07:27.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.713+0000 7f9fcb600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc4194590 con 0x7f9fc4101440 2024-03-19T06:07:27.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.714+0000 7f9fbbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4101440 0x7f9fc4193e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:27.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.714+0000 7f9fc8c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc4100240 0x7f9fc41938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:27.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.714+0000 7f9fc8c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc4100240 0x7f9fc41938f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48046/0 (socket says 172.21.15.72:48046) 2024-03-19T06:07:27.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.714+0000 7f9fc8c00700 1 -- 172.21.15.72:0/2354247632 learned_addr learned my addr 172.21.15.72:0/2354247632 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:07:27.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.715+0000 7f9fbbe00700 1 -- 172.21.15.72:0/2354247632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc4100240 msgr2=0x7f9fc41938f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:27.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.715+0000 7f9fbbe00700 1 --2- 172.21.15.72:0/2354247632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc4100240 0x7f9fc41938f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.715+0000 7f9fbbe00700 1 -- 172.21.15.72:0/2354247632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb4009d00 con 0x7f9fc4101440 2024-03-19T06:07:27.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.715+0000 7f9fbbe00700 1 --2- 172.21.15.72:0/2354247632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4101440 0x7f9fc4193e30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00d8d0 tx=0x7f9fac00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:27.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.716+0000 7f9fc2000700 1 -- 172.21.15.72:0/2354247632 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fac009900 con 0x7f9fc4101440 2024-03-19T06:07:27.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.716+0000 7f9fcb600700 1 -- 172.21.15.72:0/2354247632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc4199040 con 0x7f9fc4101440 2024-03-19T06:07:27.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.716+0000 7f9fcb600700 1 -- 172.21.15.72:0/2354247632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc4199560 con 0x7f9fc4101440 2024-03-19T06:07:27.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.716+0000 7f9fc2000700 1 -- 172.21.15.72:0/2354247632 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9fac010460 con 0x7f9fc4101440 2024-03-19T06:07:27.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.716+0000 7f9fc2000700 1 -- 172.21.15.72:0/2354247632 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fac009900 con 0x7f9fc4101440 2024-03-19T06:07:27.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.718+0000 7f9fcb600700 1 -- 172.21.15.72:0/2354247632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa0005320 con 0x7f9fc4101440 2024-03-19T06:07:27.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.720+0000 7f9fc2000700 1 -- 172.21.15.72:0/2354247632 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 36) v1 ==== 91879+0+0 (secure 0 0 0) 0x7f9fac009a60 con 0x7f9fc4101440 2024-03-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.721+0000 7f9fc2000700 1 --2- 172.21.15.72:0/2354247632 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9fa80724a0 0x7f9fa8074950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:27.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.721+0000 7f9fc2000700 1 -- 172.21.15.72:0/2354247632 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9fac08d480 con 0x7f9fc4101440 2024-03-19T06:07:27.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.722+0000 7f9fc8c00700 1 --2- 172.21.15.72:0/2354247632 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9fa80724a0 0x7f9fa8074950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:27.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.723+0000 7f9fc8c00700 1 --2- 172.21.15.72:0/2354247632 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9fa80724a0 0x7f9fa8074950 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009480 tx=0x7f9fb400b7f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:27.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:27.732+0000 7f9fc2000700 1 -- 172.21.15.72:0/2354247632 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f9fac05a3d0 con 0x7f9fc4101440 2024-03-19T06:07:27.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:27 smithi072 ceph-mon[78545]: pgmap v4: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:07:27.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:27 smithi072 ceph-mon[78545]: mgrmap e36: smithi072.jydpjk(active, since 2s), standbys: smithi172.qkcahs 2024-03-19T06:07:27.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:27 smithi072 ceph-mon[78545]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:07:27.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:27 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2559171998' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:07:27.980 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:27 smithi172 ceph-mon[35716]: pgmap v4: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:07:27.980 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:27 smithi172 ceph-mon[35716]: mgrmap e36: smithi072.jydpjk(active, since 2s), standbys: smithi172.qkcahs 2024-03-19T06:07:27.980 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:27 smithi172 ceph-mon[35716]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:07:27.980 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:27 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2559171998' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:07:28.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.060+0000 7f9fcb600700 1 -- 172.21.15.72:0/2354247632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9fa0005cc0 con 0x7f9fc4101440 2024-03-19T06:07:28.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.061+0000 7f9fc2000700 1 -- 172.21.15.72:0/2354247632 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1865 (secure 0 0 0) 0x7f9fac021760 con 0x7f9fc4101440 2024-03-19T06:07:28.053 INFO:teuthology.orchestra.run.smithi072.stdout:e15 2024-03-19T06:07:28.053 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:07:28.053 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:07:28.053 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:07:28.053 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 15 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:04:57.207619+0000 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:07:28.054 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:07:28.055 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:07:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:07:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:07:28.056 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:07:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:07:28.056 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:07:28.056 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:07:28.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.064+0000 7f9fcb600700 1 -- 172.21.15.72:0/2354247632 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9fa80724a0 msgr2=0x7f9fa8074950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.064+0000 7f9fcb600700 1 --2- 172.21.15.72:0/2354247632 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9fa80724a0 0x7f9fa8074950 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009480 tx=0x7f9fb400b7f0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.064+0000 7f9fcb600700 1 -- 172.21.15.72:0/2354247632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4101440 msgr2=0x7f9fc4193e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.064+0000 7f9fcb600700 1 --2- 172.21.15.72:0/2354247632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4101440 0x7f9fc4193e30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00d8d0 tx=0x7f9fac00dc90 comp rx=0 tx=0).stop 2024-03-19T06:07:28.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.064+0000 7f9fcb600700 1 -- 172.21.15.72:0/2354247632 shutdown_connections 2024-03-19T06:07:28.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.064+0000 7f9fcb600700 1 --2- 172.21.15.72:0/2354247632 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9fa80724a0 0x7f9fa8074950 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.064+0000 7f9fcb600700 1 --2- 172.21.15.72:0/2354247632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fc4100240 0x7f9fc41938f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.064+0000 7f9fcb600700 1 --2- 172.21.15.72:0/2354247632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4101440 0x7f9fc4193e30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.064+0000 7f9fcb600700 1 -- 172.21.15.72:0/2354247632 >> 172.21.15.72:0/2354247632 conn(0x7f9fc40fb7f0 msgr2=0x7f9fc4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:28.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.065+0000 7f9fcb600700 1 -- 172.21.15.72:0/2354247632 shutdown_connections 2024-03-19T06:07:28.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.065+0000 7f9fcb600700 1 -- 172.21.15.72:0/2354247632 wait complete. 2024-03-19T06:07:28.058 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2024-03-19T06:07:28.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.272+0000 7f3b8e800700 1 -- 172.21.15.72:0/22806088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b88100240 msgr2=0x7f3b88100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.272+0000 7f3b8e800700 1 --2- 172.21.15.72:0/22806088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b88100240 0x7f3b88100650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009910 tx=0x7f3b78009c20 comp rx=0 tx=0).stop 2024-03-19T06:07:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.273+0000 7f3b8e800700 1 -- 172.21.15.72:0/22806088 shutdown_connections 2024-03-19T06:07:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.273+0000 7f3b8e800700 1 --2- 172.21.15.72:0/22806088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b88101440 0x7f3b88101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.273+0000 7f3b8e800700 1 --2- 172.21.15.72:0/22806088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b88100240 0x7f3b88100650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.273+0000 7f3b8e800700 1 -- 172.21.15.72:0/22806088 >> 172.21.15.72:0/22806088 conn(0x7f3b880fb7f0 msgr2=0x7f3b880fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:28.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.273+0000 7f3b8e800700 1 -- 172.21.15.72:0/22806088 shutdown_connections 2024-03-19T06:07:28.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.273+0000 7f3b8e800700 1 -- 172.21.15.72:0/22806088 wait complete. 2024-03-19T06:07:28.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.274+0000 7f3b8e800700 1 Processor -- start 2024-03-19T06:07:28.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.274+0000 7f3b8e800700 1 -- start start 2024-03-19T06:07:28.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.275+0000 7f3b8e800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b88100240 0x7f3b88195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:28.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.275+0000 7f3b8e800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b88101440 0x7f3b88195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:28.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.275+0000 7f3b8e800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88196610 con 0x7f3b88101440 2024-03-19T06:07:28.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.275+0000 7f3b8e800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88196750 con 0x7f3b88100240 2024-03-19T06:07:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.275+0000 7f3b87400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b88100240 0x7f3b88195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.275+0000 7f3b86a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b88101440 0x7f3b88195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.275+0000 7f3b87400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b88100240 0x7f3b88195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:60124/0 (socket says 172.21.15.72:60124) 2024-03-19T06:07:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.275+0000 7f3b87400700 1 -- 172.21.15.72:0/1965366430 learned_addr learned my addr 172.21.15.72:0/1965366430 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:07:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.276+0000 7f3b87400700 1 -- 172.21.15.72:0/1965366430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b88101440 msgr2=0x7f3b88195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.276+0000 7f3b87400700 1 --2- 172.21.15.72:0/1965366430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b88101440 0x7f3b88195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.276+0000 7f3b87400700 1 -- 172.21.15.72:0/1965366430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b780095f0 con 0x7f3b88100240 2024-03-19T06:07:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.276+0000 7f3b86a00700 1 --2- 172.21.15.72:0/1965366430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b88101440 0x7f3b88195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:07:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.276+0000 7f3b87400700 1 --2- 172.21.15.72:0/1965366430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b88100240 0x7f3b88195ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3b78005b40 tx=0x7f3b7800fab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.276+0000 7f3b7fe00700 1 -- 172.21.15.72:0/1965366430 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b7801d070 con 0x7f3b88100240 2024-03-19T06:07:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.276+0000 7f3b8e800700 1 -- 172.21.15.72:0/1965366430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8819b1a0 con 0x7f3b88100240 2024-03-19T06:07:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.276+0000 7f3b7fe00700 1 -- 172.21.15.72:0/1965366430 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3b78005dc0 con 0x7f3b88100240 2024-03-19T06:07:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.276+0000 7f3b7fe00700 1 -- 172.21.15.72:0/1965366430 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b780226a0 con 0x7f3b88100240 2024-03-19T06:07:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.276+0000 7f3b8e800700 1 -- 172.21.15.72:0/1965366430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8819b690 con 0x7f3b88100240 2024-03-19T06:07:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.278+0000 7f3b8e800700 1 -- 172.21.15.72:0/1965366430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b88108d90 con 0x7f3b88100240 2024-03-19T06:07:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.279+0000 7f3b7fe00700 1 -- 172.21.15.72:0/1965366430 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 36) v1 ==== 91879+0+0 (secure 0 0 0) 0x7f3b78003680 con 0x7f3b88100240 2024-03-19T06:07:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.279+0000 7f3b7fe00700 1 --2- 172.21.15.72:0/1965366430 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3b6c06e040 0x7f3b6c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.280+0000 7f3b7fe00700 1 -- 172.21.15.72:0/1965366430 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3b7808f470 con 0x7f3b88100240 2024-03-19T06:07:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.280+0000 7f3b86a00700 1 --2- 172.21.15.72:0/1965366430 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3b6c06e040 0x7f3b6c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.281+0000 7f3b86a00700 1 --2- 172.21.15.72:0/1965366430 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3b6c06e040 0x7f3b6c0704f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009cb0 tx=0x7f3b74009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.288+0000 7f3b7fe00700 1 -- 172.21.15.72:0/1965366430 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f3b7805c2c0 con 0x7f3b88100240 2024-03-19T06:07:28.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.564+0000 7f3b8e800700 1 -- 172.21.15.72:0/1965366430 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b8819bcd0 con 0x7f3b6c06e040 2024-03-19T06:07:28.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.566+0000 7f3b7fe00700 1 -- 172.21.15.72:0/1965366430 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f3b8819bcd0 con 0x7f3b6c06e040 2024-03-19T06:07:28.557 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:07:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:07:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:07:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:07:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:07:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr" 2024-03-19T06:07:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:07:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "2/23 daemons upgraded", 2024-03-19T06:07:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "", 2024-03-19T06:07:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:07:28.558 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:07:28.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.568+0000 7f3b8e800700 1 -- 172.21.15.72:0/1965366430 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3b6c06e040 msgr2=0x7f3b6c0704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.568+0000 7f3b8e800700 1 --2- 172.21.15.72:0/1965366430 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3b6c06e040 0x7f3b6c0704f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009cb0 tx=0x7f3b74009260 comp rx=0 tx=0).stop 2024-03-19T06:07:28.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.568+0000 7f3b8e800700 1 -- 172.21.15.72:0/1965366430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b88100240 msgr2=0x7f3b88195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.568+0000 7f3b8e800700 1 --2- 172.21.15.72:0/1965366430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b88100240 0x7f3b88195ab0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3b78005b40 tx=0x7f3b7800fab0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.569+0000 7f3b8e800700 1 -- 172.21.15.72:0/1965366430 shutdown_connections 2024-03-19T06:07:28.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.569+0000 7f3b8e800700 1 --2- 172.21.15.72:0/1965366430 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3b6c06e040 0x7f3b6c0704f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.569+0000 7f3b8e800700 1 --2- 172.21.15.72:0/1965366430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b88100240 0x7f3b88195ab0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.569+0000 7f3b8e800700 1 --2- 172.21.15.72:0/1965366430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b88101440 0x7f3b88195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.569+0000 7f3b8e800700 1 -- 172.21.15.72:0/1965366430 >> 172.21.15.72:0/1965366430 conn(0x7f3b880fb7f0 msgr2=0x7f3b88104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:28.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.569+0000 7f3b8e800700 1 -- 172.21.15.72:0/1965366430 shutdown_connections 2024-03-19T06:07:28.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.569+0000 7f3b8e800700 1 -- 172.21.15.72:0/1965366430 wait complete. 2024-03-19T06:07:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.713+0000 7f3c52600700 1 -- 172.21.15.72:0/1121084770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c4c106670 msgr2=0x7f3c4c106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.713+0000 7f3c52600700 1 --2- 172.21.15.72:0/1121084770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c4c106670 0x7f3c4c106a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009910 tx=0x7f3c40009c20 comp rx=0 tx=0).stop 2024-03-19T06:07:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.713+0000 7f3c52600700 1 -- 172.21.15.72:0/1121084770 shutdown_connections 2024-03-19T06:07:28.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.713+0000 7f3c52600700 1 --2- 172.21.15.72:0/1121084770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c4c107870 0x7f3c4c107cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.713+0000 7f3c52600700 1 --2- 172.21.15.72:0/1121084770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c4c106670 0x7f3c4c106a80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.713+0000 7f3c52600700 1 -- 172.21.15.72:0/1121084770 >> 172.21.15.72:0/1121084770 conn(0x7f3c4c075740 msgr2=0x7f3c4c077bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:28.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.713+0000 7f3c52600700 1 -- 172.21.15.72:0/1121084770 shutdown_connections 2024-03-19T06:07:28.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.713+0000 7f3c52600700 1 -- 172.21.15.72:0/1121084770 wait complete. 2024-03-19T06:07:28.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.714+0000 7f3c52600700 1 Processor -- start 2024-03-19T06:07:28.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.714+0000 7f3c52600700 1 -- start start 2024-03-19T06:07:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.714+0000 7f3c52600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c4c106670 0x7f3c4c19bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.715+0000 7f3c52600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c4c107870 0x7f3c4c19c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.715+0000 7f3c52600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c19ca30 con 0x7f3c4c107870 2024-03-19T06:07:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.715+0000 7f3c52600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c19cb70 con 0x7f3c4c106670 2024-03-19T06:07:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.715+0000 7f3c4be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c4c107870 0x7f3c4c19c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.715+0000 7f3c4be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c4c107870 0x7f3c4c19c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48078/0 (socket says 172.21.15.72:48078) 2024-03-19T06:07:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.715+0000 7f3c4be00700 1 -- 172.21.15.72:0/3386536102 learned_addr learned my addr 172.21.15.72:0/3386536102 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:07:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.715+0000 7f3c51200700 1 --2- 172.21.15.72:0/3386536102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c4c106670 0x7f3c4c19bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.716+0000 7f3c4be00700 1 -- 172.21.15.72:0/3386536102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c4c106670 msgr2=0x7f3c4c19bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.716+0000 7f3c4be00700 1 --2- 172.21.15.72:0/3386536102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c4c106670 0x7f3c4c19bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.716+0000 7f3c4be00700 1 -- 172.21.15.72:0/3386536102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c400095f0 con 0x7f3c4c107870 2024-03-19T06:07:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.716+0000 7f3c4be00700 1 --2- 172.21.15.72:0/3386536102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c4c107870 0x7f3c4c19c410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800b4b0 tx=0x7f3c3800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.716+0000 7f3c49600700 1 -- 172.21.15.72:0/3386536102 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c38011800 con 0x7f3c4c107870 2024-03-19T06:07:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.716+0000 7f3c49600700 1 -- 172.21.15.72:0/3386536102 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3c38011e10 con 0x7f3c4c107870 2024-03-19T06:07:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.716+0000 7f3c52600700 1 -- 172.21.15.72:0/3386536102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c1a1620 con 0x7f3c4c107870 2024-03-19T06:07:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.716+0000 7f3c49600700 1 -- 172.21.15.72:0/3386536102 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c3800f2e0 con 0x7f3c4c107870 2024-03-19T06:07:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.717+0000 7f3c52600700 1 -- 172.21.15.72:0/3386536102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c1a1bf0 con 0x7f3c4c107870 2024-03-19T06:07:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.718+0000 7f3c52600700 1 -- 172.21.15.72:0/3386536102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c10f240 con 0x7f3c4c107870 2024-03-19T06:07:28.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.719+0000 7f3c49600700 1 -- 172.21.15.72:0/3386536102 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 91887+0+0 (secure 0 0 0) 0x7f3c38010380 con 0x7f3c4c107870 2024-03-19T06:07:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.720+0000 7f3c49600700 1 --2- 172.21.15.72:0/3386536102 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3c3406e040 0x7f3c340704f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.720+0000 7f3c49600700 1 -- 172.21.15.72:0/3386536102 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3c3808d8a0 con 0x7f3c4c107870 2024-03-19T06:07:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.720+0000 7f3c51200700 1 --2- 172.21.15.72:0/3386536102 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3c3406e040 0x7f3c340704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.721+0000 7f3c51200700 1 --2- 172.21.15.72:0/3386536102 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3c3406e040 0x7f3c340704f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3c40006010 tx=0x7f3c4000b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.725+0000 7f3c49600700 1 -- 172.21.15.72:0/3386536102 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f3c3805a880 con 0x7f3c4c107870 2024-03-19T06:07:28.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:28.751+0000 7f3c49600700 1 -- 172.21.15.72:0/3386536102 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7f3c38057120 con 0x7f3c4c107870 2024-03-19T06:07:28.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:28 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2354247632' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:07:29.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.110+0000 7f3c52600700 1 -- 172.21.15.72:0/3386536102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3c4c10f430 con 0x7f3c4c107870 2024-03-19T06:07:29.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.111+0000 7f3c49600700 1 -- 172.21.15.72:0/3386536102 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f3c38067490 con 0x7f3c4c107870 2024-03-19T06:07:29.102 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:07:29.102 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:07:29.102 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:07:29.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.114+0000 7f3c52600700 1 -- 172.21.15.72:0/3386536102 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3c3406e040 msgr2=0x7f3c340704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:29.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.114+0000 7f3c52600700 1 --2- 172.21.15.72:0/3386536102 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3c3406e040 0x7f3c340704f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3c40006010 tx=0x7f3c4000b560 comp rx=0 tx=0).stop 2024-03-19T06:07:29.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.114+0000 7f3c52600700 1 -- 172.21.15.72:0/3386536102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c4c107870 msgr2=0x7f3c4c19c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:29.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.114+0000 7f3c52600700 1 --2- 172.21.15.72:0/3386536102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c4c107870 0x7f3c4c19c410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800b4b0 tx=0x7f3c3800b7c0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.114+0000 7f3c52600700 1 -- 172.21.15.72:0/3386536102 shutdown_connections 2024-03-19T06:07:29.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.114+0000 7f3c52600700 1 --2- 172.21.15.72:0/3386536102 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3c3406e040 0x7f3c340704f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.114+0000 7f3c52600700 1 --2- 172.21.15.72:0/3386536102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c4c106670 0x7f3c4c19bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.114+0000 7f3c52600700 1 --2- 172.21.15.72:0/3386536102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c4c107870 0x7f3c4c19c410 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.114+0000 7f3c52600700 1 -- 172.21.15.72:0/3386536102 >> 172.21.15.72:0/3386536102 conn(0x7f3c4c075740 msgr2=0x7f3c4c10aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:29.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.114+0000 7f3c52600700 1 -- 172.21.15.72:0/3386536102 shutdown_connections 2024-03-19T06:07:29.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:29.114+0000 7f3c52600700 1 -- 172.21.15.72:0/3386536102 wait complete. 2024-03-19T06:07:29.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:28 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/2354247632' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:07:30.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:29 smithi072 ceph-mon[78545]: from='client.24549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:07:30.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:29 smithi072 ceph-mon[78545]: pgmap v5: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:07:30.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:29 smithi072 ceph-mon[78545]: mgrmap e37: smithi072.jydpjk(active, since 4s), standbys: smithi172.qkcahs 2024-03-19T06:07:30.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:29 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3386536102' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:07:30.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:29 smithi172 ceph-mon[35716]: from='client.24549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:07:30.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:29 smithi172 ceph-mon[35716]: pgmap v5: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:07:30.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:29 smithi172 ceph-mon[35716]: mgrmap e37: smithi072.jydpjk(active, since 4s), standbys: smithi172.qkcahs 2024-03-19T06:07:30.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:29 smithi172 ceph-mon[35716]: from='client.? 172.21.15.72:0/3386536102' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:07:32.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:32 smithi072 ceph-mon[78545]: pgmap v6: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:07:32.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:32.711 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:32 smithi172 ceph-mon[35716]: pgmap v6: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:07:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:32 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:32 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:34.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:34 smithi172 ceph-mon[35716]: pgmap v7: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 57 KiB/s rd, 1.3 MiB/s wr, 125 op/s 2024-03-19T06:07:34.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:34 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:34.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:34 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:34.820 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:34 smithi072 ceph-mon[78545]: pgmap v7: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 57 KiB/s rd, 1.3 MiB/s wr, 125 op/s 2024-03-19T06:07:34.820 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:34.820 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:36.235 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:36 smithi172 ceph-mon[35716]: pgmap v8: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1011 KiB/s wr, 97 op/s 2024-03-19T06:07:36.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:36 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:36.236 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:36 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:36.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:36 smithi072 ceph-mon[78545]: pgmap v8: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 1011 KiB/s wr, 97 op/s 2024-03-19T06:07:36.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:36.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:38.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:38 smithi072 ceph-mon[78545]: pgmap v9: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 52 KiB/s rd, 1.7 MiB/s wr, 125 op/s 2024-03-19T06:07:38.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:38 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:38.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:38 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:38.497 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:38 smithi172 ceph-mon[35716]: pgmap v9: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 52 KiB/s rd, 1.7 MiB/s wr, 125 op/s 2024-03-19T06:07:38.497 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:38 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:38.497 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:38 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:39.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:39.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:39.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:07:39.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:07:39.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:39 smithi072 ceph-mon[78545]: Updating smithi072:/etc/ceph/ceph.conf 2024-03-19T06:07:39.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:39 smithi072 ceph-mon[78545]: Updating smithi172:/etc/ceph/ceph.conf 2024-03-19T06:07:39.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:39 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:39.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:39 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:39.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:39 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:07:39.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:39 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:07:39.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:39 smithi172 ceph-mon[35716]: Updating smithi072:/etc/ceph/ceph.conf 2024-03-19T06:07:39.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:39 smithi172 ceph-mon[35716]: Updating smithi172:/etc/ceph/ceph.conf 2024-03-19T06:07:40.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:40 smithi072 ceph-mon[78545]: pgmap v10: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 1.5 MiB/s wr, 114 op/s 2024-03-19T06:07:40.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:40 smithi072 ceph-mon[78545]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T06:07:40.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:40 smithi072 ceph-mon[78545]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T06:07:40.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:07:40.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:40 smithi172 ceph-mon[35716]: pgmap v10: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 1.5 MiB/s wr, 114 op/s 2024-03-19T06:07:40.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:40 smithi172 ceph-mon[35716]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T06:07:40.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:40 smithi172 ceph-mon[35716]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.conf 2024-03-19T06:07:40.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:40 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:07:41.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:41 smithi072 ceph-mon[78545]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-03-19T06:07:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:41 smithi072 ceph-mon[78545]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-19T06:07:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:41 smithi072 ceph-mon[78545]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T06:07:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:41 smithi072 ceph-mon[78545]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T06:07:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:41 smithi172 ceph-mon[35716]: Updating smithi072:/etc/ceph/ceph.client.admin.keyring 2024-03-19T06:07:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:41 smithi172 ceph-mon[35716]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-03-19T06:07:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:41 smithi172 ceph-mon[35716]: Updating smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T06:07:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:41 smithi172 ceph-mon[35716]: Updating smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/config/ceph.client.admin.keyring 2024-03-19T06:07:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:41 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:41 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:41 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:41 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:41 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:42 smithi072 ceph-mon[78545]: pgmap v11: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 1.5 MiB/s wr, 114 op/s 2024-03-19T06:07:42.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:07:42.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:07:42.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-19T06:07:42.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:42 smithi172 ceph-mon[35716]: pgmap v11: 65 pgs: 65 active+clean; 357 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 1.5 MiB/s wr, 114 op/s 2024-03-19T06:07:42.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:42 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:07:42.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:42 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:07:42.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:42 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-19T06:07:44.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:44 smithi072 ceph-mon[78545]: pgmap v12: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 63 KiB/s rd, 2.1 MiB/s wr, 184 op/s 2024-03-19T06:07:44.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:44.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T06:07:44.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-19T06:07:44.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:07:44.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:44 smithi172 ceph-mon[35716]: pgmap v12: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 63 KiB/s rd, 2.1 MiB/s wr, 184 op/s 2024-03-19T06:07:44.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:44 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:44.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:44 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T06:07:44.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:44 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-19T06:07:44.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:44 smithi172 ceph-mon[35716]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:07:45.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:45 smithi172 ceph-mon[35716]: Upgrade: Updating mon.smithi172 2024-03-19T06:07:45.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:45 smithi172 ceph-mon[35716]: Deploying daemon mon.smithi172 on smithi172 2024-03-19T06:07:45.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:45 smithi072 ceph-mon[78545]: Upgrade: Updating mon.smithi172 2024-03-19T06:07:45.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:45 smithi072 ceph-mon[78545]: Deploying daemon mon.smithi172 on smithi172 2024-03-19T06:07:46.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:46 smithi172 ceph-mon[35716]: pgmap v13: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-03-19T06:07:46.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:46 smithi072 ceph-mon[78545]: pgmap v13: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-03-19T06:07:47.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:46 smithi172 systemd[1]: Stopping Ceph mon.smithi172 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:07:47.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:47 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172[35705]: 2024-03-19T06:07:47.356+0000 7f66f7e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi172 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:07:47.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:47 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172[35705]: 2024-03-19T06:07:47.356+0000 7f66f7e00700 -1 mon.smithi172@1(peon) e2 *** Got Signal Terminated *** 2024-03-19T06:07:47.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:47 smithi172 podman[66527]: 2024-03-19 06:07:47.440639445 +0000 UTC m=+0.227295741 container died 31fba31e7d8a71b74bd306264d6456302e136d46e3ff01fdaedf614d3daebd12 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, ceph=True, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-19T06:07:48.135 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:47 smithi172 podman[66527]: 2024-03-19 06:07:47.918825461 +0000 UTC m=+0.705481802 container cleanup 31fba31e7d8a71b74bd306264d6456302e136d46e3ff01fdaedf614d3daebd12 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0) 2024-03-19T06:07:48.135 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:47 smithi172 bash[66527]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172 2024-03-19T06:07:48.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:48 smithi172 podman[66541]: 2024-03-19 06:07:48.144923862 +0000 UTC m=+0.695478025 container remove 31fba31e7d8a71b74bd306264d6456302e136d46e3ff01fdaedf614d3daebd12 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0) 2024-03-19T06:07:48.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:48 smithi172 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi172.service: Deactivated successfully. 2024-03-19T06:07:48.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:48 smithi172 systemd[1]: Stopped Ceph mon.smithi172 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:07:48.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:48 smithi172 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi172.service: Consumed 17.186s CPU time. 2024-03-19T06:07:49.353 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:48 smithi172 systemd[1]: Starting Ceph mon.smithi172 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:07:49.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 podman[66664]: 2024-03-19 06:07:49.268244009 +0000 UTC m=+0.037111435 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:07:49.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 podman[66664]: 2024-03-19 06:07:49.427581426 +0000 UTC m=+0.196448890 container create 9c31f8ad367b1466910f80900331caf9e8247623f5caa1c2423400ca8c500b00 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.build-date=20240222, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:07:50.071 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 podman[66664]: 2024-03-19 06:07:49.741330416 +0000 UTC m=+0.510197887 container init 9c31f8ad367b1466910f80900331caf9e8247623f5caa1c2423400ca8c500b00 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-19T06:07:50.071 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 podman[66664]: 2024-03-19 06:07:49.755559632 +0000 UTC m=+0.524427066 container start 9c31f8ad367b1466910f80900331caf9e8247623f5caa1c2423400ca8c500b00 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, ceph=True) 2024-03-19T06:07:50.071 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: set uid:gid to 167:167 (ceph:ceph) 2024-03-19T06:07:50.071 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev), process ceph-mon, pid 2 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: pidfile_write: ignore empty --pid-file 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: load: jerasure load: lrc 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: RocksDB version: 7.9.2 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Git sha 0 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Compile date 2024-03-07 05:32:18 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: DB SUMMARY 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: DB Session ID: XSUG0VFPLOW0IYAKY0DK 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: CURRENT file: CURRENT 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: IDENTITY file: IDENTITY 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1383 Bytes 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi172/store.db dir, Total Num: 1, files: 000027.sst 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi172/store.db: 000025.log size: 8030423 ; 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.error_if_exists: 0 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.create_if_missing: 0 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.paranoid_checks: 1 2024-03-19T06:07:50.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-19T06:07:50.073 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-19T06:07:50.073 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-19T06:07:50.073 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.env: 0x559c0b59cb20 2024-03-19T06:07:50.073 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.fs: PosixFileSystem 2024-03-19T06:07:50.073 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.info_log: 0x559c0d8a77c0 2024-03-19T06:07:50.073 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_file_opening_threads: 16 2024-03-19T06:07:50.074 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.statistics: (nil) 2024-03-19T06:07:50.074 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.use_fsync: 0 2024-03-19T06:07:50.074 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_log_file_size: 0 2024-03-19T06:07:50.074 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-19T06:07:50.074 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-19T06:07:50.074 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.keep_log_file_num: 1000 2024-03-19T06:07:50.074 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.recycle_log_file_num: 0 2024-03-19T06:07:50.075 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.allow_fallocate: 1 2024-03-19T06:07:50.075 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.allow_mmap_reads: 0 2024-03-19T06:07:50.075 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.allow_mmap_writes: 0 2024-03-19T06:07:50.075 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.use_direct_reads: 0 2024-03-19T06:07:50.075 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-19T06:07:50.075 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.create_missing_column_families: 0 2024-03-19T06:07:50.075 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.db_log_dir: 2024-03-19T06:07:50.075 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.wal_dir: 2024-03-19T06:07:50.075 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-19T06:07:50.075 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-19T06:07:50.075 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.advise_random_on_open: 1 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.db_write_buffer_size: 0 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.write_buffer_manager: 0x559c0d87b400 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.rate_limiter: (nil) 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.wal_recovery_mode: 2 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.enable_thread_tracking: 0 2024-03-19T06:07:50.076 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.enable_pipelined_write: 0 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.unordered_write: 0 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.row_cache: None 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.wal_filter: None 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.allow_ingest_behind: 0 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.two_write_queues: 0 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.manual_wal_flush: 0 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.wal_compression: 0 2024-03-19T06:07:50.077 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.atomic_flush: 0 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.log_readahead_size: 0 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.best_efforts_recovery: 0 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.allow_data_in_errors: 0 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.db_host_id: __hostname__ 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_background_jobs: 2 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_background_compactions: -1 2024-03-19T06:07:50.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_subcompactions: 1 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_total_wal_size: 0 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_open_files: -1 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bytes_per_sync: 0 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_readahead_size: 0 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_background_flushes: -1 2024-03-19T06:07:50.079 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Compression algorithms supported: 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: kZSTD supported: 0 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: kXpressCompression supported: 0 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: kLZ4HCCompression supported: 1 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: kZlibCompression supported: 1 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: kSnappyCompression supported: 1 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: kLZ4Compression supported: 1 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: kBZip2Compression supported: 0 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi172/store.db/MANIFEST-000010 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.merge_operator: 2024-03-19T06:07:50.080 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_filter: None 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_filter_factory: None 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.sst_partitioner_factory: None 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559c0d8a78e0) 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: cache_index_and_filter_blocks: 1 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: pin_top_level_index_and_filter: 1 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: index_type: 0 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: data_block_index_type: 0 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: index_shortening: 1 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: checksum: 4 2024-03-19T06:07:50.081 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: no_block_cache: 0 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache: 0x559c0d8ad090 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache_name: BinnedLRUCache 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache_options: 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: capacity : 536870912 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: num_shard_bits : 4 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: strict_capacity_limit : 0 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: high_pri_pool_ratio: 0.000 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache_compressed: (nil) 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: persistent_cache: (nil) 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_size: 4096 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_size_deviation: 10 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_restart_interval: 16 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: index_block_restart_interval: 1 2024-03-19T06:07:50.082 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: metadata_block_size: 4096 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: partition_filters: 0 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: use_delta_encoding: 1 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: filter_policy: bloomfilter 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: whole_key_filtering: 1 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: verify_compression: 0 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: read_amp_bytes_per_bit: 0 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: format_version: 5 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: enable_index_compression: 1 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_align: 0 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: max_auto_readahead_size: 262144 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: prepopulate_block_cache: 0 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: initial_auto_readahead_size: 8192 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: num_file_reads_for_auto_readahead: 2 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.write_buffer_size: 33554432 2024-03-19T06:07:50.083 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_write_buffer_number: 2 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compression: NoCompression 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bottommost_compression: Disabled 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.prefix_extractor: nullptr 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.num_levels: 7 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-19T06:07:50.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compression_opts.level: 32767 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compression_opts.strategy: 0 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compression_opts.enabled: false 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-19T06:07:50.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.target_file_size_base: 67108864 2024-03-19T06:07:50.086 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-19T06:07:50.086 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-19T06:07:50.086 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-19T06:07:50.086 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-19T06:07:50.086 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-19T06:07:50.087 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-19T06:07:50.087 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-19T06:07:50.087 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-19T06:07:50.087 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-19T06:07:50.087 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-19T06:07:50.087 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-19T06:07:50.087 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-19T06:07:50.087 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-19T06:07:50.087 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-19T06:07:50.087 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.arena_block_size: 1048576 2024-03-19T06:07:50.087 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.disable_auto_compactions: 0 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.table_properties_collectors: 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.inplace_update_support: 0 2024-03-19T06:07:50.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.bloom_locality: 0 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.max_successive_merges: 0 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.paranoid_file_checks: 0 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.force_consistency_checks: 1 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.report_bg_io_stats: 0 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.ttl: 2592000 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-19T06:07:50.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.enable_blob_files: false 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.min_blob_size: 0 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.blob_file_size: 268435456 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.blob_file_starting_level: 0 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi172/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12796, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d530f8f5-d91e-4270-88af-4fad5af62a69 2024-03-19T06:07:50.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710828469821197, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710828469853266, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4862139, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12801, "largest_seqno": 16027, "table_properties": {"data_size": 4850214, "index_size": 7576, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3333, "raw_key_size": 27953, "raw_average_key_size": 21, "raw_value_size": 4824266, "raw_average_value_size": 3668, "num_data_blocks": 342, "num_entries": 1315, "num_filter_entries": 1315, "num_deletions": 253, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1710828469, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d530f8f5-d91e-4270-88af-4fad5af62a69", "db_session_id": "XSUG0VFPLOW0IYAKY0DK", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710828469853478, "job": 1, "event": "recovery_finished"} 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi172/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559c0d99e000 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: DB pointer 0x559c0d98a000 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** DB Stats ** 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-19T06:07:50.091 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** Compaction Stats [default] ** 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: L0 1/0 4.64 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 466.6 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: L6 1/0 5.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Sum 2/0 9.76 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 466.6 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 466.6 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-03-19T06:07:50.092 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** Compaction Stats [default] ** 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 466.6 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Flush(GB): cumulative 0.005, interval 0.005 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative compaction: 0.00 GB write, 118.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-19T06:07:50.093 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval compaction: 0.00 GB write, 118.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Block cache BinnedLRUCache@0x559c0d8ad090#2 capacity: 512.00 MB usage: 12.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: starting mon.smithi172 rank 1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi172 fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: mon.smithi172@-1(???) e2 preinit fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: mon.smithi172@-1(???).mds e15 new map 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: mon.smithi172@-1(???).mds e15 print_map 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: e15 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:07:50.094 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: legacy client fscid: 1 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Filesystem 'cephfs' (1) 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: fs_name cephfs 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: epoch 15 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: modified 2024-03-19T06:04:57.207619+0000 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: tableserver 0 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: root 0 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: session_timeout 60 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: session_autoclose 300 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: max_file_size 1099511627776 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: max_xattr_size 65536 2024-03-19T06:07:50.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: required_client_features {} 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: last_failure 0 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: last_failure_osd_epoch 0 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: max_mds 2 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: in 0,1 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: up {0=14464,1=24227} 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: failed 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: damaged 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: stopped 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: data_pools [3] 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: metadata_pool 2 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: inline_data enabled 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: balancer 2024-03-19T06:07:50.096 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: bal_rank_mask -1 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: standby_count_wanted 1 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: [mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: [mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Standby daemons: 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: [mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: [mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: mon.smithi172@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: mon.smithi172@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: mon.smithi172@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-03-19T06:07:50.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: mon.smithi172@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-03-19T06:07:50.098 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:49 smithi172 ceph-mon[66682]: mon.smithi172@-1(???).paxosservice(auth 1..25) refresh upgraded, format 0 -> 3 2024-03-19T06:07:50.098 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:50 smithi172 bash[66664]: 9c31f8ad367b1466910f80900331caf9e8247623f5caa1c2423400ca8c500b00 2024-03-19T06:07:50.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:50 smithi172 systemd[1]: Started Ceph mon.smithi172 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:07:51.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:51 smithi172 ceph-mon[66682]: pgmap v14: 65 pgs: 65 active+clean; 360 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 174 op/s 2024-03-19T06:07:51.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:51 smithi072 ceph-mon[78545]: pgmap v14: 65 pgs: 65 active+clean; 360 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.8 MiB/s wr, 174 op/s 2024-03-19T06:07:51.854 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-03-19T06:07:51.855 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-03-19T06:07:52.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T06:07:52.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T06:07:52.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: mon.smithi072 calling monitor election 2024-03-19T06:07:52.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: mon.smithi172 calling monitor election 2024-03-19T06:07:52.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: mon.smithi072 is new leader, mons smithi072,smithi172 in quorum (ranks 0,1) 2024-03-19T06:07:52.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: monmap e3: 2 mons at {smithi072=[v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0],smithi172=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-19T06:07:52.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:07:52.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: osdmap e48: 6 total, 6 up, 6 in 2024-03-19T06:07:52.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: mgrmap e37: smithi072.jydpjk(active, since 27s), standbys: smithi172.qkcahs 2024-03-19T06:07:52.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:07:52.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:07:52.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:07:52.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:52.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:52.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:07:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi072"}]: dispatch 2024-03-19T06:07:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-03-19T06:07:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: mon.smithi072 calling monitor election 2024-03-19T06:07:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: mon.smithi172 calling monitor election 2024-03-19T06:07:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: mon.smithi072 is new leader, mons smithi072,smithi172 in quorum (ranks 0,1) 2024-03-19T06:07:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: monmap e3: 2 mons at {smithi072=[v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0],smithi172=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-19T06:07:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:07:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: osdmap e48: 6 total, 6 up, 6 in 2024-03-19T06:07:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: mgrmap e37: smithi072.jydpjk(active, since 27s), standbys: smithi172.qkcahs 2024-03-19T06:07:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:07:53.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:07:53.077 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:07:53.077 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:53.077 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:53.077 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:07:53.159 DEBUG:teuthology.parallel:result is None 2024-03-19T06:07:53.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:53 smithi072 ceph-mon[78545]: pgmap v17: 65 pgs: 65 active+clean; 361 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 183 op/s 2024-03-19T06:07:53.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:53 smithi172 ceph-mon[66682]: pgmap v17: 65 pgs: 65 active+clean; 361 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 183 op/s 2024-03-19T06:07:56.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:55 smithi072 ceph-mon[78545]: pgmap v18: 65 pgs: 65 active+clean; 361 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 977 KiB/s wr, 113 op/s 2024-03-19T06:07:56.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:07:56.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:55 smithi172 ceph-mon[66682]: pgmap v18: 65 pgs: 65 active+clean; 361 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 977 KiB/s wr, 113 op/s 2024-03-19T06:07:56.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:07:58.030 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:57 smithi072 ceph-mon[78545]: pgmap v19: 65 pgs: 65 active+clean; 359 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.2 MiB/s wr, 153 op/s 2024-03-19T06:07:58.030 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:58.030 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:58.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:57 smithi172 ceph-mon[66682]: pgmap v19: 65 pgs: 65 active+clean; 359 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.2 MiB/s wr, 153 op/s 2024-03-19T06:07:58.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:58.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:59.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.287+0000 7f6dd3000700 1 -- 172.21.15.72:0/642251226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc106840 msgr2=0x7f6dcc106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.287+0000 7f6dd3000700 1 --2- 172.21.15.72:0/642251226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc106840 0x7f6dcc106c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009910 tx=0x7f6dbc009c20 comp rx=0 tx=0).stop 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.287+0000 7f6dd3000700 1 -- 172.21.15.72:0/642251226 shutdown_connections 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.287+0000 7f6dd3000700 1 --2- 172.21.15.72:0/642251226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dcc107a40 0x7f6dcc107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.287+0000 7f6dd3000700 1 --2- 172.21.15.72:0/642251226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc106840 0x7f6dcc106c50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.287+0000 7f6dd3000700 1 -- 172.21.15.72:0/642251226 >> 172.21.15.72:0/642251226 conn(0x7f6dcc075970 msgr2=0x7f6dcc077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.287+0000 7f6dd3000700 1 -- 172.21.15.72:0/642251226 shutdown_connections 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.288+0000 7f6dd3000700 1 -- 172.21.15.72:0/642251226 wait complete. 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.288+0000 7f6dd3000700 1 Processor -- start 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.289+0000 7f6dd3000700 1 -- start start 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.289+0000 7f6dd3000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dcc106840 0x7f6dcc19c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.289+0000 7f6dd3000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc107a40 0x7f6dcc19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.289+0000 7f6dd3000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc19cc60 con 0x7f6dcc107a40 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.289+0000 7f6dd3000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc19cda0 con 0x7f6dcc106840 2024-03-19T06:07:59.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.289+0000 7f6dcb400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc107a40 0x7f6dcc19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.289+0000 7f6dcb400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc107a40 0x7f6dcc19c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33580/0 (socket says 172.21.15.72:33580) 2024-03-19T06:07:59.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.289+0000 7f6dcb400700 1 -- 172.21.15.72:0/2138532687 learned_addr learned my addr 172.21.15.72:0/2138532687 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:07:59.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.290+0000 7f6dcbe00700 1 --2- 172.21.15.72:0/2138532687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dcc106840 0x7f6dcc19c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.290+0000 7f6dcb400700 1 -- 172.21.15.72:0/2138532687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dcc106840 msgr2=0x7f6dcc19c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.290+0000 7f6dcb400700 1 --2- 172.21.15.72:0/2138532687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dcc106840 0x7f6dcc19c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.290+0000 7f6dcb400700 1 -- 172.21.15.72:0/2138532687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0095f0 con 0x7f6dcc107a40 2024-03-19T06:07:59.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.290+0000 7f6dcb400700 1 --2- 172.21.15.72:0/2138532687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc107a40 0x7f6dcc19c640 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6db800d8d0 tx=0x7f6db800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.290+0000 7f6dc8c00700 1 -- 172.21.15.72:0/2138532687 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6db8009940 con 0x7f6dcc107a40 2024-03-19T06:07:59.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.291+0000 7f6dc8c00700 1 -- 172.21.15.72:0/2138532687 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6db8010460 con 0x7f6dcc107a40 2024-03-19T06:07:59.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.291+0000 7f6dc8c00700 1 -- 172.21.15.72:0/2138532687 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6db800f5f0 con 0x7f6dcc107a40 2024-03-19T06:07:59.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.291+0000 7f6dd3000700 1 -- 172.21.15.72:0/2138532687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc1a1850 con 0x7f6dcc107a40 2024-03-19T06:07:59.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.291+0000 7f6dd3000700 1 -- 172.21.15.72:0/2138532687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc1a1da0 con 0x7f6dcc107a40 2024-03-19T06:07:59.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.292+0000 7f6dd3000700 1 -- 172.21.15.72:0/2138532687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc10f390 con 0x7f6dcc107a40 2024-03-19T06:07:59.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.293+0000 7f6dc8c00700 1 -- 172.21.15.72:0/2138532687 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7f6db80105d0 con 0x7f6dcc107a40 2024-03-19T06:07:59.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.294+0000 7f6dc8c00700 1 --2- 172.21.15.72:0/2138532687 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6db006e0d0 0x7f6db0070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.294+0000 7f6dc8c00700 1 -- 172.21.15.72:0/2138532687 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6db808deb0 con 0x7f6dcc107a40 2024-03-19T06:07:59.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.294+0000 7f6dcbe00700 1 --2- 172.21.15.72:0/2138532687 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6db006e0d0 0x7f6db0070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.295+0000 7f6dcbe00700 1 --2- 172.21.15.72:0/2138532687 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6db006e0d0 0x7f6db0070580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc006010 tx=0x7f6dbc00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.300+0000 7f6dc8c00700 1 -- 172.21.15.72:0/2138532687 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f6db805acc0 con 0x7f6dcc107a40 2024-03-19T06:07:59.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.556+0000 7f6dd3000700 1 -- 172.21.15.72:0/2138532687 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6dcc10c390 con 0x7f6db006e0d0 2024-03-19T06:07:59.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.558+0000 7f6dc8c00700 1 -- 172.21.15.72:0/2138532687 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f6dcc10c390 con 0x7f6db006e0d0 2024-03-19T06:07:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.561+0000 7f6dd3000700 1 -- 172.21.15.72:0/2138532687 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6db006e0d0 msgr2=0x7f6db0070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.561+0000 7f6dd3000700 1 --2- 172.21.15.72:0/2138532687 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6db006e0d0 0x7f6db0070580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc006010 tx=0x7f6dbc00b540 comp rx=0 tx=0).stop 2024-03-19T06:07:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.561+0000 7f6dd3000700 1 -- 172.21.15.72:0/2138532687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc107a40 msgr2=0x7f6dcc19c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.561+0000 7f6dd3000700 1 --2- 172.21.15.72:0/2138532687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc107a40 0x7f6dcc19c640 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6db800d8d0 tx=0x7f6db800dc90 comp rx=0 tx=0).stop 2024-03-19T06:07:59.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.561+0000 7f6dd3000700 1 -- 172.21.15.72:0/2138532687 shutdown_connections 2024-03-19T06:07:59.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.561+0000 7f6dd3000700 1 --2- 172.21.15.72:0/2138532687 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6db006e0d0 0x7f6db0070580 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.561+0000 7f6dd3000700 1 --2- 172.21.15.72:0/2138532687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dcc106840 0x7f6dcc19c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.561+0000 7f6dd3000700 1 --2- 172.21.15.72:0/2138532687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc107a40 0x7f6dcc19c640 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.561+0000 7f6dd3000700 1 -- 172.21.15.72:0/2138532687 >> 172.21.15.72:0/2138532687 conn(0x7f6dcc075970 msgr2=0x7f6dcc10ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.562+0000 7f6dd3000700 1 -- 172.21.15.72:0/2138532687 shutdown_connections 2024-03-19T06:07:59.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.562+0000 7f6dd3000700 1 -- 172.21.15.72:0/2138532687 wait complete. 2024-03-19T06:07:59.567 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:07:59.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.725+0000 7f7283200700 1 -- 172.21.15.72:0/3423860258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c101280 msgr2=0x7f727c1016d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.725+0000 7f7283200700 1 --2- 172.21.15.72:0/3423860258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c101280 0x7f727c1016d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f726c009910 tx=0x7f726c009c20 comp rx=0 tx=0).stop 2024-03-19T06:07:59.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.725+0000 7f7283200700 1 -- 172.21.15.72:0/3423860258 shutdown_connections 2024-03-19T06:07:59.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.725+0000 7f7283200700 1 --2- 172.21.15.72:0/3423860258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c101280 0x7f727c1016d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.725+0000 7f7283200700 1 --2- 172.21.15.72:0/3423860258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c100080 0x7f727c100490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.725+0000 7f7283200700 1 -- 172.21.15.72:0/3423860258 >> 172.21.15.72:0/3423860258 conn(0x7f727c0fb610 msgr2=0x7f727c0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.725+0000 7f7283200700 1 -- 172.21.15.72:0/3423860258 shutdown_connections 2024-03-19T06:07:59.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.726+0000 7f7283200700 1 -- 172.21.15.72:0/3423860258 wait complete. 2024-03-19T06:07:59.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.727+0000 7f7283200700 1 Processor -- start 2024-03-19T06:07:59.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.727+0000 7f7283200700 1 -- start start 2024-03-19T06:07:59.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.727+0000 7f7283200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c100080 0x7f727c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.727+0000 7f7283200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c101280 0x7f727c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.727+0000 7f7283200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c1985c0 con 0x7f727c100080 2024-03-19T06:07:59.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.727+0000 7f7283200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c198700 con 0x7f727c101280 2024-03-19T06:07:59.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.728+0000 7f7281e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c100080 0x7f727c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.728+0000 7f7281e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c100080 0x7f727c197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33592/0 (socket says 172.21.15.72:33592) 2024-03-19T06:07:59.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.728+0000 7f7281e00700 1 -- 172.21.15.72:0/2330451517 learned_addr learned my addr 172.21.15.72:0/2330451517 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:07:59.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.728+0000 7f7281400700 1 --2- 172.21.15.72:0/2330451517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c101280 0x7f727c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.728+0000 7f7281e00700 1 -- 172.21.15.72:0/2330451517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c101280 msgr2=0x7f727c197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.728+0000 7f7281e00700 1 --2- 172.21.15.72:0/2330451517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c101280 0x7f727c197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.728+0000 7f7281e00700 1 -- 172.21.15.72:0/2330451517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0095f0 con 0x7f727c100080 2024-03-19T06:07:59.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.728+0000 7f7281e00700 1 --2- 172.21.15.72:0/2330451517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c100080 0x7f727c197a60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f727000e8f0 tx=0x7f727000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.729+0000 7f7276a00700 1 -- 172.21.15.72:0/2330451517 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7270009790 con 0x7f727c100080 2024-03-19T06:07:59.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.729+0000 7f7276a00700 1 -- 172.21.15.72:0/2330451517 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f727000c810 con 0x7f727c100080 2024-03-19T06:07:59.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.729+0000 7f7276a00700 1 -- 172.21.15.72:0/2330451517 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7270003d20 con 0x7f727c100080 2024-03-19T06:07:59.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.729+0000 7f7283200700 1 -- 172.21.15.72:0/2330451517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727c19d1b0 con 0x7f727c100080 2024-03-19T06:07:59.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.729+0000 7f7283200700 1 -- 172.21.15.72:0/2330451517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c19d700 con 0x7f727c100080 2024-03-19T06:07:59.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.730+0000 7f7283200700 1 -- 172.21.15.72:0/2330451517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c105360 con 0x7f727c100080 2024-03-19T06:07:59.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.731+0000 7f7276a00700 1 -- 172.21.15.72:0/2330451517 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7f72700041f0 con 0x7f727c100080 2024-03-19T06:07:59.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.732+0000 7f7276a00700 1 --2- 172.21.15.72:0/2330451517 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f726406e0d0 0x7f7264070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.733+0000 7f7276a00700 1 -- 172.21.15.72:0/2330451517 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7270014070 con 0x7f727c100080 2024-03-19T06:07:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.733+0000 7f7281400700 1 --2- 172.21.15.72:0/2330451517 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f726406e0d0 0x7f7264070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.734+0000 7f7281400700 1 --2- 172.21.15.72:0/2330451517 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f726406e0d0 0x7f7264070580 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f726c00b6f0 tx=0x7f726c005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:07:59.737+0000 7f7276a00700 1 -- 172.21.15.72:0/2330451517 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f727005aff0 con 0x7f727c100080 2024-03-19T06:07:59.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:59 smithi072 ceph-mon[78545]: pgmap v20: 65 pgs: 65 active+clean; 359 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 754 KiB/s wr, 90 op/s 2024-03-19T06:07:59.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:59 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:07:59.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:07:59 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:00.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.010+0000 7f7283200700 1 -- 172.21.15.72:0/2330451517 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f727c061190 con 0x7f726406e0d0 2024-03-19T06:08:00.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.011+0000 7f7276a00700 1 -- 172.21.15.72:0/2330451517 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f727c061190 con 0x7f726406e0d0 2024-03-19T06:08:00.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.015+0000 7f7283200700 1 -- 172.21.15.72:0/2330451517 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f726406e0d0 msgr2=0x7f7264070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.015+0000 7f7283200700 1 --2- 172.21.15.72:0/2330451517 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f726406e0d0 0x7f7264070580 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f726c00b6f0 tx=0x7f726c005a90 comp rx=0 tx=0).stop 2024-03-19T06:08:00.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.015+0000 7f7283200700 1 -- 172.21.15.72:0/2330451517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c100080 msgr2=0x7f727c197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.015+0000 7f7283200700 1 --2- 172.21.15.72:0/2330451517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c100080 0x7f727c197a60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f727000e8f0 tx=0x7f727000ec00 comp rx=0 tx=0).stop 2024-03-19T06:08:00.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.015+0000 7f7283200700 1 -- 172.21.15.72:0/2330451517 shutdown_connections 2024-03-19T06:08:00.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.015+0000 7f7283200700 1 --2- 172.21.15.72:0/2330451517 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f726406e0d0 0x7f7264070580 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.015+0000 7f7283200700 1 --2- 172.21.15.72:0/2330451517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c100080 0x7f727c197a60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.015+0000 7f7283200700 1 --2- 172.21.15.72:0/2330451517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c101280 0x7f727c197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.015+0000 7f7283200700 1 -- 172.21.15.72:0/2330451517 >> 172.21.15.72:0/2330451517 conn(0x7f727c0fb610 msgr2=0x7f727c1024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:00.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.015+0000 7f7283200700 1 -- 172.21.15.72:0/2330451517 shutdown_connections 2024-03-19T06:08:00.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.016+0000 7f7283200700 1 -- 172.21.15.72:0/2330451517 wait complete. 2024-03-19T06:08:00.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:59 smithi172 ceph-mon[66682]: pgmap v20: 65 pgs: 65 active+clean; 359 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 754 KiB/s wr, 90 op/s 2024-03-19T06:08:00.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:59 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:00.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:07:59 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.199+0000 7fa3fde00700 1 -- 172.21.15.72:0/1434186371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3f8105710 msgr2=0x7fa3f8107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.199+0000 7fa3fde00700 1 --2- 172.21.15.72:0/1434186371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3f8105710 0x7fa3f8107af0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009910 tx=0x7fa3e4009c20 comp rx=0 tx=0).stop 2024-03-19T06:08:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.199+0000 7fa3fde00700 1 -- 172.21.15.72:0/1434186371 shutdown_connections 2024-03-19T06:08:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.199+0000 7fa3fde00700 1 --2- 172.21.15.72:0/1434186371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3f8105710 0x7fa3f8107af0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.199+0000 7fa3fde00700 1 --2- 172.21.15.72:0/1434186371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f8069270 0x7fa3f81051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.199+0000 7fa3fde00700 1 -- 172.21.15.72:0/1434186371 >> 172.21.15.72:0/1434186371 conn(0x7fa3f80fa780 msgr2=0x7fa3f80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.200+0000 7fa3fde00700 1 -- 172.21.15.72:0/1434186371 shutdown_connections 2024-03-19T06:08:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.200+0000 7fa3fde00700 1 -- 172.21.15.72:0/1434186371 wait complete. 2024-03-19T06:08:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.201+0000 7fa3fde00700 1 Processor -- start 2024-03-19T06:08:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.201+0000 7fa3fde00700 1 -- start start 2024-03-19T06:08:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.201+0000 7fa3fde00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f8105710 0x7fa3f8197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.201+0000 7fa3fde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3f8198230 0x7fa3f819d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.201+0000 7fa3fde00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f81986a0 con 0x7fa3f8198230 2024-03-19T06:08:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.201+0000 7fa3fde00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f8198810 con 0x7fa3f8105710 2024-03-19T06:08:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.202+0000 7fa3f6000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3f8198230 0x7fa3f819d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.202+0000 7fa3f6a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f8105710 0x7fa3f8197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.202+0000 7fa3f6a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f8105710 0x7fa3f8197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:35276/0 (socket says 172.21.15.72:35276) 2024-03-19T06:08:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.202+0000 7fa3f6a00700 1 -- 172.21.15.72:0/3083721695 learned_addr learned my addr 172.21.15.72:0/3083721695 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:08:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.202+0000 7fa3f6a00700 1 -- 172.21.15.72:0/3083721695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3f8198230 msgr2=0x7fa3f819d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.202+0000 7fa3f6a00700 1 --2- 172.21.15.72:0/3083721695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3f8198230 0x7fa3f819d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.202+0000 7fa3f6a00700 1 -- 172.21.15.72:0/3083721695 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40095f0 con 0x7fa3f8105710 2024-03-19T06:08:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.202+0000 7fa3f6000700 1 --2- 172.21.15.72:0/3083721695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3f8198230 0x7fa3f819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:08:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.202+0000 7fa3f6a00700 1 --2- 172.21.15.72:0/3083721695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f8105710 0x7fa3f8197cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800e8f0 tx=0x7fa3e800ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.203+0000 7fa3fca00700 1 -- 172.21.15.72:0/3083721695 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e8009790 con 0x7fa3f8105710 2024-03-19T06:08:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.203+0000 7fa3fca00700 1 -- 172.21.15.72:0/3083721695 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa3e800c810 con 0x7fa3f8105710 2024-03-19T06:08:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.203+0000 7fa3fde00700 1 -- 172.21.15.72:0/3083721695 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f819d800 con 0x7fa3f8105710 2024-03-19T06:08:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.203+0000 7fa3fca00700 1 -- 172.21.15.72:0/3083721695 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e80055b0 con 0x7fa3f8105710 2024-03-19T06:08:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.203+0000 7fa3fde00700 1 -- 172.21.15.72:0/3083721695 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f819dd20 con 0x7fa3f8105710 2024-03-19T06:08:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.204+0000 7fa3fde00700 1 -- 172.21.15.72:0/3083721695 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f8191df0 con 0x7fa3f8105710 2024-03-19T06:08:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.205+0000 7fa3fca00700 1 -- 172.21.15.72:0/3083721695 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7fa3e800c980 con 0x7fa3f8105710 2024-03-19T06:08:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.205+0000 7fa3fca00700 1 --2- 172.21.15.72:0/3083721695 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa3dc06e0d0 0x7fa3dc070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.206+0000 7fa3fca00700 1 -- 172.21.15.72:0/3083721695 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa3e8014070 con 0x7fa3f8105710 2024-03-19T06:08:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.206+0000 7fa3f6000700 1 --2- 172.21.15.72:0/3083721695 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa3dc06e0d0 0x7fa3dc070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.206+0000 7fa3f6000700 1 --2- 172.21.15.72:0/3083721695 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa3dc06e0d0 0x7fa3dc070580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400b6f0 tx=0x7fa3e4005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.211+0000 7fa3fca00700 1 -- 172.21.15.72:0/3083721695 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fa3e8057490 con 0x7fa3f8105710 2024-03-19T06:08:00.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.467+0000 7fa3fde00700 1 -- 172.21.15.72:0/3083721695 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3f802cf10 con 0x7fa3dc06e0d0 2024-03-19T06:08:00.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.493+0000 7fa3fca00700 1 -- 172.21.15.72:0/3083721695 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fa3f802cf10 con 0x7fa3dc06e0d0 2024-03-19T06:08:00.483 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:08:00.483 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (12m) 25s ago 14m 14.2M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (14m) 25s ago 14m 8019k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (13m) 2s ago 13m 7918k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (14m) 25s ago 14m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (13m) 2s ago 13m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (12m) 25s ago 14m 75.1M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (6m) 25s ago 6m 15.2M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (7m) 25s ago 7m 167M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (6m) 2s ago 6m 15.4M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (6m) 2s ago 6m 161M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (3m) 25s ago 16m 477M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (86s) 2s ago 12m 448M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (48s) 25s ago 16m 29.8M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:08:00.484 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (11s) 2s ago 12m 23.0M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:08:00.485 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (14m) 25s ago 14m 7726k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:08:00.485 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (13m) 2s ago 13m 8044k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:08:00.485 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (11m) 25s ago 11m 183M 1216M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:08:00.485 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (11m) 25s ago 11m 190M 1216M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:08:00.485 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (10m) 25s ago 10m 157M 1216M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:08:00.485 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (10m) 2s ago 10m 225M 2241M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:08:00.485 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (9m) 2s ago 9m 222M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:08:00.485 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (8m) 2s ago 8m 188M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:08:00.485 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (99s) 25s ago 13m 54.7M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:08:00.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.496+0000 7fa3fde00700 1 -- 172.21.15.72:0/3083721695 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa3dc06e0d0 msgr2=0x7fa3dc070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.496+0000 7fa3fde00700 1 --2- 172.21.15.72:0/3083721695 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa3dc06e0d0 0x7fa3dc070580 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400b6f0 tx=0x7fa3e4005a90 comp rx=0 tx=0).stop 2024-03-19T06:08:00.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.496+0000 7fa3fde00700 1 -- 172.21.15.72:0/3083721695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f8105710 msgr2=0x7fa3f8197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.496+0000 7fa3fde00700 1 --2- 172.21.15.72:0/3083721695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f8105710 0x7fa3f8197cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800e8f0 tx=0x7fa3e800ec00 comp rx=0 tx=0).stop 2024-03-19T06:08:00.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.497+0000 7fa3fde00700 1 -- 172.21.15.72:0/3083721695 shutdown_connections 2024-03-19T06:08:00.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.497+0000 7fa3fde00700 1 --2- 172.21.15.72:0/3083721695 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa3dc06e0d0 0x7fa3dc070580 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.497+0000 7fa3fde00700 1 --2- 172.21.15.72:0/3083721695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f8105710 0x7fa3f8197cf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.497+0000 7fa3fde00700 1 --2- 172.21.15.72:0/3083721695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3f8198230 0x7fa3f819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.497+0000 7fa3fde00700 1 -- 172.21.15.72:0/3083721695 >> 172.21.15.72:0/3083721695 conn(0x7fa3f80fa780 msgr2=0x7fa3f80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:00.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.497+0000 7fa3fde00700 1 -- 172.21.15.72:0/3083721695 shutdown_connections 2024-03-19T06:08:00.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.497+0000 7fa3fde00700 1 -- 172.21.15.72:0/3083721695 wait complete. 2024-03-19T06:08:00.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.654+0000 7f5d56800700 1 -- 172.21.15.72:0/478724187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d50106840 msgr2=0x7f5d50106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.654+0000 7f5d56800700 1 --2- 172.21.15.72:0/478724187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d50106840 0x7f5d50106c50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009910 tx=0x7f5d40009c20 comp rx=0 tx=0).stop 2024-03-19T06:08:00.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.655+0000 7f5d56800700 1 -- 172.21.15.72:0/478724187 shutdown_connections 2024-03-19T06:08:00.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.655+0000 7f5d56800700 1 --2- 172.21.15.72:0/478724187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d50107a40 0x7f5d50107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.655+0000 7f5d56800700 1 --2- 172.21.15.72:0/478724187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d50106840 0x7f5d50106c50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.655+0000 7f5d56800700 1 -- 172.21.15.72:0/478724187 >> 172.21.15.72:0/478724187 conn(0x7f5d50075970 msgr2=0x7f5d50077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:00.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.655+0000 7f5d56800700 1 -- 172.21.15.72:0/478724187 shutdown_connections 2024-03-19T06:08:00.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.655+0000 7f5d56800700 1 -- 172.21.15.72:0/478724187 wait complete. 2024-03-19T06:08:00.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.656+0000 7f5d56800700 1 Processor -- start 2024-03-19T06:08:00.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.656+0000 7f5d56800700 1 -- start start 2024-03-19T06:08:00.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.657+0000 7f5d56800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d50106840 0x7f5d5019c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:00.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.657+0000 7f5d56800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d50107a40 0x7f5d5019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:00.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.657+0000 7f5d56800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5019cc60 con 0x7f5d50106840 2024-03-19T06:08:00.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.657+0000 7f5d56800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5019cda0 con 0x7f5d50107a40 2024-03-19T06:08:00.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.657+0000 7f5d4f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d50106840 0x7f5d5019c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:00.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.657+0000 7f5d4f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d50106840 0x7f5d5019c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33622/0 (socket says 172.21.15.72:33622) 2024-03-19T06:08:00.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.657+0000 7f5d4f400700 1 -- 172.21.15.72:0/4256776087 learned_addr learned my addr 172.21.15.72:0/4256776087 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:08:00.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.657+0000 7f5d4ea00700 1 --2- 172.21.15.72:0/4256776087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d50107a40 0x7f5d5019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:00.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.658+0000 7f5d4f400700 1 -- 172.21.15.72:0/4256776087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d50107a40 msgr2=0x7f5d5019c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.658+0000 7f5d4f400700 1 --2- 172.21.15.72:0/4256776087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d50107a40 0x7f5d5019c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.658+0000 7f5d4f400700 1 -- 172.21.15.72:0/4256776087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400095f0 con 0x7f5d50106840 2024-03-19T06:08:00.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.658+0000 7f5d4f400700 1 --2- 172.21.15.72:0/4256776087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d50106840 0x7f5d5019c100 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000bda0 tx=0x7f5d4000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:00.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.658+0000 7f5d47e00700 1 -- 172.21.15.72:0/4256776087 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d4001d070 con 0x7f5d50106840 2024-03-19T06:08:00.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.658+0000 7f5d47e00700 1 -- 172.21.15.72:0/4256776087 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5d4000f460 con 0x7f5d50106840 2024-03-19T06:08:00.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.658+0000 7f5d56800700 1 -- 172.21.15.72:0/4256776087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d501a17f0 con 0x7f5d50106840 2024-03-19T06:08:00.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.658+0000 7f5d47e00700 1 -- 172.21.15.72:0/4256776087 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d40021620 con 0x7f5d50106840 2024-03-19T06:08:00.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.658+0000 7f5d56800700 1 -- 172.21.15.72:0/4256776087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d501a1ce0 con 0x7f5d50106840 2024-03-19T06:08:00.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.660+0000 7f5d56800700 1 -- 172.21.15.72:0/4256776087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5010f390 con 0x7f5d50106840 2024-03-19T06:08:00.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.661+0000 7f5d47e00700 1 -- 172.21.15.72:0/4256776087 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7f5d4000f5d0 con 0x7f5d50106840 2024-03-19T06:08:00.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.662+0000 7f5d47e00700 1 --2- 172.21.15.72:0/4256776087 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5d3406e0d0 0x7f5d34070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:00.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.662+0000 7f5d47e00700 1 -- 172.21.15.72:0/4256776087 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5d4008f180 con 0x7f5d50106840 2024-03-19T06:08:00.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.662+0000 7f5d4ea00700 1 --2- 172.21.15.72:0/4256776087 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5d3406e0d0 0x7f5d34070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:00.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.663+0000 7f5d4ea00700 1 --2- 172.21.15.72:0/4256776087 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5d3406e0d0 0x7f5d34070580 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c005950 tx=0x7f5d3c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:00.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:00.667+0000 7f5d47e00700 1 -- 172.21.15.72:0/4256776087 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f5d4005bf90 con 0x7f5d50106840 2024-03-19T06:08:00.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.007+0000 7f5d56800700 1 -- 172.21.15.72:0/4256776087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5d5010f580 con 0x7f5d50106840 2024-03-19T06:08:00.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.008+0000 7f5d47e00700 1 -- 172.21.15.72:0/4256776087 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f5d4005bb20 con 0x7f5d50106840 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:08:00.999 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:08:01.000 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-03-19T06:08:01.000 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 4 2024-03-19T06:08:01.000 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:08:01.000 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:08:01.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.011+0000 7f5d56800700 1 -- 172.21.15.72:0/4256776087 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5d3406e0d0 msgr2=0x7f5d34070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:01.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.011+0000 7f5d56800700 1 --2- 172.21.15.72:0/4256776087 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5d3406e0d0 0x7f5d34070580 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c005950 tx=0x7f5d3c00b410 comp rx=0 tx=0).stop 2024-03-19T06:08:01.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.011+0000 7f5d56800700 1 -- 172.21.15.72:0/4256776087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d50106840 msgr2=0x7f5d5019c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:01.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.011+0000 7f5d56800700 1 --2- 172.21.15.72:0/4256776087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d50106840 0x7f5d5019c100 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000bda0 tx=0x7f5d4000bdd0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.011+0000 7f5d56800700 1 -- 172.21.15.72:0/4256776087 shutdown_connections 2024-03-19T06:08:01.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.011+0000 7f5d56800700 1 --2- 172.21.15.72:0/4256776087 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5d3406e0d0 0x7f5d34070580 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.011+0000 7f5d56800700 1 --2- 172.21.15.72:0/4256776087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d50106840 0x7f5d5019c100 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.011+0000 7f5d56800700 1 --2- 172.21.15.72:0/4256776087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d50107a40 0x7f5d5019c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.011+0000 7f5d56800700 1 -- 172.21.15.72:0/4256776087 >> 172.21.15.72:0/4256776087 conn(0x7f5d50075970 msgr2=0x7f5d5010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:01.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.012+0000 7f5d56800700 1 -- 172.21.15.72:0/4256776087 shutdown_connections 2024-03-19T06:08:01.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.012+0000 7f5d56800700 1 -- 172.21.15.72:0/4256776087 wait complete. 2024-03-19T06:08:01.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:00 smithi072 ceph-mon[78545]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:01.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:00 smithi072 ceph-mon[78545]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:01.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:00 smithi072 ceph-mon[78545]: from='client.44109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:01.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:00 smithi172 ceph-mon[66682]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:01.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:00 smithi172 ceph-mon[66682]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:01.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:00 smithi172 ceph-mon[66682]: from='client.44109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.193+0000 7fb538600700 1 -- 172.21.15.72:0/3344561179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb530100240 msgr2=0x7fb530100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.193+0000 7fb538600700 1 --2- 172.21.15.72:0/3344561179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb530100240 0x7fb530100650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb524009910 tx=0x7fb524009c20 comp rx=0 tx=0).stop 2024-03-19T06:08:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.193+0000 7fb538600700 1 -- 172.21.15.72:0/3344561179 shutdown_connections 2024-03-19T06:08:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.193+0000 7fb538600700 1 --2- 172.21.15.72:0/3344561179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb530101440 0x7fb530101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.193+0000 7fb538600700 1 --2- 172.21.15.72:0/3344561179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb530100240 0x7fb530100650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.193+0000 7fb538600700 1 -- 172.21.15.72:0/3344561179 >> 172.21.15.72:0/3344561179 conn(0x7fb5300fb7f0 msgr2=0x7fb5300fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.193+0000 7fb538600700 1 -- 172.21.15.72:0/3344561179 shutdown_connections 2024-03-19T06:08:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.193+0000 7fb538600700 1 -- 172.21.15.72:0/3344561179 wait complete. 2024-03-19T06:08:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.194+0000 7fb538600700 1 Processor -- start 2024-03-19T06:08:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.194+0000 7fb538600700 1 -- start start 2024-03-19T06:08:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.195+0000 7fb538600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb530100240 0x7fb5301938a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:01.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.195+0000 7fb538600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb530101440 0x7fb530193de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:01.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.195+0000 7fb538600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb530194400 con 0x7fb530101440 2024-03-19T06:08:01.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.195+0000 7fb538600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb530194540 con 0x7fb530100240 2024-03-19T06:08:01.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.195+0000 7fb535200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb530101440 0x7fb530193de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:01.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.195+0000 7fb535c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb530100240 0x7fb5301938a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:01.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.195+0000 7fb535c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb530100240 0x7fb5301938a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:35308/0 (socket says 172.21.15.72:35308) 2024-03-19T06:08:01.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.195+0000 7fb535200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb530101440 0x7fb530193de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33642/0 (socket says 172.21.15.72:33642) 2024-03-19T06:08:01.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.195+0000 7fb535c00700 1 -- 172.21.15.72:0/2131332923 learned_addr learned my addr 172.21.15.72:0/2131332923 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:08:01.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.195+0000 7fb535200700 1 -- 172.21.15.72:0/2131332923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb530100240 msgr2=0x7fb5301938a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:01.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.195+0000 7fb535200700 1 --2- 172.21.15.72:0/2131332923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb530100240 0x7fb5301938a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.195+0000 7fb535200700 1 -- 172.21.15.72:0/2131332923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5240095f0 con 0x7fb530101440 2024-03-19T06:08:01.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.196+0000 7fb535200700 1 --2- 172.21.15.72:0/2131332923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb530101440 0x7fb530193de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00e970 tx=0x7fb51c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:01.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.196+0000 7fb52e000700 1 -- 172.21.15.72:0/2131332923 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb51c00c9d0 con 0x7fb530101440 2024-03-19T06:08:01.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.196+0000 7fb52e000700 1 -- 172.21.15.72:0/2131332923 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb51c010430 con 0x7fb530101440 2024-03-19T06:08:01.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.196+0000 7fb52e000700 1 -- 172.21.15.72:0/2131332923 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb51c018650 con 0x7fb530101440 2024-03-19T06:08:01.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.196+0000 7fb538600700 1 -- 172.21.15.72:0/2131332923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb530198ff0 con 0x7fb530101440 2024-03-19T06:08:01.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.196+0000 7fb538600700 1 -- 172.21.15.72:0/2131332923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb530199540 con 0x7fb530101440 2024-03-19T06:08:01.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.197+0000 7fb538600700 1 -- 172.21.15.72:0/2131332923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb530108d90 con 0x7fb530101440 2024-03-19T06:08:01.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.199+0000 7fb52e000700 1 -- 172.21.15.72:0/2131332923 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7fb51c0105a0 con 0x7fb530101440 2024-03-19T06:08:01.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.199+0000 7fb52e000700 1 --2- 172.21.15.72:0/2131332923 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb51806e0d0 0x7fb518070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:01.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.200+0000 7fb52e000700 1 -- 172.21.15.72:0/2131332923 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb51c014070 con 0x7fb530101440 2024-03-19T06:08:01.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.200+0000 7fb535c00700 1 --2- 172.21.15.72:0/2131332923 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb51806e0d0 0x7fb518070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:01.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.201+0000 7fb535c00700 1 --2- 172.21.15.72:0/2131332923 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb51806e0d0 0x7fb518070580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb524006010 tx=0x7fb524005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:01.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.204+0000 7fb52e000700 1 -- 172.21.15.72:0/2131332923 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fb51c0531e0 con 0x7fb530101440 2024-03-19T06:08:01.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.494+0000 7fb538600700 1 -- 172.21.15.72:0/2131332923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb53002d050 con 0x7fb530101440 2024-03-19T06:08:01.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.496+0000 7fb52e000700 1 -- 172.21.15.72:0/2131332923 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1886 (secure 0 0 0) 0x7fb51c05af40 con 0x7fb530101440 2024-03-19T06:08:01.486 INFO:teuthology.orchestra.run.smithi072.stdout:e15 2024-03-19T06:08:01.486 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 15 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:04:57.207619+0000 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:08:01.487 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:08:01.488 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:08:01.489 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:08:01.489 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:08:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:08:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:08:01.489 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:08:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:08:01.489 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:08:01.489 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:08:01.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.501+0000 7fb538600700 1 -- 172.21.15.72:0/2131332923 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb51806e0d0 msgr2=0x7fb518070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:01.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.501+0000 7fb538600700 1 --2- 172.21.15.72:0/2131332923 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb51806e0d0 0x7fb518070580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb524006010 tx=0x7fb524005a90 comp rx=0 tx=0).stop 2024-03-19T06:08:01.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.501+0000 7fb538600700 1 -- 172.21.15.72:0/2131332923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb530101440 msgr2=0x7fb530193de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:01.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.501+0000 7fb538600700 1 --2- 172.21.15.72:0/2131332923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb530101440 0x7fb530193de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00e970 tx=0x7fb51c00ec80 comp rx=0 tx=0).stop 2024-03-19T06:08:01.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.501+0000 7fb538600700 1 -- 172.21.15.72:0/2131332923 shutdown_connections 2024-03-19T06:08:01.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.501+0000 7fb538600700 1 --2- 172.21.15.72:0/2131332923 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb51806e0d0 0x7fb518070580 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.501+0000 7fb538600700 1 --2- 172.21.15.72:0/2131332923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb530100240 0x7fb5301938a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.501+0000 7fb538600700 1 --2- 172.21.15.72:0/2131332923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb530101440 0x7fb530193de0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.501+0000 7fb538600700 1 -- 172.21.15.72:0/2131332923 >> 172.21.15.72:0/2131332923 conn(0x7fb5300fb7f0 msgr2=0x7fb530102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:01.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.501+0000 7fb538600700 1 -- 172.21.15.72:0/2131332923 shutdown_connections 2024-03-19T06:08:01.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.502+0000 7fb538600700 1 -- 172.21.15.72:0/2131332923 wait complete. 2024-03-19T06:08:01.495 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2024-03-19T06:08:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.668+0000 7f6ddc800700 1 -- 172.21.15.72:0/2511060957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd4102430 msgr2=0x7f6dd4102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.668+0000 7f6ddc800700 1 --2- 172.21.15.72:0/2511060957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd4102430 0x7f6dd4102840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009910 tx=0x7f6dc8009c20 comp rx=0 tx=0).stop 2024-03-19T06:08:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.668+0000 7f6ddc800700 1 -- 172.21.15.72:0/2511060957 shutdown_connections 2024-03-19T06:08:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.668+0000 7f6ddc800700 1 --2- 172.21.15.72:0/2511060957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd41036d0 0x7f6dd4103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.668+0000 7f6ddc800700 1 --2- 172.21.15.72:0/2511060957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd4102430 0x7f6dd4102840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.668+0000 7f6ddc800700 1 -- 172.21.15.72:0/2511060957 >> 172.21.15.72:0/2511060957 conn(0x7f6dd40fda80 msgr2=0x7f6dd40ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.668+0000 7f6ddc800700 1 -- 172.21.15.72:0/2511060957 shutdown_connections 2024-03-19T06:08:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.668+0000 7f6ddc800700 1 -- 172.21.15.72:0/2511060957 wait complete. 2024-03-19T06:08:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.669+0000 7f6ddc800700 1 Processor -- start 2024-03-19T06:08:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.669+0000 7f6ddc800700 1 -- start start 2024-03-19T06:08:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.670+0000 7f6ddc800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd4102430 0x7f6dd4197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.670+0000 7f6ddc800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd41036d0 0x7f6dd4198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.670+0000 7f6ddc800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4198850 con 0x7f6dd4102430 2024-03-19T06:08:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.670+0000 7f6ddc800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd419d260 con 0x7f6dd41036d0 2024-03-19T06:08:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.670+0000 7f6dd9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd4102430 0x7f6dd4197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.670+0000 7f6dd9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd4102430 0x7f6dd4197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33656/0 (socket says 172.21.15.72:33656) 2024-03-19T06:08:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.670+0000 7f6dd9e00700 1 -- 172.21.15.72:0/1952707428 learned_addr learned my addr 172.21.15.72:0/1952707428 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:08:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.670+0000 7f6dd9400700 1 --2- 172.21.15.72:0/1952707428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd41036d0 0x7f6dd4198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.671+0000 7f6dd9e00700 1 -- 172.21.15.72:0/1952707428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd41036d0 msgr2=0x7f6dd4198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.671+0000 7f6dd9e00700 1 --2- 172.21.15.72:0/1952707428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd41036d0 0x7f6dd4198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.671+0000 7f6dd9e00700 1 -- 172.21.15.72:0/1952707428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc80095f0 con 0x7f6dd4102430 2024-03-19T06:08:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.671+0000 7f6dd9e00700 1 --2- 172.21.15.72:0/1952707428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd4102430 0x7f6dd4197cf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80092e0 tx=0x7f6dc800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.671+0000 7f6dcea00700 1 -- 172.21.15.72:0/1952707428 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dc801d070 con 0x7f6dd4102430 2024-03-19T06:08:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.671+0000 7f6dcea00700 1 -- 172.21.15.72:0/1952707428 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6dc800f460 con 0x7f6dd4102430 2024-03-19T06:08:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.671+0000 7f6ddc800700 1 -- 172.21.15.72:0/1952707428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd419d400 con 0x7f6dd4102430 2024-03-19T06:08:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.671+0000 7f6dcea00700 1 -- 172.21.15.72:0/1952707428 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dc8021620 con 0x7f6dd4102430 2024-03-19T06:08:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.671+0000 7f6ddc800700 1 -- 172.21.15.72:0/1952707428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd419d8c0 con 0x7f6dd4102430 2024-03-19T06:08:01.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.672+0000 7f6ddc800700 1 -- 172.21.15.72:0/1952707428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd410af10 con 0x7f6dd4102430 2024-03-19T06:08:01.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.673+0000 7f6dcea00700 1 -- 172.21.15.72:0/1952707428 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7f6dc800f5d0 con 0x7f6dd4102430 2024-03-19T06:08:01.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.675+0000 7f6dcea00700 1 --2- 172.21.15.72:0/1952707428 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6dbc06e0e0 0x7f6dbc070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:01.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.675+0000 7f6dcea00700 1 -- 172.21.15.72:0/1952707428 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6dc808f1f0 con 0x7f6dd4102430 2024-03-19T06:08:01.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.675+0000 7f6dd9400700 1 --2- 172.21.15.72:0/1952707428 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6dbc06e0e0 0x7f6dbc070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.676+0000 7f6dd9400700 1 --2- 172.21.15.72:0/1952707428 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6dbc06e0e0 0x7f6dbc070590 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4005950 tx=0x7f6dc40058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.680+0000 7f6dcea00700 1 -- 172.21.15.72:0/1952707428 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f6dc8058570 con 0x7f6dd4102430 2024-03-19T06:08:01.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.939+0000 7f6ddc800700 1 -- 172.21.15.72:0/1952707428 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6dd4108020 con 0x7f6dbc06e0e0 2024-03-19T06:08:01.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.942+0000 7f6dcea00700 1 -- 172.21.15.72:0/1952707428 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f6dd4108020 con 0x7f6dbc06e0e0 2024-03-19T06:08:01.933 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:08:01.933 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:08:01.933 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:08:01.933 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:08:01.933 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:08:01.933 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:08:01.933 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:08:01.933 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:08:01.933 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "4/23 daemons upgraded", 2024-03-19T06:08:01.933 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mon daemons", 2024-03-19T06:08:01.933 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:08:01.933 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.945+0000 7f6ddc800700 1 -- 172.21.15.72:0/1952707428 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6dbc06e0e0 msgr2=0x7f6dbc070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.945+0000 7f6ddc800700 1 --2- 172.21.15.72:0/1952707428 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6dbc06e0e0 0x7f6dbc070590 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4005950 tx=0x7f6dc40058e0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.945+0000 7f6ddc800700 1 -- 172.21.15.72:0/1952707428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd4102430 msgr2=0x7f6dd4197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.945+0000 7f6ddc800700 1 --2- 172.21.15.72:0/1952707428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd4102430 0x7f6dd4197cf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80092e0 tx=0x7f6dc800be20 comp rx=0 tx=0).stop 2024-03-19T06:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.946+0000 7f6ddc800700 1 -- 172.21.15.72:0/1952707428 shutdown_connections 2024-03-19T06:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.946+0000 7f6ddc800700 1 --2- 172.21.15.72:0/1952707428 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6dbc06e0e0 0x7f6dbc070590 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.946+0000 7f6ddc800700 1 --2- 172.21.15.72:0/1952707428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd4102430 0x7f6dd4197cf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.946+0000 7f6ddc800700 1 --2- 172.21.15.72:0/1952707428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd41036d0 0x7f6dd4198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.946+0000 7f6ddc800700 1 -- 172.21.15.72:0/1952707428 >> 172.21.15.72:0/1952707428 conn(0x7f6dd40fda80 msgr2=0x7f6dd4106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.946+0000 7f6ddc800700 1 -- 172.21.15.72:0/1952707428 shutdown_connections 2024-03-19T06:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:01.946+0000 7f6ddc800700 1 -- 172.21.15.72:0/1952707428 wait complete. 2024-03-19T06:08:02.052 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:01 smithi172 ceph-mon[66682]: pgmap v21: 65 pgs: 65 active+clean; 359 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 754 KiB/s wr, 90 op/s 2024-03-19T06:08:02.052 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:01 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/4256776087' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:08:02.052 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:01 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2131332923' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:08:02.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:01 smithi072 ceph-mon[78545]: pgmap v21: 65 pgs: 65 active+clean; 359 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 754 KiB/s wr, 90 op/s 2024-03-19T06:08:02.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:01 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/4256776087' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:08:02.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:01 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2131332923' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:08:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.111+0000 7f15f3c00700 1 -- 172.21.15.72:0/864068776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15ec074d20 msgr2=0x7f15ec073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.111+0000 7f15f3c00700 1 --2- 172.21.15.72:0/864068776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15ec074d20 0x7f15ec073180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009910 tx=0x7f15e0009c20 comp rx=0 tx=0).stop 2024-03-19T06:08:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.112+0000 7f15f3c00700 1 -- 172.21.15.72:0/864068776 shutdown_connections 2024-03-19T06:08:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.112+0000 7f15f3c00700 1 --2- 172.21.15.72:0/864068776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15ec073750 0x7f15ec073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.112+0000 7f15f3c00700 1 --2- 172.21.15.72:0/864068776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15ec074d20 0x7f15ec073180 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.112+0000 7f15f3c00700 1 -- 172.21.15.72:0/864068776 >> 172.21.15.72:0/864068776 conn(0x7f15ec0fb7f0 msgr2=0x7f15ec0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.112+0000 7f15f3c00700 1 -- 172.21.15.72:0/864068776 shutdown_connections 2024-03-19T06:08:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.113+0000 7f15f3c00700 1 -- 172.21.15.72:0/864068776 wait complete. 2024-03-19T06:08:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.115+0000 7f15f3c00700 1 Processor -- start 2024-03-19T06:08:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.115+0000 7f15f3c00700 1 -- start start 2024-03-19T06:08:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.116+0000 7f15f3c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15ec073750 0x7f15ec197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.116+0000 7f15f3c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15ec074d20 0x7f15ec198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.116+0000 7f15f3c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1988b0 con 0x7f15ec074d20 2024-03-19T06:08:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.116+0000 7f15f3c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec1989f0 con 0x7f15ec073750 2024-03-19T06:08:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.116+0000 7f15ebe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15ec074d20 0x7f15ec198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.116+0000 7f15ebe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15ec074d20 0x7f15ec198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33668/0 (socket says 172.21.15.72:33668) 2024-03-19T06:08:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.116+0000 7f15ebe00700 1 -- 172.21.15.72:0/2956950444 learned_addr learned my addr 172.21.15.72:0/2956950444 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:08:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.116+0000 7f15f1200700 1 --2- 172.21.15.72:0/2956950444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15ec073750 0x7f15ec197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:02.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.117+0000 7f15ebe00700 1 -- 172.21.15.72:0/2956950444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15ec073750 msgr2=0x7f15ec197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:02.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.117+0000 7f15ebe00700 1 --2- 172.21.15.72:0/2956950444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15ec073750 0x7f15ec197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:02.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.117+0000 7f15ebe00700 1 -- 172.21.15.72:0/2956950444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00095f0 con 0x7f15ec074d20 2024-03-19T06:08:02.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.117+0000 7f15ebe00700 1 --2- 172.21.15.72:0/2956950444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15ec074d20 0x7f15ec198290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15d800b4b0 tx=0x7f15d800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:02.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.117+0000 7f15e9600700 1 -- 172.21.15.72:0/2956950444 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15d8011800 con 0x7f15ec074d20 2024-03-19T06:08:02.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.117+0000 7f15e9600700 1 -- 172.21.15.72:0/2956950444 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f15d8011e10 con 0x7f15ec074d20 2024-03-19T06:08:02.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.117+0000 7f15e9600700 1 -- 172.21.15.72:0/2956950444 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15d800f2e0 con 0x7f15ec074d20 2024-03-19T06:08:02.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.117+0000 7f15f3c00700 1 -- 172.21.15.72:0/2956950444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec19d4a0 con 0x7f15ec074d20 2024-03-19T06:08:02.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.118+0000 7f15f3c00700 1 -- 172.21.15.72:0/2956950444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ec19d9a0 con 0x7f15ec074d20 2024-03-19T06:08:02.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.119+0000 7f15f3c00700 1 -- 172.21.15.72:0/2956950444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ec10b000 con 0x7f15ec074d20 2024-03-19T06:08:02.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.120+0000 7f15e9600700 1 -- 172.21.15.72:0/2956950444 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7f15d8010380 con 0x7f15ec074d20 2024-03-19T06:08:02.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.121+0000 7f15e9600700 1 --2- 172.21.15.72:0/2956950444 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f15d406e0d0 0x7f15d4070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:02.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.121+0000 7f15e9600700 1 -- 172.21.15.72:0/2956950444 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f15d808da90 con 0x7f15ec074d20 2024-03-19T06:08:02.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.122+0000 7f15f1200700 1 --2- 172.21.15.72:0/2956950444 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f15d406e0d0 0x7f15d4070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:02.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.123+0000 7f15f1200700 1 --2- 172.21.15.72:0/2956950444 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f15d406e0d0 0x7f15d4070580 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f15e0006010 tx=0x7f15e000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:02.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.127+0000 7f15e9600700 1 -- 172.21.15.72:0/2956950444 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f15d805a9d0 con 0x7f15ec074d20 2024-03-19T06:08:02.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.499+0000 7f15f3c00700 1 -- 172.21.15.72:0/2956950444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f15ec10b1c0 con 0x7f15ec074d20 2024-03-19T06:08:02.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.500+0000 7f15e9600700 1 -- 172.21.15.72:0/2956950444 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f15d808d0e0 con 0x7f15ec074d20 2024-03-19T06:08:02.490 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:08:02.490 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:08:02.490 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:08:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.502+0000 7f15f3c00700 1 -- 172.21.15.72:0/2956950444 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f15d406e0d0 msgr2=0x7f15d4070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.502+0000 7f15f3c00700 1 --2- 172.21.15.72:0/2956950444 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f15d406e0d0 0x7f15d4070580 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f15e0006010 tx=0x7f15e000b540 comp rx=0 tx=0).stop 2024-03-19T06:08:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.502+0000 7f15f3c00700 1 -- 172.21.15.72:0/2956950444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15ec074d20 msgr2=0x7f15ec198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.502+0000 7f15f3c00700 1 --2- 172.21.15.72:0/2956950444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15ec074d20 0x7f15ec198290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15d800b4b0 tx=0x7f15d800b870 comp rx=0 tx=0).stop 2024-03-19T06:08:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.503+0000 7f15f3c00700 1 -- 172.21.15.72:0/2956950444 shutdown_connections 2024-03-19T06:08:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.503+0000 7f15f3c00700 1 --2- 172.21.15.72:0/2956950444 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f15d406e0d0 0x7f15d4070580 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.503+0000 7f15f3c00700 1 --2- 172.21.15.72:0/2956950444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15ec073750 0x7f15ec197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.503+0000 7f15f3c00700 1 --2- 172.21.15.72:0/2956950444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15ec074d20 0x7f15ec198290 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.503+0000 7f15f3c00700 1 -- 172.21.15.72:0/2956950444 >> 172.21.15.72:0/2956950444 conn(0x7f15ec0fb7f0 msgr2=0x7f15ec106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.503+0000 7f15f3c00700 1 -- 172.21.15.72:0/2956950444 shutdown_connections 2024-03-19T06:08:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:02.503+0000 7f15f3c00700 1 -- 172.21.15.72:0/2956950444 wait complete. 2024-03-19T06:08:02.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:02 smithi172 ceph-mon[66682]: from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:02.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:02 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2956950444' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:08:03.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:02 smithi072 ceph-mon[78545]: from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:03.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:02 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2956950444' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:08:03.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:03 smithi172 ceph-mon[66682]: pgmap v22: 65 pgs: 65 active+clean; 361 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1016 KiB/s wr, 111 op/s 2024-03-19T06:08:04.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:03 smithi072 ceph-mon[78545]: pgmap v22: 65 pgs: 65 active+clean; 361 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1016 KiB/s wr, 111 op/s 2024-03-19T06:08:05.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:05.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:05.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:05.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:08:05.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:05.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T06:08:05.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-19T06:08:05.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:05.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:05.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:05.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:05.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:08:05.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:05.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T06:08:05.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-19T06:08:05.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:06.743 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:06 smithi072 ceph-mon[78545]: pgmap v23: 65 pgs: 65 active+clean; 361 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 498 KiB/s wr, 60 op/s 2024-03-19T06:08:06.744 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:06 smithi072 ceph-mon[78545]: Reconfiguring mon.smithi072 (monmap changed)... 2024-03-19T06:08:06.744 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:06 smithi072 ceph-mon[78545]: Reconfiguring daemon mon.smithi072 on smithi072 2024-03-19T06:08:06.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:06 smithi172 ceph-mon[66682]: pgmap v23: 65 pgs: 65 active+clean; 361 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 498 KiB/s wr, 60 op/s 2024-03-19T06:08:06.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:06 smithi172 ceph-mon[66682]: Reconfiguring mon.smithi072 (monmap changed)... 2024-03-19T06:08:06.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:06 smithi172 ceph-mon[66682]: Reconfiguring daemon mon.smithi072 on smithi072 2024-03-19T06:08:08.301 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:08 smithi072 ceph-mon[78545]: pgmap v24: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 682 KiB/s wr, 91 op/s 2024-03-19T06:08:08.301 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:08.301 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:08.301 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:08 smithi072 ceph-mon[78545]: Reconfiguring mgr.smithi072.jydpjk (monmap changed)... 2024-03-19T06:08:08.302 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.jydpjk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T06:08:08.302 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T06:08:08.302 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:08.302 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:08 smithi072 ceph-mon[78545]: Reconfiguring daemon mgr.smithi072.jydpjk on smithi072 2024-03-19T06:08:08.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:08 smithi172 ceph-mon[66682]: pgmap v24: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 682 KiB/s wr, 91 op/s 2024-03-19T06:08:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:08 smithi172 ceph-mon[66682]: Reconfiguring mgr.smithi072.jydpjk (monmap changed)... 2024-03-19T06:08:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi072.jydpjk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T06:08:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T06:08:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:08 smithi172 ceph-mon[66682]: Reconfiguring daemon mgr.smithi072.jydpjk on smithi072 2024-03-19T06:08:10.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:10 smithi172 ceph-mon[66682]: pgmap v25: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 446 KiB/s wr, 51 op/s 2024-03-19T06:08:10.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:10.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:10.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T06:08:10.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T06:08:10.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-03-19T06:08:10.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi072"}]: dispatch 2024-03-19T06:08:10.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:10.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:08:10.690 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:10 smithi072 ceph-mon[78545]: pgmap v25: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 446 KiB/s wr, 51 op/s 2024-03-19T06:08:10.690 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:10.690 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:10.690 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T06:08:10.690 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T06:08:10.690 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-03-19T06:08:10.690 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi072"}]: dispatch 2024-03-19T06:08:10.690 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:10.691 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:08:11.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:11 smithi172 ceph-mon[66682]: Reconfiguring ceph-exporter.smithi072 (monmap changed)... 2024-03-19T06:08:11.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:11 smithi172 ceph-mon[66682]: Unable to update caps for client.ceph-exporter.smithi072 2024-03-19T06:08:11.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:11 smithi172 ceph-mon[66682]: Reconfiguring daemon ceph-exporter.smithi072 on smithi072 2024-03-19T06:08:11.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:11 smithi072 ceph-mon[78545]: Reconfiguring ceph-exporter.smithi072 (monmap changed)... 2024-03-19T06:08:11.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:11 smithi072 ceph-mon[78545]: Unable to update caps for client.ceph-exporter.smithi072 2024-03-19T06:08:11.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:11 smithi072 ceph-mon[78545]: Reconfiguring daemon ceph-exporter.smithi072 on smithi072 2024-03-19T06:08:12.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:12 smithi072 ceph-mon[78545]: pgmap v26: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 446 KiB/s wr, 51 op/s 2024-03-19T06:08:12.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:12 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:12.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:12 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:12.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:12 smithi072 ceph-mon[78545]: Reconfiguring crash.smithi072 (monmap changed)... 2024-03-19T06:08:12.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:12 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T06:08:12.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:12 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:12.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:12 smithi072 ceph-mon[78545]: Reconfiguring daemon crash.smithi072 on smithi072 2024-03-19T06:08:12.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:12 smithi172 ceph-mon[66682]: pgmap v26: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 446 KiB/s wr, 51 op/s 2024-03-19T06:08:12.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:12 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:12.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:12 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:12.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:12 smithi172 ceph-mon[66682]: Reconfiguring crash.smithi072 (monmap changed)... 2024-03-19T06:08:12.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:12 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T06:08:12.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:12 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:12.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:12 smithi172 ceph-mon[66682]: Reconfiguring daemon crash.smithi072 on smithi072 2024-03-19T06:08:13.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:13 smithi072 ceph-mon[78545]: pgmap v27: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 622 KiB/s wr, 90 op/s 2024-03-19T06:08:13.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:13 smithi172 ceph-mon[66682]: pgmap v27: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 622 KiB/s wr, 90 op/s 2024-03-19T06:08:15.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:15.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:15.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:15 smithi072 ceph-mon[78545]: Reconfiguring osd.0 (monmap changed)... 2024-03-19T06:08:15.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-19T06:08:15.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:15.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:15 smithi072 ceph-mon[78545]: Reconfiguring daemon osd.0 on smithi072 2024-03-19T06:08:15.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:15.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:15.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:15 smithi172 ceph-mon[66682]: Reconfiguring osd.0 (monmap changed)... 2024-03-19T06:08:15.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-19T06:08:15.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:15.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:15 smithi172 ceph-mon[66682]: Reconfiguring daemon osd.0 on smithi072 2024-03-19T06:08:16.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:16 smithi072 ceph-mon[78545]: pgmap v28: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 9.8 KiB/s rd, 359 KiB/s wr, 69 op/s 2024-03-19T06:08:16.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:16 smithi172 ceph-mon[66682]: pgmap v28: 65 pgs: 65 active+clean; 358 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 9.8 KiB/s rd, 359 KiB/s wr, 69 op/s 2024-03-19T06:08:18.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:17 smithi072 ceph-mon[78545]: pgmap v29: 65 pgs: 65 active+clean; 358 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 538 KiB/s wr, 106 op/s 2024-03-19T06:08:18.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:17 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:18.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:17 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:18.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:17 smithi072 ceph-mon[78545]: Reconfiguring osd.1 (monmap changed)... 2024-03-19T06:08:18.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:17 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-19T06:08:18.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:17 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:18.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:17 smithi072 ceph-mon[78545]: Reconfiguring daemon osd.1 on smithi072 2024-03-19T06:08:18.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:17 smithi172 ceph-mon[66682]: pgmap v29: 65 pgs: 65 active+clean; 358 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 538 KiB/s wr, 106 op/s 2024-03-19T06:08:18.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:17 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:18.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:17 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:18.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:17 smithi172 ceph-mon[66682]: Reconfiguring osd.1 (monmap changed)... 2024-03-19T06:08:18.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:17 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-19T06:08:18.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:17 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:18.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:17 smithi172 ceph-mon[66682]: Reconfiguring daemon osd.1 on smithi072 2024-03-19T06:08:20.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:19 smithi072 ceph-mon[78545]: pgmap v30: 65 pgs: 65 active+clean; 358 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 9.1 KiB/s rd, 355 KiB/s wr, 75 op/s 2024-03-19T06:08:20.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:20.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:20.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-19T06:08:20.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:20.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:19 smithi172 ceph-mon[66682]: pgmap v30: 65 pgs: 65 active+clean; 358 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 9.1 KiB/s rd, 355 KiB/s wr, 75 op/s 2024-03-19T06:08:20.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:20.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:20.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-19T06:08:20.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:21.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:20 smithi172 ceph-mon[66682]: Reconfiguring osd.2 (monmap changed)... 2024-03-19T06:08:21.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:20 smithi172 ceph-mon[66682]: Reconfiguring daemon osd.2 on smithi072 2024-03-19T06:08:21.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:20 smithi072 ceph-mon[78545]: Reconfiguring osd.2 (monmap changed)... 2024-03-19T06:08:21.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:20 smithi072 ceph-mon[78545]: Reconfiguring daemon osd.2 on smithi072 2024-03-19T06:08:22.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:21 smithi072 ceph-mon[78545]: pgmap v31: 65 pgs: 65 active+clean; 358 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 9.1 KiB/s rd, 355 KiB/s wr, 75 op/s 2024-03-19T06:08:22.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:21 smithi172 ceph-mon[66682]: pgmap v31: 65 pgs: 65 active+clean; 358 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 9.1 KiB/s rd, 355 KiB/s wr, 75 op/s 2024-03-19T06:08:23.312 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:23 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:23.312 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:23 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:23.313 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:23 smithi072 ceph-mon[78545]: Reconfiguring mds.cephfs.smithi072.jhxzfi (monmap changed)... 2024-03-19T06:08:23.313 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:23 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.jhxzfi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:08:23.313 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:23 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:23.313 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:23 smithi072 ceph-mon[78545]: Reconfiguring daemon mds.cephfs.smithi072.jhxzfi on smithi072 2024-03-19T06:08:23.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:23 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:23.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:23 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:23.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:23 smithi172 ceph-mon[66682]: Reconfiguring mds.cephfs.smithi072.jhxzfi (monmap changed)... 2024-03-19T06:08:23.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:23 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.jhxzfi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:08:23.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:23 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:23.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:23 smithi172 ceph-mon[66682]: Reconfiguring daemon mds.cephfs.smithi072.jhxzfi on smithi072 2024-03-19T06:08:24.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:24 smithi072 ceph-mon[78545]: pgmap v32: 65 pgs: 65 active+clean; 358 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 545 KiB/s wr, 115 op/s 2024-03-19T06:08:24.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:24 smithi172 ceph-mon[66682]: pgmap v32: 65 pgs: 65 active+clean; 358 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 545 KiB/s wr, 115 op/s 2024-03-19T06:08:24.895 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-03-19T06:08:24.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-19T06:08:25.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:08:25.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:08:26.044 DEBUG:teuthology.parallel:result is None 2024-03-19T06:08:26.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-19T06:08:26.159 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-19T06:08:26.160 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-03-19T06:08:26.275 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-03-19T06:08:26.275 DEBUG:teuthology.parallel:result is None 2024-03-19T06:08:26.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:26 smithi172 ceph-mon[66682]: pgmap v33: 65 pgs: 65 active+clean; 358 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 370 KiB/s wr, 76 op/s 2024-03-19T06:08:26.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:26 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:26.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:26 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:26.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:26 smithi172 ceph-mon[66682]: Reconfiguring mds.cephfs.smithi072.dvdjwb (monmap changed)... 2024-03-19T06:08:26.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:26 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.dvdjwb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:08:26.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:26 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:26.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:26 smithi172 ceph-mon[66682]: Reconfiguring daemon mds.cephfs.smithi072.dvdjwb on smithi072 2024-03-19T06:08:26.723 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:26 smithi072 ceph-mon[78545]: pgmap v33: 65 pgs: 65 active+clean; 358 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 370 KiB/s wr, 76 op/s 2024-03-19T06:08:26.724 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:26 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:26.724 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:26 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:26.724 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:26 smithi072 ceph-mon[78545]: Reconfiguring mds.cephfs.smithi072.dvdjwb (monmap changed)... 2024-03-19T06:08:26.724 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:26 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.dvdjwb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:08:26.724 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:26 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:26.724 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:26 smithi072 ceph-mon[78545]: Reconfiguring daemon mds.cephfs.smithi072.dvdjwb on smithi072 2024-03-19T06:08:28.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:28 smithi072 ceph-mon[78545]: pgmap v34: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 557 KiB/s wr, 103 op/s 2024-03-19T06:08:28.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:28 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:28.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:28 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:28.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:28 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T06:08:28.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:28 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T06:08:28.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:28 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-03-19T06:08:28.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:28 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi172"}]: dispatch 2024-03-19T06:08:28.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:28 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:28.832 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:28 smithi172 ceph-mon[66682]: pgmap v34: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 557 KiB/s wr, 103 op/s 2024-03-19T06:08:28.832 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:28 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:28.832 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:28 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:28.832 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:28 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T06:08:28.832 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:28 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T06:08:28.832 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:28 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-03-19T06:08:28.832 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:28 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi172"}]: dispatch 2024-03-19T06:08:28.832 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:28 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:29.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:29 smithi172 ceph-mon[66682]: Reconfiguring ceph-exporter.smithi172 (monmap changed)... 2024-03-19T06:08:29.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:29 smithi172 ceph-mon[66682]: Unable to update caps for client.ceph-exporter.smithi172 2024-03-19T06:08:29.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:29 smithi172 ceph-mon[66682]: Reconfiguring daemon ceph-exporter.smithi172 on smithi172 2024-03-19T06:08:29.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:29 smithi072 ceph-mon[78545]: Reconfiguring ceph-exporter.smithi172 (monmap changed)... 2024-03-19T06:08:29.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:29 smithi072 ceph-mon[78545]: Unable to update caps for client.ceph-exporter.smithi172 2024-03-19T06:08:29.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:29 smithi072 ceph-mon[78545]: Reconfiguring daemon ceph-exporter.smithi172 on smithi172 2024-03-19T06:08:30.770 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:30 smithi172 ceph-mon[66682]: pgmap v35: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 378 KiB/s wr, 67 op/s 2024-03-19T06:08:30.770 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:30 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:30.770 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:30 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:30.770 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:30 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T06:08:30.770 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:30 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:30.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:30 smithi072 ceph-mon[78545]: pgmap v35: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 378 KiB/s wr, 67 op/s 2024-03-19T06:08:30.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:30 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:30.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:30 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:30.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:30 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T06:08:30.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:30 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:31.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:31 smithi072 ceph-mon[78545]: Reconfiguring crash.smithi172 (monmap changed)... 2024-03-19T06:08:31.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:31 smithi072 ceph-mon[78545]: Reconfiguring daemon crash.smithi172 on smithi172 2024-03-19T06:08:31.828 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:31 smithi172 ceph-mon[66682]: Reconfiguring crash.smithi172 (monmap changed)... 2024-03-19T06:08:31.828 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:31 smithi172 ceph-mon[66682]: Reconfiguring daemon crash.smithi172 on smithi172 2024-03-19T06:08:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:32 smithi072 ceph-mon[78545]: pgmap v36: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 378 KiB/s wr, 67 op/s 2024-03-19T06:08:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.qkcahs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T06:08:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T06:08:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:32.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.671+0000 7fa023e00700 1 -- 172.21.15.72:0/4262622644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01c102490 msgr2=0x7fa01c1028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:32.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.671+0000 7fa023e00700 1 --2- 172.21.15.72:0/4262622644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01c102490 0x7fa01c1028a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa010009910 tx=0x7fa010009c20 comp rx=0 tx=0).stop 2024-03-19T06:08:32.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.671+0000 7fa023e00700 1 -- 172.21.15.72:0/4262622644 shutdown_connections 2024-03-19T06:08:32.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.671+0000 7fa023e00700 1 --2- 172.21.15.72:0/4262622644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa01c103640 0x7fa01c103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:32.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.671+0000 7fa023e00700 1 --2- 172.21.15.72:0/4262622644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01c102490 0x7fa01c1028a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:32.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.671+0000 7fa023e00700 1 -- 172.21.15.72:0/4262622644 >> 172.21.15.72:0/4262622644 conn(0x7fa01c0fda60 msgr2=0x7fa01c0ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:32.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.671+0000 7fa023e00700 1 -- 172.21.15.72:0/4262622644 shutdown_connections 2024-03-19T06:08:32.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.671+0000 7fa023e00700 1 -- 172.21.15.72:0/4262622644 wait complete. 2024-03-19T06:08:32.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.673+0000 7fa023e00700 1 Processor -- start 2024-03-19T06:08:32.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.673+0000 7fa023e00700 1 -- start start 2024-03-19T06:08:32.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.673+0000 7fa023e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa01c102490 0x7fa01c197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:32.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.673+0000 7fa023e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01c103640 0x7fa01c1981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:32.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.673+0000 7fa023e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c1987b0 con 0x7fa01c103640 2024-03-19T06:08:32.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.673+0000 7fa023e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c198920 con 0x7fa01c102490 2024-03-19T06:08:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.673+0000 7fa020a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01c103640 0x7fa01c1981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.674+0000 7fa020a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01c103640 0x7fa01c1981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33456/0 (socket says 172.21.15.72:33456) 2024-03-19T06:08:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.674+0000 7fa020a00700 1 -- 172.21.15.72:0/2107507355 learned_addr learned my addr 172.21.15.72:0/2107507355 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:08:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.674+0000 7fa021400700 1 --2- 172.21.15.72:0/2107507355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa01c102490 0x7fa01c197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.674+0000 7fa020a00700 1 -- 172.21.15.72:0/2107507355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa01c102490 msgr2=0x7fa01c197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.674+0000 7fa020a00700 1 --2- 172.21.15.72:0/2107507355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa01c102490 0x7fa01c197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.674+0000 7fa020a00700 1 -- 172.21.15.72:0/2107507355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0100095f0 con 0x7fa01c103640 2024-03-19T06:08:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.674+0000 7fa020a00700 1 --2- 172.21.15.72:0/2107507355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01c103640 0x7fa01c1981b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa00800c8a0 tx=0x7fa00800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.675+0000 7fa01a000700 1 -- 172.21.15.72:0/2107507355 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa00800cea0 con 0x7fa01c103640 2024-03-19T06:08:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.675+0000 7fa023e00700 1 -- 172.21.15.72:0/2107507355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c19d3b0 con 0x7fa01c103640 2024-03-19T06:08:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.675+0000 7fa01a000700 1 -- 172.21.15.72:0/2107507355 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa008004830 con 0x7fa01c103640 2024-03-19T06:08:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.675+0000 7fa01a000700 1 -- 172.21.15.72:0/2107507355 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0080055b0 con 0x7fa01c103640 2024-03-19T06:08:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.675+0000 7fa023e00700 1 -- 172.21.15.72:0/2107507355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01c19d900 con 0x7fa01c103640 2024-03-19T06:08:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.676+0000 7fa023e00700 1 -- 172.21.15.72:0/2107507355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01c10af90 con 0x7fa01c103640 2024-03-19T06:08:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.677+0000 7fa01a000700 1 -- 172.21.15.72:0/2107507355 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7fa008007ad0 con 0x7fa01c103640 2024-03-19T06:08:32.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.678+0000 7fa01a000700 1 --2- 172.21.15.72:0/2107507355 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa00406e0d0 0x7fa004070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:32.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.678+0000 7fa01a000700 1 -- 172.21.15.72:0/2107507355 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa00808dc80 con 0x7fa01c103640 2024-03-19T06:08:32.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.678+0000 7fa021400700 1 --2- 172.21.15.72:0/2107507355 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa00406e0d0 0x7fa004070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.679+0000 7fa021400700 1 --2- 172.21.15.72:0/2107507355 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa00406e0d0 0x7fa004070580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa010005090 tx=0x7fa01000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:32.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.684+0000 7fa01a000700 1 -- 172.21.15.72:0/2107507355 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fa008056f60 con 0x7fa01c103640 2024-03-19T06:08:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:32 smithi172 ceph-mon[66682]: pgmap v36: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 378 KiB/s wr, 67 op/s 2024-03-19T06:08:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.qkcahs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-19T06:08:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-19T06:08:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:32.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.928+0000 7fa023e00700 1 -- 172.21.15.72:0/2107507355 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa01c107f90 con 0x7fa00406e0d0 2024-03-19T06:08:32.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.931+0000 7fa01a000700 1 -- 172.21.15.72:0/2107507355 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fa01c107f90 con 0x7fa00406e0d0 2024-03-19T06:08:32.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.934+0000 7fa023e00700 1 -- 172.21.15.72:0/2107507355 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa00406e0d0 msgr2=0x7fa004070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:32.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.934+0000 7fa023e00700 1 --2- 172.21.15.72:0/2107507355 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa00406e0d0 0x7fa004070580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa010005090 tx=0x7fa01000b540 comp rx=0 tx=0).stop 2024-03-19T06:08:32.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.934+0000 7fa023e00700 1 -- 172.21.15.72:0/2107507355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01c103640 msgr2=0x7fa01c1981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:32.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.934+0000 7fa023e00700 1 --2- 172.21.15.72:0/2107507355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01c103640 0x7fa01c1981b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa00800c8a0 tx=0x7fa00800cc60 comp rx=0 tx=0).stop 2024-03-19T06:08:32.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.934+0000 7fa023e00700 1 -- 172.21.15.72:0/2107507355 shutdown_connections 2024-03-19T06:08:32.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.934+0000 7fa023e00700 1 --2- 172.21.15.72:0/2107507355 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa00406e0d0 0x7fa004070580 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:32.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.934+0000 7fa023e00700 1 --2- 172.21.15.72:0/2107507355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa01c102490 0x7fa01c197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:32.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.934+0000 7fa023e00700 1 --2- 172.21.15.72:0/2107507355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01c103640 0x7fa01c1981b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:32.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.934+0000 7fa023e00700 1 -- 172.21.15.72:0/2107507355 >> 172.21.15.72:0/2107507355 conn(0x7fa01c0fda60 msgr2=0x7fa01c106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:32.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.934+0000 7fa023e00700 1 -- 172.21.15.72:0/2107507355 shutdown_connections 2024-03-19T06:08:32.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:32.934+0000 7fa023e00700 1 -- 172.21.15.72:0/2107507355 wait complete. 2024-03-19T06:08:32.941 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:08:33.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.101+0000 7f8995000700 1 -- 172.21.15.72:0/2306852529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8990106840 msgr2=0x7f8990106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:33.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.101+0000 7f8995000700 1 --2- 172.21.15.72:0/2306852529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8990106840 0x7f8990106c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8980009910 tx=0x7f8980009c20 comp rx=0 tx=0).stop 2024-03-19T06:08:33.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.101+0000 7f8995000700 1 -- 172.21.15.72:0/2306852529 shutdown_connections 2024-03-19T06:08:33.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.101+0000 7f8995000700 1 --2- 172.21.15.72:0/2306852529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8990107a40 0x7f8990107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.101+0000 7f8995000700 1 --2- 172.21.15.72:0/2306852529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8990106840 0x7f8990106c50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.101+0000 7f8995000700 1 -- 172.21.15.72:0/2306852529 >> 172.21.15.72:0/2306852529 conn(0x7f8990075970 msgr2=0x7f8990077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:33.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.101+0000 7f8995000700 1 -- 172.21.15.72:0/2306852529 shutdown_connections 2024-03-19T06:08:33.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.101+0000 7f8995000700 1 -- 172.21.15.72:0/2306852529 wait complete. 2024-03-19T06:08:33.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.102+0000 7f8995000700 1 Processor -- start 2024-03-19T06:08:33.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.102+0000 7f8995000700 1 -- start start 2024-03-19T06:08:33.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.102+0000 7f8995000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8990106840 0x7f899019c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:33.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.103+0000 7f8995000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8990107a40 0x7f899019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:33.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.103+0000 7f8995000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899019cd10 con 0x7f8990107a40 2024-03-19T06:08:33.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.103+0000 7f8995000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899019ce50 con 0x7f8990106840 2024-03-19T06:08:33.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.103+0000 7f898d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8990107a40 0x7f899019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:33.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.103+0000 7f898d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8990107a40 0x7f899019c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33470/0 (socket says 172.21.15.72:33470) 2024-03-19T06:08:33.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.103+0000 7f898d400700 1 -- 172.21.15.72:0/1976246715 learned_addr learned my addr 172.21.15.72:0/1976246715 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:08:33.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.103+0000 7f898de00700 1 --2- 172.21.15.72:0/1976246715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8990106840 0x7f899019c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:33.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.104+0000 7f898d400700 1 -- 172.21.15.72:0/1976246715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8990106840 msgr2=0x7f899019c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:33.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.104+0000 7f898d400700 1 --2- 172.21.15.72:0/1976246715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8990106840 0x7f899019c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.104+0000 7f898d400700 1 -- 172.21.15.72:0/1976246715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800095f0 con 0x7f8990107a40 2024-03-19T06:08:33.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.104+0000 7f898d400700 1 --2- 172.21.15.72:0/1976246715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8990107a40 0x7f899019c6f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f897c00b4b0 tx=0x7f897c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:33.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.104+0000 7f8986a00700 1 -- 172.21.15.72:0/1976246715 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897c011800 con 0x7f8990107a40 2024-03-19T06:08:33.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.104+0000 7f8986a00700 1 -- 172.21.15.72:0/1976246715 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f897c011e10 con 0x7f8990107a40 2024-03-19T06:08:33.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.104+0000 7f8995000700 1 -- 172.21.15.72:0/1976246715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89901a1900 con 0x7f8990107a40 2024-03-19T06:08:33.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.104+0000 7f8986a00700 1 -- 172.21.15.72:0/1976246715 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897c00f2e0 con 0x7f8990107a40 2024-03-19T06:08:33.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.104+0000 7f8995000700 1 -- 172.21.15.72:0/1976246715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89901a1e50 con 0x7f8990107a40 2024-03-19T06:08:33.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.105+0000 7f8995000700 1 -- 172.21.15.72:0/1976246715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899010f410 con 0x7f8990107a40 2024-03-19T06:08:33.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.107+0000 7f8986a00700 1 -- 172.21.15.72:0/1976246715 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7f897c010380 con 0x7f8990107a40 2024-03-19T06:08:33.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.107+0000 7f8986a00700 1 --2- 172.21.15.72:0/1976246715 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f897406e0d0 0x7f8974070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:33.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.108+0000 7f8986a00700 1 -- 172.21.15.72:0/1976246715 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f897c08d980 con 0x7f8990107a40 2024-03-19T06:08:33.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.108+0000 7f898de00700 1 --2- 172.21.15.72:0/1976246715 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f897406e0d0 0x7f8974070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:33.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.108+0000 7f898de00700 1 --2- 172.21.15.72:0/1976246715 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f897406e0d0 0x7f8974070580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8980006010 tx=0x7f898000b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:33.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.113+0000 7f8986a00700 1 -- 172.21.15.72:0/1976246715 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f897c05a8a0 con 0x7f8990107a40 2024-03-19T06:08:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.354+0000 7f8995000700 1 -- 172.21.15.72:0/1976246715 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f899010c390 con 0x7f897406e0d0 2024-03-19T06:08:33.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.357+0000 7f8986a00700 1 -- 172.21.15.72:0/1976246715 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f899010c390 con 0x7f897406e0d0 2024-03-19T06:08:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.359+0000 7f8995000700 1 -- 172.21.15.72:0/1976246715 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f897406e0d0 msgr2=0x7f8974070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.359+0000 7f8995000700 1 --2- 172.21.15.72:0/1976246715 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f897406e0d0 0x7f8974070580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8980006010 tx=0x7f898000b560 comp rx=0 tx=0).stop 2024-03-19T06:08:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.359+0000 7f8995000700 1 -- 172.21.15.72:0/1976246715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8990107a40 msgr2=0x7f899019c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.359+0000 7f8995000700 1 --2- 172.21.15.72:0/1976246715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8990107a40 0x7f899019c6f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f897c00b4b0 tx=0x7f897c00b7c0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.359+0000 7f8995000700 1 -- 172.21.15.72:0/1976246715 shutdown_connections 2024-03-19T06:08:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.359+0000 7f8995000700 1 --2- 172.21.15.72:0/1976246715 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f897406e0d0 0x7f8974070580 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.359+0000 7f8995000700 1 --2- 172.21.15.72:0/1976246715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8990106840 0x7f899019c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.359+0000 7f8995000700 1 --2- 172.21.15.72:0/1976246715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8990107a40 0x7f899019c6f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.359+0000 7f8995000700 1 -- 172.21.15.72:0/1976246715 >> 172.21.15.72:0/1976246715 conn(0x7f8990075970 msgr2=0x7f899010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.360+0000 7f8995000700 1 -- 172.21.15.72:0/1976246715 shutdown_connections 2024-03-19T06:08:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.360+0000 7f8995000700 1 -- 172.21.15.72:0/1976246715 wait complete. 2024-03-19T06:08:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.514+0000 7fad81000700 1 -- 172.21.15.72:0/3640371001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad7c103470 msgr2=0x7fad7c105850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.514+0000 7fad81000700 1 --2- 172.21.15.72:0/3640371001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad7c103470 0x7fad7c105850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad64009910 tx=0x7fad64009c20 comp rx=0 tx=0).stop 2024-03-19T06:08:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.514+0000 7fad81000700 1 -- 172.21.15.72:0/3640371001 shutdown_connections 2024-03-19T06:08:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.514+0000 7fad81000700 1 --2- 172.21.15.72:0/3640371001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad7c103470 0x7fad7c105850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.514+0000 7fad81000700 1 --2- 172.21.15.72:0/3640371001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad7c100b50 0x7fad7c102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.514+0000 7fad81000700 1 -- 172.21.15.72:0/3640371001 >> 172.21.15.72:0/3640371001 conn(0x7fad7c0fa4d0 msgr2=0x7fad7c0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.515+0000 7fad81000700 1 -- 172.21.15.72:0/3640371001 shutdown_connections 2024-03-19T06:08:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.515+0000 7fad81000700 1 -- 172.21.15.72:0/3640371001 wait complete. 2024-03-19T06:08:33.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.516+0000 7fad81000700 1 Processor -- start 2024-03-19T06:08:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.516+0000 7fad81000700 1 -- start start 2024-03-19T06:08:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.517+0000 7fad81000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad7c100b50 0x7fad7c1004b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.517+0000 7fad81000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad7c103470 0x7fad7c0feb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.517+0000 7fad81000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0ff040 con 0x7fad7c100b50 2024-03-19T06:08:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.517+0000 7fad81000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0ff180 con 0x7fad7c103470 2024-03-19T06:08:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.517+0000 7fad7b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad7c100b50 0x7fad7c1004b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.517+0000 7fad7b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad7c100b50 0x7fad7c1004b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33488/0 (socket says 172.21.15.72:33488) 2024-03-19T06:08:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.517+0000 7fad7b400700 1 -- 172.21.15.72:0/1687880904 learned_addr learned my addr 172.21.15.72:0/1687880904 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:08:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.517+0000 7fad73e00700 1 --2- 172.21.15.72:0/1687880904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad7c103470 0x7fad7c0feb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.517+0000 7fad7b400700 1 -- 172.21.15.72:0/1687880904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad7c103470 msgr2=0x7fad7c0feb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.517+0000 7fad7b400700 1 --2- 172.21.15.72:0/1687880904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad7c103470 0x7fad7c0feb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.517+0000 7fad7b400700 1 -- 172.21.15.72:0/1687880904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad640095f0 con 0x7fad7c100b50 2024-03-19T06:08:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.518+0000 7fad7b400700 1 --2- 172.21.15.72:0/1687880904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad7c100b50 0x7fad7c1004b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00b4b0 tx=0x7fad6c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.520+0000 7fad78c00700 1 -- 172.21.15.72:0/1687880904 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad6c011800 con 0x7fad7c100b50 2024-03-19T06:08:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.520+0000 7fad78c00700 1 -- 172.21.15.72:0/1687880904 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fad6c011e10 con 0x7fad7c100b50 2024-03-19T06:08:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.520+0000 7fad81000700 1 -- 172.21.15.72:0/1687880904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c0ff460 con 0x7fad7c100b50 2024-03-19T06:08:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.520+0000 7fad78c00700 1 -- 172.21.15.72:0/1687880904 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad6c00f2e0 con 0x7fad7c100b50 2024-03-19T06:08:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.520+0000 7fad81000700 1 -- 172.21.15.72:0/1687880904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c19d910 con 0x7fad7c100b50 2024-03-19T06:08:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.521+0000 7fad81000700 1 -- 172.21.15.72:0/1687880904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7c18fad0 con 0x7fad7c100b50 2024-03-19T06:08:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.522+0000 7fad78c00700 1 -- 172.21.15.72:0/1687880904 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7fad6c010380 con 0x7fad7c100b50 2024-03-19T06:08:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.523+0000 7fad78c00700 1 --2- 172.21.15.72:0/1687880904 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fad6006e0e0 0x7fad60070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.523+0000 7fad78c00700 1 -- 172.21.15.72:0/1687880904 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fad6c08da80 con 0x7fad7c100b50 2024-03-19T06:08:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.524+0000 7fad73e00700 1 --2- 172.21.15.72:0/1687880904 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fad6006e0e0 0x7fad60070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.524+0000 7fad73e00700 1 --2- 172.21.15.72:0/1687880904 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fad6006e0e0 0x7fad60070590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fad64006010 tx=0x7fad6400b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:33.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.528+0000 7fad78c00700 1 -- 172.21.15.72:0/1687880904 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fad6c05a9a0 con 0x7fad7c100b50 2024-03-19T06:08:33.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:33 smithi172 ceph-mon[66682]: Reconfiguring mgr.smithi172.qkcahs (monmap changed)... 2024-03-19T06:08:33.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:33 smithi172 ceph-mon[66682]: Reconfiguring daemon mgr.smithi172.qkcahs on smithi172 2024-03-19T06:08:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.758+0000 7fad81000700 1 -- 172.21.15.72:0/1687880904 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fad7c061190 con 0x7fad6006e0e0 2024-03-19T06:08:33.749 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:33 smithi072 ceph-mon[78545]: Reconfiguring mgr.smithi172.qkcahs (monmap changed)... 2024-03-19T06:08:33.750 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:33 smithi072 ceph-mon[78545]: Reconfiguring daemon mgr.smithi172.qkcahs on smithi172 2024-03-19T06:08:33.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.789+0000 7fad78c00700 1 -- 172.21.15.72:0/1687880904 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fad7c061190 con 0x7fad6006e0e0 2024-03-19T06:08:33.780 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (12m) 58s ago 14m 14.2M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (15m) 58s ago 15m 8019k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (13m) 36s ago 13m 7918k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (15m) 58s ago 15m 6665k - 18.2.0 dc2bc1663786 7c85dafbefe8 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (13m) 36s ago 13m 6669k - 18.2.0 dc2bc1663786 565c40422392 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (12m) 58s ago 14m 75.1M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (7m) 58s ago 7m 15.2M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (7m) 58s ago 7m 167M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (7m) 36s ago 7m 15.4M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (7m) 36s ago 7m 161M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (3m) 58s ago 16m 477M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (119s) 36s ago 13m 448M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:08:33.781 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (81s) 58s ago 17m 29.8M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:08:33.782 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (44s) 36s ago 13m 23.0M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:08:33.782 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (15m) 58s ago 15m 7726k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:08:33.782 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (13m) 36s ago 13m 8044k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:08:33.782 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (12m) 58s ago 12m 183M 1216M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:08:33.782 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (11m) 58s ago 11m 190M 1216M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:08:33.782 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (11m) 58s ago 11m 157M 1216M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:08:33.782 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (10m) 36s ago 10m 225M 2241M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:08:33.782 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (10m) 36s ago 10m 222M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:08:33.782 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (9m) 36s ago 9m 188M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:08:33.782 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (2m) 58s ago 14m 54.7M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:08:33.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.792+0000 7fad81000700 1 -- 172.21.15.72:0/1687880904 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fad6006e0e0 msgr2=0x7fad60070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:33.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.792+0000 7fad81000700 1 --2- 172.21.15.72:0/1687880904 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fad6006e0e0 0x7fad60070590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fad64006010 tx=0x7fad6400b580 comp rx=0 tx=0).stop 2024-03-19T06:08:33.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.792+0000 7fad81000700 1 -- 172.21.15.72:0/1687880904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad7c100b50 msgr2=0x7fad7c1004b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:33.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.792+0000 7fad81000700 1 --2- 172.21.15.72:0/1687880904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad7c100b50 0x7fad7c1004b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00b4b0 tx=0x7fad6c00b870 comp rx=0 tx=0).stop 2024-03-19T06:08:33.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.793+0000 7fad81000700 1 -- 172.21.15.72:0/1687880904 shutdown_connections 2024-03-19T06:08:33.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.793+0000 7fad81000700 1 --2- 172.21.15.72:0/1687880904 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fad6006e0e0 0x7fad60070590 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.793+0000 7fad81000700 1 --2- 172.21.15.72:0/1687880904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad7c100b50 0x7fad7c1004b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.793+0000 7fad81000700 1 --2- 172.21.15.72:0/1687880904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad7c103470 0x7fad7c0feb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.793+0000 7fad81000700 1 -- 172.21.15.72:0/1687880904 >> 172.21.15.72:0/1687880904 conn(0x7fad7c0fa4d0 msgr2=0x7fad7c0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:33.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.793+0000 7fad81000700 1 -- 172.21.15.72:0/1687880904 shutdown_connections 2024-03-19T06:08:33.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.793+0000 7fad81000700 1 -- 172.21.15.72:0/1687880904 wait complete. 2024-03-19T06:08:33.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.939+0000 7f3dbf600700 1 -- 172.21.15.72:0/1049375227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db8100240 msgr2=0x7f3db8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:33.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.939+0000 7f3dbf600700 1 --2- 172.21.15.72:0/1049375227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db8100240 0x7f3db8100650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00b0a0 tx=0x7f3dac00b3b0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.939+0000 7f3dbf600700 1 -- 172.21.15.72:0/1049375227 shutdown_connections 2024-03-19T06:08:33.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.939+0000 7f3dbf600700 1 --2- 172.21.15.72:0/1049375227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3db8101440 0x7f3db8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.939+0000 7f3dbf600700 1 --2- 172.21.15.72:0/1049375227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db8100240 0x7f3db8100650 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.939+0000 7f3dbf600700 1 -- 172.21.15.72:0/1049375227 >> 172.21.15.72:0/1049375227 conn(0x7f3db80fb7f0 msgr2=0x7f3db80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:33.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.940+0000 7f3dbf600700 1 -- 172.21.15.72:0/1049375227 shutdown_connections 2024-03-19T06:08:33.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.940+0000 7f3dbf600700 1 -- 172.21.15.72:0/1049375227 wait complete. 2024-03-19T06:08:33.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.941+0000 7f3dbf600700 1 Processor -- start 2024-03-19T06:08:33.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.941+0000 7f3dbf600700 1 -- start start 2024-03-19T06:08:33.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.941+0000 7f3dbf600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db8100240 0x7f3db8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:33.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.941+0000 7f3dbf600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3db8101440 0x7f3db8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:33.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.941+0000 7f3dbf600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8073680 con 0x7f3db8100240 2024-03-19T06:08:33.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.941+0000 7f3dbf600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80737c0 con 0x7f3db8101440 2024-03-19T06:08:33.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.941+0000 7f3dbcc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db8100240 0x7f3db8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:33.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.941+0000 7f3dbcc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db8100240 0x7f3db8074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46650/0 (socket says 172.21.15.72:46650) 2024-03-19T06:08:33.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.941+0000 7f3dbcc00700 1 -- 172.21.15.72:0/353885413 learned_addr learned my addr 172.21.15.72:0/353885413 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:08:33.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.942+0000 7f3dbcc00700 1 -- 172.21.15.72:0/353885413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3db8101440 msgr2=0x7f3db8073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:33.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.942+0000 7f3dbcc00700 1 --2- 172.21.15.72:0/353885413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3db8101440 0x7f3db8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:33.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.942+0000 7f3dbcc00700 1 -- 172.21.15.72:0/353885413 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac009d00 con 0x7f3db8100240 2024-03-19T06:08:33.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.942+0000 7f3dbcc00700 1 --2- 172.21.15.72:0/353885413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db8100240 0x7f3db8074af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0077b0 tx=0x7f3dac003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:33.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.942+0000 7f3db5600700 1 -- 172.21.15.72:0/353885413 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dac00e040 con 0x7f3db8100240 2024-03-19T06:08:33.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.942+0000 7f3db5600700 1 -- 172.21.15.72:0/353885413 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3dac00ce60 con 0x7f3db8100240 2024-03-19T06:08:33.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.942+0000 7f3dbf600700 1 -- 172.21.15.72:0/353885413 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db8073a40 con 0x7f3db8100240 2024-03-19T06:08:33.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.942+0000 7f3db5600700 1 -- 172.21.15.72:0/353885413 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dac01db10 con 0x7f3db8100240 2024-03-19T06:08:33.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.942+0000 7f3dbf600700 1 -- 172.21.15.72:0/353885413 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db8073f30 con 0x7f3db8100240 2024-03-19T06:08:33.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.943+0000 7f3dbf600700 1 -- 172.21.15.72:0/353885413 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db8108e10 con 0x7f3db8100240 2024-03-19T06:08:33.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.944+0000 7f3db5600700 1 -- 172.21.15.72:0/353885413 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7f3dac01dc90 con 0x7f3db8100240 2024-03-19T06:08:33.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.945+0000 7f3db5600700 1 --2- 172.21.15.72:0/353885413 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3da006e0e0 0x7f3da0070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:33.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.945+0000 7f3db5600700 1 -- 172.21.15.72:0/353885413 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3dac08f9c0 con 0x7f3db8100240 2024-03-19T06:08:33.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.945+0000 7f3db7e00700 1 --2- 172.21.15.72:0/353885413 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3da006e0e0 0x7f3da0070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:33.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.946+0000 7f3db7e00700 1 --2- 172.21.15.72:0/353885413 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3da006e0e0 0x7f3da0070590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3da40097b0 tx=0x7f3da4006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:33.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:33.950+0000 7f3db5600700 1 -- 172.21.15.72:0/353885413 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f3dac05c7d0 con 0x7f3db8100240 2024-03-19T06:08:34.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.243+0000 7f3dbf600700 1 -- 172.21.15.72:0/353885413 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3db8109000 con 0x7f3db8100240 2024-03-19T06:08:34.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.244+0000 7f3db5600700 1 -- 172.21.15.72:0/353885413 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f3dac05c360 con 0x7f3db8100240 2024-03-19T06:08:34.235 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:08:34.235 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:08:34.235 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:08:34.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:08:34.235 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:08:34.235 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:08:34.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:08:34.235 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:08:34.235 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:08:34.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:08:34.236 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:08:34.236 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:08:34.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:08:34.236 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:08:34.236 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-03-19T06:08:34.236 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 4 2024-03-19T06:08:34.236 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:08:34.236 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:08:34.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.247+0000 7f3dbf600700 1 -- 172.21.15.72:0/353885413 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3da006e0e0 msgr2=0x7f3da0070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:34.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.247+0000 7f3dbf600700 1 --2- 172.21.15.72:0/353885413 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3da006e0e0 0x7f3da0070590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3da40097b0 tx=0x7f3da4006d20 comp rx=0 tx=0).stop 2024-03-19T06:08:34.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.247+0000 7f3dbf600700 1 -- 172.21.15.72:0/353885413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db8100240 msgr2=0x7f3db8074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:34.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.247+0000 7f3dbf600700 1 --2- 172.21.15.72:0/353885413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db8100240 0x7f3db8074af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0077b0 tx=0x7f3dac003ce0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.247+0000 7f3dbf600700 1 -- 172.21.15.72:0/353885413 shutdown_connections 2024-03-19T06:08:34.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.247+0000 7f3dbf600700 1 --2- 172.21.15.72:0/353885413 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3da006e0e0 0x7f3da0070590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.247+0000 7f3dbf600700 1 --2- 172.21.15.72:0/353885413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db8100240 0x7f3db8074af0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.247+0000 7f3dbf600700 1 --2- 172.21.15.72:0/353885413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3db8101440 0x7f3db8073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.247+0000 7f3dbf600700 1 -- 172.21.15.72:0/353885413 >> 172.21.15.72:0/353885413 conn(0x7f3db80fb7f0 msgr2=0x7f3db8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:34.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.247+0000 7f3dbf600700 1 -- 172.21.15.72:0/353885413 shutdown_connections 2024-03-19T06:08:34.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.247+0000 7f3dbf600700 1 -- 172.21.15.72:0/353885413 wait complete. 2024-03-19T06:08:34.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.397+0000 7fcaed200700 1 -- 172.21.15.72:0/3203277083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcae80feb50 msgr2=0x7fcae80fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.397+0000 7fcaed200700 1 --2- 172.21.15.72:0/3203277083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcae80feb50 0x7fcae80fef60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009910 tx=0x7fcad8009c20 comp rx=0 tx=0).stop 2024-03-19T06:08:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.397+0000 7fcaed200700 1 -- 172.21.15.72:0/3203277083 shutdown_connections 2024-03-19T06:08:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.397+0000 7fcaed200700 1 --2- 172.21.15.72:0/3203277083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcae80ff4a0 0x7fcae80ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.397+0000 7fcaed200700 1 --2- 172.21.15.72:0/3203277083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcae80feb50 0x7fcae80fef60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.397+0000 7fcaed200700 1 -- 172.21.15.72:0/3203277083 >> 172.21.15.72:0/3203277083 conn(0x7fcae80fa780 msgr2=0x7fcae80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.397+0000 7fcaed200700 1 -- 172.21.15.72:0/3203277083 shutdown_connections 2024-03-19T06:08:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.397+0000 7fcaed200700 1 -- 172.21.15.72:0/3203277083 wait complete. 2024-03-19T06:08:34.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.398+0000 7fcaed200700 1 Processor -- start 2024-03-19T06:08:34.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.398+0000 7fcaed200700 1 -- start start 2024-03-19T06:08:34.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.399+0000 7fcaed200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcae80feb50 0x7fcae8197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:34.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.399+0000 7fcaed200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcae80ff4a0 0x7fcae8198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:34.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.399+0000 7fcaed200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae8198840 con 0x7fcae80feb50 2024-03-19T06:08:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.399+0000 7fcaed200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae819d250 con 0x7fcae80ff4a0 2024-03-19T06:08:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.399+0000 7fcae5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcae80feb50 0x7fcae8197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.399+0000 7fcae5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcae80feb50 0x7fcae8197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46670/0 (socket says 172.21.15.72:46670) 2024-03-19T06:08:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.399+0000 7fcae5e00700 1 -- 172.21.15.72:0/2294634926 learned_addr learned my addr 172.21.15.72:0/2294634926 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:08:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.399+0000 7fcae5400700 1 --2- 172.21.15.72:0/2294634926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcae80ff4a0 0x7fcae8198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.399+0000 7fcae5e00700 1 -- 172.21.15.72:0/2294634926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcae80ff4a0 msgr2=0x7fcae8198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.399+0000 7fcae5e00700 1 --2- 172.21.15.72:0/2294634926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcae80ff4a0 0x7fcae8198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.399+0000 7fcae5e00700 1 -- 172.21.15.72:0/2294634926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad80095f0 con 0x7fcae80feb50 2024-03-19T06:08:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.400+0000 7fcae5e00700 1 --2- 172.21.15.72:0/2294634926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcae80feb50 0x7fcae8197ce0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcad800bd70 tx=0x7fcad800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.402+0000 7fcadea00700 1 -- 172.21.15.72:0/2294634926 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcad801d070 con 0x7fcae80feb50 2024-03-19T06:08:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.402+0000 7fcadea00700 1 -- 172.21.15.72:0/2294634926 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcad800f460 con 0x7fcae80feb50 2024-03-19T06:08:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.403+0000 7fcaed200700 1 -- 172.21.15.72:0/2294634926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae819d3f0 con 0x7fcae80feb50 2024-03-19T06:08:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.403+0000 7fcadea00700 1 -- 172.21.15.72:0/2294634926 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcad8021620 con 0x7fcae80feb50 2024-03-19T06:08:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.403+0000 7fcaed200700 1 -- 172.21.15.72:0/2294634926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae819d8b0 con 0x7fcae80feb50 2024-03-19T06:08:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.404+0000 7fcaed200700 1 -- 172.21.15.72:0/2294634926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae810aef0 con 0x7fcae80feb50 2024-03-19T06:08:34.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.405+0000 7fcadea00700 1 -- 172.21.15.72:0/2294634926 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7fcad800fa40 con 0x7fcae80feb50 2024-03-19T06:08:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.406+0000 7fcadea00700 1 --2- 172.21.15.72:0/2294634926 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcacc06e0d0 0x7fcacc070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.406+0000 7fcadea00700 1 -- 172.21.15.72:0/2294634926 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcad808f290 con 0x7fcae80feb50 2024-03-19T06:08:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.406+0000 7fcae5400700 1 --2- 172.21.15.72:0/2294634926 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcacc06e0d0 0x7fcacc070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.407+0000 7fcae5400700 1 --2- 172.21.15.72:0/2294634926 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcacc06e0d0 0x7fcacc070580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcad4005950 tx=0x7fcad40058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:34.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.411+0000 7fcadea00700 1 -- 172.21.15.72:0/2294634926 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fcad8058530 con 0x7fcae80feb50 2024-03-19T06:08:34.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.687+0000 7fcaed200700 1 -- 172.21.15.72:0/2294634926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcae819df80 con 0x7fcae80feb50 2024-03-19T06:08:34.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.688+0000 7fcadea00700 1 -- 172.21.15.72:0/2294634926 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1886 (secure 0 0 0) 0x7fcad805bbf0 con 0x7fcae80feb50 2024-03-19T06:08:34.679 INFO:teuthology.orchestra.run.smithi072.stdout:e15 2024-03-19T06:08:34.679 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:08:34.679 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:08:34.679 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:08:34.679 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:08:34.679 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:08:34.679 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:08:34.679 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 15 2024-03-19T06:08:34.679 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:08:34.679 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:04:57.207619+0000 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:08:34.680 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:08:34.681 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:08:34.682 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:08:34.682 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:08:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.690+0000 7fcaed200700 1 -- 172.21.15.72:0/2294634926 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcacc06e0d0 msgr2=0x7fcacc070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.690+0000 7fcaed200700 1 --2- 172.21.15.72:0/2294634926 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcacc06e0d0 0x7fcacc070580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcad4005950 tx=0x7fcad40058e0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.690+0000 7fcaed200700 1 -- 172.21.15.72:0/2294634926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcae80feb50 msgr2=0x7fcae8197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.690+0000 7fcaed200700 1 --2- 172.21.15.72:0/2294634926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcae80feb50 0x7fcae8197ce0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcad800bd70 tx=0x7fcad800be50 comp rx=0 tx=0).stop 2024-03-19T06:08:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.691+0000 7fcaed200700 1 -- 172.21.15.72:0/2294634926 shutdown_connections 2024-03-19T06:08:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.691+0000 7fcaed200700 1 --2- 172.21.15.72:0/2294634926 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcacc06e0d0 0x7fcacc070580 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.691+0000 7fcaed200700 1 --2- 172.21.15.72:0/2294634926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcae80feb50 0x7fcae8197ce0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.691+0000 7fcaed200700 1 --2- 172.21.15.72:0/2294634926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcae80ff4a0 0x7fcae8198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.691+0000 7fcaed200700 1 -- 172.21.15.72:0/2294634926 >> 172.21.15.72:0/2294634926 conn(0x7fcae80fa780 msgr2=0x7fcae8107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:34.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.691+0000 7fcaed200700 1 -- 172.21.15.72:0/2294634926 shutdown_connections 2024-03-19T06:08:34.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.691+0000 7fcaed200700 1 -- 172.21.15.72:0/2294634926 wait complete. 2024-03-19T06:08:34.684 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2024-03-19T06:08:34.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:34 smithi072 ceph-mon[78545]: pgmap v37: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 12 KiB/s rd, 390 KiB/s wr, 72 op/s 2024-03-19T06:08:34.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:34 smithi072 ceph-mon[78545]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:34.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:34 smithi072 ceph-mon[78545]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:34.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:34 smithi072 ceph-mon[78545]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:34.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:34 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/353885413' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:08:34.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:34.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:34.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:34 smithi072 ceph-mon[78545]: Reconfiguring mon.smithi172 (monmap changed)... 2024-03-19T06:08:34.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T06:08:34.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-19T06:08:34.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:34.827 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:34 smithi072 ceph-mon[78545]: Reconfiguring daemon mon.smithi172 on smithi172 2024-03-19T06:08:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.848+0000 7fa482600700 1 -- 172.21.15.72:0/3206718116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa47c100020 msgr2=0x7fa47c100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.848+0000 7fa482600700 1 --2- 172.21.15.72:0/3206718116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa47c100020 0x7fa47c100430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa470009910 tx=0x7fa470009c20 comp rx=0 tx=0).stop 2024-03-19T06:08:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.848+0000 7fa482600700 1 -- 172.21.15.72:0/3206718116 shutdown_connections 2024-03-19T06:08:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.848+0000 7fa482600700 1 --2- 172.21.15.72:0/3206718116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa47c1012c0 0x7fa47c101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.848+0000 7fa482600700 1 --2- 172.21.15.72:0/3206718116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa47c100020 0x7fa47c100430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.848+0000 7fa482600700 1 -- 172.21.15.72:0/3206718116 >> 172.21.15.72:0/3206718116 conn(0x7fa47c0fb650 msgr2=0x7fa47c0fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.848+0000 7fa482600700 1 -- 172.21.15.72:0/3206718116 shutdown_connections 2024-03-19T06:08:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.848+0000 7fa482600700 1 -- 172.21.15.72:0/3206718116 wait complete. 2024-03-19T06:08:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.849+0000 7fa482600700 1 Processor -- start 2024-03-19T06:08:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.850+0000 7fa482600700 1 -- start start 2024-03-19T06:08:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.850+0000 7fa482600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa47c100020 0x7fa47c195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.850+0000 7fa482600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa47c1012c0 0x7fa47c195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.850+0000 7fa482600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c196360 con 0x7fa47c100020 2024-03-19T06:08:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.850+0000 7fa482600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c1964a0 con 0x7fa47c1012c0 2024-03-19T06:08:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.850+0000 7fa481200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa47c100020 0x7fa47c195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.850+0000 7fa481200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa47c100020 0x7fa47c195800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46684/0 (socket says 172.21.15.72:46684) 2024-03-19T06:08:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.850+0000 7fa481200700 1 -- 172.21.15.72:0/3640409990 learned_addr learned my addr 172.21.15.72:0/3640409990 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:08:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.850+0000 7fa481200700 1 -- 172.21.15.72:0/3640409990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa47c1012c0 msgr2=0x7fa47c195d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.850+0000 7fa47be00700 1 --2- 172.21.15.72:0/3640409990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa47c1012c0 0x7fa47c195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.850+0000 7fa481200700 1 --2- 172.21.15.72:0/3640409990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa47c1012c0 0x7fa47c195d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.851+0000 7fa481200700 1 -- 172.21.15.72:0/3640409990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4700095f0 con 0x7fa47c100020 2024-03-19T06:08:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.851+0000 7fa481200700 1 --2- 172.21.15.72:0/3640409990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa47c100020 0x7fa47c195800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa47000bd70 tx=0x7fa47000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.851+0000 7fa479600700 1 -- 172.21.15.72:0/3640409990 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47001d070 con 0x7fa47c100020 2024-03-19T06:08:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.851+0000 7fa479600700 1 -- 172.21.15.72:0/3640409990 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa470022470 con 0x7fa47c100020 2024-03-19T06:08:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.851+0000 7fa482600700 1 -- 172.21.15.72:0/3640409990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47c19aef0 con 0x7fa47c100020 2024-03-19T06:08:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.851+0000 7fa479600700 1 -- 172.21.15.72:0/3640409990 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47000f670 con 0x7fa47c100020 2024-03-19T06:08:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.851+0000 7fa482600700 1 -- 172.21.15.72:0/3640409990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47c19b360 con 0x7fa47c100020 2024-03-19T06:08:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.852+0000 7fa482600700 1 -- 172.21.15.72:0/3640409990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47c108b00 con 0x7fa47c100020 2024-03-19T06:08:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.853+0000 7fa479600700 1 -- 172.21.15.72:0/3640409990 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7fa470022a50 con 0x7fa47c100020 2024-03-19T06:08:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.854+0000 7fa479600700 1 --2- 172.21.15.72:0/3640409990 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa46406e0e0 0x7fa464070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.854+0000 7fa479600700 1 -- 172.21.15.72:0/3640409990 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa47008f570 con 0x7fa47c100020 2024-03-19T06:08:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.855+0000 7fa47be00700 1 --2- 172.21.15.72:0/3640409990 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa46406e0e0 0x7fa464070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.855+0000 7fa47be00700 1 --2- 172.21.15.72:0/3640409990 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa46406e0e0 0x7fa464070590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa468005950 tx=0x7fa468005cf0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:34.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:34.859+0000 7fa479600700 1 -- 172.21.15.72:0/3640409990 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fa47005c4d0 con 0x7fa47c100020 2024-03-19T06:08:34.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:34 smithi172 ceph-mon[66682]: pgmap v37: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 12 KiB/s rd, 390 KiB/s wr, 72 op/s 2024-03-19T06:08:34.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:34 smithi172 ceph-mon[66682]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:34.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:34 smithi172 ceph-mon[66682]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:34.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:34 smithi172 ceph-mon[66682]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:34.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:34 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/353885413' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:08:34.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:34 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:34.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:34 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:34.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:34 smithi172 ceph-mon[66682]: Reconfiguring mon.smithi172 (monmap changed)... 2024-03-19T06:08:34.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:34 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-19T06:08:34.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:34 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-19T06:08:34.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:34 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:34.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:34 smithi172 ceph-mon[66682]: Reconfiguring daemon mon.smithi172 on smithi172 2024-03-19T06:08:35.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.103+0000 7fa482600700 1 -- 172.21.15.72:0/3640409990 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa47c105c10 con 0x7fa46406e0e0 2024-03-19T06:08:35.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.105+0000 7fa479600700 1 -- 172.21.15.72:0/3640409990 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fa47c105c10 con 0x7fa46406e0e0 2024-03-19T06:08:35.097 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:08:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:08:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:08:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:08:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:08:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:08:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:08:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:08:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "4/23 daemons upgraded", 2024-03-19T06:08:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mon daemons", 2024-03-19T06:08:35.098 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:08:35.098 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:08:35.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.110+0000 7fa482600700 1 -- 172.21.15.72:0/3640409990 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa46406e0e0 msgr2=0x7fa464070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:35.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.110+0000 7fa482600700 1 --2- 172.21.15.72:0/3640409990 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa46406e0e0 0x7fa464070590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa468005950 tx=0x7fa468005cf0 comp rx=0 tx=0).stop 2024-03-19T06:08:35.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.110+0000 7fa482600700 1 -- 172.21.15.72:0/3640409990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa47c100020 msgr2=0x7fa47c195800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:35.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.110+0000 7fa482600700 1 --2- 172.21.15.72:0/3640409990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa47c100020 0x7fa47c195800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa47000bd70 tx=0x7fa47000be50 comp rx=0 tx=0).stop 2024-03-19T06:08:35.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.110+0000 7fa482600700 1 -- 172.21.15.72:0/3640409990 shutdown_connections 2024-03-19T06:08:35.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.110+0000 7fa482600700 1 --2- 172.21.15.72:0/3640409990 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa46406e0e0 0x7fa464070590 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:35.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.110+0000 7fa482600700 1 --2- 172.21.15.72:0/3640409990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa47c100020 0x7fa47c195800 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:35.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.110+0000 7fa482600700 1 --2- 172.21.15.72:0/3640409990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa47c1012c0 0x7fa47c195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:35.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.110+0000 7fa482600700 1 -- 172.21.15.72:0/3640409990 >> 172.21.15.72:0/3640409990 conn(0x7fa47c0fb650 msgr2=0x7fa47c1044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:35.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.111+0000 7fa482600700 1 -- 172.21.15.72:0/3640409990 shutdown_connections 2024-03-19T06:08:35.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.111+0000 7fa482600700 1 -- 172.21.15.72:0/3640409990 wait complete. 2024-03-19T06:08:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.265+0000 7f91cb800700 1 -- 172.21.15.72:0/957243080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c4106840 msgr2=0x7f91c4106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.265+0000 7f91cb800700 1 --2- 172.21.15.72:0/957243080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c4106840 0x7f91c4106c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009910 tx=0x7f91b8009c20 comp rx=0 tx=0).stop 2024-03-19T06:08:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.265+0000 7f91cb800700 1 -- 172.21.15.72:0/957243080 shutdown_connections 2024-03-19T06:08:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.265+0000 7f91cb800700 1 --2- 172.21.15.72:0/957243080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4107a40 0x7f91c4107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.265+0000 7f91cb800700 1 --2- 172.21.15.72:0/957243080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c4106840 0x7f91c4106c50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.265+0000 7f91cb800700 1 -- 172.21.15.72:0/957243080 >> 172.21.15.72:0/957243080 conn(0x7f91c4075970 msgr2=0x7f91c4077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.265+0000 7f91cb800700 1 -- 172.21.15.72:0/957243080 shutdown_connections 2024-03-19T06:08:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.265+0000 7f91cb800700 1 -- 172.21.15.72:0/957243080 wait complete. 2024-03-19T06:08:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.266+0000 7f91cb800700 1 Processor -- start 2024-03-19T06:08:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.266+0000 7f91cb800700 1 -- start start 2024-03-19T06:08:35.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.267+0000 7f91cb800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c4106840 0x7f91c419c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:35.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.267+0000 7f91cb800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4107a40 0x7f91c419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:35.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.267+0000 7f91cb800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c419cc60 con 0x7f91c4106840 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.267+0000 7f91cb800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c419cda0 con 0x7f91c4107a40 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.267+0000 7f91c8e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c4106840 0x7f91c419c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.267+0000 7f91c8e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c4106840 0x7f91c419c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46692/0 (socket says 172.21.15.72:46692) 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.267+0000 7f91c8e00700 1 -- 172.21.15.72:0/865600161 learned_addr learned my addr 172.21.15.72:0/865600161 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.267+0000 7f91c3e00700 1 --2- 172.21.15.72:0/865600161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4107a40 0x7f91c419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.267+0000 7f91c8e00700 1 -- 172.21.15.72:0/865600161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4107a40 msgr2=0x7f91c419c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.267+0000 7f91c8e00700 1 --2- 172.21.15.72:0/865600161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4107a40 0x7f91c419c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.267+0000 7f91c8e00700 1 -- 172.21.15.72:0/865600161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80095f0 con 0x7f91c4106840 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.268+0000 7f91c3e00700 1 --2- 172.21.15.72:0/865600161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4107a40 0x7f91c419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.268+0000 7f91c8e00700 1 --2- 172.21.15.72:0/865600161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c4106840 0x7f91c419c100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91b800bd70 tx=0x7f91b800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.268+0000 7f91c1600700 1 -- 172.21.15.72:0/865600161 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b801d070 con 0x7f91c4106840 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.268+0000 7f91c1600700 1 -- 172.21.15.72:0/865600161 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f91b800f460 con 0x7f91c4106840 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.268+0000 7f91cb800700 1 -- 172.21.15.72:0/865600161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c41a17f0 con 0x7f91c4106840 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.268+0000 7f91c1600700 1 -- 172.21.15.72:0/865600161 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b8021640 con 0x7f91c4106840 2024-03-19T06:08:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.268+0000 7f91cb800700 1 -- 172.21.15.72:0/865600161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c41a1ce0 con 0x7f91c4106840 2024-03-19T06:08:35.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.269+0000 7f91cb800700 1 -- 172.21.15.72:0/865600161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c410f390 con 0x7f91c4106840 2024-03-19T06:08:35.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.270+0000 7f91c1600700 1 -- 172.21.15.72:0/865600161 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 37) v1 ==== 91943+0+0 (secure 0 0 0) 0x7f91b800fab0 con 0x7f91c4106840 2024-03-19T06:08:35.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.272+0000 7f91c1600700 1 --2- 172.21.15.72:0/865600161 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f91ac06e0d0 0x7f91ac070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:35.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.272+0000 7f91c1600700 1 -- 172.21.15.72:0/865600161 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f91b808f2c0 con 0x7f91c4106840 2024-03-19T06:08:35.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.272+0000 7f91c3e00700 1 --2- 172.21.15.72:0/865600161 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f91ac06e0d0 0x7f91ac070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:35.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.272+0000 7f91c3e00700 1 --2- 172.21.15.72:0/865600161 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f91ac06e0d0 0x7f91ac070580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f91b0005950 tx=0x7f91b0005f50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:35.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.277+0000 7f91c1600700 1 -- 172.21.15.72:0/865600161 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f91b805c170 con 0x7f91c4106840 2024-03-19T06:08:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.568+0000 7f91cb800700 1 -- 172.21.15.72:0/865600161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f91c410f550 con 0x7f91c4106840 2024-03-19T06:08:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.569+0000 7f91c1600700 1 -- 172.21.15.72:0/865600161 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f91b805bd00 con 0x7f91c4106840 2024-03-19T06:08:35.560 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:08:35.560 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:08:35.560 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:08:35.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.572+0000 7f91cb800700 1 -- 172.21.15.72:0/865600161 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f91ac06e0d0 msgr2=0x7f91ac070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:35.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.572+0000 7f91cb800700 1 --2- 172.21.15.72:0/865600161 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f91ac06e0d0 0x7f91ac070580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f91b0005950 tx=0x7f91b0005f50 comp rx=0 tx=0).stop 2024-03-19T06:08:35.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.572+0000 7f91cb800700 1 -- 172.21.15.72:0/865600161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c4106840 msgr2=0x7f91c419c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:35.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.572+0000 7f91cb800700 1 --2- 172.21.15.72:0/865600161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c4106840 0x7f91c419c100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91b800bd70 tx=0x7f91b800be50 comp rx=0 tx=0).stop 2024-03-19T06:08:35.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.572+0000 7f91cb800700 1 -- 172.21.15.72:0/865600161 shutdown_connections 2024-03-19T06:08:35.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.572+0000 7f91cb800700 1 --2- 172.21.15.72:0/865600161 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f91ac06e0d0 0x7f91ac070580 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:35.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.572+0000 7f91cb800700 1 --2- 172.21.15.72:0/865600161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c4106840 0x7f91c419c100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:35.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.572+0000 7f91cb800700 1 --2- 172.21.15.72:0/865600161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4107a40 0x7f91c419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:35.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.572+0000 7f91cb800700 1 -- 172.21.15.72:0/865600161 >> 172.21.15.72:0/865600161 conn(0x7f91c4075970 msgr2=0x7f91c410ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:35.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.572+0000 7f91cb800700 1 -- 172.21.15.72:0/865600161 shutdown_connections 2024-03-19T06:08:35.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:08:35.572+0000 7f91cb800700 1 -- 172.21.15.72:0/865600161 wait complete. 2024-03-19T06:08:35.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:35 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2294634926' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:08:35.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:35 smithi172 ceph-mon[66682]: pgmap v38: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.5 KiB/s rd, 200 KiB/s wr, 32 op/s 2024-03-19T06:08:35.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:35 smithi172 ceph-mon[66682]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:35.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:35 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2294634926' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:08:35.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:35 smithi072 ceph-mon[78545]: pgmap v38: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.5 KiB/s rd, 200 KiB/s wr, 32 op/s 2024-03-19T06:08:35.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:35 smithi072 ceph-mon[78545]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:08:36.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:36 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/865600161' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:08:36.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:36 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/865600161' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:08:37.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:37 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:37.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:37 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:37.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:37 smithi172 ceph-mon[66682]: pgmap v39: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.5 KiB/s rd, 200 KiB/s wr, 32 op/s 2024-03-19T06:08:37.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:37 smithi172 ceph-mon[66682]: Reconfiguring osd.3 (monmap changed)... 2024-03-19T06:08:37.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:37 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-19T06:08:37.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:37 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:37.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:37 smithi172 ceph-mon[66682]: Reconfiguring daemon osd.3 on smithi172 2024-03-19T06:08:38.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:37 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:38.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:37 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:38.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:37 smithi072 ceph-mon[78545]: pgmap v39: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.5 KiB/s rd, 200 KiB/s wr, 32 op/s 2024-03-19T06:08:38.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:37 smithi072 ceph-mon[78545]: Reconfiguring osd.3 (monmap changed)... 2024-03-19T06:08:38.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:37 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-19T06:08:38.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:37 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:38.030 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:37 smithi072 ceph-mon[78545]: Reconfiguring daemon osd.3 on smithi172 2024-03-19T06:08:40.111 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:39 smithi172 ceph-mon[66682]: pgmap v40: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-03-19T06:08:40.111 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:40.112 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:40.112 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:39 smithi172 ceph-mon[66682]: Reconfiguring osd.4 (monmap changed)... 2024-03-19T06:08:40.112 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-19T06:08:40.112 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:40.112 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:39 smithi172 ceph-mon[66682]: Reconfiguring daemon osd.4 on smithi172 2024-03-19T06:08:40.112 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:08:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:39 smithi072 ceph-mon[78545]: pgmap v40: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-03-19T06:08:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:39 smithi072 ceph-mon[78545]: Reconfiguring osd.4 (monmap changed)... 2024-03-19T06:08:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-19T06:08:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:39 smithi072 ceph-mon[78545]: Reconfiguring daemon osd.4 on smithi172 2024-03-19T06:08:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:08:42.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:42 smithi072 ceph-mon[78545]: pgmap v41: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-03-19T06:08:42.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:42.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:42.306 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-19T06:08:42.306 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:42.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:42 smithi172 ceph-mon[66682]: pgmap v41: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-03-19T06:08:42.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:42.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:42.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-19T06:08:42.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:43.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:43 smithi172 ceph-mon[66682]: Reconfiguring osd.5 (monmap changed)... 2024-03-19T06:08:43.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:43 smithi172 ceph-mon[66682]: Reconfiguring daemon osd.5 on smithi172 2024-03-19T06:08:43.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:43 smithi072 ceph-mon[78545]: Reconfiguring osd.5 (monmap changed)... 2024-03-19T06:08:43.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:43 smithi072 ceph-mon[78545]: Reconfiguring daemon osd.5 on smithi172 2024-03-19T06:08:44.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:44 smithi072 ceph-mon[78545]: pgmap v42: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-03-19T06:08:44.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:44.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:44.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:44 smithi172 ceph-mon[66682]: pgmap v42: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-03-19T06:08:44.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:44 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:44.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:44 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:45.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:45 smithi172 ceph-mon[66682]: Reconfiguring mds.cephfs.smithi172.xlokxp (monmap changed)... 2024-03-19T06:08:45.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:45 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.xlokxp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:08:45.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:45 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:45.097 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:45 smithi172 ceph-mon[66682]: Reconfiguring daemon mds.cephfs.smithi172.xlokxp on smithi172 2024-03-19T06:08:45.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:45 smithi072 ceph-mon[78545]: Reconfiguring mds.cephfs.smithi172.xlokxp (monmap changed)... 2024-03-19T06:08:45.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:45 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.xlokxp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:08:45.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:45 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:45.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:45 smithi072 ceph-mon[78545]: Reconfiguring daemon mds.cephfs.smithi172.xlokxp on smithi172 2024-03-19T06:08:46.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:46 smithi172 ceph-mon[66682]: pgmap v43: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-03-19T06:08:46.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:46 smithi072 ceph-mon[78545]: pgmap v43: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-03-19T06:08:47.679 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:47 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:47.679 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:47 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:47.679 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:47 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.nparnw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:08:47.679 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:47 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:47.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:47 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:47.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:47 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:47.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:47 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.nparnw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:08:47.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:47 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:48.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:48 smithi072 ceph-mon[78545]: Reconfiguring mds.cephfs.smithi172.nparnw (monmap changed)... 2024-03-19T06:08:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:48 smithi072 ceph-mon[78545]: Reconfiguring daemon mds.cephfs.smithi172.nparnw on smithi172 2024-03-19T06:08:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:48 smithi072 ceph-mon[78545]: pgmap v44: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-03-19T06:08:48.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:48 smithi172 ceph-mon[66682]: Reconfiguring mds.cephfs.smithi172.nparnw (monmap changed)... 2024-03-19T06:08:48.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:48 smithi172 ceph-mon[66682]: Reconfiguring daemon mds.cephfs.smithi172.nparnw on smithi172 2024-03-19T06:08:48.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:48 smithi172 ceph-mon[66682]: pgmap v44: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-03-19T06:08:50.058 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:49 smithi072 ceph-mon[78545]: pgmap v45: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:08:50.058 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:50.058 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:50.058 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:08:50.058 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:08:50.058 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:08:50.059 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:49 smithi072 ceph-mon[78545]: Upgrade: Setting container_image for all mon 2024-03-19T06:08:50.059 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:50.059 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi072"}]: dispatch 2024-03-19T06:08:50.059 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi072"}]': finished 2024-03-19T06:08:50.059 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi172"}]: dispatch 2024-03-19T06:08:50.059 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi172"}]': finished 2024-03-19T06:08:50.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:49 smithi172 ceph-mon[66682]: pgmap v45: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:08:50.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:50.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:50.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:08:50.103 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:08:50.103 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:08:50.103 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:49 smithi172 ceph-mon[66682]: Upgrade: Setting container_image for all mon 2024-03-19T06:08:50.103 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:50.103 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi072"}]: dispatch 2024-03-19T06:08:50.103 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi072"}]': finished 2024-03-19T06:08:50.103 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi172"}]: dispatch 2024-03-19T06:08:50.103 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi172"}]': finished 2024-03-19T06:08:52.392 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:52 smithi072 ceph-mon[78545]: pgmap v46: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:08:52.392 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:52 smithi072 ceph-mon[78545]: Upgrade: Updating crash.smithi072 (1/2) 2024-03-19T06:08:52.392 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:52.393 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T06:08:52.393 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:52.393 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:52 smithi072 ceph-mon[78545]: Deploying daemon crash.smithi072 on smithi072 2024-03-19T06:08:52.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:52 smithi172 ceph-mon[66682]: pgmap v46: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:08:52.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:52 smithi172 ceph-mon[66682]: Upgrade: Updating crash.smithi072 (1/2) 2024-03-19T06:08:52.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:52.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi072", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T06:08:52.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:08:52.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:52 smithi172 ceph-mon[66682]: Deploying daemon crash.smithi072 on smithi072 2024-03-19T06:08:54.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:54 smithi072 ceph-mon[78545]: pgmap v47: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:08:54.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:54 smithi172 ceph-mon[66682]: pgmap v47: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:08:55.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:08:55.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:08:56.491 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:56 smithi072 ceph-mon[78545]: pgmap v48: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:08:56.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:56 smithi172 ceph-mon[66682]: pgmap v48: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:08:57.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:57.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:57.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:57 smithi172 ceph-mon[66682]: pgmap v49: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:08:58.028 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:58.028 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:08:58.028 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:57 smithi072 ceph-mon[78545]: pgmap v49: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:08:58.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:08:58 smithi172 ceph-mon[66682]: mgrmap e38: smithi072.jydpjk(active, since 93s), standbys: smithi172.qkcahs 2024-03-19T06:08:59.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:08:58 smithi072 ceph-mon[78545]: mgrmap e38: smithi072.jydpjk(active, since 93s), standbys: smithi172.qkcahs 2024-03-19T06:09:00.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:00 smithi072 ceph-mon[78545]: pgmap v50: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:09:00.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:00 smithi072 ceph-mon[78545]: Upgrade: Updating crash.smithi172 (2/2) 2024-03-19T06:09:00.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:00 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:00.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:00 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T06:09:00.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:00 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:09:00.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:00 smithi072 ceph-mon[78545]: Deploying daemon crash.smithi172 on smithi172 2024-03-19T06:09:00.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:00 smithi172 ceph-mon[66682]: pgmap v50: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:09:00.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:00 smithi172 ceph-mon[66682]: Upgrade: Updating crash.smithi172 (2/2) 2024-03-19T06:09:00.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:00 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:00.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:00 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-19T06:09:00.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:00 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:09:00.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:00 smithi172 ceph-mon[66682]: Deploying daemon crash.smithi172 on smithi172 2024-03-19T06:09:02.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:02 smithi072 ceph-mon[78545]: pgmap v51: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:09:02.327 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:02 smithi172 ceph-mon[66682]: pgmap v51: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:09:04.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:04 smithi172 ceph-mon[66682]: pgmap v52: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:09:04.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:04 smithi072 ceph-mon[78545]: pgmap v52: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:09:05.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:05.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:05.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:09:05.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.734+0000 7fcd4ce00700 1 -- 172.21.15.72:0/3797650494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd48103680 msgr2=0x7fcd48105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:05.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.734+0000 7fcd4ce00700 1 --2- 172.21.15.72:0/3797650494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd48103680 0x7fcd48105a60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009910 tx=0x7fcd34009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:05.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.734+0000 7fcd4ce00700 1 -- 172.21.15.72:0/3797650494 shutdown_connections 2024-03-19T06:09:05.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.734+0000 7fcd4ce00700 1 --2- 172.21.15.72:0/3797650494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd48103680 0x7fcd48105a60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:05.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.734+0000 7fcd4ce00700 1 --2- 172.21.15.72:0/3797650494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd48100d60 0x7fcd48103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:05.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.734+0000 7fcd4ce00700 1 -- 172.21.15.72:0/3797650494 >> 172.21.15.72:0/3797650494 conn(0x7fcd480fa780 msgr2=0x7fcd480fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:05.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.734+0000 7fcd4ce00700 1 -- 172.21.15.72:0/3797650494 shutdown_connections 2024-03-19T06:09:05.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.734+0000 7fcd4ce00700 1 -- 172.21.15.72:0/3797650494 wait complete. 2024-03-19T06:09:05.727 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:05.727 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:05.727 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:09:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.736+0000 7fcd4ce00700 1 Processor -- start 2024-03-19T06:09:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.736+0000 7fcd4ce00700 1 -- start start 2024-03-19T06:09:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.736+0000 7fcd4ce00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd48100d60 0x7fcd481938c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.736+0000 7fcd4ce00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd48103680 0x7fcd48193e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.736+0000 7fcd4ce00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd48194420 con 0x7fcd48103680 2024-03-19T06:09:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.736+0000 7fcd4ce00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd48194560 con 0x7fcd48100d60 2024-03-19T06:09:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.737+0000 7fcd45400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd48103680 0x7fcd48193e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.737+0000 7fcd45400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd48103680 0x7fcd48193e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43546/0 (socket says 172.21.15.72:43546) 2024-03-19T06:09:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.737+0000 7fcd45400700 1 -- 172.21.15.72:0/2320518886 learned_addr learned my addr 172.21.15.72:0/2320518886 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.737+0000 7fcd45e00700 1 --2- 172.21.15.72:0/2320518886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd48100d60 0x7fcd481938c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.737+0000 7fcd45400700 1 -- 172.21.15.72:0/2320518886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd48100d60 msgr2=0x7fcd481938c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.737+0000 7fcd45400700 1 --2- 172.21.15.72:0/2320518886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd48100d60 0x7fcd481938c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.737+0000 7fcd45400700 1 -- 172.21.15.72:0/2320518886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd340095f0 con 0x7fcd48103680 2024-03-19T06:09:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.738+0000 7fcd45400700 1 --2- 172.21.15.72:0/2320518886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd48103680 0x7fcd48193e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400b5c0 tx=0x7fcd3400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.738+0000 7fcd3ea00700 1 -- 172.21.15.72:0/2320518886 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd3401d070 con 0x7fcd48103680 2024-03-19T06:09:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.738+0000 7fcd3ea00700 1 -- 172.21.15.72:0/2320518886 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcd3400f460 con 0x7fcd48103680 2024-03-19T06:09:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.738+0000 7fcd4ce00700 1 -- 172.21.15.72:0/2320518886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd48198fb0 con 0x7fcd48103680 2024-03-19T06:09:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.738+0000 7fcd3ea00700 1 -- 172.21.15.72:0/2320518886 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd34021640 con 0x7fcd48103680 2024-03-19T06:09:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.738+0000 7fcd4ce00700 1 -- 172.21.15.72:0/2320518886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd481994a0 con 0x7fcd48103680 2024-03-19T06:09:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.740+0000 7fcd4ce00700 1 -- 172.21.15.72:0/2320518886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd480fc340 con 0x7fcd48103680 2024-03-19T06:09:05.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.741+0000 7fcd3ea00700 1 -- 172.21.15.72:0/2320518886 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fcd3400f5d0 con 0x7fcd48103680 2024-03-19T06:09:05.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.742+0000 7fcd3ea00700 1 --2- 172.21.15.72:0/2320518886 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcd2c06dfa0 0x7fcd2c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:05.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.742+0000 7fcd3ea00700 1 -- 172.21.15.72:0/2320518886 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcd3408f080 con 0x7fcd48103680 2024-03-19T06:09:05.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.743+0000 7fcd45e00700 1 --2- 172.21.15.72:0/2320518886 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcd2c06dfa0 0x7fcd2c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:05.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.743+0000 7fcd45e00700 1 --2- 172.21.15.72:0/2320518886 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcd2c06dfa0 0x7fcd2c070450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcd38005950 tx=0x7fcd380058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:05.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.748+0000 7fcd3ea00700 1 -- 172.21.15.72:0/2320518886 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fcd3405c030 con 0x7fcd48103680 2024-03-19T06:09:05.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:05.998+0000 7fcd4ce00700 1 -- 172.21.15.72:0/2320518886 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd4819a8b0 con 0x7fcd2c06dfa0 2024-03-19T06:09:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.001+0000 7fcd3ea00700 1 -- 172.21.15.72:0/2320518886 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fcd4819a8b0 con 0x7fcd2c06dfa0 2024-03-19T06:09:05.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.003+0000 7fcd4ce00700 1 -- 172.21.15.72:0/2320518886 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcd2c06dfa0 msgr2=0x7fcd2c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:05.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.003+0000 7fcd4ce00700 1 --2- 172.21.15.72:0/2320518886 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcd2c06dfa0 0x7fcd2c070450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcd38005950 tx=0x7fcd380058e0 comp rx=0 tx=0).stop 2024-03-19T06:09:05.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.003+0000 7fcd4ce00700 1 -- 172.21.15.72:0/2320518886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd48103680 msgr2=0x7fcd48193e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:05.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.003+0000 7fcd4ce00700 1 --2- 172.21.15.72:0/2320518886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd48103680 0x7fcd48193e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400b5c0 tx=0x7fcd3400be20 comp rx=0 tx=0).stop 2024-03-19T06:09:05.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.004+0000 7fcd4ce00700 1 -- 172.21.15.72:0/2320518886 shutdown_connections 2024-03-19T06:09:05.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.004+0000 7fcd4ce00700 1 --2- 172.21.15.72:0/2320518886 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcd2c06dfa0 0x7fcd2c070450 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:05.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.004+0000 7fcd4ce00700 1 --2- 172.21.15.72:0/2320518886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd48100d60 0x7fcd481938c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:05.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.004+0000 7fcd4ce00700 1 --2- 172.21.15.72:0/2320518886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd48103680 0x7fcd48193e00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:05.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.004+0000 7fcd4ce00700 1 -- 172.21.15.72:0/2320518886 >> 172.21.15.72:0/2320518886 conn(0x7fcd480fa780 msgr2=0x7fcd480ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:05.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.004+0000 7fcd4ce00700 1 -- 172.21.15.72:0/2320518886 shutdown_connections 2024-03-19T06:09:05.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.004+0000 7fcd4ce00700 1 -- 172.21.15.72:0/2320518886 wait complete. 2024-03-19T06:09:06.010 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:09:06.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.149+0000 7f0975e00700 1 -- 172.21.15.72:0/267378275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0970074d80 msgr2=0x7f09700731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.149+0000 7f0975e00700 1 --2- 172.21.15.72:0/267378275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0970074d80 0x7f09700731e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0960009910 tx=0x7f0960009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.149+0000 7f0975e00700 1 -- 172.21.15.72:0/267378275 shutdown_connections 2024-03-19T06:09:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.149+0000 7f0975e00700 1 --2- 172.21.15.72:0/267378275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09700737b0 0x7f0970073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.149+0000 7f0975e00700 1 --2- 172.21.15.72:0/267378275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0970074d80 0x7f09700731e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.149+0000 7f0975e00700 1 -- 172.21.15.72:0/267378275 >> 172.21.15.72:0/267378275 conn(0x7f09700fb7f0 msgr2=0x7f09700fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.150+0000 7f0975e00700 1 -- 172.21.15.72:0/267378275 shutdown_connections 2024-03-19T06:09:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.150+0000 7f0975e00700 1 -- 172.21.15.72:0/267378275 wait complete. 2024-03-19T06:09:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.151+0000 7f0975e00700 1 Processor -- start 2024-03-19T06:09:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.151+0000 7f0975e00700 1 -- start start 2024-03-19T06:09:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.151+0000 7f0975e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09700737b0 0x7f097019c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.151+0000 7f0975e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0970074d80 0x7f097019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.151+0000 7f0975e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097019cc50 con 0x7f09700737b0 2024-03-19T06:09:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.151+0000 7f0975e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097019cd90 con 0x7f0970074d80 2024-03-19T06:09:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.151+0000 7f096ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09700737b0 0x7f097019c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.151+0000 7f096ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09700737b0 0x7f097019c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43556/0 (socket says 172.21.15.72:43556) 2024-03-19T06:09:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.151+0000 7f096ea00700 1 -- 172.21.15.72:0/2304838326 learned_addr learned my addr 172.21.15.72:0/2304838326 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.152+0000 7f096ea00700 1 -- 172.21.15.72:0/2304838326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0970074d80 msgr2=0x7f097019c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.152+0000 7f096ea00700 1 --2- 172.21.15.72:0/2304838326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0970074d80 0x7f097019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.152+0000 7f096ea00700 1 -- 172.21.15.72:0/2304838326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09600095f0 con 0x7f09700737b0 2024-03-19T06:09:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.152+0000 7f096ea00700 1 --2- 172.21.15.72:0/2304838326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09700737b0 0x7f097019c0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f096000bd70 tx=0x7f096000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.152+0000 7f0974a00700 1 -- 172.21.15.72:0/2304838326 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f096001d070 con 0x7f09700737b0 2024-03-19T06:09:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.152+0000 7f0974a00700 1 -- 172.21.15.72:0/2304838326 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0960022470 con 0x7f09700737b0 2024-03-19T06:09:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.152+0000 7f0975e00700 1 -- 172.21.15.72:0/2304838326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09701a17e0 con 0x7f09700737b0 2024-03-19T06:09:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.152+0000 7f0974a00700 1 -- 172.21.15.72:0/2304838326 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f096000f670 con 0x7f09700737b0 2024-03-19T06:09:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.152+0000 7f0975e00700 1 -- 172.21.15.72:0/2304838326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09701a1cd0 con 0x7f09700737b0 2024-03-19T06:09:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.153+0000 7f0975e00700 1 -- 172.21.15.72:0/2304838326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097010f3f0 con 0x7f09700737b0 2024-03-19T06:09:06.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.154+0000 7f0974a00700 1 -- 172.21.15.72:0/2304838326 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f0960022a50 con 0x7f09700737b0 2024-03-19T06:09:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.155+0000 7f0974a00700 1 --2- 172.21.15.72:0/2304838326 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f095406dfa0 0x7f0954070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.155+0000 7f0974a00700 1 -- 172.21.15.72:0/2304838326 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f096008f2f0 con 0x7f09700737b0 2024-03-19T06:09:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.155+0000 7f096e000700 1 --2- 172.21.15.72:0/2304838326 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f095406dfa0 0x7f0954070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.156+0000 7f096e000700 1 --2- 172.21.15.72:0/2304838326 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f095406dfa0 0x7f0954070450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f095c0097b0 tx=0x7f095c006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:06.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.161+0000 7f0974a00700 1 -- 172.21.15.72:0/2304838326 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f096005c470 con 0x7f09700737b0 2024-03-19T06:09:06.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.406+0000 7f0975e00700 1 -- 172.21.15.72:0/2304838326 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f09701032f0 con 0x7f095406dfa0 2024-03-19T06:09:06.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.407+0000 7f0974a00700 1 -- 172.21.15.72:0/2304838326 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f09701032f0 con 0x7f095406dfa0 2024-03-19T06:09:06.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.410+0000 7f0975e00700 1 -- 172.21.15.72:0/2304838326 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f095406dfa0 msgr2=0x7f0954070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:06.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.410+0000 7f0975e00700 1 --2- 172.21.15.72:0/2304838326 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f095406dfa0 0x7f0954070450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f095c0097b0 tx=0x7f095c006d20 comp rx=0 tx=0).stop 2024-03-19T06:09:06.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.410+0000 7f0975e00700 1 -- 172.21.15.72:0/2304838326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09700737b0 msgr2=0x7f097019c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:06.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.410+0000 7f0975e00700 1 --2- 172.21.15.72:0/2304838326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09700737b0 0x7f097019c0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f096000bd70 tx=0x7f096000be50 comp rx=0 tx=0).stop 2024-03-19T06:09:06.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.410+0000 7f0975e00700 1 -- 172.21.15.72:0/2304838326 shutdown_connections 2024-03-19T06:09:06.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.410+0000 7f0975e00700 1 --2- 172.21.15.72:0/2304838326 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f095406dfa0 0x7f0954070450 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.410+0000 7f0975e00700 1 --2- 172.21.15.72:0/2304838326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09700737b0 0x7f097019c0f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.410+0000 7f0975e00700 1 --2- 172.21.15.72:0/2304838326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0970074d80 0x7f097019c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.410+0000 7f0975e00700 1 -- 172.21.15.72:0/2304838326 >> 172.21.15.72:0/2304838326 conn(0x7f09700fb7f0 msgr2=0x7f0970101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:06.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.411+0000 7f0975e00700 1 -- 172.21.15.72:0/2304838326 shutdown_connections 2024-03-19T06:09:06.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.411+0000 7f0975e00700 1 -- 172.21.15.72:0/2304838326 wait complete. 2024-03-19T06:09:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.565+0000 7f7705800700 1 -- 172.21.15.72:0/2706439905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77000737b0 msgr2=0x7f7700073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.565+0000 7f7705800700 1 --2- 172.21.15.72:0/2706439905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77000737b0 0x7f7700073c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009910 tx=0x7f76ec009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.565+0000 7f7705800700 1 -- 172.21.15.72:0/2706439905 shutdown_connections 2024-03-19T06:09:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.565+0000 7f7705800700 1 --2- 172.21.15.72:0/2706439905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77000737b0 0x7f7700073c20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.565+0000 7f7705800700 1 --2- 172.21.15.72:0/2706439905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7700074d80 0x7f77000731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.565+0000 7f7705800700 1 -- 172.21.15.72:0/2706439905 >> 172.21.15.72:0/2706439905 conn(0x7f77000fb7f0 msgr2=0x7f77000fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.565+0000 7f7705800700 1 -- 172.21.15.72:0/2706439905 shutdown_connections 2024-03-19T06:09:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.565+0000 7f7705800700 1 -- 172.21.15.72:0/2706439905 wait complete. 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.566+0000 7f7705800700 1 Processor -- start 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.566+0000 7f7705800700 1 -- start start 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.566+0000 7f7705800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77000737b0 0x7f770019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.566+0000 7f7705800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7700074d80 0x7f770019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.566+0000 7f7705800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770019cbd0 con 0x7f7700074d80 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.566+0000 7f7705800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770019cd10 con 0x7f77000737b0 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.567+0000 7f76fe000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7700074d80 0x7f770019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.567+0000 7f76fe000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7700074d80 0x7f770019c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43578/0 (socket says 172.21.15.72:43578) 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.567+0000 7f76fe000700 1 -- 172.21.15.72:0/2426190227 learned_addr learned my addr 172.21.15.72:0/2426190227 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.567+0000 7f76fea00700 1 --2- 172.21.15.72:0/2426190227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77000737b0 0x7f770019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.567+0000 7f76fe000700 1 -- 172.21.15.72:0/2426190227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77000737b0 msgr2=0x7f770019c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.567+0000 7f76fe000700 1 --2- 172.21.15.72:0/2426190227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77000737b0 0x7f770019c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.567+0000 7f76fe000700 1 -- 172.21.15.72:0/2426190227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec0095f0 con 0x7f7700074d80 2024-03-19T06:09:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.568+0000 7f76fe000700 1 --2- 172.21.15.72:0/2426190227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7700074d80 0x7f770019c5b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00b5c0 tx=0x7f76ec00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.568+0000 7f76f7400700 1 -- 172.21.15.72:0/2426190227 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76ec01d070 con 0x7f7700074d80 2024-03-19T06:09:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.568+0000 7f76f7400700 1 -- 172.21.15.72:0/2426190227 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f76ec00f460 con 0x7f7700074d80 2024-03-19T06:09:06.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.568+0000 7f7705800700 1 -- 172.21.15.72:0/2426190227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77001a1760 con 0x7f7700074d80 2024-03-19T06:09:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.568+0000 7f76f7400700 1 -- 172.21.15.72:0/2426190227 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76ec021640 con 0x7f7700074d80 2024-03-19T06:09:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.568+0000 7f7705800700 1 -- 172.21.15.72:0/2426190227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77001a1c50 con 0x7f7700074d80 2024-03-19T06:09:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.569+0000 7f7705800700 1 -- 172.21.15.72:0/2426190227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770010f380 con 0x7f7700074d80 2024-03-19T06:09:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.571+0000 7f76f7400700 1 -- 172.21.15.72:0/2426190227 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f76ec00f5d0 con 0x7f7700074d80 2024-03-19T06:09:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.572+0000 7f76f7400700 1 --2- 172.21.15.72:0/2426190227 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f76e406dfa0 0x7f76e4070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.572+0000 7f76f7400700 1 -- 172.21.15.72:0/2426190227 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f76ec08ef60 con 0x7f7700074d80 2024-03-19T06:09:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.572+0000 7f76fea00700 1 --2- 172.21.15.72:0/2426190227 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f76e406dfa0 0x7f76e4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.573+0000 7f76fea00700 1 --2- 172.21.15.72:0/2426190227 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f76e406dfa0 0x7f76e4070450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f76f0005950 tx=0x7f76f00058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:06.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.581+0000 7f76f7400700 1 -- 172.21.15.72:0/2426190227 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f76ec0c31e0 con 0x7f7700074d80 2024-03-19T06:09:06.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.809+0000 7f7705800700 1 -- 172.21.15.72:0/2426190227 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f77001031e0 con 0x7f76e406dfa0 2024-03-19T06:09:06.800 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:06 smithi072 ceph-mon[78545]: pgmap v53: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:09:06.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.847+0000 7f76f7400700 1 -- 172.21.15.72:0/2426190227 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f77001031e0 con 0x7f76e406dfa0 2024-03-19T06:09:06.839 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:09:06.839 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (13m) 91s ago 15m 14.2M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:09:06.839 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (15m) 91s ago 15m 8019k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:09:06.839 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (14m) 69s ago 14m 7918k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:09:06.839 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 starting - - - - 2024-03-19T06:09:06.839 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 starting - - - - 2024-03-19T06:09:06.839 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (13m) 91s ago 15m 75.1M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:09:06.839 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (8m) 91s ago 7m 15.2M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:09:06.839 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (8m) 91s ago 8m 167M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:09:06.839 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (7m) 69s ago 7m 15.4M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:09:06.839 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (8m) 69s ago 8m 161M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (4m) 91s ago 17m 477M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (2m) 69s ago 14m 448M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (114s) 91s ago 17m 29.8M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (77s) 69s ago 13m 23.0M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (15m) 91s ago 15m 7726k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (14m) 69s ago 14m 8044k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (13m) 91s ago 13m 183M 1216M 18.2.0 dc2bc1663786 27a327aa4f87 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (12m) 91s ago 12m 190M 1216M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (11m) 91s ago 11m 157M 1216M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (11m) 69s ago 11m 225M 2241M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (10m) 69s ago 10m 222M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (10m) 69s ago 10m 188M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:09:06.840 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (2m) 91s ago 14m 54.7M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:09:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.851+0000 7f7705800700 1 -- 172.21.15.72:0/2426190227 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f76e406dfa0 msgr2=0x7f76e4070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.851+0000 7f7705800700 1 --2- 172.21.15.72:0/2426190227 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f76e406dfa0 0x7f76e4070450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f76f0005950 tx=0x7f76f00058e0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.851+0000 7f7705800700 1 -- 172.21.15.72:0/2426190227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7700074d80 msgr2=0x7f770019c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.851+0000 7f7705800700 1 --2- 172.21.15.72:0/2426190227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7700074d80 0x7f770019c5b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00b5c0 tx=0x7f76ec00be20 comp rx=0 tx=0).stop 2024-03-19T06:09:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.851+0000 7f7705800700 1 -- 172.21.15.72:0/2426190227 shutdown_connections 2024-03-19T06:09:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.851+0000 7f7705800700 1 --2- 172.21.15.72:0/2426190227 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f76e406dfa0 0x7f76e4070450 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.851+0000 7f7705800700 1 --2- 172.21.15.72:0/2426190227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77000737b0 0x7f770019c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.851+0000 7f7705800700 1 --2- 172.21.15.72:0/2426190227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7700074d80 0x7f770019c5b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.851+0000 7f7705800700 1 -- 172.21.15.72:0/2426190227 >> 172.21.15.72:0/2426190227 conn(0x7f77000fb7f0 msgr2=0x7f7700101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.851+0000 7f7705800700 1 -- 172.21.15.72:0/2426190227 shutdown_connections 2024-03-19T06:09:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.852+0000 7f7705800700 1 -- 172.21.15.72:0/2426190227 wait complete. 2024-03-19T06:09:06.854 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:06 smithi172 ceph-mon[66682]: pgmap v53: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:09:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.997+0000 7f298ea00700 1 -- 172.21.15.72:0/2118750270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2988069270 msgr2=0x7f2988102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.997+0000 7f298ea00700 1 --2- 172.21.15.72:0/2118750270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2988069270 0x7f2988102dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2978009910 tx=0x7f2978009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.997+0000 7f298ea00700 1 -- 172.21.15.72:0/2118750270 shutdown_connections 2024-03-19T06:09:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.997+0000 7f298ea00700 1 --2- 172.21.15.72:0/2118750270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2988103310 0x7f2988105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.997+0000 7f298ea00700 1 --2- 172.21.15.72:0/2118750270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2988069270 0x7f2988102dd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.997+0000 7f298ea00700 1 -- 172.21.15.72:0/2118750270 >> 172.21.15.72:0/2118750270 conn(0x7f29880fa780 msgr2=0x7f29880fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.997+0000 7f298ea00700 1 -- 172.21.15.72:0/2118750270 shutdown_connections 2024-03-19T06:09:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.997+0000 7f298ea00700 1 -- 172.21.15.72:0/2118750270 wait complete. 2024-03-19T06:09:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.998+0000 7f298ea00700 1 Processor -- start 2024-03-19T06:09:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.999+0000 7f298ea00700 1 -- start start 2024-03-19T06:09:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.999+0000 7f298ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2988103310 0x7f2988100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.999+0000 7f298ea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29880fed70 0x7f29880ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.999+0000 7f298ea00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880ff720 con 0x7f2988103310 2024-03-19T06:09:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.999+0000 7f298ea00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880ff890 con 0x7f29880fed70 2024-03-19T06:09:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.999+0000 7f2987e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2988103310 0x7f2988100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.999+0000 7f2987e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2988103310 0x7f2988100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43582/0 (socket says 172.21.15.72:43582) 2024-03-19T06:09:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:06.999+0000 7f2987e00700 1 -- 172.21.15.72:0/3942112403 learned_addr learned my addr 172.21.15.72:0/3942112403 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.000+0000 7f2987e00700 1 -- 172.21.15.72:0/3942112403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29880fed70 msgr2=0x7f29880ff1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.000+0000 7f2987400700 1 --2- 172.21.15.72:0/3942112403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29880fed70 0x7f29880ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.000+0000 7f2987e00700 1 --2- 172.21.15.72:0/3942112403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29880fed70 0x7f29880ff1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.000+0000 7f2987e00700 1 -- 172.21.15.72:0/3942112403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29780095f0 con 0x7f2988103310 2024-03-19T06:09:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.000+0000 7f2987e00700 1 --2- 172.21.15.72:0/3942112403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2988103310 0x7f2988100720 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f297800bd70 tx=0x7f297800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.001+0000 7f2984c00700 1 -- 172.21.15.72:0/3942112403 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297801d070 con 0x7f2988103310 2024-03-19T06:09:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.001+0000 7f2984c00700 1 -- 172.21.15.72:0/3942112403 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f297800f460 con 0x7f2988103310 2024-03-19T06:09:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.001+0000 7f298ea00700 1 -- 172.21.15.72:0/3942112403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29880ffb10 con 0x7f2988103310 2024-03-19T06:09:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.001+0000 7f2984c00700 1 -- 172.21.15.72:0/3942112403 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2978021620 con 0x7f2988103310 2024-03-19T06:09:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.001+0000 7f298ea00700 1 -- 172.21.15.72:0/3942112403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298819dcf0 con 0x7f2988103310 2024-03-19T06:09:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.002+0000 7f298ea00700 1 -- 172.21.15.72:0/3942112403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298818fbd0 con 0x7f2988103310 2024-03-19T06:09:06.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.003+0000 7f2984c00700 1 -- 172.21.15.72:0/3942112403 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f2978003a60 con 0x7f2988103310 2024-03-19T06:09:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.004+0000 7f2984c00700 1 --2- 172.21.15.72:0/3942112403 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f296c06dfa0 0x7f296c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.004+0000 7f2984c00700 1 -- 172.21.15.72:0/3942112403 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f297808ef80 con 0x7f2988103310 2024-03-19T06:09:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.004+0000 7f2987400700 1 --2- 172.21.15.72:0/3942112403 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f296c06dfa0 0x7f296c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.005+0000 7f2987400700 1 --2- 172.21.15.72:0/3942112403 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f296c06dfa0 0x7f296c070450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2974005950 tx=0x7f29740058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.009+0000 7f2984c00700 1 -- 172.21.15.72:0/3942112403 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f297805bfb0 con 0x7f2988103310 2024-03-19T06:09:07.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.330+0000 7f298ea00700 1 -- 172.21.15.72:0/3942112403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2988069270 con 0x7f2988103310 2024-03-19T06:09:07.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.331+0000 7f2984c00700 1 -- 172.21.15.72:0/3942112403 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f297805bb40 con 0x7f2988103310 2024-03-19T06:09:07.322 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:09:07.322 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:09:07.322 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:09:07.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:09:07.322 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:09:07.322 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:09:07.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:09:07.322 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:09:07.322 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-03-19T06:09:07.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:09:07.323 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:09:07.323 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:09:07.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:09:07.323 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:09:07.323 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-03-19T06:09:07.323 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 4 2024-03-19T06:09:07.323 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:09:07.323 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:09:07.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.334+0000 7f298ea00700 1 -- 172.21.15.72:0/3942112403 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f296c06dfa0 msgr2=0x7f296c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:07.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.334+0000 7f298ea00700 1 --2- 172.21.15.72:0/3942112403 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f296c06dfa0 0x7f296c070450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2974005950 tx=0x7f29740058e0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.334+0000 7f298ea00700 1 -- 172.21.15.72:0/3942112403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2988103310 msgr2=0x7f2988100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:07.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.334+0000 7f298ea00700 1 --2- 172.21.15.72:0/3942112403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2988103310 0x7f2988100720 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f297800bd70 tx=0x7f297800be50 comp rx=0 tx=0).stop 2024-03-19T06:09:07.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.334+0000 7f298ea00700 1 -- 172.21.15.72:0/3942112403 shutdown_connections 2024-03-19T06:09:07.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.334+0000 7f298ea00700 1 --2- 172.21.15.72:0/3942112403 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f296c06dfa0 0x7f296c070450 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.334+0000 7f298ea00700 1 --2- 172.21.15.72:0/3942112403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2988103310 0x7f2988100720 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.334+0000 7f298ea00700 1 --2- 172.21.15.72:0/3942112403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29880fed70 0x7f29880ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.334+0000 7f298ea00700 1 -- 172.21.15.72:0/3942112403 >> 172.21.15.72:0/3942112403 conn(0x7f29880fa780 msgr2=0x7f29880fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:07.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.335+0000 7f298ea00700 1 -- 172.21.15.72:0/3942112403 shutdown_connections 2024-03-19T06:09:07.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.335+0000 7f298ea00700 1 -- 172.21.15.72:0/3942112403 wait complete. 2024-03-19T06:09:07.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.478+0000 7f4e3c600700 1 -- 172.21.15.72:0/558589034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e34103680 msgr2=0x7f4e34105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.478+0000 7f4e3c600700 1 --2- 172.21.15.72:0/558589034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e34103680 0x7f4e34105a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009910 tx=0x7f4e20009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.478+0000 7f4e3c600700 1 -- 172.21.15.72:0/558589034 shutdown_connections 2024-03-19T06:09:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.478+0000 7f4e3c600700 1 --2- 172.21.15.72:0/558589034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e34103680 0x7f4e34105a60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.478+0000 7f4e3c600700 1 --2- 172.21.15.72:0/558589034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e34100d60 0x7f4e34103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.478+0000 7f4e3c600700 1 -- 172.21.15.72:0/558589034 >> 172.21.15.72:0/558589034 conn(0x7f4e340fa780 msgr2=0x7f4e340fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.478+0000 7f4e3c600700 1 -- 172.21.15.72:0/558589034 shutdown_connections 2024-03-19T06:09:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.478+0000 7f4e3c600700 1 -- 172.21.15.72:0/558589034 wait complete. 2024-03-19T06:09:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.479+0000 7f4e3c600700 1 Processor -- start 2024-03-19T06:09:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.479+0000 7f4e3c600700 1 -- start start 2024-03-19T06:09:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.480+0000 7f4e3c600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e34100d60 0x7f4e34197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.480+0000 7f4e3c600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e34103680 0x7f4e34198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:07.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.480+0000 7f4e3c600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34198870 con 0x7f4e34103680 2024-03-19T06:09:07.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.480+0000 7f4e3c600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3419d280 con 0x7f4e34100d60 2024-03-19T06:09:07.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.480+0000 7f4e39200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e34103680 0x7f4e34198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:07.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.480+0000 7f4e39200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e34103680 0x7f4e34198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43606/0 (socket says 172.21.15.72:43606) 2024-03-19T06:09:07.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.480+0000 7f4e39200700 1 -- 172.21.15.72:0/975234934 learned_addr learned my addr 172.21.15.72:0/975234934 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:07.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.480+0000 7f4e39c00700 1 --2- 172.21.15.72:0/975234934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e34100d60 0x7f4e34197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:07.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.481+0000 7f4e39200700 1 -- 172.21.15.72:0/975234934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e34100d60 msgr2=0x7f4e34197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:07.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.481+0000 7f4e39200700 1 --2- 172.21.15.72:0/975234934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e34100d60 0x7f4e34197d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.481+0000 7f4e39200700 1 -- 172.21.15.72:0/975234934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e200095f0 con 0x7f4e34103680 2024-03-19T06:09:07.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.481+0000 7f4e39200700 1 --2- 172.21.15.72:0/975234934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e34103680 0x7f4e34198250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4e20006010 tx=0x7f4e2000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:07.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.481+0000 7f4e32000700 1 -- 172.21.15.72:0/975234934 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e2001d070 con 0x7f4e34103680 2024-03-19T06:09:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.481+0000 7f4e32000700 1 -- 172.21.15.72:0/975234934 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4e2000f460 con 0x7f4e34103680 2024-03-19T06:09:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.481+0000 7f4e3c600700 1 -- 172.21.15.72:0/975234934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3419d420 con 0x7f4e34103680 2024-03-19T06:09:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.482+0000 7f4e32000700 1 -- 172.21.15.72:0/975234934 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e20021640 con 0x7f4e34103680 2024-03-19T06:09:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.482+0000 7f4e3c600700 1 -- 172.21.15.72:0/975234934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3419d8e0 con 0x7f4e34103680 2024-03-19T06:09:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.483+0000 7f4e3c600700 1 -- 172.21.15.72:0/975234934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e340fc340 con 0x7f4e34103680 2024-03-19T06:09:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.484+0000 7f4e32000700 1 -- 172.21.15.72:0/975234934 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f4e2000fab0 con 0x7f4e34103680 2024-03-19T06:09:07.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.485+0000 7f4e32000700 1 --2- 172.21.15.72:0/975234934 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4e1c06dfa0 0x7f4e1c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:07.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.485+0000 7f4e32000700 1 -- 172.21.15.72:0/975234934 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4e2008f110 con 0x7f4e34103680 2024-03-19T06:09:07.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.486+0000 7f4e39c00700 1 --2- 172.21.15.72:0/975234934 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4e1c06dfa0 0x7f4e1c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:07.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.487+0000 7f4e39c00700 1 --2- 172.21.15.72:0/975234934 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4e1c06dfa0 0x7f4e1c070450 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4e28005950 tx=0x7f4e28005eb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:07.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.490+0000 7f4e32000700 1 -- 172.21.15.72:0/975234934 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f4e20058610 con 0x7f4e34103680 2024-03-19T06:09:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.760+0000 7f4e3c600700 1 -- 172.21.15.72:0/975234934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4e3402cc30 con 0x7f4e34103680 2024-03-19T06:09:07.752 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:07 smithi072 ceph-mon[78545]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:07.752 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:07 smithi072 ceph-mon[78545]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:07.752 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:07 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3942112403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:07.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.761+0000 7f4e32000700 1 -- 172.21.15.72:0/975234934 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1886 (secure 0 0 0) 0x7f4e2005bcd0 con 0x7f4e34103680 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout:e15 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 15 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:04:57.207619+0000 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:09:07.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.764+0000 7f4e3c600700 1 -- 172.21.15.72:0/975234934 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4e1c06dfa0 msgr2=0x7f4e1c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:07.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.764+0000 7f4e3c600700 1 --2- 172.21.15.72:0/975234934 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4e1c06dfa0 0x7f4e1c070450 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4e28005950 tx=0x7f4e28005eb0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.764+0000 7f4e3c600700 1 -- 172.21.15.72:0/975234934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e34103680 msgr2=0x7f4e34198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:07.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.764+0000 7f4e3c600700 1 --2- 172.21.15.72:0/975234934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e34103680 0x7f4e34198250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4e20006010 tx=0x7f4e2000be20 comp rx=0 tx=0).stop 2024-03-19T06:09:07.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.764+0000 7f4e3c600700 1 -- 172.21.15.72:0/975234934 shutdown_connections 2024-03-19T06:09:07.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.764+0000 7f4e3c600700 1 --2- 172.21.15.72:0/975234934 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4e1c06dfa0 0x7f4e1c070450 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.764+0000 7f4e3c600700 1 --2- 172.21.15.72:0/975234934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e34100d60 0x7f4e34197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.764+0000 7f4e3c600700 1 --2- 172.21.15.72:0/975234934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e34103680 0x7f4e34198250 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.764+0000 7f4e3c600700 1 -- 172.21.15.72:0/975234934 >> 172.21.15.72:0/975234934 conn(0x7f4e340fa780 msgr2=0x7f4e34100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:07.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.764+0000 7f4e3c600700 1 -- 172.21.15.72:0/975234934 shutdown_connections 2024-03-19T06:09:07.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.764+0000 7f4e3c600700 1 -- 172.21.15.72:0/975234934 wait complete. 2024-03-19T06:09:07.757 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2024-03-19T06:09:07.823 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:07 smithi172 ceph-mon[66682]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:07.823 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:07 smithi172 ceph-mon[66682]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:07.823 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:07 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3942112403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:07.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.911+0000 7fc10b800700 1 -- 172.21.15.72:0/3244885144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc104106840 msgr2=0x7fc104106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:07.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.911+0000 7fc10b800700 1 --2- 172.21.15.72:0/3244885144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc104106840 0x7fc104106c50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009910 tx=0x7fc0f8009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:07.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.911+0000 7fc10b800700 1 -- 172.21.15.72:0/3244885144 shutdown_connections 2024-03-19T06:09:07.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.911+0000 7fc10b800700 1 --2- 172.21.15.72:0/3244885144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc104107a40 0x7fc104107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.911+0000 7fc10b800700 1 --2- 172.21.15.72:0/3244885144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc104106840 0x7fc104106c50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.911+0000 7fc10b800700 1 -- 172.21.15.72:0/3244885144 >> 172.21.15.72:0/3244885144 conn(0x7fc104075970 msgr2=0x7fc104077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:07.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.911+0000 7fc10b800700 1 -- 172.21.15.72:0/3244885144 shutdown_connections 2024-03-19T06:09:07.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.911+0000 7fc10b800700 1 -- 172.21.15.72:0/3244885144 wait complete. 2024-03-19T06:09:07.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.912+0000 7fc10b800700 1 Processor -- start 2024-03-19T06:09:07.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.913+0000 7fc10b800700 1 -- start start 2024-03-19T06:09:07.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.913+0000 7fc10b800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc104106840 0x7fc10419c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:07.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.913+0000 7fc10b800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc104107a40 0x7fc10419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:07.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.913+0000 7fc10b800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10419cbd0 con 0x7fc104106840 2024-03-19T06:09:07.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.913+0000 7fc10b800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10419cd10 con 0x7fc104107a40 2024-03-19T06:09:07.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.913+0000 7fc108e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc104106840 0x7fc10419c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:07.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.913+0000 7fc108e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc104106840 0x7fc10419c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43622/0 (socket says 172.21.15.72:43622) 2024-03-19T06:09:07.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.913+0000 7fc108e00700 1 -- 172.21.15.72:0/2971939039 learned_addr learned my addr 172.21.15.72:0/2971939039 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:07.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.913+0000 7fc108e00700 1 -- 172.21.15.72:0/2971939039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc104107a40 msgr2=0x7fc10419c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:07.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.913+0000 7fc108e00700 1 --2- 172.21.15.72:0/2971939039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc104107a40 0x7fc10419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:07.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.913+0000 7fc108e00700 1 -- 172.21.15.72:0/2971939039 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f80095f0 con 0x7fc104106840 2024-03-19T06:09:07.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.914+0000 7fc108e00700 1 --2- 172.21.15.72:0/2971939039 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc104106840 0x7fc10419c100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800bd70 tx=0x7fc0f800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:07.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.914+0000 7fc101600700 1 -- 172.21.15.72:0/2971939039 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f801d070 con 0x7fc104106840 2024-03-19T06:09:07.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.914+0000 7fc101600700 1 -- 172.21.15.72:0/2971939039 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc0f800f460 con 0x7fc104106840 2024-03-19T06:09:07.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.914+0000 7fc101600700 1 -- 172.21.15.72:0/2971939039 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f8021640 con 0x7fc104106840 2024-03-19T06:09:07.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.914+0000 7fc10b800700 1 -- 172.21.15.72:0/2971939039 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1041a1770 con 0x7fc104106840 2024-03-19T06:09:07.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.914+0000 7fc10b800700 1 -- 172.21.15.72:0/2971939039 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1041a1be0 con 0x7fc104106840 2024-03-19T06:09:07.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.915+0000 7fc10b800700 1 -- 172.21.15.72:0/2971939039 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10410f390 con 0x7fc104106840 2024-03-19T06:09:07.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.916+0000 7fc101600700 1 -- 172.21.15.72:0/2971939039 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fc0f800fab0 con 0x7fc104106840 2024-03-19T06:09:07.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.917+0000 7fc101600700 1 --2- 172.21.15.72:0/2971939039 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc0ec06dfa0 0x7fc0ec070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:07.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.917+0000 7fc101600700 1 -- 172.21.15.72:0/2971939039 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc0f808f0e0 con 0x7fc104106840 2024-03-19T06:09:07.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.917+0000 7fc103e00700 1 --2- 172.21.15.72:0/2971939039 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc0ec06dfa0 0x7fc0ec070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:07.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.918+0000 7fc103e00700 1 --2- 172.21.15.72:0/2971939039 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc0ec06dfa0 0x7fc0ec070450 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0005fd0 tx=0x7fc0f0005d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:07.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:07.922+0000 7fc101600700 1 -- 172.21.15.72:0/2971939039 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fc0f805c110 con 0x7fc104106840 2024-03-19T06:09:08.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.160+0000 7fc10b800700 1 -- 172.21.15.72:0/2971939039 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1041a2330 con 0x7fc0ec06dfa0 2024-03-19T06:09:08.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.162+0000 7fc101600700 1 -- 172.21.15.72:0/2971939039 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fc1041a2330 con 0x7fc0ec06dfa0 2024-03-19T06:09:08.153 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:09:08.153 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:09:08.153 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:09:08.153 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:09:08.153 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:09:08.153 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:09:08.153 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:09:08.153 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:09:08.153 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "4/23 daemons upgraded", 2024-03-19T06:09:08.153 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading crash daemons", 2024-03-19T06:09:08.153 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:09:08.153 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:09:08.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.164+0000 7fc10b800700 1 -- 172.21.15.72:0/2971939039 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc0ec06dfa0 msgr2=0x7fc0ec070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:08.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.164+0000 7fc10b800700 1 --2- 172.21.15.72:0/2971939039 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc0ec06dfa0 0x7fc0ec070450 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0005fd0 tx=0x7fc0f0005d00 comp rx=0 tx=0).stop 2024-03-19T06:09:08.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.164+0000 7fc10b800700 1 -- 172.21.15.72:0/2971939039 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc104106840 msgr2=0x7fc10419c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:08.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.164+0000 7fc10b800700 1 --2- 172.21.15.72:0/2971939039 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc104106840 0x7fc10419c100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800bd70 tx=0x7fc0f800be50 comp rx=0 tx=0).stop 2024-03-19T06:09:08.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.165+0000 7fc10b800700 1 -- 172.21.15.72:0/2971939039 shutdown_connections 2024-03-19T06:09:08.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.165+0000 7fc10b800700 1 --2- 172.21.15.72:0/2971939039 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc0ec06dfa0 0x7fc0ec070450 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:08.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.165+0000 7fc10b800700 1 --2- 172.21.15.72:0/2971939039 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc104106840 0x7fc10419c100 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:08.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.165+0000 7fc10b800700 1 --2- 172.21.15.72:0/2971939039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc104107a40 0x7fc10419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:08.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.165+0000 7fc10b800700 1 -- 172.21.15.72:0/2971939039 >> 172.21.15.72:0/2971939039 conn(0x7fc104075970 msgr2=0x7fc10410ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:08.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.165+0000 7fc10b800700 1 -- 172.21.15.72:0/2971939039 shutdown_connections 2024-03-19T06:09:08.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.165+0000 7fc10b800700 1 -- 172.21.15.72:0/2971939039 wait complete. 2024-03-19T06:09:08.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.319+0000 7f85fec00700 1 -- 172.21.15.72:0/1043988625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8100240 msgr2=0x7f85f8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:08.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.319+0000 7f85fec00700 1 --2- 172.21.15.72:0/1043988625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8100240 0x7f85f8100650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009910 tx=0x7f85e8009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.319+0000 7f85fec00700 1 -- 172.21.15.72:0/1043988625 shutdown_connections 2024-03-19T06:09:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.319+0000 7f85fec00700 1 --2- 172.21.15.72:0/1043988625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85f8101440 0x7f85f8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.319+0000 7f85fec00700 1 --2- 172.21.15.72:0/1043988625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8100240 0x7f85f8100650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.319+0000 7f85fec00700 1 -- 172.21.15.72:0/1043988625 >> 172.21.15.72:0/1043988625 conn(0x7f85f80fb7f0 msgr2=0x7f85f80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.319+0000 7f85fec00700 1 -- 172.21.15.72:0/1043988625 shutdown_connections 2024-03-19T06:09:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.320+0000 7f85fec00700 1 -- 172.21.15.72:0/1043988625 wait complete. 2024-03-19T06:09:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.321+0000 7f85fec00700 1 Processor -- start 2024-03-19T06:09:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.321+0000 7f85fec00700 1 -- start start 2024-03-19T06:09:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.321+0000 7f85fec00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8100240 0x7f85f8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.321+0000 7f85fec00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85f8101440 0x7f85f8073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.321+0000 7f85fec00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8073680 con 0x7f85f8100240 2024-03-19T06:09:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.321+0000 7f85fec00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80737c0 con 0x7f85f8101440 2024-03-19T06:09:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.321+0000 7f85f7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8100240 0x7f85f8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.321+0000 7f85f7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8100240 0x7f85f8074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43626/0 (socket says 172.21.15.72:43626) 2024-03-19T06:09:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.322+0000 7f85f7e00700 1 -- 172.21.15.72:0/2301753432 learned_addr learned my addr 172.21.15.72:0/2301753432 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.322+0000 7f85f7400700 1 --2- 172.21.15.72:0/2301753432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85f8101440 0x7f85f8073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.322+0000 7f85f7e00700 1 -- 172.21.15.72:0/2301753432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85f8101440 msgr2=0x7f85f8073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.322+0000 7f85f7e00700 1 --2- 172.21.15.72:0/2301753432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85f8101440 0x7f85f8073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.322+0000 7f85f7e00700 1 -- 172.21.15.72:0/2301753432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e80095f0 con 0x7f85f8100240 2024-03-19T06:09:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.322+0000 7f85f7e00700 1 --2- 172.21.15.72:0/2301753432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8100240 0x7f85f8074af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f85e800bda0 tx=0x7f85e800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.322+0000 7f85f4c00700 1 -- 172.21.15.72:0/2301753432 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85e801d070 con 0x7f85f8100240 2024-03-19T06:09:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.323+0000 7f85f4c00700 1 -- 172.21.15.72:0/2301753432 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f85e800f460 con 0x7f85f8100240 2024-03-19T06:09:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.323+0000 7f85fec00700 1 -- 172.21.15.72:0/2301753432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f8073a40 con 0x7f85f8100240 2024-03-19T06:09:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.323+0000 7f85f4c00700 1 -- 172.21.15.72:0/2301753432 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85e8021640 con 0x7f85f8100240 2024-03-19T06:09:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.323+0000 7f85fec00700 1 -- 172.21.15.72:0/2301753432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f8073f30 con 0x7f85f8100240 2024-03-19T06:09:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.324+0000 7f85fec00700 1 -- 172.21.15.72:0/2301753432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f8108d90 con 0x7f85f8100240 2024-03-19T06:09:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.326+0000 7f85f4c00700 1 -- 172.21.15.72:0/2301753432 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f85e800f5d0 con 0x7f85f8100240 2024-03-19T06:09:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.327+0000 7f85f4c00700 1 --2- 172.21.15.72:0/2301753432 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f85dc06dfa0 0x7f85dc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.327+0000 7f85f4c00700 1 -- 172.21.15.72:0/2301753432 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f85e808f3f0 con 0x7f85f8100240 2024-03-19T06:09:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.328+0000 7f85f7400700 1 --2- 172.21.15.72:0/2301753432 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f85dc06dfa0 0x7f85dc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.328+0000 7f85f7400700 1 --2- 172.21.15.72:0/2301753432 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f85dc06dfa0 0x7f85dc070450 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f85e4005950 tx=0x7f85e400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.331+0000 7f85f4c00700 1 -- 172.21.15.72:0/2301753432 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f85e805c4c0 con 0x7f85f8100240 2024-03-19T06:09:08.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:08 smithi072 ceph-mon[78545]: pgmap v54: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:09:08.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:08 smithi072 ceph-mon[78545]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:08.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:08 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/975234934' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:09:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.639+0000 7f85fec00700 1 -- 172.21.15.72:0/2301753432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f85f8108f80 con 0x7f85f8100240 2024-03-19T06:09:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.640+0000 7f85f4c00700 1 -- 172.21.15.72:0/2301753432 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f85e805c050 con 0x7f85f8100240 2024-03-19T06:09:08.631 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:09:08.631 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:09:08.631 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:09:08.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.642+0000 7f85fec00700 1 -- 172.21.15.72:0/2301753432 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f85dc06dfa0 msgr2=0x7f85dc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:08.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.642+0000 7f85fec00700 1 --2- 172.21.15.72:0/2301753432 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f85dc06dfa0 0x7f85dc070450 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f85e4005950 tx=0x7f85e400b410 comp rx=0 tx=0).stop 2024-03-19T06:09:08.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.642+0000 7f85fec00700 1 -- 172.21.15.72:0/2301753432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8100240 msgr2=0x7f85f8074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:08.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.642+0000 7f85fec00700 1 --2- 172.21.15.72:0/2301753432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8100240 0x7f85f8074af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f85e800bda0 tx=0x7f85e800bdd0 comp rx=0 tx=0).stop 2024-03-19T06:09:08.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.643+0000 7f85fec00700 1 -- 172.21.15.72:0/2301753432 shutdown_connections 2024-03-19T06:09:08.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.643+0000 7f85fec00700 1 --2- 172.21.15.72:0/2301753432 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f85dc06dfa0 0x7f85dc070450 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:08.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.643+0000 7f85fec00700 1 --2- 172.21.15.72:0/2301753432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8100240 0x7f85f8074af0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:08.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.643+0000 7f85fec00700 1 --2- 172.21.15.72:0/2301753432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85f8101440 0x7f85f8073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:08.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.643+0000 7f85fec00700 1 -- 172.21.15.72:0/2301753432 >> 172.21.15.72:0/2301753432 conn(0x7f85f80fb7f0 msgr2=0x7f85f8104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:08.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.643+0000 7f85fec00700 1 -- 172.21.15.72:0/2301753432 shutdown_connections 2024-03-19T06:09:08.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:08.643+0000 7f85fec00700 1 -- 172.21.15.72:0/2301753432 wait complete. 2024-03-19T06:09:08.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:08 smithi172 ceph-mon[66682]: pgmap v54: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-19T06:09:08.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:08 smithi172 ceph-mon[66682]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:08.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:08 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/975234934' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:09:09.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:09 smithi072 ceph-mon[78545]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:09.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:09 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2301753432' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:09:09.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:09.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:09.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:09 smithi172 ceph-mon[66682]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:09.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:09 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2301753432' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:09:09.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:09.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:10.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:10 smithi172 ceph-mon[66682]: pgmap v55: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:10.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:09:10.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:10 smithi072 ceph-mon[78545]: pgmap v55: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:10.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:09:12.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:12 smithi072 ceph-mon[78545]: pgmap v56: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:12.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:12 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:12.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:12 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:12.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:12 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:12.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:12 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:12.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:12 smithi172 ceph-mon[66682]: pgmap v56: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:12.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:12 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:12.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:12 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:12.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:12 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:12.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:12 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:14.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:14 smithi172 ceph-mon[66682]: pgmap v57: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:14.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:14 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:14.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:14 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:14.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:14 smithi072 ceph-mon[78545]: pgmap v57: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:14.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:14 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:14.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:14 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:16.742 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:16 smithi072 ceph-mon[78545]: pgmap v58: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:16.742 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:16 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:16.742 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:16 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:16.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:16 smithi172 ceph-mon[66682]: pgmap v58: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:16.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:16 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:16.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:16 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:18.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:18 smithi072 ceph-mon[78545]: pgmap v59: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:18.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:18 smithi172 ceph-mon[66682]: pgmap v59: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:19.765 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:19.765 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:19.765 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:09:19.765 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:09:19.765 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:19.765 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:09:19.766 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:19.766 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:19.766 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:19.766 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:19.766 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi072"}]: dispatch 2024-03-19T06:09:19.766 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi072"}]': finished 2024-03-19T06:09:19.766 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi172"}]: dispatch 2024-03-19T06:09:19.766 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi172"}]': finished 2024-03-19T06:09:19.766 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-19T06:09:19.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:19.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:19.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:09:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:09:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:09:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi072"}]: dispatch 2024-03-19T06:09:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi072"}]': finished 2024-03-19T06:09:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi172"}]: dispatch 2024-03-19T06:09:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi172"}]': finished 2024-03-19T06:09:19.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-19T06:09:20.803 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:20 smithi072 ceph-mon[78545]: pgmap v60: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:20.804 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:20 smithi072 ceph-mon[78545]: Upgrade: Setting container_image for all crash 2024-03-19T06:09:20.804 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:20 smithi072 ceph-mon[78545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-19T06:09:20.804 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:20 smithi072 ceph-mon[78545]: Upgrade: osd.0 is safe to restart 2024-03-19T06:09:20.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:20 smithi172 ceph-mon[66682]: pgmap v60: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:20.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:20 smithi172 ceph-mon[66682]: Upgrade: Setting container_image for all crash 2024-03-19T06:09:20.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:20 smithi172 ceph-mon[66682]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-19T06:09:20.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:20 smithi172 ceph-mon[66682]: Upgrade: osd.0 is safe to restart 2024-03-19T06:09:22.255 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:22 smithi072 ceph-mon[78545]: pgmap v61: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:22.255 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:22 smithi072 ceph-mon[78545]: Upgrade: Updating osd.0 2024-03-19T06:09:22.255 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:22.255 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-19T06:09:22.256 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:09:22.256 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:22 smithi072 ceph-mon[78545]: Deploying daemon osd.0 on smithi072 2024-03-19T06:09:22.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:22 smithi172 ceph-mon[66682]: pgmap v61: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:22.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:22 smithi172 ceph-mon[66682]: Upgrade: Updating osd.0 2024-03-19T06:09:22.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:22.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-19T06:09:22.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:09:22.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:22 smithi172 ceph-mon[66682]: Deploying daemon osd.0 on smithi072 2024-03-19T06:09:24.185 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:24 smithi072 ceph-mon[78545]: pgmap v62: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:24.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:24 smithi172 ceph-mon[66682]: pgmap v62: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:25.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:25 smithi072 ceph-mon[78545]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:09:25.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:09:25.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:25 smithi172 ceph-mon[66682]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:09:25.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:09:26.076 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:25 smithi072 systemd[1]: Stopping Ceph osd.0 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:09:26.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:26 smithi172 ceph-mon[66682]: pgmap v63: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:26.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:26 smithi172 ceph-mon[66682]: osd.0 marked itself down and dead 2024-03-19T06:09:26.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:26 smithi072 ceph-mon[78545]: pgmap v63: 65 pgs: 65 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:26.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:26 smithi072 ceph-mon[78545]: osd.0 marked itself down and dead 2024-03-19T06:09:26.576 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:26 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0[43545]: 2024-03-19T06:09:26.102+0000 7ff0a6800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:09:26.576 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:26 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0[43545]: 2024-03-19T06:09:26.102+0000 7ff0a6800700 -1 osd.0 48 *** Got signal Terminated *** 2024-03-19T06:09:26.576 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:26 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0[43545]: 2024-03-19T06:09:26.102+0000 7ff0a6800700 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-19T06:09:27.022 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:26 smithi072 podman[84820]: 2024-03-19 06:09:26.64700506 +0000 UTC m=+0.681848841 container died 27a327aa4f87c5de608c1ca32ac5d5e3a4461380819373ac3d22c97225bdfe12 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD) 2024-03-19T06:09:27.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:27 smithi072 ceph-mon[78545]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-19T06:09:27.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:27 smithi072 ceph-mon[78545]: osdmap e49: 6 total, 5 up, 6 in 2024-03-19T06:09:27.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:27 smithi072 ceph-mon[78545]: osdmap e50: 6 total, 5 up, 6 in 2024-03-19T06:09:27.326 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:27 smithi072 podman[84820]: 2024-03-19 06:09:27.150791754 +0000 UTC m=+1.185635554 container cleanup 27a327aa4f87c5de608c1ca32ac5d5e3a4461380819373ac3d22c97225bdfe12 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1) 2024-03-19T06:09:27.326 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:27 smithi072 bash[84820]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0 2024-03-19T06:09:27.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:27 smithi172 ceph-mon[66682]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-19T06:09:27.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:27 smithi172 ceph-mon[66682]: osdmap e49: 6 total, 5 up, 6 in 2024-03-19T06:09:27.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:27 smithi172 ceph-mon[66682]: osdmap e50: 6 total, 5 up, 6 in 2024-03-19T06:09:27.825 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:27 smithi072 podman[84839]: 2024-03-19 06:09:27.345254341 +0000 UTC m=+0.684217577 container remove 27a327aa4f87c5de608c1ca32ac5d5e3a4461380819373ac3d22c97225bdfe12 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1) 2024-03-19T06:09:28.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:28 smithi072 ceph-mon[78545]: pgmap v65: 65 pgs: 9 stale+active+clean, 56 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:28.325 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:28 smithi072 podman[84928]: 2024-03-19 06:09:28.122587951 +0000 UTC m=+0.034277398 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:09:28.326 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:28 smithi072 podman[84928]: 2024-03-19 06:09:28.249154682 +0000 UTC m=+0.160844160 container create c5a9f92b15fa410e46ee3ed04d7f4d905856e98f53cdd66549702b7558a52ea2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:09:28.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:28 smithi172 ceph-mon[66682]: pgmap v65: 65 pgs: 9 stale+active+clean, 56 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:28.825 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:28 smithi072 podman[84928]: 2024-03-19 06:09:28.571303424 +0000 UTC m=+0.482992909 container init c5a9f92b15fa410e46ee3ed04d7f4d905856e98f53cdd66549702b7558a52ea2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271) 2024-03-19T06:09:28.826 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:28 smithi072 podman[84928]: 2024-03-19 06:09:28.582422944 +0000 UTC m=+0.494112395 container start c5a9f92b15fa410e46ee3ed04d7f4d905856e98f53cdd66549702b7558a52ea2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, ceph=True, org.label-schema.vendor=CentOS) 2024-03-19T06:09:28.826 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:28 smithi072 podman[84928]: 2024-03-19 06:09:28.678910165 +0000 UTC m=+0.590599666 container attach c5a9f92b15fa410e46ee3ed04d7f4d905856e98f53cdd66549702b7558a52ea2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-19T06:09:29.325 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:29 smithi072 podman[84928]: 2024-03-19 06:09:29.019676888 +0000 UTC m=+0.931366329 container died c5a9f92b15fa410e46ee3ed04d7f4d905856e98f53cdd66549702b7558a52ea2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-deactivate, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:09:30.076 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:29 smithi072 podman[84953]: 2024-03-19 06:09:29.771141986 +0000 UTC m=+0.732592164 container remove c5a9f92b15fa410e46ee3ed04d7f4d905856e98f53cdd66549702b7558a52ea2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-19T06:09:30.076 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:29 smithi072 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.0.service: Deactivated successfully. 2024-03-19T06:09:30.076 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:29 smithi072 systemd[1]: Stopped Ceph osd.0 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:09:30.076 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:29 smithi072 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.0.service: Consumed 1min 38.330s CPU time. 2024-03-19T06:09:30.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:30 smithi172 ceph-mon[66682]: pgmap v67: 65 pgs: 9 stale+active+clean, 56 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:30.539 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:30 smithi072 ceph-mon[78545]: pgmap v67: 65 pgs: 9 stale+active+clean, 56 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:30.540 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:30 smithi072 systemd[1]: Starting Ceph osd.0 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:09:30.814 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:30 smithi072 podman[85058]: 2024-03-19 06:09:30.45346037 +0000 UTC m=+0.033895521 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:09:30.814 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:30 smithi072 podman[85058]: 2024-03-19 06:09:30.556942922 +0000 UTC m=+0.137378089 container create 46fa99475c0cf124f3b9f436ce7a98b4c61dbe37206bae45059eed1e1d04387c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, ceph=True) 2024-03-19T06:09:30.814 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:30 smithi072 podman[85058]: 2024-03-19 06:09:30.823293388 +0000 UTC m=+0.403728571 container init 46fa99475c0cf124f3b9f436ce7a98b4c61dbe37206bae45059eed1e1d04387c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222) 2024-03-19T06:09:31.075 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:30 smithi072 podman[85058]: 2024-03-19 06:09:30.835599059 +0000 UTC m=+0.416034215 container start 46fa99475c0cf124f3b9f436ce7a98b4c61dbe37206bae45059eed1e1d04387c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271) 2024-03-19T06:09:31.075 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:30 smithi072 podman[85058]: 2024-03-19 06:09:30.980864194 +0000 UTC m=+0.561299420 container attach 46fa99475c0cf124f3b9f436ce7a98b4c61dbe37206bae45059eed1e1d04387c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-03-19T06:09:32.028 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate[85073]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-19T06:09:32.028 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate[85073]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-19T06:09:32.028 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 bash[85058]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-19T06:09:32.028 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 bash[85058]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-19T06:09:32.028 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 bash[85058]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-19T06:09:32.028 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 bash[85058]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-19T06:09:32.028 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 bash[85058]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-03-19T06:09:32.028 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 bash[85058]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-19T06:09:32.029 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 bash[85058]: --> ceph-volume raw activate successful for osd ID: 0 2024-03-19T06:09:32.029 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate[85073]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-19T06:09:32.029 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate[85073]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-19T06:09:32.029 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate[85073]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-03-19T06:09:32.029 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate[85073]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-19T06:09:32.029 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate[85073]: --> ceph-volume raw activate successful for osd ID: 0 2024-03-19T06:09:32.029 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:31 smithi072 podman[85058]: 2024-03-19 06:09:31.733874862 +0000 UTC m=+1.314310064 container died 46fa99475c0cf124f3b9f436ce7a98b4c61dbe37206bae45059eed1e1d04387c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b) 2024-03-19T06:09:32.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:32 smithi072 ceph-mon[78545]: pgmap v68: 65 pgs: 9 stale+active+clean, 56 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:32.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:32 smithi172 ceph-mon[66682]: pgmap v68: 65 pgs: 9 stale+active+clean, 56 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:32.575 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:32 smithi072 podman[85198]: 2024-03-19 06:09:32.465704071 +0000 UTC m=+0.712708277 container remove 46fa99475c0cf124f3b9f436ce7a98b4c61dbe37206bae45059eed1e1d04387c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-activate, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-19T06:09:33.075 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:32 smithi072 podman[85261]: 2024-03-19 06:09:32.725013454 +0000 UTC m=+0.033898270 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:09:33.076 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:32 smithi072 podman[85261]: 2024-03-19 06:09:32.867735439 +0000 UTC m=+0.176620290 container create 94123452ea80f58f061e0607c02abe65e48b2a5c0de22295c3669000d366952a (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-19T06:09:33.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:33 smithi072 ceph-mon[78545]: Health check failed: Degraded data redundancy: 79/396 objects degraded (19.949%), 20 pgs degraded (PG_DEGRADED) 2024-03-19T06:09:33.575 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:33 smithi072 podman[85261]: 2024-03-19 06:09:33.14161577 +0000 UTC m=+0.450500648 container init 94123452ea80f58f061e0607c02abe65e48b2a5c0de22295c3669000d366952a (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271) 2024-03-19T06:09:33.575 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:33 smithi072 podman[85261]: 2024-03-19 06:09:33.152945851 +0000 UTC m=+0.461830678 container start 94123452ea80f58f061e0607c02abe65e48b2a5c0de22295c3669000d366952a (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-03-19T06:09:33.575 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:33 smithi072 ceph-osd[85280]: -- 172.21.15.72:0/3319668196 <== mon.0 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561458aaf680 con 0x561458a78c00 2024-03-19T06:09:33.576 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:33 smithi072 bash[85261]: 94123452ea80f58f061e0607c02abe65e48b2a5c0de22295c3669000d366952a 2024-03-19T06:09:33.576 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:33 smithi072 systemd[1]: Started Ceph osd.0 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:09:33.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:33 smithi172 ceph-mon[66682]: Health check failed: Degraded data redundancy: 79/396 objects degraded (19.949%), 20 pgs degraded (PG_DEGRADED) 2024-03-19T06:09:34.075 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:33 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0[85276]: 2024-03-19T06:09:33.725+0000 7f7fbb53e7c0 -1 Falling back to public interface 2024-03-19T06:09:34.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:34 smithi172 ceph-mon[66682]: pgmap v69: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 79/396 objects degraded (19.949%) 2024-03-19T06:09:34.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:34 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:34.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:34 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:34.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:34 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:09:34.779 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:34 smithi072 ceph-mon[78545]: pgmap v69: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 79/396 objects degraded (19.949%) 2024-03-19T06:09:34.780 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:34.780 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:34.780 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:09:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:36 smithi172 ceph-mon[66682]: pgmap v70: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 79/396 objects degraded (19.949%) 2024-03-19T06:09:36.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:36 smithi072 ceph-mon[78545]: pgmap v70: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 79/396 objects degraded (19.949%) 2024-03-19T06:09:38.643 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:38 smithi072 ceph-mon[78545]: pgmap v71: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 79/396 objects degraded (19.949%) 2024-03-19T06:09:38.643 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:38 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0[85276]: 2024-03-19T06:09:38.535+0000 7f7fbb53e7c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-03-19T06:09:38.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:38 smithi172 ceph-mon[66682]: pgmap v71: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 79/396 objects degraded (19.949%) 2024-03-19T06:09:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.820+0000 7ff86f400700 1 -- 172.21.15.72:0/2376677085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff868103680 msgr2=0x7ff868105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.820+0000 7ff86f400700 1 --2- 172.21.15.72:0/2376677085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff868103680 0x7ff868105a60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff854009910 tx=0x7ff854009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.821+0000 7ff86f400700 1 -- 172.21.15.72:0/2376677085 shutdown_connections 2024-03-19T06:09:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.821+0000 7ff86f400700 1 --2- 172.21.15.72:0/2376677085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff868103680 0x7ff868105a60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.821+0000 7ff86f400700 1 --2- 172.21.15.72:0/2376677085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff868100d60 0x7ff868103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.821+0000 7ff86f400700 1 -- 172.21.15.72:0/2376677085 >> 172.21.15.72:0/2376677085 conn(0x7ff8680fa780 msgr2=0x7ff8680fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.821+0000 7ff86f400700 1 -- 172.21.15.72:0/2376677085 shutdown_connections 2024-03-19T06:09:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.821+0000 7ff86f400700 1 -- 172.21.15.72:0/2376677085 wait complete. 2024-03-19T06:09:38.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.822+0000 7ff86f400700 1 Processor -- start 2024-03-19T06:09:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.822+0000 7ff86f400700 1 -- start start 2024-03-19T06:09:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.823+0000 7ff86f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff868100d60 0x7ff86819c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.823+0000 7ff86f400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff868103680 0x7ff86819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.823+0000 7ff86f400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86819ccd0 con 0x7ff868100d60 2024-03-19T06:09:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.823+0000 7ff86f400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86819ce10 con 0x7ff868103680 2024-03-19T06:09:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.823+0000 7ff86ca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff868100d60 0x7ff86819c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.823+0000 7ff86ca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff868100d60 0x7ff86819c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41872/0 (socket says 172.21.15.72:41872) 2024-03-19T06:09:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.823+0000 7ff86ca00700 1 -- 172.21.15.72:0/2739631040 learned_addr learned my addr 172.21.15.72:0/2739631040 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.823+0000 7ff867e00700 1 --2- 172.21.15.72:0/2739631040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff868103680 0x7ff86819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.824+0000 7ff86ca00700 1 -- 172.21.15.72:0/2739631040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff868103680 msgr2=0x7ff86819c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.824+0000 7ff86ca00700 1 --2- 172.21.15.72:0/2739631040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff868103680 0x7ff86819c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.824+0000 7ff86ca00700 1 -- 172.21.15.72:0/2739631040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8540095f0 con 0x7ff868100d60 2024-03-19T06:09:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.824+0000 7ff86ca00700 1 --2- 172.21.15.72:0/2739631040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff868100d60 0x7ff86819c170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00b480 tx=0x7ff85c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.824+0000 7ff865600700 1 -- 172.21.15.72:0/2739631040 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff85c011800 con 0x7ff868100d60 2024-03-19T06:09:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.825+0000 7ff865600700 1 -- 172.21.15.72:0/2739631040 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff85c011e10 con 0x7ff868100d60 2024-03-19T06:09:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.825+0000 7ff865600700 1 -- 172.21.15.72:0/2739631040 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff85c010ea0 con 0x7ff868100d60 2024-03-19T06:09:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.825+0000 7ff86f400700 1 -- 172.21.15.72:0/2739631040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8681a18c0 con 0x7ff868100d60 2024-03-19T06:09:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.825+0000 7ff86f400700 1 -- 172.21.15.72:0/2739631040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8681a1e10 con 0x7ff868100d60 2024-03-19T06:09:38.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.826+0000 7ff86f400700 1 -- 172.21.15.72:0/2739631040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8680fc340 con 0x7ff868100d60 2024-03-19T06:09:38.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.828+0000 7ff865600700 1 -- 172.21.15.72:0/2739631040 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7ff85c010380 con 0x7ff868100d60 2024-03-19T06:09:38.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.829+0000 7ff865600700 1 --2- 172.21.15.72:0/2739631040 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff85006dfa0 0x7ff850070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:38.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.829+0000 7ff865600700 1 -- 172.21.15.72:0/2739631040 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff85c08dce0 con 0x7ff868100d60 2024-03-19T06:09:38.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.830+0000 7ff867e00700 1 --2- 172.21.15.72:0/2739631040 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff85006dfa0 0x7ff850070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:38.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.831+0000 7ff867e00700 1 --2- 172.21.15.72:0/2739631040 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff85006dfa0 0x7ff850070450 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff85400b5c0 tx=0x7ff8540052a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:38.837+0000 7ff865600700 1 -- 172.21.15.72:0/2739631040 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7ff85c05ae50 con 0x7ff868100d60 2024-03-19T06:09:39.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.109+0000 7ff86f400700 1 -- 172.21.15.72:0/2739631040 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff868061190 con 0x7ff85006dfa0 2024-03-19T06:09:39.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.112+0000 7ff865600700 1 -- 172.21.15.72:0/2739631040 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff868061190 con 0x7ff85006dfa0 2024-03-19T06:09:39.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.114+0000 7ff86f400700 1 -- 172.21.15.72:0/2739631040 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff85006dfa0 msgr2=0x7ff850070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:39.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.114+0000 7ff86f400700 1 --2- 172.21.15.72:0/2739631040 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff85006dfa0 0x7ff850070450 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff85400b5c0 tx=0x7ff8540052a0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.114+0000 7ff86f400700 1 -- 172.21.15.72:0/2739631040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff868100d60 msgr2=0x7ff86819c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:39.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.114+0000 7ff86f400700 1 --2- 172.21.15.72:0/2739631040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff868100d60 0x7ff86819c170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00b480 tx=0x7ff85c00b790 comp rx=0 tx=0).stop 2024-03-19T06:09:39.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.114+0000 7ff86f400700 1 -- 172.21.15.72:0/2739631040 shutdown_connections 2024-03-19T06:09:39.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.114+0000 7ff86f400700 1 --2- 172.21.15.72:0/2739631040 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff85006dfa0 0x7ff850070450 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.114+0000 7ff86f400700 1 --2- 172.21.15.72:0/2739631040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff868100d60 0x7ff86819c170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.114+0000 7ff86f400700 1 --2- 172.21.15.72:0/2739631040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff868103680 0x7ff86819c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.114+0000 7ff86f400700 1 -- 172.21.15.72:0/2739631040 >> 172.21.15.72:0/2739631040 conn(0x7ff8680fa780 msgr2=0x7ff8680ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.115+0000 7ff86f400700 1 -- 172.21.15.72:0/2739631040 shutdown_connections 2024-03-19T06:09:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.115+0000 7ff86f400700 1 -- 172.21.15.72:0/2739631040 wait complete. 2024-03-19T06:09:39.122 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:09:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.270+0000 7fd027c00700 1 -- 172.21.15.72:0/630238173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd020102440 msgr2=0x7fd020102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.270+0000 7fd027c00700 1 --2- 172.21.15.72:0/630238173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd020102440 0x7fd020102850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd01400b0a0 tx=0x7fd01400b3b0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.270+0000 7fd027c00700 1 -- 172.21.15.72:0/630238173 shutdown_connections 2024-03-19T06:09:39.261 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:39 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0[85276]: 2024-03-19T06:09:39.016+0000 7f7fbb53e7c0 -1 osd.0 48 log_to_monitors true 2024-03-19T06:09:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.270+0000 7fd027c00700 1 --2- 172.21.15.72:0/630238173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd020103640 0x7fd020103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.270+0000 7fd027c00700 1 --2- 172.21.15.72:0/630238173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd020102440 0x7fd020102850 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.270+0000 7fd027c00700 1 -- 172.21.15.72:0/630238173 >> 172.21.15.72:0/630238173 conn(0x7fd0200fd9f0 msgr2=0x7fd0200ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.270+0000 7fd027c00700 1 -- 172.21.15.72:0/630238173 shutdown_connections 2024-03-19T06:09:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.270+0000 7fd027c00700 1 -- 172.21.15.72:0/630238173 wait complete. 2024-03-19T06:09:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.272+0000 7fd027c00700 1 Processor -- start 2024-03-19T06:09:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.272+0000 7fd027c00700 1 -- start start 2024-03-19T06:09:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.272+0000 7fd027c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd020102440 0x7fd020197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.272+0000 7fd027c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd020103640 0x7fd020198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.272+0000 7fd027c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd020198990 con 0x7fd020102440 2024-03-19T06:09:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.272+0000 7fd027c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd020198ad0 con 0x7fd020103640 2024-03-19T06:09:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.272+0000 7fd025200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd020102440 0x7fd020197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.273+0000 7fd025200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd020102440 0x7fd020197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41894/0 (socket says 172.21.15.72:41894) 2024-03-19T06:09:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.273+0000 7fd025200700 1 -- 172.21.15.72:0/29353471 learned_addr learned my addr 172.21.15.72:0/29353471 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.273+0000 7fd01fe00700 1 --2- 172.21.15.72:0/29353471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd020103640 0x7fd020198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.273+0000 7fd025200700 1 -- 172.21.15.72:0/29353471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd020103640 msgr2=0x7fd020198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.273+0000 7fd025200700 1 --2- 172.21.15.72:0/29353471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd020103640 0x7fd020198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.273+0000 7fd025200700 1 -- 172.21.15.72:0/29353471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd014009d00 con 0x7fd020102440 2024-03-19T06:09:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.273+0000 7fd01fe00700 1 --2- 172.21.15.72:0/29353471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd020103640 0x7fd020198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:09:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.273+0000 7fd025200700 1 --2- 172.21.15.72:0/29353471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd020102440 0x7fd020197e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd01400b070 tx=0x7fd014003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.274+0000 7fd01d600700 1 -- 172.21.15.72:0/29353471 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd01400e040 con 0x7fd020102440 2024-03-19T06:09:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.274+0000 7fd01d600700 1 -- 172.21.15.72:0/29353471 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd01400ce60 con 0x7fd020102440 2024-03-19T06:09:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.274+0000 7fd027c00700 1 -- 172.21.15.72:0/29353471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02019d520 con 0x7fd020102440 2024-03-19T06:09:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.274+0000 7fd01d600700 1 -- 172.21.15.72:0/29353471 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd01401da90 con 0x7fd020102440 2024-03-19T06:09:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.274+0000 7fd027c00700 1 -- 172.21.15.72:0/29353471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02019da10 con 0x7fd020102440 2024-03-19T06:09:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.275+0000 7fd027c00700 1 -- 172.21.15.72:0/29353471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02010b010 con 0x7fd020102440 2024-03-19T06:09:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.276+0000 7fd01d600700 1 -- 172.21.15.72:0/29353471 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fd014004250 con 0x7fd020102440 2024-03-19T06:09:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.277+0000 7fd01d600700 1 --2- 172.21.15.72:0/29353471 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd00806dfa0 0x7fd008070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.277+0000 7fd01d600700 1 -- 172.21.15.72:0/29353471 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd01408f930 con 0x7fd020102440 2024-03-19T06:09:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.277+0000 7fd01fe00700 1 --2- 172.21.15.72:0/29353471 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd00806dfa0 0x7fd008070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.278+0000 7fd01fe00700 1 --2- 172.21.15.72:0/29353471 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd00806dfa0 0x7fd008070450 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd00c007900 tx=0x7fd00c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.281+0000 7fd01d600700 1 -- 172.21.15.72:0/29353471 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fd01405c980 con 0x7fd020102440 2024-03-19T06:09:39.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.576+0000 7fd027c00700 1 -- 172.21.15.72:0/29353471 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd020107f90 con 0x7fd00806dfa0 2024-03-19T06:09:39.567 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:39 smithi072 ceph-mon[78545]: from='osd.0 [v2:172.21.15.72:6802/823954487,v1:172.21.15.72:6803/823954487]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-19T06:09:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.577+0000 7fd01d600700 1 -- 172.21.15.72:0/29353471 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd020107f90 con 0x7fd00806dfa0 2024-03-19T06:09:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.581+0000 7fd027c00700 1 -- 172.21.15.72:0/29353471 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd00806dfa0 msgr2=0x7fd008070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.581+0000 7fd027c00700 1 --2- 172.21.15.72:0/29353471 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd00806dfa0 0x7fd008070450 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd00c007900 tx=0x7fd00c008040 comp rx=0 tx=0).stop 2024-03-19T06:09:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.581+0000 7fd027c00700 1 -- 172.21.15.72:0/29353471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd020102440 msgr2=0x7fd020197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.581+0000 7fd027c00700 1 --2- 172.21.15.72:0/29353471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd020102440 0x7fd020197e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd01400b070 tx=0x7fd014003ce0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.581+0000 7fd027c00700 1 -- 172.21.15.72:0/29353471 shutdown_connections 2024-03-19T06:09:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.581+0000 7fd027c00700 1 --2- 172.21.15.72:0/29353471 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd00806dfa0 0x7fd008070450 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.581+0000 7fd027c00700 1 --2- 172.21.15.72:0/29353471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd020102440 0x7fd020197e30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.581+0000 7fd027c00700 1 --2- 172.21.15.72:0/29353471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd020103640 0x7fd020198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.581+0000 7fd027c00700 1 -- 172.21.15.72:0/29353471 >> 172.21.15.72:0/29353471 conn(0x7fd0200fd9f0 msgr2=0x7fd020106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.581+0000 7fd027c00700 1 -- 172.21.15.72:0/29353471 shutdown_connections 2024-03-19T06:09:39.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.581+0000 7fd027c00700 1 -- 172.21.15.72:0/29353471 wait complete. 2024-03-19T06:09:39.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:39 smithi172 ceph-mon[66682]: from='osd.0 [v2:172.21.15.72:6802/823954487,v1:172.21.15.72:6803/823954487]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-19T06:09:39.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.738+0000 7feb40a00700 1 -- 172.21.15.72:0/57696880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3c074d00 msgr2=0x7feb3c073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:39.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.738+0000 7feb40a00700 1 --2- 172.21.15.72:0/57696880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3c074d00 0x7feb3c073160 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009910 tx=0x7feb2c009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:39.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.738+0000 7feb40a00700 1 -- 172.21.15.72:0/57696880 shutdown_connections 2024-03-19T06:09:39.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.738+0000 7feb40a00700 1 --2- 172.21.15.72:0/57696880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3c073730 0x7feb3c073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.738+0000 7feb40a00700 1 --2- 172.21.15.72:0/57696880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3c074d00 0x7feb3c073160 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.738+0000 7feb40a00700 1 -- 172.21.15.72:0/57696880 >> 172.21.15.72:0/57696880 conn(0x7feb3c0fb7f0 msgr2=0x7feb3c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:39.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.738+0000 7feb40a00700 1 -- 172.21.15.72:0/57696880 shutdown_connections 2024-03-19T06:09:39.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.738+0000 7feb40a00700 1 -- 172.21.15.72:0/57696880 wait complete. 2024-03-19T06:09:39.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.740+0000 7feb40a00700 1 Processor -- start 2024-03-19T06:09:39.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.740+0000 7feb40a00700 1 -- start start 2024-03-19T06:09:39.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.740+0000 7feb40a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3c073730 0x7feb3c197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:39.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.740+0000 7feb40a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3c074d00 0x7feb3c1981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:39.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.740+0000 7feb40a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c1987d0 con 0x7feb3c073730 2024-03-19T06:09:39.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.740+0000 7feb40a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c198940 con 0x7feb3c074d00 2024-03-19T06:09:39.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.740+0000 7feb39e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3c073730 0x7feb3c197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:39.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.741+0000 7feb39e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3c073730 0x7feb3c197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41908/0 (socket says 172.21.15.72:41908) 2024-03-19T06:09:39.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.741+0000 7feb39e00700 1 -- 172.21.15.72:0/3868907128 learned_addr learned my addr 172.21.15.72:0/3868907128 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:39.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.741+0000 7feb39400700 1 --2- 172.21.15.72:0/3868907128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3c074d00 0x7feb3c1981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:39.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.741+0000 7feb39e00700 1 -- 172.21.15.72:0/3868907128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3c074d00 msgr2=0x7feb3c1981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:39.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.741+0000 7feb39e00700 1 --2- 172.21.15.72:0/3868907128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3c074d00 0x7feb3c1981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:39.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.741+0000 7feb39e00700 1 -- 172.21.15.72:0/3868907128 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c0095f0 con 0x7feb3c073730 2024-03-19T06:09:39.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.741+0000 7feb39e00700 1 --2- 172.21.15.72:0/3868907128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3c073730 0x7feb3c197c90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feb2c005b40 tx=0x7feb2c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:39.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.742+0000 7feb32a00700 1 -- 172.21.15.72:0/3868907128 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb2c01d070 con 0x7feb3c073730 2024-03-19T06:09:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.742+0000 7feb32a00700 1 -- 172.21.15.72:0/3868907128 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feb2c022470 con 0x7feb3c073730 2024-03-19T06:09:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.742+0000 7feb40a00700 1 -- 172.21.15.72:0/3868907128 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3c19d370 con 0x7feb3c073730 2024-03-19T06:09:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.742+0000 7feb32a00700 1 -- 172.21.15.72:0/3868907128 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb2c00f690 con 0x7feb3c073730 2024-03-19T06:09:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.742+0000 7feb40a00700 1 -- 172.21.15.72:0/3868907128 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c19d860 con 0x7feb3c073730 2024-03-19T06:09:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.743+0000 7feb40a00700 1 -- 172.21.15.72:0/3868907128 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c10af70 con 0x7feb3c073730 2024-03-19T06:09:39.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.744+0000 7feb32a00700 1 -- 172.21.15.72:0/3868907128 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7feb2c0225e0 con 0x7feb3c073730 2024-03-19T06:09:39.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.745+0000 7feb32a00700 1 --2- 172.21.15.72:0/3868907128 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7feb2006dfa0 0x7feb20070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:39.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.746+0000 7feb32a00700 1 -- 172.21.15.72:0/3868907128 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7feb2c08f410 con 0x7feb3c073730 2024-03-19T06:09:39.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.746+0000 7feb39400700 1 --2- 172.21.15.72:0/3868907128 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7feb2006dfa0 0x7feb20070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:39.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.747+0000 7feb39400700 1 --2- 172.21.15.72:0/3868907128 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7feb2006dfa0 0x7feb20070450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feb28005fd0 tx=0x7feb2800a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:39.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:39.750+0000 7feb32a00700 1 -- 172.21.15.72:0/3868907128 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7feb2c058940 con 0x7feb3c073730 2024-03-19T06:09:40.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.138+0000 7feb40a00700 1 -- 172.21.15.72:0/3868907128 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feb3c1077c0 con 0x7feb2006dfa0 2024-03-19T06:09:40.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.152+0000 7feb32a00700 1 -- 172.21.15.72:0/3868907128 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7feb3c1077c0 con 0x7feb2006dfa0 2024-03-19T06:09:40.143 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:09:40.143 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (14m) 28s ago 16m 14.1M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:09:40.143 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (16m) 28s ago 16m 8190k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:09:40.143 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (14m) 31s ago 14m 8010k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:09:40.143 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (44s) 28s ago 16m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (36s) 31s ago 14m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (13m) 28s ago 15m 75.1M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (8m) 28s ago 8m 15.9M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (8m) 28s ago 8m 126M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (8m) 31s ago 8m 15.9M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (8m) 31s ago 8m 142M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (4m) 28s ago 17m 499M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (3m) 31s ago 14m 450M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (2m) 28s ago 18m 44.1M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (110s) 31s ago 14m 35.7M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (16m) 28s ago 16m 7721k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (14m) 31s ago 14m 8430k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 starting - - - 1216M 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (12m) 28s ago 12m 203M 1216M 18.2.0 dc2bc1663786 b03daf84d86f 2024-03-19T06:09:40.144 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (12m) 28s ago 12m 173M 1216M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:09:40.145 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (11m) 31s ago 11m 237M 2241M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:09:40.145 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (11m) 31s ago 11m 230M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:09:40.145 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (10m) 31s ago 10m 189M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:09:40.145 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (3m) 28s ago 15m 63.6M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:09:40.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.155+0000 7feb40a00700 1 -- 172.21.15.72:0/3868907128 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7feb2006dfa0 msgr2=0x7feb20070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:40.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.155+0000 7feb40a00700 1 --2- 172.21.15.72:0/3868907128 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7feb2006dfa0 0x7feb20070450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feb28005fd0 tx=0x7feb2800a560 comp rx=0 tx=0).stop 2024-03-19T06:09:40.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.155+0000 7feb40a00700 1 -- 172.21.15.72:0/3868907128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3c073730 msgr2=0x7feb3c197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:40.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.155+0000 7feb40a00700 1 --2- 172.21.15.72:0/3868907128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3c073730 0x7feb3c197c90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feb2c005b40 tx=0x7feb2c00be20 comp rx=0 tx=0).stop 2024-03-19T06:09:40.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.155+0000 7feb40a00700 1 -- 172.21.15.72:0/3868907128 shutdown_connections 2024-03-19T06:09:40.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.155+0000 7feb40a00700 1 --2- 172.21.15.72:0/3868907128 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7feb2006dfa0 0x7feb20070450 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.155+0000 7feb40a00700 1 --2- 172.21.15.72:0/3868907128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3c073730 0x7feb3c197c90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.155+0000 7feb40a00700 1 --2- 172.21.15.72:0/3868907128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3c074d00 0x7feb3c1981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.155+0000 7feb40a00700 1 -- 172.21.15.72:0/3868907128 >> 172.21.15.72:0/3868907128 conn(0x7feb3c0fb7f0 msgr2=0x7feb3c1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:40.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.156+0000 7feb40a00700 1 -- 172.21.15.72:0/3868907128 shutdown_connections 2024-03-19T06:09:40.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.156+0000 7feb40a00700 1 -- 172.21.15.72:0/3868907128 wait complete. 2024-03-19T06:09:40.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.344+0000 7fb50e600700 1 -- 172.21.15.72:0/2932894387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508100020 msgr2=0x7fb508100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:40.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.344+0000 7fb50e600700 1 --2- 172.21.15.72:0/2932894387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508100020 0x7fb508100430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009910 tx=0x7fb4fc009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:40.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.345+0000 7fb50e600700 1 -- 172.21.15.72:0/2932894387 shutdown_connections 2024-03-19T06:09:40.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.345+0000 7fb50e600700 1 --2- 172.21.15.72:0/2932894387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5081012c0 0x7fb508101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.345+0000 7fb50e600700 1 --2- 172.21.15.72:0/2932894387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508100020 0x7fb508100430 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.345+0000 7fb50e600700 1 -- 172.21.15.72:0/2932894387 >> 172.21.15.72:0/2932894387 conn(0x7fb5080fb650 msgr2=0x7fb5080fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:40.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.345+0000 7fb50e600700 1 -- 172.21.15.72:0/2932894387 shutdown_connections 2024-03-19T06:09:40.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.345+0000 7fb50e600700 1 -- 172.21.15.72:0/2932894387 wait complete. 2024-03-19T06:09:40.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.346+0000 7fb50e600700 1 Processor -- start 2024-03-19T06:09:40.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.346+0000 7fb50e600700 1 -- start start 2024-03-19T06:09:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.346+0000 7fb50e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508100020 0x7fb508197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.347+0000 7fb50e600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5081012c0 0x7fb508197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.347+0000 7fb50e600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb508198560 con 0x7fb508100020 2024-03-19T06:09:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.347+0000 7fb50e600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081986a0 con 0x7fb5081012c0 2024-03-19T06:09:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.347+0000 7fb50d200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508100020 0x7fb508197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.347+0000 7fb50d200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508100020 0x7fb508197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41926/0 (socket says 172.21.15.72:41926) 2024-03-19T06:09:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.347+0000 7fb50d200700 1 -- 172.21.15.72:0/2401129475 learned_addr learned my addr 172.21.15.72:0/2401129475 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.347+0000 7fb50d200700 1 -- 172.21.15.72:0/2401129475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5081012c0 msgr2=0x7fb508197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.347+0000 7fb50d200700 1 --2- 172.21.15.72:0/2401129475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5081012c0 0x7fb508197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.347+0000 7fb50d200700 1 -- 172.21.15.72:0/2401129475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc0095f0 con 0x7fb508100020 2024-03-19T06:09:40.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.348+0000 7fb50d200700 1 --2- 172.21.15.72:0/2401129475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508100020 0x7fb508197a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc006010 tx=0x7fb4fc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:40.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.348+0000 7fb505600700 1 -- 172.21.15.72:0/2401129475 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4fc01d070 con 0x7fb508100020 2024-03-19T06:09:40.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.348+0000 7fb50e600700 1 -- 172.21.15.72:0/2401129475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50819d0f0 con 0x7fb508100020 2024-03-19T06:09:40.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.348+0000 7fb505600700 1 -- 172.21.15.72:0/2401129475 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb4fc00f460 con 0x7fb508100020 2024-03-19T06:09:40.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.348+0000 7fb505600700 1 -- 172.21.15.72:0/2401129475 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4fc017630 con 0x7fb508100020 2024-03-19T06:09:40.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.348+0000 7fb50e600700 1 -- 172.21.15.72:0/2401129475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50819d5e0 con 0x7fb508100020 2024-03-19T06:09:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.350+0000 7fb50e600700 1 -- 172.21.15.72:0/2401129475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb508108b00 con 0x7fb508100020 2024-03-19T06:09:40.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.351+0000 7fb505600700 1 -- 172.21.15.72:0/2401129475 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fb4fc003a60 con 0x7fb508100020 2024-03-19T06:09:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.352+0000 7fb505600700 1 --2- 172.21.15.72:0/2401129475 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb4f006dfa0 0x7fb4f0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.353+0000 7fb505600700 1 -- 172.21.15.72:0/2401129475 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb4fc08f1e0 con 0x7fb508100020 2024-03-19T06:09:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.353+0000 7fb507e00700 1 --2- 172.21.15.72:0/2401129475 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb4f006dfa0 0x7fb4f0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.354+0000 7fb507e00700 1 --2- 172.21.15.72:0/2401129475 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb4f006dfa0 0x7fb4f0070450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4005950 tx=0x7fb4f40058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:40.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.359+0000 7fb505600700 1 -- 172.21.15.72:0/2401129475 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fb4fc05c210 con 0x7fb508100020 2024-03-19T06:09:40.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:40 smithi072 ceph-mon[78545]: pgmap v72: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 79/396 objects degraded (19.949%) 2024-03-19T06:09:40.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:40 smithi072 ceph-mon[78545]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:40.502 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:40 smithi072 ceph-mon[78545]: from='osd.0 [v2:172.21.15.72:6802/823954487,v1:172.21.15.72:6803/823954487]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-19T06:09:40.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:40 smithi072 ceph-mon[78545]: osdmap e51: 6 total, 5 up, 6 in 2024-03-19T06:09:40.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:40 smithi072 ceph-mon[78545]: from='osd.0 [v2:172.21.15.72:6802/823954487,v1:172.21.15.72:6803/823954487]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-19T06:09:40.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:40.503 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:09:40.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.702+0000 7fb50e600700 1 -- 172.21.15.72:0/2401129475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb50819dd30 con 0x7fb508100020 2024-03-19T06:09:40.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.703+0000 7fb505600700 1 -- 172.21.15.72:0/2401129475 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+687 (secure 0 0 0) 0x7fb4fc05bda0 con 0x7fb508100020 2024-03-19T06:09:40.694 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:09:40.694 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:09:40.694 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:09:40.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:09:40.694 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:09:40.694 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:09:40.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:09:40.694 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:09:40.694 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5 2024-03-19T06:09:40.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:09:40.695 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:09:40.695 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:09:40.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:09:40.695 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:09:40.695 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-03-19T06:09:40.695 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 4 2024-03-19T06:09:40.695 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:09:40.695 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:09:40.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.705+0000 7fb50e600700 1 -- 172.21.15.72:0/2401129475 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb4f006dfa0 msgr2=0x7fb4f0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:40.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.705+0000 7fb50e600700 1 --2- 172.21.15.72:0/2401129475 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb4f006dfa0 0x7fb4f0070450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4005950 tx=0x7fb4f40058e0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.705+0000 7fb50e600700 1 -- 172.21.15.72:0/2401129475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508100020 msgr2=0x7fb508197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.705+0000 7fb50e600700 1 --2- 172.21.15.72:0/2401129475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508100020 0x7fb508197a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc006010 tx=0x7fb4fc00be20 comp rx=0 tx=0).stop 2024-03-19T06:09:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.706+0000 7fb50e600700 1 -- 172.21.15.72:0/2401129475 shutdown_connections 2024-03-19T06:09:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.706+0000 7fb50e600700 1 --2- 172.21.15.72:0/2401129475 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb4f006dfa0 0x7fb4f0070450 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.706+0000 7fb50e600700 1 --2- 172.21.15.72:0/2401129475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508100020 0x7fb508197a00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.706+0000 7fb50e600700 1 --2- 172.21.15.72:0/2401129475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5081012c0 0x7fb508197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.706+0000 7fb50e600700 1 -- 172.21.15.72:0/2401129475 >> 172.21.15.72:0/2401129475 conn(0x7fb5080fb650 msgr2=0x7fb5080fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.706+0000 7fb50e600700 1 -- 172.21.15.72:0/2401129475 shutdown_connections 2024-03-19T06:09:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.706+0000 7fb50e600700 1 -- 172.21.15.72:0/2401129475 wait complete. 2024-03-19T06:09:40.825 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:09:40 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0[85276]: 2024-03-19T06:09:40.511+0000 7f7fa5800700 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:09:40.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.861+0000 7f922bc00700 1 -- 172.21.15.72:0/741678826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92241014b0 msgr2=0x7f9224103930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:40.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.861+0000 7f922bc00700 1 --2- 172.21.15.72:0/741678826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92241014b0 0x7f9224103930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9210009910 tx=0x7f9210009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:40.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.861+0000 7f922bc00700 1 -- 172.21.15.72:0/741678826 shutdown_connections 2024-03-19T06:09:40.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.861+0000 7f922bc00700 1 --2- 172.21.15.72:0/741678826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92241014b0 0x7f9224103930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.861+0000 7f922bc00700 1 --2- 172.21.15.72:0/741678826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92240feb50 0x7f9224100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.861+0000 7f922bc00700 1 -- 172.21.15.72:0/741678826 >> 172.21.15.72:0/741678826 conn(0x7f92240fa780 msgr2=0x7f92240fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:40.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.861+0000 7f922bc00700 1 -- 172.21.15.72:0/741678826 shutdown_connections 2024-03-19T06:09:40.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.861+0000 7f922bc00700 1 -- 172.21.15.72:0/741678826 wait complete. 2024-03-19T06:09:40.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.862+0000 7f922bc00700 1 Processor -- start 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.862+0000 7f922bc00700 1 -- start start 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.862+0000 7f922bc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92240feb50 0x7f922419c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.862+0000 7f922bc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92241014b0 0x7f922419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.862+0000 7f922bc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922419ccb0 con 0x7f92241014b0 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.862+0000 7f922bc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922419cdf0 con 0x7f92240feb50 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.863+0000 7f9223e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92241014b0 0x7f922419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.863+0000 7f9223e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92241014b0 0x7f922419c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41946/0 (socket says 172.21.15.72:41946) 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.863+0000 7f9223e00700 1 -- 172.21.15.72:0/1613473302 learned_addr learned my addr 172.21.15.72:0/1613473302 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.863+0000 7f9229200700 1 --2- 172.21.15.72:0/1613473302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92240feb50 0x7f922419c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.863+0000 7f9223e00700 1 -- 172.21.15.72:0/1613473302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92240feb50 msgr2=0x7f922419c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.863+0000 7f9223e00700 1 --2- 172.21.15.72:0/1613473302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92240feb50 0x7f922419c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.863+0000 7f9223e00700 1 -- 172.21.15.72:0/1613473302 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92100095f0 con 0x7f92241014b0 2024-03-19T06:09:40.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.863+0000 7f9229200700 1 --2- 172.21.15.72:0/1613473302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92240feb50 0x7f922419c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:09:40.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.864+0000 7f9223e00700 1 --2- 172.21.15.72:0/1613473302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92241014b0 0x7f922419c690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9210005b40 tx=0x7f921000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:40.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.864+0000 7f9221600700 1 -- 172.21.15.72:0/1613473302 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f921001d070 con 0x7f92241014b0 2024-03-19T06:09:40.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.864+0000 7f9221600700 1 -- 172.21.15.72:0/1613473302 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9210022470 con 0x7f92241014b0 2024-03-19T06:09:40.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.864+0000 7f9221600700 1 -- 172.21.15.72:0/1613473302 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f921000f690 con 0x7f92241014b0 2024-03-19T06:09:40.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.864+0000 7f922bc00700 1 -- 172.21.15.72:0/1613473302 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92241a1840 con 0x7f92241014b0 2024-03-19T06:09:40.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.864+0000 7f922bc00700 1 -- 172.21.15.72:0/1613473302 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92241a1d30 con 0x7f92241014b0 2024-03-19T06:09:40.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.865+0000 7f922bc00700 1 -- 172.21.15.72:0/1613473302 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9224196260 con 0x7f92241014b0 2024-03-19T06:09:40.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.867+0000 7f9221600700 1 -- 172.21.15.72:0/1613473302 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f92100225e0 con 0x7f92241014b0 2024-03-19T06:09:40.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.868+0000 7f9221600700 1 --2- 172.21.15.72:0/1613473302 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f920c06dfa0 0x7f920c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:40.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.868+0000 7f9221600700 1 -- 172.21.15.72:0/1613473302 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f921008f460 con 0x7f92241014b0 2024-03-19T06:09:40.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.868+0000 7f9229200700 1 --2- 172.21.15.72:0/1613473302 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f920c06dfa0 0x7f920c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:40.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.869+0000 7f9229200700 1 --2- 172.21.15.72:0/1613473302 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f920c06dfa0 0x7f920c070450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9224069000 tx=0x7f9218008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:40.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:40.873+0000 7f9221600700 1 -- 172.21.15.72:0/1613473302 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f921005c550 con 0x7f92241014b0 2024-03-19T06:09:40.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:40 smithi172 ceph-mon[66682]: pgmap v72: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 355 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 79/396 objects degraded (19.949%) 2024-03-19T06:09:40.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:40 smithi172 ceph-mon[66682]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:40.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:40 smithi172 ceph-mon[66682]: from='osd.0 [v2:172.21.15.72:6802/823954487,v1:172.21.15.72:6803/823954487]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-19T06:09:40.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:40 smithi172 ceph-mon[66682]: osdmap e51: 6 total, 5 up, 6 in 2024-03-19T06:09:40.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:40 smithi172 ceph-mon[66682]: from='osd.0 [v2:172.21.15.72:6802/823954487,v1:172.21.15.72:6803/823954487]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-19T06:09:40.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:40.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:09:41.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.158+0000 7f922bc00700 1 -- 172.21.15.72:0/1613473302 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f922402cc30 con 0x7f92241014b0 2024-03-19T06:09:41.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.158+0000 7f9221600700 1 -- 172.21.15.72:0/1613473302 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1869 (secure 0 0 0) 0x7f921005c0e0 con 0x7f92241014b0 2024-03-19T06:09:41.150 INFO:teuthology.orchestra.run.smithi072.stdout:e16 2024-03-19T06:09:41.150 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:09:41.150 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:09:41.150 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:09:41.150 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:09:41.150 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:09:41.150 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:09:41.150 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 16 2024-03-19T06:09:41.150 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:09:41.150 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:09:41.150 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:09:23.789448+0000 2024-03-19T06:09:41.150 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:09:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:09:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:09:41.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.162+0000 7f922bc00700 1 -- 172.21.15.72:0/1613473302 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f920c06dfa0 msgr2=0x7f920c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:41.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.162+0000 7f922bc00700 1 --2- 172.21.15.72:0/1613473302 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f920c06dfa0 0x7f920c070450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9224069000 tx=0x7f9218008040 comp rx=0 tx=0).stop 2024-03-19T06:09:41.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.162+0000 7f922bc00700 1 -- 172.21.15.72:0/1613473302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92241014b0 msgr2=0x7f922419c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:41.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.162+0000 7f922bc00700 1 --2- 172.21.15.72:0/1613473302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92241014b0 0x7f922419c690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9210005b40 tx=0x7f921000be20 comp rx=0 tx=0).stop 2024-03-19T06:09:41.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.163+0000 7f922bc00700 1 -- 172.21.15.72:0/1613473302 shutdown_connections 2024-03-19T06:09:41.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.163+0000 7f922bc00700 1 --2- 172.21.15.72:0/1613473302 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f920c06dfa0 0x7f920c070450 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:41.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.163+0000 7f922bc00700 1 --2- 172.21.15.72:0/1613473302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92240feb50 0x7f922419c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:41.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.163+0000 7f922bc00700 1 --2- 172.21.15.72:0/1613473302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92241014b0 0x7f922419c690 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:41.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.163+0000 7f922bc00700 1 -- 172.21.15.72:0/1613473302 >> 172.21.15.72:0/1613473302 conn(0x7f92240fa780 msgr2=0x7f92240fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:41.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.163+0000 7f922bc00700 1 -- 172.21.15.72:0/1613473302 shutdown_connections 2024-03-19T06:09:41.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.163+0000 7f922bc00700 1 -- 172.21.15.72:0/1613473302 wait complete. 2024-03-19T06:09:41.154 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 16 2024-03-19T06:09:41.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.314+0000 7f2fefc00700 1 -- 172.21.15.72:0/3666437304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8100d60 msgr2=0x7f2fe8103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:41.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.314+0000 7f2fefc00700 1 --2- 172.21.15.72:0/3666437304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8100d60 0x7f2fe8103140 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009910 tx=0x7f2fdc009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:41.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.315+0000 7f2fefc00700 1 -- 172.21.15.72:0/3666437304 shutdown_connections 2024-03-19T06:09:41.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.315+0000 7f2fefc00700 1 --2- 172.21.15.72:0/3666437304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe8103680 0x7f2fe8105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:41.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.315+0000 7f2fefc00700 1 --2- 172.21.15.72:0/3666437304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8100d60 0x7f2fe8103140 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:41.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.315+0000 7f2fefc00700 1 -- 172.21.15.72:0/3666437304 >> 172.21.15.72:0/3666437304 conn(0x7f2fe80fa780 msgr2=0x7f2fe80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:41.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.315+0000 7f2fefc00700 1 -- 172.21.15.72:0/3666437304 shutdown_connections 2024-03-19T06:09:41.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.315+0000 7f2fefc00700 1 -- 172.21.15.72:0/3666437304 wait complete. 2024-03-19T06:09:41.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.316+0000 7f2fefc00700 1 Processor -- start 2024-03-19T06:09:41.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.316+0000 7f2fefc00700 1 -- start start 2024-03-19T06:09:41.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.316+0000 7f2fefc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8100d60 0x7f2fe81006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:41.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.316+0000 7f2fefc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe8103680 0x7f2fe80fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:41.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.316+0000 7f2fefc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8199780 con 0x7f2fe8100d60 2024-03-19T06:09:41.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.316+0000 7f2fefc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81998c0 con 0x7f2fe8103680 2024-03-19T06:09:41.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.317+0000 7f2fed200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8100d60 0x7f2fe81006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.317+0000 7f2fed200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8100d60 0x7f2fe81006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41972/0 (socket says 172.21.15.72:41972) 2024-03-19T06:09:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.317+0000 7f2fed200700 1 -- 172.21.15.72:0/2378492189 learned_addr learned my addr 172.21.15.72:0/2378492189 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.317+0000 7f2fed200700 1 -- 172.21.15.72:0/2378492189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe8103680 msgr2=0x7f2fe80fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.317+0000 7f2fed200700 1 --2- 172.21.15.72:0/2378492189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe8103680 0x7f2fe80fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.317+0000 7f2fed200700 1 -- 172.21.15.72:0/2378492189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0095f0 con 0x7f2fe8100d60 2024-03-19T06:09:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.317+0000 7f2fed200700 1 --2- 172.21.15.72:0/2378492189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8100d60 0x7f2fe81006c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00bda0 tx=0x7f2fdc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.318+0000 7f2fe5600700 1 -- 172.21.15.72:0/2378492189 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fdc01d070 con 0x7f2fe8100d60 2024-03-19T06:09:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.318+0000 7f2fe5600700 1 -- 172.21.15.72:0/2378492189 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2fdc004c50 con 0x7f2fe8100d60 2024-03-19T06:09:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.318+0000 7f2fefc00700 1 -- 172.21.15.72:0/2378492189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe80ff250 con 0x7f2fe8100d60 2024-03-19T06:09:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.318+0000 7f2fe5600700 1 -- 172.21.15.72:0/2378492189 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fdc00f690 con 0x7f2fe8100d60 2024-03-19T06:09:41.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.318+0000 7f2fefc00700 1 -- 172.21.15.72:0/2378492189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe80ff710 con 0x7f2fe8100d60 2024-03-19T06:09:41.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.319+0000 7f2fefc00700 1 -- 172.21.15.72:0/2378492189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe818fc40 con 0x7f2fe8100d60 2024-03-19T06:09:41.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.320+0000 7f2fe5600700 1 -- 172.21.15.72:0/2378492189 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f2fdc00f7f0 con 0x7f2fe8100d60 2024-03-19T06:09:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.321+0000 7f2fe5600700 1 --2- 172.21.15.72:0/2378492189 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2fd006dfa0 0x7f2fd0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.321+0000 7f2fe5600700 1 -- 172.21.15.72:0/2378492189 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2fdc08f4a0 con 0x7f2fe8100d60 2024-03-19T06:09:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.322+0000 7f2fe7e00700 1 --2- 172.21.15.72:0/2378492189 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2fd006dfa0 0x7f2fd0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:41.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.322+0000 7f2fe7e00700 1 --2- 172.21.15.72:0/2378492189 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2fd006dfa0 0x7f2fd0070450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40097b0 tx=0x7f2fd4006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:41.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.326+0000 7f2fe5600700 1 -- 172.21.15.72:0/2378492189 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f2fdc05c4d0 con 0x7f2fe8100d60 2024-03-19T06:09:41.512 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:41 smithi072 ceph-mon[78545]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:41.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.586+0000 7f2fefc00700 1 -- 172.21.15.72:0/2378492189 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fe802cef0 con 0x7f2fd006dfa0 2024-03-19T06:09:41.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.587+0000 7f2fe5600700 1 -- 172.21.15.72:0/2378492189 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2fe802cef0 con 0x7f2fd006dfa0 2024-03-19T06:09:41.578 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:09:41.578 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:09:41.578 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:09:41.578 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:09:41.578 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:09:41.578 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:09:41.579 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:09:41.579 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:09:41.579 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:09:41.579 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "7/23 daemons upgraded", 2024-03-19T06:09:41.579 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-03-19T06:09:41.579 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:09:41.579 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:09:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.590+0000 7f2fefc00700 1 -- 172.21.15.72:0/2378492189 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2fd006dfa0 msgr2=0x7f2fd0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.590+0000 7f2fefc00700 1 --2- 172.21.15.72:0/2378492189 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2fd006dfa0 0x7f2fd0070450 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40097b0 tx=0x7f2fd4006d20 comp rx=0 tx=0).stop 2024-03-19T06:09:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.590+0000 7f2fefc00700 1 -- 172.21.15.72:0/2378492189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8100d60 msgr2=0x7f2fe81006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.590+0000 7f2fefc00700 1 --2- 172.21.15.72:0/2378492189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8100d60 0x7f2fe81006c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00bda0 tx=0x7f2fdc00be80 comp rx=0 tx=0).stop 2024-03-19T06:09:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.591+0000 7f2fefc00700 1 -- 172.21.15.72:0/2378492189 shutdown_connections 2024-03-19T06:09:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.591+0000 7f2fefc00700 1 --2- 172.21.15.72:0/2378492189 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2fd006dfa0 0x7f2fd0070450 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.591+0000 7f2fefc00700 1 --2- 172.21.15.72:0/2378492189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe8100d60 0x7f2fe81006c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.591+0000 7f2fefc00700 1 --2- 172.21.15.72:0/2378492189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe8103680 0x7f2fe80fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.591+0000 7f2fefc00700 1 -- 172.21.15.72:0/2378492189 >> 172.21.15.72:0/2378492189 conn(0x7f2fe80fa780 msgr2=0x7f2fe80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.591+0000 7f2fefc00700 1 -- 172.21.15.72:0/2378492189 shutdown_connections 2024-03-19T06:09:41.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.591+0000 7f2fefc00700 1 -- 172.21.15.72:0/2378492189 wait complete. 2024-03-19T06:09:41.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.753+0000 7fac38800700 1 -- 172.21.15.72:0/1065331639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac30073750 msgr2=0x7fac30073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:41.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.753+0000 7fac38800700 1 --2- 172.21.15.72:0/1065331639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac30073750 0x7fac30073bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fac20009910 tx=0x7fac20009c20 comp rx=0 tx=0).stop 2024-03-19T06:09:41.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.753+0000 7fac38800700 1 -- 172.21.15.72:0/1065331639 shutdown_connections 2024-03-19T06:09:41.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.753+0000 7fac38800700 1 --2- 172.21.15.72:0/1065331639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac30073750 0x7fac30073bc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:41.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.753+0000 7fac38800700 1 --2- 172.21.15.72:0/1065331639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac30074d20 0x7fac30073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:41.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.753+0000 7fac38800700 1 -- 172.21.15.72:0/1065331639 >> 172.21.15.72:0/1065331639 conn(0x7fac300fb7f0 msgr2=0x7fac300fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:41.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.753+0000 7fac38800700 1 -- 172.21.15.72:0/1065331639 shutdown_connections 2024-03-19T06:09:41.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.753+0000 7fac38800700 1 -- 172.21.15.72:0/1065331639 wait complete. 2024-03-19T06:09:41.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.754+0000 7fac38800700 1 Processor -- start 2024-03-19T06:09:41.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.754+0000 7fac38800700 1 -- start start 2024-03-19T06:09:41.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.755+0000 7fac38800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac30073750 0x7fac30197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:41.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.755+0000 7fac38800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac30074d20 0x7fac301981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.755+0000 7fac38800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac301987e0 con 0x7fac30074d20 2024-03-19T06:09:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.755+0000 7fac38800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac30198950 con 0x7fac30073750 2024-03-19T06:09:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.755+0000 7fac35400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac30074d20 0x7fac301981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.755+0000 7fac35400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac30074d20 0x7fac301981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41992/0 (socket says 172.21.15.72:41992) 2024-03-19T06:09:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.755+0000 7fac35400700 1 -- 172.21.15.72:0/1664524468 learned_addr learned my addr 172.21.15.72:0/1664524468 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:09:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.756+0000 7fac35e00700 1 --2- 172.21.15.72:0/1664524468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac30073750 0x7fac30197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.756+0000 7fac35400700 1 -- 172.21.15.72:0/1664524468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac30073750 msgr2=0x7fac30197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.756+0000 7fac35400700 1 --2- 172.21.15.72:0/1664524468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac30073750 0x7fac30197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.756+0000 7fac35400700 1 -- 172.21.15.72:0/1664524468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac200095f0 con 0x7fac30074d20 2024-03-19T06:09:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.756+0000 7fac35400700 1 --2- 172.21.15.72:0/1664524468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac30074d20 0x7fac301981e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac20005b40 tx=0x7fac2000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.756+0000 7fac2aa00700 1 -- 172.21.15.72:0/1664524468 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac2001d070 con 0x7fac30074d20 2024-03-19T06:09:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.756+0000 7fac2aa00700 1 -- 172.21.15.72:0/1664524468 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fac2000f460 con 0x7fac30074d20 2024-03-19T06:09:41.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.756+0000 7fac38800700 1 -- 172.21.15.72:0/1664524468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3019d380 con 0x7fac30074d20 2024-03-19T06:09:41.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.757+0000 7fac2aa00700 1 -- 172.21.15.72:0/1664524468 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac20021640 con 0x7fac30074d20 2024-03-19T06:09:41.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.757+0000 7fac38800700 1 -- 172.21.15.72:0/1664524468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3019d870 con 0x7fac30074d20 2024-03-19T06:09:41.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.758+0000 7fac38800700 1 -- 172.21.15.72:0/1664524468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3010af80 con 0x7fac30074d20 2024-03-19T06:09:41.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.759+0000 7fac2aa00700 1 -- 172.21.15.72:0/1664524468 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fac2000fa90 con 0x7fac30074d20 2024-03-19T06:09:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.760+0000 7fac2aa00700 1 --2- 172.21.15.72:0/1664524468 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fac1806dfa0 0x7fac18070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:09:41.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.760+0000 7fac2aa00700 1 -- 172.21.15.72:0/1664524468 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fac2008efe0 con 0x7fac30074d20 2024-03-19T06:09:41.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.761+0000 7fac35e00700 1 --2- 172.21.15.72:0/1664524468 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fac1806dfa0 0x7fac18070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:09:41.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.761+0000 7fac35e00700 1 --2- 172.21.15.72:0/1664524468 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fac1806dfa0 0x7fac18070450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fac24005950 tx=0x7fac240058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:09:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:41.765+0000 7fac2aa00700 1 -- 172.21.15.72:0/1664524468 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fac200c31e0 con 0x7fac30074d20 2024-03-19T06:09:41.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:41 smithi072 ceph-mon[78545]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:41.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:41 smithi072 ceph-mon[78545]: from='osd.0 [v2:172.21.15.72:6802/823954487,v1:172.21.15.72:6803/823954487]' entity='osd.0' 2024-03-19T06:09:41.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:41 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2401129475' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:41.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:41.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:41.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:41 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1613473302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:09:41.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:41 smithi172 ceph-mon[66682]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:41.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:41 smithi172 ceph-mon[66682]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:41.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:41 smithi172 ceph-mon[66682]: from='osd.0 [v2:172.21.15.72:6802/823954487,v1:172.21.15.72:6803/823954487]' entity='osd.0' 2024-03-19T06:09:41.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:41 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2401129475' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:41.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:41.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:41.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:41 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1613473302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:09:42.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.077+0000 7fac38800700 1 -- 172.21.15.72:0/1664524468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fac3019df00 con 0x7fac30074d20 2024-03-19T06:09:42.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.078+0000 7fac2aa00700 1 -- 172.21.15.72:0/1664524468 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1484 (secure 0 0 0) 0x7fac200265e0 con 0x7fac30074d20 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 79/396 objects degraded (19.949%), 20 pgs degraded 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 79/396 objects degraded (19.949%), 20 pgs degraded 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-03-19T06:09:42.070 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-03-19T06:09:42.071 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-03-19T06:09:42.071 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-03-19T06:09:42.071 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-03-19T06:09:42.071 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-03-19T06:09:42.071 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-03-19T06:09:42.071 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-03-19T06:09:42.071 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-03-19T06:09:42.071 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-03-19T06:09:42.071 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-03-19T06:09:42.071 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-03-19T06:09:42.071 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-03-19T06:09:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.081+0000 7fac38800700 1 -- 172.21.15.72:0/1664524468 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fac1806dfa0 msgr2=0x7fac18070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.081+0000 7fac38800700 1 --2- 172.21.15.72:0/1664524468 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fac1806dfa0 0x7fac18070450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fac24005950 tx=0x7fac240058e0 comp rx=0 tx=0).stop 2024-03-19T06:09:42.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.081+0000 7fac38800700 1 -- 172.21.15.72:0/1664524468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac30074d20 msgr2=0x7fac301981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:09:42.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.081+0000 7fac38800700 1 --2- 172.21.15.72:0/1664524468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac30074d20 0x7fac301981e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac20005b40 tx=0x7fac2000be20 comp rx=0 tx=0).stop 2024-03-19T06:09:42.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.081+0000 7fac38800700 1 -- 172.21.15.72:0/1664524468 shutdown_connections 2024-03-19T06:09:42.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.081+0000 7fac38800700 1 --2- 172.21.15.72:0/1664524468 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fac1806dfa0 0x7fac18070450 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:42.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.081+0000 7fac38800700 1 --2- 172.21.15.72:0/1664524468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac30073750 0x7fac30197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:42.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.081+0000 7fac38800700 1 --2- 172.21.15.72:0/1664524468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac30074d20 0x7fac301981e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:09:42.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.081+0000 7fac38800700 1 -- 172.21.15.72:0/1664524468 >> 172.21.15.72:0/1664524468 conn(0x7fac300fb7f0 msgr2=0x7fac30106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:09:42.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.082+0000 7fac38800700 1 -- 172.21.15.72:0/1664524468 shutdown_connections 2024-03-19T06:09:42.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:09:42.082+0000 7fac38800700 1 -- 172.21.15.72:0/1664524468 wait complete. 2024-03-19T06:09:42.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:42 smithi072 ceph-mon[78545]: pgmap v74: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 79/396 objects degraded (19.949%) 2024-03-19T06:09:42.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:42 smithi072 ceph-mon[78545]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-19T06:09:42.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:42 smithi072 ceph-mon[78545]: osd.0 [v2:172.21.15.72:6802/823954487,v1:172.21.15.72:6803/823954487] boot 2024-03-19T06:09:42.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:42 smithi072 ceph-mon[78545]: osdmap e52: 6 total, 6 up, 6 in 2024-03-19T06:09:42.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T06:09:42.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:42 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1664524468' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:09:42.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:42 smithi072 ceph-mon[78545]: osdmap e53: 6 total, 6 up, 6 in 2024-03-19T06:09:42.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:42 smithi172 ceph-mon[66682]: pgmap v74: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 79/396 objects degraded (19.949%) 2024-03-19T06:09:42.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:42 smithi172 ceph-mon[66682]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-19T06:09:42.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:42 smithi172 ceph-mon[66682]: osd.0 [v2:172.21.15.72:6802/823954487,v1:172.21.15.72:6803/823954487] boot 2024-03-19T06:09:42.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:42 smithi172 ceph-mon[66682]: osdmap e52: 6 total, 6 up, 6 in 2024-03-19T06:09:42.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-19T06:09:42.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:42 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1664524468' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:09:42.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:42 smithi172 ceph-mon[66682]: osdmap e53: 6 total, 6 up, 6 in 2024-03-19T06:09:43.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:43 smithi072 ceph-mon[78545]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:43.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:43.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:43.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:43 smithi172 ceph-mon[66682]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:09:43.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:43.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:44.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:44 smithi072 ceph-mon[78545]: pgmap v77: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 79/396 objects degraded (19.949%) 2024-03-19T06:09:44.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:44 smithi172 ceph-mon[66682]: pgmap v77: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 79/396 objects degraded (19.949%) 2024-03-19T06:09:45.753 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:45 smithi072 ceph-mon[78545]: pgmap v78: 65 pgs: 17 active+undersized+degraded, 8 active+undersized, 40 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 64/396 objects degraded (16.162%) 2024-03-19T06:09:45.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:45 smithi172 ceph-mon[66682]: pgmap v78: 65 pgs: 17 active+undersized+degraded, 8 active+undersized, 40 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 64/396 objects degraded (16.162%) 2024-03-19T06:09:46.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:46 smithi172 ceph-mon[66682]: Health check update: Degraded data redundancy: 64/396 objects degraded (16.162%), 17 pgs degraded (PG_DEGRADED) 2024-03-19T06:09:46.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:46 smithi072 ceph-mon[78545]: Health check update: Degraded data redundancy: 64/396 objects degraded (16.162%), 17 pgs degraded (PG_DEGRADED) 2024-03-19T06:09:47.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:47 smithi072 ceph-mon[78545]: pgmap v79: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:47.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:47 smithi172 ceph-mon[66682]: pgmap v79: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:48.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 64/396 objects degraded (16.162%), 17 pgs degraded) 2024-03-19T06:09:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:09:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:09:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:09:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-19T06:09:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-19T06:09:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:48 smithi072 ceph-mon[78545]: Upgrade: osd.1 is safe to restart 2024-03-19T06:09:48.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 64/396 objects degraded (16.162%), 17 pgs degraded) 2024-03-19T06:09:48.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:48.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:48.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:09:48.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:09:48.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:48.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:09:48.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:48.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:48.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:09:48.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-19T06:09:48.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-19T06:09:48.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:48 smithi172 ceph-mon[66682]: Upgrade: osd.1 is safe to restart 2024-03-19T06:09:49.603 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:49 smithi072 ceph-mon[78545]: pgmap v80: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:49.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:49 smithi172 ceph-mon[66682]: pgmap v80: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:51.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:51 smithi072 ceph-mon[78545]: Upgrade: Updating osd.1 2024-03-19T06:09:51.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:51 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:51.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:51 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-19T06:09:51.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:51 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:09:51.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:51 smithi072 ceph-mon[78545]: Deploying daemon osd.1 on smithi072 2024-03-19T06:09:51.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:51 smithi172 ceph-mon[66682]: Upgrade: Updating osd.1 2024-03-19T06:09:51.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:51 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:51.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:51 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-19T06:09:51.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:51 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:09:51.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:51 smithi172 ceph-mon[66682]: Deploying daemon osd.1 on smithi072 2024-03-19T06:09:52.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:52 smithi072 ceph-mon[78545]: pgmap v81: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:52.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:52 smithi172 ceph-mon[66682]: pgmap v81: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:54.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:54 smithi072 ceph-mon[78545]: pgmap v82: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:54.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:54 smithi172 ceph-mon[66682]: pgmap v82: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:55.819 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:55 smithi072 systemd[1]: Stopping Ceph osd.1 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:09:56.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:55 smithi072 ceph-mon[78545]: pgmap v83: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:56.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:56.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:09:56.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:56.076 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:55 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1[49107]: 2024-03-19T06:09:55.936+0000 7f1f7ce00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:09:56.076 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:55 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1[49107]: 2024-03-19T06:09:55.936+0000 7f1f7ce00700 -1 osd.1 53 *** Got signal Terminated *** 2024-03-19T06:09:56.076 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:55 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1[49107]: 2024-03-19T06:09:55.936+0000 7f1f7ce00700 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-19T06:09:56.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:55 smithi172 ceph-mon[66682]: pgmap v83: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:56.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:56.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:09:56.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:09:56.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:56 smithi172 ceph-mon[66682]: osd.1 marked itself down and dead 2024-03-19T06:09:57.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:56 smithi072 ceph-mon[78545]: osd.1 marked itself down and dead 2024-03-19T06:09:57.788 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:57 smithi072 podman[88179]: 2024-03-19 06:09:57.440737849 +0000 UTC m=+1.665076788 container died b03daf84d86f2c167c6d1260bb1962b9916bdef7666214fa106c95465a8e0144 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2) 2024-03-19T06:09:58.075 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:57 smithi072 podman[88179]: 2024-03-19 06:09:57.940081397 +0000 UTC m=+2.164420333 container cleanup b03daf84d86f2c167c6d1260bb1962b9916bdef7666214fa106c95465a8e0144 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.license=GPLv2) 2024-03-19T06:09:58.075 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:57 smithi072 bash[88179]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1 2024-03-19T06:09:58.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:57 smithi072 ceph-mon[78545]: pgmap v84: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:58.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:57 smithi072 ceph-mon[78545]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-19T06:09:58.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:57 smithi072 ceph-mon[78545]: osdmap e54: 6 total, 5 up, 6 in 2024-03-19T06:09:58.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:57 smithi172 ceph-mon[66682]: pgmap v84: 65 pgs: 65 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:09:58.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:57 smithi172 ceph-mon[66682]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-19T06:09:58.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:57 smithi172 ceph-mon[66682]: osdmap e54: 6 total, 5 up, 6 in 2024-03-19T06:09:58.578 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:58 smithi072 podman[88199]: 2024-03-19 06:09:58.153134122 +0000 UTC m=+0.696477826 container remove b03daf84d86f2c167c6d1260bb1962b9916bdef7666214fa106c95465a8e0144 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-19T06:09:59.103 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:58 smithi072 ceph-mon[78545]: osdmap e55: 6 total, 5 up, 6 in 2024-03-19T06:09:59.103 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:58 smithi072 podman[88289]: 2024-03-19 06:09:58.832475405 +0000 UTC m=+0.036307045 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:09:59.103 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:58 smithi072 podman[88289]: 2024-03-19 06:09:58.955360566 +0000 UTC m=+0.159192243 container create cee9aeaebc8d5d0a1c32475532fd79ff94c1a4307c92370c1f49a501d05dde77 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-deactivate, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222) 2024-03-19T06:09:59.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:58 smithi172 ceph-mon[66682]: osdmap e55: 6 total, 5 up, 6 in 2024-03-19T06:09:59.575 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:59 smithi072 podman[88289]: 2024-03-19 06:09:59.281574053 +0000 UTC m=+0.485405723 container init cee9aeaebc8d5d0a1c32475532fd79ff94c1a4307c92370c1f49a501d05dde77 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-deactivate, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-19T06:09:59.576 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:59 smithi072 podman[88289]: 2024-03-19 06:09:59.292788961 +0000 UTC m=+0.496620645 container start cee9aeaebc8d5d0a1c32475532fd79ff94c1a4307c92370c1f49a501d05dde77 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240222, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:09:59.576 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:59 smithi072 podman[88289]: 2024-03-19 06:09:59.395278242 +0000 UTC m=+0.599109887 container attach cee9aeaebc8d5d0a1c32475532fd79ff94c1a4307c92370c1f49a501d05dde77 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, ceph=True, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271) 2024-03-19T06:10:00.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:09:59 smithi072 ceph-mon[78545]: pgmap v87: 65 pgs: 12 stale+active+clean, 53 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:00.076 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:09:59 smithi072 podman[88289]: 2024-03-19 06:09:59.725258019 +0000 UTC m=+0.929089659 container died cee9aeaebc8d5d0a1c32475532fd79ff94c1a4307c92370c1f49a501d05dde77 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-03-19T06:10:00.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:09:59 smithi172 ceph-mon[66682]: pgmap v87: 65 pgs: 12 stale+active+clean, 53 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:00.826 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:00 smithi072 podman[88314]: 2024-03-19 06:10:00.462474594 +0000 UTC m=+0.722579303 container remove cee9aeaebc8d5d0a1c32475532fd79ff94c1a4307c92370c1f49a501d05dde77 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:10:00.826 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:00 smithi072 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.1.service: Deactivated successfully. 2024-03-19T06:10:00.826 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:00 smithi072 systemd[1]: Stopped Ceph osd.1 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:10:00.826 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:00 smithi072 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.1.service: Consumed 1min 41.645s CPU time. 2024-03-19T06:10:01.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:00 smithi172 ceph-mon[66682]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-03-19T06:10:01.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:00 smithi172 ceph-mon[66682]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:10:01.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:00 smithi172 ceph-mon[66682]: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:10:01.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:00 smithi172 ceph-mon[66682]: [WRN] OSD_DOWN: 1 osds down 2024-03-19T06:10:01.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:00 smithi172 ceph-mon[66682]: osd.1 (root=default,host=smithi072) is down 2024-03-19T06:10:01.218 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:00 smithi072 systemd[1]: Starting Ceph osd.1 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:10:01.219 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:00 smithi072 ceph-mon[78545]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-03-19T06:10:01.219 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:00 smithi072 ceph-mon[78545]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:10:01.219 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:00 smithi072 ceph-mon[78545]: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:10:01.219 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:00 smithi072 ceph-mon[78545]: [WRN] OSD_DOWN: 1 osds down 2024-03-19T06:10:01.219 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:00 smithi072 ceph-mon[78545]: osd.1 (root=default,host=smithi072) is down 2024-03-19T06:10:01.511 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:01 smithi072 podman[88412]: 2024-03-19 06:10:01.13363246 +0000 UTC m=+0.032951557 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:10:01.511 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:01 smithi072 podman[88412]: 2024-03-19 06:10:01.248911376 +0000 UTC m=+0.148230497 container create f3863e01470af4fdfe151f9d1ca0fba41bfc87d250f8f937cda7275d3afd2c2e (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-19T06:10:01.511 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:01 smithi072 podman[88412]: 2024-03-19 06:10:01.520998422 +0000 UTC m=+0.420317617 container init f3863e01470af4fdfe151f9d1ca0fba41bfc87d250f8f937cda7275d3afd2c2e (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0) 2024-03-19T06:10:01.826 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:01 smithi072 podman[88412]: 2024-03-19 06:10:01.532073988 +0000 UTC m=+0.431393087 container start f3863e01470af4fdfe151f9d1ca0fba41bfc87d250f8f937cda7275d3afd2c2e (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-19T06:10:01.826 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:01 smithi072 podman[88412]: 2024-03-19 06:10:01.680434798 +0000 UTC m=+0.579753966 container attach f3863e01470af4fdfe151f9d1ca0fba41bfc87d250f8f937cda7275d3afd2c2e (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True) 2024-03-19T06:10:02.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:01 smithi172 ceph-mon[66682]: pgmap v88: 65 pgs: 2 active+undersized+degraded, 9 stale+active+clean, 3 active+undersized, 51 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 9/396 objects degraded (2.273%) 2024-03-19T06:10:02.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:01 smithi172 ceph-mon[66682]: Health check failed: Degraded data redundancy: 9/396 objects degraded (2.273%), 2 pgs degraded (PG_DEGRADED) 2024-03-19T06:10:02.304 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:01 smithi072 ceph-mon[78545]: pgmap v88: 65 pgs: 2 active+undersized+degraded, 9 stale+active+clean, 3 active+undersized, 51 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 9/396 objects degraded (2.273%) 2024-03-19T06:10:02.304 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:01 smithi072 ceph-mon[78545]: Health check failed: Degraded data redundancy: 9/396 objects degraded (2.273%), 2 pgs degraded (PG_DEGRADED) 2024-03-19T06:10:02.576 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate[88427]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-19T06:10:02.576 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate[88427]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-19T06:10:02.576 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 bash[88412]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-19T06:10:02.576 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 bash[88412]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-19T06:10:02.576 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 bash[88412]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-19T06:10:02.577 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 bash[88412]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-19T06:10:02.577 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 bash[88412]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-03-19T06:10:02.577 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 bash[88412]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-19T06:10:02.577 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 bash[88412]: --> ceph-volume raw activate successful for osd ID: 1 2024-03-19T06:10:02.577 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate[88427]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-19T06:10:02.577 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate[88427]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-19T06:10:02.577 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate[88427]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-03-19T06:10:02.577 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate[88427]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-19T06:10:02.577 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate[88427]: --> ceph-volume raw activate successful for osd ID: 1 2024-03-19T06:10:02.577 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:02 smithi072 podman[88412]: 2024-03-19 06:10:02.454373518 +0000 UTC m=+1.353692679 container died f3863e01470af4fdfe151f9d1ca0fba41bfc87d250f8f937cda7275d3afd2c2e (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-03-19T06:10:03.803 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:03 smithi072 podman[88557]: 2024-03-19 06:10:03.47342389 +0000 UTC m=+1.000631472 container remove f3863e01470af4fdfe151f9d1ca0fba41bfc87d250f8f937cda7275d3afd2c2e (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-activate, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-03-19T06:10:04.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:03 smithi072 ceph-mon[78545]: pgmap v89: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:04.076 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:03 smithi072 podman[88620]: 2024-03-19 06:10:03.720406507 +0000 UTC m=+0.033628046 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:10:04.076 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:03 smithi072 podman[88620]: 2024-03-19 06:10:03.833543831 +0000 UTC m=+0.146765394 container create 5b934e3ebc97d0414944c086d7ed398563a0521be48e1bd17c6d2788f35528b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-03-19T06:10:04.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:03 smithi172 ceph-mon[66682]: pgmap v89: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:04.575 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:04 smithi072 podman[88620]: 2024-03-19 06:10:04.088910953 +0000 UTC m=+0.402132523 container init 5b934e3ebc97d0414944c086d7ed398563a0521be48e1bd17c6d2788f35528b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222) 2024-03-19T06:10:04.575 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:04 smithi072 podman[88620]: 2024-03-19 06:10:04.099808736 +0000 UTC m=+0.413030306 container start 5b934e3ebc97d0414944c086d7ed398563a0521be48e1bd17c6d2788f35528b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240222, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b) 2024-03-19T06:10:04.575 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:04 smithi072 ceph-osd[88639]: -- 172.21.15.72:0/274680967 <== mon.0 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563428a2f680 con 0x5634289f9000 2024-03-19T06:10:04.576 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:04 smithi072 bash[88620]: 5b934e3ebc97d0414944c086d7ed398563a0521be48e1bd17c6d2788f35528b8 2024-03-19T06:10:04.576 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:04 smithi072 systemd[1]: Started Ceph osd.1 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:10:05.075 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:04 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1[88635]: 2024-03-19T06:10:04.675+0000 7f0c9e0557c0 -1 Falling back to public interface 2024-03-19T06:10:05.686 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:05.687 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:05.687 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:10:05.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:05.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:05.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:10:06.680 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:06 smithi072 ceph-mon[78545]: pgmap v90: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:06.881 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:06 smithi172 ceph-mon[66682]: pgmap v90: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:08.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:08 smithi072 ceph-mon[78545]: pgmap v91: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:08.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:08 smithi072 ceph-mon[78545]: Health check update: Degraded data redundancy: 59/396 objects degraded (14.899%), 16 pgs degraded (PG_DEGRADED) 2024-03-19T06:10:08.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:08 smithi172 ceph-mon[66682]: pgmap v91: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:08.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:08 smithi172 ceph-mon[66682]: Health check update: Degraded data redundancy: 59/396 objects degraded (14.899%), 16 pgs degraded (PG_DEGRADED) 2024-03-19T06:10:10.075 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:09 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1[88635]: 2024-03-19T06:10:09.816+0000 7f0c9e0557c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-03-19T06:10:10.435 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:10 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1[88635]: 2024-03-19T06:10:10.185+0000 7f0c9e0557c0 -1 osd.1 53 log_to_monitors true 2024-03-19T06:10:10.751 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:10 smithi072 ceph-mon[78545]: pgmap v92: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:10.751 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:10.751 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:10:10.752 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:10 smithi072 ceph-mon[78545]: from='osd.1 [v2:172.21.15.72:6810/2275618942,v1:172.21.15.72:6811/2275618942]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-19T06:10:10.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:10 smithi172 ceph-mon[66682]: pgmap v92: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:10.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:10.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:10:10.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:10 smithi172 ceph-mon[66682]: from='osd.1 [v2:172.21.15.72:6810/2275618942,v1:172.21.15.72:6811/2275618942]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-19T06:10:12.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:11 smithi172 ceph-mon[66682]: pgmap v93: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:12.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:11 smithi172 ceph-mon[66682]: from='osd.1 [v2:172.21.15.72:6810/2275618942,v1:172.21.15.72:6811/2275618942]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-19T06:10:12.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:11 smithi172 ceph-mon[66682]: osdmap e56: 6 total, 5 up, 6 in 2024-03-19T06:10:12.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:11 smithi172 ceph-mon[66682]: from='osd.1 [v2:172.21.15.72:6810/2275618942,v1:172.21.15.72:6811/2275618942]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-19T06:10:12.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:11 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:12.235 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:10:11 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1[88635]: 2024-03-19T06:10:11.862+0000 7f0c88400700 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:10:12.236 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:11 smithi072 ceph-mon[78545]: pgmap v93: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:12.236 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:11 smithi072 ceph-mon[78545]: from='osd.1 [v2:172.21.15.72:6810/2275618942,v1:172.21.15.72:6811/2275618942]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-19T06:10:12.236 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:11 smithi072 ceph-mon[78545]: osdmap e56: 6 total, 5 up, 6 in 2024-03-19T06:10:12.236 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:11 smithi072 ceph-mon[78545]: from='osd.1 [v2:172.21.15.72:6810/2275618942,v1:172.21.15.72:6811/2275618942]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-19T06:10:12.236 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:11 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:12.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.245+0000 7f9a87600700 1 -- 172.21.15.72:0/1403652936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a80101440 msgr2=0x7f9a80101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:12.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.245+0000 7f9a87600700 1 --2- 172.21.15.72:0/1403652936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a80101440 0x7f9a80101890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009910 tx=0x7f9a6c009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:12.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.245+0000 7f9a87600700 1 -- 172.21.15.72:0/1403652936 shutdown_connections 2024-03-19T06:10:12.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.245+0000 7f9a87600700 1 --2- 172.21.15.72:0/1403652936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a80101440 0x7f9a80101890 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:12.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.245+0000 7f9a87600700 1 --2- 172.21.15.72:0/1403652936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a80100240 0x7f9a80100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:12.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.245+0000 7f9a87600700 1 -- 172.21.15.72:0/1403652936 >> 172.21.15.72:0/1403652936 conn(0x7f9a800fb7f0 msgr2=0x7f9a800fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:12.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.245+0000 7f9a87600700 1 -- 172.21.15.72:0/1403652936 shutdown_connections 2024-03-19T06:10:12.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.245+0000 7f9a87600700 1 -- 172.21.15.72:0/1403652936 wait complete. 2024-03-19T06:10:12.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.246+0000 7f9a87600700 1 Processor -- start 2024-03-19T06:10:12.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.246+0000 7f9a87600700 1 -- start start 2024-03-19T06:10:12.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.246+0000 7f9a87600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a80100240 0x7f9a80197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:12.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.246+0000 7f9a87600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a80101440 0x7f9a80198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:12.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.247+0000 7f9a87600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801988a0 con 0x7f9a80101440 2024-03-19T06:10:12.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.247+0000 7f9a87600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801989e0 con 0x7f9a80100240 2024-03-19T06:10:12.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.247+0000 7f9a7fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a80101440 0x7f9a80198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:12.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.247+0000 7f9a7fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a80101440 0x7f9a80198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35094/0 (socket says 172.21.15.72:35094) 2024-03-19T06:10:12.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.247+0000 7f9a7fe00700 1 -- 172.21.15.72:0/2530289242 learned_addr learned my addr 172.21.15.72:0/2530289242 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:12.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.247+0000 7f9a84c00700 1 --2- 172.21.15.72:0/2530289242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a80100240 0x7f9a80197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:12.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.247+0000 7f9a7fe00700 1 -- 172.21.15.72:0/2530289242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a80100240 msgr2=0x7f9a80197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:12.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.247+0000 7f9a7fe00700 1 --2- 172.21.15.72:0/2530289242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a80100240 0x7f9a80197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:12.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.247+0000 7f9a7fe00700 1 -- 172.21.15.72:0/2530289242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0095f0 con 0x7f9a80101440 2024-03-19T06:10:12.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.248+0000 7f9a7fe00700 1 --2- 172.21.15.72:0/2530289242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a80101440 0x7f9a80198280 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c005b40 tx=0x7f9a6c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:12.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.248+0000 7f9a7d600700 1 -- 172.21.15.72:0/2530289242 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a6c01d070 con 0x7f9a80101440 2024-03-19T06:10:12.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.248+0000 7f9a7d600700 1 -- 172.21.15.72:0/2530289242 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9a6c022470 con 0x7f9a80101440 2024-03-19T06:10:12.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.248+0000 7f9a87600700 1 -- 172.21.15.72:0/2530289242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8019d430 con 0x7f9a80101440 2024-03-19T06:10:12.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.248+0000 7f9a7d600700 1 -- 172.21.15.72:0/2530289242 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a6c00f690 con 0x7f9a80101440 2024-03-19T06:10:12.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.248+0000 7f9a87600700 1 -- 172.21.15.72:0/2530289242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8019d920 con 0x7f9a80101440 2024-03-19T06:10:12.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.250+0000 7f9a87600700 1 -- 172.21.15.72:0/2530289242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a80105520 con 0x7f9a80101440 2024-03-19T06:10:12.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.250+0000 7f9a7d600700 1 -- 172.21.15.72:0/2530289242 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f9a6c0225e0 con 0x7f9a80101440 2024-03-19T06:10:12.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.251+0000 7f9a7d600700 1 --2- 172.21.15.72:0/2530289242 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9a6806dfa0 0x7f9a68070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:12.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.251+0000 7f9a7d600700 1 -- 172.21.15.72:0/2530289242 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9a6c08f600 con 0x7f9a80101440 2024-03-19T06:10:12.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.252+0000 7f9a84c00700 1 --2- 172.21.15.72:0/2530289242 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9a6806dfa0 0x7f9a68070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:12.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.252+0000 7f9a84c00700 1 --2- 172.21.15.72:0/2530289242 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9a6806dfa0 0x7f9a68070450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a74006fd0 tx=0x7f9a74008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:12.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.257+0000 7f9a7d600700 1 -- 172.21.15.72:0/2530289242 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f9a6c05c630 con 0x7f9a80101440 2024-03-19T06:10:12.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.501+0000 7f9a87600700 1 -- 172.21.15.72:0/2530289242 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a80061190 con 0x7f9a6806dfa0 2024-03-19T06:10:12.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.503+0000 7f9a7d600700 1 -- 172.21.15.72:0/2530289242 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9a80061190 con 0x7f9a6806dfa0 2024-03-19T06:10:12.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.505+0000 7f9a87600700 1 -- 172.21.15.72:0/2530289242 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9a6806dfa0 msgr2=0x7f9a68070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:12.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.505+0000 7f9a87600700 1 --2- 172.21.15.72:0/2530289242 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9a6806dfa0 0x7f9a68070450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a74006fd0 tx=0x7f9a74008040 comp rx=0 tx=0).stop 2024-03-19T06:10:12.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.505+0000 7f9a87600700 1 -- 172.21.15.72:0/2530289242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a80101440 msgr2=0x7f9a80198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:12.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.505+0000 7f9a87600700 1 --2- 172.21.15.72:0/2530289242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a80101440 0x7f9a80198280 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c005b40 tx=0x7f9a6c00be20 comp rx=0 tx=0).stop 2024-03-19T06:10:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.506+0000 7f9a87600700 1 -- 172.21.15.72:0/2530289242 shutdown_connections 2024-03-19T06:10:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.506+0000 7f9a87600700 1 --2- 172.21.15.72:0/2530289242 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9a6806dfa0 0x7f9a68070450 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.506+0000 7f9a87600700 1 --2- 172.21.15.72:0/2530289242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a80100240 0x7f9a80197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.506+0000 7f9a87600700 1 --2- 172.21.15.72:0/2530289242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a80101440 0x7f9a80198280 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.506+0000 7f9a87600700 1 -- 172.21.15.72:0/2530289242 >> 172.21.15.72:0/2530289242 conn(0x7f9a800fb7f0 msgr2=0x7f9a80102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.506+0000 7f9a87600700 1 -- 172.21.15.72:0/2530289242 shutdown_connections 2024-03-19T06:10:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.506+0000 7f9a87600700 1 -- 172.21.15.72:0/2530289242 wait complete. 2024-03-19T06:10:12.512 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:10:12.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.658+0000 7f8861200700 1 -- 172.21.15.72:0/344685364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885c1033d0 msgr2=0x7f885c1057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:12.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.658+0000 7f8861200700 1 --2- 172.21.15.72:0/344685364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885c1033d0 0x7f885c1057b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8848009910 tx=0x7f8848009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:12.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.659+0000 7f8861200700 1 -- 172.21.15.72:0/344685364 shutdown_connections 2024-03-19T06:10:12.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.659+0000 7f8861200700 1 --2- 172.21.15.72:0/344685364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885c1033d0 0x7f885c1057b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:12.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.659+0000 7f8861200700 1 --2- 172.21.15.72:0/344685364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c100ab0 0x7f885c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:12.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.659+0000 7f8861200700 1 -- 172.21.15.72:0/344685364 >> 172.21.15.72:0/344685364 conn(0x7f885c0fa4d0 msgr2=0x7f885c0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:12.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.659+0000 7f8861200700 1 -- 172.21.15.72:0/344685364 shutdown_connections 2024-03-19T06:10:12.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.659+0000 7f8861200700 1 -- 172.21.15.72:0/344685364 wait complete. 2024-03-19T06:10:12.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.660+0000 7f8861200700 1 Processor -- start 2024-03-19T06:10:12.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.660+0000 7f8861200700 1 -- start start 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.660+0000 7f8861200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c100ab0 0x7f885c100410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.660+0000 7f8861200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885c1033d0 0x7f885c0fea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.660+0000 7f8861200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0fefa0 con 0x7f885c1033d0 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.660+0000 7f8861200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0ff0e0 con 0x7f885c100ab0 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.661+0000 7f885aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885c1033d0 0x7f885c0fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.661+0000 7f885aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885c1033d0 0x7f885c0fea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35124/0 (socket says 172.21.15.72:35124) 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.661+0000 7f885aa00700 1 -- 172.21.15.72:0/3695141634 learned_addr learned my addr 172.21.15.72:0/3695141634 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.661+0000 7f885b400700 1 --2- 172.21.15.72:0/3695141634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c100ab0 0x7f885c100410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.661+0000 7f885aa00700 1 -- 172.21.15.72:0/3695141634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c100ab0 msgr2=0x7f885c100410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.661+0000 7f885aa00700 1 --2- 172.21.15.72:0/3695141634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c100ab0 0x7f885c100410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.661+0000 7f885aa00700 1 -- 172.21.15.72:0/3695141634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480095f0 con 0x7f885c1033d0 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.661+0000 7f885b400700 1 --2- 172.21.15.72:0/3695141634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c100ab0 0x7f885c100410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:10:12.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.662+0000 7f885aa00700 1 --2- 172.21.15.72:0/3695141634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885c1033d0 0x7f885c0fea60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8848005b40 tx=0x7f884800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:12.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.662+0000 7f8853e00700 1 -- 172.21.15.72:0/3695141634 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f884801d070 con 0x7f885c1033d0 2024-03-19T06:10:12.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.662+0000 7f8853e00700 1 -- 172.21.15.72:0/3695141634 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8848022470 con 0x7f885c1033d0 2024-03-19T06:10:12.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.662+0000 7f8853e00700 1 -- 172.21.15.72:0/3695141634 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f884800f690 con 0x7f885c1033d0 2024-03-19T06:10:12.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.662+0000 7f8861200700 1 -- 172.21.15.72:0/3695141634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c0ff360 con 0x7f885c1033d0 2024-03-19T06:10:12.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.662+0000 7f8861200700 1 -- 172.21.15.72:0/3695141634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c0ff850 con 0x7f885c1033d0 2024-03-19T06:10:12.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.663+0000 7f8861200700 1 -- 172.21.15.72:0/3695141634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c18fac0 con 0x7f885c1033d0 2024-03-19T06:10:12.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.665+0000 7f8853e00700 1 -- 172.21.15.72:0/3695141634 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f88480225e0 con 0x7f885c1033d0 2024-03-19T06:10:12.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.666+0000 7f8853e00700 1 --2- 172.21.15.72:0/3695141634 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f884006dfa0 0x7f8840070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:12.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.666+0000 7f8853e00700 1 -- 172.21.15.72:0/3695141634 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f884808f400 con 0x7f885c1033d0 2024-03-19T06:10:12.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.667+0000 7f885b400700 1 --2- 172.21.15.72:0/3695141634 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f884006dfa0 0x7f8840070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:12.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.667+0000 7f885b400700 1 --2- 172.21.15.72:0/3695141634 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f884006dfa0 0x7f8840070450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f884c007900 tx=0x7f884c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:12.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.671+0000 7f8853e00700 1 -- 172.21.15.72:0/3695141634 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f884805c570 con 0x7f885c1033d0 2024-03-19T06:10:12.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.934+0000 7f8861200700 1 -- 172.21.15.72:0/3695141634 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f885c061190 con 0x7f884006dfa0 2024-03-19T06:10:12.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.935+0000 7f8853e00700 1 -- 172.21.15.72:0/3695141634 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f885c061190 con 0x7f884006dfa0 2024-03-19T06:10:12.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.938+0000 7f8861200700 1 -- 172.21.15.72:0/3695141634 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f884006dfa0 msgr2=0x7f8840070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:12.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.938+0000 7f8861200700 1 --2- 172.21.15.72:0/3695141634 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f884006dfa0 0x7f8840070450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f884c007900 tx=0x7f884c008040 comp rx=0 tx=0).stop 2024-03-19T06:10:12.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.938+0000 7f8861200700 1 -- 172.21.15.72:0/3695141634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885c1033d0 msgr2=0x7f885c0fea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.938+0000 7f8861200700 1 --2- 172.21.15.72:0/3695141634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885c1033d0 0x7f885c0fea60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8848005b40 tx=0x7f884800be20 comp rx=0 tx=0).stop 2024-03-19T06:10:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.938+0000 7f8861200700 1 -- 172.21.15.72:0/3695141634 shutdown_connections 2024-03-19T06:10:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.938+0000 7f8861200700 1 --2- 172.21.15.72:0/3695141634 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f884006dfa0 0x7f8840070450 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.938+0000 7f8861200700 1 --2- 172.21.15.72:0/3695141634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c100ab0 0x7f885c100410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.938+0000 7f8861200700 1 --2- 172.21.15.72:0/3695141634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885c1033d0 0x7f885c0fea60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.938+0000 7f8861200700 1 -- 172.21.15.72:0/3695141634 >> 172.21.15.72:0/3695141634 conn(0x7f885c0fa4d0 msgr2=0x7f885c0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.938+0000 7f8861200700 1 -- 172.21.15.72:0/3695141634 shutdown_connections 2024-03-19T06:10:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:12.938+0000 7f8861200700 1 -- 172.21.15.72:0/3695141634 wait complete. 2024-03-19T06:10:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.081+0000 7fc0f3400700 1 -- 172.21.15.72:0/1417118905 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e00054b0 con 0x7fc0f4101440 2024-03-19T06:10:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.082+0000 7fc0fba00700 1 -- 172.21.15.72:0/1417118905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0f4101440 msgr2=0x7fc0f4101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.082+0000 7fc0fba00700 1 --2- 172.21.15.72:0/1417118905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0f4101440 0x7fc0f4101890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009910 tx=0x7fc0e0009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.082+0000 7fc0fba00700 1 -- 172.21.15.72:0/1417118905 shutdown_connections 2024-03-19T06:10:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.082+0000 7fc0fba00700 1 --2- 172.21.15.72:0/1417118905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0f4101440 0x7fc0f4101890 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.082+0000 7fc0fba00700 1 --2- 172.21.15.72:0/1417118905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0f4100240 0x7fc0f4100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.082+0000 7fc0fba00700 1 -- 172.21.15.72:0/1417118905 >> 172.21.15.72:0/1417118905 conn(0x7fc0f40fb7f0 msgr2=0x7fc0f40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.082+0000 7fc0fba00700 1 -- 172.21.15.72:0/1417118905 shutdown_connections 2024-03-19T06:10:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.082+0000 7fc0fba00700 1 -- 172.21.15.72:0/1417118905 wait complete. 2024-03-19T06:10:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.083+0000 7fc0fba00700 1 Processor -- start 2024-03-19T06:10:13.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.083+0000 7fc0fba00700 1 -- start start 2024-03-19T06:10:13.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.083+0000 7fc0fba00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0f4100240 0x7fc0f4195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:13.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.083+0000 7fc0fba00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0f4101440 0x7fc0f4196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:13.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.083+0000 7fc0fba00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f41966b0 con 0x7fc0f4101440 2024-03-19T06:10:13.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.083+0000 7fc0fba00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f41967f0 con 0x7fc0f4100240 2024-03-19T06:10:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.084+0000 7fc0f3e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0f4101440 0x7fc0f4196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.084+0000 7fc0f3e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0f4101440 0x7fc0f4196090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35144/0 (socket says 172.21.15.72:35144) 2024-03-19T06:10:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.084+0000 7fc0f3e00700 1 -- 172.21.15.72:0/1099426657 learned_addr learned my addr 172.21.15.72:0/1099426657 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.084+0000 7fc0f9000700 1 --2- 172.21.15.72:0/1099426657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0f4100240 0x7fc0f4195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.084+0000 7fc0f3e00700 1 -- 172.21.15.72:0/1099426657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0f4100240 msgr2=0x7fc0f4195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.084+0000 7fc0f3e00700 1 --2- 172.21.15.72:0/1099426657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0f4100240 0x7fc0f4195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.084+0000 7fc0f3e00700 1 -- 172.21.15.72:0/1099426657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e00095f0 con 0x7fc0f4101440 2024-03-19T06:10:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.085+0000 7fc0f3e00700 1 --2- 172.21.15.72:0/1099426657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0f4101440 0x7fc0f4196090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000bd70 tx=0x7fc0e000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.085+0000 7fc0f1600700 1 -- 172.21.15.72:0/1099426657 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e001d070 con 0x7fc0f4101440 2024-03-19T06:10:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.085+0000 7fc0f1600700 1 -- 172.21.15.72:0/1099426657 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc0e0022470 con 0x7fc0f4101440 2024-03-19T06:10:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.085+0000 7fc0fba00700 1 -- 172.21.15.72:0/1099426657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f419b240 con 0x7fc0f4101440 2024-03-19T06:10:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.085+0000 7fc0f1600700 1 -- 172.21.15.72:0/1099426657 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e000f670 con 0x7fc0f4101440 2024-03-19T06:10:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.085+0000 7fc0fba00700 1 -- 172.21.15.72:0/1099426657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f419b730 con 0x7fc0f4101440 2024-03-19T06:10:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.086+0000 7fc0fba00700 1 -- 172.21.15.72:0/1099426657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f4108e30 con 0x7fc0f4101440 2024-03-19T06:10:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.087+0000 7fc0f1600700 1 -- 172.21.15.72:0/1099426657 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fc0e0022a50 con 0x7fc0f4101440 2024-03-19T06:10:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.089+0000 7fc0f1600700 1 --2- 172.21.15.72:0/1099426657 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc0dc06dfa0 0x7fc0dc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.089+0000 7fc0f1600700 1 -- 172.21.15.72:0/1099426657 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc0e008f390 con 0x7fc0f4101440 2024-03-19T06:10:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.089+0000 7fc0f9000700 1 --2- 172.21.15.72:0/1099426657 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc0dc06dfa0 0x7fc0dc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.090+0000 7fc0f9000700 1 --2- 172.21.15.72:0/1099426657 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc0dc06dfa0 0x7fc0dc070450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8006fd0 tx=0x7fc0e8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:13.082 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:12 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:12 smithi072 ceph-mon[78545]: from='osd.1 [v2:172.21.15.72:6810/2275618942,v1:172.21.15.72:6811/2275618942]' entity='osd.1' 2024-03-19T06:10:13.083 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:12 smithi072 ceph-mon[78545]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:13.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.096+0000 7fc0f1600700 1 -- 172.21.15.72:0/1099426657 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fc0e005c470 con 0x7fc0f4101440 2024-03-19T06:10:13.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:12 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:13.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:12 smithi172 ceph-mon[66682]: from='osd.1 [v2:172.21.15.72:6810/2275618942,v1:172.21.15.72:6811/2275618942]' entity='osd.1' 2024-03-19T06:10:13.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:12 smithi172 ceph-mon[66682]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:13.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.323+0000 7fc0fba00700 1 -- 172.21.15.72:0/1099426657 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0f419bdc0 con 0x7fc0dc06dfa0 2024-03-19T06:10:13.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.335+0000 7fc0f1600700 1 -- 172.21.15.72:0/1099426657 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc0f419bdc0 con 0x7fc0dc06dfa0 2024-03-19T06:10:13.326 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:10:13.326 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (14m) 1s ago 16m 14.0M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:10:13.326 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (17m) 1s ago 17m 8434k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (15m) 64s ago 15m 8010k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (77s) 1s ago 16m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (69s) 64s ago 15m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (14m) 1s ago 16m 74.0M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (9m) 1s ago 9m 16.3M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (9m) 1s ago 9m 125M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (9m) 64s ago 9m 15.9M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (9m) 64s ago 9m 142M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (5m) 1s ago 18m 502M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (3m) 64s ago 15m 450M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (3m) 1s ago 18m 47.2M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (2m) 64s ago 15m 35.7M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (16m) 1s ago 16m 7964k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (15m) 64s ago 15m 8430k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:10:13.327 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (40s) 1s ago 14m 85.4M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:10:13.328 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (9s) 1s ago 13m 11.1M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:10:13.328 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (12m) 1s ago 12m 172M 1216M 18.2.0 dc2bc1663786 34339cf9a90b 2024-03-19T06:10:13.328 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (12m) 64s ago 12m 237M 2241M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:10:13.328 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (11m) 64s ago 11m 230M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:10:13.328 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (11m) 64s ago 11m 189M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:10:13.328 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (3m) 1s ago 15m 64.9M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:10:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.338+0000 7fc0fba00700 1 -- 172.21.15.72:0/1099426657 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc0dc06dfa0 msgr2=0x7fc0dc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.338+0000 7fc0fba00700 1 --2- 172.21.15.72:0/1099426657 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc0dc06dfa0 0x7fc0dc070450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8006fd0 tx=0x7fc0e8008040 comp rx=0 tx=0).stop 2024-03-19T06:10:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.338+0000 7fc0fba00700 1 -- 172.21.15.72:0/1099426657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0f4101440 msgr2=0x7fc0f4196090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.338+0000 7fc0fba00700 1 --2- 172.21.15.72:0/1099426657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0f4101440 0x7fc0f4196090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000bd70 tx=0x7fc0e000be50 comp rx=0 tx=0).stop 2024-03-19T06:10:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.338+0000 7fc0fba00700 1 -- 172.21.15.72:0/1099426657 shutdown_connections 2024-03-19T06:10:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.338+0000 7fc0fba00700 1 --2- 172.21.15.72:0/1099426657 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc0dc06dfa0 0x7fc0dc070450 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.338+0000 7fc0fba00700 1 --2- 172.21.15.72:0/1099426657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0f4100240 0x7fc0f4195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.338+0000 7fc0fba00700 1 --2- 172.21.15.72:0/1099426657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0f4101440 0x7fc0f4196090 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.338+0000 7fc0fba00700 1 -- 172.21.15.72:0/1099426657 >> 172.21.15.72:0/1099426657 conn(0x7fc0f40fb7f0 msgr2=0x7fc0f4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.338+0000 7fc0fba00700 1 -- 172.21.15.72:0/1099426657 shutdown_connections 2024-03-19T06:10:13.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.338+0000 7fc0fba00700 1 -- 172.21.15.72:0/1099426657 wait complete. 2024-03-19T06:10:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.489+0000 7fd626a00700 1 -- 172.21.15.72:0/3676199438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6200737b0 msgr2=0x7fd620073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.489+0000 7fd626a00700 1 --2- 172.21.15.72:0/3676199438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6200737b0 0x7fd620073c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009940 tx=0x7fd60c009c50 comp rx=0 tx=0).stop 2024-03-19T06:10:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.489+0000 7fd626a00700 1 -- 172.21.15.72:0/3676199438 shutdown_connections 2024-03-19T06:10:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.489+0000 7fd626a00700 1 --2- 172.21.15.72:0/3676199438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6200737b0 0x7fd620073c20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.489+0000 7fd626a00700 1 --2- 172.21.15.72:0/3676199438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd620074d80 0x7fd6200731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.489+0000 7fd626a00700 1 -- 172.21.15.72:0/3676199438 >> 172.21.15.72:0/3676199438 conn(0x7fd6200fb7f0 msgr2=0x7fd6200fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.489+0000 7fd626a00700 1 -- 172.21.15.72:0/3676199438 shutdown_connections 2024-03-19T06:10:13.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.490+0000 7fd626a00700 1 -- 172.21.15.72:0/3676199438 wait complete. 2024-03-19T06:10:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.491+0000 7fd626a00700 1 Processor -- start 2024-03-19T06:10:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.491+0000 7fd626a00700 1 -- start start 2024-03-19T06:10:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.492+0000 7fd626a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6200737b0 0x7fd620197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.492+0000 7fd626a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd620074d80 0x7fd6201981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.492+0000 7fd626a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6201987e0 con 0x7fd6200737b0 2024-03-19T06:10:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.492+0000 7fd626a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd620198950 con 0x7fd620074d80 2024-03-19T06:10:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.492+0000 7fd61fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6200737b0 0x7fd620197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.492+0000 7fd61fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6200737b0 0x7fd620197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35160/0 (socket says 172.21.15.72:35160) 2024-03-19T06:10:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.492+0000 7fd61fe00700 1 -- 172.21.15.72:0/1276744214 learned_addr learned my addr 172.21.15.72:0/1276744214 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.492+0000 7fd61f400700 1 --2- 172.21.15.72:0/1276744214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd620074d80 0x7fd6201981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.493+0000 7fd61fe00700 1 -- 172.21.15.72:0/1276744214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd620074d80 msgr2=0x7fd6201981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.493+0000 7fd61fe00700 1 --2- 172.21.15.72:0/1276744214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd620074d80 0x7fd6201981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.493+0000 7fd61fe00700 1 -- 172.21.15.72:0/1276744214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0095f0 con 0x7fd6200737b0 2024-03-19T06:10:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.493+0000 7fd61fe00700 1 --2- 172.21.15.72:0/1276744214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6200737b0 0x7fd620197ca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd61000d8d0 tx=0x7fd61000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.493+0000 7fd61cc00700 1 -- 172.21.15.72:0/1276744214 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6100098a0 con 0x7fd6200737b0 2024-03-19T06:10:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.494+0000 7fd61cc00700 1 -- 172.21.15.72:0/1276744214 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd610010460 con 0x7fd6200737b0 2024-03-19T06:10:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.494+0000 7fd626a00700 1 -- 172.21.15.72:0/1276744214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62019d3e0 con 0x7fd6200737b0 2024-03-19T06:10:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.494+0000 7fd61cc00700 1 -- 172.21.15.72:0/1276744214 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd61000f5f0 con 0x7fd6200737b0 2024-03-19T06:10:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.494+0000 7fd626a00700 1 -- 172.21.15.72:0/1276744214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62019d900 con 0x7fd6200737b0 2024-03-19T06:10:13.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.495+0000 7fd626a00700 1 -- 172.21.15.72:0/1276744214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62010af80 con 0x7fd6200737b0 2024-03-19T06:10:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.496+0000 7fd61cc00700 1 -- 172.21.15.72:0/1276744214 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fd610009a00 con 0x7fd6200737b0 2024-03-19T06:10:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.497+0000 7fd61cc00700 1 --2- 172.21.15.72:0/1276744214 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd60406dfa0 0x7fd604070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.497+0000 7fd61cc00700 1 -- 172.21.15.72:0/1276744214 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fd61008db60 con 0x7fd6200737b0 2024-03-19T06:10:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.498+0000 7fd61f400700 1 --2- 172.21.15.72:0/1276744214 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd60406dfa0 0x7fd604070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.498+0000 7fd61f400700 1 --2- 172.21.15.72:0/1276744214 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd60406dfa0 0x7fd604070450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd60c006010 tx=0x7fd60c005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:13.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.502+0000 7fd61cc00700 1 -- 172.21.15.72:0/1276744214 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fd610057080 con 0x7fd6200737b0 2024-03-19T06:10:13.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.827+0000 7fd626a00700 1 -- 172.21.15.72:0/1276744214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd62010b140 con 0x7fd6200737b0 2024-03-19T06:10:13.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.828+0000 7fd61cc00700 1 -- 172.21.15.72:0/1276744214 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fd61005a740 con 0x7fd6200737b0 2024-03-19T06:10:13.819 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:10:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:10:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:10:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:10:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:10:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:10:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:10:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:10:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-03-19T06:10:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:10:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:10:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:10:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:10:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:10:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:10:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-03-19T06:10:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 6 2024-03-19T06:10:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:10:13.820 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:10:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.830+0000 7fd626a00700 1 -- 172.21.15.72:0/1276744214 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd60406dfa0 msgr2=0x7fd604070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.830+0000 7fd626a00700 1 --2- 172.21.15.72:0/1276744214 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd60406dfa0 0x7fd604070450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd60c006010 tx=0x7fd60c005ab0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.830+0000 7fd626a00700 1 -- 172.21.15.72:0/1276744214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6200737b0 msgr2=0x7fd620197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.830+0000 7fd626a00700 1 --2- 172.21.15.72:0/1276744214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6200737b0 0x7fd620197ca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd61000d8d0 tx=0x7fd61000dbe0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.831+0000 7fd626a00700 1 -- 172.21.15.72:0/1276744214 shutdown_connections 2024-03-19T06:10:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.831+0000 7fd626a00700 1 --2- 172.21.15.72:0/1276744214 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd60406dfa0 0x7fd604070450 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.831+0000 7fd626a00700 1 --2- 172.21.15.72:0/1276744214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6200737b0 0x7fd620197ca0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.831+0000 7fd626a00700 1 --2- 172.21.15.72:0/1276744214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd620074d80 0x7fd6201981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.831+0000 7fd626a00700 1 -- 172.21.15.72:0/1276744214 >> 172.21.15.72:0/1276744214 conn(0x7fd6200fb7f0 msgr2=0x7fd620106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.831+0000 7fd626a00700 1 -- 172.21.15.72:0/1276744214 shutdown_connections 2024-03-19T06:10:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.831+0000 7fd626a00700 1 -- 172.21.15.72:0/1276744214 wait complete. 2024-03-19T06:10:13.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.993+0000 7f6d26c00700 1 -- 172.21.15.72:0/1207160472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d200737b0 msgr2=0x7f6d20073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:13.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.993+0000 7f6d26c00700 1 --2- 172.21.15.72:0/1207160472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d200737b0 0x7f6d20073c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009910 tx=0x7f6d0c009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:13.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.993+0000 7f6d26c00700 1 -- 172.21.15.72:0/1207160472 shutdown_connections 2024-03-19T06:10:13.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.993+0000 7f6d26c00700 1 --2- 172.21.15.72:0/1207160472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d200737b0 0x7f6d20073c20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.993+0000 7f6d26c00700 1 --2- 172.21.15.72:0/1207160472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d20074d80 0x7f6d200731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.993+0000 7f6d26c00700 1 -- 172.21.15.72:0/1207160472 >> 172.21.15.72:0/1207160472 conn(0x7f6d200fb7f0 msgr2=0x7f6d200fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:13.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.993+0000 7f6d26c00700 1 -- 172.21.15.72:0/1207160472 shutdown_connections 2024-03-19T06:10:13.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.993+0000 7f6d26c00700 1 -- 172.21.15.72:0/1207160472 wait complete. 2024-03-19T06:10:13.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.995+0000 7f6d26c00700 1 Processor -- start 2024-03-19T06:10:13.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.995+0000 7f6d26c00700 1 -- start start 2024-03-19T06:10:13.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.995+0000 7f6d26c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d200737b0 0x7f6d2019c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:13.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.995+0000 7f6d26c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20074d80 0x7f6d2019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:13.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.996+0000 7f6d26c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2019cc70 con 0x7f6d20074d80 2024-03-19T06:10:13.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.996+0000 7f6d26c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2019cdb0 con 0x7f6d200737b0 2024-03-19T06:10:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.996+0000 7f6d1f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20074d80 0x7f6d2019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.996+0000 7f6d1f400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20074d80 0x7f6d2019c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46354/0 (socket says 172.21.15.72:46354) 2024-03-19T06:10:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.996+0000 7f6d1f400700 1 -- 172.21.15.72:0/4027514847 learned_addr learned my addr 172.21.15.72:0/4027514847 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.996+0000 7f6d1f400700 1 -- 172.21.15.72:0/4027514847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d200737b0 msgr2=0x7f6d2019c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.996+0000 7f6d1f400700 1 --2- 172.21.15.72:0/4027514847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d200737b0 0x7f6d2019c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.996+0000 7f6d1f400700 1 -- 172.21.15.72:0/4027514847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0095f0 con 0x7f6d20074d80 2024-03-19T06:10:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.997+0000 7f6d1f400700 1 --2- 172.21.15.72:0/4027514847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20074d80 0x7f6d2019c650 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c005b40 tx=0x7f6d0c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.997+0000 7f6d1cc00700 1 -- 172.21.15.72:0/4027514847 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d0c01d070 con 0x7f6d20074d80 2024-03-19T06:10:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.997+0000 7f6d1cc00700 1 -- 172.21.15.72:0/4027514847 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d0c022470 con 0x7f6d20074d80 2024-03-19T06:10:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.997+0000 7f6d26c00700 1 -- 172.21.15.72:0/4027514847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d201a1800 con 0x7f6d20074d80 2024-03-19T06:10:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.997+0000 7f6d1cc00700 1 -- 172.21.15.72:0/4027514847 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d0c00f690 con 0x7f6d20074d80 2024-03-19T06:10:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.997+0000 7f6d26c00700 1 -- 172.21.15.72:0/4027514847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d201a1cf0 con 0x7f6d20074d80 2024-03-19T06:10:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.998+0000 7f6d26c00700 1 -- 172.21.15.72:0/4027514847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2010f3f0 con 0x7f6d20074d80 2024-03-19T06:10:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:13.999+0000 7f6d1cc00700 1 -- 172.21.15.72:0/4027514847 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f6d0c0225e0 con 0x7f6d20074d80 2024-03-19T06:10:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.000+0000 7f6d1cc00700 1 --2- 172.21.15.72:0/4027514847 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6d0406dfa0 0x7f6d04070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.000+0000 7f6d1cc00700 1 -- 172.21.15.72:0/4027514847 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6d0c08f600 con 0x7f6d20074d80 2024-03-19T06:10:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.000+0000 7f6d1fe00700 1 --2- 172.21.15.72:0/4027514847 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6d0406dfa0 0x7f6d04070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.001+0000 7f6d1fe00700 1 --2- 172.21.15.72:0/4027514847 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6d0406dfa0 0x7f6d04070450 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6d100097b0 tx=0x7f6d10006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.005+0000 7f6d1cc00700 1 -- 172.21.15.72:0/4027514847 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f6d0c05c630 con 0x7f6d20074d80 2024-03-19T06:10:14.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:13 smithi072 ceph-mon[78545]: pgmap v95: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:14.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:13 smithi072 ceph-mon[78545]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-19T06:10:14.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:13 smithi072 ceph-mon[78545]: osd.1 [v2:172.21.15.72:6810/2275618942,v1:172.21.15.72:6811/2275618942] boot 2024-03-19T06:10:14.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:13 smithi072 ceph-mon[78545]: osdmap e57: 6 total, 6 up, 6 in 2024-03-19T06:10:14.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:13 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T06:10:14.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:13 smithi072 ceph-mon[78545]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:14.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:13 smithi072 ceph-mon[78545]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:14.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:13 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:14.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:13 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:14.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:13 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1276744214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:14.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:13 smithi172 ceph-mon[66682]: pgmap v95: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:14.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:13 smithi172 ceph-mon[66682]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-19T06:10:14.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:13 smithi172 ceph-mon[66682]: osd.1 [v2:172.21.15.72:6810/2275618942,v1:172.21.15.72:6811/2275618942] boot 2024-03-19T06:10:14.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:13 smithi172 ceph-mon[66682]: osdmap e57: 6 total, 6 up, 6 in 2024-03-19T06:10:14.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:13 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-19T06:10:14.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:13 smithi172 ceph-mon[66682]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:14.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:13 smithi172 ceph-mon[66682]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:14.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:13 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:14.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:13 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:14.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:13 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1276744214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:14.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.269+0000 7f6d26c00700 1 -- 172.21.15.72:0/4027514847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6d201a2330 con 0x7f6d20074d80 2024-03-19T06:10:14.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.270+0000 7f6d1cc00700 1 -- 172.21.15.72:0/4027514847 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1869 (secure 0 0 0) 0x7f6d0c027760 con 0x7f6d20074d80 2024-03-19T06:10:14.260 INFO:teuthology.orchestra.run.smithi072.stdout:e16 2024-03-19T06:10:14.260 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:10:14.260 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 16 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:09:23.789448+0000 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:10:14.261 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:10:14.262 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:10:14.263 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:10:14.263 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:10:14.263 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:10:14.263 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:10:14.263 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:10:14.263 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:10:14.263 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:10:14.263 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:10:14.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.272+0000 7f6d26c00700 1 -- 172.21.15.72:0/4027514847 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6d0406dfa0 msgr2=0x7f6d04070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:14.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.272+0000 7f6d26c00700 1 --2- 172.21.15.72:0/4027514847 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6d0406dfa0 0x7f6d04070450 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6d100097b0 tx=0x7f6d10006d20 comp rx=0 tx=0).stop 2024-03-19T06:10:14.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.272+0000 7f6d26c00700 1 -- 172.21.15.72:0/4027514847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20074d80 msgr2=0x7f6d2019c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:14.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.272+0000 7f6d26c00700 1 --2- 172.21.15.72:0/4027514847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20074d80 0x7f6d2019c650 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c005b40 tx=0x7f6d0c00be20 comp rx=0 tx=0).stop 2024-03-19T06:10:14.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.272+0000 7f6d26c00700 1 -- 172.21.15.72:0/4027514847 shutdown_connections 2024-03-19T06:10:14.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.272+0000 7f6d26c00700 1 --2- 172.21.15.72:0/4027514847 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6d0406dfa0 0x7f6d04070450 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.272+0000 7f6d26c00700 1 --2- 172.21.15.72:0/4027514847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d200737b0 0x7f6d2019c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.272+0000 7f6d26c00700 1 --2- 172.21.15.72:0/4027514847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20074d80 0x7f6d2019c650 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.272+0000 7f6d26c00700 1 -- 172.21.15.72:0/4027514847 >> 172.21.15.72:0/4027514847 conn(0x7f6d200fb7f0 msgr2=0x7f6d20101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:14.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.273+0000 7f6d26c00700 1 -- 172.21.15.72:0/4027514847 shutdown_connections 2024-03-19T06:10:14.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.273+0000 7f6d26c00700 1 -- 172.21.15.72:0/4027514847 wait complete. 2024-03-19T06:10:14.265 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 16 2024-03-19T06:10:14.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.425+0000 7f3050e00700 1 -- 172.21.15.72:0/4027398553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f304c101440 msgr2=0x7f304c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:14.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.425+0000 7f3050e00700 1 --2- 172.21.15.72:0/4027398553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f304c101440 0x7f304c101890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3038009910 tx=0x7f3038009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:14.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.426+0000 7f3050e00700 1 -- 172.21.15.72:0/4027398553 shutdown_connections 2024-03-19T06:10:14.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.426+0000 7f3050e00700 1 --2- 172.21.15.72:0/4027398553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f304c101440 0x7f304c101890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.426+0000 7f3050e00700 1 --2- 172.21.15.72:0/4027398553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f304c100240 0x7f304c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.426+0000 7f3050e00700 1 -- 172.21.15.72:0/4027398553 >> 172.21.15.72:0/4027398553 conn(0x7f304c0fb7f0 msgr2=0x7f304c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:14.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.426+0000 7f3050e00700 1 -- 172.21.15.72:0/4027398553 shutdown_connections 2024-03-19T06:10:14.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.426+0000 7f3050e00700 1 -- 172.21.15.72:0/4027398553 wait complete. 2024-03-19T06:10:14.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.427+0000 7f3050e00700 1 Processor -- start 2024-03-19T06:10:14.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.427+0000 7f3050e00700 1 -- start start 2024-03-19T06:10:14.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.427+0000 7f3050e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f304c100240 0x7f304c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:14.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.427+0000 7f3050e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f304c101440 0x7f304c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:14.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.427+0000 7f3050e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c073680 con 0x7f304c100240 2024-03-19T06:10:14.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.427+0000 7f3050e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0737c0 con 0x7f304c101440 2024-03-19T06:10:14.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.427+0000 7f3049e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f304c100240 0x7f304c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:14.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.428+0000 7f3049e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f304c100240 0x7f304c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46378/0 (socket says 172.21.15.72:46378) 2024-03-19T06:10:14.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.428+0000 7f3049e00700 1 -- 172.21.15.72:0/2582420010 learned_addr learned my addr 172.21.15.72:0/2582420010 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:14.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.428+0000 7f3049e00700 1 -- 172.21.15.72:0/2582420010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f304c101440 msgr2=0x7f304c073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:14.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.428+0000 7f3049400700 1 --2- 172.21.15.72:0/2582420010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f304c101440 0x7f304c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:14.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.428+0000 7f3049e00700 1 --2- 172.21.15.72:0/2582420010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f304c101440 0x7f304c073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.428+0000 7f3049e00700 1 -- 172.21.15.72:0/2582420010 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30380095f0 con 0x7f304c100240 2024-03-19T06:10:14.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.428+0000 7f3049e00700 1 --2- 172.21.15.72:0/2582420010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f304c100240 0x7f304c074af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f303c00c8f0 tx=0x7f303c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:14.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.429+0000 7f3042a00700 1 -- 172.21.15.72:0/2582420010 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f303c007a70 con 0x7f304c100240 2024-03-19T06:10:14.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.429+0000 7f3050e00700 1 -- 172.21.15.72:0/2582420010 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c073aa0 con 0x7f304c100240 2024-03-19T06:10:14.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.429+0000 7f3042a00700 1 -- 172.21.15.72:0/2582420010 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f303c007bd0 con 0x7f304c100240 2024-03-19T06:10:14.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.429+0000 7f3042a00700 1 -- 172.21.15.72:0/2582420010 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f303c018630 con 0x7f304c100240 2024-03-19T06:10:14.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.429+0000 7f3050e00700 1 -- 172.21.15.72:0/2582420010 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c19db10 con 0x7f304c100240 2024-03-19T06:10:14.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.430+0000 7f3050e00700 1 -- 172.21.15.72:0/2582420010 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c108d90 con 0x7f304c100240 2024-03-19T06:10:14.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.431+0000 7f3042a00700 1 -- 172.21.15.72:0/2582420010 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f303c00f450 con 0x7f304c100240 2024-03-19T06:10:14.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.432+0000 7f3042a00700 1 --2- 172.21.15.72:0/2582420010 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f303006dfa0 0x7f3030070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:14.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.432+0000 7f3042a00700 1 -- 172.21.15.72:0/2582420010 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f303c08dcb0 con 0x7f304c100240 2024-03-19T06:10:14.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.432+0000 7f3049400700 1 --2- 172.21.15.72:0/2582420010 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f303006dfa0 0x7f3030070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:14.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.433+0000 7f3049400700 1 --2- 172.21.15.72:0/2582420010 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f303006dfa0 0x7f3030070450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3038006010 tx=0x7f303800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:14.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.437+0000 7f3042a00700 1 -- 172.21.15.72:0/2582420010 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f303c05adb0 con 0x7f304c100240 2024-03-19T06:10:14.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.676+0000 7f3050e00700 1 -- 172.21.15.72:0/2582420010 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f304c105d90 con 0x7f303006dfa0 2024-03-19T06:10:14.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.678+0000 7f3042a00700 1 -- 172.21.15.72:0/2582420010 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f304c105d90 con 0x7f303006dfa0 2024-03-19T06:10:14.669 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:10:14.669 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:10:14.669 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:10:14.670 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:10:14.670 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:10:14.670 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:10:14.670 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:10:14.670 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:10:14.670 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:10:14.670 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "8/23 daemons upgraded", 2024-03-19T06:10:14.670 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-03-19T06:10:14.670 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:10:14.670 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:10:14.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.681+0000 7f3050e00700 1 -- 172.21.15.72:0/2582420010 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f303006dfa0 msgr2=0x7f3030070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:14.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.681+0000 7f3050e00700 1 --2- 172.21.15.72:0/2582420010 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f303006dfa0 0x7f3030070450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3038006010 tx=0x7f303800b540 comp rx=0 tx=0).stop 2024-03-19T06:10:14.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.681+0000 7f3050e00700 1 -- 172.21.15.72:0/2582420010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f304c100240 msgr2=0x7f304c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:14.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.681+0000 7f3050e00700 1 --2- 172.21.15.72:0/2582420010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f304c100240 0x7f304c074af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f303c00c8f0 tx=0x7f303c00ccb0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.682+0000 7f3050e00700 1 -- 172.21.15.72:0/2582420010 shutdown_connections 2024-03-19T06:10:14.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.682+0000 7f3050e00700 1 --2- 172.21.15.72:0/2582420010 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f303006dfa0 0x7f3030070450 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.682+0000 7f3050e00700 1 --2- 172.21.15.72:0/2582420010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f304c100240 0x7f304c074af0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.682+0000 7f3050e00700 1 --2- 172.21.15.72:0/2582420010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f304c101440 0x7f304c073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.682+0000 7f3050e00700 1 -- 172.21.15.72:0/2582420010 >> 172.21.15.72:0/2582420010 conn(0x7f304c0fb7f0 msgr2=0x7f304c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:14.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.682+0000 7f3050e00700 1 -- 172.21.15.72:0/2582420010 shutdown_connections 2024-03-19T06:10:14.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.683+0000 7f3050e00700 1 -- 172.21.15.72:0/2582420010 wait complete. 2024-03-19T06:10:14.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.829+0000 7fbc10800700 1 -- 172.21.15.72:0/3085480657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc08101440 msgr2=0x7fbc08101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:14.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.829+0000 7fbc10800700 1 --2- 172.21.15.72:0/3085480657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc08101440 0x7fbc08101890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009910 tx=0x7fbbf4009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:14.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.829+0000 7fbc10800700 1 -- 172.21.15.72:0/3085480657 shutdown_connections 2024-03-19T06:10:14.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.829+0000 7fbc10800700 1 --2- 172.21.15.72:0/3085480657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc08101440 0x7fbc08101890 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.829+0000 7fbc10800700 1 --2- 172.21.15.72:0/3085480657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc08100240 0x7fbc08100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.829+0000 7fbc10800700 1 -- 172.21.15.72:0/3085480657 >> 172.21.15.72:0/3085480657 conn(0x7fbc080fb7f0 msgr2=0x7fbc080fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:14.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.830+0000 7fbc10800700 1 -- 172.21.15.72:0/3085480657 shutdown_connections 2024-03-19T06:10:14.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.830+0000 7fbc10800700 1 -- 172.21.15.72:0/3085480657 wait complete. 2024-03-19T06:10:14.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.831+0000 7fbc10800700 1 Processor -- start 2024-03-19T06:10:14.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.831+0000 7fbc10800700 1 -- start start 2024-03-19T06:10:14.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.831+0000 7fbc10800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc08100240 0x7fbc08074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:14.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.831+0000 7fbc10800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc08101440 0x7fbc08073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:14.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.831+0000 7fbc10800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08073680 con 0x7fbc08101440 2024-03-19T06:10:14.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.831+0000 7fbc10800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc080737c0 con 0x7fbc08100240 2024-03-19T06:10:14.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.832+0000 7fbc0d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc08101440 0x7fbc08073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:14.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.832+0000 7fbc0d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc08101440 0x7fbc08073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46394/0 (socket says 172.21.15.72:46394) 2024-03-19T06:10:14.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.832+0000 7fbc0d400700 1 -- 172.21.15.72:0/4062532131 learned_addr learned my addr 172.21.15.72:0/4062532131 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:14.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.832+0000 7fbc0de00700 1 --2- 172.21.15.72:0/4062532131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc08100240 0x7fbc08074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:14.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.834+0000 7fbc0de00700 1 -- 172.21.15.72:0/4062532131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc08101440 msgr2=0x7fbc08073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:14.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.834+0000 7fbc0de00700 1 --2- 172.21.15.72:0/4062532131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc08101440 0x7fbc08073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:14.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.834+0000 7fbc0de00700 1 -- 172.21.15.72:0/4062532131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40095f0 con 0x7fbc08100240 2024-03-19T06:10:14.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.834+0000 7fbc0de00700 1 --2- 172.21.15.72:0/4062532131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc08100240 0x7fbc08074af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00c8c0 tx=0x7fbbfc00cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:14.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.834+0000 7fbc02a00700 1 -- 172.21.15.72:0/4062532131 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbfc004200 con 0x7fbc08100240 2024-03-19T06:10:14.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.834+0000 7fbc10800700 1 -- 172.21.15.72:0/4062532131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc08073aa0 con 0x7fbc08100240 2024-03-19T06:10:14.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.834+0000 7fbc10800700 1 -- 172.21.15.72:0/4062532131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0819db10 con 0x7fbc08100240 2024-03-19T06:10:14.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.834+0000 7fbc02a00700 1 -- 172.21.15.72:0/4062532131 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbbfc004360 con 0x7fbc08100240 2024-03-19T06:10:14.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.834+0000 7fbc02a00700 1 -- 172.21.15.72:0/4062532131 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbfc003c80 con 0x7fbc08100240 2024-03-19T06:10:14.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.836+0000 7fbc10800700 1 -- 172.21.15.72:0/4062532131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe8005320 con 0x7fbc08100240 2024-03-19T06:10:14.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.838+0000 7fbc02a00700 1 -- 172.21.15.72:0/4062532131 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fbbfc0076d0 con 0x7fbc08100240 2024-03-19T06:10:14.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.839+0000 7fbc02a00700 1 --2- 172.21.15.72:0/4062532131 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbbf006dfa0 0x7fbbf0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:14.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.840+0000 7fbc02a00700 1 -- 172.21.15.72:0/4062532131 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbbfc013070 con 0x7fbc08100240 2024-03-19T06:10:14.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.840+0000 7fbc0d400700 1 --2- 172.21.15.72:0/4062532131 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbbf006dfa0 0x7fbbf0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:14.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.840+0000 7fbc0d400700 1 --2- 172.21.15.72:0/4062532131 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbbf006dfa0 0x7fbbf0070450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4006010 tx=0x7fbbf400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:14.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:14.855+0000 7fbc02a00700 1 -- 172.21.15.72:0/4062532131 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fbbfc05b090 con 0x7fbc08100240 2024-03-19T06:10:15.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:14 smithi072 ceph-mon[78545]: osdmap e58: 6 total, 6 up, 6 in 2024-03-19T06:10:15.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:14 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/4027514847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:10:15.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:14 smithi172 ceph-mon[66682]: osdmap e58: 6 total, 6 up, 6 in 2024-03-19T06:10:15.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:14 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/4027514847' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:10:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.174+0000 7fbc10800700 1 -- 172.21.15.72:0/4062532131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbbe8005190 con 0x7fbc08100240 2024-03-19T06:10:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.176+0000 7fbc02a00700 1 -- 172.21.15.72:0/4062532131 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1261 (secure 0 0 0) 0x7fbbfc05ac20 con 0x7fbc08100240 2024-03-19T06:10:15.166 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 59/396 objects degraded (14.899%), 16 pgs degraded 2024-03-19T06:10:15.166 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:10:15.166 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:10:15.166 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 59/396 objects degraded (14.899%), 16 pgs degraded 2024-03-19T06:10:15.166 INFO:teuthology.orchestra.run.smithi072.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-03-19T06:10:15.166 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-03-19T06:10:15.166 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-03-19T06:10:15.166 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-03-19T06:10:15.167 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-03-19T06:10:15.167 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-03-19T06:10:15.167 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-03-19T06:10:15.167 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-03-19T06:10:15.167 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-03-19T06:10:15.167 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-03-19T06:10:15.167 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-03-19T06:10:15.167 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-03-19T06:10:15.167 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-03-19T06:10:15.167 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-03-19T06:10:15.167 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-03-19T06:10:15.167 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-03-19T06:10:15.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.179+0000 7fbc10800700 1 -- 172.21.15.72:0/4062532131 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbbf006dfa0 msgr2=0x7fbbf0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:15.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.179+0000 7fbc10800700 1 --2- 172.21.15.72:0/4062532131 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbbf006dfa0 0x7fbbf0070450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4006010 tx=0x7fbbf400b540 comp rx=0 tx=0).stop 2024-03-19T06:10:15.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.179+0000 7fbc10800700 1 -- 172.21.15.72:0/4062532131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc08100240 msgr2=0x7fbc08074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:15.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.179+0000 7fbc10800700 1 --2- 172.21.15.72:0/4062532131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc08100240 0x7fbc08074af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00c8c0 tx=0x7fbbfc00cbd0 comp rx=0 tx=0).stop 2024-03-19T06:10:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.179+0000 7fbc10800700 1 -- 172.21.15.72:0/4062532131 shutdown_connections 2024-03-19T06:10:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.179+0000 7fbc10800700 1 --2- 172.21.15.72:0/4062532131 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbbf006dfa0 0x7fbbf0070450 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.179+0000 7fbc10800700 1 --2- 172.21.15.72:0/4062532131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc08100240 0x7fbc08074af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.179+0000 7fbc10800700 1 --2- 172.21.15.72:0/4062532131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc08101440 0x7fbc08073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.179+0000 7fbc10800700 1 -- 172.21.15.72:0/4062532131 >> 172.21.15.72:0/4062532131 conn(0x7fbc080fb7f0 msgr2=0x7fbc08104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.179+0000 7fbc10800700 1 -- 172.21.15.72:0/4062532131 shutdown_connections 2024-03-19T06:10:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:15.179+0000 7fbc10800700 1 -- 172.21.15.72:0/4062532131 wait complete. 2024-03-19T06:10:16.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:15 smithi072 ceph-mon[78545]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:16.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:15 smithi072 ceph-mon[78545]: pgmap v98: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:16.121 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:15 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/4062532131' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:10:16.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:15 smithi172 ceph-mon[66682]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:16.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:15 smithi172 ceph-mon[66682]: pgmap v98: 65 pgs: 16 active+undersized+degraded, 16 active+undersized, 33 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 59/396 objects degraded (14.899%) 2024-03-19T06:10:16.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:15 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/4062532131' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:10:17.168 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:16 smithi172 ceph-mon[66682]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/396 objects degraded (14.899%), 16 pgs degraded) 2024-03-19T06:10:17.206 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:16 smithi072 ceph-mon[78545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/396 objects degraded (14.899%), 16 pgs degraded) 2024-03-19T06:10:18.030 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:17 smithi072 ceph-mon[78545]: pgmap v99: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:18.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:17 smithi172 ceph-mon[66682]: pgmap v99: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:19.477 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:19.477 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:19.477 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:10:19.478 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:10:19.478 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:19.478 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:10:19.478 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:19.478 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:19.478 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:19.478 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-19T06:10:19.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:19.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:19.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:10:19.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:10:19.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:19.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:10:19.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:19.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:19.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:19.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-19T06:10:20.518 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:20 smithi072 ceph-mon[78545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-19T06:10:20.519 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:20 smithi072 ceph-mon[78545]: Upgrade: osd.2 is safe to restart 2024-03-19T06:10:20.519 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:20 smithi072 ceph-mon[78545]: pgmap v100: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:20.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:20 smithi172 ceph-mon[66682]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-19T06:10:20.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:20 smithi172 ceph-mon[66682]: Upgrade: osd.2 is safe to restart 2024-03-19T06:10:20.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:20 smithi172 ceph-mon[66682]: pgmap v100: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:22.183 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:21 smithi072 ceph-mon[78545]: pgmap v101: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:22.183 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:21 smithi072 ceph-mon[78545]: Upgrade: Updating osd.2 2024-03-19T06:10:22.183 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:21 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:22.183 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:21 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-19T06:10:22.183 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:21 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:10:22.183 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:21 smithi072 ceph-mon[78545]: Deploying daemon osd.2 on smithi072 2024-03-19T06:10:22.313 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:21 smithi172 ceph-mon[66682]: pgmap v101: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:22.313 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:21 smithi172 ceph-mon[66682]: Upgrade: Updating osd.2 2024-03-19T06:10:22.313 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:21 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:22.313 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:21 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-19T06:10:22.313 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:21 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:10:22.314 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:21 smithi172 ceph-mon[66682]: Deploying daemon osd.2 on smithi072 2024-03-19T06:10:24.206 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:23 smithi072 ceph-mon[78545]: pgmap v102: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:24.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:23 smithi172 ceph-mon[66682]: pgmap v102: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:26.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:25 smithi072 ceph-mon[78545]: pgmap v103: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:26.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:26.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:10:26.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:26.076 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:25 smithi072 systemd[1]: Stopping Ceph osd.2 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:10:26.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:25 smithi172 ceph-mon[66682]: pgmap v103: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:26.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:26.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:10:26.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:26.575 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:26 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2[54561]: 2024-03-19T06:10:26.190+0000 7fd266600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:10:26.576 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:26 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2[54561]: 2024-03-19T06:10:26.190+0000 7fd266600700 -1 osd.2 58 *** Got signal Terminated *** 2024-03-19T06:10:26.576 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:26 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2[54561]: 2024-03-19T06:10:26.190+0000 7fd266600700 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-19T06:10:27.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:26 smithi172 ceph-mon[66682]: osd.2 marked itself down and dead 2024-03-19T06:10:27.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:26 smithi072 ceph-mon[78545]: osd.2 marked itself down and dead 2024-03-19T06:10:27.792 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:27 smithi072 podman[91532]: 2024-03-19 06:10:27.485922344 +0000 UTC m=+1.462867613 container died 34339cf9a90b2c979d31e3d0e147d4bc226f9d4dc428631e720948eaabc2aa00 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, org.label-schema.build-date=20231212, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0) 2024-03-19T06:10:28.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:27 smithi072 ceph-mon[78545]: pgmap v104: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:28.077 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:27 smithi072 ceph-mon[78545]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-19T06:10:28.077 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:27 smithi072 ceph-mon[78545]: osdmap e59: 6 total, 5 up, 6 in 2024-03-19T06:10:28.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:28 smithi072 podman[91532]: 2024-03-19 06:10:28.020447678 +0000 UTC m=+1.997392987 container cleanup 34339cf9a90b2c979d31e3d0e147d4bc226f9d4dc428631e720948eaabc2aa00 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=HEAD, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-19T06:10:28.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:28 smithi072 bash[91532]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2 2024-03-19T06:10:28.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:27 smithi172 ceph-mon[66682]: pgmap v104: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:28.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:27 smithi172 ceph-mon[66682]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-19T06:10:28.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:27 smithi172 ceph-mon[66682]: osdmap e59: 6 total, 5 up, 6 in 2024-03-19T06:10:28.575 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:28 smithi072 podman[91551]: 2024-03-19 06:10:28.23192037 +0000 UTC m=+0.735971001 container remove 34339cf9a90b2c979d31e3d0e147d4bc226f9d4dc428631e720948eaabc2aa00 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2, org.label-schema.build-date=20231212, GIT_CLEAN=True, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-03-19T06:10:29.006 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:28 smithi072 ceph-mon[78545]: osdmap e60: 6 total, 5 up, 6 in 2024-03-19T06:10:29.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:28 smithi172 ceph-mon[66682]: osdmap e60: 6 total, 5 up, 6 in 2024-03-19T06:10:29.326 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:29 smithi072 podman[91636]: 2024-03-19 06:10:28.924864063 +0000 UTC m=+0.037429130 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:10:29.326 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:29 smithi072 podman[91636]: 2024-03-19 06:10:29.033789744 +0000 UTC m=+0.146354842 container create 62f89468d609aba1aef839c428bc0c0de0e2115003db8c9020957ccf40250fa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-19T06:10:29.780 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:29 smithi072 podman[91636]: 2024-03-19 06:10:29.349399067 +0000 UTC m=+0.461964172 container init 62f89468d609aba1aef839c428bc0c0de0e2115003db8c9020957ccf40250fa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS) 2024-03-19T06:10:29.780 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:29 smithi072 podman[91636]: 2024-03-19 06:10:29.360423312 +0000 UTC m=+0.472988416 container start 62f89468d609aba1aef839c428bc0c0de0e2115003db8c9020957ccf40250fa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-19T06:10:29.780 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:29 smithi072 podman[91636]: 2024-03-19 06:10:29.457013598 +0000 UTC m=+0.569578679 container attach 62f89468d609aba1aef839c428bc0c0de0e2115003db8c9020957ccf40250fa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240222, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_BRANCH=HEAD, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:10:30.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:29 smithi072 ceph-mon[78545]: pgmap v107: 65 pgs: 9 stale+active+clean, 56 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:30.075 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:29 smithi072 podman[91636]: 2024-03-19 06:10:29.791763065 +0000 UTC m=+0.904328193 container died 62f89468d609aba1aef839c428bc0c0de0e2115003db8c9020957ccf40250fa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b) 2024-03-19T06:10:30.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:29 smithi172 ceph-mon[66682]: pgmap v107: 65 pgs: 9 stale+active+clean, 56 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:30.826 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:30 smithi072 podman[91661]: 2024-03-19 06:10:30.515520517 +0000 UTC m=+0.706137412 container remove 62f89468d609aba1aef839c428bc0c0de0e2115003db8c9020957ccf40250fa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5) 2024-03-19T06:10:30.826 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:30 smithi072 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.2.service: Deactivated successfully. 2024-03-19T06:10:30.826 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:30 smithi072 systemd[1]: Stopped Ceph osd.2 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:10:30.826 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:30 smithi072 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.2.service: Consumed 1min 24.784s CPU time. 2024-03-19T06:10:31.252 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:30 smithi072 ceph-mon[78545]: Health check failed: Degraded data redundancy: 17/396 objects degraded (4.293%), 4 pgs degraded (PG_DEGRADED) 2024-03-19T06:10:31.252 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:30 smithi072 systemd[1]: Starting Ceph osd.2 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:10:31.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:30 smithi172 ceph-mon[66682]: Health check failed: Degraded data redundancy: 17/396 objects degraded (4.293%), 4 pgs degraded (PG_DEGRADED) 2024-03-19T06:10:31.575 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:31 smithi072 podman[91762]: 2024-03-19 06:10:31.167241816 +0000 UTC m=+0.033939948 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:10:31.575 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:31 smithi072 podman[91762]: 2024-03-19 06:10:31.300998951 +0000 UTC m=+0.167697124 container create 2c4435370eec5cfef8d5472e15d504b60423f16075c42e543cbe71606f6c9657 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-03-19T06:10:32.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:31 smithi072 ceph-mon[78545]: pgmap v108: 65 pgs: 4 active+undersized+degraded, 6 stale+active+clean, 4 active+undersized, 51 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17/396 objects degraded (4.293%) 2024-03-19T06:10:32.075 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:31 smithi072 podman[91762]: 2024-03-19 06:10:31.917091908 +0000 UTC m=+0.783790088 container init 2c4435370eec5cfef8d5472e15d504b60423f16075c42e543cbe71606f6c9657 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271) 2024-03-19T06:10:32.075 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:31 smithi072 podman[91762]: 2024-03-19 06:10:31.92955407 +0000 UTC m=+0.796252264 container start 2c4435370eec5cfef8d5472e15d504b60423f16075c42e543cbe71606f6c9657 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-03-19T06:10:32.076 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 podman[91762]: 2024-03-19 06:10:32.033007182 +0000 UTC m=+0.899705408 container attach 2c4435370eec5cfef8d5472e15d504b60423f16075c42e543cbe71606f6c9657 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-03-19T06:10:32.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:31 smithi172 ceph-mon[66682]: pgmap v108: 65 pgs: 4 active+undersized+degraded, 6 stale+active+clean, 4 active+undersized, 51 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17/396 objects degraded (4.293%) 2024-03-19T06:10:33.077 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate[91776]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-19T06:10:33.077 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate[91776]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-19T06:10:33.077 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 bash[91762]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-19T06:10:33.077 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 bash[91762]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-19T06:10:33.077 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 bash[91762]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-19T06:10:33.077 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 bash[91762]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-19T06:10:33.077 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 bash[91762]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-03-19T06:10:33.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 bash[91762]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-19T06:10:33.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 bash[91762]: --> ceph-volume raw activate successful for osd ID: 2 2024-03-19T06:10:33.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate[91776]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-19T06:10:33.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate[91776]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-19T06:10:33.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate[91776]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-03-19T06:10:33.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate[91776]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-19T06:10:33.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate[91776]: --> ceph-volume raw activate successful for osd ID: 2 2024-03-19T06:10:33.078 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:32 smithi072 podman[91762]: 2024-03-19 06:10:32.839141324 +0000 UTC m=+1.705839541 container died 2c4435370eec5cfef8d5472e15d504b60423f16075c42e543cbe71606f6c9657 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.build-date=20240222, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:10:33.938 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:33 smithi072 podman[91903]: 2024-03-19 06:10:33.650161769 +0000 UTC m=+0.791318221 container remove 2c4435370eec5cfef8d5472e15d504b60423f16075c42e543cbe71606f6c9657 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-activate, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:10:34.227 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:33 smithi072 ceph-mon[78545]: pgmap v109: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/396 objects degraded (12.374%) 2024-03-19T06:10:34.227 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:33 smithi072 ceph-mon[78545]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:10:34.227 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:34 smithi072 podman[91964]: 2024-03-19 06:10:33.909793322 +0000 UTC m=+0.032833736 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:10:34.227 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:34 smithi072 podman[91964]: 2024-03-19 06:10:34.043851074 +0000 UTC m=+0.166891513 container create 7d013647ed4a0a6709e8124fcbc663f19e33967970ff0c779828ab3f90a8cc3c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2, org.label-schema.vendor=CentOS, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:10:34.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:33 smithi172 ceph-mon[66682]: pgmap v109: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/396 objects degraded (12.374%) 2024-03-19T06:10:34.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:33 smithi172 ceph-mon[66682]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:10:34.825 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:34 smithi072 podman[91964]: 2024-03-19 06:10:34.340885275 +0000 UTC m=+0.463925750 container init 7d013647ed4a0a6709e8124fcbc663f19e33967970ff0c779828ab3f90a8cc3c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:10:34.825 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:34 smithi072 podman[91964]: 2024-03-19 06:10:34.352043679 +0000 UTC m=+0.475084148 container start 7d013647ed4a0a6709e8124fcbc663f19e33967970ff0c779828ab3f90a8cc3c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:10:34.825 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:34 smithi072 ceph-osd[91983]: -- 172.21.15.72:0/2193245165 <== mon.0 v2:172.21.15.72:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56233ffdb680 con 0x56233ffa4c00 2024-03-19T06:10:34.825 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:34 smithi072 bash[91964]: 7d013647ed4a0a6709e8124fcbc663f19e33967970ff0c779828ab3f90a8cc3c 2024-03-19T06:10:34.825 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:34 smithi072 systemd[1]: Started Ceph osd.2 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:10:35.263 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:34 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2[91979]: 2024-03-19T06:10:34.927+0000 7f6d4cfc37c0 -1 Falling back to public interface 2024-03-19T06:10:35.874 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:35 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:35.874 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:35 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:35.874 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:35 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:10:35.874 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:35 smithi072 ceph-mon[78545]: pgmap v110: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/396 objects degraded (12.374%) 2024-03-19T06:10:35.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:35 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:35.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:35 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:35.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:35 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:10:35.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:35 smithi172 ceph-mon[66682]: pgmap v110: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/396 objects degraded (12.374%) 2024-03-19T06:10:38.055 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:37 smithi072 ceph-mon[78545]: pgmap v111: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/396 objects degraded (12.374%) 2024-03-19T06:10:38.055 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:37 smithi072 ceph-mon[78545]: Health check update: Degraded data redundancy: 49/396 objects degraded (12.374%), 13 pgs degraded (PG_DEGRADED) 2024-03-19T06:10:38.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:37 smithi172 ceph-mon[66682]: pgmap v111: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/396 objects degraded (12.374%) 2024-03-19T06:10:38.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:37 smithi172 ceph-mon[66682]: Health check update: Degraded data redundancy: 49/396 objects degraded (12.374%), 13 pgs degraded (PG_DEGRADED) 2024-03-19T06:10:39.799 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:39 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2[91979]: 2024-03-19T06:10:39.468+0000 7f6d4cfc37c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-03-19T06:10:40.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:39 smithi072 ceph-mon[78545]: pgmap v112: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/396 objects degraded (12.374%) 2024-03-19T06:10:40.075 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:39 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2[91979]: 2024-03-19T06:10:39.823+0000 7f6d4cfc37c0 -1 osd.2 58 log_to_monitors true 2024-03-19T06:10:40.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:39 smithi172 ceph-mon[66682]: pgmap v112: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/396 objects degraded (12.374%) 2024-03-19T06:10:40.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:40.913 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:10:40.914 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:40 smithi072 ceph-mon[78545]: from='osd.2 [v2:172.21.15.72:6818/517254227,v1:172.21.15.72:6819/517254227]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-19T06:10:41.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:41.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:10:41.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:40 smithi172 ceph-mon[66682]: from='osd.2 [v2:172.21.15.72:6818/517254227,v1:172.21.15.72:6819/517254227]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-19T06:10:42.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:41 smithi172 ceph-mon[66682]: pgmap v113: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/396 objects degraded (12.374%) 2024-03-19T06:10:42.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:41 smithi172 ceph-mon[66682]: from='osd.2 [v2:172.21.15.72:6818/517254227,v1:172.21.15.72:6819/517254227]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-19T06:10:42.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:41 smithi172 ceph-mon[66682]: osdmap e61: 6 total, 5 up, 6 in 2024-03-19T06:10:42.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:41 smithi172 ceph-mon[66682]: from='osd.2 [v2:172.21.15.72:6818/517254227,v1:172.21.15.72:6819/517254227]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-19T06:10:42.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:42.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:42.305 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:10:41 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2[91979]: 2024-03-19T06:10:41.901+0000 7f6d37400700 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:10:42.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:41 smithi072 ceph-mon[78545]: pgmap v113: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/396 objects degraded (12.374%) 2024-03-19T06:10:42.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:41 smithi072 ceph-mon[78545]: from='osd.2 [v2:172.21.15.72:6818/517254227,v1:172.21.15.72:6819/517254227]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-19T06:10:42.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:41 smithi072 ceph-mon[78545]: osdmap e61: 6 total, 5 up, 6 in 2024-03-19T06:10:42.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:41 smithi072 ceph-mon[78545]: from='osd.2 [v2:172.21.15.72:6818/517254227,v1:172.21.15.72:6819/517254227]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi072", "root=default"]}]: dispatch 2024-03-19T06:10:42.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:42.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:43.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:42 smithi172 ceph-mon[66682]: from='osd.2 [v2:172.21.15.72:6818/517254227,v1:172.21.15.72:6819/517254227]' entity='osd.2' 2024-03-19T06:10:43.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:42 smithi072 ceph-mon[78545]: from='osd.2 [v2:172.21.15.72:6818/517254227,v1:172.21.15.72:6819/517254227]' entity='osd.2' 2024-03-19T06:10:44.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:43 smithi072 ceph-mon[78545]: pgmap v115: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/396 objects degraded (12.374%) 2024-03-19T06:10:44.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:43 smithi072 ceph-mon[78545]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-19T06:10:44.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:43 smithi072 ceph-mon[78545]: osd.2 [v2:172.21.15.72:6818/517254227,v1:172.21.15.72:6819/517254227] boot 2024-03-19T06:10:44.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:43 smithi072 ceph-mon[78545]: osdmap e62: 6 total, 6 up, 6 in 2024-03-19T06:10:44.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T06:10:44.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:44.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:44.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:43 smithi072 ceph-mon[78545]: osdmap e63: 6 total, 6 up, 6 in 2024-03-19T06:10:44.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:43 smithi172 ceph-mon[66682]: pgmap v115: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/396 objects degraded (12.374%) 2024-03-19T06:10:44.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:43 smithi172 ceph-mon[66682]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-19T06:10:44.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:43 smithi172 ceph-mon[66682]: osd.2 [v2:172.21.15.72:6818/517254227,v1:172.21.15.72:6819/517254227] boot 2024-03-19T06:10:44.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:43 smithi172 ceph-mon[66682]: osdmap e62: 6 total, 6 up, 6 in 2024-03-19T06:10:44.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-19T06:10:44.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:44.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:44.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:43 smithi172 ceph-mon[66682]: osdmap e63: 6 total, 6 up, 6 in 2024-03-19T06:10:45.227 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:44 smithi072 ceph-mon[78545]: Health check update: Degraded data redundancy: 39/396 objects degraded (9.848%), 11 pgs degraded (PG_DEGRADED) 2024-03-19T06:10:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.346+0000 7f98c9c00700 1 -- 172.21.15.72:0/4216563192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c40737b0 msgr2=0x7f98c4073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.346+0000 7f98c9c00700 1 --2- 172.21.15.72:0/4216563192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c40737b0 0x7f98c4073c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009910 tx=0x7f98ac009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.346+0000 7f98c9c00700 1 -- 172.21.15.72:0/4216563192 shutdown_connections 2024-03-19T06:10:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.346+0000 7f98c9c00700 1 --2- 172.21.15.72:0/4216563192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c40737b0 0x7f98c4073c20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.346+0000 7f98c9c00700 1 --2- 172.21.15.72:0/4216563192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c4074d80 0x7f98c40731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.346+0000 7f98c9c00700 1 -- 172.21.15.72:0/4216563192 >> 172.21.15.72:0/4216563192 conn(0x7f98c40fb7f0 msgr2=0x7f98c40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.346+0000 7f98c9c00700 1 -- 172.21.15.72:0/4216563192 shutdown_connections 2024-03-19T06:10:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.346+0000 7f98c9c00700 1 -- 172.21.15.72:0/4216563192 wait complete. 2024-03-19T06:10:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.347+0000 7f98c9c00700 1 Processor -- start 2024-03-19T06:10:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.348+0000 7f98c9c00700 1 -- start start 2024-03-19T06:10:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.348+0000 7f98c9c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c40737b0 0x7f98c419c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.348+0000 7f98c9c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c4074d80 0x7f98c419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.348+0000 7f98c9c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c419cbd0 con 0x7f98c4074d80 2024-03-19T06:10:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.348+0000 7f98c9c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c419cd10 con 0x7f98c40737b0 2024-03-19T06:10:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.348+0000 7f98bbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c4074d80 0x7f98c419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.348+0000 7f98bbe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c4074d80 0x7f98c419c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43940/0 (socket says 172.21.15.72:43940) 2024-03-19T06:10:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.348+0000 7f98bbe00700 1 -- 172.21.15.72:0/2008367960 learned_addr learned my addr 172.21.15.72:0/2008367960 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.349+0000 7f98c2a00700 1 --2- 172.21.15.72:0/2008367960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c40737b0 0x7f98c419c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:45.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.349+0000 7f98bbe00700 1 -- 172.21.15.72:0/2008367960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c40737b0 msgr2=0x7f98c419c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:45.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.349+0000 7f98bbe00700 1 --2- 172.21.15.72:0/2008367960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c40737b0 0x7f98c419c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:45.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.349+0000 7f98bbe00700 1 -- 172.21.15.72:0/2008367960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0095f0 con 0x7f98c4074d80 2024-03-19T06:10:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.349+0000 7f98bbe00700 1 --2- 172.21.15.72:0/2008367960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c4074d80 0x7f98c419c5b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00b5c0 tx=0x7f98ac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.349+0000 7f98bb400700 1 -- 172.21.15.72:0/2008367960 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98ac01d070 con 0x7f98c4074d80 2024-03-19T06:10:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.349+0000 7f98bb400700 1 -- 172.21.15.72:0/2008367960 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f98ac00f460 con 0x7f98c4074d80 2024-03-19T06:10:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.349+0000 7f98c9c00700 1 -- 172.21.15.72:0/2008367960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c41a1760 con 0x7f98c4074d80 2024-03-19T06:10:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.349+0000 7f98bb400700 1 -- 172.21.15.72:0/2008367960 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98ac021640 con 0x7f98c4074d80 2024-03-19T06:10:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.350+0000 7f98c9c00700 1 -- 172.21.15.72:0/2008367960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c41a1c50 con 0x7f98c4074d80 2024-03-19T06:10:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.351+0000 7f98c9c00700 1 -- 172.21.15.72:0/2008367960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c410f380 con 0x7f98c4074d80 2024-03-19T06:10:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.352+0000 7f98bb400700 1 -- 172.21.15.72:0/2008367960 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f98ac00f5d0 con 0x7f98c4074d80 2024-03-19T06:10:45.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.353+0000 7f98bb400700 1 --2- 172.21.15.72:0/2008367960 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f98a806dfa0 0x7f98a8070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:45.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.353+0000 7f98bb400700 1 -- 172.21.15.72:0/2008367960 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f98ac08f500 con 0x7f98c4074d80 2024-03-19T06:10:45.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.353+0000 7f98c2a00700 1 --2- 172.21.15.72:0/2008367960 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f98a806dfa0 0x7f98a8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:45.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.354+0000 7f98c2a00700 1 --2- 172.21.15.72:0/2008367960 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f98a806dfa0 0x7f98a8070450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f98b4005950 tx=0x7f98b40058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:45.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.357+0000 7f98bb400700 1 -- 172.21.15.72:0/2008367960 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f98ac05c530 con 0x7f98c4074d80 2024-03-19T06:10:45.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:44 smithi172 ceph-mon[66682]: Health check update: Degraded data redundancy: 39/396 objects degraded (9.848%), 11 pgs degraded (PG_DEGRADED) 2024-03-19T06:10:45.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.604+0000 7f98c9c00700 1 -- 172.21.15.72:0/2008367960 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98c41a2350 con 0x7f98a806dfa0 2024-03-19T06:10:45.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.607+0000 7f98bb400700 1 -- 172.21.15.72:0/2008367960 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f98c41a2350 con 0x7f98a806dfa0 2024-03-19T06:10:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.609+0000 7f98c9c00700 1 -- 172.21.15.72:0/2008367960 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f98a806dfa0 msgr2=0x7f98a8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.609+0000 7f98c9c00700 1 --2- 172.21.15.72:0/2008367960 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f98a806dfa0 0x7f98a8070450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f98b4005950 tx=0x7f98b40058e0 comp rx=0 tx=0).stop 2024-03-19T06:10:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.609+0000 7f98c9c00700 1 -- 172.21.15.72:0/2008367960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c4074d80 msgr2=0x7f98c419c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.609+0000 7f98c9c00700 1 --2- 172.21.15.72:0/2008367960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c4074d80 0x7f98c419c5b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00b5c0 tx=0x7f98ac00be20 comp rx=0 tx=0).stop 2024-03-19T06:10:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.609+0000 7f98c9c00700 1 -- 172.21.15.72:0/2008367960 shutdown_connections 2024-03-19T06:10:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.609+0000 7f98c9c00700 1 --2- 172.21.15.72:0/2008367960 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f98a806dfa0 0x7f98a8070450 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.609+0000 7f98c9c00700 1 --2- 172.21.15.72:0/2008367960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c40737b0 0x7f98c419c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.609+0000 7f98c9c00700 1 --2- 172.21.15.72:0/2008367960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c4074d80 0x7f98c419c5b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.609+0000 7f98c9c00700 1 -- 172.21.15.72:0/2008367960 >> 172.21.15.72:0/2008367960 conn(0x7f98c40fb7f0 msgr2=0x7f98c4101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.610+0000 7f98c9c00700 1 -- 172.21.15.72:0/2008367960 shutdown_connections 2024-03-19T06:10:45.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.610+0000 7f98c9c00700 1 -- 172.21.15.72:0/2008367960 wait complete. 2024-03-19T06:10:45.616 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:10:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.771+0000 7f5a81400700 1 -- 172.21.15.72:0/4178035885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7c103600 msgr2=0x7f5a7c1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.771+0000 7f5a81400700 1 --2- 172.21.15.72:0/4178035885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7c103600 0x7f5a7c1059e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009910 tx=0x7f5a68009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.771+0000 7f5a81400700 1 -- 172.21.15.72:0/4178035885 shutdown_connections 2024-03-19T06:10:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.771+0000 7f5a81400700 1 --2- 172.21.15.72:0/4178035885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7c103600 0x7f5a7c1059e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.771+0000 7f5a81400700 1 --2- 172.21.15.72:0/4178035885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a7c100ce0 0x7f5a7c1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.771+0000 7f5a81400700 1 -- 172.21.15.72:0/4178035885 >> 172.21.15.72:0/4178035885 conn(0x7f5a7c0fa700 msgr2=0x7f5a7c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.771+0000 7f5a81400700 1 -- 172.21.15.72:0/4178035885 shutdown_connections 2024-03-19T06:10:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.771+0000 7f5a81400700 1 -- 172.21.15.72:0/4178035885 wait complete. 2024-03-19T06:10:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.772+0000 7f5a81400700 1 Processor -- start 2024-03-19T06:10:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.772+0000 7f5a81400700 1 -- start start 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.772+0000 7f5a81400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a7c100ce0 0x7f5a7c195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.772+0000 7f5a81400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7c103600 0x7f5a7c196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.772+0000 7f5a81400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c196620 con 0x7f5a7c103600 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.772+0000 7f5a81400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c196760 con 0x7f5a7c100ce0 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.773+0000 7f5a79e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7c103600 0x7f5a7c196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.773+0000 7f5a79e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7c103600 0x7f5a7c196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43962/0 (socket says 172.21.15.72:43962) 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.773+0000 7f5a79e00700 1 -- 172.21.15.72:0/3287769297 learned_addr learned my addr 172.21.15.72:0/3287769297 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.773+0000 7f5a79e00700 1 -- 172.21.15.72:0/3287769297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a7c100ce0 msgr2=0x7f5a7c195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.773+0000 7f5a7a800700 1 --2- 172.21.15.72:0/3287769297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a7c100ce0 0x7f5a7c195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.773+0000 7f5a79e00700 1 --2- 172.21.15.72:0/3287769297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a7c100ce0 0x7f5a7c195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.773+0000 7f5a79e00700 1 -- 172.21.15.72:0/3287769297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680095f0 con 0x7f5a7c103600 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.773+0000 7f5a7a800700 1 --2- 172.21.15.72:0/3287769297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a7c100ce0 0x7f5a7c195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:10:45.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.773+0000 7f5a79e00700 1 --2- 172.21.15.72:0/3287769297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7c103600 0x7f5a7c196000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a68006010 tx=0x7f5a6800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:45.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.774+0000 7f5a73400700 1 -- 172.21.15.72:0/3287769297 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a6801d070 con 0x7f5a7c103600 2024-03-19T06:10:45.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.774+0000 7f5a73400700 1 -- 172.21.15.72:0/3287769297 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a6800f460 con 0x7f5a7c103600 2024-03-19T06:10:45.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.774+0000 7f5a81400700 1 -- 172.21.15.72:0/3287769297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7c19b160 con 0x7f5a7c103600 2024-03-19T06:10:45.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.774+0000 7f5a73400700 1 -- 172.21.15.72:0/3287769297 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a68021640 con 0x7f5a7c103600 2024-03-19T06:10:45.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.774+0000 7f5a81400700 1 -- 172.21.15.72:0/3287769297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7c19b650 con 0x7f5a7c103600 2024-03-19T06:10:45.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.775+0000 7f5a81400700 1 -- 172.21.15.72:0/3287769297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7c18fc70 con 0x7f5a7c103600 2024-03-19T06:10:45.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.776+0000 7f5a73400700 1 -- 172.21.15.72:0/3287769297 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f5a6800fab0 con 0x7f5a7c103600 2024-03-19T06:10:45.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.777+0000 7f5a73400700 1 --2- 172.21.15.72:0/3287769297 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5a6006dfa0 0x7f5a60070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:45.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.777+0000 7f5a73400700 1 -- 172.21.15.72:0/3287769297 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5a6808f160 con 0x7f5a7c103600 2024-03-19T06:10:45.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.777+0000 7f5a7a800700 1 --2- 172.21.15.72:0/3287769297 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5a6006dfa0 0x7f5a60070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:45.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.778+0000 7f5a7a800700 1 --2- 172.21.15.72:0/3287769297 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5a6006dfa0 0x7f5a60070450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c005fd0 tx=0x7f5a6c005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:45.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:45.782+0000 7f5a73400700 1 -- 172.21.15.72:0/3287769297 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f5a6805c190 con 0x7f5a7c103600 2024-03-19T06:10:46.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.032+0000 7f5a81400700 1 -- 172.21.15.72:0/3287769297 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a7c061190 con 0x7f5a6006dfa0 2024-03-19T06:10:46.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.034+0000 7f5a73400700 1 -- 172.21.15.72:0/3287769297 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5a7c061190 con 0x7f5a6006dfa0 2024-03-19T06:10:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.036+0000 7f5a81400700 1 -- 172.21.15.72:0/3287769297 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5a6006dfa0 msgr2=0x7f5a60070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.036+0000 7f5a81400700 1 --2- 172.21.15.72:0/3287769297 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5a6006dfa0 0x7f5a60070450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c005fd0 tx=0x7f5a6c005dc0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.036+0000 7f5a81400700 1 -- 172.21.15.72:0/3287769297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7c103600 msgr2=0x7f5a7c196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.036+0000 7f5a81400700 1 --2- 172.21.15.72:0/3287769297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7c103600 0x7f5a7c196000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a68006010 tx=0x7f5a6800be20 comp rx=0 tx=0).stop 2024-03-19T06:10:46.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.037+0000 7f5a81400700 1 -- 172.21.15.72:0/3287769297 shutdown_connections 2024-03-19T06:10:46.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.037+0000 7f5a81400700 1 --2- 172.21.15.72:0/3287769297 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5a6006dfa0 0x7f5a60070450 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.037+0000 7f5a81400700 1 --2- 172.21.15.72:0/3287769297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a7c100ce0 0x7f5a7c195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.037+0000 7f5a81400700 1 --2- 172.21.15.72:0/3287769297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a7c103600 0x7f5a7c196000 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.037+0000 7f5a81400700 1 -- 172.21.15.72:0/3287769297 >> 172.21.15.72:0/3287769297 conn(0x7f5a7c0fa700 msgr2=0x7f5a7c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:46.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.037+0000 7f5a81400700 1 -- 172.21.15.72:0/3287769297 shutdown_connections 2024-03-19T06:10:46.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.037+0000 7f5a81400700 1 -- 172.21.15.72:0/3287769297 wait complete. 2024-03-19T06:10:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.195+0000 7f08efe00700 1 -- 172.21.15.72:0/2024980198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e80fee50 msgr2=0x7f08e80ff310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.195+0000 7f08efe00700 1 --2- 172.21.15.72:0/2024980198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e80fee50 0x7f08e80ff310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f08d4009910 tx=0x7f08d4009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.195+0000 7f08efe00700 1 -- 172.21.15.72:0/2024980198 shutdown_connections 2024-03-19T06:10:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.195+0000 7f08efe00700 1 --2- 172.21.15.72:0/2024980198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e80fee50 0x7f08e80ff310 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.195+0000 7f08efe00700 1 --2- 172.21.15.72:0/2024980198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e80fe500 0x7f08e80fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.195+0000 7f08efe00700 1 -- 172.21.15.72:0/2024980198 >> 172.21.15.72:0/2024980198 conn(0x7f08e80f9f10 msgr2=0x7f08e80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.195+0000 7f08efe00700 1 -- 172.21.15.72:0/2024980198 shutdown_connections 2024-03-19T06:10:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.195+0000 7f08efe00700 1 -- 172.21.15.72:0/2024980198 wait complete. 2024-03-19T06:10:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.196+0000 7f08efe00700 1 Processor -- start 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.196+0000 7f08efe00700 1 -- start start 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.197+0000 7f08efe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e80fe500 0x7f08e819c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.197+0000 7f08efe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e80fee50 0x7f08e819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.197+0000 7f08efe00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e819cc60 con 0x7f08e80fee50 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.197+0000 7f08efe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e819cda0 con 0x7f08e80fe500 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.197+0000 7f08eca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e80fee50 0x7f08e819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.197+0000 7f08eca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e80fee50 0x7f08e819c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43972/0 (socket says 172.21.15.72:43972) 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.197+0000 7f08eca00700 1 -- 172.21.15.72:0/2801404712 learned_addr learned my addr 172.21.15.72:0/2801404712 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.197+0000 7f08ed400700 1 --2- 172.21.15.72:0/2801404712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e80fe500 0x7f08e819c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.197+0000 7f08eca00700 1 -- 172.21.15.72:0/2801404712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e80fe500 msgr2=0x7f08e819c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.197+0000 7f08eca00700 1 --2- 172.21.15.72:0/2801404712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e80fe500 0x7f08e819c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.197+0000 7f08eca00700 1 -- 172.21.15.72:0/2801404712 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d40095f0 con 0x7f08e80fee50 2024-03-19T06:10:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.197+0000 7f08ed400700 1 --2- 172.21.15.72:0/2801404712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e80fe500 0x7f08e819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:10:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.198+0000 7f08eca00700 1 --2- 172.21.15.72:0/2801404712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e80fee50 0x7f08e819c640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f08d400bd70 tx=0x7f08d400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.198+0000 7f08e6000700 1 -- 172.21.15.72:0/2801404712 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d401d070 con 0x7f08e80fee50 2024-03-19T06:10:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.198+0000 7f08efe00700 1 -- 172.21.15.72:0/2801404712 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e81a17f0 con 0x7f08e80fee50 2024-03-19T06:10:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.198+0000 7f08e6000700 1 -- 172.21.15.72:0/2801404712 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f08d400f460 con 0x7f08e80fee50 2024-03-19T06:10:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.198+0000 7f08e6000700 1 -- 172.21.15.72:0/2801404712 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08d4021640 con 0x7f08e80fee50 2024-03-19T06:10:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.198+0000 7f08efe00700 1 -- 172.21.15.72:0/2801404712 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e81a1ce0 con 0x7f08e80fee50 2024-03-19T06:10:46.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.199+0000 7f08efe00700 1 -- 172.21.15.72:0/2801404712 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e810f300 con 0x7f08e80fee50 2024-03-19T06:10:46.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.201+0000 7f08e6000700 1 -- 172.21.15.72:0/2801404712 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f08d400fa40 con 0x7f08e80fee50 2024-03-19T06:10:46.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.201+0000 7f08e6000700 1 --2- 172.21.15.72:0/2801404712 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f08d006dfa0 0x7f08d0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:46.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.202+0000 7f08e6000700 1 -- 172.21.15.72:0/2801404712 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f08d408eff0 con 0x7f08e80fee50 2024-03-19T06:10:46.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.202+0000 7f08ed400700 1 --2- 172.21.15.72:0/2801404712 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f08d006dfa0 0x7f08d0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:46.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.202+0000 7f08ed400700 1 --2- 172.21.15.72:0/2801404712 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f08d006dfa0 0x7f08d0070450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f08dc005fd0 tx=0x7f08dc005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:46.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.206+0000 7f08e6000700 1 -- 172.21.15.72:0/2801404712 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f08d405bfe0 con 0x7f08e80fee50 2024-03-19T06:10:46.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:45 smithi072 ceph-mon[78545]: pgmap v118: 65 pgs: 11 active+undersized+degraded, 11 active+undersized, 43 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39/396 objects degraded (9.848%) 2024-03-19T06:10:46.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:45 smithi172 ceph-mon[66682]: pgmap v118: 65 pgs: 11 active+undersized+degraded, 11 active+undersized, 43 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39/396 objects degraded (9.848%) 2024-03-19T06:10:46.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.448+0000 7f08efe00700 1 -- 172.21.15.72:0/2801404712 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f08e81a23e0 con 0x7f08d006dfa0 2024-03-19T06:10:46.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.461+0000 7f08e6000700 1 -- 172.21.15.72:0/2801404712 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f08e81a23e0 con 0x7f08d006dfa0 2024-03-19T06:10:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:10:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (15m) 4s ago 17m 14.0M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:10:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (17m) 4s ago 17m 8678k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:10:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (16m) 97s ago 16m 8010k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:10:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (110s) 4s ago 17m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:10:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (102s) 97s ago 15m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:10:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (14m) 4s ago 16m 71.5M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:10:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (9m) 4s ago 9m 16.5M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:10:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (9m) 4s ago 9m 126M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:10:46.452 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (9m) 97s ago 9m 15.9M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (9m) 97s ago 9m 142M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (5m) 4s ago 19m 504M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (4m) 97s ago 15m 450M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (3m) 4s ago 19m 50.4M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (2m) 97s ago 15m 35.7M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (17m) 4s ago 17m 8196k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (15m) 97s ago 15m 8430k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (73s) 4s ago 14m 87.0M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (42s) 4s ago 14m 87.1M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (12s) 4s ago 13m 11.2M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (12m) 97s ago 12m 237M 2241M 18.2.0 dc2bc1663786 651eb6ad682c 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (12m) 97s ago 12m 230M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (11m) 97s ago 11m 189M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:10:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (4m) 4s ago 16m 67.0M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:10:46.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.464+0000 7f08efe00700 1 -- 172.21.15.72:0/2801404712 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f08d006dfa0 msgr2=0x7f08d0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:46.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.464+0000 7f08efe00700 1 --2- 172.21.15.72:0/2801404712 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f08d006dfa0 0x7f08d0070450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f08dc005fd0 tx=0x7f08dc005ee0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.464+0000 7f08efe00700 1 -- 172.21.15.72:0/2801404712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e80fee50 msgr2=0x7f08e819c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:46.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.464+0000 7f08efe00700 1 --2- 172.21.15.72:0/2801404712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e80fee50 0x7f08e819c640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f08d400bd70 tx=0x7f08d400be50 comp rx=0 tx=0).stop 2024-03-19T06:10:46.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.464+0000 7f08efe00700 1 -- 172.21.15.72:0/2801404712 shutdown_connections 2024-03-19T06:10:46.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.464+0000 7f08efe00700 1 --2- 172.21.15.72:0/2801404712 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f08d006dfa0 0x7f08d0070450 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.464+0000 7f08efe00700 1 --2- 172.21.15.72:0/2801404712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e80fe500 0x7f08e819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.464+0000 7f08efe00700 1 --2- 172.21.15.72:0/2801404712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e80fee50 0x7f08e819c640 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.464+0000 7f08efe00700 1 -- 172.21.15.72:0/2801404712 >> 172.21.15.72:0/2801404712 conn(0x7f08e80f9f10 msgr2=0x7f08e8102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:46.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.464+0000 7f08efe00700 1 -- 172.21.15.72:0/2801404712 shutdown_connections 2024-03-19T06:10:46.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.464+0000 7f08efe00700 1 -- 172.21.15.72:0/2801404712 wait complete. 2024-03-19T06:10:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.619+0000 7f809a400700 1 -- 172.21.15.72:0/579272350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8094101440 msgr2=0x7f8094101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.619+0000 7f809a400700 1 --2- 172.21.15.72:0/579272350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8094101440 0x7f8094101890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8080009910 tx=0x7f8080009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.619+0000 7f809a400700 1 -- 172.21.15.72:0/579272350 shutdown_connections 2024-03-19T06:10:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.619+0000 7f809a400700 1 --2- 172.21.15.72:0/579272350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8094101440 0x7f8094101890 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.619+0000 7f809a400700 1 --2- 172.21.15.72:0/579272350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8094100240 0x7f8094100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.619+0000 7f809a400700 1 -- 172.21.15.72:0/579272350 >> 172.21.15.72:0/579272350 conn(0x7f80940fb7f0 msgr2=0x7f80940fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:46.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.620+0000 7f809a400700 1 -- 172.21.15.72:0/579272350 shutdown_connections 2024-03-19T06:10:46.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.620+0000 7f809a400700 1 -- 172.21.15.72:0/579272350 wait complete. 2024-03-19T06:10:46.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.621+0000 7f809a400700 1 Processor -- start 2024-03-19T06:10:46.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.621+0000 7f809a400700 1 -- start start 2024-03-19T06:10:46.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.622+0000 7f809a400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8094100240 0x7f8094197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:46.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.622+0000 7f809a400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8094101440 0x7f8094198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:46.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.622+0000 7f809a400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80941988b0 con 0x7f8094100240 2024-03-19T06:10:46.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.622+0000 7f809a400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80941989f0 con 0x7f8094101440 2024-03-19T06:10:46.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.622+0000 7f8093400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8094100240 0x7f8094197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:46.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.622+0000 7f8093400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8094100240 0x7f8094197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43994/0 (socket says 172.21.15.72:43994) 2024-03-19T06:10:46.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.622+0000 7f8093400700 1 -- 172.21.15.72:0/4090567088 learned_addr learned my addr 172.21.15.72:0/4090567088 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:46.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.622+0000 7f8092a00700 1 --2- 172.21.15.72:0/4090567088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8094101440 0x7f8094198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:46.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.623+0000 7f8093400700 1 -- 172.21.15.72:0/4090567088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8094101440 msgr2=0x7f8094198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:46.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.623+0000 7f8093400700 1 --2- 172.21.15.72:0/4090567088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8094101440 0x7f8094198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.623+0000 7f8093400700 1 -- 172.21.15.72:0/4090567088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80800095f0 con 0x7f8094100240 2024-03-19T06:10:46.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.623+0000 7f8093400700 1 --2- 172.21.15.72:0/4090567088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8094100240 0x7f8094197d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f808400b480 tx=0x7f808400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.623+0000 7f808be00700 1 -- 172.21.15.72:0/4090567088 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80840118c0 con 0x7f8094100240 2024-03-19T06:10:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.623+0000 7f808be00700 1 -- 172.21.15.72:0/4090567088 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8084010380 con 0x7f8094100240 2024-03-19T06:10:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.624+0000 7f809a400700 1 -- 172.21.15.72:0/4090567088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809419d4a0 con 0x7f8094100240 2024-03-19T06:10:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.624+0000 7f808be00700 1 -- 172.21.15.72:0/4090567088 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f808400f4f0 con 0x7f8094100240 2024-03-19T06:10:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.624+0000 7f809a400700 1 -- 172.21.15.72:0/4090567088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809419d9f0 con 0x7f8094100240 2024-03-19T06:10:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.625+0000 7f809a400700 1 -- 172.21.15.72:0/4090567088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8094105520 con 0x7f8094100240 2024-03-19T06:10:46.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.626+0000 7f808be00700 1 -- 172.21.15.72:0/4090567088 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f80840104f0 con 0x7f8094100240 2024-03-19T06:10:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.627+0000 7f808be00700 1 --2- 172.21.15.72:0/4090567088 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f807806dfa0 0x7f8078070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.627+0000 7f808be00700 1 -- 172.21.15.72:0/4090567088 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f808408d890 con 0x7f8094100240 2024-03-19T06:10:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.627+0000 7f8092a00700 1 --2- 172.21.15.72:0/4090567088 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f807806dfa0 0x7f8078070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.628+0000 7f8092a00700 1 --2- 172.21.15.72:0/4090567088 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f807806dfa0 0x7f8078070450 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8080006010 tx=0x7f808000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:46.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.632+0000 7f808be00700 1 -- 172.21.15.72:0/4090567088 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f808405a960 con 0x7f8094100240 2024-03-19T06:10:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.943+0000 7f809a400700 1 -- 172.21.15.72:0/4090567088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f809402cc30 con 0x7f8094100240 2024-03-19T06:10:46.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.944+0000 7f808be00700 1 -- 172.21.15.72:0/4090567088 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f808405a4f0 con 0x7f8094100240 2024-03-19T06:10:46.935 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:10:46.935 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:10:46.935 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:10:46.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:10:46.935 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:10:46.935 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:10:46.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:10:46.935 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:10:46.935 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-03-19T06:10:46.935 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 3 2024-03-19T06:10:46.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:10:46.936 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:10:46.936 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:10:46.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:10:46.936 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:10:46.936 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-03-19T06:10:46.936 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 7 2024-03-19T06:10:46.936 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:10:46.936 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:10:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.947+0000 7f809a400700 1 -- 172.21.15.72:0/4090567088 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f807806dfa0 msgr2=0x7f8078070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.947+0000 7f809a400700 1 --2- 172.21.15.72:0/4090567088 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f807806dfa0 0x7f8078070450 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8080006010 tx=0x7f808000b540 comp rx=0 tx=0).stop 2024-03-19T06:10:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.947+0000 7f809a400700 1 -- 172.21.15.72:0/4090567088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8094100240 msgr2=0x7f8094197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.947+0000 7f809a400700 1 --2- 172.21.15.72:0/4090567088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8094100240 0x7f8094197d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f808400b480 tx=0x7f808400b840 comp rx=0 tx=0).stop 2024-03-19T06:10:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.948+0000 7f809a400700 1 -- 172.21.15.72:0/4090567088 shutdown_connections 2024-03-19T06:10:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.948+0000 7f809a400700 1 --2- 172.21.15.72:0/4090567088 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f807806dfa0 0x7f8078070450 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.948+0000 7f809a400700 1 --2- 172.21.15.72:0/4090567088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8094100240 0x7f8094197d50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.948+0000 7f809a400700 1 --2- 172.21.15.72:0/4090567088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8094101440 0x7f8094198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.948+0000 7f809a400700 1 -- 172.21.15.72:0/4090567088 >> 172.21.15.72:0/4090567088 conn(0x7f80940fb7f0 msgr2=0x7f8094102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.948+0000 7f809a400700 1 -- 172.21.15.72:0/4090567088 shutdown_connections 2024-03-19T06:10:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:46.948+0000 7f809a400700 1 -- 172.21.15.72:0/4090567088 wait complete. 2024-03-19T06:10:47.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:46 smithi072 ceph-mon[78545]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:47.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:46 smithi072 ceph-mon[78545]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:47.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:46 smithi072 ceph-mon[78545]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:47.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:46 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/4090567088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:47.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.095+0000 7fda6da00700 1 -- 172.21.15.72:0/22323184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda680736c0 msgr2=0x7fda68073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:47.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.095+0000 7fda6da00700 1 --2- 172.21.15.72:0/22323184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda680736c0 0x7fda68073b30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fda54009910 tx=0x7fda54009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:47.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.095+0000 7fda6da00700 1 -- 172.21.15.72:0/22323184 shutdown_connections 2024-03-19T06:10:47.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.095+0000 7fda6da00700 1 --2- 172.21.15.72:0/22323184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda680736c0 0x7fda68073b30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.095+0000 7fda6da00700 1 --2- 172.21.15.72:0/22323184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda68074c80 0x7fda68073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.095+0000 7fda6da00700 1 -- 172.21.15.72:0/22323184 >> 172.21.15.72:0/22323184 conn(0x7fda680fb680 msgr2=0x7fda680fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:47.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.095+0000 7fda6da00700 1 -- 172.21.15.72:0/22323184 shutdown_connections 2024-03-19T06:10:47.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.095+0000 7fda6da00700 1 -- 172.21.15.72:0/22323184 wait complete. 2024-03-19T06:10:47.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.096+0000 7fda6da00700 1 Processor -- start 2024-03-19T06:10:47.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.096+0000 7fda6da00700 1 -- start start 2024-03-19T06:10:47.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.097+0000 7fda6da00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda680736c0 0x7fda681979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:47.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.097+0000 7fda6da00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda68074c80 0x7fda68197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:47.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.097+0000 7fda6da00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda68198520 con 0x7fda680736c0 2024-03-19T06:10:47.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.097+0000 7fda6da00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda68198660 con 0x7fda68074c80 2024-03-19T06:10:47.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.097+0000 7fda67e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda680736c0 0x7fda681979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:47.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.097+0000 7fda67e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda680736c0 0x7fda681979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44010/0 (socket says 172.21.15.72:44010) 2024-03-19T06:10:47.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.097+0000 7fda67e00700 1 -- 172.21.15.72:0/2456612742 learned_addr learned my addr 172.21.15.72:0/2456612742 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:47.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.097+0000 7fda67400700 1 --2- 172.21.15.72:0/2456612742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda68074c80 0x7fda68197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:47.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.097+0000 7fda67e00700 1 -- 172.21.15.72:0/2456612742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda68074c80 msgr2=0x7fda68197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:47.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.097+0000 7fda67e00700 1 --2- 172.21.15.72:0/2456612742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda68074c80 0x7fda68197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.097+0000 7fda67e00700 1 -- 172.21.15.72:0/2456612742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda540095f0 con 0x7fda680736c0 2024-03-19T06:10:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.098+0000 7fda67e00700 1 --2- 172.21.15.72:0/2456612742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda680736c0 0x7fda681979c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda5800e8f0 tx=0x7fda5800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.098+0000 7fda64c00700 1 -- 172.21.15.72:0/2456612742 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda58009790 con 0x7fda680736c0 2024-03-19T06:10:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.098+0000 7fda6da00700 1 -- 172.21.15.72:0/2456612742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6819d110 con 0x7fda680736c0 2024-03-19T06:10:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.098+0000 7fda64c00700 1 -- 172.21.15.72:0/2456612742 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda580044d0 con 0x7fda680736c0 2024-03-19T06:10:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.098+0000 7fda64c00700 1 -- 172.21.15.72:0/2456612742 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda58003da0 con 0x7fda680736c0 2024-03-19T06:10:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.098+0000 7fda6da00700 1 -- 172.21.15.72:0/2456612742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6819d660 con 0x7fda680736c0 2024-03-19T06:10:47.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.099+0000 7fda6da00700 1 -- 172.21.15.72:0/2456612742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6810aca0 con 0x7fda680736c0 2024-03-19T06:10:47.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.100+0000 7fda64c00700 1 -- 172.21.15.72:0/2456612742 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fda5800cba0 con 0x7fda680736c0 2024-03-19T06:10:47.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.101+0000 7fda64c00700 1 --2- 172.21.15.72:0/2456612742 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fda4c06dfa0 0x7fda4c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:47.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.101+0000 7fda64c00700 1 -- 172.21.15.72:0/2456612742 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fda58014070 con 0x7fda680736c0 2024-03-19T06:10:47.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.101+0000 7fda67400700 1 --2- 172.21.15.72:0/2456612742 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fda4c06dfa0 0x7fda4c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:47.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.102+0000 7fda67400700 1 --2- 172.21.15.72:0/2456612742 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fda4c06dfa0 0x7fda4c070450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda5400b6f0 tx=0x7fda54009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:47.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.106+0000 7fda64c00700 1 -- 172.21.15.72:0/2456612742 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fda5805b190 con 0x7fda680736c0 2024-03-19T06:10:47.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.370+0000 7fda6da00700 1 -- 172.21.15.72:0/2456612742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fda6819e200 con 0x7fda680736c0 2024-03-19T06:10:47.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.371+0000 7fda64c00700 1 -- 172.21.15.72:0/2456612742 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1852 (secure 0 0 0) 0x7fda5805ad20 con 0x7fda680736c0 2024-03-19T06:10:47.362 INFO:teuthology.orchestra.run.smithi072.stdout:e17 2024-03-19T06:10:47.362 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:10:47.362 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:10:47.362 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:10:47.362 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:10:47.363 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:10:47.363 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:10:47.363 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 17 2024-03-19T06:10:47.363 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:10:47.363 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:10:47.363 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:10:32.464152+0000 2024-03-19T06:10:47.363 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:10:47.363 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:10:47.363 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:10:47.363 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:10:47.363 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:10:47.364 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:10:47.364 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:10:47.364 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:10:47.364 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:10:47.364 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:10:47.364 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:10:47.364 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:10:47.364 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:10:47.364 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:10:47.364 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:10:47.364 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:10:47.364 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:10:47.365 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:10:47.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.374+0000 7fda6da00700 1 -- 172.21.15.72:0/2456612742 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fda4c06dfa0 msgr2=0x7fda4c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:47.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.374+0000 7fda6da00700 1 --2- 172.21.15.72:0/2456612742 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fda4c06dfa0 0x7fda4c070450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda5400b6f0 tx=0x7fda54009f70 comp rx=0 tx=0).stop 2024-03-19T06:10:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.374+0000 7fda6da00700 1 -- 172.21.15.72:0/2456612742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda680736c0 msgr2=0x7fda681979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.374+0000 7fda6da00700 1 --2- 172.21.15.72:0/2456612742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda680736c0 0x7fda681979c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda5800e8f0 tx=0x7fda5800ecb0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.374+0000 7fda6da00700 1 -- 172.21.15.72:0/2456612742 shutdown_connections 2024-03-19T06:10:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.374+0000 7fda6da00700 1 --2- 172.21.15.72:0/2456612742 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fda4c06dfa0 0x7fda4c070450 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.374+0000 7fda6da00700 1 --2- 172.21.15.72:0/2456612742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda680736c0 0x7fda681979c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.374+0000 7fda6da00700 1 --2- 172.21.15.72:0/2456612742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda68074c80 0x7fda68197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.374+0000 7fda6da00700 1 -- 172.21.15.72:0/2456612742 >> 172.21.15.72:0/2456612742 conn(0x7fda680fb680 msgr2=0x7fda68105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.375+0000 7fda6da00700 1 -- 172.21.15.72:0/2456612742 shutdown_connections 2024-03-19T06:10:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.375+0000 7fda6da00700 1 -- 172.21.15.72:0/2456612742 wait complete. 2024-03-19T06:10:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2024-03-19T06:10:47.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:46 smithi172 ceph-mon[66682]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:47.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:46 smithi172 ceph-mon[66682]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:47.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:46 smithi172 ceph-mon[66682]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:47.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:46 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/4090567088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:47.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.522+0000 7f3688600700 1 -- 172.21.15.72:0/920933410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680075660 msgr2=0x7f3680075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:47.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.522+0000 7f3688600700 1 --2- 172.21.15.72:0/920933410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680075660 0x7f3680075a70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3674009910 tx=0x7f3674009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:47.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.522+0000 7f3688600700 1 -- 172.21.15.72:0/920933410 shutdown_connections 2024-03-19T06:10:47.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.522+0000 7f3688600700 1 --2- 172.21.15.72:0/920933410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3680075fb0 0x7f36800769b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.522+0000 7f3688600700 1 --2- 172.21.15.72:0/920933410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680075660 0x7f3680075a70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.522+0000 7f3688600700 1 -- 172.21.15.72:0/920933410 >> 172.21.15.72:0/920933410 conn(0x7f36800fda80 msgr2=0x7f36800ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:47.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.522+0000 7f3688600700 1 -- 172.21.15.72:0/920933410 shutdown_connections 2024-03-19T06:10:47.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.522+0000 7f3688600700 1 -- 172.21.15.72:0/920933410 wait complete. 2024-03-19T06:10:47.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.523+0000 7f3688600700 1 Processor -- start 2024-03-19T06:10:47.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.523+0000 7f3688600700 1 -- start start 2024-03-19T06:10:47.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.523+0000 7f3688600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680075660 0x7f368019c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:47.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.523+0000 7f3688600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3680075fb0 0x7f368019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:47.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.523+0000 7f3688600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368019ccc0 con 0x7f3680075660 2024-03-19T06:10:47.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.523+0000 7f3688600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368019ce00 con 0x7f3680075fb0 2024-03-19T06:10:47.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.524+0000 7f3685c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680075660 0x7f368019c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:47.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.524+0000 7f3685c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680075660 0x7f368019c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44016/0 (socket says 172.21.15.72:44016) 2024-03-19T06:10:47.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.524+0000 7f3685c00700 1 -- 172.21.15.72:0/3064818689 learned_addr learned my addr 172.21.15.72:0/3064818689 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:47.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.524+0000 7f3685c00700 1 -- 172.21.15.72:0/3064818689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3680075fb0 msgr2=0x7f368019c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:47.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.524+0000 7f3685200700 1 --2- 172.21.15.72:0/3064818689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3680075fb0 0x7f368019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:47.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.524+0000 7f3685c00700 1 --2- 172.21.15.72:0/3064818689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3680075fb0 0x7f368019c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.524+0000 7f3685c00700 1 -- 172.21.15.72:0/3064818689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36740095f0 con 0x7f3680075660 2024-03-19T06:10:47.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.524+0000 7f3685c00700 1 --2- 172.21.15.72:0/3064818689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680075660 0x7f368019c160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f367400bda0 tx=0x7f367400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:47.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.525+0000 7f367e000700 1 -- 172.21.15.72:0/3064818689 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f367401d070 con 0x7f3680075660 2024-03-19T06:10:47.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.525+0000 7f367e000700 1 -- 172.21.15.72:0/3064818689 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3674004c50 con 0x7f3680075660 2024-03-19T06:10:47.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.525+0000 7f367e000700 1 -- 172.21.15.72:0/3064818689 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f367400f690 con 0x7f3680075660 2024-03-19T06:10:47.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.525+0000 7f3688600700 1 -- 172.21.15.72:0/3064818689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36801a1850 con 0x7f3680075660 2024-03-19T06:10:47.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.525+0000 7f3688600700 1 -- 172.21.15.72:0/3064818689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36801a1d40 con 0x7f3680075660 2024-03-19T06:10:47.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.526+0000 7f3688600700 1 -- 172.21.15.72:0/3064818689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368010f360 con 0x7f3680075660 2024-03-19T06:10:47.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.527+0000 7f367e000700 1 -- 172.21.15.72:0/3064818689 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f3674022a20 con 0x7f3680075660 2024-03-19T06:10:47.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.528+0000 7f367e000700 1 --2- 172.21.15.72:0/3064818689 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f366806dfa0 0x7f3668070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:47.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.528+0000 7f367e000700 1 -- 172.21.15.72:0/3064818689 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f367408f4b0 con 0x7f3680075660 2024-03-19T06:10:47.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.529+0000 7f3685200700 1 --2- 172.21.15.72:0/3064818689 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f366806dfa0 0x7f3668070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:47.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.529+0000 7f3685200700 1 --2- 172.21.15.72:0/3064818689 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f366806dfa0 0x7f3668070450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f366c006fd0 tx=0x7f366c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:47.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.533+0000 7f367e000700 1 -- 172.21.15.72:0/3064818689 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f367405c6b0 con 0x7f3680075660 2024-03-19T06:10:47.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.766+0000 7f3688600700 1 -- 172.21.15.72:0/3064818689 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36801a2490 con 0x7f366806dfa0 2024-03-19T06:10:47.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.770+0000 7f367e000700 1 -- 172.21.15.72:0/3064818689 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f36801a2490 con 0x7f366806dfa0 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "9/23 daemons upgraded", 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:10:47.761 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:10:47.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.773+0000 7f3688600700 1 -- 172.21.15.72:0/3064818689 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f366806dfa0 msgr2=0x7f3668070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:47.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.773+0000 7f3688600700 1 --2- 172.21.15.72:0/3064818689 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f366806dfa0 0x7f3668070450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f366c006fd0 tx=0x7f366c008040 comp rx=0 tx=0).stop 2024-03-19T06:10:47.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.773+0000 7f3688600700 1 -- 172.21.15.72:0/3064818689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680075660 msgr2=0x7f368019c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:47.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.773+0000 7f3688600700 1 --2- 172.21.15.72:0/3064818689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680075660 0x7f368019c160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f367400bda0 tx=0x7f367400be80 comp rx=0 tx=0).stop 2024-03-19T06:10:47.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.773+0000 7f3688600700 1 -- 172.21.15.72:0/3064818689 shutdown_connections 2024-03-19T06:10:47.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.773+0000 7f3688600700 1 --2- 172.21.15.72:0/3064818689 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f366806dfa0 0x7f3668070450 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.773+0000 7f3688600700 1 --2- 172.21.15.72:0/3064818689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680075660 0x7f368019c160 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.773+0000 7f3688600700 1 --2- 172.21.15.72:0/3064818689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3680075fb0 0x7f368019c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.773+0000 7f3688600700 1 -- 172.21.15.72:0/3064818689 >> 172.21.15.72:0/3064818689 conn(0x7f36800fda80 msgr2=0x7f368010c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:47.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.773+0000 7f3688600700 1 -- 172.21.15.72:0/3064818689 shutdown_connections 2024-03-19T06:10:47.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.773+0000 7f3688600700 1 -- 172.21.15.72:0/3064818689 wait complete. 2024-03-19T06:10:47.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.926+0000 7f508ee00700 1 -- 172.21.15.72:0/738320086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5088101900 msgr2=0x7f5088101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:47.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.926+0000 7f508ee00700 1 --2- 172.21.15.72:0/738320086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5088101900 0x7f5088101d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5078009910 tx=0x7f5078009c20 comp rx=0 tx=0).stop 2024-03-19T06:10:47.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.926+0000 7f508ee00700 1 -- 172.21.15.72:0/738320086 shutdown_connections 2024-03-19T06:10:47.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.926+0000 7f508ee00700 1 --2- 172.21.15.72:0/738320086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5088102250 0x7f50880fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.926+0000 7f508ee00700 1 --2- 172.21.15.72:0/738320086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5088101900 0x7f5088101d10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.926+0000 7f508ee00700 1 -- 172.21.15.72:0/738320086 >> 172.21.15.72:0/738320086 conn(0x7f50880f9f10 msgr2=0x7f50880fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:47.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.926+0000 7f508ee00700 1 -- 172.21.15.72:0/738320086 shutdown_connections 2024-03-19T06:10:47.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.927+0000 7f508ee00700 1 -- 172.21.15.72:0/738320086 wait complete. 2024-03-19T06:10:47.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.928+0000 7f508ee00700 1 Processor -- start 2024-03-19T06:10:47.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.928+0000 7f508ee00700 1 -- start start 2024-03-19T06:10:47.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.928+0000 7f508ee00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5088101900 0x7f5088197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:47.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.928+0000 7f508ee00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5088102250 0x7f5088198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:47.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.928+0000 7f508ee00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5088198890 con 0x7f5088101900 2024-03-19T06:10:47.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.928+0000 7f508ee00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508819d2a0 con 0x7f5088102250 2024-03-19T06:10:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.928+0000 7f5087e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5088101900 0x7f5088197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.928+0000 7f5087e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5088101900 0x7f5088197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44024/0 (socket says 172.21.15.72:44024) 2024-03-19T06:10:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.928+0000 7f5087e00700 1 -- 172.21.15.72:0/1475467366 learned_addr learned my addr 172.21.15.72:0/1475467366 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:10:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.929+0000 7f5087e00700 1 -- 172.21.15.72:0/1475467366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5088102250 msgr2=0x7f5088198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.929+0000 7f5087400700 1 --2- 172.21.15.72:0/1475467366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5088102250 0x7f5088198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.929+0000 7f5087e00700 1 --2- 172.21.15.72:0/1475467366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5088102250 0x7f5088198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.929+0000 7f5087e00700 1 -- 172.21.15.72:0/1475467366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50780095f0 con 0x7f5088101900 2024-03-19T06:10:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.929+0000 7f5087e00700 1 --2- 172.21.15.72:0/1475467366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5088101900 0x7f5088197d30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f507800b5c0 tx=0x7f507800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.929+0000 7f5084c00700 1 -- 172.21.15.72:0/1475467366 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f507801d070 con 0x7f5088101900 2024-03-19T06:10:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.929+0000 7f5084c00700 1 -- 172.21.15.72:0/1475467366 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5078022470 con 0x7f5088101900 2024-03-19T06:10:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.929+0000 7f5084c00700 1 -- 172.21.15.72:0/1475467366 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f507800f690 con 0x7f5088101900 2024-03-19T06:10:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.929+0000 7f508ee00700 1 -- 172.21.15.72:0/1475467366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508819d440 con 0x7f5088101900 2024-03-19T06:10:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.929+0000 7f508ee00700 1 -- 172.21.15.72:0/1475467366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508819d900 con 0x7f5088101900 2024-03-19T06:10:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.930+0000 7f508ee00700 1 -- 172.21.15.72:0/1475467366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5088105780 con 0x7f5088101900 2024-03-19T06:10:47.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.931+0000 7f5084c00700 1 -- 172.21.15.72:0/1475467366 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f5078004b70 con 0x7f5088101900 2024-03-19T06:10:47.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.932+0000 7f5084c00700 1 --2- 172.21.15.72:0/1475467366 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f506c06dfa0 0x7f506c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:10:47.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.932+0000 7f5084c00700 1 -- 172.21.15.72:0/1475467366 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f507808f390 con 0x7f5088101900 2024-03-19T06:10:47.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.933+0000 7f5087400700 1 --2- 172.21.15.72:0/1475467366 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f506c06dfa0 0x7f506c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:10:47.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.933+0000 7f5087400700 1 --2- 172.21.15.72:0/1475467366 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f506c06dfa0 0x7f506c070450 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5074005950 tx=0x7f5074005d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:10:47.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:47.937+0000 7f5084c00700 1 -- 172.21.15.72:0/1475467366 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f5078058940 con 0x7f5088101900 2024-03-19T06:10:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:47 smithi072 ceph-mon[78545]: pgmap v119: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:48.030 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:47 smithi072 ceph-mon[78545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/396 objects degraded (9.848%), 11 pgs degraded) 2024-03-19T06:10:48.030 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:47 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2456612742' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:10:48.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.244+0000 7f508ee00700 1 -- 172.21.15.72:0/1475467366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f508802cc30 con 0x7f5088101900 2024-03-19T06:10:48.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.245+0000 7f5084c00700 1 -- 172.21.15.72:0/1475467366 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f507805c000 con 0x7f5088101900 2024-03-19T06:10:48.236 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:10:48.236 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:10:48.236 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:10:48.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.247+0000 7f508ee00700 1 -- 172.21.15.72:0/1475467366 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f506c06dfa0 msgr2=0x7f506c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:48.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.247+0000 7f508ee00700 1 --2- 172.21.15.72:0/1475467366 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f506c06dfa0 0x7f506c070450 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5074005950 tx=0x7f5074005d10 comp rx=0 tx=0).stop 2024-03-19T06:10:48.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.247+0000 7f508ee00700 1 -- 172.21.15.72:0/1475467366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5088101900 msgr2=0x7f5088197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:10:48.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.247+0000 7f508ee00700 1 --2- 172.21.15.72:0/1475467366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5088101900 0x7f5088197d30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f507800b5c0 tx=0x7f507800be20 comp rx=0 tx=0).stop 2024-03-19T06:10:48.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.247+0000 7f508ee00700 1 -- 172.21.15.72:0/1475467366 shutdown_connections 2024-03-19T06:10:48.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.247+0000 7f508ee00700 1 --2- 172.21.15.72:0/1475467366 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f506c06dfa0 0x7f506c070450 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:48.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.248+0000 7f508ee00700 1 --2- 172.21.15.72:0/1475467366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5088101900 0x7f5088197d30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:48.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.248+0000 7f508ee00700 1 --2- 172.21.15.72:0/1475467366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5088102250 0x7f5088198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:10:48.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.248+0000 7f508ee00700 1 -- 172.21.15.72:0/1475467366 >> 172.21.15.72:0/1475467366 conn(0x7f50880f9f10 msgr2=0x7f50881028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:10:48.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.248+0000 7f508ee00700 1 -- 172.21.15.72:0/1475467366 shutdown_connections 2024-03-19T06:10:48.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:10:48.248+0000 7f508ee00700 1 -- 172.21.15.72:0/1475467366 wait complete. 2024-03-19T06:10:48.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:47 smithi172 ceph-mon[66682]: pgmap v119: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:48.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:47 smithi172 ceph-mon[66682]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/396 objects degraded (9.848%), 11 pgs degraded) 2024-03-19T06:10:48.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:47 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2456612742' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:10:49.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:48 smithi072 ceph-mon[78545]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:49.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:48 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1475467366' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:10:49.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:49.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:49.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:10:49.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:10:49.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:49.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:10:49.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:49.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:49.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:49.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:48 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-19T06:10:49.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:48 smithi172 ceph-mon[66682]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:10:49.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:48 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1475467366' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:10:49.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:49.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:49.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:10:49.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:10:49.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:49.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:10:49.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:49.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:49.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:10:49.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:48 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-19T06:10:50.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:50 smithi172 ceph-mon[66682]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-19T06:10:50.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:50 smithi172 ceph-mon[66682]: Upgrade: osd.3 is safe to restart 2024-03-19T06:10:50.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:50 smithi172 ceph-mon[66682]: pgmap v120: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:50.404 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:50.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:50 smithi072 ceph-mon[78545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-19T06:10:50.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:50 smithi072 ceph-mon[78545]: Upgrade: osd.3 is safe to restart 2024-03-19T06:10:50.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:50 smithi072 ceph-mon[78545]: pgmap v120: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:50.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:52.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:51 smithi172 ceph-mon[66682]: pgmap v121: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:52.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:51 smithi172 ceph-mon[66682]: Upgrade: Updating osd.3 2024-03-19T06:10:52.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:51 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:52.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:51 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-19T06:10:52.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:51 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:10:52.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:51 smithi172 ceph-mon[66682]: Deploying daemon osd.3 on smithi172 2024-03-19T06:10:52.304 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:51 smithi072 ceph-mon[78545]: pgmap v121: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:52.304 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:51 smithi072 ceph-mon[78545]: Upgrade: Updating osd.3 2024-03-19T06:10:52.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:51 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:52.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:51 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-19T06:10:52.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:51 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:10:52.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:51 smithi072 ceph-mon[78545]: Deploying daemon osd.3 on smithi172 2024-03-19T06:10:54.067 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:53 smithi172 ceph-mon[66682]: pgmap v122: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:54.310 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:53 smithi072 ceph-mon[78545]: pgmap v122: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:55.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:55 smithi172 ceph-mon[66682]: pgmap v123: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:55.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:55.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:10:55.903 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:55 smithi172 systemd[1]: Stopping Ceph osd.3 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:10:56.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:55 smithi072 ceph-mon[78545]: pgmap v123: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:56.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:10:56.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:10:56.403 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:56 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[41663]: 2024-03-19T06:10:56.105+0000 7f8c44200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:10:56.403 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:56 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[41663]: 2024-03-19T06:10:56.105+0000 7f8c44200700 -1 osd.3 63 *** Got signal Terminated *** 2024-03-19T06:10:56.403 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:56 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[41663]: 2024-03-19T06:10:56.105+0000 7f8c44200700 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-19T06:10:57.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:56 smithi072 ceph-mon[78545]: osd.3 marked itself down and dead 2024-03-19T06:10:57.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:56 smithi172 ceph-mon[66682]: osd.3 marked itself down and dead 2024-03-19T06:10:57.652 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:57 smithi172 podman[71392]: 2024-03-19 06:10:57.380560083 +0000 UTC m=+1.459915007 container died 651eb6ad682c0a688db24c55f5211f5e01956ab2a6173450ccfd769f389f5220 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-03-19T06:10:58.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:57 smithi172 ceph-mon[66682]: pgmap v124: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:58.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:57 smithi172 ceph-mon[66682]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-19T06:10:58.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:57 smithi172 ceph-mon[66682]: osdmap e64: 6 total, 5 up, 6 in 2024-03-19T06:10:58.131 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:57 smithi172 podman[71392]: 2024-03-19 06:10:57.82313461 +0000 UTC m=+1.902489547 container cleanup 651eb6ad682c0a688db24c55f5211f5e01956ab2a6173450ccfd769f389f5220 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-19T06:10:58.131 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:57 smithi172 bash[71392]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3 2024-03-19T06:10:58.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:57 smithi072 ceph-mon[78545]: pgmap v124: 65 pgs: 65 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:10:58.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:57 smithi072 ceph-mon[78545]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-19T06:10:58.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:57 smithi072 ceph-mon[78545]: osdmap e64: 6 total, 5 up, 6 in 2024-03-19T06:10:58.402 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:58 smithi172 podman[71409]: 2024-03-19 06:10:58.14075722 +0000 UTC m=+0.747992435 container remove 651eb6ad682c0a688db24c55f5211f5e01956ab2a6173450ccfd769f389f5220 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212) 2024-03-19T06:10:59.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:58 smithi172 ceph-mon[66682]: osdmap e65: 6 total, 5 up, 6 in 2024-03-19T06:10:59.152 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:58 smithi172 podman[71498]: 2024-03-19 06:10:58.859983837 +0000 UTC m=+0.033554520 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:10:59.153 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:58 smithi172 podman[71498]: 2024-03-19 06:10:58.983650876 +0000 UTC m=+0.157221595 container create bb0fbec628f85ec8e1d47896bdca86028be691b21ba88cdd9821ddbfae551e9c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.license=GPLv2) 2024-03-19T06:10:59.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:58 smithi072 ceph-mon[78545]: osdmap e65: 6 total, 5 up, 6 in 2024-03-19T06:10:59.402 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:59 smithi172 podman[71498]: 2024-03-19 06:10:59.254113052 +0000 UTC m=+0.427683845 container init bb0fbec628f85ec8e1d47896bdca86028be691b21ba88cdd9821ddbfae551e9c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-19T06:10:59.403 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:59 smithi172 podman[71498]: 2024-03-19 06:10:59.265402706 +0000 UTC m=+0.438973455 container start bb0fbec628f85ec8e1d47896bdca86028be691b21ba88cdd9821ddbfae551e9c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-deactivate, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, ceph=True, GIT_CLEAN=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-19T06:10:59.403 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:59 smithi172 podman[71498]: 2024-03-19 06:10:59.352683693 +0000 UTC m=+0.526254439 container attach bb0fbec628f85ec8e1d47896bdca86028be691b21ba88cdd9821ddbfae551e9c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271) 2024-03-19T06:11:00.057 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:10:59 smithi172 ceph-mon[66682]: pgmap v127: 65 pgs: 16 stale+active+clean, 49 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:00.058 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:10:59 smithi172 podman[71498]: 2024-03-19 06:10:59.698366702 +0000 UTC m=+0.871937478 container died bb0fbec628f85ec8e1d47896bdca86028be691b21ba88cdd9821ddbfae551e9c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240222) 2024-03-19T06:11:00.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:10:59 smithi072 ceph-mon[78545]: pgmap v127: 65 pgs: 16 stale+active+clean, 49 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:00.848 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:00 smithi172 podman[71524]: 2024-03-19 06:11:00.442140703 +0000 UTC m=+0.726125092 container remove bb0fbec628f85ec8e1d47896bdca86028be691b21ba88cdd9821ddbfae551e9c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, ceph=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-03-19T06:11:00.848 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:00 smithi172 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.3.service: Deactivated successfully. 2024-03-19T06:11:00.848 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:00 smithi172 systemd[1]: Stopped Ceph osd.3 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:11:00.848 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:00 smithi172 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.3.service: Consumed 1min 59.000s CPU time. 2024-03-19T06:11:01.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:00 smithi172 ceph-mon[66682]: Health check failed: Degraded data redundancy: 10/396 objects degraded (2.525%), 3 pgs degraded (PG_DEGRADED) 2024-03-19T06:11:01.153 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:00 smithi172 systemd[1]: Starting Ceph osd.3 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:11:01.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:00 smithi072 ceph-mon[78545]: Health check failed: Degraded data redundancy: 10/396 objects degraded (2.525%), 3 pgs degraded (PG_DEGRADED) 2024-03-19T06:11:01.520 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:01 smithi172 podman[71626]: 2024-03-19 06:11:01.215425582 +0000 UTC m=+0.127148645 container create d60dd7066cbf9e9bcb3599ceab138b2279bdcbf5607bcf51ccbd253a4930e2ab (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.schema-version=1.0) 2024-03-19T06:11:01.520 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:01 smithi172 podman[71626]: 2024-03-19 06:11:01.123215254 +0000 UTC m=+0.034938295 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:11:01.902 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:01 smithi172 podman[71626]: 2024-03-19 06:11:01.530325846 +0000 UTC m=+0.442048931 container init d60dd7066cbf9e9bcb3599ceab138b2279bdcbf5607bcf51ccbd253a4930e2ab (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-19T06:11:01.903 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:01 smithi172 podman[71626]: 2024-03-19 06:11:01.54173068 +0000 UTC m=+0.453453758 container start d60dd7066cbf9e9bcb3599ceab138b2279bdcbf5607bcf51ccbd253a4930e2ab (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-03-19T06:11:01.903 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:01 smithi172 podman[71626]: 2024-03-19 06:11:01.626423854 +0000 UTC m=+0.538146935 container attach d60dd7066cbf9e9bcb3599ceab138b2279bdcbf5607bcf51ccbd253a4930e2ab (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, ceph=True) 2024-03-19T06:11:02.304 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:01 smithi072 ceph-mon[78545]: pgmap v128: 65 pgs: 3 active+undersized+degraded, 13 stale+active+clean, 4 active+undersized, 45 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 10/396 objects degraded (2.525%) 2024-03-19T06:11:02.388 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:01 smithi172 ceph-mon[66682]: pgmap v128: 65 pgs: 3 active+undersized+degraded, 13 stale+active+clean, 4 active+undersized, 45 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 10/396 objects degraded (2.525%) 2024-03-19T06:11:02.653 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate[71640]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate[71640]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 bash[71626]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 bash[71626]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 bash[71626]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 bash[71626]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 bash[71626]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 bash[71626]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 bash[71626]: --> ceph-volume raw activate successful for osd ID: 3 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate[71640]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate[71640]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate[71640]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate[71640]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-19T06:11:02.654 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate[71640]: --> ceph-volume raw activate successful for osd ID: 3 2024-03-19T06:11:02.655 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:02 smithi172 podman[71626]: 2024-03-19 06:11:02.442865391 +0000 UTC m=+1.354588453 container died d60dd7066cbf9e9bcb3599ceab138b2279bdcbf5607bcf51ccbd253a4930e2ab (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:11:03.402 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:03 smithi172 podman[71776]: 2024-03-19 06:11:03.146242407 +0000 UTC m=+0.684825299 container remove d60dd7066cbf9e9bcb3599ceab138b2279bdcbf5607bcf51ccbd253a4930e2ab (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b) 2024-03-19T06:11:03.783 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:03 smithi172 podman[71840]: 2024-03-19 06:11:03.410087377 +0000 UTC m=+0.035619435 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:11:03.783 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:03 smithi172 podman[71840]: 2024-03-19 06:11:03.53879576 +0000 UTC m=+0.164327855 container create 7ea8347dc3cb03140a518f4c04ae8470103338b6e23d423ff8fd6485e3221831 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222) 2024-03-19T06:11:03.783 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:03 smithi172 podman[71840]: 2024-03-19 06:11:03.792157452 +0000 UTC m=+0.417689553 container init 7ea8347dc3cb03140a518f4c04ae8470103338b6e23d423ff8fd6485e3221831 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:11:04.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:03 smithi172 ceph-mon[66682]: pgmap v129: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 80/396 objects degraded (20.202%) 2024-03-19T06:11:04.152 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:03 smithi172 podman[71840]: 2024-03-19 06:11:03.804335647 +0000 UTC m=+0.429867728 container start 7ea8347dc3cb03140a518f4c04ae8470103338b6e23d423ff8fd6485e3221831 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:11:04.153 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:03 smithi172 ceph-osd[71859]: -- 172.21.15.172:0/1057064669 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c5f05d5680 con 0x55c5f059f000 2024-03-19T06:11:04.153 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:03 smithi172 bash[71840]: 7ea8347dc3cb03140a518f4c04ae8470103338b6e23d423ff8fd6485e3221831 2024-03-19T06:11:04.153 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:03 smithi172 systemd[1]: Started Ceph osd.3 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:11:04.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:03 smithi072 ceph-mon[78545]: pgmap v129: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 80/396 objects degraded (20.202%) 2024-03-19T06:11:04.656 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:04 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:11:04.375+0000 7f7956e807c0 -1 Falling back to public interface 2024-03-19T06:11:05.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:05.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:05.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:11:05.327 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:05.328 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:05.328 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:11:06.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:06 smithi072 ceph-mon[78545]: pgmap v130: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 80/396 objects degraded (20.202%) 2024-03-19T06:11:06.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:06 smithi172 ceph-mon[66682]: pgmap v130: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 80/396 objects degraded (20.202%) 2024-03-19T06:11:08.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:08 smithi072 ceph-mon[78545]: pgmap v131: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 80/396 objects degraded (20.202%) 2024-03-19T06:11:08.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:08 smithi072 ceph-mon[78545]: Health check update: Degraded data redundancy: 80/396 objects degraded (20.202%), 20 pgs degraded (PG_DEGRADED) 2024-03-19T06:11:08.363 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:08 smithi172 ceph-mon[66682]: pgmap v131: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 80/396 objects degraded (20.202%) 2024-03-19T06:11:08.363 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:08 smithi172 ceph-mon[66682]: Health check update: Degraded data redundancy: 80/396 objects degraded (20.202%), 20 pgs degraded (PG_DEGRADED) 2024-03-19T06:11:09.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:09.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:09.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:09.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:10.152 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:09 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:11:09.813+0000 7f7956e807c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-03-19T06:11:10.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:10 smithi072 ceph-mon[78545]: pgmap v132: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 80/396 objects degraded (20.202%) 2024-03-19T06:11:10.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:10.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:11:10.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:10 smithi072 ceph-mon[78545]: from='osd.3 [v2:172.21.15.172:6800/2721074858,v1:172.21.15.172:6801/2721074858]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-19T06:11:10.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:10 smithi072 ceph-mon[78545]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-19T06:11:10.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:10.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:10.652 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:10 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:11:10.256+0000 7f7956e807c0 -1 osd.3 63 log_to_monitors true 2024-03-19T06:11:10.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:10 smithi172 ceph-mon[66682]: pgmap v132: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 80/396 objects degraded (20.202%) 2024-03-19T06:11:10.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:10.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:11:10.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:10 smithi172 ceph-mon[66682]: from='osd.3 [v2:172.21.15.172:6800/2721074858,v1:172.21.15.172:6801/2721074858]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-19T06:11:10.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:10 smithi172 ceph-mon[66682]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-19T06:11:10.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:10.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:11.152 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:11:10 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:11:10.861+0000 7f7946200700 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:11:12.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:11 smithi172 ceph-mon[66682]: pgmap v133: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 80/396 objects degraded (20.202%) 2024-03-19T06:11:12.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:11 smithi172 ceph-mon[66682]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-19T06:11:12.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:11 smithi172 ceph-mon[66682]: osdmap e66: 6 total, 5 up, 6 in 2024-03-19T06:11:12.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:11 smithi172 ceph-mon[66682]: from='osd.3 [v2:172.21.15.172:6800/2721074858,v1:172.21.15.172:6801/2721074858]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T06:11:12.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:11 smithi172 ceph-mon[66682]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T06:11:12.304 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:11 smithi072 ceph-mon[78545]: pgmap v133: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 355 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 80/396 objects degraded (20.202%) 2024-03-19T06:11:12.304 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:11 smithi072 ceph-mon[78545]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-19T06:11:12.304 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:11 smithi072 ceph-mon[78545]: osdmap e66: 6 total, 5 up, 6 in 2024-03-19T06:11:12.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:11 smithi072 ceph-mon[78545]: from='osd.3 [v2:172.21.15.172:6800/2721074858,v1:172.21.15.172:6801/2721074858]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T06:11:12.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:11 smithi072 ceph-mon[78545]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T06:11:13.070 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:12 smithi172 ceph-mon[66682]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-19T06:11:13.070 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:12 smithi172 ceph-mon[66682]: osd.3 [v2:172.21.15.172:6800/2721074858,v1:172.21.15.172:6801/2721074858] boot 2024-03-19T06:11:13.070 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:12 smithi172 ceph-mon[66682]: osdmap e67: 6 total, 6 up, 6 in 2024-03-19T06:11:13.070 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:12 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T06:11:13.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:12 smithi072 ceph-mon[78545]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-19T06:11:13.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:12 smithi072 ceph-mon[78545]: osd.3 [v2:172.21.15.172:6800/2721074858,v1:172.21.15.172:6801/2721074858] boot 2024-03-19T06:11:13.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:12 smithi072 ceph-mon[78545]: osdmap e67: 6 total, 6 up, 6 in 2024-03-19T06:11:13.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:12 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-19T06:11:14.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:13 smithi172 ceph-mon[66682]: pgmap v136: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 80/396 objects degraded (20.202%) 2024-03-19T06:11:14.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:13 smithi172 ceph-mon[66682]: osdmap e68: 6 total, 6 up, 6 in 2024-03-19T06:11:14.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:13 smithi072 ceph-mon[78545]: pgmap v136: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 80/396 objects degraded (20.202%) 2024-03-19T06:11:14.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:13 smithi072 ceph-mon[78545]: osdmap e68: 6 total, 6 up, 6 in 2024-03-19T06:11:15.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:15.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:15.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:11:15.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:11:15.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:15.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: pgmap v138: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 75/396 objects degraded (18.939%) 2024-03-19T06:11:15.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:11:15.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:15.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:15.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:15.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-19T06:11:15.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-19T06:11:15.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:15 smithi172 ceph-mon[66682]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-03-19T06:11:16.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:16.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:16.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:11:16.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:11:16.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:16.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: pgmap v138: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 75/396 objects degraded (18.939%) 2024-03-19T06:11:16.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:11:16.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:16.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:16.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:16.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-19T06:11:16.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-19T06:11:16.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:15 smithi072 ceph-mon[78545]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-03-19T06:11:16.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:16 smithi172 ceph-mon[66682]: Health check update: Degraded data redundancy: 75/396 objects degraded (18.939%), 19 pgs degraded (PG_DEGRADED) 2024-03-19T06:11:17.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:16 smithi072 ceph-mon[78545]: Health check update: Degraded data redundancy: 75/396 objects degraded (18.939%), 19 pgs degraded (PG_DEGRADED) 2024-03-19T06:11:17.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:17 smithi172 ceph-mon[66682]: pgmap v139: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:18.027 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:17 smithi072 ceph-mon[78545]: pgmap v139: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.422+0000 7f9763000700 1 -- 172.21.15.72:0/2825375619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f975c1036d0 msgr2=0x7f975c103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.422+0000 7f9763000700 1 --2- 172.21.15.72:0/2825375619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f975c1036d0 0x7f975c103b40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9748009910 tx=0x7f9748009c20 comp rx=0 tx=0).stop 2024-03-19T06:11:18.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.422+0000 7f9763000700 1 -- 172.21.15.72:0/2825375619 shutdown_connections 2024-03-19T06:11:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.422+0000 7f9763000700 1 --2- 172.21.15.72:0/2825375619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f975c1036d0 0x7f975c103b40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.422+0000 7f9763000700 1 --2- 172.21.15.72:0/2825375619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975c102430 0x7f975c102840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.422+0000 7f9763000700 1 -- 172.21.15.72:0/2825375619 >> 172.21.15.72:0/2825375619 conn(0x7f975c0fda80 msgr2=0x7f975c0ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.422+0000 7f9763000700 1 -- 172.21.15.72:0/2825375619 shutdown_connections 2024-03-19T06:11:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.422+0000 7f9763000700 1 -- 172.21.15.72:0/2825375619 wait complete. 2024-03-19T06:11:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.423+0000 7f9763000700 1 Processor -- start 2024-03-19T06:11:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.423+0000 7f9763000700 1 -- start start 2024-03-19T06:11:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.423+0000 7f9763000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f975c102430 0x7f975c197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.423+0000 7f9763000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975c1036d0 0x7f975c1981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.423+0000 7f9763000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c1987d0 con 0x7f975c102430 2024-03-19T06:11:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.423+0000 7f9763000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c198940 con 0x7f975c1036d0 2024-03-19T06:11:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.424+0000 7f975be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f975c102430 0x7f975c197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.424+0000 7f975be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f975c102430 0x7f975c197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53292/0 (socket says 172.21.15.72:53292) 2024-03-19T06:11:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.424+0000 7f975be00700 1 -- 172.21.15.72:0/2969657448 learned_addr learned my addr 172.21.15.72:0/2969657448 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.424+0000 7f975b400700 1 --2- 172.21.15.72:0/2969657448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975c1036d0 0x7f975c1981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.424+0000 7f975be00700 1 -- 172.21.15.72:0/2969657448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975c1036d0 msgr2=0x7f975c1981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.424+0000 7f975be00700 1 --2- 172.21.15.72:0/2969657448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975c1036d0 0x7f975c1981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.424+0000 7f975be00700 1 -- 172.21.15.72:0/2969657448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97480095f0 con 0x7f975c102430 2024-03-19T06:11:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.425+0000 7f975be00700 1 --2- 172.21.15.72:0/2969657448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f975c102430 0x7f975c197c90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f974c00d8d0 tx=0x7f974c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.425+0000 7f9758c00700 1 -- 172.21.15.72:0/2969657448 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f974c009940 con 0x7f975c102430 2024-03-19T06:11:18.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.425+0000 7f9758c00700 1 -- 172.21.15.72:0/2969657448 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f974c010460 con 0x7f975c102430 2024-03-19T06:11:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.425+0000 7f9763000700 1 -- 172.21.15.72:0/2969657448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c19d3d0 con 0x7f975c102430 2024-03-19T06:11:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.425+0000 7f9758c00700 1 -- 172.21.15.72:0/2969657448 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f974c00f5f0 con 0x7f975c102430 2024-03-19T06:11:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.425+0000 7f9763000700 1 -- 172.21.15.72:0/2969657448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c19d920 con 0x7f975c102430 2024-03-19T06:11:18.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.426+0000 7f9763000700 1 -- 172.21.15.72:0/2969657448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c10af10 con 0x7f975c102430 2024-03-19T06:11:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.427+0000 7f9758c00700 1 -- 172.21.15.72:0/2969657448 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f974c0105d0 con 0x7f975c102430 2024-03-19T06:11:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.429+0000 7f9758c00700 1 --2- 172.21.15.72:0/2969657448 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f974006dfa0 0x7f9740070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.429+0000 7f9758c00700 1 -- 172.21.15.72:0/2969657448 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f974c08db90 con 0x7f975c102430 2024-03-19T06:11:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.429+0000 7f975b400700 1 --2- 172.21.15.72:0/2969657448 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f974006dfa0 0x7f9740070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.430+0000 7f975b400700 1 --2- 172.21.15.72:0/2969657448 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f974006dfa0 0x7f9740070450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9748005950 tx=0x7f97480058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:18.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.434+0000 7f9758c00700 1 -- 172.21.15.72:0/2969657448 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f974c057130 con 0x7f975c102430 2024-03-19T06:11:18.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.678+0000 7f9763000700 1 -- 172.21.15.72:0/2969657448 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f975c108020 con 0x7f974006dfa0 2024-03-19T06:11:18.671 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:18 smithi072 ceph-mon[78545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 75/396 objects degraded (18.939%), 19 pgs degraded) 2024-03-19T06:11:18.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.681+0000 7f9758c00700 1 -- 172.21.15.72:0/2969657448 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f975c108020 con 0x7f974006dfa0 2024-03-19T06:11:18.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.684+0000 7f9763000700 1 -- 172.21.15.72:0/2969657448 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f974006dfa0 msgr2=0x7f9740070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:18.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.684+0000 7f9763000700 1 --2- 172.21.15.72:0/2969657448 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f974006dfa0 0x7f9740070450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9748005950 tx=0x7f97480058e0 comp rx=0 tx=0).stop 2024-03-19T06:11:18.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.684+0000 7f9763000700 1 -- 172.21.15.72:0/2969657448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f975c102430 msgr2=0x7f975c197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:18.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.684+0000 7f9763000700 1 --2- 172.21.15.72:0/2969657448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f975c102430 0x7f975c197c90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f974c00d8d0 tx=0x7f974c00dc90 comp rx=0 tx=0).stop 2024-03-19T06:11:18.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.684+0000 7f9763000700 1 -- 172.21.15.72:0/2969657448 shutdown_connections 2024-03-19T06:11:18.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.684+0000 7f9763000700 1 --2- 172.21.15.72:0/2969657448 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f974006dfa0 0x7f9740070450 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:18.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.684+0000 7f9763000700 1 --2- 172.21.15.72:0/2969657448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f975c102430 0x7f975c197c90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:18.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.684+0000 7f9763000700 1 --2- 172.21.15.72:0/2969657448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975c1036d0 0x7f975c1981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:18.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.684+0000 7f9763000700 1 -- 172.21.15.72:0/2969657448 >> 172.21.15.72:0/2969657448 conn(0x7f975c0fda80 msgr2=0x7f975c106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:18.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.684+0000 7f9763000700 1 -- 172.21.15.72:0/2969657448 shutdown_connections 2024-03-19T06:11:18.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.685+0000 7f9763000700 1 -- 172.21.15.72:0/2969657448 wait complete. 2024-03-19T06:11:18.691 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:11:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.845+0000 7f11da800700 1 -- 172.21.15.72:0/1668922825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11d40ffb60 msgr2=0x7f11d40fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.845+0000 7f11da800700 1 --2- 172.21.15.72:0/1668922825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11d40ffb60 0x7f11d40fffd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009910 tx=0x7f11bc009c20 comp rx=0 tx=0).stop 2024-03-19T06:11:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.845+0000 7f11da800700 1 -- 172.21.15.72:0/1668922825 shutdown_connections 2024-03-19T06:11:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.845+0000 7f11da800700 1 --2- 172.21.15.72:0/1668922825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11d40ffb60 0x7f11d40fffd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.845+0000 7f11da800700 1 --2- 172.21.15.72:0/1668922825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11d40fe8c0 0x7f11d40fecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.845+0000 7f11da800700 1 -- 172.21.15.72:0/1668922825 >> 172.21.15.72:0/1668922825 conn(0x7f11d40f9f10 msgr2=0x7f11d40fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.845+0000 7f11da800700 1 -- 172.21.15.72:0/1668922825 shutdown_connections 2024-03-19T06:11:18.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.846+0000 7f11da800700 1 -- 172.21.15.72:0/1668922825 wait complete. 2024-03-19T06:11:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.846+0000 7f11da800700 1 Processor -- start 2024-03-19T06:11:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.847+0000 7f11da800700 1 -- start start 2024-03-19T06:11:18.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.847+0000 7f11da800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11d40fe8c0 0x7f11d4197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:18.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.847+0000 7f11da800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11d40ffb60 0x7f11d41981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:18.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.847+0000 7f11da800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d41987f0 con 0x7f11d40ffb60 2024-03-19T06:11:18.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.847+0000 7f11da800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d4198960 con 0x7f11d40fe8c0 2024-03-19T06:11:18.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.847+0000 7f11caa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11d40ffb60 0x7f11d41981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:18.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.847+0000 7f11caa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11d40ffb60 0x7f11d41981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53310/0 (socket says 172.21.15.72:53310) 2024-03-19T06:11:18.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.847+0000 7f11caa00700 1 -- 172.21.15.72:0/2576964245 learned_addr learned my addr 172.21.15.72:0/2576964245 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:18.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.848+0000 7f11d3400700 1 --2- 172.21.15.72:0/2576964245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11d40fe8c0 0x7f11d4197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:18.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.848+0000 7f11caa00700 1 -- 172.21.15.72:0/2576964245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11d40fe8c0 msgr2=0x7f11d4197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:18.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.848+0000 7f11caa00700 1 --2- 172.21.15.72:0/2576964245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11d40fe8c0 0x7f11d4197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:18.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.848+0000 7f11caa00700 1 -- 172.21.15.72:0/2576964245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc0095f0 con 0x7f11d40ffb60 2024-03-19T06:11:18.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.848+0000 7f11caa00700 1 --2- 172.21.15.72:0/2576964245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11d40ffb60 0x7f11d41981f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f11bc005b40 tx=0x7f11bc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:18.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.848+0000 7f11d0c00700 1 -- 172.21.15.72:0/2576964245 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11bc01d070 con 0x7f11d40ffb60 2024-03-19T06:11:18.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.848+0000 7f11d0c00700 1 -- 172.21.15.72:0/2576964245 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f11bc022470 con 0x7f11d40ffb60 2024-03-19T06:11:18.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.848+0000 7f11d0c00700 1 -- 172.21.15.72:0/2576964245 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11bc00f690 con 0x7f11d40ffb60 2024-03-19T06:11:18.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.848+0000 7f11da800700 1 -- 172.21.15.72:0/2576964245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d419d390 con 0x7f11d40ffb60 2024-03-19T06:11:18.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.849+0000 7f11da800700 1 -- 172.21.15.72:0/2576964245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d419d880 con 0x7f11d40ffb60 2024-03-19T06:11:18.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.850+0000 7f11da800700 1 -- 172.21.15.72:0/2576964245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d4107c30 con 0x7f11d40ffb60 2024-03-19T06:11:18.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.851+0000 7f11d0c00700 1 -- 172.21.15.72:0/2576964245 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f11bc0225e0 con 0x7f11d40ffb60 2024-03-19T06:11:18.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.852+0000 7f11d0c00700 1 --2- 172.21.15.72:0/2576964245 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f11b806dfa0 0x7f11b8070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:18.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.852+0000 7f11d0c00700 1 -- 172.21.15.72:0/2576964245 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f11bc08f2f0 con 0x7f11d40ffb60 2024-03-19T06:11:18.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.852+0000 7f11d3400700 1 --2- 172.21.15.72:0/2576964245 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f11b806dfa0 0x7f11b8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.853+0000 7f11d3400700 1 --2- 172.21.15.72:0/2576964245 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f11b806dfa0 0x7f11b8070450 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f11c4005950 tx=0x7f11c4005ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:18.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:18.857+0000 7f11d0c00700 1 -- 172.21.15.72:0/2576964245 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f11bc058940 con 0x7f11d40ffb60 2024-03-19T06:11:18.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:18 smithi172 ceph-mon[66682]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 75/396 objects degraded (18.939%), 19 pgs degraded) 2024-03-19T06:11:19.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.102+0000 7f11da800700 1 -- 172.21.15.72:0/2576964245 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11d4107110 con 0x7f11b806dfa0 2024-03-19T06:11:19.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.104+0000 7f11d0c00700 1 -- 172.21.15.72:0/2576964245 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f11d4107110 con 0x7f11b806dfa0 2024-03-19T06:11:19.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.106+0000 7f11da800700 1 -- 172.21.15.72:0/2576964245 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f11b806dfa0 msgr2=0x7f11b8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:19.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.106+0000 7f11da800700 1 --2- 172.21.15.72:0/2576964245 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f11b806dfa0 0x7f11b8070450 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f11c4005950 tx=0x7f11c4005ed0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.106+0000 7f11da800700 1 -- 172.21.15.72:0/2576964245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11d40ffb60 msgr2=0x7f11d41981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:19.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.106+0000 7f11da800700 1 --2- 172.21.15.72:0/2576964245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11d40ffb60 0x7f11d41981f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f11bc005b40 tx=0x7f11bc00be20 comp rx=0 tx=0).stop 2024-03-19T06:11:19.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.106+0000 7f11da800700 1 -- 172.21.15.72:0/2576964245 shutdown_connections 2024-03-19T06:11:19.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.106+0000 7f11da800700 1 --2- 172.21.15.72:0/2576964245 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f11b806dfa0 0x7f11b8070450 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.106+0000 7f11da800700 1 --2- 172.21.15.72:0/2576964245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11d40fe8c0 0x7f11d4197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.106+0000 7f11da800700 1 --2- 172.21.15.72:0/2576964245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11d40ffb60 0x7f11d41981f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.106+0000 7f11da800700 1 -- 172.21.15.72:0/2576964245 >> 172.21.15.72:0/2576964245 conn(0x7f11d40f9f10 msgr2=0x7f11d4106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:19.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.107+0000 7f11da800700 1 -- 172.21.15.72:0/2576964245 shutdown_connections 2024-03-19T06:11:19.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.107+0000 7f11da800700 1 -- 172.21.15.72:0/2576964245 wait complete. 2024-03-19T06:11:19.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.264+0000 7fcedf400700 1 -- 172.21.15.72:0/1149127637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced8106840 msgr2=0x7fced8106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:19.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.264+0000 7fcedf400700 1 --2- 172.21.15.72:0/1149127637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced8106840 0x7fced8106c50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009910 tx=0x7fcecc009c20 comp rx=0 tx=0).stop 2024-03-19T06:11:19.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.265+0000 7fcedf400700 1 -- 172.21.15.72:0/1149127637 shutdown_connections 2024-03-19T06:11:19.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.265+0000 7fcedf400700 1 --2- 172.21.15.72:0/1149127637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fced8107a40 0x7fced8107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.265+0000 7fcedf400700 1 --2- 172.21.15.72:0/1149127637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced8106840 0x7fced8106c50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.265+0000 7fcedf400700 1 -- 172.21.15.72:0/1149127637 >> 172.21.15.72:0/1149127637 conn(0x7fced8075970 msgr2=0x7fced8077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:19.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.265+0000 7fcedf400700 1 -- 172.21.15.72:0/1149127637 shutdown_connections 2024-03-19T06:11:19.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.265+0000 7fcedf400700 1 -- 172.21.15.72:0/1149127637 wait complete. 2024-03-19T06:11:19.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.266+0000 7fcedf400700 1 Processor -- start 2024-03-19T06:11:19.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.266+0000 7fcedf400700 1 -- start start 2024-03-19T06:11:19.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.267+0000 7fcedf400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fced8106840 0x7fced819c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:19.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.267+0000 7fcedf400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced8107a40 0x7fced819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:19.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.267+0000 7fcedf400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced819cc60 con 0x7fced8107a40 2024-03-19T06:11:19.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.267+0000 7fcedf400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced819cda0 con 0x7fced8106840 2024-03-19T06:11:19.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.267+0000 7fced7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced8107a40 0x7fced819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:19.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.267+0000 7fced7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced8107a40 0x7fced819c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53324/0 (socket says 172.21.15.72:53324) 2024-03-19T06:11:19.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.267+0000 7fced7e00700 1 -- 172.21.15.72:0/1761210784 learned_addr learned my addr 172.21.15.72:0/1761210784 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:19.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.267+0000 7fcedca00700 1 --2- 172.21.15.72:0/1761210784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fced8106840 0x7fced819c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:19.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.268+0000 7fced7e00700 1 -- 172.21.15.72:0/1761210784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fced8106840 msgr2=0x7fced819c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:19.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.268+0000 7fced7e00700 1 --2- 172.21.15.72:0/1761210784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fced8106840 0x7fced819c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.268+0000 7fced7e00700 1 -- 172.21.15.72:0/1761210784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0095f0 con 0x7fced8107a40 2024-03-19T06:11:19.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.268+0000 7fcedca00700 1 --2- 172.21.15.72:0/1761210784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fced8106840 0x7fced819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:11:19.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.268+0000 7fced7e00700 1 --2- 172.21.15.72:0/1761210784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced8107a40 0x7fced819c640 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcec400e920 tx=0x7fcec400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:19.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.268+0000 7fced5600700 1 -- 172.21.15.72:0/1761210784 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcec4009790 con 0x7fced8107a40 2024-03-19T06:11:19.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.268+0000 7fced5600700 1 -- 172.21.15.72:0/1761210784 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcec400cba0 con 0x7fced8107a40 2024-03-19T06:11:19.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.268+0000 7fcedf400700 1 -- 172.21.15.72:0/1761210784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced81a1850 con 0x7fced8107a40 2024-03-19T06:11:19.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.268+0000 7fced5600700 1 -- 172.21.15.72:0/1761210784 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcec4018630 con 0x7fced8107a40 2024-03-19T06:11:19.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.269+0000 7fcedf400700 1 -- 172.21.15.72:0/1761210784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced81a1da0 con 0x7fced8107a40 2024-03-19T06:11:19.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.270+0000 7fcedf400700 1 -- 172.21.15.72:0/1761210784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced810f390 con 0x7fced8107a40 2024-03-19T06:11:19.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.271+0000 7fced5600700 1 -- 172.21.15.72:0/1761210784 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fcec400cd10 con 0x7fced8107a40 2024-03-19T06:11:19.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.272+0000 7fced5600700 1 --2- 172.21.15.72:0/1761210784 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcec006dfa0 0x7fcec0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:19.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.272+0000 7fced5600700 1 -- 172.21.15.72:0/1761210784 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcec4014070 con 0x7fced8107a40 2024-03-19T06:11:19.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.272+0000 7fcedca00700 1 --2- 172.21.15.72:0/1761210784 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcec006dfa0 0x7fcec0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:19.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.273+0000 7fcedca00700 1 --2- 172.21.15.72:0/1761210784 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcec006dfa0 0x7fcec0070450 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcecc000c00 tx=0x7fcecc009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:19.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.277+0000 7fced5600700 1 -- 172.21.15.72:0/1761210784 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fcec40531e0 con 0x7fced8107a40 2024-03-19T06:11:19.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.494+0000 7fcedf400700 1 -- 172.21.15.72:0/1761210784 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fced810c390 con 0x7fcec006dfa0 2024-03-19T06:11:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.508+0000 7fced5600700 1 -- 172.21.15.72:0/1761210784 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fced810c390 con 0x7fcec006dfa0 2024-03-19T06:11:19.499 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:11:19.499 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (15m) 37s ago 17m 14.0M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:11:19.499 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (18m) 37s ago 18m 8678k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:11:19.499 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (16m) 11s ago 16m 8196k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:11:19.499 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (2m) 37s ago 18m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:11:19.499 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (2m) 11s ago 16m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (15m) 37s ago 17m 71.5M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (10m) 37s ago 10m 16.5M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (10m) 37s ago 10m 126M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (10m) 11s ago 10m 16.7M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (10m) 11s ago 10m 142M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (6m) 37s ago 19m 504M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (4m) 11s ago 16m 451M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (4m) 37s ago 20m 50.4M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (3m) 11s ago 16m 38.7M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (17m) 37s ago 17m 8196k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (16m) 11s ago 16m 7864k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (106s) 37s ago 15m 87.0M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (75s) 37s ago 14m 87.1M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:11:19.500 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (45s) 37s ago 13m 11.2M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:11:19.501 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (16s) 11s ago 13m 11.1M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:11:19.501 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (12m) 11s ago 12m 231M 2241M 18.2.0 dc2bc1663786 d7d3add455a4 2024-03-19T06:11:19.501 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (12m) 11s ago 12m 193M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:11:19.501 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (4m) 37s ago 16m 67.0M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:11:19.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.511+0000 7fcedf400700 1 -- 172.21.15.72:0/1761210784 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcec006dfa0 msgr2=0x7fcec0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:19.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.511+0000 7fcedf400700 1 --2- 172.21.15.72:0/1761210784 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcec006dfa0 0x7fcec0070450 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcecc000c00 tx=0x7fcecc009f70 comp rx=0 tx=0).stop 2024-03-19T06:11:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.511+0000 7fcedf400700 1 -- 172.21.15.72:0/1761210784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced8107a40 msgr2=0x7fced819c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.511+0000 7fcedf400700 1 --2- 172.21.15.72:0/1761210784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced8107a40 0x7fced819c640 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcec400e920 tx=0x7fcec400ece0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.511+0000 7fcedf400700 1 -- 172.21.15.72:0/1761210784 shutdown_connections 2024-03-19T06:11:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.511+0000 7fcedf400700 1 --2- 172.21.15.72:0/1761210784 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fcec006dfa0 0x7fcec0070450 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.511+0000 7fcedf400700 1 --2- 172.21.15.72:0/1761210784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fced8106840 0x7fced819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.511+0000 7fcedf400700 1 --2- 172.21.15.72:0/1761210784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced8107a40 0x7fced819c640 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.511+0000 7fcedf400700 1 -- 172.21.15.72:0/1761210784 >> 172.21.15.72:0/1761210784 conn(0x7fced8075970 msgr2=0x7fced810ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.512+0000 7fcedf400700 1 -- 172.21.15.72:0/1761210784 shutdown_connections 2024-03-19T06:11:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.512+0000 7fcedf400700 1 -- 172.21.15.72:0/1761210784 wait complete. 2024-03-19T06:11:19.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.666+0000 7fda18800700 1 -- 172.21.15.72:0/3417586312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda10103680 msgr2=0x7fda10105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.666+0000 7fda18800700 1 --2- 172.21.15.72:0/3417586312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda10103680 0x7fda10105a60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fda00009910 tx=0x7fda00009c20 comp rx=0 tx=0).stop 2024-03-19T06:11:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.666+0000 7fda18800700 1 -- 172.21.15.72:0/3417586312 shutdown_connections 2024-03-19T06:11:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.666+0000 7fda18800700 1 --2- 172.21.15.72:0/3417586312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda10103680 0x7fda10105a60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.666+0000 7fda18800700 1 --2- 172.21.15.72:0/3417586312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda10100d60 0x7fda10103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.666+0000 7fda18800700 1 -- 172.21.15.72:0/3417586312 >> 172.21.15.72:0/3417586312 conn(0x7fda100fa780 msgr2=0x7fda100fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.666+0000 7fda18800700 1 -- 172.21.15.72:0/3417586312 shutdown_connections 2024-03-19T06:11:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.666+0000 7fda18800700 1 -- 172.21.15.72:0/3417586312 wait complete. 2024-03-19T06:11:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.667+0000 7fda18800700 1 Processor -- start 2024-03-19T06:11:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.667+0000 7fda18800700 1 -- start start 2024-03-19T06:11:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.668+0000 7fda18800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda10100d60 0x7fda10197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.668+0000 7fda18800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda10103680 0x7fda10198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.668+0000 7fda18800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda10198850 con 0x7fda10103680 2024-03-19T06:11:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.668+0000 7fda18800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1019d260 con 0x7fda10100d60 2024-03-19T06:11:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.668+0000 7fda15400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda10103680 0x7fda10198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.668+0000 7fda15400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda10103680 0x7fda10198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53352/0 (socket says 172.21.15.72:53352) 2024-03-19T06:11:19.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.668+0000 7fda15400700 1 -- 172.21.15.72:0/3929080847 learned_addr learned my addr 172.21.15.72:0/3929080847 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.668+0000 7fda15e00700 1 --2- 172.21.15.72:0/3929080847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda10100d60 0x7fda10197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.668+0000 7fda15400700 1 -- 172.21.15.72:0/3929080847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda10100d60 msgr2=0x7fda10197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.668+0000 7fda15400700 1 --2- 172.21.15.72:0/3929080847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda10100d60 0x7fda10197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.668+0000 7fda15400700 1 -- 172.21.15.72:0/3929080847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda000095f0 con 0x7fda10103680 2024-03-19T06:11:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.669+0000 7fda15400700 1 --2- 172.21.15.72:0/3929080847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda10103680 0x7fda10198230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda00005b40 tx=0x7fda0000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.669+0000 7fda0aa00700 1 -- 172.21.15.72:0/3929080847 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0001d070 con 0x7fda10103680 2024-03-19T06:11:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.669+0000 7fda0aa00700 1 -- 172.21.15.72:0/3929080847 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda0000f460 con 0x7fda10103680 2024-03-19T06:11:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.669+0000 7fda0aa00700 1 -- 172.21.15.72:0/3929080847 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda00021640 con 0x7fda10103680 2024-03-19T06:11:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.669+0000 7fda18800700 1 -- 172.21.15.72:0/3929080847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1019d400 con 0x7fda10103680 2024-03-19T06:11:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.669+0000 7fda18800700 1 -- 172.21.15.72:0/3929080847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1019d8c0 con 0x7fda10103680 2024-03-19T06:11:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.670+0000 7fda18800700 1 -- 172.21.15.72:0/3929080847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda100fc340 con 0x7fda10103680 2024-03-19T06:11:19.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.671+0000 7fda0aa00700 1 -- 172.21.15.72:0/3929080847 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fda0000fa90 con 0x7fda10103680 2024-03-19T06:11:19.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.672+0000 7fda0aa00700 1 --2- 172.21.15.72:0/3929080847 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd9f806dfa0 0x7fd9f8070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:19.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.672+0000 7fda0aa00700 1 -- 172.21.15.72:0/3929080847 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fda0008ef90 con 0x7fda10103680 2024-03-19T06:11:19.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.672+0000 7fda15e00700 1 --2- 172.21.15.72:0/3929080847 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd9f806dfa0 0x7fd9f8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:19.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.673+0000 7fda15e00700 1 --2- 172.21.15.72:0/3929080847 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd9f806dfa0 0x7fd9f8070450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fda04005950 tx=0x7fda040058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:19.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.677+0000 7fda0aa00700 1 -- 172.21.15.72:0/3929080847 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fda00058490 con 0x7fda10103680 2024-03-19T06:11:19.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:19 smithi072 ceph-mon[78545]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:19.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:19 smithi072 ceph-mon[78545]: pgmap v140: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:19.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:19 smithi072 ceph-mon[78545]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:19.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:19 smithi072 ceph-mon[78545]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:19.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.980+0000 7fda18800700 1 -- 172.21.15.72:0/3929080847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fda1002cc30 con 0x7fda10103680 2024-03-19T06:11:19.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.981+0000 7fda0aa00700 1 -- 172.21.15.72:0/3929080847 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fda0005bb50 con 0x7fda10103680 2024-03-19T06:11:19.971 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:11:19.971 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 4 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:11:19.972 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6, 2024-03-19T06:11:19.973 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 8 2024-03-19T06:11:19.973 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:11:19.973 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:11:19.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.984+0000 7fda18800700 1 -- 172.21.15.72:0/3929080847 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd9f806dfa0 msgr2=0x7fd9f8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:19.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.984+0000 7fda18800700 1 --2- 172.21.15.72:0/3929080847 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd9f806dfa0 0x7fd9f8070450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fda04005950 tx=0x7fda040058e0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.984+0000 7fda18800700 1 -- 172.21.15.72:0/3929080847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda10103680 msgr2=0x7fda10198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:19.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.984+0000 7fda18800700 1 --2- 172.21.15.72:0/3929080847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda10103680 0x7fda10198230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda00005b40 tx=0x7fda0000be20 comp rx=0 tx=0).stop 2024-03-19T06:11:19.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.984+0000 7fda18800700 1 -- 172.21.15.72:0/3929080847 shutdown_connections 2024-03-19T06:11:19.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.984+0000 7fda18800700 1 --2- 172.21.15.72:0/3929080847 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd9f806dfa0 0x7fd9f8070450 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.984+0000 7fda18800700 1 --2- 172.21.15.72:0/3929080847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda10100d60 0x7fda10197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.984+0000 7fda18800700 1 --2- 172.21.15.72:0/3929080847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda10103680 0x7fda10198230 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:19.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.984+0000 7fda18800700 1 -- 172.21.15.72:0/3929080847 >> 172.21.15.72:0/3929080847 conn(0x7fda100fa780 msgr2=0x7fda100ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:19.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.985+0000 7fda18800700 1 -- 172.21.15.72:0/3929080847 shutdown_connections 2024-03-19T06:11:19.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:19.985+0000 7fda18800700 1 -- 172.21.15.72:0/3929080847 wait complete. 2024-03-19T06:11:20.033 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:19 smithi172 ceph-mon[66682]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:20.033 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:19 smithi172 ceph-mon[66682]: pgmap v140: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:20.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:19 smithi172 ceph-mon[66682]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:20.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:19 smithi172 ceph-mon[66682]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.132+0000 7f251be00700 1 -- 172.21.15.72:0/1009395340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2514101440 msgr2=0x7f2514101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.132+0000 7f251be00700 1 --2- 172.21.15.72:0/1009395340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2514101440 0x7f2514101890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2500009910 tx=0x7f2500009c20 comp rx=0 tx=0).stop 2024-03-19T06:11:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.132+0000 7f251be00700 1 -- 172.21.15.72:0/1009395340 shutdown_connections 2024-03-19T06:11:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.132+0000 7f251be00700 1 --2- 172.21.15.72:0/1009395340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2514101440 0x7f2514101890 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.132+0000 7f251be00700 1 --2- 172.21.15.72:0/1009395340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2514100240 0x7f2514100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.132+0000 7f251be00700 1 -- 172.21.15.72:0/1009395340 >> 172.21.15.72:0/1009395340 conn(0x7f25140fb7f0 msgr2=0x7f25140fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.133+0000 7f251be00700 1 -- 172.21.15.72:0/1009395340 shutdown_connections 2024-03-19T06:11:20.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.133+0000 7f251be00700 1 -- 172.21.15.72:0/1009395340 wait complete. 2024-03-19T06:11:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.134+0000 7f251be00700 1 Processor -- start 2024-03-19T06:11:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.134+0000 7f251be00700 1 -- start start 2024-03-19T06:11:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.134+0000 7f251be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2514100240 0x7f2514074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.134+0000 7f251be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2514101440 0x7f2514073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.134+0000 7f251be00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2514073680 con 0x7f2514101440 2024-03-19T06:11:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.134+0000 7f251be00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25140737c0 con 0x7f2514100240 2024-03-19T06:11:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.134+0000 7f2518a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2514101440 0x7f2514073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.134+0000 7f2518a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2514101440 0x7f2514073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53376/0 (socket says 172.21.15.72:53376) 2024-03-19T06:11:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.134+0000 7f2518a00700 1 -- 172.21.15.72:0/1766398043 learned_addr learned my addr 172.21.15.72:0/1766398043 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.135+0000 7f2519400700 1 --2- 172.21.15.72:0/1766398043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2514100240 0x7f2514074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.135+0000 7f2518a00700 1 -- 172.21.15.72:0/1766398043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2514100240 msgr2=0x7f2514074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.135+0000 7f2518a00700 1 --2- 172.21.15.72:0/1766398043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2514100240 0x7f2514074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.135+0000 7f2518a00700 1 -- 172.21.15.72:0/1766398043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25000095f0 con 0x7f2514101440 2024-03-19T06:11:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.135+0000 7f2519400700 1 --2- 172.21.15.72:0/1766398043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2514100240 0x7f2514074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:11:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.135+0000 7f2518a00700 1 --2- 172.21.15.72:0/1766398043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2514101440 0x7f2514073140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2500005b40 tx=0x7f250000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.135+0000 7f2512000700 1 -- 172.21.15.72:0/1766398043 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f250001d070 con 0x7f2514101440 2024-03-19T06:11:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.136+0000 7f251be00700 1 -- 172.21.15.72:0/1766398043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2514073a40 con 0x7f2514101440 2024-03-19T06:11:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.136+0000 7f2512000700 1 -- 172.21.15.72:0/1766398043 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2500022470 con 0x7f2514101440 2024-03-19T06:11:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.136+0000 7f2512000700 1 -- 172.21.15.72:0/1766398043 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f250000f690 con 0x7f2514101440 2024-03-19T06:11:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.136+0000 7f251be00700 1 -- 172.21.15.72:0/1766398043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2514073f30 con 0x7f2514101440 2024-03-19T06:11:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.137+0000 7f251be00700 1 -- 172.21.15.72:0/1766398043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2514108db0 con 0x7f2514101440 2024-03-19T06:11:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.138+0000 7f2512000700 1 -- 172.21.15.72:0/1766398043 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f25000225e0 con 0x7f2514101440 2024-03-19T06:11:20.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.139+0000 7f2512000700 1 --2- 172.21.15.72:0/1766398043 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f24fc06dfa0 0x7f24fc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:20.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.139+0000 7f2512000700 1 -- 172.21.15.72:0/1766398043 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f250008f4a0 con 0x7f2514101440 2024-03-19T06:11:20.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.139+0000 7f2519400700 1 --2- 172.21.15.72:0/1766398043 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f24fc06dfa0 0x7f24fc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:20.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.140+0000 7f2519400700 1 --2- 172.21.15.72:0/1766398043 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f24fc06dfa0 0x7f24fc070450 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2508005fd0 tx=0x7f2508005de0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:20.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.143+0000 7f2512000700 1 -- 172.21.15.72:0/1766398043 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f250005c570 con 0x7f2514101440 2024-03-19T06:11:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.425+0000 7f251be00700 1 -- 172.21.15.72:0/1766398043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f251419dfb0 con 0x7f2514101440 2024-03-19T06:11:20.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.426+0000 7f2512000700 1 -- 172.21.15.72:0/1766398043 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1852 (secure 0 0 0) 0x7f250005c100 con 0x7f2514101440 2024-03-19T06:11:20.417 INFO:teuthology.orchestra.run.smithi072.stdout:e17 2024-03-19T06:11:20.417 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:11:20.417 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:11:20.417 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:11:20.417 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:11:20.417 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:11:20.417 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:11:20.417 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 17 2024-03-19T06:11:20.417 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:11:20.417 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:10:32.464152+0000 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:11:20.418 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:11:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:11:20.420 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:11:20.420 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:11:20.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.428+0000 7f251be00700 1 -- 172.21.15.72:0/1766398043 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f24fc06dfa0 msgr2=0x7f24fc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.428+0000 7f251be00700 1 --2- 172.21.15.72:0/1766398043 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f24fc06dfa0 0x7f24fc070450 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2508005fd0 tx=0x7f2508005de0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.428+0000 7f251be00700 1 -- 172.21.15.72:0/1766398043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2514101440 msgr2=0x7f2514073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.428+0000 7f251be00700 1 --2- 172.21.15.72:0/1766398043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2514101440 0x7f2514073140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2500005b40 tx=0x7f250000be20 comp rx=0 tx=0).stop 2024-03-19T06:11:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.428+0000 7f251be00700 1 -- 172.21.15.72:0/1766398043 shutdown_connections 2024-03-19T06:11:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.428+0000 7f251be00700 1 --2- 172.21.15.72:0/1766398043 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f24fc06dfa0 0x7f24fc070450 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.428+0000 7f251be00700 1 --2- 172.21.15.72:0/1766398043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2514100240 0x7f2514074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.428+0000 7f251be00700 1 --2- 172.21.15.72:0/1766398043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2514101440 0x7f2514073140 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.428+0000 7f251be00700 1 -- 172.21.15.72:0/1766398043 >> 172.21.15.72:0/1766398043 conn(0x7f25140fb7f0 msgr2=0x7f2514104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.429+0000 7f251be00700 1 -- 172.21.15.72:0/1766398043 shutdown_connections 2024-03-19T06:11:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.429+0000 7f251be00700 1 -- 172.21.15.72:0/1766398043 wait complete. 2024-03-19T06:11:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2024-03-19T06:11:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.584+0000 7f82c7600700 1 -- 172.21.15.72:0/1193748218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0073750 msgr2=0x7f82c0073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.584+0000 7f82c7600700 1 --2- 172.21.15.72:0/1193748218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0073750 0x7f82c0073bc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009870 tx=0x7f82a8009b80 comp rx=0 tx=0).stop 2024-03-19T06:11:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.584+0000 7f82c7600700 1 -- 172.21.15.72:0/1193748218 shutdown_connections 2024-03-19T06:11:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.584+0000 7f82c7600700 1 --2- 172.21.15.72:0/1193748218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0073750 0x7f82c0073bc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.584+0000 7f82c7600700 1 --2- 172.21.15.72:0/1193748218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c0074d20 0x7f82c0073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.584+0000 7f82c7600700 1 -- 172.21.15.72:0/1193748218 >> 172.21.15.72:0/1193748218 conn(0x7f82c00fb7f0 msgr2=0x7f82c00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.585+0000 7f82c7600700 1 -- 172.21.15.72:0/1193748218 shutdown_connections 2024-03-19T06:11:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.585+0000 7f82c7600700 1 -- 172.21.15.72:0/1193748218 wait complete. 2024-03-19T06:11:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.586+0000 7f82c7600700 1 Processor -- start 2024-03-19T06:11:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.586+0000 7f82c7600700 1 -- start start 2024-03-19T06:11:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.586+0000 7f82c7600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c0073750 0x7f82c0197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.586+0000 7f82c7600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0074d20 0x7f82c01981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.586+0000 7f82c7600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c01987b0 con 0x7f82c0074d20 2024-03-19T06:11:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.586+0000 7f82c7600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c0198920 con 0x7f82c0073750 2024-03-19T06:11:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.587+0000 7f82b7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0074d20 0x7f82c01981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.587+0000 7f82b7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0074d20 0x7f82c01981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53394/0 (socket says 172.21.15.72:53394) 2024-03-19T06:11:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.587+0000 7f82b7e00700 1 -- 172.21.15.72:0/222501113 learned_addr learned my addr 172.21.15.72:0/222501113 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.587+0000 7f82c4c00700 1 --2- 172.21.15.72:0/222501113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c0073750 0x7f82c0197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.587+0000 7f82b7e00700 1 -- 172.21.15.72:0/222501113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c0073750 msgr2=0x7f82c0197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.587+0000 7f82b7e00700 1 --2- 172.21.15.72:0/222501113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c0073750 0x7f82c0197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.587+0000 7f82b7e00700 1 -- 172.21.15.72:0/222501113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8009520 con 0x7f82c0074d20 2024-03-19T06:11:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.587+0000 7f82b7e00700 1 --2- 172.21.15.72:0/222501113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0074d20 0x7f82c01981b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009f50 tx=0x7f82a800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.588+0000 7f82be000700 1 -- 172.21.15.72:0/222501113 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82a801c070 con 0x7f82c0074d20 2024-03-19T06:11:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.588+0000 7f82be000700 1 -- 172.21.15.72:0/222501113 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f82a800be80 con 0x7f82c0074d20 2024-03-19T06:11:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.588+0000 7f82c7600700 1 -- 172.21.15.72:0/222501113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c019d350 con 0x7f82c0074d20 2024-03-19T06:11:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.588+0000 7f82be000700 1 -- 172.21.15.72:0/222501113 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82a80173f0 con 0x7f82c0074d20 2024-03-19T06:11:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.588+0000 7f82c7600700 1 -- 172.21.15.72:0/222501113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c019d840 con 0x7f82c0074d20 2024-03-19T06:11:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.589+0000 7f82c7600700 1 -- 172.21.15.72:0/222501113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c010af80 con 0x7f82c0074d20 2024-03-19T06:11:20.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.590+0000 7f82be000700 1 -- 172.21.15.72:0/222501113 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f82a8020070 con 0x7f82c0074d20 2024-03-19T06:11:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.591+0000 7f82be000700 1 --2- 172.21.15.72:0/222501113 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f82a406dfa0 0x7f82a4070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.591+0000 7f82be000700 1 -- 172.21.15.72:0/222501113 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f82a808efb0 con 0x7f82c0074d20 2024-03-19T06:11:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.591+0000 7f82c4c00700 1 --2- 172.21.15.72:0/222501113 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f82a406dfa0 0x7f82a4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.592+0000 7f82c4c00700 1 --2- 172.21.15.72:0/222501113 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f82a406dfa0 0x7f82a4070450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82c0198b50 tx=0x7f82b0009310 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:20.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.596+0000 7f82be000700 1 -- 172.21.15.72:0/222501113 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f82a80584d0 con 0x7f82c0074d20 2024-03-19T06:11:20.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:20 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3929080847' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:20.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:20 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1766398043' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:11:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.839+0000 7f82c7600700 1 -- 172.21.15.72:0/222501113 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82c01077a0 con 0x7f82a406dfa0 2024-03-19T06:11:20.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.841+0000 7f82be000700 1 -- 172.21.15.72:0/222501113 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f82c01077a0 con 0x7f82a406dfa0 2024-03-19T06:11:20.832 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:11:20.832 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:11:20.832 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:11:20.832 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:11:20.832 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:11:20.833 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:11:20.833 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:11:20.833 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:11:20.833 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:11:20.833 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "10/23 daemons upgraded", 2024-03-19T06:11:20.834 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-03-19T06:11:20.834 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:11:20.834 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:11:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.843+0000 7f82c7600700 1 -- 172.21.15.72:0/222501113 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f82a406dfa0 msgr2=0x7f82a4070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.843+0000 7f82c7600700 1 --2- 172.21.15.72:0/222501113 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f82a406dfa0 0x7f82a4070450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82c0198b50 tx=0x7f82b0009310 comp rx=0 tx=0).stop 2024-03-19T06:11:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.843+0000 7f82c7600700 1 -- 172.21.15.72:0/222501113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0074d20 msgr2=0x7f82c01981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.843+0000 7f82c7600700 1 --2- 172.21.15.72:0/222501113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0074d20 0x7f82c01981b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009f50 tx=0x7f82a800f740 comp rx=0 tx=0).stop 2024-03-19T06:11:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.844+0000 7f82c7600700 1 -- 172.21.15.72:0/222501113 shutdown_connections 2024-03-19T06:11:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.844+0000 7f82c7600700 1 --2- 172.21.15.72:0/222501113 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f82a406dfa0 0x7f82a4070450 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.844+0000 7f82c7600700 1 --2- 172.21.15.72:0/222501113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82c0073750 0x7f82c0197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.844+0000 7f82c7600700 1 --2- 172.21.15.72:0/222501113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c0074d20 0x7f82c01981b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.844+0000 7f82c7600700 1 -- 172.21.15.72:0/222501113 >> 172.21.15.72:0/222501113 conn(0x7f82c00fb7f0 msgr2=0x7f82c0106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.844+0000 7f82c7600700 1 -- 172.21.15.72:0/222501113 shutdown_connections 2024-03-19T06:11:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:20.844+0000 7f82c7600700 1 -- 172.21.15.72:0/222501113 wait complete. 2024-03-19T06:11:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.000+0000 7f47db600700 1 -- 172.21.15.72:0/4068137233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4106840 msgr2=0x7f47d4106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.000+0000 7f47db600700 1 --2- 172.21.15.72:0/4068137233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4106840 0x7f47d4106c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f47c400b0a0 tx=0x7f47c400b3b0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.000+0000 7f47db600700 1 -- 172.21.15.72:0/4068137233 shutdown_connections 2024-03-19T06:11:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.000+0000 7f47db600700 1 --2- 172.21.15.72:0/4068137233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47d4107a40 0x7f47d4107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.000+0000 7f47db600700 1 --2- 172.21.15.72:0/4068137233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4106840 0x7f47d4106c50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.000+0000 7f47db600700 1 -- 172.21.15.72:0/4068137233 >> 172.21.15.72:0/4068137233 conn(0x7f47d4075970 msgr2=0x7f47d4077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.000+0000 7f47db600700 1 -- 172.21.15.72:0/4068137233 shutdown_connections 2024-03-19T06:11:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.001+0000 7f47db600700 1 -- 172.21.15.72:0/4068137233 wait complete. 2024-03-19T06:11:20.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.001+0000 7f47db600700 1 Processor -- start 2024-03-19T06:11:20.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.002+0000 7f47db600700 1 -- start start 2024-03-19T06:11:20.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.002+0000 7f47db600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4106840 0x7f47d419c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:20.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.002+0000 7f47db600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47d4107a40 0x7f47d419c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:20.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.002+0000 7f47db600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d419ce60 con 0x7f47d4106840 2024-03-19T06:11:20.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.002+0000 7f47db600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d419cfa0 con 0x7f47d4107a40 2024-03-19T06:11:20.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.002+0000 7f47d8c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4106840 0x7f47d419c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:20.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.002+0000 7f47d8c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4106840 0x7f47d419c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53424/0 (socket says 172.21.15.72:53424) 2024-03-19T06:11:20.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.002+0000 7f47d8c00700 1 -- 172.21.15.72:0/731209873 learned_addr learned my addr 172.21.15.72:0/731209873 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:20.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.003+0000 7f47cbe00700 1 --2- 172.21.15.72:0/731209873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47d4107a40 0x7f47d419c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:20.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.003+0000 7f47d8c00700 1 -- 172.21.15.72:0/731209873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47d4107a40 msgr2=0x7f47d419c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:20.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.003+0000 7f47d8c00700 1 --2- 172.21.15.72:0/731209873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47d4107a40 0x7f47d419c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:20.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.003+0000 7f47d8c00700 1 -- 172.21.15.72:0/731209873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c4009d00 con 0x7f47d4106840 2024-03-19T06:11:20.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.003+0000 7f47d8c00700 1 --2- 172.21.15.72:0/731209873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4106840 0x7f47d419c300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f47c400b070 tx=0x7f47c4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:20.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.003+0000 7f47d2000700 1 -- 172.21.15.72:0/731209873 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c400e040 con 0x7f47d4106840 2024-03-19T06:11:20.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.003+0000 7f47d2000700 1 -- 172.21.15.72:0/731209873 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47c400ce60 con 0x7f47d4106840 2024-03-19T06:11:20.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.003+0000 7f47db600700 1 -- 172.21.15.72:0/731209873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d41a19f0 con 0x7f47d4106840 2024-03-19T06:11:20.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.003+0000 7f47d2000700 1 -- 172.21.15.72:0/731209873 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c401da90 con 0x7f47d4106840 2024-03-19T06:11:20.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.004+0000 7f47db600700 1 -- 172.21.15.72:0/731209873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d41a1ee0 con 0x7f47d4106840 2024-03-19T06:11:20.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.005+0000 7f47db600700 1 -- 172.21.15.72:0/731209873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d410f410 con 0x7f47d4106840 2024-03-19T06:11:20.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.005+0000 7f47d2000700 1 -- 172.21.15.72:0/731209873 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f47c4004250 con 0x7f47d4106840 2024-03-19T06:11:20.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.006+0000 7f47d2000700 1 --2- 172.21.15.72:0/731209873 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f47b806dfa0 0x7f47b8070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:20.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.006+0000 7f47d2000700 1 -- 172.21.15.72:0/731209873 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f47c408f960 con 0x7f47d4106840 2024-03-19T06:11:20.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.007+0000 7f47cbe00700 1 --2- 172.21.15.72:0/731209873 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f47b806dfa0 0x7f47b8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:20.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.007+0000 7f47cbe00700 1 --2- 172.21.15.72:0/731209873 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f47b806dfa0 0x7f47b8070450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f47bc006fd0 tx=0x7f47bc008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.011+0000 7f47d2000700 1 -- 172.21.15.72:0/731209873 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f47c405c9b0 con 0x7f47d4106840 2024-03-19T06:11:21.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:20 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3929080847' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:21.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:20 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1766398043' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:11:21.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.304+0000 7f47db600700 1 -- 172.21.15.72:0/731209873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f47d410f5d0 con 0x7f47d4106840 2024-03-19T06:11:21.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.306+0000 7f47d2000700 1 -- 172.21.15.72:0/731209873 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f47c405c540 con 0x7f47d4106840 2024-03-19T06:11:21.296 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:11:21.296 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:11:21.296 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:11:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.309+0000 7f47db600700 1 -- 172.21.15.72:0/731209873 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f47b806dfa0 msgr2=0x7f47b8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.309+0000 7f47db600700 1 --2- 172.21.15.72:0/731209873 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f47b806dfa0 0x7f47b8070450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f47bc006fd0 tx=0x7f47bc008040 comp rx=0 tx=0).stop 2024-03-19T06:11:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.309+0000 7f47db600700 1 -- 172.21.15.72:0/731209873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4106840 msgr2=0x7f47d419c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.309+0000 7f47db600700 1 --2- 172.21.15.72:0/731209873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4106840 0x7f47d419c300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f47c400b070 tx=0x7f47c4003ce0 comp rx=0 tx=0).stop 2024-03-19T06:11:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.309+0000 7f47db600700 1 -- 172.21.15.72:0/731209873 shutdown_connections 2024-03-19T06:11:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.309+0000 7f47db600700 1 --2- 172.21.15.72:0/731209873 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f47b806dfa0 0x7f47b8070450 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.309+0000 7f47db600700 1 --2- 172.21.15.72:0/731209873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4106840 0x7f47d419c300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.309+0000 7f47db600700 1 --2- 172.21.15.72:0/731209873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47d4107a40 0x7f47d419c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.309+0000 7f47db600700 1 -- 172.21.15.72:0/731209873 >> 172.21.15.72:0/731209873 conn(0x7f47d4075970 msgr2=0x7f47d410ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.310+0000 7f47db600700 1 -- 172.21.15.72:0/731209873 shutdown_connections 2024-03-19T06:11:21.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:21.310+0000 7f47db600700 1 -- 172.21.15.72:0/731209873 wait complete. 2024-03-19T06:11:22.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:21 smithi072 ceph-mon[78545]: pgmap v141: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:22.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:21 smithi072 ceph-mon[78545]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:22.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:21 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/731209873' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:11:22.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:21 smithi172 ceph-mon[66682]: pgmap v141: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:22.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:21 smithi172 ceph-mon[66682]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:22.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:21 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/731209873' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:11:24.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:23 smithi072 ceph-mon[78545]: pgmap v142: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:24.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:23 smithi172 ceph-mon[66682]: pgmap v142: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:26.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:25 smithi072 ceph-mon[78545]: pgmap v143: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:26.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:26.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:11:26.076 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:26.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:25 smithi172 ceph-mon[66682]: pgmap v143: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:26.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:26.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:11:26.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:28.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:27 smithi172 ceph-mon[66682]: pgmap v144: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:28.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:27 smithi072 ceph-mon[78545]: pgmap v144: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:30.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:29 smithi172 ceph-mon[66682]: pgmap v145: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:30.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:29 smithi072 ceph-mon[78545]: pgmap v145: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:31.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:30 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-19T06:11:31.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:30 smithi172 ceph-mon[66682]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-19T06:11:31.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:30 smithi172 ceph-mon[66682]: Upgrade: osd.4 is safe to restart 2024-03-19T06:11:31.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:30 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-19T06:11:31.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:30 smithi072 ceph-mon[78545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-19T06:11:31.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:30 smithi072 ceph-mon[78545]: Upgrade: osd.4 is safe to restart 2024-03-19T06:11:32.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:31 smithi172 ceph-mon[66682]: pgmap v146: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:32.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:31 smithi072 ceph-mon[78545]: pgmap v146: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:33.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:33 smithi172 ceph-mon[66682]: Upgrade: Updating osd.4 2024-03-19T06:11:33.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:33 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:33.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:33 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-19T06:11:33.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:33 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:11:33.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:33 smithi172 ceph-mon[66682]: Deploying daemon osd.4 on smithi172 2024-03-19T06:11:33.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:33 smithi072 ceph-mon[78545]: Upgrade: Updating osd.4 2024-03-19T06:11:33.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:33 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:33.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:33 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-19T06:11:33.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:33 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:11:33.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:33 smithi072 ceph-mon[78545]: Deploying daemon osd.4 on smithi172 2024-03-19T06:11:34.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:34 smithi172 ceph-mon[66682]: pgmap v147: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:34.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:34 smithi072 ceph-mon[78545]: pgmap v147: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:36 smithi172 ceph-mon[66682]: pgmap v148: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:36.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:36 smithi072 ceph-mon[78545]: pgmap v148: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:37.601 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:37 smithi172 systemd[1]: Stopping Ceph osd.4 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:11:37.903 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:37 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[46338]: 2024-03-19T06:11:37.610+0000 7f06e7a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:11:37.903 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:37 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[46338]: 2024-03-19T06:11:37.610+0000 7f06e7a00700 -1 osd.4 68 *** Got signal Terminated *** 2024-03-19T06:11:37.903 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:37 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[46338]: 2024-03-19T06:11:37.610+0000 7f06e7a00700 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-19T06:11:38.804 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:38 smithi172 ceph-mon[66682]: pgmap v149: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:38.805 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:38 smithi172 ceph-mon[66682]: osd.4 marked itself down and dead 2024-03-19T06:11:38.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:38 smithi072 ceph-mon[78545]: pgmap v149: 65 pgs: 65 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:38.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:38 smithi072 ceph-mon[78545]: osd.4 marked itself down and dead 2024-03-19T06:11:39.152 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:38 smithi172 podman[74292]: 2024-03-19 06:11:38.999267242 +0000 UTC m=+1.532942534 container died d7d3add455a4f226c4ddc80dd7cfc73b4751ea7ae88b39641d8bee9a99e3eb72 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:11:39.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:39 smithi072 ceph-mon[78545]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-19T06:11:39.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:39 smithi072 ceph-mon[78545]: osdmap e69: 6 total, 5 up, 6 in 2024-03-19T06:11:39.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:39 smithi172 ceph-mon[66682]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-19T06:11:39.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:39 smithi172 ceph-mon[66682]: osdmap e69: 6 total, 5 up, 6 in 2024-03-19T06:11:39.903 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:39 smithi172 podman[74292]: 2024-03-19 06:11:39.507683525 +0000 UTC m=+2.041358821 container cleanup d7d3add455a4f226c4ddc80dd7cfc73b4751ea7ae88b39641d8bee9a99e3eb72 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-19T06:11:39.903 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:39 smithi172 bash[74292]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4 2024-03-19T06:11:39.904 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:39 smithi172 podman[74312]: 2024-03-19 06:11:39.700217075 +0000 UTC m=+0.685680151 container remove d7d3add455a4f226c4ddc80dd7cfc73b4751ea7ae88b39641d8bee9a99e3eb72 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-03-19T06:11:40.778 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:40 smithi172 ceph-mon[66682]: pgmap v151: 65 pgs: 6 stale+active+clean, 59 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:40.778 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:40 smithi172 ceph-mon[66682]: osdmap e70: 6 total, 5 up, 6 in 2024-03-19T06:11:40.778 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:40.778 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:11:40.779 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:40 smithi172 podman[74401]: 2024-03-19 06:11:40.360677164 +0000 UTC m=+0.034912860 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:11:40.779 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:40 smithi172 podman[74401]: 2024-03-19 06:11:40.50956185 +0000 UTC m=+0.183797567 container create b7cb165bb00d297ca0fd358a83e4148fe91420f91e42838d9b4399c58fd1c9e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-03-19T06:11:40.803 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:40 smithi072 ceph-mon[78545]: pgmap v151: 65 pgs: 6 stale+active+clean, 59 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:40.803 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:40 smithi072 ceph-mon[78545]: osdmap e70: 6 total, 5 up, 6 in 2024-03-19T06:11:40.803 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:40.803 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:11:41.152 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:40 smithi172 podman[74401]: 2024-03-19 06:11:40.788305708 +0000 UTC m=+0.462541470 container init b7cb165bb00d297ca0fd358a83e4148fe91420f91e42838d9b4399c58fd1c9e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-19T06:11:41.152 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:40 smithi172 podman[74401]: 2024-03-19 06:11:40.798669726 +0000 UTC m=+0.472905454 container start b7cb165bb00d297ca0fd358a83e4148fe91420f91e42838d9b4399c58fd1c9e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222) 2024-03-19T06:11:41.153 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:40 smithi172 podman[74401]: 2024-03-19 06:11:40.878714452 +0000 UTC m=+0.552950236 container attach b7cb165bb00d297ca0fd358a83e4148fe91420f91e42838d9b4399c58fd1c9e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:11:41.498 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:41 smithi172 podman[74401]: 2024-03-19 06:11:41.2324962 +0000 UTC m=+0.906731930 container died b7cb165bb00d297ca0fd358a83e4148fe91420f91e42838d9b4399c58fd1c9e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-19T06:11:41.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:41 smithi072 ceph-mon[78545]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-03-19T06:11:41.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:41 smithi172 ceph-mon[66682]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-03-19T06:11:42.152 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:41 smithi172 podman[74426]: 2024-03-19 06:11:41.890439626 +0000 UTC m=+0.639276582 container remove b7cb165bb00d297ca0fd358a83e4148fe91420f91e42838d9b4399c58fd1c9e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.build-date=20240222) 2024-03-19T06:11:42.152 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:41 smithi172 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.4.service: Deactivated successfully. 2024-03-19T06:11:42.152 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:41 smithi172 systemd[1]: Stopped Ceph osd.4 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:11:42.152 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:41 smithi172 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.4.service: Consumed 1min 44.927s CPU time. 2024-03-19T06:11:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:42 smithi072 ceph-mon[78545]: pgmap v153: 65 pgs: 8 peering, 4 stale+active+clean, 53 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:42.635 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:42 smithi172 systemd[1]: Starting Ceph osd.4 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:11:42.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:42 smithi172 ceph-mon[66682]: pgmap v153: 65 pgs: 8 peering, 4 stale+active+clean, 53 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:42.903 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:42 smithi172 podman[74525]: 2024-03-19 06:11:42.55069686 +0000 UTC m=+0.032603712 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:11:42.903 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:42 smithi172 podman[74525]: 2024-03-19 06:11:42.666240299 +0000 UTC m=+0.148147174 container create 8729e26df4c259a1a06e6e7024ef52e2328019dc0959b977b298f262b2198bda (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271) 2024-03-19T06:11:43.402 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:42 smithi172 podman[74525]: 2024-03-19 06:11:42.970387762 +0000 UTC m=+0.452294733 container init 8729e26df4c259a1a06e6e7024ef52e2328019dc0959b977b298f262b2198bda (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222) 2024-03-19T06:11:43.403 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:42 smithi172 podman[74525]: 2024-03-19 06:11:42.985164115 +0000 UTC m=+0.467071023 container start 8729e26df4c259a1a06e6e7024ef52e2328019dc0959b977b298f262b2198bda (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:11:43.403 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 podman[74525]: 2024-03-19 06:11:43.068949118 +0000 UTC m=+0.550856053 container attach 8729e26df4c259a1a06e6e7024ef52e2328019dc0959b977b298f262b2198bda (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:11:43.824 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:43 smithi172 ceph-mon[66682]: Health check failed: Degraded data redundancy: 51/396 objects degraded (12.879%), 12 pgs degraded (PG_DEGRADED) 2024-03-19T06:11:43.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:43 smithi072 ceph-mon[78545]: Health check failed: Degraded data redundancy: 51/396 objects degraded (12.879%), 12 pgs degraded (PG_DEGRADED) 2024-03-19T06:11:44.153 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate[74540]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-19T06:11:44.153 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate[74540]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-19T06:11:44.153 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 bash[74525]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-19T06:11:44.153 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 bash[74525]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-19T06:11:44.153 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 bash[74525]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-19T06:11:44.153 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 bash[74525]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-19T06:11:44.154 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 bash[74525]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-03-19T06:11:44.154 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 bash[74525]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-19T06:11:44.154 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 bash[74525]: --> ceph-volume raw activate successful for osd ID: 4 2024-03-19T06:11:44.154 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate[74540]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-19T06:11:44.154 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate[74540]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-19T06:11:44.154 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate[74540]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-03-19T06:11:44.154 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate[74540]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-19T06:11:44.154 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate[74540]: --> ceph-volume raw activate successful for osd ID: 4 2024-03-19T06:11:44.154 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:43 smithi172 podman[74525]: 2024-03-19 06:11:43.896002168 +0000 UTC m=+1.377909050 container died 8729e26df4c259a1a06e6e7024ef52e2328019dc0959b977b298f262b2198bda (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:11:44.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:44 smithi072 ceph-mon[78545]: pgmap v154: 65 pgs: 12 active+undersized+degraded, 8 peering, 14 active+undersized, 31 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/396 objects degraded (12.879%) 2024-03-19T06:11:44.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:44 smithi172 ceph-mon[66682]: pgmap v154: 65 pgs: 12 active+undersized+degraded, 8 peering, 14 active+undersized, 31 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/396 objects degraded (12.879%) 2024-03-19T06:11:44.902 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:44 smithi172 podman[74667]: 2024-03-19 06:11:44.788665753 +0000 UTC m=+0.873303031 container remove 8729e26df4c259a1a06e6e7024ef52e2328019dc0959b977b298f262b2198bda (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222) 2024-03-19T06:11:45.402 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:45 smithi172 podman[74731]: 2024-03-19 06:11:45.041928415 +0000 UTC m=+0.031629822 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:11:45.403 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:45 smithi172 podman[74731]: 2024-03-19 06:11:45.173890231 +0000 UTC m=+0.163591677 container create 985a6457cf21c7a7efea5c93dd8b3cb14fc99e961173cd80c1fc7faa2d82cec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.schema-version=1.0) 2024-03-19T06:11:45.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:45 smithi072 ceph-mon[78545]: pgmap v155: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 69/396 objects degraded (17.424%) 2024-03-19T06:11:45.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:45 smithi172 ceph-mon[66682]: pgmap v155: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 69/396 objects degraded (17.424%) 2024-03-19T06:11:45.902 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:45 smithi172 podman[74731]: 2024-03-19 06:11:45.427954409 +0000 UTC m=+0.417655896 container init 985a6457cf21c7a7efea5c93dd8b3cb14fc99e961173cd80c1fc7faa2d82cec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-19T06:11:45.902 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:45 smithi172 podman[74731]: 2024-03-19 06:11:45.439444962 +0000 UTC m=+0.429146415 container start 985a6457cf21c7a7efea5c93dd8b3cb14fc99e961173cd80c1fc7faa2d82cec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:11:45.903 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:45 smithi172 ceph-osd[74750]: -- 172.21.15.172:0/3592862059 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56282009f680 con 0x562820069000 2024-03-19T06:11:45.903 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:45 smithi172 bash[74731]: 985a6457cf21c7a7efea5c93dd8b3cb14fc99e961173cd80c1fc7faa2d82cec0 2024-03-19T06:11:45.903 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:45 smithi172 systemd[1]: Started Ceph osd.4 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:11:46.402 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:46 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:11:46.006+0000 7f35f61be7c0 -1 Falling back to public interface 2024-03-19T06:11:46.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:46 smithi072 ceph-mon[78545]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-03-19T06:11:46.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:46 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:46.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:46 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:46.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:46 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:11:46.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:46 smithi172 ceph-mon[66682]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-03-19T06:11:46.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:46 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:46.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:46 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:46.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:46 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:11:47.846 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:47 smithi172 ceph-mon[66682]: pgmap v156: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 69/396 objects degraded (17.424%) 2024-03-19T06:11:48.029 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:47 smithi072 ceph-mon[78545]: pgmap v156: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 69/396 objects degraded (17.424%) 2024-03-19T06:11:50.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:49 smithi072 ceph-mon[78545]: pgmap v157: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 69/396 objects degraded (17.424%) 2024-03-19T06:11:50.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:49 smithi172 ceph-mon[66682]: pgmap v157: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 69/396 objects degraded (17.424%) 2024-03-19T06:11:51.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:51.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:51.391 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:51.392 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.480+0000 7fbcd2a00700 1 -- 172.21.15.72:0/3926038534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbccc100240 msgr2=0x7fbccc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.480+0000 7fbcd2a00700 1 --2- 172.21.15.72:0/3926038534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbccc100240 0x7fbccc100650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009910 tx=0x7fbcbc009c20 comp rx=0 tx=0).stop 2024-03-19T06:11:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.480+0000 7fbcd2a00700 1 -- 172.21.15.72:0/3926038534 shutdown_connections 2024-03-19T06:11:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.480+0000 7fbcd2a00700 1 --2- 172.21.15.72:0/3926038534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbccc101440 0x7fbccc101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.480+0000 7fbcd2a00700 1 --2- 172.21.15.72:0/3926038534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbccc100240 0x7fbccc100650 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.480+0000 7fbcd2a00700 1 -- 172.21.15.72:0/3926038534 >> 172.21.15.72:0/3926038534 conn(0x7fbccc0fb7f0 msgr2=0x7fbccc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.480+0000 7fbcd2a00700 1 -- 172.21.15.72:0/3926038534 shutdown_connections 2024-03-19T06:11:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.480+0000 7fbcd2a00700 1 -- 172.21.15.72:0/3926038534 wait complete. 2024-03-19T06:11:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.481+0000 7fbcd2a00700 1 Processor -- start 2024-03-19T06:11:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.482+0000 7fbcd2a00700 1 -- start start 2024-03-19T06:11:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.482+0000 7fbcd2a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbccc100240 0x7fbccc195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.482+0000 7fbcd2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbccc101440 0x7fbccc195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.482+0000 7fbcd2a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc196610 con 0x7fbccc101440 2024-03-19T06:11:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.482+0000 7fbcd2a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc196750 con 0x7fbccc100240 2024-03-19T06:11:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.482+0000 7fbcc3e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbccc101440 0x7fbccc195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.482+0000 7fbccbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbccc100240 0x7fbccc195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.482+0000 7fbcc3e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbccc101440 0x7fbccc195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33698/0 (socket says 172.21.15.72:33698) 2024-03-19T06:11:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.482+0000 7fbcc3e00700 1 -- 172.21.15.72:0/2408461700 learned_addr learned my addr 172.21.15.72:0/2408461700 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.483+0000 7fbcc3e00700 1 -- 172.21.15.72:0/2408461700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbccc100240 msgr2=0x7fbccc195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.483+0000 7fbcc3e00700 1 --2- 172.21.15.72:0/2408461700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbccc100240 0x7fbccc195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.483+0000 7fbcc3e00700 1 -- 172.21.15.72:0/2408461700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc0095f0 con 0x7fbccc101440 2024-03-19T06:11:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.483+0000 7fbcc3e00700 1 --2- 172.21.15.72:0/2408461700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbccc101440 0x7fbccc195ff0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400d8d0 tx=0x7fbcb400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.483+0000 7fbcc9600700 1 -- 172.21.15.72:0/2408461700 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcb40098a0 con 0x7fbccc101440 2024-03-19T06:11:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.483+0000 7fbcc9600700 1 -- 172.21.15.72:0/2408461700 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbcb4010460 con 0x7fbccc101440 2024-03-19T06:11:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.483+0000 7fbcc9600700 1 -- 172.21.15.72:0/2408461700 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcb400f5f0 con 0x7fbccc101440 2024-03-19T06:11:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.484+0000 7fbcd2a00700 1 -- 172.21.15.72:0/2408461700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc19b200 con 0x7fbccc101440 2024-03-19T06:11:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.484+0000 7fbcd2a00700 1 -- 172.21.15.72:0/2408461700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc19b750 con 0x7fbccc101440 2024-03-19T06:11:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.485+0000 7fbcd2a00700 1 -- 172.21.15.72:0/2408461700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc108d90 con 0x7fbccc101440 2024-03-19T06:11:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.486+0000 7fbcc9600700 1 -- 172.21.15.72:0/2408461700 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fbcb4009a00 con 0x7fbccc101440 2024-03-19T06:11:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.487+0000 7fbcc9600700 1 --2- 172.21.15.72:0/2408461700 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbcb006dfa0 0x7fbcb0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.487+0000 7fbcc9600700 1 -- 172.21.15.72:0/2408461700 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbcb408dc10 con 0x7fbccc101440 2024-03-19T06:11:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.487+0000 7fbccbe00700 1 --2- 172.21.15.72:0/2408461700 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbcb006dfa0 0x7fbcb0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.488+0000 7fbccbe00700 1 --2- 172.21.15.72:0/2408461700 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbcb006dfa0 0x7fbcb0070450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc006010 tx=0x7fbcbc00b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:51.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.492+0000 7fbcc9600700 1 -- 172.21.15.72:0/2408461700 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fbcb405abc0 con 0x7fbccc101440 2024-03-19T06:11:51.652 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:51 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:11:51.401+0000 7f35f61be7c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-03-19T06:11:51.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.735+0000 7fbcd2a00700 1 -- 172.21.15.72:0/2408461700 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbccc105d90 con 0x7fbcb006dfa0 2024-03-19T06:11:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.738+0000 7fbcc9600700 1 -- 172.21.15.72:0/2408461700 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fbccc105d90 con 0x7fbcb006dfa0 2024-03-19T06:11:51.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.741+0000 7fbcd2a00700 1 -- 172.21.15.72:0/2408461700 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbcb006dfa0 msgr2=0x7fbcb0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:51.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.741+0000 7fbcd2a00700 1 --2- 172.21.15.72:0/2408461700 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbcb006dfa0 0x7fbcb0070450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc006010 tx=0x7fbcbc00b560 comp rx=0 tx=0).stop 2024-03-19T06:11:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.741+0000 7fbcd2a00700 1 -- 172.21.15.72:0/2408461700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbccc101440 msgr2=0x7fbccc195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.741+0000 7fbcd2a00700 1 --2- 172.21.15.72:0/2408461700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbccc101440 0x7fbccc195ff0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400d8d0 tx=0x7fbcb400dbe0 comp rx=0 tx=0).stop 2024-03-19T06:11:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.742+0000 7fbcd2a00700 1 -- 172.21.15.72:0/2408461700 shutdown_connections 2024-03-19T06:11:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.742+0000 7fbcd2a00700 1 --2- 172.21.15.72:0/2408461700 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbcb006dfa0 0x7fbcb0070450 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.742+0000 7fbcd2a00700 1 --2- 172.21.15.72:0/2408461700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbccc100240 0x7fbccc195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.742+0000 7fbcd2a00700 1 --2- 172.21.15.72:0/2408461700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbccc101440 0x7fbccc195ff0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.742+0000 7fbcd2a00700 1 -- 172.21.15.72:0/2408461700 >> 172.21.15.72:0/2408461700 conn(0x7fbccc0fb7f0 msgr2=0x7fbccc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.742+0000 7fbcd2a00700 1 -- 172.21.15.72:0/2408461700 shutdown_connections 2024-03-19T06:11:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.742+0000 7fbcd2a00700 1 -- 172.21.15.72:0/2408461700 wait complete. 2024-03-19T06:11:51.747 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:11:51.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.902+0000 7efd50800700 1 -- 172.21.15.72:0/85432124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd48107a40 msgr2=0x7efd48107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.902+0000 7efd50800700 1 --2- 172.21.15.72:0/85432124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd48107a40 0x7efd48107e90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efd38009910 tx=0x7efd38009c20 comp rx=0 tx=0).stop 2024-03-19T06:11:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.902+0000 7efd50800700 1 -- 172.21.15.72:0/85432124 shutdown_connections 2024-03-19T06:11:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.902+0000 7efd50800700 1 --2- 172.21.15.72:0/85432124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd48107a40 0x7efd48107e90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.902+0000 7efd50800700 1 --2- 172.21.15.72:0/85432124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48106840 0x7efd48106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.902+0000 7efd50800700 1 -- 172.21.15.72:0/85432124 >> 172.21.15.72:0/85432124 conn(0x7efd48075970 msgr2=0x7efd48077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.902+0000 7efd50800700 1 -- 172.21.15.72:0/85432124 shutdown_connections 2024-03-19T06:11:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.902+0000 7efd50800700 1 -- 172.21.15.72:0/85432124 wait complete. 2024-03-19T06:11:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.903+0000 7efd50800700 1 Processor -- start 2024-03-19T06:11:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.903+0000 7efd50800700 1 -- start start 2024-03-19T06:11:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.904+0000 7efd50800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd48106840 0x7efd4819c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.904+0000 7efd50800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48107a40 0x7efd4819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.904+0000 7efd50800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4819cce0 con 0x7efd48106840 2024-03-19T06:11:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.904+0000 7efd50800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4819ce20 con 0x7efd48107a40 2024-03-19T06:11:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.904+0000 7efd4de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd48106840 0x7efd4819c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.904+0000 7efd4de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd48106840 0x7efd4819c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33722/0 (socket says 172.21.15.72:33722) 2024-03-19T06:11:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.904+0000 7efd4de00700 1 -- 172.21.15.72:0/3871482276 learned_addr learned my addr 172.21.15.72:0/3871482276 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.904+0000 7efd4d400700 1 --2- 172.21.15.72:0/3871482276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48107a40 0x7efd4819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:51.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.905+0000 7efd4de00700 1 -- 172.21.15.72:0/3871482276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48107a40 msgr2=0x7efd4819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:51.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.905+0000 7efd4de00700 1 --2- 172.21.15.72:0/3871482276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48107a40 0x7efd4819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:51.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.905+0000 7efd4de00700 1 -- 172.21.15.72:0/3871482276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd380095f0 con 0x7efd48106840 2024-03-19T06:11:51.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.905+0000 7efd4d400700 1 --2- 172.21.15.72:0/3871482276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48107a40 0x7efd4819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:11:51.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.905+0000 7efd4de00700 1 --2- 172.21.15.72:0/3871482276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd48106840 0x7efd4819c180 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00b480 tx=0x7efd3c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:51.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.905+0000 7efd42a00700 1 -- 172.21.15.72:0/3871482276 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd3c0118c0 con 0x7efd48106840 2024-03-19T06:11:51.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.905+0000 7efd42a00700 1 -- 172.21.15.72:0/3871482276 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efd3c010380 con 0x7efd48106840 2024-03-19T06:11:51.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.905+0000 7efd42a00700 1 -- 172.21.15.72:0/3871482276 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd3c00f4f0 con 0x7efd48106840 2024-03-19T06:11:51.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.905+0000 7efd50800700 1 -- 172.21.15.72:0/3871482276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd481a18d0 con 0x7efd48106840 2024-03-19T06:11:51.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.905+0000 7efd50800700 1 -- 172.21.15.72:0/3871482276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd481a1e20 con 0x7efd48106840 2024-03-19T06:11:51.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.906+0000 7efd50800700 1 -- 172.21.15.72:0/3871482276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4810f430 con 0x7efd48106840 2024-03-19T06:11:51.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.907+0000 7efd42a00700 1 -- 172.21.15.72:0/3871482276 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7efd3c0104f0 con 0x7efd48106840 2024-03-19T06:11:51.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.908+0000 7efd42a00700 1 --2- 172.21.15.72:0/3871482276 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efd3006dfa0 0x7efd30070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:51.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.909+0000 7efd42a00700 1 -- 172.21.15.72:0/3871482276 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6328+0+0 (secure 0 0 0) 0x7efd3c08d870 con 0x7efd48106840 2024-03-19T06:11:51.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.909+0000 7efd4d400700 1 --2- 172.21.15.72:0/3871482276 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efd3006dfa0 0x7efd30070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:51.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.910+0000 7efd4d400700 1 --2- 172.21.15.72:0/3871482276 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efd3006dfa0 0x7efd30070450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd38005b40 tx=0x7efd38005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:51.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:51.914+0000 7efd42a00700 1 -- 172.21.15.72:0/3871482276 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7efd3c05a940 con 0x7efd48106840 2024-03-19T06:11:52.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:51 smithi072 ceph-mon[78545]: pgmap v158: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 69/396 objects degraded (17.424%) 2024-03-19T06:11:52.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:51 smithi072 ceph-mon[78545]: from='osd.4 [v2:172.21.15.172:6808/1295620546,v1:172.21.15.172:6809/1295620546]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-19T06:11:52.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:51 smithi072 ceph-mon[78545]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-19T06:11:52.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:51 smithi172 ceph-mon[66682]: pgmap v158: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 69/396 objects degraded (17.424%) 2024-03-19T06:11:52.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:51 smithi172 ceph-mon[66682]: from='osd.4 [v2:172.21.15.172:6808/1295620546,v1:172.21.15.172:6809/1295620546]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-19T06:11:52.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:51 smithi172 ceph-mon[66682]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-19T06:11:52.152 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:51 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:11:51.792+0000 7f35f61be7c0 -1 osd.4 68 log_to_monitors true 2024-03-19T06:11:52.152 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:11:51 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:11:51.982+0000 7f35e5600700 -1 osd.4 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:11:52.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.163+0000 7efd50800700 1 -- 172.21.15.72:0/3871482276 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd4810c390 con 0x7efd3006dfa0 2024-03-19T06:11:52.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.167+0000 7efd42a00700 1 -- 172.21.15.72:0/3871482276 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7efd4810c390 con 0x7efd3006dfa0 2024-03-19T06:11:52.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.170+0000 7efd50800700 1 -- 172.21.15.72:0/3871482276 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efd3006dfa0 msgr2=0x7efd30070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:52.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.170+0000 7efd50800700 1 --2- 172.21.15.72:0/3871482276 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efd3006dfa0 0x7efd30070450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd38005b40 tx=0x7efd38005ab0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.170+0000 7efd50800700 1 -- 172.21.15.72:0/3871482276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd48106840 msgr2=0x7efd4819c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:52.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.170+0000 7efd50800700 1 --2- 172.21.15.72:0/3871482276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd48106840 0x7efd4819c180 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00b480 tx=0x7efd3c00b840 comp rx=0 tx=0).stop 2024-03-19T06:11:52.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.170+0000 7efd50800700 1 -- 172.21.15.72:0/3871482276 shutdown_connections 2024-03-19T06:11:52.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.170+0000 7efd50800700 1 --2- 172.21.15.72:0/3871482276 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efd3006dfa0 0x7efd30070450 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.170+0000 7efd50800700 1 --2- 172.21.15.72:0/3871482276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd48106840 0x7efd4819c180 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.170+0000 7efd50800700 1 --2- 172.21.15.72:0/3871482276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd48107a40 0x7efd4819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.170+0000 7efd50800700 1 -- 172.21.15.72:0/3871482276 >> 172.21.15.72:0/3871482276 conn(0x7efd48075970 msgr2=0x7efd4810ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:52.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.170+0000 7efd50800700 1 -- 172.21.15.72:0/3871482276 shutdown_connections 2024-03-19T06:11:52.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.171+0000 7efd50800700 1 -- 172.21.15.72:0/3871482276 wait complete. 2024-03-19T06:11:52.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.329+0000 7f179a000700 1 -- 172.21.15.72:0/4036670382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794102430 msgr2=0x7f1794102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:52.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.329+0000 7f179a000700 1 --2- 172.21.15.72:0/4036670382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794102430 0x7f1794102840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1784009910 tx=0x7f1784009c20 comp rx=0 tx=0).stop 2024-03-19T06:11:52.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.329+0000 7f179a000700 1 -- 172.21.15.72:0/4036670382 shutdown_connections 2024-03-19T06:11:52.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.329+0000 7f179a000700 1 --2- 172.21.15.72:0/4036670382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17941036d0 0x7f1794103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.329+0000 7f179a000700 1 --2- 172.21.15.72:0/4036670382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794102430 0x7f1794102840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.329+0000 7f179a000700 1 -- 172.21.15.72:0/4036670382 >> 172.21.15.72:0/4036670382 conn(0x7f17940fda80 msgr2=0x7f17940ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:52.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.329+0000 7f179a000700 1 -- 172.21.15.72:0/4036670382 shutdown_connections 2024-03-19T06:11:52.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.329+0000 7f179a000700 1 -- 172.21.15.72:0/4036670382 wait complete. 2024-03-19T06:11:52.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.330+0000 7f179a000700 1 Processor -- start 2024-03-19T06:11:52.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.330+0000 7f179a000700 1 -- start start 2024-03-19T06:11:52.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.330+0000 7f179a000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1794102430 0x7f1794197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:52.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.330+0000 7f179a000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17941036d0 0x7f1794198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:52.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.330+0000 7f179a000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1794198850 con 0x7f17941036d0 2024-03-19T06:11:52.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.330+0000 7f179a000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179419d260 con 0x7f1794102430 2024-03-19T06:11:52.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.331+0000 7f1792a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17941036d0 0x7f1794198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:52.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.331+0000 7f1792a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17941036d0 0x7f1794198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33748/0 (socket says 172.21.15.72:33748) 2024-03-19T06:11:52.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.331+0000 7f1792a00700 1 -- 172.21.15.72:0/69353332 learned_addr learned my addr 172.21.15.72:0/69353332 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:52.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.331+0000 7f1793400700 1 --2- 172.21.15.72:0/69353332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1794102430 0x7f1794197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:52.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.331+0000 7f1792a00700 1 -- 172.21.15.72:0/69353332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1794102430 msgr2=0x7f1794197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:52.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.331+0000 7f1792a00700 1 --2- 172.21.15.72:0/69353332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1794102430 0x7f1794197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.331+0000 7f1792a00700 1 -- 172.21.15.72:0/69353332 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840095f0 con 0x7f17941036d0 2024-03-19T06:11:52.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.332+0000 7f1792a00700 1 --2- 172.21.15.72:0/69353332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17941036d0 0x7f1794198230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f178000d8d0 tx=0x7f178000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:52.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.332+0000 7f178be00700 1 -- 172.21.15.72:0/69353332 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17800098a0 con 0x7f17941036d0 2024-03-19T06:11:52.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.332+0000 7f178be00700 1 -- 172.21.15.72:0/69353332 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1780010460 con 0x7f17941036d0 2024-03-19T06:11:52.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.332+0000 7f179a000700 1 -- 172.21.15.72:0/69353332 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179419d460 con 0x7f17941036d0 2024-03-19T06:11:52.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.332+0000 7f178be00700 1 -- 172.21.15.72:0/69353332 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178000f5f0 con 0x7f17941036d0 2024-03-19T06:11:52.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.332+0000 7f179a000700 1 -- 172.21.15.72:0/69353332 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179419d980 con 0x7f17941036d0 2024-03-19T06:11:52.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.333+0000 7f179a000700 1 -- 172.21.15.72:0/69353332 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179410af10 con 0x7f17941036d0 2024-03-19T06:11:52.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.334+0000 7f178be00700 1 -- 172.21.15.72:0/69353332 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f1780009a00 con 0x7f17941036d0 2024-03-19T06:11:52.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.335+0000 7f178be00700 1 --2- 172.21.15.72:0/69353332 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f177806dfa0 0x7f1778070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:52.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.335+0000 7f178be00700 1 -- 172.21.15.72:0/69353332 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f178008dbc0 con 0x7f17941036d0 2024-03-19T06:11:52.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.335+0000 7f1793400700 1 --2- 172.21.15.72:0/69353332 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f177806dfa0 0x7f1778070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:52.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.336+0000 7f1793400700 1 --2- 172.21.15.72:0/69353332 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f177806dfa0 0x7f1778070450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1784006010 tx=0x7f1784005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:52.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.340+0000 7f178be00700 1 -- 172.21.15.72:0/69353332 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f1780057040 con 0x7f17941036d0 2024-03-19T06:11:52.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.572+0000 7f179a000700 1 -- 172.21.15.72:0/69353332 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1794108020 con 0x7f177806dfa0 2024-03-19T06:11:52.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.603+0000 7f178be00700 1 -- 172.21.15.72:0/69353332 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f1794108020 con 0x7f177806dfa0 2024-03-19T06:11:52.592 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:11:52.592 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (16m) 70s ago 18m 14.0M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (18m) 70s ago 18m 8678k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (17m) 2s ago 17m 8472k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (2m) 70s ago 18m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (2m) 2s ago 17m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (16m) 70s ago 17m 71.5M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (10m) 70s ago 10m 16.5M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (10m) 70s ago 10m 126M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (10m) 2s ago 10m 17.0M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (10m) 2s ago 10m 142M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (7m) 70s ago 20m 504M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (5m) 2s ago 16m 451M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (4m) 70s ago 20m 50.4M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (4m) 2s ago 16m 39.6M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (18m) 70s ago 18m 8196k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:11:52.593 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (16m) 2s ago 16m 8346k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:11:52.594 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (2m) 70s ago 15m 87.0M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:11:52.594 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (108s) 70s ago 15m 87.1M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:11:52.594 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (78s) 70s ago 14m 11.2M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:11:52.594 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (49s) 2s ago 13m 88.9M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:11:52.594 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (7s) 2s ago 13m 11.2M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:11:52.594 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (12m) 2s ago 12m 194M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:11:52.594 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (5m) 70s ago 17m 67.0M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:11:52.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.606+0000 7f179a000700 1 -- 172.21.15.72:0/69353332 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f177806dfa0 msgr2=0x7f1778070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:52.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.606+0000 7f179a000700 1 --2- 172.21.15.72:0/69353332 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f177806dfa0 0x7f1778070450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1784006010 tx=0x7f1784005ee0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.606+0000 7f179a000700 1 -- 172.21.15.72:0/69353332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17941036d0 msgr2=0x7f1794198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:52.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.606+0000 7f179a000700 1 --2- 172.21.15.72:0/69353332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17941036d0 0x7f1794198230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f178000d8d0 tx=0x7f178000dbe0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.606+0000 7f179a000700 1 -- 172.21.15.72:0/69353332 shutdown_connections 2024-03-19T06:11:52.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.606+0000 7f179a000700 1 --2- 172.21.15.72:0/69353332 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f177806dfa0 0x7f1778070450 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.606+0000 7f179a000700 1 --2- 172.21.15.72:0/69353332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1794102430 0x7f1794197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.606+0000 7f179a000700 1 --2- 172.21.15.72:0/69353332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17941036d0 0x7f1794198230 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.606+0000 7f179a000700 1 -- 172.21.15.72:0/69353332 >> 172.21.15.72:0/69353332 conn(0x7f17940fda80 msgr2=0x7f1794106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:52.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.606+0000 7f179a000700 1 -- 172.21.15.72:0/69353332 shutdown_connections 2024-03-19T06:11:52.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.606+0000 7f179a000700 1 -- 172.21.15.72:0/69353332 wait complete. 2024-03-19T06:11:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.761+0000 7fbeebe00700 1 -- 172.21.15.72:0/1429187424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbee4073730 msgr2=0x7fbee4073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.761+0000 7fbeebe00700 1 --2- 172.21.15.72:0/1429187424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbee4073730 0x7fbee4073ba0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009910 tx=0x7fbed0009c20 comp rx=0 tx=0).stop 2024-03-19T06:11:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.761+0000 7fbeebe00700 1 -- 172.21.15.72:0/1429187424 shutdown_connections 2024-03-19T06:11:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.761+0000 7fbeebe00700 1 --2- 172.21.15.72:0/1429187424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbee4073730 0x7fbee4073ba0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.761+0000 7fbeebe00700 1 --2- 172.21.15.72:0/1429187424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbee4074d00 0x7fbee4073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.761+0000 7fbeebe00700 1 -- 172.21.15.72:0/1429187424 >> 172.21.15.72:0/1429187424 conn(0x7fbee40fb7f0 msgr2=0x7fbee40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.762+0000 7fbeebe00700 1 -- 172.21.15.72:0/1429187424 shutdown_connections 2024-03-19T06:11:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.762+0000 7fbeebe00700 1 -- 172.21.15.72:0/1429187424 wait complete. 2024-03-19T06:11:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.763+0000 7fbeebe00700 1 Processor -- start 2024-03-19T06:11:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.763+0000 7fbeebe00700 1 -- start start 2024-03-19T06:11:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.763+0000 7fbeebe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbee4073730 0x7fbee4197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.763+0000 7fbeebe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbee4074d00 0x7fbee41981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.763+0000 7fbeebe00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee4198720 con 0x7fbee4074d00 2024-03-19T06:11:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.763+0000 7fbeebe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee4198890 con 0x7fbee4073730 2024-03-19T06:11:52.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.764+0000 7fbee9400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbee4073730 0x7fbee4197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:52.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.764+0000 7fbee8a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbee4074d00 0x7fbee41981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.764+0000 7fbee9400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbee4073730 0x7fbee4197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.72:53592/0 (socket says 172.21.15.72:53592) 2024-03-19T06:11:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.764+0000 7fbee8a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbee4074d00 0x7fbee41981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33754/0 (socket says 172.21.15.72:33754) 2024-03-19T06:11:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.764+0000 7fbee9400700 1 -- 172.21.15.72:0/364971797 learned_addr learned my addr 172.21.15.72:0/364971797 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.764+0000 7fbee8a00700 1 -- 172.21.15.72:0/364971797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbee4073730 msgr2=0x7fbee4197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.764+0000 7fbee8a00700 1 --2- 172.21.15.72:0/364971797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbee4073730 0x7fbee4197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.764+0000 7fbee8a00700 1 -- 172.21.15.72:0/364971797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00095f0 con 0x7fbee4074d00 2024-03-19T06:11:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.764+0000 7fbee8a00700 1 --2- 172.21.15.72:0/364971797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbee4074d00 0x7fbee41981b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbed0000c00 tx=0x7fbed000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.765+0000 7fbee2000700 1 -- 172.21.15.72:0/364971797 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbed001d070 con 0x7fbee4074d00 2024-03-19T06:11:52.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.765+0000 7fbee2000700 1 -- 172.21.15.72:0/364971797 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbed000f460 con 0x7fbee4074d00 2024-03-19T06:11:52.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.765+0000 7fbeebe00700 1 -- 172.21.15.72:0/364971797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee419d2d0 con 0x7fbee4074d00 2024-03-19T06:11:52.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.765+0000 7fbee2000700 1 -- 172.21.15.72:0/364971797 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbed0021640 con 0x7fbee4074d00 2024-03-19T06:11:52.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.765+0000 7fbeebe00700 1 -- 172.21.15.72:0/364971797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee419d7c0 con 0x7fbee4074d00 2024-03-19T06:11:52.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.766+0000 7fbeebe00700 1 -- 172.21.15.72:0/364971797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee410af70 con 0x7fbee4074d00 2024-03-19T06:11:52.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.768+0000 7fbee2000700 1 -- 172.21.15.72:0/364971797 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fbed000fa20 con 0x7fbee4074d00 2024-03-19T06:11:52.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.769+0000 7fbee2000700 1 --2- 172.21.15.72:0/364971797 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbecc06dfa0 0x7fbecc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:52.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.769+0000 7fbee2000700 1 -- 172.21.15.72:0/364971797 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbed008f270 con 0x7fbee4074d00 2024-03-19T06:11:52.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.770+0000 7fbee9400700 1 --2- 172.21.15.72:0/364971797 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbecc06dfa0 0x7fbecc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:52.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.771+0000 7fbee9400700 1 --2- 172.21.15.72:0/364971797 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbecc06dfa0 0x7fbecc070450 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbee4198b50 tx=0x7fbed8005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:52.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:52.773+0000 7fbee2000700 1 -- 172.21.15.72:0/364971797 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fbed00588b0 con 0x7fbee4074d00 2024-03-19T06:11:53.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.105+0000 7fbeebe00700 1 -- 172.21.15.72:0/364971797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbee410b160 con 0x7fbee4074d00 2024-03-19T06:11:53.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.105+0000 7fbee2000700 1 -- 172.21.15.72:0/364971797 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fbed005bf70 con 0x7fbee4074d00 2024-03-19T06:11:53.095 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:11:53.095 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:11:53.095 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:11:53.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:11:53.095 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:11:53.095 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:11:53.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:11:53.095 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:11:53.096 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-03-19T06:11:53.096 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 5 2024-03-19T06:11:53.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:11:53.096 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:11:53.096 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:11:53.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:11:53.096 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:11:53.096 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-03-19T06:11:53.096 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 9 2024-03-19T06:11:53.096 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:11:53.096 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:11:53.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.108+0000 7fbeebe00700 1 -- 172.21.15.72:0/364971797 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbecc06dfa0 msgr2=0x7fbecc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:53.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.108+0000 7fbeebe00700 1 --2- 172.21.15.72:0/364971797 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbecc06dfa0 0x7fbecc070450 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbee4198b50 tx=0x7fbed8005f90 comp rx=0 tx=0).stop 2024-03-19T06:11:53.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.108+0000 7fbeebe00700 1 -- 172.21.15.72:0/364971797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbee4074d00 msgr2=0x7fbee41981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:53.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.108+0000 7fbeebe00700 1 --2- 172.21.15.72:0/364971797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbee4074d00 0x7fbee41981b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbed0000c00 tx=0x7fbed000bd70 comp rx=0 tx=0).stop 2024-03-19T06:11:53.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.108+0000 7fbeebe00700 1 -- 172.21.15.72:0/364971797 shutdown_connections 2024-03-19T06:11:53.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.108+0000 7fbeebe00700 1 --2- 172.21.15.72:0/364971797 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbecc06dfa0 0x7fbecc070450 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.108+0000 7fbeebe00700 1 --2- 172.21.15.72:0/364971797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbee4073730 0x7fbee4197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.108+0000 7fbeebe00700 1 --2- 172.21.15.72:0/364971797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbee4074d00 0x7fbee41981b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.108+0000 7fbeebe00700 1 -- 172.21.15.72:0/364971797 >> 172.21.15.72:0/364971797 conn(0x7fbee40fb7f0 msgr2=0x7fbee41060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:53.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.108+0000 7fbeebe00700 1 -- 172.21.15.72:0/364971797 shutdown_connections 2024-03-19T06:11:53.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.109+0000 7fbeebe00700 1 -- 172.21.15.72:0/364971797 wait complete. 2024-03-19T06:11:53.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:52 smithi172 ceph-mon[66682]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:53.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:53.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:52 smithi172 ceph-mon[66682]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-19T06:11:53.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:52 smithi172 ceph-mon[66682]: osdmap e71: 6 total, 5 up, 6 in 2024-03-19T06:11:53.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:52 smithi172 ceph-mon[66682]: from='osd.4 [v2:172.21.15.172:6808/1295620546,v1:172.21.15.172:6809/1295620546]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T06:11:53.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:53.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:52 smithi172 ceph-mon[66682]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T06:11:53.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:52 smithi172 ceph-mon[66682]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:53.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:52 smithi172 ceph-mon[66682]: Health check update: Degraded data redundancy: 69/396 objects degraded (17.424%), 16 pgs degraded (PG_DEGRADED) 2024-03-19T06:11:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.250+0000 7fb648800700 1 -- 172.21.15.72:0/1708720959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6400737b0 msgr2=0x7fb640073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.251+0000 7fb648800700 1 --2- 172.21.15.72:0/1708720959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6400737b0 0x7fb640073c20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb630009910 tx=0x7fb630009c20 comp rx=0 tx=0).stop 2024-03-19T06:11:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.251+0000 7fb648800700 1 -- 172.21.15.72:0/1708720959 shutdown_connections 2024-03-19T06:11:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.251+0000 7fb648800700 1 --2- 172.21.15.72:0/1708720959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6400737b0 0x7fb640073c20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.251+0000 7fb648800700 1 --2- 172.21.15.72:0/1708720959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb640074d80 0x7fb6400731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.251+0000 7fb648800700 1 -- 172.21.15.72:0/1708720959 >> 172.21.15.72:0/1708720959 conn(0x7fb6400fb7f0 msgr2=0x7fb6400fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.251+0000 7fb648800700 1 -- 172.21.15.72:0/1708720959 shutdown_connections 2024-03-19T06:11:53.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.251+0000 7fb648800700 1 -- 172.21.15.72:0/1708720959 wait complete. 2024-03-19T06:11:53.241 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:52 smithi072 ceph-mon[78545]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:53.241 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:53.241 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:52 smithi072 ceph-mon[78545]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-19T06:11:53.241 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:52 smithi072 ceph-mon[78545]: osdmap e71: 6 total, 5 up, 6 in 2024-03-19T06:11:53.241 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:52 smithi072 ceph-mon[78545]: from='osd.4 [v2:172.21.15.172:6808/1295620546,v1:172.21.15.172:6809/1295620546]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T06:11:53.241 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:53.242 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:52 smithi072 ceph-mon[78545]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T06:11:53.242 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:52 smithi072 ceph-mon[78545]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:53.242 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:52 smithi072 ceph-mon[78545]: Health check update: Degraded data redundancy: 69/396 objects degraded (17.424%), 16 pgs degraded (PG_DEGRADED) 2024-03-19T06:11:53.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.252+0000 7fb648800700 1 Processor -- start 2024-03-19T06:11:53.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.252+0000 7fb648800700 1 -- start start 2024-03-19T06:11:53.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.253+0000 7fb648800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6400737b0 0x7fb64019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.253+0000 7fb648800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb640074d80 0x7fb64019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.253+0000 7fb648800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64019cbd0 con 0x7fb6400737b0 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.253+0000 7fb648800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64019cd10 con 0x7fb640074d80 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.253+0000 7fb645e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6400737b0 0x7fb64019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.253+0000 7fb645e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6400737b0 0x7fb64019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33784/0 (socket says 172.21.15.72:33784) 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.253+0000 7fb645e00700 1 -- 172.21.15.72:0/2599631910 learned_addr learned my addr 172.21.15.72:0/2599631910 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.253+0000 7fb645400700 1 --2- 172.21.15.72:0/2599631910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb640074d80 0x7fb64019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.254+0000 7fb645e00700 1 -- 172.21.15.72:0/2599631910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb640074d80 msgr2=0x7fb64019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.254+0000 7fb645e00700 1 --2- 172.21.15.72:0/2599631910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb640074d80 0x7fb64019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.254+0000 7fb645e00700 1 -- 172.21.15.72:0/2599631910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300095f0 con 0x7fb6400737b0 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.254+0000 7fb645e00700 1 --2- 172.21.15.72:0/2599631910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6400737b0 0x7fb64019c070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb6380060b0 tx=0x7fb63800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.254+0000 7fb636a00700 1 -- 172.21.15.72:0/2599631910 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb63800dda0 con 0x7fb6400737b0 2024-03-19T06:11:53.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.254+0000 7fb636a00700 1 -- 172.21.15.72:0/2599631910 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb63800f040 con 0x7fb6400737b0 2024-03-19T06:11:53.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.254+0000 7fb648800700 1 -- 172.21.15.72:0/2599631910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6401a17c0 con 0x7fb6400737b0 2024-03-19T06:11:53.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.255+0000 7fb648800700 1 -- 172.21.15.72:0/2599631910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6401a1d10 con 0x7fb6400737b0 2024-03-19T06:11:53.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.255+0000 7fb636a00700 1 -- 172.21.15.72:0/2599631910 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6380146f0 con 0x7fb6400737b0 2024-03-19T06:11:53.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.256+0000 7fb648800700 1 -- 172.21.15.72:0/2599631910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64010f380 con 0x7fb6400737b0 2024-03-19T06:11:53.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.257+0000 7fb636a00700 1 -- 172.21.15.72:0/2599631910 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fb638004ad0 con 0x7fb6400737b0 2024-03-19T06:11:53.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.258+0000 7fb636a00700 1 --2- 172.21.15.72:0/2599631910 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb62c06dfa0 0x7fb62c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:53.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.258+0000 7fb636a00700 1 -- 172.21.15.72:0/2599631910 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb63808d7c0 con 0x7fb6400737b0 2024-03-19T06:11:53.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.258+0000 7fb645400700 1 --2- 172.21.15.72:0/2599631910 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb62c06dfa0 0x7fb62c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:53.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.259+0000 7fb645400700 1 --2- 172.21.15.72:0/2599631910 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb62c06dfa0 0x7fb62c070450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb630006010 tx=0x7fb63000b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:53.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.263+0000 7fb636a00700 1 -- 172.21.15.72:0/2599631910 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fb63805a770 con 0x7fb6400737b0 2024-03-19T06:11:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.516+0000 7fb648800700 1 -- 172.21.15.72:0/2599631910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb6401a1950 con 0x7fb6400737b0 2024-03-19T06:11:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.517+0000 7fb636a00700 1 -- 172.21.15.72:0/2599631910 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1852 (secure 0 0 0) 0x7fb6401a1950 con 0x7fb6400737b0 2024-03-19T06:11:53.506 INFO:teuthology.orchestra.run.smithi072.stdout:e17 2024-03-19T06:11:53.506 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:11:53.506 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 17 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:10:32.464152+0000 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:11:53.507 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:11:53.508 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:11:53.509 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:11:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:11:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:11:53.509 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:11:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:11:53.509 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:11:53.509 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:11:53.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.520+0000 7fb648800700 1 -- 172.21.15.72:0/2599631910 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb62c06dfa0 msgr2=0x7fb62c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:53.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.520+0000 7fb648800700 1 --2- 172.21.15.72:0/2599631910 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb62c06dfa0 0x7fb62c070450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb630006010 tx=0x7fb63000b560 comp rx=0 tx=0).stop 2024-03-19T06:11:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.520+0000 7fb648800700 1 -- 172.21.15.72:0/2599631910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6400737b0 msgr2=0x7fb64019c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.520+0000 7fb648800700 1 --2- 172.21.15.72:0/2599631910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6400737b0 0x7fb64019c070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb6380060b0 tx=0x7fb63800d3b0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.520+0000 7fb648800700 1 -- 172.21.15.72:0/2599631910 shutdown_connections 2024-03-19T06:11:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.520+0000 7fb648800700 1 --2- 172.21.15.72:0/2599631910 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb62c06dfa0 0x7fb62c070450 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.520+0000 7fb648800700 1 --2- 172.21.15.72:0/2599631910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6400737b0 0x7fb64019c070 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.520+0000 7fb648800700 1 --2- 172.21.15.72:0/2599631910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb640074d80 0x7fb64019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.520+0000 7fb648800700 1 -- 172.21.15.72:0/2599631910 >> 172.21.15.72:0/2599631910 conn(0x7fb6400fb7f0 msgr2=0x7fb640101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.520+0000 7fb648800700 1 -- 172.21.15.72:0/2599631910 shutdown_connections 2024-03-19T06:11:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.520+0000 7fb648800700 1 -- 172.21.15.72:0/2599631910 wait complete. 2024-03-19T06:11:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2024-03-19T06:11:53.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.673+0000 7f1f01a00700 1 -- 172.21.15.72:0/3165102779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc0737b0 msgr2=0x7f1efc073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:53.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.673+0000 7f1f01a00700 1 --2- 172.21.15.72:0/3165102779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc0737b0 0x7f1efc073c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009910 tx=0x7f1ee4009c20 comp rx=0 tx=0).stop 2024-03-19T06:11:53.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.673+0000 7f1f01a00700 1 -- 172.21.15.72:0/3165102779 shutdown_connections 2024-03-19T06:11:53.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.673+0000 7f1f01a00700 1 --2- 172.21.15.72:0/3165102779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc0737b0 0x7f1efc073c20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.673+0000 7f1f01a00700 1 --2- 172.21.15.72:0/3165102779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1efc074d80 0x7f1efc0731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.673+0000 7f1f01a00700 1 -- 172.21.15.72:0/3165102779 >> 172.21.15.72:0/3165102779 conn(0x7f1efc0fb7f0 msgr2=0x7f1efc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:53.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.673+0000 7f1f01a00700 1 -- 172.21.15.72:0/3165102779 shutdown_connections 2024-03-19T06:11:53.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.673+0000 7f1f01a00700 1 -- 172.21.15.72:0/3165102779 wait complete. 2024-03-19T06:11:53.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.674+0000 7f1f01a00700 1 Processor -- start 2024-03-19T06:11:53.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.674+0000 7f1f01a00700 1 -- start start 2024-03-19T06:11:53.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.675+0000 7f1f01a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1efc0737b0 0x7f1efc19c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:53.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.675+0000 7f1f01a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc074d80 0x7f1efc19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:53.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.675+0000 7f1f01a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc19cbd0 con 0x7f1efc074d80 2024-03-19T06:11:53.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.675+0000 7f1f01a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc19cd10 con 0x7f1efc0737b0 2024-03-19T06:11:53.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.675+0000 7f1ef2000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc074d80 0x7f1efc19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:53.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.675+0000 7f1ef2000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc074d80 0x7f1efc19c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33808/0 (socket says 172.21.15.72:33808) 2024-03-19T06:11:53.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.675+0000 7f1ef2000700 1 -- 172.21.15.72:0/1066883079 learned_addr learned my addr 172.21.15.72:0/1066883079 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:53.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.675+0000 7f1efaa00700 1 --2- 172.21.15.72:0/1066883079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1efc0737b0 0x7f1efc19c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:53.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.675+0000 7f1ef2000700 1 -- 172.21.15.72:0/1066883079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1efc0737b0 msgr2=0x7f1efc19c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:53.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.675+0000 7f1ef2000700 1 --2- 172.21.15.72:0/1066883079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1efc0737b0 0x7f1efc19c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.675+0000 7f1ef2000700 1 -- 172.21.15.72:0/1066883079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee40095f0 con 0x7f1efc074d80 2024-03-19T06:11:53.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.676+0000 7f1ef2000700 1 --2- 172.21.15.72:0/1066883079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc074d80 0x7f1efc19c5b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4005b40 tx=0x7f1ee400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:53.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.676+0000 7f1ef3e00700 1 -- 172.21.15.72:0/1066883079 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ee401d070 con 0x7f1efc074d80 2024-03-19T06:11:53.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.676+0000 7f1ef3e00700 1 -- 172.21.15.72:0/1066883079 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1ee4022470 con 0x7f1efc074d80 2024-03-19T06:11:53.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.676+0000 7f1ef3e00700 1 -- 172.21.15.72:0/1066883079 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ee400f690 con 0x7f1efc074d80 2024-03-19T06:11:53.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.676+0000 7f1f01a00700 1 -- 172.21.15.72:0/1066883079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1efc1a1760 con 0x7f1efc074d80 2024-03-19T06:11:53.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.676+0000 7f1f01a00700 1 -- 172.21.15.72:0/1066883079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1efc1a1c50 con 0x7f1efc074d80 2024-03-19T06:11:53.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.677+0000 7f1f01a00700 1 -- 172.21.15.72:0/1066883079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1efc10f380 con 0x7f1efc074d80 2024-03-19T06:11:53.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.678+0000 7f1ef3e00700 1 -- 172.21.15.72:0/1066883079 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f1ee40225e0 con 0x7f1efc074d80 2024-03-19T06:11:53.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.679+0000 7f1ef3e00700 1 --2- 172.21.15.72:0/1066883079 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1ee006dfa0 0x7f1ee0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:53.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.679+0000 7f1ef3e00700 1 -- 172.21.15.72:0/1066883079 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1ee408f540 con 0x7f1efc074d80 2024-03-19T06:11:53.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.680+0000 7f1efaa00700 1 --2- 172.21.15.72:0/1066883079 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1ee006dfa0 0x7f1ee0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:53.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.680+0000 7f1efaa00700 1 --2- 172.21.15.72:0/1066883079 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1ee006dfa0 0x7f1ee0070450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1eec005fd0 tx=0x7f1eec00a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:53.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.684+0000 7f1ef3e00700 1 -- 172.21.15.72:0/1066883079 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f1ee405c570 con 0x7f1efc074d80 2024-03-19T06:11:53.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.930+0000 7f1f01a00700 1 -- 172.21.15.72:0/1066883079 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1efc1a2290 con 0x7f1ee006dfa0 2024-03-19T06:11:53.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.931+0000 7f1ef3e00700 1 -- 172.21.15.72:0/1066883079 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f1efc1a2290 con 0x7f1ee006dfa0 2024-03-19T06:11:53.920 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:11:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:11:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:11:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:11:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:11:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:11:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:11:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:11:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:11:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "11/23 daemons upgraded", 2024-03-19T06:11:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-03-19T06:11:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:11:53.921 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:11:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.934+0000 7f1f01a00700 1 -- 172.21.15.72:0/1066883079 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1ee006dfa0 msgr2=0x7f1ee0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.934+0000 7f1f01a00700 1 --2- 172.21.15.72:0/1066883079 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1ee006dfa0 0x7f1ee0070450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1eec005fd0 tx=0x7f1eec00a560 comp rx=0 tx=0).stop 2024-03-19T06:11:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.934+0000 7f1f01a00700 1 -- 172.21.15.72:0/1066883079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc074d80 msgr2=0x7f1efc19c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.934+0000 7f1f01a00700 1 --2- 172.21.15.72:0/1066883079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc074d80 0x7f1efc19c5b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4005b40 tx=0x7f1ee400be20 comp rx=0 tx=0).stop 2024-03-19T06:11:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.934+0000 7f1f01a00700 1 -- 172.21.15.72:0/1066883079 shutdown_connections 2024-03-19T06:11:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.934+0000 7f1f01a00700 1 --2- 172.21.15.72:0/1066883079 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1ee006dfa0 0x7f1ee0070450 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.934+0000 7f1f01a00700 1 --2- 172.21.15.72:0/1066883079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1efc0737b0 0x7f1efc19c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.934+0000 7f1f01a00700 1 --2- 172.21.15.72:0/1066883079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc074d80 0x7f1efc19c5b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.934+0000 7f1f01a00700 1 -- 172.21.15.72:0/1066883079 >> 172.21.15.72:0/1066883079 conn(0x7f1efc0fb7f0 msgr2=0x7f1efc101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.934+0000 7f1f01a00700 1 -- 172.21.15.72:0/1066883079 shutdown_connections 2024-03-19T06:11:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:53.935+0000 7f1f01a00700 1 -- 172.21.15.72:0/1066883079 wait complete. 2024-03-19T06:11:53.983 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:53 smithi172 ceph-mon[66682]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:53.983 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:53 smithi172 ceph-mon[66682]: pgmap v160: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 69/396 objects degraded (17.424%) 2024-03-19T06:11:53.984 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:53 smithi172 ceph-mon[66682]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-19T06:11:53.984 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:53 smithi172 ceph-mon[66682]: osd.4 [v2:172.21.15.172:6808/1295620546,v1:172.21.15.172:6809/1295620546] boot 2024-03-19T06:11:53.984 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:53 smithi172 ceph-mon[66682]: osdmap e72: 6 total, 6 up, 6 in 2024-03-19T06:11:53.984 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:53 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T06:11:53.984 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:53 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/364971797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:53.984 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:53 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2599631910' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:11:54.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.109+0000 7f69faa00700 1 -- 172.21.15.72:0/1368545357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4107a40 msgr2=0x7f69f4107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:54.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.109+0000 7f69faa00700 1 --2- 172.21.15.72:0/1368545357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4107a40 0x7f69f4107e90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009910 tx=0x7f69dc009c20 comp rx=0 tx=0).stop 2024-03-19T06:11:54.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.109+0000 7f69faa00700 1 -- 172.21.15.72:0/1368545357 shutdown_connections 2024-03-19T06:11:54.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.109+0000 7f69faa00700 1 --2- 172.21.15.72:0/1368545357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4107a40 0x7f69f4107e90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:54.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.109+0000 7f69faa00700 1 --2- 172.21.15.72:0/1368545357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69f4106840 0x7f69f4106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:54.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.109+0000 7f69faa00700 1 -- 172.21.15.72:0/1368545357 >> 172.21.15.72:0/1368545357 conn(0x7f69f4075970 msgr2=0x7f69f4077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:54.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.109+0000 7f69faa00700 1 -- 172.21.15.72:0/1368545357 shutdown_connections 2024-03-19T06:11:54.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.109+0000 7f69faa00700 1 -- 172.21.15.72:0/1368545357 wait complete. 2024-03-19T06:11:54.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.110+0000 7f69faa00700 1 Processor -- start 2024-03-19T06:11:54.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.110+0000 7f69faa00700 1 -- start start 2024-03-19T06:11:54.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.111+0000 7f69faa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69f4106840 0x7f69f419c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:54.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.111+0000 7f69faa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4107a40 0x7f69f419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:54.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.111+0000 7f69faa00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f419cc40 con 0x7f69f4107a40 2024-03-19T06:11:54.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.111+0000 7f69faa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f419cd80 con 0x7f69f4106840 2024-03-19T06:11:54.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.111+0000 7f69ebe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4107a40 0x7f69f419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:54.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.111+0000 7f69ebe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4107a40 0x7f69f419c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34682/0 (socket says 172.21.15.72:34682) 2024-03-19T06:11:54.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.111+0000 7f69ebe00700 1 -- 172.21.15.72:0/4039137236 learned_addr learned my addr 172.21.15.72:0/4039137236 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:11:54.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.111+0000 7f69f3e00700 1 --2- 172.21.15.72:0/4039137236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69f4106840 0x7f69f419c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:54.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.111+0000 7f69ebe00700 1 -- 172.21.15.72:0/4039137236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69f4106840 msgr2=0x7f69f419c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:54.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.111+0000 7f69ebe00700 1 --2- 172.21.15.72:0/4039137236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69f4106840 0x7f69f419c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:54.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.111+0000 7f69ebe00700 1 -- 172.21.15.72:0/4039137236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc0095f0 con 0x7f69f4107a40 2024-03-19T06:11:54.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.111+0000 7f69f3e00700 1 --2- 172.21.15.72:0/4039137236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69f4106840 0x7f69f419c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:11:54.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.112+0000 7f69ebe00700 1 --2- 172.21.15.72:0/4039137236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4107a40 0x7f69f419c620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00bd70 tx=0x7f69dc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:54.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.112+0000 7f69f1600700 1 -- 172.21.15.72:0/4039137236 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69dc01d070 con 0x7f69f4107a40 2024-03-19T06:11:54.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.112+0000 7f69f1600700 1 -- 172.21.15.72:0/4039137236 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f69dc022470 con 0x7f69f4107a40 2024-03-19T06:11:54.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.112+0000 7f69f1600700 1 -- 172.21.15.72:0/4039137236 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69dc00f670 con 0x7f69f4107a40 2024-03-19T06:11:54.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.112+0000 7f69faa00700 1 -- 172.21.15.72:0/4039137236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f41a17d0 con 0x7f69f4107a40 2024-03-19T06:11:54.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.112+0000 7f69faa00700 1 -- 172.21.15.72:0/4039137236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f41a1cc0 con 0x7f69f4107a40 2024-03-19T06:11:54.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.113+0000 7f69faa00700 1 -- 172.21.15.72:0/4039137236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f410f390 con 0x7f69f4107a40 2024-03-19T06:11:54.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.114+0000 7f69f1600700 1 -- 172.21.15.72:0/4039137236 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f69dc022a50 con 0x7f69f4107a40 2024-03-19T06:11:54.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.115+0000 7f69f1600700 1 --2- 172.21.15.72:0/4039137236 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f69d806dfa0 0x7f69d8070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:11:54.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.115+0000 7f69f1600700 1 -- 172.21.15.72:0/4039137236 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f69dc08f390 con 0x7f69f4107a40 2024-03-19T06:11:54.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.115+0000 7f69f3e00700 1 --2- 172.21.15.72:0/4039137236 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f69d806dfa0 0x7f69d8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:11:54.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.116+0000 7f69f3e00700 1 --2- 172.21.15.72:0/4039137236 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f69d806dfa0 0x7f69d8070450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005fd0 tx=0x7f69e4005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:11:54.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.120+0000 7f69f1600700 1 -- 172.21.15.72:0/4039137236 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f69dc05c630 con 0x7f69f4107a40 2024-03-19T06:11:54.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:53 smithi072 ceph-mon[78545]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:54.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:53 smithi072 ceph-mon[78545]: pgmap v160: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 69/396 objects degraded (17.424%) 2024-03-19T06:11:54.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:53 smithi072 ceph-mon[78545]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-19T06:11:54.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:53 smithi072 ceph-mon[78545]: osd.4 [v2:172.21.15.172:6808/1295620546,v1:172.21.15.172:6809/1295620546] boot 2024-03-19T06:11:54.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:53 smithi072 ceph-mon[78545]: osdmap e72: 6 total, 6 up, 6 in 2024-03-19T06:11:54.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:53 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-19T06:11:54.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:53 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/364971797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:54.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:53 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2599631910' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:11:54.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.427+0000 7f69faa00700 1 -- 172.21.15.72:0/4039137236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f69f410f580 con 0x7f69f4107a40 2024-03-19T06:11:54.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.428+0000 7f69f1600700 1 -- 172.21.15.72:0/4039137236 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1263 (secure 0 0 0) 0x7f69dc05c1c0 con 0x7f69f4107a40 2024-03-19T06:11:54.417 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 69/396 objects degraded (17.424%), 16 pgs degraded 2024-03-19T06:11:54.417 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:11:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:11:54.417 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 69/396 objects degraded (17.424%), 16 pgs degraded 2024-03-19T06:11:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-03-19T06:11:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-03-19T06:11:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-03-19T06:11:54.417 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-03-19T06:11:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-03-19T06:11:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-03-19T06:11:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-03-19T06:11:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-03-19T06:11:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-03-19T06:11:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-03-19T06:11:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-03-19T06:11:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-03-19T06:11:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-03-19T06:11:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-03-19T06:11:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-03-19T06:11:54.418 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-03-19T06:11:54.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.431+0000 7f69faa00700 1 -- 172.21.15.72:0/4039137236 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f69d806dfa0 msgr2=0x7f69d8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:54.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.431+0000 7f69faa00700 1 --2- 172.21.15.72:0/4039137236 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f69d806dfa0 0x7f69d8070450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005fd0 tx=0x7f69e4005dc0 comp rx=0 tx=0).stop 2024-03-19T06:11:54.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.431+0000 7f69faa00700 1 -- 172.21.15.72:0/4039137236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4107a40 msgr2=0x7f69f419c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:11:54.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.431+0000 7f69faa00700 1 --2- 172.21.15.72:0/4039137236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4107a40 0x7f69f419c620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00bd70 tx=0x7f69dc00be50 comp rx=0 tx=0).stop 2024-03-19T06:11:54.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.431+0000 7f69faa00700 1 -- 172.21.15.72:0/4039137236 shutdown_connections 2024-03-19T06:11:54.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.431+0000 7f69faa00700 1 --2- 172.21.15.72:0/4039137236 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f69d806dfa0 0x7f69d8070450 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:54.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.431+0000 7f69faa00700 1 --2- 172.21.15.72:0/4039137236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69f4106840 0x7f69f419c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:54.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.431+0000 7f69faa00700 1 --2- 172.21.15.72:0/4039137236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f4107a40 0x7f69f419c620 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:11:54.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.431+0000 7f69faa00700 1 -- 172.21.15.72:0/4039137236 >> 172.21.15.72:0/4039137236 conn(0x7f69f4075970 msgr2=0x7f69f410ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:11:54.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.431+0000 7f69faa00700 1 -- 172.21.15.72:0/4039137236 shutdown_connections 2024-03-19T06:11:54.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:11:54.431+0000 7f69faa00700 1 -- 172.21.15.72:0/4039137236 wait complete. 2024-03-19T06:11:55.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:54 smithi072 ceph-mon[78545]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:55.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:54 smithi072 ceph-mon[78545]: osdmap e73: 6 total, 6 up, 6 in 2024-03-19T06:11:55.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:54 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/4039137236' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:11:55.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:54 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:55.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:54 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:11:55.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:54 smithi172 ceph-mon[66682]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:11:55.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:54 smithi172 ceph-mon[66682]: osdmap e73: 6 total, 6 up, 6 in 2024-03-19T06:11:55.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:54 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/4039137236' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:11:55.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:54 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:55.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:54 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:11:56.292 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:56 smithi072 ceph-mon[78545]: pgmap v163: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/396 objects degraded (13.636%) 2024-03-19T06:11:56.393 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:56 smithi172 ceph-mon[66682]: pgmap v163: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/396 objects degraded (13.636%) 2024-03-19T06:11:57.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:57.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:57.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:11:57.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:11:57.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:57.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:11:57.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:57.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:57.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:57.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-19T06:11:57.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:57.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:57.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:11:57.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:11:57.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:11:57.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:11:57.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:57.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:57.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:11:57.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-19T06:11:58.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:58 smithi072 ceph-mon[78545]: pgmap v164: 65 pgs: 3 active+undersized+degraded, 3 active+undersized, 59 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/396 objects degraded (2.020%) 2024-03-19T06:11:58.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:58 smithi072 ceph-mon[78545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-19T06:11:58.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:58 smithi072 ceph-mon[78545]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-03-19T06:11:58.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:58 smithi072 ceph-mon[78545]: Health check update: Degraded data redundancy: 8/396 objects degraded (2.020%), 3 pgs degraded (PG_DEGRADED) 2024-03-19T06:11:58.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:58 smithi172 ceph-mon[66682]: pgmap v164: 65 pgs: 3 active+undersized+degraded, 3 active+undersized, 59 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/396 objects degraded (2.020%) 2024-03-19T06:11:58.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:58 smithi172 ceph-mon[66682]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-19T06:11:58.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:58 smithi172 ceph-mon[66682]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-03-19T06:11:58.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:58 smithi172 ceph-mon[66682]: Health check update: Degraded data redundancy: 8/396 objects degraded (2.020%), 3 pgs degraded (PG_DEGRADED) 2024-03-19T06:11:59.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:59 smithi172 ceph-mon[66682]: pgmap v165: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:11:59.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:11:59 smithi172 ceph-mon[66682]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/396 objects degraded (2.020%), 3 pgs degraded) 2024-03-19T06:12:00.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:59 smithi072 ceph-mon[78545]: pgmap v165: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:00.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:11:59 smithi072 ceph-mon[78545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/396 objects degraded (2.020%), 3 pgs degraded) 2024-03-19T06:12:02.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:01 smithi172 ceph-mon[66682]: pgmap v166: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:02.304 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:01 smithi072 ceph-mon[78545]: pgmap v166: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:04.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:03 smithi172 ceph-mon[66682]: pgmap v167: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:04.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:03 smithi072 ceph-mon[78545]: pgmap v167: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:06.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:05 smithi072 ceph-mon[78545]: pgmap v168: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:06.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:06.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:05 smithi172 ceph-mon[66682]: pgmap v168: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:06.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:08.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:07 smithi172 ceph-mon[66682]: pgmap v169: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:08.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:07 smithi072 ceph-mon[78545]: pgmap v169: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:10.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:09 smithi172 ceph-mon[66682]: pgmap v170: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:10.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:10.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:12:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:09 smithi072 ceph-mon[78545]: pgmap v170: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:12:12.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:11 smithi072 ceph-mon[78545]: pgmap v171: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:12.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:11 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-19T06:12:12.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:11 smithi172 ceph-mon[66682]: pgmap v171: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:12.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:11 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-19T06:12:13.122 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:12 smithi172 ceph-mon[66682]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-19T06:12:13.122 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:12 smithi172 ceph-mon[66682]: Upgrade: osd.5 is safe to restart 2024-03-19T06:12:13.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:12 smithi072 ceph-mon[78545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-19T06:12:13.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:12 smithi072 ceph-mon[78545]: Upgrade: osd.5 is safe to restart 2024-03-19T06:12:14.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:13 smithi072 ceph-mon[78545]: pgmap v172: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:14.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:13 smithi172 ceph-mon[66682]: pgmap v172: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:15.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:15 smithi172 ceph-mon[66682]: Upgrade: Updating osd.5 2024-03-19T06:12:15.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:15.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-19T06:12:15.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:15 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:12:15.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:15 smithi172 ceph-mon[66682]: Deploying daemon osd.5 on smithi172 2024-03-19T06:12:15.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:15 smithi072 ceph-mon[78545]: Upgrade: Updating osd.5 2024-03-19T06:12:15.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:15.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-19T06:12:15.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:15 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:12:15.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:15 smithi072 ceph-mon[78545]: Deploying daemon osd.5 on smithi172 2024-03-19T06:12:16.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:16 smithi072 ceph-mon[78545]: pgmap v173: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:16.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:16 smithi172 ceph-mon[66682]: pgmap v173: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:18.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:18 smithi072 ceph-mon[78545]: pgmap v174: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:18.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:18 smithi172 ceph-mon[66682]: pgmap v174: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:19.153 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:18 smithi172 systemd[1]: Stopping Ceph osd.5 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:12:19.653 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:19 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[51116]: 2024-03-19T06:12:19.376+0000 7f88f1600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:12:19.653 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:19 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[51116]: 2024-03-19T06:12:19.376+0000 7f88f1600700 -1 osd.5 73 *** Got signal Terminated *** 2024-03-19T06:12:19.653 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:19 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[51116]: 2024-03-19T06:12:19.376+0000 7f88f1600700 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-19T06:12:20.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:20 smithi072 ceph-mon[78545]: pgmap v175: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:20.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:20 smithi072 ceph-mon[78545]: osd.5 marked itself down and dead 2024-03-19T06:12:20.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:20 smithi172 ceph-mon[66682]: pgmap v175: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:20.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:20 smithi172 ceph-mon[66682]: osd.5 marked itself down and dead 2024-03-19T06:12:21.152 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:20 smithi172 podman[77180]: 2024-03-19 06:12:20.856649681 +0000 UTC m=+1.741275889 container died d7b0f887a54492c30ac0cc6f488b737810055b63d1a662a44a97876b93a26442 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5, RELEASE=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0) 2024-03-19T06:12:21.527 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:21 smithi172 ceph-mon[66682]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-19T06:12:21.527 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:21 smithi172 ceph-mon[66682]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-19T06:12:21.527 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:21 smithi172 ceph-mon[66682]: osdmap e74: 6 total, 5 up, 6 in 2024-03-19T06:12:21.527 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:21 smithi172 podman[77180]: 2024-03-19 06:12:21.31129205 +0000 UTC m=+2.195918274 container cleanup d7b0f887a54492c30ac0cc6f488b737810055b63d1a662a44a97876b93a26442 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.license=GPLv2) 2024-03-19T06:12:21.527 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:21 smithi172 bash[77180]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5 2024-03-19T06:12:21.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:21 smithi072 ceph-mon[78545]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-19T06:12:21.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:21 smithi072 ceph-mon[78545]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-19T06:12:21.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:21 smithi072 ceph-mon[78545]: osdmap e74: 6 total, 5 up, 6 in 2024-03-19T06:12:21.902 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:21 smithi172 podman[77200]: 2024-03-19 06:12:21.537321981 +0000 UTC m=+0.666596150 container remove d7b0f887a54492c30ac0cc6f488b737810055b63d1a662a44a97876b93a26442 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-03-19T06:12:22.543 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:22 smithi172 ceph-mon[66682]: pgmap v177: 65 pgs: 13 stale+active+clean, 52 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:22.543 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:22 smithi172 ceph-mon[66682]: osdmap e75: 6 total, 5 up, 6 in 2024-03-19T06:12:22.543 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:22 smithi172 podman[77289]: 2024-03-19 06:12:22.279811123 +0000 UTC m=+0.038560831 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:12:22.543 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:22 smithi172 podman[77289]: 2024-03-19 06:12:22.379887998 +0000 UTC m=+0.138637736 container create b050d9239c97d068a8b85aa5dcd2d27f720d42a516c77c7413ff6c56664bf67d (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:12:22.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:22 smithi072 ceph-mon[78545]: pgmap v177: 65 pgs: 13 stale+active+clean, 52 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:22.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:22 smithi072 ceph-mon[78545]: osdmap e75: 6 total, 5 up, 6 in 2024-03-19T06:12:22.902 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:22 smithi172 podman[77289]: 2024-03-19 06:12:22.683344476 +0000 UTC m=+0.442094215 container init b050d9239c97d068a8b85aa5dcd2d27f720d42a516c77c7413ff6c56664bf67d (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:12:22.902 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:22 smithi172 podman[77289]: 2024-03-19 06:12:22.694292511 +0000 UTC m=+0.453042250 container start b050d9239c97d068a8b85aa5dcd2d27f720d42a516c77c7413ff6c56664bf67d (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:12:22.902 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:22 smithi172 podman[77289]: 2024-03-19 06:12:22.79077874 +0000 UTC m=+0.549528492 container attach b050d9239c97d068a8b85aa5dcd2d27f720d42a516c77c7413ff6c56664bf67d (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-03-19T06:12:23.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:23 smithi172 ceph-mon[66682]: Health check failed: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-03-19T06:12:23.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:23 smithi172 ceph-mon[66682]: Health check failed: Degraded data redundancy: 9/396 objects degraded (2.273%), 3 pgs degraded (PG_DEGRADED) 2024-03-19T06:12:23.402 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:23 smithi172 podman[77289]: 2024-03-19 06:12:23.129339827 +0000 UTC m=+0.888089522 container died b050d9239c97d068a8b85aa5dcd2d27f720d42a516c77c7413ff6c56664bf67d (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, io.buildah.version=1.33.5) 2024-03-19T06:12:23.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:23 smithi072 ceph-mon[78545]: Health check failed: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-03-19T06:12:23.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:23 smithi072 ceph-mon[78545]: Health check failed: Degraded data redundancy: 9/396 objects degraded (2.273%), 3 pgs degraded (PG_DEGRADED) 2024-03-19T06:12:24.153 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:23 smithi172 podman[77315]: 2024-03-19 06:12:23.894625413 +0000 UTC m=+0.746253121 container remove b050d9239c97d068a8b85aa5dcd2d27f720d42a516c77c7413ff6c56664bf67d (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2) 2024-03-19T06:12:24.153 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:23 smithi172 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.5.service: Deactivated successfully. 2024-03-19T06:12:24.153 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:23 smithi172 systemd[1]: Stopped Ceph osd.5 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:12:24.153 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:23 smithi172 systemd[1]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.5.service: Consumed 1min 38.825s CPU time. 2024-03-19T06:12:24.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:24 smithi072 ceph-mon[78545]: pgmap v179: 65 pgs: 3 active+undersized+degraded, 18 peering, 2 stale+active+clean, 4 active+undersized, 38 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9/396 objects degraded (2.273%) 2024-03-19T06:12:24.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.599+0000 7f34ec000700 1 -- 172.21.15.72:0/3673884976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4100240 msgr2=0x7f34e4100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.599+0000 7f34ec000700 1 --2- 172.21.15.72:0/3673884976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4100240 0x7f34e4100650 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009910 tx=0x7f34d8009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.599+0000 7f34ec000700 1 -- 172.21.15.72:0/3673884976 shutdown_connections 2024-03-19T06:12:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.599+0000 7f34ec000700 1 --2- 172.21.15.72:0/3673884976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e4101440 0x7f34e4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.599+0000 7f34ec000700 1 --2- 172.21.15.72:0/3673884976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4100240 0x7f34e4100650 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.599+0000 7f34ec000700 1 -- 172.21.15.72:0/3673884976 >> 172.21.15.72:0/3673884976 conn(0x7f34e40fb7f0 msgr2=0x7f34e40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.599+0000 7f34ec000700 1 -- 172.21.15.72:0/3673884976 shutdown_connections 2024-03-19T06:12:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.599+0000 7f34ec000700 1 -- 172.21.15.72:0/3673884976 wait complete. 2024-03-19T06:12:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.600+0000 7f34ec000700 1 Processor -- start 2024-03-19T06:12:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.601+0000 7f34ec000700 1 -- start start 2024-03-19T06:12:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.601+0000 7f34ec000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4100240 0x7f34e4195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.601+0000 7f34ec000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e4101440 0x7f34e4195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.601+0000 7f34ec000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4196610 con 0x7f34e4100240 2024-03-19T06:12:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.601+0000 7f34ec000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4196750 con 0x7f34e4101440 2024-03-19T06:12:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.601+0000 7f34e9600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4100240 0x7f34e4195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.601+0000 7f34e9600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4100240 0x7f34e4195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43800/0 (socket says 172.21.15.72:43800) 2024-03-19T06:12:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.601+0000 7f34e9600700 1 -- 172.21.15.72:0/2086185282 learned_addr learned my addr 172.21.15.72:0/2086185282 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:24.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.601+0000 7f34e9600700 1 -- 172.21.15.72:0/2086185282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e4101440 msgr2=0x7f34e4195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.601+0000 7f34e8c00700 1 --2- 172.21.15.72:0/2086185282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e4101440 0x7f34e4195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.602+0000 7f34e9600700 1 --2- 172.21.15.72:0/2086185282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e4101440 0x7f34e4195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.602+0000 7f34e9600700 1 -- 172.21.15.72:0/2086185282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d80095f0 con 0x7f34e4100240 2024-03-19T06:12:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.602+0000 7f34e8c00700 1 --2- 172.21.15.72:0/2086185282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e4101440 0x7f34e4195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:12:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.602+0000 7f34e9600700 1 --2- 172.21.15.72:0/2086185282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4100240 0x7f34e4195ab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f34d800bda0 tx=0x7f34d800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.602+0000 7f34e2000700 1 -- 172.21.15.72:0/2086185282 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34d801d070 con 0x7f34e4100240 2024-03-19T06:12:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.602+0000 7f34e2000700 1 -- 172.21.15.72:0/2086185282 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f34d800f460 con 0x7f34e4100240 2024-03-19T06:12:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.602+0000 7f34ec000700 1 -- 172.21.15.72:0/2086185282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e419b1a0 con 0x7f34e4100240 2024-03-19T06:12:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.602+0000 7f34e2000700 1 -- 172.21.15.72:0/2086185282 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34d8021620 con 0x7f34e4100240 2024-03-19T06:12:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.602+0000 7f34ec000700 1 -- 172.21.15.72:0/2086185282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e419b690 con 0x7f34e4100240 2024-03-19T06:12:24.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.604+0000 7f34ec000700 1 -- 172.21.15.72:0/2086185282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e4108d90 con 0x7f34e4100240 2024-03-19T06:12:24.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.605+0000 7f34e2000700 1 -- 172.21.15.72:0/2086185282 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f34d800f5d0 con 0x7f34e4100240 2024-03-19T06:12:24.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.605+0000 7f34e2000700 1 --2- 172.21.15.72:0/2086185282 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f34cc06dfa0 0x7f34cc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:24.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.606+0000 7f34e2000700 1 -- 172.21.15.72:0/2086185282 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f34d808f120 con 0x7f34e4100240 2024-03-19T06:12:24.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.606+0000 7f34e8c00700 1 --2- 172.21.15.72:0/2086185282 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f34cc06dfa0 0x7f34cc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:24.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.606+0000 7f34e8c00700 1 --2- 172.21.15.72:0/2086185282 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f34cc06dfa0 0x7f34cc070450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34d0005fd0 tx=0x7f34d0005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:24.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.611+0000 7f34e2000700 1 -- 172.21.15.72:0/2086185282 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f34d805c0d0 con 0x7f34e4100240 2024-03-19T06:12:24.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:24 smithi172 ceph-mon[66682]: pgmap v179: 65 pgs: 3 active+undersized+degraded, 18 peering, 2 stale+active+clean, 4 active+undersized, 38 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9/396 objects degraded (2.273%) 2024-03-19T06:12:24.652 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:24 smithi172 systemd[1]: Starting Ceph osd.5 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:12:24.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.856+0000 7f34ec000700 1 -- 172.21.15.72:0/2086185282 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f34e4105d90 con 0x7f34cc06dfa0 2024-03-19T06:12:24.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.865+0000 7f34e2000700 1 -- 172.21.15.72:0/2086185282 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f34e4105d90 con 0x7f34cc06dfa0 2024-03-19T06:12:24.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.868+0000 7f34ec000700 1 -- 172.21.15.72:0/2086185282 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f34cc06dfa0 msgr2=0x7f34cc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:24.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.868+0000 7f34ec000700 1 --2- 172.21.15.72:0/2086185282 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f34cc06dfa0 0x7f34cc070450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34d0005fd0 tx=0x7f34d0005ee0 comp rx=0 tx=0).stop 2024-03-19T06:12:24.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.868+0000 7f34ec000700 1 -- 172.21.15.72:0/2086185282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4100240 msgr2=0x7f34e4195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:24.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.868+0000 7f34ec000700 1 --2- 172.21.15.72:0/2086185282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4100240 0x7f34e4195ab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f34d800bda0 tx=0x7f34d800be80 comp rx=0 tx=0).stop 2024-03-19T06:12:24.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.868+0000 7f34ec000700 1 -- 172.21.15.72:0/2086185282 shutdown_connections 2024-03-19T06:12:24.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.868+0000 7f34ec000700 1 --2- 172.21.15.72:0/2086185282 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f34cc06dfa0 0x7f34cc070450 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:24.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.868+0000 7f34ec000700 1 --2- 172.21.15.72:0/2086185282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4100240 0x7f34e4195ab0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:24.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.868+0000 7f34ec000700 1 --2- 172.21.15.72:0/2086185282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e4101440 0x7f34e4195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:24.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.868+0000 7f34ec000700 1 -- 172.21.15.72:0/2086185282 >> 172.21.15.72:0/2086185282 conn(0x7f34e40fb7f0 msgr2=0x7f34e4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:24.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.868+0000 7f34ec000700 1 -- 172.21.15.72:0/2086185282 shutdown_connections 2024-03-19T06:12:24.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:24.868+0000 7f34ec000700 1 -- 172.21.15.72:0/2086185282 wait complete. 2024-03-19T06:12:24.874 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:12:25.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.028+0000 7fe866a00700 1 -- 172.21.15.72:0/2531530239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860106840 msgr2=0x7fe860106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:25.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.028+0000 7fe866a00700 1 --2- 172.21.15.72:0/2531530239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860106840 0x7fe860106c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe850009910 tx=0x7fe850009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:25.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.028+0000 7fe866a00700 1 -- 172.21.15.72:0/2531530239 shutdown_connections 2024-03-19T06:12:25.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.028+0000 7fe866a00700 1 --2- 172.21.15.72:0/2531530239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860107a40 0x7fe860107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.028+0000 7fe866a00700 1 --2- 172.21.15.72:0/2531530239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860106840 0x7fe860106c50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.028+0000 7fe866a00700 1 -- 172.21.15.72:0/2531530239 >> 172.21.15.72:0/2531530239 conn(0x7fe860075970 msgr2=0x7fe860077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:25.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.029+0000 7fe866a00700 1 -- 172.21.15.72:0/2531530239 shutdown_connections 2024-03-19T06:12:25.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.029+0000 7fe866a00700 1 -- 172.21.15.72:0/2531530239 wait complete. 2024-03-19T06:12:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.030+0000 7fe866a00700 1 Processor -- start 2024-03-19T06:12:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.030+0000 7fe866a00700 1 -- start start 2024-03-19T06:12:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.030+0000 7fe866a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860106840 0x7fe86019c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.030+0000 7fe866a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860107a40 0x7fe86019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.030+0000 7fe866a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86019cd10 con 0x7fe860106840 2024-03-19T06:12:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.030+0000 7fe866a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86019ce50 con 0x7fe860107a40 2024-03-19T06:12:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.030+0000 7fe85fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860106840 0x7fe86019c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.030+0000 7fe85fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860106840 0x7fe86019c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43820/0 (socket says 172.21.15.72:43820) 2024-03-19T06:12:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.030+0000 7fe85fe00700 1 -- 172.21.15.72:0/3332861637 learned_addr learned my addr 172.21.15.72:0/3332861637 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.031+0000 7fe85f400700 1 --2- 172.21.15.72:0/3332861637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860107a40 0x7fe86019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.031+0000 7fe85fe00700 1 -- 172.21.15.72:0/3332861637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860107a40 msgr2=0x7fe86019c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.031+0000 7fe85fe00700 1 --2- 172.21.15.72:0/3332861637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860107a40 0x7fe86019c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.031+0000 7fe85fe00700 1 -- 172.21.15.72:0/3332861637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500095f0 con 0x7fe860106840 2024-03-19T06:12:25.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.031+0000 7fe85fe00700 1 --2- 172.21.15.72:0/3332861637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860106840 0x7fe86019c1b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe85000bd70 tx=0x7fe85000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:25.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.031+0000 7fe85cc00700 1 -- 172.21.15.72:0/3332861637 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe85001d070 con 0x7fe860106840 2024-03-19T06:12:25.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.031+0000 7fe85cc00700 1 -- 172.21.15.72:0/3332861637 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe85000f460 con 0x7fe860106840 2024-03-19T06:12:25.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.031+0000 7fe85cc00700 1 -- 172.21.15.72:0/3332861637 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe850021640 con 0x7fe860106840 2024-03-19T06:12:25.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.031+0000 7fe866a00700 1 -- 172.21.15.72:0/3332861637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8601a18a0 con 0x7fe860106840 2024-03-19T06:12:25.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.032+0000 7fe866a00700 1 -- 172.21.15.72:0/3332861637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8601a1d90 con 0x7fe860106840 2024-03-19T06:12:25.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.033+0000 7fe866a00700 1 -- 172.21.15.72:0/3332861637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86010f410 con 0x7fe860106840 2024-03-19T06:12:25.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.033+0000 7fe85cc00700 1 -- 172.21.15.72:0/3332861637 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fe85000fab0 con 0x7fe860106840 2024-03-19T06:12:25.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.034+0000 7fe85cc00700 1 --2- 172.21.15.72:0/3332861637 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe84406dfa0 0x7fe844070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:25.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.034+0000 7fe85cc00700 1 -- 172.21.15.72:0/3332861637 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe85008efb0 con 0x7fe860106840 2024-03-19T06:12:25.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.035+0000 7fe85f400700 1 --2- 172.21.15.72:0/3332861637 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe84406dfa0 0x7fe844070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:25.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.035+0000 7fe85f400700 1 --2- 172.21.15.72:0/3332861637 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe84406dfa0 0x7fe844070450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe84c006fd0 tx=0x7fe84c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:25.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.039+0000 7fe85cc00700 1 -- 172.21.15.72:0/3332861637 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fe85005c080 con 0x7fe860106840 2024-03-19T06:12:25.061 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:24 smithi172 podman[77415]: 2024-03-19 06:12:24.573999727 +0000 UTC m=+0.032720041 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:12:25.061 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:24 smithi172 podman[77415]: 2024-03-19 06:12:24.904026614 +0000 UTC m=+0.362746998 container create 8a3c0b392a5ee914e88a08d4c286bb2d2d67b5ae30aa46f552fad9bf939cfb1d (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222) 2024-03-19T06:12:25.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.282+0000 7fe866a00700 1 -- 172.21.15.72:0/3332861637 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8601a23d0 con 0x7fe84406dfa0 2024-03-19T06:12:25.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.284+0000 7fe85cc00700 1 -- 172.21.15.72:0/3332861637 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe8601a23d0 con 0x7fe84406dfa0 2024-03-19T06:12:25.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.287+0000 7fe866a00700 1 -- 172.21.15.72:0/3332861637 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe84406dfa0 msgr2=0x7fe844070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:25.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.287+0000 7fe866a00700 1 --2- 172.21.15.72:0/3332861637 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe84406dfa0 0x7fe844070450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe84c006fd0 tx=0x7fe84c008040 comp rx=0 tx=0).stop 2024-03-19T06:12:25.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.287+0000 7fe866a00700 1 -- 172.21.15.72:0/3332861637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860106840 msgr2=0x7fe86019c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:25.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.287+0000 7fe866a00700 1 --2- 172.21.15.72:0/3332861637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860106840 0x7fe86019c1b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe85000bd70 tx=0x7fe85000be50 comp rx=0 tx=0).stop 2024-03-19T06:12:25.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.287+0000 7fe866a00700 1 -- 172.21.15.72:0/3332861637 shutdown_connections 2024-03-19T06:12:25.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.287+0000 7fe866a00700 1 --2- 172.21.15.72:0/3332861637 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe84406dfa0 0x7fe844070450 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.287+0000 7fe866a00700 1 --2- 172.21.15.72:0/3332861637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe860106840 0x7fe86019c1b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.287+0000 7fe866a00700 1 --2- 172.21.15.72:0/3332861637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860107a40 0x7fe86019c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.287+0000 7fe866a00700 1 -- 172.21.15.72:0/3332861637 >> 172.21.15.72:0/3332861637 conn(0x7fe860075970 msgr2=0x7fe86010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:25.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.287+0000 7fe866a00700 1 -- 172.21.15.72:0/3332861637 shutdown_connections 2024-03-19T06:12:25.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.287+0000 7fe866a00700 1 -- 172.21.15.72:0/3332861637 wait complete. 2024-03-19T06:12:25.402 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:25 smithi172 podman[77415]: 2024-03-19 06:12:25.19107113 +0000 UTC m=+0.649791483 container init 8a3c0b392a5ee914e88a08d4c286bb2d2d67b5ae30aa46f552fad9bf939cfb1d (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, ceph=True, org.label-schema.schema-version=1.0) 2024-03-19T06:12:25.402 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:25 smithi172 podman[77415]: 2024-03-19 06:12:25.204564932 +0000 UTC m=+0.663285263 container start 8a3c0b392a5ee914e88a08d4c286bb2d2d67b5ae30aa46f552fad9bf939cfb1d (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True) 2024-03-19T06:12:25.402 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:25 smithi172 podman[77415]: 2024-03-19 06:12:25.281581028 +0000 UTC m=+0.740301359 container attach 8a3c0b392a5ee914e88a08d4c286bb2d2d67b5ae30aa46f552fad9bf939cfb1d (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-19T06:12:25.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.440+0000 7f375d400700 1 -- 172.21.15.72:0/1048495064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3758106840 msgr2=0x7f3758106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:25.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.440+0000 7f375d400700 1 --2- 172.21.15.72:0/1048495064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3758106840 0x7f3758106c50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3748009910 tx=0x7f3748009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:25.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.441+0000 7f375d400700 1 -- 172.21.15.72:0/1048495064 shutdown_connections 2024-03-19T06:12:25.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.441+0000 7f375d400700 1 --2- 172.21.15.72:0/1048495064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3758107a40 0x7f3758107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.441+0000 7f375d400700 1 --2- 172.21.15.72:0/1048495064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3758106840 0x7f3758106c50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.441+0000 7f375d400700 1 -- 172.21.15.72:0/1048495064 >> 172.21.15.72:0/1048495064 conn(0x7f3758075970 msgr2=0x7f3758077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:25.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.441+0000 7f375d400700 1 -- 172.21.15.72:0/1048495064 shutdown_connections 2024-03-19T06:12:25.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.441+0000 7f375d400700 1 -- 172.21.15.72:0/1048495064 wait complete. 2024-03-19T06:12:25.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.442+0000 7f375d400700 1 Processor -- start 2024-03-19T06:12:25.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.442+0000 7f375d400700 1 -- start start 2024-03-19T06:12:25.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.442+0000 7f375d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3758106840 0x7f375819c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:25.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.442+0000 7f375d400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3758107a40 0x7f375819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:25.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.442+0000 7f375d400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375819cc60 con 0x7f3758106840 2024-03-19T06:12:25.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.442+0000 7f375d400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375819cda0 con 0x7f3758107a40 2024-03-19T06:12:25.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.443+0000 7f3756800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3758106840 0x7f375819c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:25.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.443+0000 7f3756800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3758106840 0x7f375819c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43846/0 (socket says 172.21.15.72:43846) 2024-03-19T06:12:25.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.443+0000 7f3756800700 1 -- 172.21.15.72:0/1880326748 learned_addr learned my addr 172.21.15.72:0/1880326748 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:25.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.443+0000 7f3755e00700 1 --2- 172.21.15.72:0/1880326748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3758107a40 0x7f375819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:25.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.443+0000 7f3756800700 1 -- 172.21.15.72:0/1880326748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3758107a40 msgr2=0x7f375819c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:25.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.443+0000 7f3756800700 1 --2- 172.21.15.72:0/1880326748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3758107a40 0x7f375819c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.443+0000 7f3756800700 1 -- 172.21.15.72:0/1880326748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3744009520 con 0x7f3758106840 2024-03-19T06:12:25.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.443+0000 7f3756800700 1 --2- 172.21.15.72:0/1880326748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3758106840 0x7f375819c100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f374800fa00 tx=0x7f374800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:25.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.443+0000 7f374f400700 1 -- 172.21.15.72:0/1880326748 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f374801d070 con 0x7f3758106840 2024-03-19T06:12:25.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.444+0000 7f375d400700 1 -- 172.21.15.72:0/1880326748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37480095f0 con 0x7f3758106840 2024-03-19T06:12:25.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.444+0000 7f374f400700 1 -- 172.21.15.72:0/1880326748 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3748005640 con 0x7f3758106840 2024-03-19T06:12:25.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.444+0000 7f374f400700 1 -- 172.21.15.72:0/1880326748 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3748017630 con 0x7f3758106840 2024-03-19T06:12:25.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.444+0000 7f375d400700 1 -- 172.21.15.72:0/1880326748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37581a1b50 con 0x7f3758106840 2024-03-19T06:12:25.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.445+0000 7f375d400700 1 -- 172.21.15.72:0/1880326748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375810f390 con 0x7f3758106840 2024-03-19T06:12:25.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.446+0000 7f374f400700 1 -- 172.21.15.72:0/1880326748 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f37480050d0 con 0x7f3758106840 2024-03-19T06:12:25.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.447+0000 7f374f400700 1 --2- 172.21.15.72:0/1880326748 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f373c06dfa0 0x7f373c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:25.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.447+0000 7f374f400700 1 -- 172.21.15.72:0/1880326748 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f374808f1a0 con 0x7f3758106840 2024-03-19T06:12:25.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.447+0000 7f3755e00700 1 --2- 172.21.15.72:0/1880326748 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f373c06dfa0 0x7f373c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:25.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.448+0000 7f3755e00700 1 --2- 172.21.15.72:0/1880326748 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f373c06dfa0 0x7f373c070450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3744009d80 tx=0x7f3744009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:25.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.452+0000 7f374f400700 1 -- 172.21.15.72:0/1880326748 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f374805c1f0 con 0x7f3758106840 2024-03-19T06:12:25.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.676+0000 7f375d400700 1 -- 172.21.15.72:0/1880326748 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f37581a2190 con 0x7f373c06dfa0 2024-03-19T06:12:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.692+0000 7f374f400700 1 -- 172.21.15.72:0/1880326748 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f37581a2190 con 0x7f373c06dfa0 2024-03-19T06:12:25.683 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:12:25.683 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (16m) 103s ago 18m 14.0M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:12:25.683 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (19m) 103s ago 19m 8678k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:12:25.683 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (17m) 35s ago 17m 8472k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:12:25.683 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (3m) 103s ago 19m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:12:25.683 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (3m) 35s ago 17m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:12:25.683 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (16m) 103s ago 18m 71.5M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:12:25.683 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (11m) 103s ago 11m 16.5M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:12:25.683 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (11m) 103s ago 11m 126M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:12:25.683 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (11m) 35s ago 11m 17.0M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:12:25.683 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (11m) 35s ago 11m 142M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (7m) 103s ago 20m 504M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (5m) 35s ago 17m 451M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (5m) 103s ago 21m 50.4M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (4m) 35s ago 17m 39.6M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (19m) 103s ago 19m 8196k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (17m) 35s ago 17m 8346k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (2m) 103s ago 16m 87.0M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (2m) 103s ago 15m 87.1M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (111s) 103s ago 15m 11.2M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (82s) 35s ago 14m 88.9M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (40s) 35s ago 13m 11.2M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (13m) 35s ago 13m 194M 2241M 18.2.0 dc2bc1663786 d7b0f887a544 2024-03-19T06:12:25.684 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (6m) 103s ago 18m 67.0M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:12:25.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.695+0000 7f375d400700 1 -- 172.21.15.72:0/1880326748 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f373c06dfa0 msgr2=0x7f373c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:25.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.695+0000 7f375d400700 1 --2- 172.21.15.72:0/1880326748 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f373c06dfa0 0x7f373c070450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3744009d80 tx=0x7f3744009260 comp rx=0 tx=0).stop 2024-03-19T06:12:25.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.695+0000 7f375d400700 1 -- 172.21.15.72:0/1880326748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3758106840 msgr2=0x7f375819c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:25.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.695+0000 7f375d400700 1 --2- 172.21.15.72:0/1880326748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3758106840 0x7f375819c100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f374800fa00 tx=0x7f374800fae0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.695+0000 7f375d400700 1 -- 172.21.15.72:0/1880326748 shutdown_connections 2024-03-19T06:12:25.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.695+0000 7f375d400700 1 --2- 172.21.15.72:0/1880326748 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f373c06dfa0 0x7f373c070450 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.695+0000 7f375d400700 1 --2- 172.21.15.72:0/1880326748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3758106840 0x7f375819c100 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.695+0000 7f375d400700 1 --2- 172.21.15.72:0/1880326748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3758107a40 0x7f375819c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.695+0000 7f375d400700 1 -- 172.21.15.72:0/1880326748 >> 172.21.15.72:0/1880326748 conn(0x7f3758075970 msgr2=0x7f375810ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:25.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.695+0000 7f375d400700 1 -- 172.21.15.72:0/1880326748 shutdown_connections 2024-03-19T06:12:25.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.695+0000 7f375d400700 1 -- 172.21.15.72:0/1880326748 wait complete. 2024-03-19T06:12:25.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.843+0000 7fa027200700 1 -- 172.21.15.72:0/1447576668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa020107a40 msgr2=0x7fa020107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:25.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.843+0000 7fa027200700 1 --2- 172.21.15.72:0/1447576668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa020107a40 0x7fa020107e90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa00c009910 tx=0x7fa00c009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:25.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.843+0000 7fa027200700 1 -- 172.21.15.72:0/1447576668 shutdown_connections 2024-03-19T06:12:25.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.843+0000 7fa027200700 1 --2- 172.21.15.72:0/1447576668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa020107a40 0x7fa020107e90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.843+0000 7fa027200700 1 --2- 172.21.15.72:0/1447576668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa020106840 0x7fa020106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.843+0000 7fa027200700 1 -- 172.21.15.72:0/1447576668 >> 172.21.15.72:0/1447576668 conn(0x7fa020075970 msgr2=0x7fa020077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:25.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.843+0000 7fa027200700 1 -- 172.21.15.72:0/1447576668 shutdown_connections 2024-03-19T06:12:25.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.843+0000 7fa027200700 1 -- 172.21.15.72:0/1447576668 wait complete. 2024-03-19T06:12:25.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.844+0000 7fa027200700 1 Processor -- start 2024-03-19T06:12:25.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.844+0000 7fa027200700 1 -- start start 2024-03-19T06:12:25.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.845+0000 7fa027200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa020106840 0x7fa02019c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:25.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.845+0000 7fa027200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa020107a40 0x7fa02019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:25.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.845+0000 7fa027200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02019cce0 con 0x7fa020106840 2024-03-19T06:12:25.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.845+0000 7fa027200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02019ce20 con 0x7fa020107a40 2024-03-19T06:12:25.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.845+0000 7fa01fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa020106840 0x7fa02019c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:25.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.845+0000 7fa01fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa020106840 0x7fa02019c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43864/0 (socket says 172.21.15.72:43864) 2024-03-19T06:12:25.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.845+0000 7fa01fe00700 1 -- 172.21.15.72:0/2774705237 learned_addr learned my addr 172.21.15.72:0/2774705237 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:25.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.845+0000 7fa01f400700 1 --2- 172.21.15.72:0/2774705237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa020107a40 0x7fa02019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:25.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.845+0000 7fa01fe00700 1 -- 172.21.15.72:0/2774705237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa020107a40 msgr2=0x7fa02019c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:25.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.845+0000 7fa01fe00700 1 --2- 172.21.15.72:0/2774705237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa020107a40 0x7fa02019c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:25.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.845+0000 7fa01fe00700 1 -- 172.21.15.72:0/2774705237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0095f0 con 0x7fa020106840 2024-03-19T06:12:25.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.846+0000 7fa01fe00700 1 --2- 172.21.15.72:0/2774705237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa020106840 0x7fa02019c180 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa01000b480 tx=0x7fa01000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:25.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.846+0000 7fa01cc00700 1 -- 172.21.15.72:0/2774705237 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0100118c0 con 0x7fa020106840 2024-03-19T06:12:25.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.846+0000 7fa01cc00700 1 -- 172.21.15.72:0/2774705237 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa010010380 con 0x7fa020106840 2024-03-19T06:12:25.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.846+0000 7fa01cc00700 1 -- 172.21.15.72:0/2774705237 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa01000f4f0 con 0x7fa020106840 2024-03-19T06:12:25.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.846+0000 7fa027200700 1 -- 172.21.15.72:0/2774705237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0201a18d0 con 0x7fa020106840 2024-03-19T06:12:25.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.846+0000 7fa027200700 1 -- 172.21.15.72:0/2774705237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0201a1e20 con 0x7fa020106840 2024-03-19T06:12:25.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.847+0000 7fa027200700 1 -- 172.21.15.72:0/2774705237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02010f430 con 0x7fa020106840 2024-03-19T06:12:25.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.848+0000 7fa01cc00700 1 -- 172.21.15.72:0/2774705237 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fa0100104f0 con 0x7fa020106840 2024-03-19T06:12:25.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.849+0000 7fa01cc00700 1 --2- 172.21.15.72:0/2774705237 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa00406dfa0 0x7fa004070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:25.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.849+0000 7fa01cc00700 1 -- 172.21.15.72:0/2774705237 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa01008d870 con 0x7fa020106840 2024-03-19T06:12:25.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.850+0000 7fa01f400700 1 --2- 172.21.15.72:0/2774705237 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa00406dfa0 0x7fa004070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:25.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.850+0000 7fa01f400700 1 --2- 172.21.15.72:0/2774705237 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa00406dfa0 0x7fa004070450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa00c006010 tx=0x7fa00c00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:25.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:25.854+0000 7fa01cc00700 1 -- 172.21.15.72:0/2774705237 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fa01005a940 con 0x7fa020106840 2024-03-19T06:12:26.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:25 smithi072 ceph-mon[78545]: pgmap v180: 65 pgs: 3 active+undersized+degraded, 18 peering, 7 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9/396 objects degraded (2.273%) 2024-03-19T06:12:26.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:26.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:12:26.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:25 smithi072 ceph-mon[78545]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:12:26.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:25 smithi072 ceph-mon[78545]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:12:26.117 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:25 smithi172 ceph-mon[66682]: pgmap v180: 65 pgs: 3 active+undersized+degraded, 18 peering, 7 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9/396 objects degraded (2.273%) 2024-03-19T06:12:26.117 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:26.117 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:12:26.117 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:25 smithi172 ceph-mon[66682]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:12:26.117 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:25 smithi172 ceph-mon[66682]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:12:26.118 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate[77430]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-19T06:12:26.118 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate[77430]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-19T06:12:26.118 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 bash[77415]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-19T06:12:26.118 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 bash[77415]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-19T06:12:26.118 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 bash[77415]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-19T06:12:26.118 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 bash[77415]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-19T06:12:26.118 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 bash[77415]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-03-19T06:12:26.118 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 bash[77415]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-19T06:12:26.118 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 bash[77415]: --> ceph-volume raw activate successful for osd ID: 5 2024-03-19T06:12:26.119 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate[77430]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-19T06:12:26.119 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate[77430]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-19T06:12:26.119 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate[77430]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-03-19T06:12:26.119 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate[77430]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-19T06:12:26.119 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate[77430]: --> ceph-volume raw activate successful for osd ID: 5 2024-03-19T06:12:26.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.153+0000 7fa027200700 1 -- 172.21.15.72:0/2774705237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa0201a2490 con 0x7fa020106840 2024-03-19T06:12:26.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.154+0000 7fa01cc00700 1 -- 172.21.15.72:0/2774705237 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+700 (secure 0 0 0) 0x7fa01005a4d0 con 0x7fa020106840 2024-03-19T06:12:26.144 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:12:26.144 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:12:26.144 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 5 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 9 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:12:26.145 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:12:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.157+0000 7fa027200700 1 -- 172.21.15.72:0/2774705237 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa00406dfa0 msgr2=0x7fa004070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.157+0000 7fa027200700 1 --2- 172.21.15.72:0/2774705237 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa00406dfa0 0x7fa004070450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa00c006010 tx=0x7fa00c00b540 comp rx=0 tx=0).stop 2024-03-19T06:12:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.157+0000 7fa027200700 1 -- 172.21.15.72:0/2774705237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa020106840 msgr2=0x7fa02019c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.157+0000 7fa027200700 1 --2- 172.21.15.72:0/2774705237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa020106840 0x7fa02019c180 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa01000b480 tx=0x7fa01000b840 comp rx=0 tx=0).stop 2024-03-19T06:12:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.157+0000 7fa027200700 1 -- 172.21.15.72:0/2774705237 shutdown_connections 2024-03-19T06:12:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.157+0000 7fa027200700 1 --2- 172.21.15.72:0/2774705237 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa00406dfa0 0x7fa004070450 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.157+0000 7fa027200700 1 --2- 172.21.15.72:0/2774705237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa020106840 0x7fa02019c180 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.157+0000 7fa027200700 1 --2- 172.21.15.72:0/2774705237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa020107a40 0x7fa02019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.157+0000 7fa027200700 1 -- 172.21.15.72:0/2774705237 >> 172.21.15.72:0/2774705237 conn(0x7fa020075970 msgr2=0x7fa02010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.158+0000 7fa027200700 1 -- 172.21.15.72:0/2774705237 shutdown_connections 2024-03-19T06:12:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.158+0000 7fa027200700 1 -- 172.21.15.72:0/2774705237 wait complete. 2024-03-19T06:12:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.313+0000 7f4eaea00700 1 -- 172.21.15.72:0/2587151715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea8103460 msgr2=0x7f4ea81038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.313+0000 7f4eaea00700 1 --2- 172.21.15.72:0/2587151715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea8103460 0x7f4ea81038b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009910 tx=0x7f4e94009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.313+0000 7f4eaea00700 1 -- 172.21.15.72:0/2587151715 shutdown_connections 2024-03-19T06:12:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.313+0000 7f4eaea00700 1 --2- 172.21.15.72:0/2587151715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea8103460 0x7f4ea81038b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.314+0000 7f4eaea00700 1 --2- 172.21.15.72:0/2587151715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ea8102260 0x7f4ea8102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.314+0000 7f4eaea00700 1 -- 172.21.15.72:0/2587151715 >> 172.21.15.72:0/2587151715 conn(0x7f4ea80fd8d0 msgr2=0x7f4ea80ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.314+0000 7f4eaea00700 1 -- 172.21.15.72:0/2587151715 shutdown_connections 2024-03-19T06:12:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.314+0000 7f4eaea00700 1 -- 172.21.15.72:0/2587151715 wait complete. 2024-03-19T06:12:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.315+0000 7f4eaea00700 1 Processor -- start 2024-03-19T06:12:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.315+0000 7f4eaea00700 1 -- start start 2024-03-19T06:12:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.315+0000 7f4eaea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea8102260 0x7f4ea8197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.315+0000 7f4eaea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ea8103460 0x7f4ea8197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.315+0000 7f4eaea00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea81985e0 con 0x7f4ea8102260 2024-03-19T06:12:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.315+0000 7f4eaea00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8198720 con 0x7f4ea8103460 2024-03-19T06:12:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.315+0000 7f4ead600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea8102260 0x7f4ea8197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.316+0000 7f4ead600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea8102260 0x7f4ea8197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43886/0 (socket says 172.21.15.72:43886) 2024-03-19T06:12:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.316+0000 7f4ead600700 1 -- 172.21.15.72:0/3535565212 learned_addr learned my addr 172.21.15.72:0/3535565212 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:26.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.316+0000 7f4eacc00700 1 --2- 172.21.15.72:0/3535565212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ea8103460 0x7f4ea8197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:26.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.316+0000 7f4ead600700 1 -- 172.21.15.72:0/3535565212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ea8103460 msgr2=0x7f4ea8197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:26.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.316+0000 7f4ead600700 1 --2- 172.21.15.72:0/3535565212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ea8103460 0x7f4ea8197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.316+0000 7f4ead600700 1 -- 172.21.15.72:0/3535565212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940095f0 con 0x7f4ea8102260 2024-03-19T06:12:26.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.316+0000 7f4ead600700 1 --2- 172.21.15.72:0/3535565212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea8102260 0x7f4ea8197a80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00c8f0 tx=0x7f4e9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:26.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.317+0000 7f4ea6000700 1 -- 172.21.15.72:0/3535565212 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e9c007a70 con 0x7f4ea8102260 2024-03-19T06:12:26.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.317+0000 7f4ea6000700 1 -- 172.21.15.72:0/3535565212 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4e9c007bd0 con 0x7f4ea8102260 2024-03-19T06:12:26.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.317+0000 7f4ea6000700 1 -- 172.21.15.72:0/3535565212 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e9c018630 con 0x7f4ea8102260 2024-03-19T06:12:26.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.317+0000 7f4eaea00700 1 -- 172.21.15.72:0/3535565212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea819d1d0 con 0x7f4ea8102260 2024-03-19T06:12:26.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.317+0000 7f4eaea00700 1 -- 172.21.15.72:0/3535565212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea819d720 con 0x7f4ea8102260 2024-03-19T06:12:26.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.318+0000 7f4eaea00700 1 -- 172.21.15.72:0/3535565212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea810adb0 con 0x7f4ea8102260 2024-03-19T06:12:26.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.319+0000 7f4ea6000700 1 -- 172.21.15.72:0/3535565212 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f4e9c00f450 con 0x7f4ea8102260 2024-03-19T06:12:26.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.320+0000 7f4ea6000700 1 --2- 172.21.15.72:0/3535565212 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4e9006dfa0 0x7f4e90070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:26.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.320+0000 7f4ea6000700 1 -- 172.21.15.72:0/3535565212 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4e9c08dc40 con 0x7f4ea8102260 2024-03-19T06:12:26.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.320+0000 7f4eacc00700 1 --2- 172.21.15.72:0/3535565212 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4e9006dfa0 0x7f4e90070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:26.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.321+0000 7f4eacc00700 1 --2- 172.21.15.72:0/3535565212 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4e9006dfa0 0x7f4e90070450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e94006010 tx=0x7f4e9400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:26.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.325+0000 7f4ea6000700 1 -- 172.21.15.72:0/3535565212 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f4e9c05adc0 con 0x7f4ea8102260 2024-03-19T06:12:26.402 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 podman[77415]: 2024-03-19 06:12:26.128041726 +0000 UTC m=+1.586762088 container died 8a3c0b392a5ee914e88a08d4c286bb2d2d67b5ae30aa46f552fad9bf939cfb1d (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.build-date=20240222, GIT_CLEAN=True) 2024-03-19T06:12:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.599+0000 7f4eaea00700 1 -- 172.21.15.72:0/3535565212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4ea819ddc0 con 0x7f4ea8102260 2024-03-19T06:12:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.600+0000 7f4ea6000700 1 -- 172.21.15.72:0/3535565212 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1852 (secure 0 0 0) 0x7f4e9c05a950 con 0x7f4ea8102260 2024-03-19T06:12:26.590 INFO:teuthology.orchestra.run.smithi072.stdout:e17 2024-03-19T06:12:26.590 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:12:26.590 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:12:26.590 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:12:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:12:26.590 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:12:26.590 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:12:26.590 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 17 2024-03-19T06:12:26.590 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:12:26.590 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:12:26.590 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:10:32.464152+0000 2024-03-19T06:12:26.590 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:12:26.591 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:12:26.592 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:12:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.602+0000 7f4eaea00700 1 -- 172.21.15.72:0/3535565212 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4e9006dfa0 msgr2=0x7f4e90070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.602+0000 7f4eaea00700 1 --2- 172.21.15.72:0/3535565212 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4e9006dfa0 0x7f4e90070450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e94006010 tx=0x7f4e9400b540 comp rx=0 tx=0).stop 2024-03-19T06:12:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.602+0000 7f4eaea00700 1 -- 172.21.15.72:0/3535565212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea8102260 msgr2=0x7f4ea8197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.602+0000 7f4eaea00700 1 --2- 172.21.15.72:0/3535565212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea8102260 0x7f4ea8197a80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00c8f0 tx=0x7f4e9c00ccb0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.603+0000 7f4eaea00700 1 -- 172.21.15.72:0/3535565212 shutdown_connections 2024-03-19T06:12:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.603+0000 7f4eaea00700 1 --2- 172.21.15.72:0/3535565212 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4e9006dfa0 0x7f4e90070450 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.603+0000 7f4eaea00700 1 --2- 172.21.15.72:0/3535565212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea8102260 0x7f4ea8197a80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.603+0000 7f4eaea00700 1 --2- 172.21.15.72:0/3535565212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ea8103460 0x7f4ea8197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.603+0000 7f4eaea00700 1 -- 172.21.15.72:0/3535565212 >> 172.21.15.72:0/3535565212 conn(0x7f4ea80fd8d0 msgr2=0x7f4ea8106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.603+0000 7f4eaea00700 1 -- 172.21.15.72:0/3535565212 shutdown_connections 2024-03-19T06:12:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.603+0000 7f4eaea00700 1 -- 172.21.15.72:0/3535565212 wait complete. 2024-03-19T06:12:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2024-03-19T06:12:26.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.757+0000 7facb1e00700 1 -- 172.21.15.72:0/934632513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac102430 msgr2=0x7facac102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:26.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.757+0000 7facb1e00700 1 --2- 172.21.15.72:0/934632513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac102430 0x7facac102840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009910 tx=0x7fac9c009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:26.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.757+0000 7facb1e00700 1 -- 172.21.15.72:0/934632513 shutdown_connections 2024-03-19T06:12:26.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.757+0000 7facb1e00700 1 --2- 172.21.15.72:0/934632513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facac1036d0 0x7facac103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.757+0000 7facb1e00700 1 --2- 172.21.15.72:0/934632513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac102430 0x7facac102840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.757+0000 7facb1e00700 1 -- 172.21.15.72:0/934632513 >> 172.21.15.72:0/934632513 conn(0x7facac0fda80 msgr2=0x7facac0ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:26.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.757+0000 7facb1e00700 1 -- 172.21.15.72:0/934632513 shutdown_connections 2024-03-19T06:12:26.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.757+0000 7facb1e00700 1 -- 172.21.15.72:0/934632513 wait complete. 2024-03-19T06:12:26.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.758+0000 7facb1e00700 1 Processor -- start 2024-03-19T06:12:26.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.758+0000 7facb1e00700 1 -- start start 2024-03-19T06:12:26.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.759+0000 7facb1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac102430 0x7facac197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:26.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.759+0000 7facb1e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facac1036d0 0x7facac198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:26.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.759+0000 7facb1e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac1987c0 con 0x7facac102430 2024-03-19T06:12:26.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.759+0000 7facb1e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac198930 con 0x7facac1036d0 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.759+0000 7facaaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac102430 0x7facac197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.759+0000 7facaaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac102430 0x7facac197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43914/0 (socket says 172.21.15.72:43914) 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.759+0000 7facaaa00700 1 -- 172.21.15.72:0/3758096198 learned_addr learned my addr 172.21.15.72:0/3758096198 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.759+0000 7facaa000700 1 --2- 172.21.15.72:0/3758096198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facac1036d0 0x7facac198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.759+0000 7facaaa00700 1 -- 172.21.15.72:0/3758096198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facac1036d0 msgr2=0x7facac198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.759+0000 7facaaa00700 1 --2- 172.21.15.72:0/3758096198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facac1036d0 0x7facac198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.759+0000 7facaaa00700 1 -- 172.21.15.72:0/3758096198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0095f0 con 0x7facac102430 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.760+0000 7facaaa00700 1 --2- 172.21.15.72:0/3758096198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac102430 0x7facac197cf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0092e0 tx=0x7fac9c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.760+0000 7facb0a00700 1 -- 172.21.15.72:0/3758096198 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac9c01d070 con 0x7facac102430 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.760+0000 7facb0a00700 1 -- 172.21.15.72:0/3758096198 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fac9c00f460 con 0x7facac102430 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.760+0000 7facb1e00700 1 -- 172.21.15.72:0/3758096198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac19d320 con 0x7facac102430 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.760+0000 7facb0a00700 1 -- 172.21.15.72:0/3758096198 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac9c017610 con 0x7facac102430 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.760+0000 7facb1e00700 1 -- 172.21.15.72:0/3758096198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac19d810 con 0x7facac102430 2024-03-19T06:12:26.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.761+0000 7facb1e00700 1 -- 172.21.15.72:0/3758096198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac10af10 con 0x7facac102430 2024-03-19T06:12:26.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.762+0000 7facb0a00700 1 -- 172.21.15.72:0/3758096198 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fac9c00f5d0 con 0x7facac102430 2024-03-19T06:12:26.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.763+0000 7facb0a00700 1 --2- 172.21.15.72:0/3758096198 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fac9006dfa0 0x7fac90070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:26.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.763+0000 7facb0a00700 1 -- 172.21.15.72:0/3758096198 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fac9c08f310 con 0x7facac102430 2024-03-19T06:12:26.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.763+0000 7facaa000700 1 --2- 172.21.15.72:0/3758096198 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fac9006dfa0 0x7fac90070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:26.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.764+0000 7facaa000700 1 --2- 172.21.15.72:0/3758096198 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fac9006dfa0 0x7fac90070450 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fac9800ba60 tx=0x7fac98005d50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:26.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:26.768+0000 7facb0a00700 1 -- 172.21.15.72:0/3758096198 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fac9c0588b0 con 0x7facac102430 2024-03-19T06:12:26.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.005+0000 7facb1e00700 1 -- 172.21.15.72:0/3758096198 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7facac19dea0 con 0x7fac9006dfa0 2024-03-19T06:12:26.995 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:26 smithi072 ceph-mon[78545]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:12:26.995 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:26 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2774705237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:26.995 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:26 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3535565212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:12:26.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.007+0000 7facb0a00700 1 -- 172.21.15.72:0/3758096198 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7facac19dea0 con 0x7fac9006dfa0 2024-03-19T06:12:26.997 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:12:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:12:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:12:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:12:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:12:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:12:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:12:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:12:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:12:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "11/23 daemons upgraded", 2024-03-19T06:12:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-03-19T06:12:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:12:26.998 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:12:27.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.010+0000 7facb1e00700 1 -- 172.21.15.72:0/3758096198 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fac9006dfa0 msgr2=0x7fac90070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:27.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.010+0000 7facb1e00700 1 --2- 172.21.15.72:0/3758096198 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fac9006dfa0 0x7fac90070450 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fac9800ba60 tx=0x7fac98005d50 comp rx=0 tx=0).stop 2024-03-19T06:12:27.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.010+0000 7facb1e00700 1 -- 172.21.15.72:0/3758096198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac102430 msgr2=0x7facac197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:27.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.010+0000 7facb1e00700 1 --2- 172.21.15.72:0/3758096198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac102430 0x7facac197cf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0092e0 tx=0x7fac9c00be20 comp rx=0 tx=0).stop 2024-03-19T06:12:27.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.010+0000 7facb1e00700 1 -- 172.21.15.72:0/3758096198 shutdown_connections 2024-03-19T06:12:27.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.010+0000 7facb1e00700 1 --2- 172.21.15.72:0/3758096198 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fac9006dfa0 0x7fac90070450 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:27.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.010+0000 7facb1e00700 1 --2- 172.21.15.72:0/3758096198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac102430 0x7facac197cf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:27.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.010+0000 7facb1e00700 1 --2- 172.21.15.72:0/3758096198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facac1036d0 0x7facac198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:27.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.010+0000 7facb1e00700 1 -- 172.21.15.72:0/3758096198 >> 172.21.15.72:0/3758096198 conn(0x7facac0fda80 msgr2=0x7facac106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:27.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.010+0000 7facb1e00700 1 -- 172.21.15.72:0/3758096198 shutdown_connections 2024-03-19T06:12:27.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.010+0000 7facb1e00700 1 -- 172.21.15.72:0/3758096198 wait complete. 2024-03-19T06:12:27.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:26 smithi172 ceph-mon[66682]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:12:27.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:26 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2774705237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:27.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:26 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3535565212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:12:27.153 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:26 smithi172 podman[77551]: 2024-03-19 06:12:26.868794711 +0000 UTC m=+0.720024488 container remove 8a3c0b392a5ee914e88a08d4c286bb2d2d67b5ae30aa46f552fad9bf939cfb1d (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-activate, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0) 2024-03-19T06:12:27.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.162+0000 7fa1b7600700 1 -- 172.21.15.72:0/950000074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b0100240 msgr2=0x7fa1b0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:27.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.162+0000 7fa1b7600700 1 --2- 172.21.15.72:0/950000074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b0100240 0x7fa1b0100650 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009910 tx=0x7fa1a4009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.162+0000 7fa1b7600700 1 -- 172.21.15.72:0/950000074 shutdown_connections 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.162+0000 7fa1b7600700 1 --2- 172.21.15.72:0/950000074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1b01014e0 0x7fa1b0101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.162+0000 7fa1b7600700 1 --2- 172.21.15.72:0/950000074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b0100240 0x7fa1b0100650 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.162+0000 7fa1b7600700 1 -- 172.21.15.72:0/950000074 >> 172.21.15.72:0/950000074 conn(0x7fa1b00fb890 msgr2=0x7fa1b00fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.162+0000 7fa1b7600700 1 -- 172.21.15.72:0/950000074 shutdown_connections 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.162+0000 7fa1b7600700 1 -- 172.21.15.72:0/950000074 wait complete. 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.163+0000 7fa1b7600700 1 Processor -- start 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.163+0000 7fa1b7600700 1 -- start start 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.164+0000 7fa1b7600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1b0100240 0x7fa1b0197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.164+0000 7fa1b7600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b01014e0 0x7fa1b01981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.164+0000 7fa1b7600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0198740 con 0x7fa1b01014e0 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.164+0000 7fa1b7600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b01988b0 con 0x7fa1b0100240 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.164+0000 7fa1afe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b01014e0 0x7fa1b01981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.164+0000 7fa1afe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b01014e0 0x7fa1b01981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43930/0 (socket says 172.21.15.72:43930) 2024-03-19T06:12:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.164+0000 7fa1afe00700 1 -- 172.21.15.72:0/2532729713 learned_addr learned my addr 172.21.15.72:0/2532729713 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:27.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.164+0000 7fa1b4c00700 1 --2- 172.21.15.72:0/2532729713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1b0100240 0x7fa1b0197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:27.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.164+0000 7fa1afe00700 1 -- 172.21.15.72:0/2532729713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1b0100240 msgr2=0x7fa1b0197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:27.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.164+0000 7fa1afe00700 1 --2- 172.21.15.72:0/2532729713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1b0100240 0x7fa1b0197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:27.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.164+0000 7fa1afe00700 1 -- 172.21.15.72:0/2532729713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a40095f0 con 0x7fa1b01014e0 2024-03-19T06:12:27.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.165+0000 7fa1afe00700 1 --2- 172.21.15.72:0/2532729713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b01014e0 0x7fa1b01981d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00c930 tx=0x7fa19c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:27.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.165+0000 7fa1ad600700 1 -- 172.21.15.72:0/2532729713 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa19c007ad0 con 0x7fa1b01014e0 2024-03-19T06:12:27.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.165+0000 7fa1ad600700 1 -- 172.21.15.72:0/2532729713 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa19c007c30 con 0x7fa1b01014e0 2024-03-19T06:12:27.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.165+0000 7fa1b7600700 1 -- 172.21.15.72:0/2532729713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b019d350 con 0x7fa1b01014e0 2024-03-19T06:12:27.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.165+0000 7fa1ad600700 1 -- 172.21.15.72:0/2532729713 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa19c018630 con 0x7fa1b01014e0 2024-03-19T06:12:27.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.165+0000 7fa1b7600700 1 -- 172.21.15.72:0/2532729713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b019d8a0 con 0x7fa1b01014e0 2024-03-19T06:12:27.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.166+0000 7fa1b7600700 1 -- 172.21.15.72:0/2532729713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b01055c0 con 0x7fa1b01014e0 2024-03-19T06:12:27.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.167+0000 7fa1ad600700 1 -- 172.21.15.72:0/2532729713 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fa19c00f450 con 0x7fa1b01014e0 2024-03-19T06:12:27.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.168+0000 7fa1ad600700 1 --2- 172.21.15.72:0/2532729713 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa19806dfa0 0x7fa198070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:27.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.168+0000 7fa1ad600700 1 -- 172.21.15.72:0/2532729713 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa19c08de60 con 0x7fa1b01014e0 2024-03-19T06:12:27.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.169+0000 7fa1b4c00700 1 --2- 172.21.15.72:0/2532729713 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa19806dfa0 0x7fa198070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:27.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.169+0000 7fa1b4c00700 1 --2- 172.21.15.72:0/2532729713 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa19806dfa0 0x7fa198070450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4006010 tx=0x7fa1a400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:27.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.173+0000 7fa1ad600700 1 -- 172.21.15.72:0/2532729713 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fa19c057360 con 0x7fa1b01014e0 2024-03-19T06:12:27.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.488+0000 7fa1b7600700 1 -- 172.21.15.72:0/2532729713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa1b002cc30 con 0x7fa1b01014e0 2024-03-19T06:12:27.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.489+0000 7fa1ad600700 1 -- 172.21.15.72:0/2532729713 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1480 (secure 0 0 0) 0x7fa19c05aa20 con 0x7fa1b01014e0 2024-03-19T06:12:27.479 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 60/396 objects degraded (15.152%), 14 pgs degraded 2024-03-19T06:12:27.479 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:12:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:12:27.479 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] OSD_DOWN: 1 osds down 2024-03-19T06:12:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: osd.5 (root=default,host=smithi172) is down 2024-03-19T06:12:27.479 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 60/396 objects degraded (15.152%), 14 pgs degraded 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-03-19T06:12:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-03-19T06:12:27.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.491+0000 7fa1b7600700 1 -- 172.21.15.72:0/2532729713 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa19806dfa0 msgr2=0x7fa198070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:27.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.491+0000 7fa1b7600700 1 --2- 172.21.15.72:0/2532729713 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa19806dfa0 0x7fa198070450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4006010 tx=0x7fa1a400b540 comp rx=0 tx=0).stop 2024-03-19T06:12:27.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.491+0000 7fa1b7600700 1 -- 172.21.15.72:0/2532729713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b01014e0 msgr2=0x7fa1b01981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:27.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.491+0000 7fa1b7600700 1 --2- 172.21.15.72:0/2532729713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b01014e0 0x7fa1b01981d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00c930 tx=0x7fa19c00ccf0 comp rx=0 tx=0).stop 2024-03-19T06:12:27.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.492+0000 7fa1b7600700 1 -- 172.21.15.72:0/2532729713 shutdown_connections 2024-03-19T06:12:27.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.492+0000 7fa1b7600700 1 --2- 172.21.15.72:0/2532729713 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa19806dfa0 0x7fa198070450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:27.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.492+0000 7fa1b7600700 1 --2- 172.21.15.72:0/2532729713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1b0100240 0x7fa1b0197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:27.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.492+0000 7fa1b7600700 1 --2- 172.21.15.72:0/2532729713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b01014e0 0x7fa1b01981d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:27.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.492+0000 7fa1b7600700 1 -- 172.21.15.72:0/2532729713 >> 172.21.15.72:0/2532729713 conn(0x7fa1b00fb890 msgr2=0x7fa1b0102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:27.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.492+0000 7fa1b7600700 1 -- 172.21.15.72:0/2532729713 shutdown_connections 2024-03-19T06:12:27.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:27.492+0000 7fa1b7600700 1 -- 172.21.15.72:0/2532729713 wait complete. 2024-03-19T06:12:27.521 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:27 smithi172 podman[77612]: 2024-03-19 06:12:27.13435676 +0000 UTC m=+0.034964993 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:12:27.521 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:27 smithi172 podman[77612]: 2024-03-19 06:12:27.278155815 +0000 UTC m=+0.178764068 container create c47c9c7fd3c72cfbd2616d5b65258bfc493b24b1616f14d9fd5bf1ca98697b2b (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, CEPH_POINT_RELEASE=) 2024-03-19T06:12:27.521 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:27 smithi172 podman[77612]: 2024-03-19 06:12:27.531788633 +0000 UTC m=+0.432396889 container init c47c9c7fd3c72cfbd2616d5b65258bfc493b24b1616f14d9fd5bf1ca98697b2b (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b) 2024-03-19T06:12:27.845 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:27 smithi172 podman[77612]: 2024-03-19 06:12:27.543195732 +0000 UTC m=+0.443803954 container start c47c9c7fd3c72cfbd2616d5b65258bfc493b24b1616f14d9fd5bf1ca98697b2b (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5, GIT_CLEAN=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, ceph=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:12:27.845 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:27 smithi172 ceph-osd[77631]: -- 172.21.15.172:0/4223759380 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f4ccb21680 con 0x55f4ccaeb000 2024-03-19T06:12:27.845 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:27 smithi172 bash[77612]: c47c9c7fd3c72cfbd2616d5b65258bfc493b24b1616f14d9fd5bf1ca98697b2b 2024-03-19T06:12:27.845 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:27 smithi172 systemd[1]: Started Ceph osd.5 for 9ad98512-e5b4-11ee-95c9-87774f69a715. 2024-03-19T06:12:28.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:27 smithi172 ceph-mon[66682]: pgmap v181: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/396 objects degraded (15.152%) 2024-03-19T06:12:28.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:27 smithi172 ceph-mon[66682]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-03-19T06:12:28.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:27 smithi172 ceph-mon[66682]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:12:28.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:27 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2532729713' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:12:28.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:27 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:28.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:27 smithi072 ceph-mon[78545]: pgmap v181: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/396 objects degraded (15.152%) 2024-03-19T06:12:28.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:27 smithi072 ceph-mon[78545]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-03-19T06:12:28.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:27 smithi072 ceph-mon[78545]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:12:28.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:27 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2532729713' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:12:28.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:27 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:28.402 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:28 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:12:28.112+0000 7f931554a7c0 -1 Falling back to public interface 2024-03-19T06:12:29.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:28 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:29.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:28 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:12:29.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:28 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:29.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:28 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:12:30.111 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:29 smithi172 ceph-mon[66682]: pgmap v182: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/396 objects degraded (15.152%) 2024-03-19T06:12:30.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:29 smithi072 ceph-mon[78545]: pgmap v182: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/396 objects degraded (15.152%) 2024-03-19T06:12:32.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:31 smithi172 ceph-mon[66682]: pgmap v183: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/396 objects degraded (15.152%) 2024-03-19T06:12:32.305 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:31 smithi072 ceph-mon[78545]: pgmap v183: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/396 objects degraded (15.152%) 2024-03-19T06:12:32.902 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:32 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:12:32.624+0000 7f931554a7c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-03-19T06:12:33.402 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:32 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:12:32.949+0000 7f931554a7c0 -1 osd.5 73 log_to_monitors true 2024-03-19T06:12:33.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:33 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:33.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:33 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:33.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:33 smithi172 ceph-mon[66682]: Health check update: Degraded data redundancy: 60/396 objects degraded (15.152%), 14 pgs degraded (PG_DEGRADED) 2024-03-19T06:12:33.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:33 smithi172 ceph-mon[66682]: from='osd.5 [v2:172.21.15.172:6816/1857818067,v1:172.21.15.172:6817/1857818067]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-19T06:12:33.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:33 smithi172 ceph-mon[66682]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-19T06:12:33.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:33 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:33.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:33 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:33.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:33 smithi072 ceph-mon[78545]: Health check update: Degraded data redundancy: 60/396 objects degraded (15.152%), 14 pgs degraded (PG_DEGRADED) 2024-03-19T06:12:33.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:33 smithi072 ceph-mon[78545]: from='osd.5 [v2:172.21.15.172:6816/1857818067,v1:172.21.15.172:6817/1857818067]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-19T06:12:33.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:33 smithi072 ceph-mon[78545]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-19T06:12:34.402 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:12:34 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:12:34.213+0000 7f92ff800700 -1 osd.5 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:12:34.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:34 smithi172 ceph-mon[66682]: pgmap v184: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/396 objects degraded (15.152%) 2024-03-19T06:12:34.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:34 smithi172 ceph-mon[66682]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-19T06:12:34.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:34 smithi172 ceph-mon[66682]: osdmap e76: 6 total, 5 up, 6 in 2024-03-19T06:12:34.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:34 smithi172 ceph-mon[66682]: from='osd.5 [v2:172.21.15.172:6816/1857818067,v1:172.21.15.172:6817/1857818067]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T06:12:34.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:34 smithi172 ceph-mon[66682]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T06:12:34.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:34 smithi072 ceph-mon[78545]: pgmap v184: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/396 objects degraded (15.152%) 2024-03-19T06:12:34.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:34 smithi072 ceph-mon[78545]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-19T06:12:34.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:34 smithi072 ceph-mon[78545]: osdmap e76: 6 total, 5 up, 6 in 2024-03-19T06:12:34.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:34 smithi072 ceph-mon[78545]: from='osd.5 [v2:172.21.15.172:6816/1857818067,v1:172.21.15.172:6817/1857818067]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T06:12:34.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:34 smithi072 ceph-mon[78545]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-03-19T06:12:35.541 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:35 smithi172 ceph-mon[66682]: from='osd.5 ' entity='osd.5' 2024-03-19T06:12:35.542 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:35 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:35.542 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:35 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:35.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:35 smithi072 ceph-mon[78545]: from='osd.5 ' entity='osd.5' 2024-03-19T06:12:35.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:35 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:35.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:35 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:36.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:36 smithi172 ceph-mon[66682]: pgmap v186: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/396 objects degraded (15.152%) 2024-03-19T06:12:36.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:36 smithi172 ceph-mon[66682]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-19T06:12:36.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:36 smithi172 ceph-mon[66682]: osd.5 [v2:172.21.15.172:6816/1857818067,v1:172.21.15.172:6817/1857818067] boot 2024-03-19T06:12:36.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:36 smithi172 ceph-mon[66682]: osdmap e77: 6 total, 6 up, 6 in 2024-03-19T06:12:36.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T06:12:36.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:36 smithi172 ceph-mon[66682]: osdmap e78: 6 total, 6 up, 6 in 2024-03-19T06:12:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:36 smithi072 ceph-mon[78545]: pgmap v186: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 60/396 objects degraded (15.152%) 2024-03-19T06:12:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:36 smithi072 ceph-mon[78545]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-19T06:12:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:36 smithi072 ceph-mon[78545]: osd.5 [v2:172.21.15.172:6816/1857818067,v1:172.21.15.172:6817/1857818067] boot 2024-03-19T06:12:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:36 smithi072 ceph-mon[78545]: osdmap e77: 6 total, 6 up, 6 in 2024-03-19T06:12:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-19T06:12:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:36 smithi072 ceph-mon[78545]: osdmap e78: 6 total, 6 up, 6 in 2024-03-19T06:12:38.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:38 smithi072 ceph-mon[78545]: pgmap v189: 65 pgs: 11 peering, 7 active+undersized+degraded, 10 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23/396 objects degraded (5.808%) 2024-03-19T06:12:38.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:38 smithi072 ceph-mon[78545]: Health check update: Degraded data redundancy: 23/396 objects degraded (5.808%), 7 pgs degraded (PG_DEGRADED) 2024-03-19T06:12:38.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:38 smithi172 ceph-mon[66682]: pgmap v189: 65 pgs: 11 peering, 7 active+undersized+degraded, 10 active+undersized, 37 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23/396 objects degraded (5.808%) 2024-03-19T06:12:38.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:38 smithi172 ceph-mon[66682]: Health check update: Degraded data redundancy: 23/396 objects degraded (5.808%), 7 pgs degraded (PG_DEGRADED) 2024-03-19T06:12:40.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: pgmap v190: 65 pgs: 11 peering, 1 active+undersized, 53 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:40.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:40.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:40.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:12:40.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/396 objects degraded (5.808%), 7 pgs degraded) 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: Upgrade: Setting container_image for all osd 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-19T06:12:40.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-19T06:12:40.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-19T06:12:40.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-19T06:12:40.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-19T06:12:40.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-19T06:12:40.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-19T06:12:40.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-19T06:12:40.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-19T06:12:40.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: Upgrade: Setting require_osd_release to 19 squid 2024-03-19T06:12:40.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-19T06:12:40.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:40.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:12:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: pgmap v190: 65 pgs: 11 peering, 1 active+undersized, 53 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:12:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:12:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:12:40.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/396 objects degraded (5.808%), 7 pgs degraded) 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: Upgrade: Setting container_image for all osd 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-19T06:12:40.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-19T06:12:40.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-19T06:12:40.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-19T06:12:40.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-19T06:12:40.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: Upgrade: Setting require_osd_release to 19 squid 2024-03-19T06:12:40.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-19T06:12:40.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:40.328 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:12:41.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:40 smithi172 ceph-mon[66682]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-19T06:12:41.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-19T06:12:41.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:40 smithi172 ceph-mon[66682]: osdmap e79: 6 total, 6 up, 6 in 2024-03-19T06:12:41.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:40 smithi172 ceph-mon[66682]: Upgrade: Scaling down filesystem cephfs 2024-03-19T06:12:41.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:41.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-03-19T06:12:41.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:40 smithi072 ceph-mon[78545]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-19T06:12:41.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-19T06:12:41.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:40 smithi072 ceph-mon[78545]: osdmap e79: 6 total, 6 up, 6 in 2024-03-19T06:12:41.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:40 smithi072 ceph-mon[78545]: Upgrade: Scaling down filesystem cephfs 2024-03-19T06:12:41.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:41.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-03-19T06:12:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: pgmap v192: 65 pgs: 11 peering, 54 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-03-19T06:12:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: stopping daemon mds.cephfs.smithi172.xlokxp 2024-03-19T06:12:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:12:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:stopping} 2 up:standby 2024-03-19T06:12:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:12:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:12:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:12:42.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:42.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:12:42.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:42.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:42.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:42.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:42.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: pgmap v192: 65 pgs: 11 peering, 54 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:42.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-03-19T06:12:42.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: stopping daemon mds.cephfs.smithi172.xlokxp 2024-03-19T06:12:42.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:active} 2 up:standby 2024-03-19T06:12:42.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:stopping} 2 up:standby 2024-03-19T06:12:42.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:12:42.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:12:42.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:12:42.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:42.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:12:42.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:42.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:42.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:42.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:43.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:43 smithi172 ceph-mon[66682]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-03-19T06:12:43.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:43 smithi072 ceph-mon[78545]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-03-19T06:12:44.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:44 smithi172 ceph-mon[66682]: pgmap v193: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:44.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:44 smithi072 ceph-mon[78545]: pgmap v193: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-19T06:12:46.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:46 smithi172 ceph-mon[66682]: pgmap v194: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 119 B/s wr, 0 op/s 2024-03-19T06:12:46.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:46 smithi072 ceph-mon[78545]: pgmap v194: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 119 B/s wr, 0 op/s 2024-03-19T06:12:48.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:48 smithi172 ceph-mon[66682]: pgmap v195: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s wr, 1 op/s 2024-03-19T06:12:48.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:48 smithi072 ceph-mon[78545]: pgmap v195: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s wr, 1 op/s 2024-03-19T06:12:49.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:49 smithi072 ceph-mon[78545]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:stopping} 2 up:standby 2024-03-19T06:12:49.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:49 smithi172 ceph-mon[66682]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi172.xlokxp=up:stopping} 2 up:standby 2024-03-19T06:12:50.805 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:50 smithi172 ceph-mon[66682]: pgmap v196: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s wr, 1 op/s 2024-03-19T06:12:50.805 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:50.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:50 smithi072 ceph-mon[78545]: pgmap v196: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s wr, 1 op/s 2024-03-19T06:12:50.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:52.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:52 smithi072 ceph-mon[78545]: pgmap v197: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s wr, 1 op/s 2024-03-19T06:12:52.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:12:52.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:52 smithi172 ceph-mon[66682]: pgmap v197: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s wr, 1 op/s 2024-03-19T06:12:52.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:12:53.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:53 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:12:53.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:53 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:12:53.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:53 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:53.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:53 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:12:53.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:53 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:53.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:53 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:53.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:53 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:53.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:53 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:53.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:53 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:12:53.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:53 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:12:53.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:53 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:53.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:53 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:12:53.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:53 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:53.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:53 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:53.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:53 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:53.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:53 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:12:54.728 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:54 smithi072 ceph-mon[78545]: pgmap v198: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 3.6 KiB/s wr, 1 op/s 2024-03-19T06:12:54.728 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:54 smithi072 ceph-mon[78545]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-03-19T06:12:54.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:54 smithi172 ceph-mon[66682]: pgmap v198: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 3.6 KiB/s wr, 1 op/s 2024-03-19T06:12:54.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:54 smithi172 ceph-mon[66682]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-03-19T06:12:56.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:55 smithi072 ceph-mon[78545]: pgmap v199: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 3.6 KiB/s wr, 1 op/s 2024-03-19T06:12:56.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:56.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:12:56.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:55 smithi172 ceph-mon[66682]: pgmap v199: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 3.6 KiB/s wr, 1 op/s 2024-03-19T06:12:56.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:12:56.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:12:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.658+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1695782470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc0103480 msgr2=0x7ffbc01038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.658+0000 7ffbc4c00700 1 --2- 172.21.15.72:0/1695782470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc0103480 0x7ffbc01038d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009910 tx=0x7ffbac009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.658+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1695782470 shutdown_connections 2024-03-19T06:12:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.658+0000 7ffbc4c00700 1 --2- 172.21.15.72:0/1695782470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc0103480 0x7ffbc01038d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.658+0000 7ffbc4c00700 1 --2- 172.21.15.72:0/1695782470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbc0102280 0x7ffbc0102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.658+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1695782470 >> 172.21.15.72:0/1695782470 conn(0x7ffbc00fd8d0 msgr2=0x7ffbc00ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.658+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1695782470 shutdown_connections 2024-03-19T06:12:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.658+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1695782470 wait complete. 2024-03-19T06:12:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.659+0000 7ffbc4c00700 1 Processor -- start 2024-03-19T06:12:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.659+0000 7ffbc4c00700 1 -- start start 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.660+0000 7ffbc4c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbc0102280 0x7ffbc0197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.660+0000 7ffbc4c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc0103480 0x7ffbc0198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.660+0000 7ffbc4c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0198650 con 0x7ffbc0103480 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.660+0000 7ffbc4c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0198790 con 0x7ffbc0102280 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.660+0000 7ffbbea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc0103480 0x7ffbc0198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.660+0000 7ffbbea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc0103480 0x7ffbc0198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44688/0 (socket says 172.21.15.72:44688) 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.660+0000 7ffbbea00700 1 -- 172.21.15.72:0/1564120271 learned_addr learned my addr 172.21.15.72:0/1564120271 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.660+0000 7ffbbea00700 1 -- 172.21.15.72:0/1564120271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbc0102280 msgr2=0x7ffbc0197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.660+0000 7ffbbea00700 1 --2- 172.21.15.72:0/1564120271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbc0102280 0x7ffbc0197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.660+0000 7ffbbea00700 1 -- 172.21.15.72:0/1564120271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac0095f0 con 0x7ffbc0103480 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.661+0000 7ffbbea00700 1 --2- 172.21.15.72:0/1564120271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc0103480 0x7ffbc0198030 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffbac005b40 tx=0x7ffbac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.661+0000 7ffbb7e00700 1 -- 172.21.15.72:0/1564120271 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbac01d070 con 0x7ffbc0103480 2024-03-19T06:12:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.661+0000 7ffbb7e00700 1 -- 172.21.15.72:0/1564120271 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffbac022470 con 0x7ffbc0103480 2024-03-19T06:12:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.661+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1564120271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc019d1e0 con 0x7ffbc0103480 2024-03-19T06:12:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.661+0000 7ffbb7e00700 1 -- 172.21.15.72:0/1564120271 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbac00f690 con 0x7ffbc0103480 2024-03-19T06:12:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.661+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1564120271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc019d750 con 0x7ffbc0103480 2024-03-19T06:12:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.662+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1564120271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc010ae70 con 0x7ffbc0103480 2024-03-19T06:12:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.663+0000 7ffbb7e00700 1 -- 172.21.15.72:0/1564120271 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7ffbac0225e0 con 0x7ffbc0103480 2024-03-19T06:12:57.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.664+0000 7ffbb7e00700 1 --2- 172.21.15.72:0/1564120271 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffba406dfa0 0x7ffba4070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:57.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.664+0000 7ffbb7e00700 1 -- 172.21.15.72:0/1564120271 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ffbac08f3f0 con 0x7ffbc0103480 2024-03-19T06:12:57.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.664+0000 7ffbbf400700 1 --2- 172.21.15.72:0/1564120271 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffba406dfa0 0x7ffba4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.665+0000 7ffbbf400700 1 --2- 172.21.15.72:0/1564120271 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffba406dfa0 0x7ffba4070450 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffbc01032e0 tx=0x7ffbb0006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.669+0000 7ffbb7e00700 1 -- 172.21.15.72:0/1564120271 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7ffbac05c4c0 con 0x7ffbc0103480 2024-03-19T06:12:57.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.913+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1564120271 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbc0107dd0 con 0x7ffba406dfa0 2024-03-19T06:12:57.903 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:57 smithi072 ceph-mon[78545]: pgmap v200: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 4.0 KiB/s wr, 2 op/s 2024-03-19T06:12:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.915+0000 7ffbb7e00700 1 -- 172.21.15.72:0/1564120271 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ffbc0107dd0 con 0x7ffba406dfa0 2024-03-19T06:12:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.919+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1564120271 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffba406dfa0 msgr2=0x7ffba4070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.919+0000 7ffbc4c00700 1 --2- 172.21.15.72:0/1564120271 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffba406dfa0 0x7ffba4070450 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffbc01032e0 tx=0x7ffbb0006d20 comp rx=0 tx=0).stop 2024-03-19T06:12:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.919+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1564120271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc0103480 msgr2=0x7ffbc0198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.919+0000 7ffbc4c00700 1 --2- 172.21.15.72:0/1564120271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc0103480 0x7ffbc0198030 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffbac005b40 tx=0x7ffbac00be20 comp rx=0 tx=0).stop 2024-03-19T06:12:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.919+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1564120271 shutdown_connections 2024-03-19T06:12:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.919+0000 7ffbc4c00700 1 --2- 172.21.15.72:0/1564120271 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffba406dfa0 0x7ffba4070450 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.919+0000 7ffbc4c00700 1 --2- 172.21.15.72:0/1564120271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbc0102280 0x7ffbc0197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.919+0000 7ffbc4c00700 1 --2- 172.21.15.72:0/1564120271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc0103480 0x7ffbc0198030 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.919+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1564120271 >> 172.21.15.72:0/1564120271 conn(0x7ffbc00fd8d0 msgr2=0x7ffbc01066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.919+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1564120271 shutdown_connections 2024-03-19T06:12:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:57.919+0000 7ffbc4c00700 1 -- 172.21.15.72:0/1564120271 wait complete. 2024-03-19T06:12:57.925 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:12:58.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.083+0000 7f6026e00700 1 -- 172.21.15.72:0/2337917062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60200737b0 msgr2=0x7f6020073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:58.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.083+0000 7f6026e00700 1 --2- 172.21.15.72:0/2337917062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60200737b0 0x7f6020073c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6008009910 tx=0x7f6008009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:58.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.083+0000 7f6026e00700 1 -- 172.21.15.72:0/2337917062 shutdown_connections 2024-03-19T06:12:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.083+0000 7f6026e00700 1 --2- 172.21.15.72:0/2337917062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60200737b0 0x7f6020073c20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.083+0000 7f6026e00700 1 --2- 172.21.15.72:0/2337917062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6020074d80 0x7f60200731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.083+0000 7f6026e00700 1 -- 172.21.15.72:0/2337917062 >> 172.21.15.72:0/2337917062 conn(0x7f60200fb7f0 msgr2=0x7f60200fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.083+0000 7f6026e00700 1 -- 172.21.15.72:0/2337917062 shutdown_connections 2024-03-19T06:12:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.083+0000 7f6026e00700 1 -- 172.21.15.72:0/2337917062 wait complete. 2024-03-19T06:12:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.085+0000 7f6026e00700 1 Processor -- start 2024-03-19T06:12:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.085+0000 7f6026e00700 1 -- start start 2024-03-19T06:12:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.085+0000 7f6026e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60200737b0 0x7f602019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.085+0000 7f6026e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6020074d80 0x7f602019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.085+0000 7f6026e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602019cbd0 con 0x7f60200737b0 2024-03-19T06:12:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.085+0000 7f6026e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602019cd10 con 0x7f6020074d80 2024-03-19T06:12:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.085+0000 7f601fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60200737b0 0x7f602019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.085+0000 7f601fe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60200737b0 0x7f602019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44712/0 (socket says 172.21.15.72:44712) 2024-03-19T06:12:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.085+0000 7f601fe00700 1 -- 172.21.15.72:0/3350236713 learned_addr learned my addr 172.21.15.72:0/3350236713 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.086+0000 7f6017400700 1 --2- 172.21.15.72:0/3350236713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6020074d80 0x7f602019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.086+0000 7f601fe00700 1 -- 172.21.15.72:0/3350236713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6020074d80 msgr2=0x7f602019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.086+0000 7f601fe00700 1 --2- 172.21.15.72:0/3350236713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6020074d80 0x7f602019c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.086+0000 7f601fe00700 1 -- 172.21.15.72:0/3350236713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60080095f0 con 0x7f60200737b0 2024-03-19T06:12:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.086+0000 7f601fe00700 1 --2- 172.21.15.72:0/3350236713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60200737b0 0x7f602019c070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f601000d8d0 tx=0x7f601000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.087+0000 7f601d600700 1 -- 172.21.15.72:0/3350236713 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6010009940 con 0x7f60200737b0 2024-03-19T06:12:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.087+0000 7f601d600700 1 -- 172.21.15.72:0/3350236713 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6010010460 con 0x7f60200737b0 2024-03-19T06:12:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.087+0000 7f601d600700 1 -- 172.21.15.72:0/3350236713 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f601000f5f0 con 0x7f60200737b0 2024-03-19T06:12:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.087+0000 7f6026e00700 1 -- 172.21.15.72:0/3350236713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60201a17c0 con 0x7f60200737b0 2024-03-19T06:12:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.087+0000 7f6026e00700 1 -- 172.21.15.72:0/3350236713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60201a1d10 con 0x7f60200737b0 2024-03-19T06:12:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.088+0000 7f6026e00700 1 -- 172.21.15.72:0/3350236713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602010f380 con 0x7f60200737b0 2024-03-19T06:12:58.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.089+0000 7f601d600700 1 -- 172.21.15.72:0/3350236713 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f60100105d0 con 0x7f60200737b0 2024-03-19T06:12:58.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.090+0000 7f601d600700 1 --2- 172.21.15.72:0/3350236713 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f600406dfa0 0x7f6004070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:58.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.090+0000 7f601d600700 1 -- 172.21.15.72:0/3350236713 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f601008db90 con 0x7f60200737b0 2024-03-19T06:12:58.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.090+0000 7f6017400700 1 --2- 172.21.15.72:0/3350236713 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f600406dfa0 0x7f6004070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:58.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.091+0000 7f6017400700 1 --2- 172.21.15.72:0/3350236713 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f600406dfa0 0x7f6004070450 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f600800b5c0 tx=0x7f6008005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:58.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.095+0000 7f601d600700 1 -- 172.21.15.72:0/3350236713 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f601005ac60 con 0x7f60200737b0 2024-03-19T06:12:58.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:57 smithi172 ceph-mon[66682]: pgmap v200: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 4.0 KiB/s wr, 2 op/s 2024-03-19T06:12:58.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.332+0000 7f6026e00700 1 -- 172.21.15.72:0/3350236713 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60201031e0 con 0x7f600406dfa0 2024-03-19T06:12:58.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.333+0000 7f601d600700 1 -- 172.21.15.72:0/3350236713 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f60201031e0 con 0x7f600406dfa0 2024-03-19T06:12:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.336+0000 7f6026e00700 1 -- 172.21.15.72:0/3350236713 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f600406dfa0 msgr2=0x7f6004070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.336+0000 7f6026e00700 1 --2- 172.21.15.72:0/3350236713 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f600406dfa0 0x7f6004070450 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f600800b5c0 tx=0x7f6008005960 comp rx=0 tx=0).stop 2024-03-19T06:12:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.336+0000 7f6026e00700 1 -- 172.21.15.72:0/3350236713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60200737b0 msgr2=0x7f602019c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.336+0000 7f6026e00700 1 --2- 172.21.15.72:0/3350236713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60200737b0 0x7f602019c070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f601000d8d0 tx=0x7f601000dc90 comp rx=0 tx=0).stop 2024-03-19T06:12:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.336+0000 7f6026e00700 1 -- 172.21.15.72:0/3350236713 shutdown_connections 2024-03-19T06:12:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.336+0000 7f6026e00700 1 --2- 172.21.15.72:0/3350236713 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f600406dfa0 0x7f6004070450 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.336+0000 7f6026e00700 1 --2- 172.21.15.72:0/3350236713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60200737b0 0x7f602019c070 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.336+0000 7f6026e00700 1 --2- 172.21.15.72:0/3350236713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6020074d80 0x7f602019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.336+0000 7f6026e00700 1 -- 172.21.15.72:0/3350236713 >> 172.21.15.72:0/3350236713 conn(0x7f60200fb7f0 msgr2=0x7f6020101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.337+0000 7f6026e00700 1 -- 172.21.15.72:0/3350236713 shutdown_connections 2024-03-19T06:12:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.337+0000 7f6026e00700 1 -- 172.21.15.72:0/3350236713 wait complete. 2024-03-19T06:12:58.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.502+0000 7f10da000700 1 -- 172.21.15.72:0/1544968658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d4100240 msgr2=0x7f10d4100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:58.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.502+0000 7f10da000700 1 --2- 172.21.15.72:0/1544968658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d4100240 0x7f10d4100650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009910 tx=0x7f10c4009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:58.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.502+0000 7f10da000700 1 -- 172.21.15.72:0/1544968658 shutdown_connections 2024-03-19T06:12:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.502+0000 7f10da000700 1 --2- 172.21.15.72:0/1544968658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10d4101440 0x7f10d4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.502+0000 7f10da000700 1 --2- 172.21.15.72:0/1544968658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d4100240 0x7f10d4100650 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.502+0000 7f10da000700 1 -- 172.21.15.72:0/1544968658 >> 172.21.15.72:0/1544968658 conn(0x7f10d40fb7f0 msgr2=0x7f10d40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.502+0000 7f10da000700 1 -- 172.21.15.72:0/1544968658 shutdown_connections 2024-03-19T06:12:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.502+0000 7f10da000700 1 -- 172.21.15.72:0/1544968658 wait complete. 2024-03-19T06:12:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.503+0000 7f10da000700 1 Processor -- start 2024-03-19T06:12:58.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.504+0000 7f10da000700 1 -- start start 2024-03-19T06:12:58.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.504+0000 7f10da000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d4100240 0x7f10d4195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:58.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.504+0000 7f10da000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10d4101440 0x7f10d4196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.504+0000 7f10da000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d4196630 con 0x7f10d4100240 2024-03-19T06:12:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.504+0000 7f10da000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d4196770 con 0x7f10d4101440 2024-03-19T06:12:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.504+0000 7f10d3400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d4100240 0x7f10d4195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.504+0000 7f10d3400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d4100240 0x7f10d4195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44716/0 (socket says 172.21.15.72:44716) 2024-03-19T06:12:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.504+0000 7f10d3400700 1 -- 172.21.15.72:0/66236108 learned_addr learned my addr 172.21.15.72:0/66236108 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.505+0000 7f10caa00700 1 --2- 172.21.15.72:0/66236108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10d4101440 0x7f10d4196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.505+0000 7f10d3400700 1 -- 172.21.15.72:0/66236108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10d4101440 msgr2=0x7f10d4196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.505+0000 7f10d3400700 1 --2- 172.21.15.72:0/66236108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10d4101440 0x7f10d4196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.505+0000 7f10d3400700 1 -- 172.21.15.72:0/66236108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c40095f0 con 0x7f10d4100240 2024-03-19T06:12:58.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.505+0000 7f10d3400700 1 --2- 172.21.15.72:0/66236108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d4100240 0x7f10d4195ad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f10c400bd70 tx=0x7f10c400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.505+0000 7f10d0c00700 1 -- 172.21.15.72:0/66236108 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c401d070 con 0x7f10d4100240 2024-03-19T06:12:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.505+0000 7f10d0c00700 1 -- 172.21.15.72:0/66236108 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f10c400f460 con 0x7f10d4100240 2024-03-19T06:12:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.505+0000 7f10d0c00700 1 -- 172.21.15.72:0/66236108 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c4021620 con 0x7f10d4100240 2024-03-19T06:12:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.505+0000 7f10da000700 1 -- 172.21.15.72:0/66236108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d419b1c0 con 0x7f10d4100240 2024-03-19T06:12:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.506+0000 7f10da000700 1 -- 172.21.15.72:0/66236108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d419b6b0 con 0x7f10d4100240 2024-03-19T06:12:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.507+0000 7f10da000700 1 -- 172.21.15.72:0/66236108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d4108d90 con 0x7f10d4100240 2024-03-19T06:12:58.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.508+0000 7f10d0c00700 1 -- 172.21.15.72:0/66236108 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f10c400fa40 con 0x7f10d4100240 2024-03-19T06:12:58.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.508+0000 7f10d0c00700 1 --2- 172.21.15.72:0/66236108 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f10b806dfa0 0x7f10b8070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:58.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.509+0000 7f10d0c00700 1 -- 172.21.15.72:0/66236108 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f10c408ef90 con 0x7f10d4100240 2024-03-19T06:12:58.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.509+0000 7f10caa00700 1 --2- 172.21.15.72:0/66236108 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f10b806dfa0 0x7f10b8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:58.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.509+0000 7f10caa00700 1 --2- 172.21.15.72:0/66236108 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f10b806dfa0 0x7f10b8070450 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f10bc005950 tx=0x7f10bc0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.513+0000 7f10d0c00700 1 -- 172.21.15.72:0/66236108 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f10c405bfc0 con 0x7f10d4100240 2024-03-19T06:12:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.751+0000 7f10da000700 1 -- 172.21.15.72:0/66236108 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10d419bd40 con 0x7f10b806dfa0 2024-03-19T06:12:58.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.783+0000 7f10d0c00700 1 -- 172.21.15.72:0/66236108 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f10d419bd40 con 0x7f10b806dfa0 2024-03-19T06:12:58.773 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:12:58.773 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (17m) 2m ago 19m 14.0M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:12:58.773 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (19m) 2m ago 19m 8678k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:12:58.773 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (18m) 26s ago 18m 8724k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:12:58.773 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (4m) 2m ago 19m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (3m) 26s ago 18m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (17m) 2m ago 19m 71.5M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (11m) 2m ago 11m 16.5M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (12m) 2m ago 12m 126M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (11m) 26s ago 11m 17.3M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (11m) 26s ago 11m 142M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (8m) 2m ago 21m 504M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (6m) 26s ago 17m 451M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (5m) 2m ago 21m 50.4M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (5m) 26s ago 17m 41.0M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (19m) 2m ago 19m 8196k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (18m) 26s ago 18m 8036k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (3m) 2m ago 16m 87.0M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:12:58.774 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (2m) 2m ago 16m 87.1M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:12:58.775 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (2m) 2m ago 15m 11.2M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:12:58.775 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (115s) 26s ago 15m 90.4M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:12:58.775 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (73s) 26s ago 14m 90.4M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:12:58.775 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (31s) 26s ago 13m 11.2M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a c47c9c7fd3c7 2024-03-19T06:12:58.775 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (6m) 2m ago 18m 67.0M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:12:58.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.786+0000 7f10da000700 1 -- 172.21.15.72:0/66236108 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f10b806dfa0 msgr2=0x7f10b8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:58.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.786+0000 7f10da000700 1 --2- 172.21.15.72:0/66236108 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f10b806dfa0 0x7f10b8070450 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f10bc005950 tx=0x7f10bc0058e0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.786+0000 7f10da000700 1 -- 172.21.15.72:0/66236108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d4100240 msgr2=0x7f10d4195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:58.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.786+0000 7f10da000700 1 --2- 172.21.15.72:0/66236108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d4100240 0x7f10d4195ad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f10c400bd70 tx=0x7f10c400be50 comp rx=0 tx=0).stop 2024-03-19T06:12:58.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.786+0000 7f10da000700 1 -- 172.21.15.72:0/66236108 shutdown_connections 2024-03-19T06:12:58.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.786+0000 7f10da000700 1 --2- 172.21.15.72:0/66236108 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f10b806dfa0 0x7f10b8070450 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.786+0000 7f10da000700 1 --2- 172.21.15.72:0/66236108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d4100240 0x7f10d4195ad0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.786+0000 7f10da000700 1 --2- 172.21.15.72:0/66236108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10d4101440 0x7f10d4196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.786+0000 7f10da000700 1 -- 172.21.15.72:0/66236108 >> 172.21.15.72:0/66236108 conn(0x7f10d40fb7f0 msgr2=0x7f10d4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:58.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.786+0000 7f10da000700 1 -- 172.21.15.72:0/66236108 shutdown_connections 2024-03-19T06:12:58.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.786+0000 7f10da000700 1 -- 172.21.15.72:0/66236108 wait complete. 2024-03-19T06:12:58.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.938+0000 7f0845400700 1 -- 172.21.15.72:0/3544851319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08401036d0 msgr2=0x7f0840103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.938+0000 7f0845400700 1 --2- 172.21.15.72:0/3544851319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08401036d0 0x7f0840103b40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0828009910 tx=0x7f0828009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.938+0000 7f0845400700 1 -- 172.21.15.72:0/3544851319 shutdown_connections 2024-03-19T06:12:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.938+0000 7f0845400700 1 --2- 172.21.15.72:0/3544851319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08401036d0 0x7f0840103b40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.938+0000 7f0845400700 1 --2- 172.21.15.72:0/3544851319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0840102430 0x7f0840102840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.938+0000 7f0845400700 1 -- 172.21.15.72:0/3544851319 >> 172.21.15.72:0/3544851319 conn(0x7f08400fda80 msgr2=0x7f08400ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.939+0000 7f0845400700 1 -- 172.21.15.72:0/3544851319 shutdown_connections 2024-03-19T06:12:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.939+0000 7f0845400700 1 -- 172.21.15.72:0/3544851319 wait complete. 2024-03-19T06:12:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.940+0000 7f0845400700 1 Processor -- start 2024-03-19T06:12:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.940+0000 7f0845400700 1 -- start start 2024-03-19T06:12:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.940+0000 7f0845400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840102430 0x7f0840197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.940+0000 7f0845400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08401036d0 0x7f0840198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.940+0000 7f0845400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0840198880 con 0x7f0840102430 2024-03-19T06:12:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.940+0000 7f0845400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084019d290 con 0x7f08401036d0 2024-03-19T06:12:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.940+0000 7f083e800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840102430 0x7f0840197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.940+0000 7f083e800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840102430 0x7f0840197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44732/0 (socket says 172.21.15.72:44732) 2024-03-19T06:12:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.941+0000 7f083e800700 1 -- 172.21.15.72:0/1631373635 learned_addr learned my addr 172.21.15.72:0/1631373635 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.941+0000 7f0837e00700 1 --2- 172.21.15.72:0/1631373635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08401036d0 0x7f0840198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.941+0000 7f083e800700 1 -- 172.21.15.72:0/1631373635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08401036d0 msgr2=0x7f0840198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.941+0000 7f083e800700 1 --2- 172.21.15.72:0/1631373635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08401036d0 0x7f0840198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.941+0000 7f083e800700 1 -- 172.21.15.72:0/1631373635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280095f0 con 0x7f0840102430 2024-03-19T06:12:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.941+0000 7f083e800700 1 --2- 172.21.15.72:0/1631373635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840102430 0x7f0840197d20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f083000b4b0 tx=0x7f083000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.942+0000 7f0837400700 1 -- 172.21.15.72:0/1631373635 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0830011800 con 0x7f0840102430 2024-03-19T06:12:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.942+0000 7f0845400700 1 -- 172.21.15.72:0/1631373635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084019d490 con 0x7f0840102430 2024-03-19T06:12:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.942+0000 7f0837400700 1 -- 172.21.15.72:0/1631373635 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0830011e10 con 0x7f0840102430 2024-03-19T06:12:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.942+0000 7f0837400700 1 -- 172.21.15.72:0/1631373635 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f083000f2e0 con 0x7f0840102430 2024-03-19T06:12:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.942+0000 7f0845400700 1 -- 172.21.15.72:0/1631373635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084019d9b0 con 0x7f0840102430 2024-03-19T06:12:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.943+0000 7f0845400700 1 -- 172.21.15.72:0/1631373635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084010af90 con 0x7f0840102430 2024-03-19T06:12:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.944+0000 7f0837400700 1 -- 172.21.15.72:0/1631373635 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f0830010380 con 0x7f0840102430 2024-03-19T06:12:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.945+0000 7f0837400700 1 --2- 172.21.15.72:0/1631373635 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f082406dfa0 0x7f0824070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.945+0000 7f0837400700 1 -- 172.21.15.72:0/1631373635 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f083008da00 con 0x7f0840102430 2024-03-19T06:12:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.945+0000 7f0837e00700 1 --2- 172.21.15.72:0/1631373635 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f082406dfa0 0x7f0824070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.946+0000 7f0837e00700 1 --2- 172.21.15.72:0/1631373635 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f082406dfa0 0x7f0824070450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0828006010 tx=0x7f082800b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:58.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:58.952+0000 7f0837400700 1 -- 172.21.15.72:0/1631373635 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f0830056e80 con 0x7f0840102430 2024-03-19T06:12:59.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:58 smithi072 ceph-mon[78545]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:12:59.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:58 smithi072 ceph-mon[78545]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:12:59.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:58 smithi172 ceph-mon[66682]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:12:59.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:58 smithi172 ceph-mon[66682]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:12:59.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.264+0000 7f0845400700 1 -- 172.21.15.72:0/1631373635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f084010b180 con 0x7f0840102430 2024-03-19T06:12:59.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.265+0000 7f0837400700 1 -- 172.21.15.72:0/1631373635 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+701 (secure 0 0 0) 0x7f083005a540 con 0x7f0840102430 2024-03-19T06:12:59.255 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:12:59.255 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 6 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:12:59.256 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-03-19T06:12:59.257 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 10 2024-03-19T06:12:59.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:12:59.257 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:12:59.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.269+0000 7f0845400700 1 -- 172.21.15.72:0/1631373635 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f082406dfa0 msgr2=0x7f0824070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:59.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.269+0000 7f0845400700 1 --2- 172.21.15.72:0/1631373635 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f082406dfa0 0x7f0824070450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0828006010 tx=0x7f082800b580 comp rx=0 tx=0).stop 2024-03-19T06:12:59.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.269+0000 7f0845400700 1 -- 172.21.15.72:0/1631373635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840102430 msgr2=0x7f0840197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:59.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.269+0000 7f0845400700 1 --2- 172.21.15.72:0/1631373635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840102430 0x7f0840197d20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f083000b4b0 tx=0x7f083000b870 comp rx=0 tx=0).stop 2024-03-19T06:12:59.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.269+0000 7f0845400700 1 -- 172.21.15.72:0/1631373635 shutdown_connections 2024-03-19T06:12:59.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.269+0000 7f0845400700 1 --2- 172.21.15.72:0/1631373635 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f082406dfa0 0x7f0824070450 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.269+0000 7f0845400700 1 --2- 172.21.15.72:0/1631373635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840102430 0x7f0840197d20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.269+0000 7f0845400700 1 --2- 172.21.15.72:0/1631373635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08401036d0 0x7f0840198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.269+0000 7f0845400700 1 -- 172.21.15.72:0/1631373635 >> 172.21.15.72:0/1631373635 conn(0x7f08400fda80 msgr2=0x7f0840106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:59.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.269+0000 7f0845400700 1 -- 172.21.15.72:0/1631373635 shutdown_connections 2024-03-19T06:12:59.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.269+0000 7f0845400700 1 -- 172.21.15.72:0/1631373635 wait complete. 2024-03-19T06:12:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.426+0000 7f19e3e00700 1 -- 172.21.15.72:0/1238951140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc0ff4a0 msgr2=0x7f19dc0ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.426+0000 7f19e3e00700 1 --2- 172.21.15.72:0/1238951140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc0ff4a0 0x7f19dc0ff910 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009910 tx=0x7f19c8009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.427+0000 7f19e3e00700 1 -- 172.21.15.72:0/1238951140 shutdown_connections 2024-03-19T06:12:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.427+0000 7f19e3e00700 1 --2- 172.21.15.72:0/1238951140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc0ff4a0 0x7f19dc0ff910 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.427+0000 7f19e3e00700 1 --2- 172.21.15.72:0/1238951140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc0feb50 0x7f19dc0fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.427+0000 7f19e3e00700 1 -- 172.21.15.72:0/1238951140 >> 172.21.15.72:0/1238951140 conn(0x7f19dc0fa700 msgr2=0x7f19dc0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.427+0000 7f19e3e00700 1 -- 172.21.15.72:0/1238951140 shutdown_connections 2024-03-19T06:12:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.427+0000 7f19e3e00700 1 -- 172.21.15.72:0/1238951140 wait complete. 2024-03-19T06:12:59.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.428+0000 7f19e3e00700 1 Processor -- start 2024-03-19T06:12:59.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.428+0000 7f19e3e00700 1 -- start start 2024-03-19T06:12:59.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.428+0000 7f19e3e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc0feb50 0x7f19dc197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:59.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.428+0000 7f19e3e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc0ff4a0 0x7f19dc198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:59.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.428+0000 7f19e3e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc198860 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.428+0000 7f19e3e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc19d270 con 0x7f19dc0feb50 2024-03-19T06:12:59.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.429+0000 7f19e0a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc0ff4a0 0x7f19dc198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:59.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.429+0000 7f19e0a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc0ff4a0 0x7f19dc198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44754/0 (socket says 172.21.15.72:44754) 2024-03-19T06:12:59.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.429+0000 7f19e0a00700 1 -- 172.21.15.72:0/3892084501 learned_addr learned my addr 172.21.15.72:0/3892084501 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:59.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.429+0000 7f19e1400700 1 --2- 172.21.15.72:0/3892084501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc0feb50 0x7f19dc197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:59.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.429+0000 7f19e0a00700 1 -- 172.21.15.72:0/3892084501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc0feb50 msgr2=0x7f19dc197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:59.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.429+0000 7f19e0a00700 1 --2- 172.21.15.72:0/3892084501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc0feb50 0x7f19dc197d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.429+0000 7f19e0a00700 1 -- 172.21.15.72:0/3892084501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80095f0 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.429+0000 7f19e0a00700 1 --2- 172.21.15.72:0/3892084501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc0ff4a0 0x7f19dc198240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f19c800b5c0 tx=0x7f19c800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:59.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.430+0000 7f19da000700 1 -- 172.21.15.72:0/3892084501 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c801d070 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.430+0000 7f19da000700 1 -- 172.21.15.72:0/3892084501 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19c8022470 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.430+0000 7f19e3e00700 1 -- 172.21.15.72:0/3892084501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc19d410 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.430+0000 7f19da000700 1 -- 172.21.15.72:0/3892084501 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c800f690 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.430+0000 7f19e3e00700 1 -- 172.21.15.72:0/3892084501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc19d8d0 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.431+0000 7f19e3e00700 1 -- 172.21.15.72:0/3892084501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc10afa0 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.432+0000 7f19da000700 1 -- 172.21.15.72:0/3892084501 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f19c8004b70 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.433+0000 7f19da000700 1 --2- 172.21.15.72:0/3892084501 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f19c406dfa0 0x7f19c4070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:59.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.433+0000 7f19da000700 1 -- 172.21.15.72:0/3892084501 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f19c808f390 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.433+0000 7f19e1400700 1 --2- 172.21.15.72:0/3892084501 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f19c406dfa0 0x7f19c4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:59.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.434+0000 7f19e1400700 1 --2- 172.21.15.72:0/3892084501 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f19c406dfa0 0x7f19c4070450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f19dc1991e0 tx=0x7f19d0005cf0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:59.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.438+0000 7f19da000700 1 -- 172.21.15.72:0/3892084501 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f19c8058940 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.690+0000 7f19e3e00700 1 -- 172.21.15.72:0/3892084501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f19dc10b190 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.691+0000 7f19da000700 1 -- 172.21.15.72:0/3892084501 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1871 (secure 0 0 0) 0x7f19c8027760 con 0x7f19dc0ff4a0 2024-03-19T06:12:59.681 INFO:teuthology.orchestra.run.smithi072.stdout:e20 2024-03-19T06:12:59.681 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:12:59.681 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:12:59.681 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:12:59.682 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:12:59.682 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:12:59.682 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:12:59.682 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 20 2024-03-19T06:12:59.682 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:12:59.682 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:12:59.682 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:12:47.467520+0000 2024-03-19T06:12:59.682 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:12:59.682 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:12:59.682 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:12:59.682 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:12:59.682 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:12:59.683 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:12:59.683 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:12:59.683 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:12:59.683 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 0 2024-03-19T06:12:59.683 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:12:59.683 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-03-19T06:12:59.683 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:12:59.683 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14464,1=24227} 2024-03-19T06:12:59.683 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:12:59.683 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.72:6826/772635337,v1:172.21.15.72:6827/772635337] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{1:24227} state up:stopping seq 5 export targets 0 join_fscid=1 addr [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:12:59.684 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:12:59.685 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:14472} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:12:59.685 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:12:59.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.693+0000 7f19e3e00700 1 -- 172.21.15.72:0/3892084501 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f19c406dfa0 msgr2=0x7f19c4070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:59.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.693+0000 7f19e3e00700 1 --2- 172.21.15.72:0/3892084501 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f19c406dfa0 0x7f19c4070450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f19dc1991e0 tx=0x7f19d0005cf0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.693+0000 7f19e3e00700 1 -- 172.21.15.72:0/3892084501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc0ff4a0 msgr2=0x7f19dc198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:59.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.693+0000 7f19e3e00700 1 --2- 172.21.15.72:0/3892084501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc0ff4a0 0x7f19dc198240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f19c800b5c0 tx=0x7f19c800be20 comp rx=0 tx=0).stop 2024-03-19T06:12:59.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.693+0000 7f19e3e00700 1 -- 172.21.15.72:0/3892084501 shutdown_connections 2024-03-19T06:12:59.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.693+0000 7f19e3e00700 1 --2- 172.21.15.72:0/3892084501 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f19c406dfa0 0x7f19c4070450 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.693+0000 7f19e3e00700 1 --2- 172.21.15.72:0/3892084501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc0feb50 0x7f19dc197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.693+0000 7f19e3e00700 1 --2- 172.21.15.72:0/3892084501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc0ff4a0 0x7f19dc198240 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.693+0000 7f19e3e00700 1 -- 172.21.15.72:0/3892084501 >> 172.21.15.72:0/3892084501 conn(0x7f19dc0fa700 msgr2=0x7f19dc107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:59.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.693+0000 7f19e3e00700 1 -- 172.21.15.72:0/3892084501 shutdown_connections 2024-03-19T06:12:59.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.694+0000 7f19e3e00700 1 -- 172.21.15.72:0/3892084501 wait complete. 2024-03-19T06:12:59.686 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 20 2024-03-19T06:12:59.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.846+0000 7f18c6400700 1 -- 172.21.15.72:0/2195295478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c0102490 msgr2=0x7f18c01028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:59.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.846+0000 7f18c6400700 1 --2- 172.21.15.72:0/2195295478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c0102490 0x7f18c01028a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009910 tx=0x7f18b0009c20 comp rx=0 tx=0).stop 2024-03-19T06:12:59.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.846+0000 7f18c6400700 1 -- 172.21.15.72:0/2195295478 shutdown_connections 2024-03-19T06:12:59.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.846+0000 7f18c6400700 1 --2- 172.21.15.72:0/2195295478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18c0103640 0x7f18c0103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.846+0000 7f18c6400700 1 --2- 172.21.15.72:0/2195295478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c0102490 0x7f18c01028a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.846+0000 7f18c6400700 1 -- 172.21.15.72:0/2195295478 >> 172.21.15.72:0/2195295478 conn(0x7f18c00fda60 msgr2=0x7f18c00ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:12:59.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.846+0000 7f18c6400700 1 -- 172.21.15.72:0/2195295478 shutdown_connections 2024-03-19T06:12:59.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.847+0000 7f18c6400700 1 -- 172.21.15.72:0/2195295478 wait complete. 2024-03-19T06:12:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.847+0000 7f18c6400700 1 Processor -- start 2024-03-19T06:12:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.848+0000 7f18c6400700 1 -- start start 2024-03-19T06:12:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.848+0000 7f18c6400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18c0102490 0x7f18c0197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.848+0000 7f18c6400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c0103640 0x7f18c0198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.848+0000 7f18c6400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c0198850 con 0x7f18c0103640 2024-03-19T06:12:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.848+0000 7f18c6400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c019d260 con 0x7f18c0102490 2024-03-19T06:12:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.848+0000 7f18bea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c0103640 0x7f18c0198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.848+0000 7f18bea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c0103640 0x7f18c0198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44776/0 (socket says 172.21.15.72:44776) 2024-03-19T06:12:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.848+0000 7f18bea00700 1 -- 172.21.15.72:0/3507720509 learned_addr learned my addr 172.21.15.72:0/3507720509 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:12:59.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.849+0000 7f18bf400700 1 --2- 172.21.15.72:0/3507720509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18c0102490 0x7f18c0197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:59.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.849+0000 7f18bea00700 1 -- 172.21.15.72:0/3507720509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18c0102490 msgr2=0x7f18c0197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:12:59.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.849+0000 7f18bea00700 1 --2- 172.21.15.72:0/3507720509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18c0102490 0x7f18c0197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:12:59.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.849+0000 7f18bea00700 1 -- 172.21.15.72:0/3507720509 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b00095f0 con 0x7f18c0103640 2024-03-19T06:12:59.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.849+0000 7f18bea00700 1 --2- 172.21.15.72:0/3507720509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c0103640 0x7f18c0198230 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00d8d0 tx=0x7f18ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:59.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.849+0000 7f18b7e00700 1 -- 172.21.15.72:0/3507720509 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18ac009940 con 0x7f18c0103640 2024-03-19T06:12:59.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.849+0000 7f18b7e00700 1 -- 172.21.15.72:0/3507720509 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f18ac010460 con 0x7f18c0103640 2024-03-19T06:12:59.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.849+0000 7f18c6400700 1 -- 172.21.15.72:0/3507720509 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c019d460 con 0x7f18c0103640 2024-03-19T06:12:59.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.849+0000 7f18b7e00700 1 -- 172.21.15.72:0/3507720509 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18ac00f5f0 con 0x7f18c0103640 2024-03-19T06:12:59.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.849+0000 7f18c6400700 1 -- 172.21.15.72:0/3507720509 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c019d980 con 0x7f18c0103640 2024-03-19T06:12:59.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.850+0000 7f18c6400700 1 -- 172.21.15.72:0/3507720509 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c010af90 con 0x7f18c0103640 2024-03-19T06:12:59.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.852+0000 7f18b7e00700 1 -- 172.21.15.72:0/3507720509 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f18ac0105d0 con 0x7f18c0103640 2024-03-19T06:12:59.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.853+0000 7f18b7e00700 1 --2- 172.21.15.72:0/3507720509 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f18a406dfa0 0x7f18a4070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:12:59.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.853+0000 7f18b7e00700 1 -- 172.21.15.72:0/3507720509 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f18ac08d790 con 0x7f18c0103640 2024-03-19T06:12:59.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.853+0000 7f18bf400700 1 --2- 172.21.15.72:0/3507720509 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f18a406dfa0 0x7f18a4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:12:59.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.854+0000 7f18bf400700 1 --2- 172.21.15.72:0/3507720509 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f18a406dfa0 0x7f18a4070450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18b00059d0 tx=0x7f18b0005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:12:59.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:12:59.859+0000 7f18b7e00700 1 -- 172.21.15.72:0/3507720509 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f18ac056c10 con 0x7f18c0103640 2024-03-19T06:13:00.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:59 smithi072 ceph-mon[78545]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:13:00.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:59 smithi072 ceph-mon[78545]: pgmap v201: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 2.5 KiB/s wr, 2 op/s 2024-03-19T06:13:00.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:59 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1631373635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:00.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:12:59 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3892084501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:13:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.101+0000 7f18c6400700 1 -- 172.21.15.72:0/3507720509 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18c0107f90 con 0x7f18a406dfa0 2024-03-19T06:13:00.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.104+0000 7f18b7e00700 1 -- 172.21.15.72:0/3507720509 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f18c0107f90 con 0x7f18a406dfa0 2024-03-19T06:13:00.094 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:13:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:13:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:13:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:13:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:13:00.094 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:13:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:13:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-03-19T06:13:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:13:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:13:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "12/23 daemons upgraded", 2024-03-19T06:13:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading osd daemons", 2024-03-19T06:13:00.095 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:13:00.095 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:13:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.107+0000 7f18c6400700 1 -- 172.21.15.72:0/3507720509 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f18a406dfa0 msgr2=0x7f18a4070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.107+0000 7f18c6400700 1 --2- 172.21.15.72:0/3507720509 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f18a406dfa0 0x7f18a4070450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18b00059d0 tx=0x7f18b0005960 comp rx=0 tx=0).stop 2024-03-19T06:13:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.107+0000 7f18c6400700 1 -- 172.21.15.72:0/3507720509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c0103640 msgr2=0x7f18c0198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.107+0000 7f18c6400700 1 --2- 172.21.15.72:0/3507720509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c0103640 0x7f18c0198230 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00d8d0 tx=0x7f18ac00dc90 comp rx=0 tx=0).stop 2024-03-19T06:13:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.107+0000 7f18c6400700 1 -- 172.21.15.72:0/3507720509 shutdown_connections 2024-03-19T06:13:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.107+0000 7f18c6400700 1 --2- 172.21.15.72:0/3507720509 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f18a406dfa0 0x7f18a4070450 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.107+0000 7f18c6400700 1 --2- 172.21.15.72:0/3507720509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18c0102490 0x7f18c0197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.107+0000 7f18c6400700 1 --2- 172.21.15.72:0/3507720509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18c0103640 0x7f18c0198230 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.107+0000 7f18c6400700 1 -- 172.21.15.72:0/3507720509 >> 172.21.15.72:0/3507720509 conn(0x7f18c00fda60 msgr2=0x7f18c0106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.107+0000 7f18c6400700 1 -- 172.21.15.72:0/3507720509 shutdown_connections 2024-03-19T06:13:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.107+0000 7f18c6400700 1 -- 172.21.15.72:0/3507720509 wait complete. 2024-03-19T06:13:00.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:59 smithi172 ceph-mon[66682]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:13:00.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:59 smithi172 ceph-mon[66682]: pgmap v201: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 2.5 KiB/s wr, 2 op/s 2024-03-19T06:13:00.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:59 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1631373635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:00.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:12:59 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3892084501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:13:00.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.255+0000 7f11c1400700 1 -- 172.21.15.72:0/4161573346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11bc103310 msgr2=0x7f11bc105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.255+0000 7f11c1400700 1 --2- 172.21.15.72:0/4161573346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11bc103310 0x7f11bc105790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009910 tx=0x7f11a8009c20 comp rx=0 tx=0).stop 2024-03-19T06:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.255+0000 7f11c1400700 1 -- 172.21.15.72:0/4161573346 shutdown_connections 2024-03-19T06:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.255+0000 7f11c1400700 1 --2- 172.21.15.72:0/4161573346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11bc103310 0x7f11bc105790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.255+0000 7f11c1400700 1 --2- 172.21.15.72:0/4161573346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11bc069270 0x7f11bc102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.255+0000 7f11c1400700 1 -- 172.21.15.72:0/4161573346 >> 172.21.15.72:0/4161573346 conn(0x7f11bc0fa780 msgr2=0x7f11bc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.255+0000 7f11c1400700 1 -- 172.21.15.72:0/4161573346 shutdown_connections 2024-03-19T06:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.255+0000 7f11c1400700 1 -- 172.21.15.72:0/4161573346 wait complete. 2024-03-19T06:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.256+0000 7f11c1400700 1 Processor -- start 2024-03-19T06:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.256+0000 7f11c1400700 1 -- start start 2024-03-19T06:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.257+0000 7f11c1400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11bc103310 0x7f11bc197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.257+0000 7f11c1400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11bc198290 0x7f11bc19d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.257+0000 7f11c1400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc198790 con 0x7f11bc103310 2024-03-19T06:13:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.257+0000 7f11c1400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc198900 con 0x7f11bc198290 2024-03-19T06:13:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.257+0000 7f11ba800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11bc103310 0x7f11bc197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.257+0000 7f11ba800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11bc103310 0x7f11bc197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44796/0 (socket says 172.21.15.72:44796) 2024-03-19T06:13:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.257+0000 7f11ba800700 1 -- 172.21.15.72:0/1879753912 learned_addr learned my addr 172.21.15.72:0/1879753912 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:13:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.257+0000 7f11ba800700 1 -- 172.21.15.72:0/1879753912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11bc198290 msgr2=0x7f11bc19d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.257+0000 7f11ba800700 1 --2- 172.21.15.72:0/1879753912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11bc198290 0x7f11bc19d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.257+0000 7f11ba800700 1 -- 172.21.15.72:0/1879753912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a80095f0 con 0x7f11bc103310 2024-03-19T06:13:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.258+0000 7f11ba800700 1 --2- 172.21.15.72:0/1879753912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11bc103310 0x7f11bc197d50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00b480 tx=0x7f11ac00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.258+0000 7f11b3400700 1 -- 172.21.15.72:0/1879753912 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11ac0118c0 con 0x7f11bc103310 2024-03-19T06:13:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.258+0000 7f11b3400700 1 -- 172.21.15.72:0/1879753912 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f11ac010380 con 0x7f11bc103310 2024-03-19T06:13:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.258+0000 7f11b3400700 1 -- 172.21.15.72:0/1879753912 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11ac00f4f0 con 0x7f11bc103310 2024-03-19T06:13:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.258+0000 7f11c1400700 1 -- 172.21.15.72:0/1879753912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc19d8a0 con 0x7f11bc103310 2024-03-19T06:13:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.258+0000 7f11c1400700 1 -- 172.21.15.72:0/1879753912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc19ddc0 con 0x7f11bc103310 2024-03-19T06:13:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.259+0000 7f11c1400700 1 -- 172.21.15.72:0/1879753912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11bc0fc340 con 0x7f11bc103310 2024-03-19T06:13:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.260+0000 7f11b3400700 1 -- 172.21.15.72:0/1879753912 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f11ac0104f0 con 0x7f11bc103310 2024-03-19T06:13:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.261+0000 7f11b3400700 1 --2- 172.21.15.72:0/1879753912 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f11a006dfa0 0x7f11a0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.261+0000 7f11b3400700 1 -- 172.21.15.72:0/1879753912 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f11ac08d8e0 con 0x7f11bc103310 2024-03-19T06:13:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.262+0000 7f11b9e00700 1 --2- 172.21.15.72:0/1879753912 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f11a006dfa0 0x7f11a0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.262+0000 7f11b9e00700 1 --2- 172.21.15.72:0/1879753912 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f11a006dfa0 0x7f11a0070450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f11a800b5c0 tx=0x7f11a8005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:00.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.266+0000 7f11b3400700 1 -- 172.21.15.72:0/1879753912 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f11ac05a910 con 0x7f11bc103310 2024-03-19T06:13:00.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.572+0000 7f11c1400700 1 -- 172.21.15.72:0/1879753912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f11bc069270 con 0x7f11bc103310 2024-03-19T06:13:00.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.573+0000 7f11b3400700 1 -- 172.21.15.72:0/1879753912 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f11ac05a4a0 con 0x7f11bc103310 2024-03-19T06:13:00.563 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:13:00.563 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:13:00.563 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:13:00.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.577+0000 7f11c1400700 1 -- 172.21.15.72:0/1879753912 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f11a006dfa0 msgr2=0x7f11a0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:00.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.577+0000 7f11c1400700 1 --2- 172.21.15.72:0/1879753912 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f11a006dfa0 0x7f11a0070450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f11a800b5c0 tx=0x7f11a8005fd0 comp rx=0 tx=0).stop 2024-03-19T06:13:00.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.577+0000 7f11c1400700 1 -- 172.21.15.72:0/1879753912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11bc103310 msgr2=0x7f11bc197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:00.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.577+0000 7f11c1400700 1 --2- 172.21.15.72:0/1879753912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11bc103310 0x7f11bc197d50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00b480 tx=0x7f11ac00b840 comp rx=0 tx=0).stop 2024-03-19T06:13:00.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.577+0000 7f11c1400700 1 -- 172.21.15.72:0/1879753912 shutdown_connections 2024-03-19T06:13:00.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.577+0000 7f11c1400700 1 --2- 172.21.15.72:0/1879753912 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f11a006dfa0 0x7f11a0070450 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:00.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.577+0000 7f11c1400700 1 --2- 172.21.15.72:0/1879753912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11bc103310 0x7f11bc197d50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:00.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.577+0000 7f11c1400700 1 --2- 172.21.15.72:0/1879753912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11bc198290 0x7f11bc19d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:00.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.577+0000 7f11c1400700 1 -- 172.21.15.72:0/1879753912 >> 172.21.15.72:0/1879753912 conn(0x7f11bc0fa780 msgr2=0x7f11bc103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:00.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.577+0000 7f11c1400700 1 -- 172.21.15.72:0/1879753912 shutdown_connections 2024-03-19T06:13:00.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:00.577+0000 7f11c1400700 1 -- 172.21.15.72:0/1879753912 wait complete. 2024-03-19T06:13:01.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:00 smithi172 ceph-mon[66682]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:13:01.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:00 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1879753912' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:13:01.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:00 smithi072 ceph-mon[78545]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:13:01.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:00 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1879753912' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:13:02.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:01 smithi172 ceph-mon[66682]: pgmap v202: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 2.5 KiB/s wr, 3 op/s 2024-03-19T06:13:02.304 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:01 smithi072 ceph-mon[78545]: pgmap v202: 65 pgs: 65 active+clean; 355 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 2.5 KiB/s wr, 3 op/s 2024-03-19T06:13:04.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:03 smithi172 ceph-mon[66682]: pgmap v203: 65 pgs: 65 active+clean; 351 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 2.7 KiB/s wr, 6 op/s 2024-03-19T06:13:04.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:03 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:13:04.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:03 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:13:04.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:03 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:13:04.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:03 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:04.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:03 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:13:04.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:03 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:04.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:03 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:04.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:03 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:04.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:03 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:04.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:03 smithi072 ceph-mon[78545]: pgmap v203: 65 pgs: 65 active+clean; 351 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 2.7 KiB/s wr, 6 op/s 2024-03-19T06:13:04.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:03 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:13:04.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:03 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:13:04.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:03 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:13:04.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:03 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:04.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:03 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:13:04.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:03 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:04.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:03 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:04.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:03 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:04.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:03 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:05.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:04 smithi172 ceph-mon[66682]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-03-19T06:13:05.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:04 smithi072 ceph-mon[78545]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-03-19T06:13:06.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:05 smithi172 ceph-mon[66682]: pgmap v204: 65 pgs: 65 active+clean; 311 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-19T06:13:06.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:05 smithi072 ceph-mon[78545]: pgmap v204: 65 pgs: 65 active+clean; 311 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-19T06:13:08.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:07 smithi172 ceph-mon[66682]: pgmap v205: 65 pgs: 65 active+clean; 203 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.4 KiB/s wr, 8 op/s 2024-03-19T06:13:08.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:07 smithi072 ceph-mon[78545]: pgmap v205: 65 pgs: 65 active+clean; 203 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.4 KiB/s wr, 8 op/s 2024-03-19T06:13:10.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:09 smithi172 ceph-mon[66682]: pgmap v206: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 8 op/s 2024-03-19T06:13:10.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:13:10.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:09 smithi072 ceph-mon[78545]: pgmap v206: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 8 op/s 2024-03-19T06:13:10.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:13:12.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:11 smithi172 ceph-mon[66682]: pgmap v207: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 7 op/s 2024-03-19T06:13:12.303 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:11 smithi072 ceph-mon[78545]: pgmap v207: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 7 op/s 2024-03-19T06:13:13.327 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:12 smithi072 ceph-mon[78545]: daemon mds.cephfs.smithi172.xlokxp finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-03-19T06:13:13.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:12 smithi172 ceph-mon[66682]: daemon mds.cephfs.smithi172.xlokxp finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-03-19T06:13:14.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:13 smithi072 ceph-mon[78545]: pgmap v208: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 7 op/s 2024-03-19T06:13:14.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:13 smithi072 ceph-mon[78545]: mds.1 [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] down:stopped 2024-03-19T06:13:14.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:13 smithi072 ceph-mon[78545]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:active} 2 up:standby 2024-03-19T06:13:14.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:13 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:13:14.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:13 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:13:14.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:13 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:13:14.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:13 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:14.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:13 smithi172 ceph-mon[66682]: pgmap v208: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 7 op/s 2024-03-19T06:13:14.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:13 smithi172 ceph-mon[66682]: mds.1 [v2:172.21.15.172:6824/2806079216,v1:172.21.15.172:6825/2806079216] down:stopped 2024-03-19T06:13:14.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:13 smithi172 ceph-mon[66682]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:active} 2 up:standby 2024-03-19T06:13:14.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:13 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:13:14.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:13 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:13:14.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:13 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:13:14.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:13 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:15.178 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:14 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.172:6824/3611765575,v1:172.21.15.172:6825/3611765575] up:boot 2024-03-19T06:13:15.178 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:14 smithi072 ceph-mon[78545]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:active} 3 up:standby 2024-03-19T06:13:15.178 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:14 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:13:15.178 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:14 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:13:15.178 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:14 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:15.178 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:14 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:15.178 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:14 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:15.178 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:14 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:15.179 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:14 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi072.jhxzfi"]}]: dispatch 2024-03-19T06:13:15.179 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:14 smithi072 ceph-mon[78545]: Upgrade: It appears safe to stop mds.cephfs.smithi072.jhxzfi 2024-03-19T06:13:15.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:14 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.172:6824/3611765575,v1:172.21.15.172:6825/3611765575] up:boot 2024-03-19T06:13:15.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:14 smithi172 ceph-mon[66682]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:active} 3 up:standby 2024-03-19T06:13:15.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:14 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:13:15.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:14 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:13:15.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:14 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:15.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:14 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:15.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:14 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:15.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:14 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:15.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:14 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi072.jhxzfi"]}]: dispatch 2024-03-19T06:13:15.403 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:14 smithi172 ceph-mon[66682]: Upgrade: It appears safe to stop mds.cephfs.smithi072.jhxzfi 2024-03-19T06:13:16.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:15 smithi072 ceph-mon[78545]: pgmap v209: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 3 op/s 2024-03-19T06:13:16.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:15 smithi172 ceph-mon[66682]: pgmap v209: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 3 op/s 2024-03-19T06:13:17.594 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:17 smithi072 ceph-mon[78545]: Upgrade: Updating mds.cephfs.smithi072.jhxzfi 2024-03-19T06:13:17.595 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:17 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:17.595 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:17 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.jhxzfi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:13:17.595 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:17 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:13:17.595 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:17 smithi072 ceph-mon[78545]: Deploying daemon mds.cephfs.smithi072.jhxzfi on smithi072 2024-03-19T06:13:17.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:17 smithi172 ceph-mon[66682]: Upgrade: Updating mds.cephfs.smithi072.jhxzfi 2024-03-19T06:13:17.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:17 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:17.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:17 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.jhxzfi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:13:17.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:17 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:13:17.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:17 smithi172 ceph-mon[66682]: Deploying daemon mds.cephfs.smithi072.jhxzfi on smithi072 2024-03-19T06:13:18.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:18 smithi072 ceph-mon[78545]: pgmap v210: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 2 op/s 2024-03-19T06:13:18.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:18 smithi172 ceph-mon[66682]: pgmap v210: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 2 op/s 2024-03-19T06:13:20.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:19 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072[78541]: 2024-03-19T06:13:19.630+0000 7f9b50200700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:13:20.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:20 smithi072 ceph-mon[78545]: pgmap v211: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-03-19T06:13:20.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:20 smithi072 ceph-mon[78545]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-19T06:13:20.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:20 smithi072 ceph-mon[78545]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:13:20.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:20 smithi072 ceph-mon[78545]: osdmap e80: 6 total, 6 up, 6 in 2024-03-19T06:13:20.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:20 smithi072 ceph-mon[78545]: Standby daemon mds.cephfs.smithi072.dvdjwb assigned to filesystem cephfs as rank 0 2024-03-19T06:13:20.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:20 smithi072 ceph-mon[78545]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-19T06:13:20.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:20 smithi072 ceph-mon[78545]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-03-19T06:13:20.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:20 smithi072 ceph-mon[78545]: fsmap cephfs:1/1 {0=cephfs.smithi072.dvdjwb=up:replay} 2 up:standby 2024-03-19T06:13:20.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:20 smithi172 ceph-mon[66682]: pgmap v211: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-03-19T06:13:20.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:20 smithi172 ceph-mon[66682]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-19T06:13:20.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:20 smithi172 ceph-mon[66682]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:13:20.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:20 smithi172 ceph-mon[66682]: osdmap e80: 6 total, 6 up, 6 in 2024-03-19T06:13:20.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:20 smithi172 ceph-mon[66682]: Standby daemon mds.cephfs.smithi072.dvdjwb assigned to filesystem cephfs as rank 0 2024-03-19T06:13:20.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:20 smithi172 ceph-mon[66682]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-19T06:13:20.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:20 smithi172 ceph-mon[66682]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-03-19T06:13:20.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:20 smithi172 ceph-mon[66682]: fsmap cephfs:1/1 {0=cephfs.smithi072.dvdjwb=up:replay} 2 up:standby 2024-03-19T06:13:21.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:21 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:13:21.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:21 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:13:22.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:22 smithi072 ceph-mon[78545]: pgmap v213: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:13:22.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:22 smithi172 ceph-mon[66682]: pgmap v213: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:13:24.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:24 smithi072 ceph-mon[78545]: pgmap v214: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-03-19T06:13:24.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:24 smithi172 ceph-mon[66682]: pgmap v214: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-03-19T06:13:26.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:25 smithi172 ceph-mon[66682]: pgmap v215: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-03-19T06:13:26.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:26.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:13:26.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:25 smithi072 ceph-mon[78545]: pgmap v215: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-03-19T06:13:26.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:26.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:13:27.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:27 smithi172 ceph-mon[66682]: reconnect by client.14520 192.168.0.1:0/3828438056 after 0.00299994 2024-03-19T06:13:27.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:27 smithi172 ceph-mon[66682]: reconnect by client.24271 192.168.0.1:0/1243789683 after 0.00299994 2024-03-19T06:13:27.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:27 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] up:reconnect 2024-03-19T06:13:27.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:27 smithi172 ceph-mon[66682]: fsmap cephfs:1/1 {0=cephfs.smithi072.dvdjwb=up:reconnect} 2 up:standby 2024-03-19T06:13:27.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:27 smithi072 ceph-mon[78545]: reconnect by client.14520 192.168.0.1:0/3828438056 after 0.00299994 2024-03-19T06:13:27.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:27 smithi072 ceph-mon[78545]: reconnect by client.24271 192.168.0.1:0/1243789683 after 0.00299994 2024-03-19T06:13:27.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:27 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] up:reconnect 2024-03-19T06:13:27.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:27 smithi072 ceph-mon[78545]: fsmap cephfs:1/1 {0=cephfs.smithi072.dvdjwb=up:reconnect} 2 up:standby 2024-03-19T06:13:28.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:28 smithi072 ceph-mon[78545]: pgmap v216: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-03-19T06:13:28.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:28 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] up:rejoin 2024-03-19T06:13:28.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:28 smithi072 ceph-mon[78545]: fsmap cephfs:1/1 {0=cephfs.smithi072.dvdjwb=up:rejoin} 2 up:standby 2024-03-19T06:13:28.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:28 smithi072 ceph-mon[78545]: daemon mds.cephfs.smithi072.dvdjwb is now active in filesystem cephfs as rank 0 2024-03-19T06:13:28.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:28 smithi172 ceph-mon[66682]: pgmap v216: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-03-19T06:13:28.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:28 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] up:rejoin 2024-03-19T06:13:28.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:28 smithi172 ceph-mon[66682]: fsmap cephfs:1/1 {0=cephfs.smithi072.dvdjwb=up:rejoin} 2 up:standby 2024-03-19T06:13:28.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:28 smithi172 ceph-mon[66682]: daemon mds.cephfs.smithi072.dvdjwb is now active in filesystem cephfs as rank 0 2024-03-19T06:13:29.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:29 smithi072 ceph-mon[78545]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-19T06:13:29.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:29 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] up:active 2024-03-19T06:13:29.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:29 smithi072 ceph-mon[78545]: fsmap cephfs:1 {0=cephfs.smithi072.dvdjwb=up:active} 2 up:standby 2024-03-19T06:13:29.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:29 smithi172 ceph-mon[66682]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-19T06:13:29.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:29 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] up:active 2024-03-19T06:13:29.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:29 smithi172 ceph-mon[66682]: fsmap cephfs:1 {0=cephfs.smithi072.dvdjwb=up:active} 2 up:standby 2024-03-19T06:13:30.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:30 smithi072 ceph-mon[78545]: pgmap v217: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-03-19T06:13:30.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.870+0000 7fa740000700 1 -- 172.21.15.72:0/1249826789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa738102430 msgr2=0x7fa738102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:30.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.870+0000 7fa740000700 1 --2- 172.21.15.72:0/1249826789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa738102430 0x7fa738102840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00b0a0 tx=0x7fa72c00b3b0 comp rx=0 tx=0).stop 2024-03-19T06:13:30.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.871+0000 7fa740000700 1 -- 172.21.15.72:0/1249826789 shutdown_connections 2024-03-19T06:13:30.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.871+0000 7fa740000700 1 --2- 172.21.15.72:0/1249826789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7381036d0 0x7fa738103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:30.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.871+0000 7fa740000700 1 --2- 172.21.15.72:0/1249826789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa738102430 0x7fa738102840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:30.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.871+0000 7fa740000700 1 -- 172.21.15.72:0/1249826789 >> 172.21.15.72:0/1249826789 conn(0x7fa7380fda80 msgr2=0x7fa7380ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:30.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.871+0000 7fa740000700 1 -- 172.21.15.72:0/1249826789 shutdown_connections 2024-03-19T06:13:30.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.871+0000 7fa740000700 1 -- 172.21.15.72:0/1249826789 wait complete. 2024-03-19T06:13:30.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.874+0000 7fa740000700 1 Processor -- start 2024-03-19T06:13:30.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.875+0000 7fa740000700 1 -- start start 2024-03-19T06:13:30.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.876+0000 7fa740000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa738102430 0x7fa738197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:30.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.876+0000 7fa740000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7381036d0 0x7fa7381982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:30.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.876+0000 7fa740000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa738198910 con 0x7fa7381036d0 2024-03-19T06:13:30.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.876+0000 7fa740000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa738198a50 con 0x7fa738102430 2024-03-19T06:13:30.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.876+0000 7fa73cc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7381036d0 0x7fa7381982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:30.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.877+0000 7fa73cc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7381036d0 0x7fa7381982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47180/0 (socket says 172.21.15.72:47180) 2024-03-19T06:13:30.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.877+0000 7fa73cc00700 1 -- 172.21.15.72:0/2317388629 learned_addr learned my addr 172.21.15.72:0/2317388629 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:13:30.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.877+0000 7fa73d600700 1 --2- 172.21.15.72:0/2317388629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa738102430 0x7fa738197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:30.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.877+0000 7fa73d600700 1 -- 172.21.15.72:0/2317388629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7381036d0 msgr2=0x7fa7381982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:30.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.877+0000 7fa73d600700 1 --2- 172.21.15.72:0/2317388629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7381036d0 0x7fa7381982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:30.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.877+0000 7fa73d600700 1 -- 172.21.15.72:0/2317388629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c009d00 con 0x7fa738102430 2024-03-19T06:13:30.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.878+0000 7fa73d600700 1 --2- 172.21.15.72:0/2317388629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa738102430 0x7fa738197db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00b070 tx=0x7fa72c003c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.878+0000 7fa736000700 1 -- 172.21.15.72:0/2317388629 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa72c021070 con 0x7fa738102430 2024-03-19T06:13:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.878+0000 7fa740000700 1 -- 172.21.15.72:0/2317388629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73819d4a0 con 0x7fa738102430 2024-03-19T06:13:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.879+0000 7fa736000700 1 -- 172.21.15.72:0/2317388629 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa72c00ce60 con 0x7fa738102430 2024-03-19T06:13:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.879+0000 7fa736000700 1 -- 172.21.15.72:0/2317388629 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa72c00e040 con 0x7fa738102430 2024-03-19T06:13:30.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.879+0000 7fa740000700 1 -- 172.21.15.72:0/2317388629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73819d990 con 0x7fa738102430 2024-03-19T06:13:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.881+0000 7fa740000700 1 -- 172.21.15.72:0/2317388629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73810af90 con 0x7fa738102430 2024-03-19T06:13:30.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.882+0000 7fa736000700 1 -- 172.21.15.72:0/2317388629 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fa72c01d9f0 con 0x7fa738102430 2024-03-19T06:13:30.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.883+0000 7fa736000700 1 --2- 172.21.15.72:0/2317388629 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa72006dfa0 0x7fa720070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:30.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.883+0000 7fa736000700 1 -- 172.21.15.72:0/2317388629 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa72c08efc0 con 0x7fa738102430 2024-03-19T06:13:30.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.883+0000 7fa73cc00700 1 --2- 172.21.15.72:0/2317388629 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa72006dfa0 0x7fa720070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:30.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.884+0000 7fa73cc00700 1 --2- 172.21.15.72:0/2317388629 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa72006dfa0 0x7fa720070450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa724009ad0 tx=0x7fa724009290 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:30.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:30.899+0000 7fa736000700 1 -- 172.21.15.72:0/2317388629 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fa72c05c020 con 0x7fa738102430 2024-03-19T06:13:30.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:30 smithi172 ceph-mon[66682]: pgmap v217: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-03-19T06:13:31.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.159+0000 7fa740000700 1 -- 172.21.15.72:0/2317388629 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa738108020 con 0x7fa72006dfa0 2024-03-19T06:13:31.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.163+0000 7fa736000700 1 -- 172.21.15.72:0/2317388629 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa738108020 con 0x7fa72006dfa0 2024-03-19T06:13:31.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.166+0000 7fa740000700 1 -- 172.21.15.72:0/2317388629 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa72006dfa0 msgr2=0x7fa720070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:31.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.166+0000 7fa740000700 1 --2- 172.21.15.72:0/2317388629 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa72006dfa0 0x7fa720070450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa724009ad0 tx=0x7fa724009290 comp rx=0 tx=0).stop 2024-03-19T06:13:31.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.166+0000 7fa740000700 1 -- 172.21.15.72:0/2317388629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa738102430 msgr2=0x7fa738197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:31.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.166+0000 7fa740000700 1 --2- 172.21.15.72:0/2317388629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa738102430 0x7fa738197db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00b070 tx=0x7fa72c003c30 comp rx=0 tx=0).stop 2024-03-19T06:13:31.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.167+0000 7fa740000700 1 -- 172.21.15.72:0/2317388629 shutdown_connections 2024-03-19T06:13:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.167+0000 7fa740000700 1 --2- 172.21.15.72:0/2317388629 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa72006dfa0 0x7fa720070450 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.167+0000 7fa740000700 1 --2- 172.21.15.72:0/2317388629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa738102430 0x7fa738197db0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.167+0000 7fa740000700 1 --2- 172.21.15.72:0/2317388629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7381036d0 0x7fa7381982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.167+0000 7fa740000700 1 -- 172.21.15.72:0/2317388629 >> 172.21.15.72:0/2317388629 conn(0x7fa7380fda80 msgr2=0x7fa738106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.167+0000 7fa740000700 1 -- 172.21.15.72:0/2317388629 shutdown_connections 2024-03-19T06:13:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.167+0000 7fa740000700 1 -- 172.21.15.72:0/2317388629 wait complete. 2024-03-19T06:13:31.171 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:13:31.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.325+0000 7f111a400700 1 -- 172.21.15.72:0/3433778585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1114101440 msgr2=0x7f1114101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:31.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.325+0000 7f111a400700 1 --2- 172.21.15.72:0/3433778585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1114101440 0x7f1114101890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009910 tx=0x7f10fc009c20 comp rx=0 tx=0).stop 2024-03-19T06:13:31.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.325+0000 7f111a400700 1 -- 172.21.15.72:0/3433778585 shutdown_connections 2024-03-19T06:13:31.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.325+0000 7f111a400700 1 --2- 172.21.15.72:0/3433778585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1114101440 0x7f1114101890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:31.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.325+0000 7f111a400700 1 --2- 172.21.15.72:0/3433778585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1114100240 0x7f1114100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:31.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.325+0000 7f111a400700 1 -- 172.21.15.72:0/3433778585 >> 172.21.15.72:0/3433778585 conn(0x7f11140fb7f0 msgr2=0x7f11140fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:31.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.325+0000 7f111a400700 1 -- 172.21.15.72:0/3433778585 shutdown_connections 2024-03-19T06:13:31.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.325+0000 7f111a400700 1 -- 172.21.15.72:0/3433778585 wait complete. 2024-03-19T06:13:31.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.326+0000 7f111a400700 1 Processor -- start 2024-03-19T06:13:31.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.326+0000 7f111a400700 1 -- start start 2024-03-19T06:13:31.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.327+0000 7f111a400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1114100240 0x7f1114195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:31.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.327+0000 7f111a400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1114101440 0x7f1114195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:31.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.327+0000 7f111a400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1114196610 con 0x7f1114101440 2024-03-19T06:13:31.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.327+0000 7f111a400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1114196750 con 0x7f1114100240 2024-03-19T06:13:31.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.327+0000 7f110be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1114101440 0x7f1114195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:31.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.327+0000 7f110be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1114101440 0x7f1114195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47198/0 (socket says 172.21.15.72:47198) 2024-03-19T06:13:31.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.327+0000 7f110be00700 1 -- 172.21.15.72:0/1340048972 learned_addr learned my addr 172.21.15.72:0/1340048972 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:13:31.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.327+0000 7f1113400700 1 --2- 172.21.15.72:0/1340048972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1114100240 0x7f1114195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:31.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.328+0000 7f110be00700 1 -- 172.21.15.72:0/1340048972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1114100240 msgr2=0x7f1114195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:31.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.328+0000 7f110be00700 1 --2- 172.21.15.72:0/1340048972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1114100240 0x7f1114195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:31.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.328+0000 7f110be00700 1 -- 172.21.15.72:0/1340048972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc0095f0 con 0x7f1114101440 2024-03-19T06:13:31.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.328+0000 7f110be00700 1 --2- 172.21.15.72:0/1340048972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1114101440 0x7f1114195ff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00b5c0 tx=0x7f10fc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:31.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.328+0000 7f1110c00700 1 -- 172.21.15.72:0/1340048972 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10fc01d070 con 0x7f1114101440 2024-03-19T06:13:31.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.329+0000 7f111a400700 1 -- 172.21.15.72:0/1340048972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111419b1a0 con 0x7f1114101440 2024-03-19T06:13:31.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.329+0000 7f1110c00700 1 -- 172.21.15.72:0/1340048972 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f10fc022470 con 0x7f1114101440 2024-03-19T06:13:31.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.329+0000 7f1110c00700 1 -- 172.21.15.72:0/1340048972 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10fc00f690 con 0x7f1114101440 2024-03-19T06:13:31.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.329+0000 7f111a400700 1 -- 172.21.15.72:0/1340048972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111419b690 con 0x7f1114101440 2024-03-19T06:13:31.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.330+0000 7f111a400700 1 -- 172.21.15.72:0/1340048972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1114108d90 con 0x7f1114101440 2024-03-19T06:13:31.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.332+0000 7f1110c00700 1 -- 172.21.15.72:0/1340048972 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f10fc0225e0 con 0x7f1114101440 2024-03-19T06:13:31.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.333+0000 7f1110c00700 1 --2- 172.21.15.72:0/1340048972 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f10f806dfa0 0x7f10f8070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:31.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.333+0000 7f1110c00700 1 -- 172.21.15.72:0/1340048972 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f10fc08f400 con 0x7f1114101440 2024-03-19T06:13:31.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.333+0000 7f1113400700 1 --2- 172.21.15.72:0/1340048972 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f10f806dfa0 0x7f10f8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:31.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.334+0000 7f1113400700 1 --2- 172.21.15.72:0/1340048972 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f10f806dfa0 0x7f10f8070450 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f11141012a0 tx=0x7f110400c040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:31.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.338+0000 7f1110c00700 1 -- 172.21.15.72:0/1340048972 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f10fc05c400 con 0x7f1114101440 2024-03-19T06:13:31.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.586+0000 7f111a400700 1 -- 172.21.15.72:0/1340048972 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1114105d90 con 0x7f10f806dfa0 2024-03-19T06:13:31.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.589+0000 7f1110c00700 1 -- 172.21.15.72:0/1340048972 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1114105d90 con 0x7f10f806dfa0 2024-03-19T06:13:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.592+0000 7f111a400700 1 -- 172.21.15.72:0/1340048972 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f10f806dfa0 msgr2=0x7f10f8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.592+0000 7f111a400700 1 --2- 172.21.15.72:0/1340048972 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f10f806dfa0 0x7f10f8070450 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f11141012a0 tx=0x7f110400c040 comp rx=0 tx=0).stop 2024-03-19T06:13:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.592+0000 7f111a400700 1 -- 172.21.15.72:0/1340048972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1114101440 msgr2=0x7f1114195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.592+0000 7f111a400700 1 --2- 172.21.15.72:0/1340048972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1114101440 0x7f1114195ff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00b5c0 tx=0x7f10fc00bd70 comp rx=0 tx=0).stop 2024-03-19T06:13:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.592+0000 7f111a400700 1 -- 172.21.15.72:0/1340048972 shutdown_connections 2024-03-19T06:13:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.592+0000 7f111a400700 1 --2- 172.21.15.72:0/1340048972 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f10f806dfa0 0x7f10f8070450 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.592+0000 7f111a400700 1 --2- 172.21.15.72:0/1340048972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1114100240 0x7f1114195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.592+0000 7f111a400700 1 --2- 172.21.15.72:0/1340048972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1114101440 0x7f1114195ff0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.592+0000 7f111a400700 1 -- 172.21.15.72:0/1340048972 >> 172.21.15.72:0/1340048972 conn(0x7f11140fb7f0 msgr2=0x7f1114104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.592+0000 7f111a400700 1 -- 172.21.15.72:0/1340048972 shutdown_connections 2024-03-19T06:13:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.592+0000 7f111a400700 1 -- 172.21.15.72:0/1340048972 wait complete. 2024-03-19T06:13:31.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.747+0000 7f79f7200700 1 -- 172.21.15.72:0/3384171793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79f8101230 msgr2=0x7f79f81036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:31.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.747+0000 7f79f7200700 1 --2- 172.21.15.72:0/3384171793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79f8101230 0x7f79f81036b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009910 tx=0x7f79e4009c20 comp rx=0 tx=0).stop 2024-03-19T06:13:31.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.747+0000 7f79f7200700 1 -- 172.21.15.72:0/3384171793 shutdown_connections 2024-03-19T06:13:31.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.747+0000 7f79f7200700 1 --2- 172.21.15.72:0/3384171793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79f8101230 0x7f79f81036b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:31.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.747+0000 7f79f7200700 1 --2- 172.21.15.72:0/3384171793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f80fe8d0 0x7f79f8100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:31.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.747+0000 7f79f7200700 1 -- 172.21.15.72:0/3384171793 >> 172.21.15.72:0/3384171793 conn(0x7f79f80fa520 msgr2=0x7f79f80fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:31.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.747+0000 7f79f7200700 1 -- 172.21.15.72:0/3384171793 shutdown_connections 2024-03-19T06:13:31.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.747+0000 7f79f7200700 1 -- 172.21.15.72:0/3384171793 wait complete. 2024-03-19T06:13:31.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.748+0000 7f79f7200700 1 Processor -- start 2024-03-19T06:13:31.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.748+0000 7f79f7200700 1 -- start start 2024-03-19T06:13:31.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.748+0000 7f79f7200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f80fe8d0 0x7f79f819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:31.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.749+0000 7f79f7200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79f8101230 0x7f79f819c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:31.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.749+0000 7f79f7200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f819c9c0 con 0x7f79f8101230 2024-03-19T06:13:31.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.749+0000 7f79f7200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f819cb00 con 0x7f79f80fe8d0 2024-03-19T06:13:31.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.749+0000 7f79f5400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79f8101230 0x7f79f819c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:31.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.749+0000 7f79f5400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79f8101230 0x7f79f819c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47206/0 (socket says 172.21.15.72:47206) 2024-03-19T06:13:31.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.749+0000 7f79f5400700 1 -- 172.21.15.72:0/4178669099 learned_addr learned my addr 172.21.15.72:0/4178669099 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:13:31.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.749+0000 7f79f5e00700 1 --2- 172.21.15.72:0/4178669099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f80fe8d0 0x7f79f819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:31.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.749+0000 7f79f5400700 1 -- 172.21.15.72:0/4178669099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f80fe8d0 msgr2=0x7f79f819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:31.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.749+0000 7f79f5400700 1 --2- 172.21.15.72:0/4178669099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f80fe8d0 0x7f79f819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:31.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.749+0000 7f79f5400700 1 -- 172.21.15.72:0/4178669099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e40095f0 con 0x7f79f8101230 2024-03-19T06:13:31.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.750+0000 7f79f5400700 1 --2- 172.21.15.72:0/4178669099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79f8101230 0x7f79f819c3a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f79e400b5c0 tx=0x7f79e400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:31.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.750+0000 7f79eea00700 1 -- 172.21.15.72:0/4178669099 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79e401d070 con 0x7f79f8101230 2024-03-19T06:13:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.750+0000 7f79eea00700 1 -- 172.21.15.72:0/4178669099 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f79e400f460 con 0x7f79f8101230 2024-03-19T06:13:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.750+0000 7f79eea00700 1 -- 172.21.15.72:0/4178669099 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79e4021640 con 0x7f79f8101230 2024-03-19T06:13:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.750+0000 7f79f7200700 1 -- 172.21.15.72:0/4178669099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f81a1550 con 0x7f79f8101230 2024-03-19T06:13:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.750+0000 7f79f7200700 1 -- 172.21.15.72:0/4178669099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f81a1a40 con 0x7f79f8101230 2024-03-19T06:13:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.751+0000 7f79f7200700 1 -- 172.21.15.72:0/4178669099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f8196070 con 0x7f79f8101230 2024-03-19T06:13:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.752+0000 7f79eea00700 1 -- 172.21.15.72:0/4178669099 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f79e400f5d0 con 0x7f79f8101230 2024-03-19T06:13:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.753+0000 7f79eea00700 1 --2- 172.21.15.72:0/4178669099 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f79dc06dfa0 0x7f79dc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.753+0000 7f79eea00700 1 -- 172.21.15.72:0/4178669099 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f79e408efd0 con 0x7f79f8101230 2024-03-19T06:13:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.753+0000 7f79f5e00700 1 --2- 172.21.15.72:0/4178669099 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f79dc06dfa0 0x7f79dc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:31.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.754+0000 7f79f5e00700 1 --2- 172.21.15.72:0/4178669099 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f79dc06dfa0 0x7f79dc070450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f79e8005950 tx=0x7f79e80058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:31.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.757+0000 7f79eea00700 1 -- 172.21.15.72:0/4178669099 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f79e405c050 con 0x7f79f8101230 2024-03-19T06:13:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:31.998+0000 7f79f7200700 1 -- 172.21.15.72:0/4178669099 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f79f8061190 con 0x7f79dc06dfa0 2024-03-19T06:13:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.028+0000 7f79eea00700 1 -- 172.21.15.72:0/4178669099 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f79f8061190 con 0x7f79dc06dfa0 2024-03-19T06:13:32.017 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:13:32.017 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (17m) 2m ago 19m 14.0M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:13:32.017 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (20m) 2m ago 20m 8678k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (18m) 59s ago 18m 8724k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (4m) 2m ago 20m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (4m) 59s ago 18m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (17m) 2m ago 19m 71.5M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (12m) 2m ago 12m 16.5M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (12m) 2m ago 12m 126M - 18.2.0 dc2bc1663786 6d147ccfbbd6 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (12m) 59s ago 12m 17.3M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (12m) 59s ago 12m 142M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (8m) 2m ago 21m 504M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (6m) 59s ago 18m 451M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (6m) 2m ago 22m 50.4M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (5m) 59s ago 18m 41.0M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (20m) 2m ago 20m 8196k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (18m) 59s ago 18m 8036k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:13:32.018 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (3m) 2m ago 17m 87.0M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:13:32.019 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (3m) 2m ago 16m 87.1M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:13:32.019 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (2m) 2m ago 16m 11.2M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:13:32.019 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (2m) 59s ago 15m 90.4M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:13:32.019 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (106s) 59s ago 15m 90.4M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:13:32.019 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (64s) 59s ago 14m 11.2M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a c47c9c7fd3c7 2024-03-19T06:13:32.019 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (7m) 2m ago 19m 67.0M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:13:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.031+0000 7f79f7200700 1 -- 172.21.15.72:0/4178669099 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f79dc06dfa0 msgr2=0x7f79dc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.031+0000 7f79f7200700 1 --2- 172.21.15.72:0/4178669099 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f79dc06dfa0 0x7f79dc070450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f79e8005950 tx=0x7f79e80058e0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.031+0000 7f79f7200700 1 -- 172.21.15.72:0/4178669099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79f8101230 msgr2=0x7f79f819c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.031+0000 7f79f7200700 1 --2- 172.21.15.72:0/4178669099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79f8101230 0x7f79f819c3a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f79e400b5c0 tx=0x7f79e400be20 comp rx=0 tx=0).stop 2024-03-19T06:13:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.032+0000 7f79f7200700 1 -- 172.21.15.72:0/4178669099 shutdown_connections 2024-03-19T06:13:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.032+0000 7f79f7200700 1 --2- 172.21.15.72:0/4178669099 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f79dc06dfa0 0x7f79dc070450 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.032+0000 7f79f7200700 1 --2- 172.21.15.72:0/4178669099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f80fe8d0 0x7f79f819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.032+0000 7f79f7200700 1 --2- 172.21.15.72:0/4178669099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79f8101230 0x7f79f819c3a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.032+0000 7f79f7200700 1 -- 172.21.15.72:0/4178669099 >> 172.21.15.72:0/4178669099 conn(0x7f79f80fa520 msgr2=0x7f79f80fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.032+0000 7f79f7200700 1 -- 172.21.15.72:0/4178669099 shutdown_connections 2024-03-19T06:13:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.032+0000 7f79f7200700 1 -- 172.21.15.72:0/4178669099 wait complete. 2024-03-19T06:13:32.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.182+0000 7ff442400700 1 -- 172.21.15.72:0/2988718305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff43c100240 msgr2=0x7ff43c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:32.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.182+0000 7ff442400700 1 --2- 172.21.15.72:0/2988718305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff43c100240 0x7ff43c100650 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009910 tx=0x7ff42c009c20 comp rx=0 tx=0).stop 2024-03-19T06:13:32.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.182+0000 7ff442400700 1 -- 172.21.15.72:0/2988718305 shutdown_connections 2024-03-19T06:13:32.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.182+0000 7ff442400700 1 --2- 172.21.15.72:0/2988718305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43c101440 0x7ff43c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.182+0000 7ff442400700 1 --2- 172.21.15.72:0/2988718305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff43c100240 0x7ff43c100650 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.182+0000 7ff442400700 1 -- 172.21.15.72:0/2988718305 >> 172.21.15.72:0/2988718305 conn(0x7ff43c0fb7f0 msgr2=0x7ff43c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.182+0000 7ff442400700 1 -- 172.21.15.72:0/2988718305 shutdown_connections 2024-03-19T06:13:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.182+0000 7ff442400700 1 -- 172.21.15.72:0/2988718305 wait complete. 2024-03-19T06:13:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.183+0000 7ff442400700 1 Processor -- start 2024-03-19T06:13:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.184+0000 7ff442400700 1 -- start start 2024-03-19T06:13:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.184+0000 7ff442400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff43c100240 0x7ff43c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.184+0000 7ff442400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43c101440 0x7ff43c196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.184+0000 7ff442400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c196630 con 0x7ff43c100240 2024-03-19T06:13:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.184+0000 7ff442400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c196770 con 0x7ff43c101440 2024-03-19T06:13:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.184+0000 7ff43b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff43c100240 0x7ff43c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.184+0000 7ff43b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff43c100240 0x7ff43c195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47218/0 (socket says 172.21.15.72:47218) 2024-03-19T06:13:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.184+0000 7ff43b400700 1 -- 172.21.15.72:0/3243733972 learned_addr learned my addr 172.21.15.72:0/3243733972 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:13:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.185+0000 7ff43aa00700 1 --2- 172.21.15.72:0/3243733972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43c101440 0x7ff43c196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.185+0000 7ff43b400700 1 -- 172.21.15.72:0/3243733972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43c101440 msgr2=0x7ff43c196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.185+0000 7ff43b400700 1 --2- 172.21.15.72:0/3243733972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43c101440 0x7ff43c196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.185+0000 7ff43b400700 1 -- 172.21.15.72:0/3243733972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c0095f0 con 0x7ff43c100240 2024-03-19T06:13:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.185+0000 7ff43aa00700 1 --2- 172.21.15.72:0/3243733972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43c101440 0x7ff43c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:13:32.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.185+0000 7ff43b400700 1 --2- 172.21.15.72:0/3243733972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff43c100240 0x7ff43c195ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00bda0 tx=0x7ff42c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:32.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.185+0000 7ff433e00700 1 -- 172.21.15.72:0/3243733972 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff42c01d070 con 0x7ff43c100240 2024-03-19T06:13:32.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.185+0000 7ff433e00700 1 -- 172.21.15.72:0/3243733972 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff42c00f460 con 0x7ff43c100240 2024-03-19T06:13:32.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.185+0000 7ff433e00700 1 -- 172.21.15.72:0/3243733972 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff42c021620 con 0x7ff43c100240 2024-03-19T06:13:32.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.185+0000 7ff442400700 1 -- 172.21.15.72:0/3243733972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43c19b1c0 con 0x7ff43c100240 2024-03-19T06:13:32.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.186+0000 7ff442400700 1 -- 172.21.15.72:0/3243733972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c19b6b0 con 0x7ff43c100240 2024-03-19T06:13:32.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.187+0000 7ff442400700 1 -- 172.21.15.72:0/3243733972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c108db0 con 0x7ff43c100240 2024-03-19T06:13:32.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.188+0000 7ff433e00700 1 -- 172.21.15.72:0/3243733972 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7ff42c00f5d0 con 0x7ff43c100240 2024-03-19T06:13:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.189+0000 7ff433e00700 1 --2- 172.21.15.72:0/3243733972 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff42006dfa0 0x7ff420070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.189+0000 7ff433e00700 1 -- 172.21.15.72:0/3243733972 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff42c08f170 con 0x7ff43c100240 2024-03-19T06:13:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.189+0000 7ff43aa00700 1 --2- 172.21.15.72:0/3243733972 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff42006dfa0 0x7ff420070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.190+0000 7ff43aa00700 1 --2- 172.21.15.72:0/3243733972 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff42006dfa0 0x7ff420070450 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff428005fd0 tx=0x7ff428005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:32.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.193+0000 7ff433e00700 1 -- 172.21.15.72:0/3243733972 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7ff42c05c0d0 con 0x7ff43c100240 2024-03-19T06:13:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.521+0000 7ff442400700 1 -- 172.21.15.72:0/3243733972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff43c19bdb0 con 0x7ff43c100240 2024-03-19T06:13:32.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.522+0000 7ff433e00700 1 -- 172.21.15.72:0/3243733972 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+701 (secure 0 0 0) 0x7ff43c19bdb0 con 0x7ff43c100240 2024-03-19T06:13:32.510 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:13:32.510 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:13:32.510 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 6 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-03-19T06:13:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 10 2024-03-19T06:13:32.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:13:32.512 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:13:32.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.524+0000 7ff442400700 1 -- 172.21.15.72:0/3243733972 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff42006dfa0 msgr2=0x7ff420070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:32.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.524+0000 7ff442400700 1 --2- 172.21.15.72:0/3243733972 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff42006dfa0 0x7ff420070450 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff428005fd0 tx=0x7ff428005ee0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.524+0000 7ff442400700 1 -- 172.21.15.72:0/3243733972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff43c100240 msgr2=0x7ff43c195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:32.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.524+0000 7ff442400700 1 --2- 172.21.15.72:0/3243733972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff43c100240 0x7ff43c195ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00bda0 tx=0x7ff42c00be80 comp rx=0 tx=0).stop 2024-03-19T06:13:32.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.524+0000 7ff442400700 1 -- 172.21.15.72:0/3243733972 shutdown_connections 2024-03-19T06:13:32.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.524+0000 7ff442400700 1 --2- 172.21.15.72:0/3243733972 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff42006dfa0 0x7ff420070450 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.524+0000 7ff442400700 1 --2- 172.21.15.72:0/3243733972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff43c100240 0x7ff43c195ad0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.524+0000 7ff442400700 1 --2- 172.21.15.72:0/3243733972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43c101440 0x7ff43c196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.524+0000 7ff442400700 1 -- 172.21.15.72:0/3243733972 >> 172.21.15.72:0/3243733972 conn(0x7ff43c0fb7f0 msgr2=0x7ff43c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:32.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.525+0000 7ff442400700 1 -- 172.21.15.72:0/3243733972 shutdown_connections 2024-03-19T06:13:32.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.525+0000 7ff442400700 1 -- 172.21.15.72:0/3243733972 wait complete. 2024-03-19T06:13:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.677+0000 7f6028e00700 1 -- 172.21.15.72:0/1616569773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6024102260 msgr2=0x7f6024102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.677+0000 7f6028e00700 1 --2- 172.21.15.72:0/1616569773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6024102260 0x7f6024102670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6014009910 tx=0x7f6014009c20 comp rx=0 tx=0).stop 2024-03-19T06:13:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.677+0000 7f6028e00700 1 -- 172.21.15.72:0/1616569773 shutdown_connections 2024-03-19T06:13:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.677+0000 7f6028e00700 1 --2- 172.21.15.72:0/1616569773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024103460 0x7f60241038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.677+0000 7f6028e00700 1 --2- 172.21.15.72:0/1616569773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6024102260 0x7f6024102670 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.677+0000 7f6028e00700 1 -- 172.21.15.72:0/1616569773 >> 172.21.15.72:0/1616569773 conn(0x7f60240fd8d0 msgr2=0x7f60240ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.677+0000 7f6028e00700 1 -- 172.21.15.72:0/1616569773 shutdown_connections 2024-03-19T06:13:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.678+0000 7f6028e00700 1 -- 172.21.15.72:0/1616569773 wait complete. 2024-03-19T06:13:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.679+0000 7f6028e00700 1 Processor -- start 2024-03-19T06:13:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.679+0000 7f6028e00700 1 -- start start 2024-03-19T06:13:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.679+0000 7f6028e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024102260 0x7f6024197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.679+0000 7f6028e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6024103460 0x7f6024198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.679+0000 7f6028e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024198690 con 0x7f6024103460 2024-03-19T06:13:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.679+0000 7f6028e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60241987d0 con 0x7f6024102260 2024-03-19T06:13:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.679+0000 7f601be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6024103460 0x7f6024198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.679+0000 7f601be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6024103460 0x7f6024198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47236/0 (socket says 172.21.15.72:47236) 2024-03-19T06:13:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.680+0000 7f601be00700 1 -- 172.21.15.72:0/180985190 learned_addr learned my addr 172.21.15.72:0/180985190 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:13:32.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.680+0000 7f6023400700 1 --2- 172.21.15.72:0/180985190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024102260 0x7f6024197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:32.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.680+0000 7f601be00700 1 -- 172.21.15.72:0/180985190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024102260 msgr2=0x7f6024197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.680+0000 7f601be00700 1 --2- 172.21.15.72:0/180985190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024102260 0x7f6024197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.680+0000 7f601be00700 1 -- 172.21.15.72:0/180985190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140095f0 con 0x7f6024103460 2024-03-19T06:13:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.680+0000 7f6023400700 1 --2- 172.21.15.72:0/180985190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024102260 0x7f6024197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:13:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.680+0000 7f601be00700 1 --2- 172.21.15.72:0/180985190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6024103460 0x7f6024198070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f600c00b4b0 tx=0x7f600c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.680+0000 7f6020c00700 1 -- 172.21.15.72:0/180985190 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600c011800 con 0x7f6024103460 2024-03-19T06:13:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.681+0000 7f6020c00700 1 -- 172.21.15.72:0/180985190 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f600c011e10 con 0x7f6024103460 2024-03-19T06:13:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.681+0000 7f6028e00700 1 -- 172.21.15.72:0/180985190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602419d280 con 0x7f6024103460 2024-03-19T06:13:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.681+0000 7f6028e00700 1 -- 172.21.15.72:0/180985190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602419d850 con 0x7f6024103460 2024-03-19T06:13:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.681+0000 7f6020c00700 1 -- 172.21.15.72:0/180985190 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600c00f2e0 con 0x7f6024103460 2024-03-19T06:13:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.682+0000 7f6028e00700 1 -- 172.21.15.72:0/180985190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602410ae30 con 0x7f6024103460 2024-03-19T06:13:32.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.683+0000 7f6020c00700 1 -- 172.21.15.72:0/180985190 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f600c010380 con 0x7f6024103460 2024-03-19T06:13:32.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.685+0000 7f6020c00700 1 --2- 172.21.15.72:0/180985190 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f600806dfa0 0x7f6008070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:32.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.685+0000 7f6020c00700 1 -- 172.21.15.72:0/180985190 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f600c08df70 con 0x7f6024103460 2024-03-19T06:13:32.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.685+0000 7f6023400700 1 --2- 172.21.15.72:0/180985190 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f600806dfa0 0x7f6008070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:32.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.686+0000 7f6023400700 1 --2- 172.21.15.72:0/180985190 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f600806dfa0 0x7f6008070450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6014006010 tx=0x7f6014005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:32.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.688+0000 7f6020c00700 1 -- 172.21.15.72:0/180985190 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f600c05af50 con 0x7f6024103460 2024-03-19T06:13:32.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:32 smithi072 ceph-mon[78545]: pgmap v218: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-03-19T06:13:32.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:32 smithi072 ceph-mon[78545]: from='client.44257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:13:32.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:32 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3243733972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:32.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:32 smithi172 ceph-mon[66682]: pgmap v218: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-03-19T06:13:32.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:32 smithi172 ceph-mon[66682]: from='client.44257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:13:32.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:32 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3243733972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:32.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.973+0000 7f6028e00700 1 -- 172.21.15.72:0/180985190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f602410aff0 con 0x7f6024103460 2024-03-19T06:13:32.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.974+0000 7f6020c00700 1 -- 172.21.15.72:0/180985190 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1674 (secure 0 0 0) 0x7f600c0156a0 con 0x7f6024103460 2024-03-19T06:13:32.963 INFO:teuthology.orchestra.run.smithi072.stdout:e27 2024-03-19T06:13:32.963 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:13:32.963 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:13:32.963 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:13:32.963 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:13:32.963 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:13:32.963 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:13:32.963 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 27 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:13:27.604181+0000 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 80 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-03-19T06:13:32.964 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=14472} 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 1 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{0:14472} state up:active seq 188 join_fscid=1 addr [v2:172.21.15.72:6828/1218260294,v1:172.21.15.72:6829/1218260294] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:13:32.965 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:13:32.966 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:24237} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:13:32.966 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{-1:44255} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/3611765575,v1:172.21.15.172:6825/3611765575] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:13:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.978+0000 7f6028e00700 1 -- 172.21.15.72:0/180985190 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f600806dfa0 msgr2=0x7f6008070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.978+0000 7f6028e00700 1 --2- 172.21.15.72:0/180985190 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f600806dfa0 0x7f6008070450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6014006010 tx=0x7f6014005960 comp rx=0 tx=0).stop 2024-03-19T06:13:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.978+0000 7f6028e00700 1 -- 172.21.15.72:0/180985190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6024103460 msgr2=0x7f6024198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.978+0000 7f6028e00700 1 --2- 172.21.15.72:0/180985190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6024103460 0x7f6024198070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f600c00b4b0 tx=0x7f600c00b870 comp rx=0 tx=0).stop 2024-03-19T06:13:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.978+0000 7f6028e00700 1 -- 172.21.15.72:0/180985190 shutdown_connections 2024-03-19T06:13:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.978+0000 7f6028e00700 1 --2- 172.21.15.72:0/180985190 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f600806dfa0 0x7f6008070450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.978+0000 7f6028e00700 1 --2- 172.21.15.72:0/180985190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024102260 0x7f6024197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.978+0000 7f6028e00700 1 --2- 172.21.15.72:0/180985190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6024103460 0x7f6024198070 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.978+0000 7f6028e00700 1 -- 172.21.15.72:0/180985190 >> 172.21.15.72:0/180985190 conn(0x7f60240fd8d0 msgr2=0x7f6024106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.978+0000 7f6028e00700 1 -- 172.21.15.72:0/180985190 shutdown_connections 2024-03-19T06:13:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:32.978+0000 7f6028e00700 1 -- 172.21.15.72:0/180985190 wait complete. 2024-03-19T06:13:32.968 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 27 2024-03-19T06:13:33.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.139+0000 7fc34be00700 1 -- 172.21.15.72:0/3577009270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc344074d00 msgr2=0x7fc344073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:33.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.139+0000 7fc34be00700 1 --2- 172.21.15.72:0/3577009270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc344074d00 0x7fc344073160 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc338009910 tx=0x7fc338009c20 comp rx=0 tx=0).stop 2024-03-19T06:13:33.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.139+0000 7fc34be00700 1 -- 172.21.15.72:0/3577009270 shutdown_connections 2024-03-19T06:13:33.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.139+0000 7fc34be00700 1 --2- 172.21.15.72:0/3577009270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc344073730 0x7fc344073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:33.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.139+0000 7fc34be00700 1 --2- 172.21.15.72:0/3577009270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc344074d00 0x7fc344073160 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:33.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.139+0000 7fc34be00700 1 -- 172.21.15.72:0/3577009270 >> 172.21.15.72:0/3577009270 conn(0x7fc3440fb7f0 msgr2=0x7fc3440fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:33.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.139+0000 7fc34be00700 1 -- 172.21.15.72:0/3577009270 shutdown_connections 2024-03-19T06:13:33.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.139+0000 7fc34be00700 1 -- 172.21.15.72:0/3577009270 wait complete. 2024-03-19T06:13:33.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.140+0000 7fc34be00700 1 Processor -- start 2024-03-19T06:13:33.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.141+0000 7fc34be00700 1 -- start start 2024-03-19T06:13:33.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.141+0000 7fc34be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc344073730 0x7fc344197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:33.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.141+0000 7fc34be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc344074d00 0x7fc3441981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:33.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.141+0000 7fc34be00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3441987d0 con 0x7fc344074d00 2024-03-19T06:13:33.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.141+0000 7fc34be00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc344198940 con 0x7fc344073730 2024-03-19T06:13:33.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.141+0000 7fc348a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc344074d00 0x7fc3441981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:33.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.141+0000 7fc348a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc344074d00 0x7fc3441981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47256/0 (socket says 172.21.15.72:47256) 2024-03-19T06:13:33.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.141+0000 7fc348a00700 1 -- 172.21.15.72:0/969254543 learned_addr learned my addr 172.21.15.72:0/969254543 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:13:33.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.142+0000 7fc349400700 1 --2- 172.21.15.72:0/969254543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc344073730 0x7fc344197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:33.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.142+0000 7fc348a00700 1 -- 172.21.15.72:0/969254543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc344073730 msgr2=0x7fc344197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:33.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.142+0000 7fc348a00700 1 --2- 172.21.15.72:0/969254543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc344073730 0x7fc344197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:33.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.142+0000 7fc348a00700 1 -- 172.21.15.72:0/969254543 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3380095f0 con 0x7fc344074d00 2024-03-19T06:13:33.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.142+0000 7fc349400700 1 --2- 172.21.15.72:0/969254543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc344073730 0x7fc344197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:13:33.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.142+0000 7fc348a00700 1 --2- 172.21.15.72:0/969254543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc344074d00 0x7fc3441981d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc33000d8d0 tx=0x7fc33000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:33.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.143+0000 7fc342000700 1 -- 172.21.15.72:0/969254543 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc330009940 con 0x7fc344074d00 2024-03-19T06:13:33.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.143+0000 7fc342000700 1 -- 172.21.15.72:0/969254543 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc330010460 con 0x7fc344074d00 2024-03-19T06:13:33.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.143+0000 7fc342000700 1 -- 172.21.15.72:0/969254543 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc33000f5f0 con 0x7fc344074d00 2024-03-19T06:13:33.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.143+0000 7fc34be00700 1 -- 172.21.15.72:0/969254543 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34419d3d0 con 0x7fc344074d00 2024-03-19T06:13:33.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.143+0000 7fc34be00700 1 -- 172.21.15.72:0/969254543 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34419d920 con 0x7fc344074d00 2024-03-19T06:13:33.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.144+0000 7fc34be00700 1 -- 172.21.15.72:0/969254543 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34410af70 con 0x7fc344074d00 2024-03-19T06:13:33.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.145+0000 7fc342000700 1 -- 172.21.15.72:0/969254543 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fc3300105d0 con 0x7fc344074d00 2024-03-19T06:13:33.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.146+0000 7fc342000700 1 --2- 172.21.15.72:0/969254543 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc32c06dfa0 0x7fc32c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:33.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.146+0000 7fc342000700 1 -- 172.21.15.72:0/969254543 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc33008dc80 con 0x7fc344074d00 2024-03-19T06:13:33.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.146+0000 7fc349400700 1 --2- 172.21.15.72:0/969254543 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc32c06dfa0 0x7fc32c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:33.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.147+0000 7fc349400700 1 --2- 172.21.15.72:0/969254543 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc32c06dfa0 0x7fc32c070450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc338006010 tx=0x7fc338005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:33.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.151+0000 7fc342000700 1 -- 172.21.15.72:0/969254543 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fc330057130 con 0x7fc344074d00 2024-03-19T06:13:33.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.428+0000 7fc34be00700 1 -- 172.21.15.72:0/969254543 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3441077c0 con 0x7fc32c06dfa0 2024-03-19T06:13:33.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.431+0000 7fc342000700 1 -- 172.21.15.72:0/969254543 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc3441077c0 con 0x7fc32c06dfa0 2024-03-19T06:13:33.420 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:13:33.420 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:13:33.420 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:13:33.420 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:13:33.420 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:13:33.421 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:13:33.421 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:13:33.421 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-03-19T06:13:33.421 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:13:33.421 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:13:33.421 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "12/23 daemons upgraded", 2024-03-19T06:13:33.421 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mds daemons", 2024-03-19T06:13:33.421 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:13:33.421 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:13:33.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.434+0000 7fc34be00700 1 -- 172.21.15.72:0/969254543 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc32c06dfa0 msgr2=0x7fc32c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:33.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.434+0000 7fc34be00700 1 --2- 172.21.15.72:0/969254543 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc32c06dfa0 0x7fc32c070450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc338006010 tx=0x7fc338005a90 comp rx=0 tx=0).stop 2024-03-19T06:13:33.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.434+0000 7fc34be00700 1 -- 172.21.15.72:0/969254543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc344074d00 msgr2=0x7fc3441981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:33.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.434+0000 7fc34be00700 1 --2- 172.21.15.72:0/969254543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc344074d00 0x7fc3441981d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc33000d8d0 tx=0x7fc33000dc90 comp rx=0 tx=0).stop 2024-03-19T06:13:33.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.434+0000 7fc34be00700 1 -- 172.21.15.72:0/969254543 shutdown_connections 2024-03-19T06:13:33.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.434+0000 7fc34be00700 1 --2- 172.21.15.72:0/969254543 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fc32c06dfa0 0x7fc32c070450 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:33.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.434+0000 7fc34be00700 1 --2- 172.21.15.72:0/969254543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc344073730 0x7fc344197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:33.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.434+0000 7fc34be00700 1 --2- 172.21.15.72:0/969254543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc344074d00 0x7fc3441981d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:33.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.434+0000 7fc34be00700 1 -- 172.21.15.72:0/969254543 >> 172.21.15.72:0/969254543 conn(0x7fc3440fb7f0 msgr2=0x7fc3441060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:33.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.434+0000 7fc34be00700 1 -- 172.21.15.72:0/969254543 shutdown_connections 2024-03-19T06:13:33.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.434+0000 7fc34be00700 1 -- 172.21.15.72:0/969254543 wait complete. 2024-03-19T06:13:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.591+0000 7fedbc000700 1 -- 172.21.15.72:0/2365094111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedb4074d80 msgr2=0x7fedb40731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.591+0000 7fedbc000700 1 --2- 172.21.15.72:0/2365094111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedb4074d80 0x7fedb40731e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feda8009910 tx=0x7feda8009c20 comp rx=0 tx=0).stop 2024-03-19T06:13:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.591+0000 7fedbc000700 1 -- 172.21.15.72:0/2365094111 shutdown_connections 2024-03-19T06:13:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.591+0000 7fedbc000700 1 --2- 172.21.15.72:0/2365094111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedb40737b0 0x7fedb4073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.591+0000 7fedbc000700 1 --2- 172.21.15.72:0/2365094111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedb4074d80 0x7fedb40731e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.591+0000 7fedbc000700 1 -- 172.21.15.72:0/2365094111 >> 172.21.15.72:0/2365094111 conn(0x7fedb40fb7f0 msgr2=0x7fedb40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.591+0000 7fedbc000700 1 -- 172.21.15.72:0/2365094111 shutdown_connections 2024-03-19T06:13:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.591+0000 7fedbc000700 1 -- 172.21.15.72:0/2365094111 wait complete. 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.592+0000 7fedbc000700 1 Processor -- start 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.592+0000 7fedbc000700 1 -- start start 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.593+0000 7fedbc000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedb40737b0 0x7fedb419c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.593+0000 7fedbc000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedb4074d80 0x7fedb419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.593+0000 7fedbc000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb419cc50 con 0x7fedb40737b0 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.593+0000 7fedbc000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb419cd90 con 0x7fedb4074d80 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.593+0000 7fedb9600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedb40737b0 0x7fedb419c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.593+0000 7fedb9600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedb40737b0 0x7fedb419c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47272/0 (socket says 172.21.15.72:47272) 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.593+0000 7fedb9600700 1 -- 172.21.15.72:0/1601489678 learned_addr learned my addr 172.21.15.72:0/1601489678 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.593+0000 7fedb8c00700 1 --2- 172.21.15.72:0/1601489678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedb4074d80 0x7fedb419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.593+0000 7fedb9600700 1 -- 172.21.15.72:0/1601489678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedb4074d80 msgr2=0x7fedb419c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.593+0000 7fedb9600700 1 --2- 172.21.15.72:0/1601489678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedb4074d80 0x7fedb419c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.593+0000 7fedb9600700 1 -- 172.21.15.72:0/1601489678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda80095f0 con 0x7fedb40737b0 2024-03-19T06:13:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.593+0000 7fedb8c00700 1 --2- 172.21.15.72:0/1601489678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedb4074d80 0x7fedb419c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:13:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.594+0000 7fedb9600700 1 --2- 172.21.15.72:0/1601489678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedb40737b0 0x7fedb419c0f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feda8005b40 tx=0x7feda800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.594+0000 7fedb2000700 1 -- 172.21.15.72:0/1601489678 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feda801d070 con 0x7fedb40737b0 2024-03-19T06:13:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.594+0000 7fedb2000700 1 -- 172.21.15.72:0/1601489678 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feda8022470 con 0x7fedb40737b0 2024-03-19T06:13:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.594+0000 7fedb2000700 1 -- 172.21.15.72:0/1601489678 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feda800f690 con 0x7fedb40737b0 2024-03-19T06:13:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.594+0000 7fedbc000700 1 -- 172.21.15.72:0/1601489678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb41a17e0 con 0x7fedb40737b0 2024-03-19T06:13:33.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.594+0000 7fedbc000700 1 -- 172.21.15.72:0/1601489678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb41a1cd0 con 0x7fedb40737b0 2024-03-19T06:13:33.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.596+0000 7fedbc000700 1 -- 172.21.15.72:0/1601489678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb410f3f0 con 0x7fedb40737b0 2024-03-19T06:13:33.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.597+0000 7fedb2000700 1 -- 172.21.15.72:0/1601489678 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7feda80225e0 con 0x7fedb40737b0 2024-03-19T06:13:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.598+0000 7fedb2000700 1 --2- 172.21.15.72:0/1601489678 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fed9c06dfa0 0x7fed9c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:13:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.598+0000 7fedb2000700 1 -- 172.21.15.72:0/1601489678 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7feda808f4b0 con 0x7fedb40737b0 2024-03-19T06:13:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.598+0000 7fedb8c00700 1 --2- 172.21.15.72:0/1601489678 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fed9c06dfa0 0x7fed9c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:13:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.599+0000 7fedb8c00700 1 --2- 172.21.15.72:0/1601489678 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fed9c06dfa0 0x7fed9c070450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feda0007900 tx=0x7feda0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:13:33.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.602+0000 7fedb2000700 1 -- 172.21.15.72:0/1601489678 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7feda805c550 con 0x7fedb40737b0 2024-03-19T06:13:33.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:33 smithi072 ceph-mon[78545]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:13:33.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:33 smithi072 ceph-mon[78545]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:13:33.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:33 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/180985190' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:13:33.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:33 smithi172 ceph-mon[66682]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:13:33.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:33 smithi172 ceph-mon[66682]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:13:33.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:33 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/180985190' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:13:33.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.922+0000 7fedbc000700 1 -- 172.21.15.72:0/1601489678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fedb41a26c0 con 0x7fedb40737b0 2024-03-19T06:13:33.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.923+0000 7fedb2000700 1 -- 172.21.15.72:0/1601489678 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7feda805c0e0 con 0x7fedb40737b0 2024-03-19T06:13:33.912 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:13:33.912 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:13:33.912 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:13:33.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.925+0000 7fedbc000700 1 -- 172.21.15.72:0/1601489678 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fed9c06dfa0 msgr2=0x7fed9c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:33.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.925+0000 7fedbc000700 1 --2- 172.21.15.72:0/1601489678 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fed9c06dfa0 0x7fed9c070450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feda0007900 tx=0x7feda0008040 comp rx=0 tx=0).stop 2024-03-19T06:13:33.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.926+0000 7fedbc000700 1 -- 172.21.15.72:0/1601489678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedb40737b0 msgr2=0x7fedb419c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:13:33.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.926+0000 7fedbc000700 1 --2- 172.21.15.72:0/1601489678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedb40737b0 0x7fedb419c0f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feda8005b40 tx=0x7feda800be20 comp rx=0 tx=0).stop 2024-03-19T06:13:33.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.926+0000 7fedbc000700 1 -- 172.21.15.72:0/1601489678 shutdown_connections 2024-03-19T06:13:33.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.926+0000 7fedbc000700 1 --2- 172.21.15.72:0/1601489678 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fed9c06dfa0 0x7fed9c070450 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:33.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.926+0000 7fedbc000700 1 --2- 172.21.15.72:0/1601489678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fedb40737b0 0x7fedb419c0f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:33.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.926+0000 7fedbc000700 1 --2- 172.21.15.72:0/1601489678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedb4074d80 0x7fedb419c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:13:33.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.926+0000 7fedbc000700 1 -- 172.21.15.72:0/1601489678 >> 172.21.15.72:0/1601489678 conn(0x7fedb40fb7f0 msgr2=0x7fedb4101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:13:33.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.926+0000 7fedbc000700 1 -- 172.21.15.72:0/1601489678 shutdown_connections 2024-03-19T06:13:33.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:13:33.926+0000 7fedbc000700 1 -- 172.21.15.72:0/1601489678 wait complete. 2024-03-19T06:13:34.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:34 smithi072 ceph-mon[78545]: pgmap v219: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 767 B/s wr, 9 op/s 2024-03-19T06:13:34.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:34 smithi072 ceph-mon[78545]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:13:34.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:34 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1601489678' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:13:34.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:34.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:34.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:34 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:13:34.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:34 smithi172 ceph-mon[66682]: pgmap v219: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 767 B/s wr, 9 op/s 2024-03-19T06:13:34.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:34 smithi172 ceph-mon[66682]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:13:34.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:34 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1601489678' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:13:34.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:34 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:34.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:34 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:34.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:34 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:13:35.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:35 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] up:boot 2024-03-19T06:13:35.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:35 smithi072 ceph-mon[78545]: fsmap cephfs:1 {0=cephfs.smithi072.dvdjwb=up:active} 3 up:standby 2024-03-19T06:13:35.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:35 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:13:35.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:35 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] up:boot 2024-03-19T06:13:35.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:35 smithi172 ceph-mon[66682]: fsmap cephfs:1 {0=cephfs.smithi072.dvdjwb=up:active} 3 up:standby 2024-03-19T06:13:35.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:35 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:13:36.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:36 smithi072 ceph-mon[78545]: pgmap v220: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 767 B/s wr, 6 op/s 2024-03-19T06:13:36.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:36 smithi172 ceph-mon[66682]: pgmap v220: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 767 B/s wr, 6 op/s 2024-03-19T06:13:38.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:38 smithi072 ceph-mon[78545]: pgmap v221: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 6.1 KiB/s wr, 7 op/s 2024-03-19T06:13:38.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:38 smithi172 ceph-mon[66682]: pgmap v221: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 6.1 KiB/s wr, 7 op/s 2024-03-19T06:13:40.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:40 smithi072 ceph-mon[78545]: pgmap v222: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 6.1 KiB/s wr, 6 op/s 2024-03-19T06:13:40.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:40.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:13:40.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:40 smithi172 ceph-mon[66682]: pgmap v222: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 6.1 KiB/s wr, 6 op/s 2024-03-19T06:13:40.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:40.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:13:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:42 smithi072 ceph-mon[78545]: pgmap v223: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 3.7 KiB/s rd, 6.1 KiB/s wr, 6 op/s 2024-03-19T06:13:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:42.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:42 smithi172 ceph-mon[66682]: pgmap v223: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 3.7 KiB/s rd, 6.1 KiB/s wr, 6 op/s 2024-03-19T06:13:42.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:42.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:44.783 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:44 smithi072 ceph-mon[78545]: pgmap v224: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 6.1 KiB/s wr, 5 op/s 2024-03-19T06:13:44.783 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:44.783 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:44.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:44 smithi172 ceph-mon[66682]: pgmap v224: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 6.1 KiB/s wr, 5 op/s 2024-03-19T06:13:44.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:44 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:44.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:44 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:46.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:46 smithi072 ceph-mon[78545]: pgmap v225: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 5.3 KiB/s wr, 2 op/s 2024-03-19T06:13:46.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:46 smithi172 ceph-mon[66682]: pgmap v225: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 5.3 KiB/s wr, 2 op/s 2024-03-19T06:13:48.755 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:48 smithi072 ceph-mon[78545]: pgmap v226: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 5.3 KiB/s wr, 2 op/s 2024-03-19T06:13:48.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:48 smithi172 ceph-mon[66682]: pgmap v226: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 5.3 KiB/s wr, 2 op/s 2024-03-19T06:13:50.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: pgmap v227: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:13:50.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: Detected new or changed devices on smithi072 2024-03-19T06:13:50.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:50.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:50.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:13:50.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:13:50.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:50.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:13:50.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:50.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:50.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:50.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:50.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi072.dvdjwb"]}]: dispatch 2024-03-19T06:13:50.704 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: pgmap v227: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:13:50.704 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: Detected new or changed devices on smithi072 2024-03-19T06:13:50.705 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:50.705 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:50.705 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:13:50.705 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:13:50.705 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:50.705 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:13:50.705 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:50.705 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:50.705 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:50.705 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:13:50.706 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi072.dvdjwb"]}]: dispatch 2024-03-19T06:13:51.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:51 smithi172 ceph-mon[66682]: Upgrade: It appears safe to stop mds.cephfs.smithi072.dvdjwb 2024-03-19T06:13:51.743 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:51 smithi072 ceph-mon[78545]: Upgrade: It appears safe to stop mds.cephfs.smithi072.dvdjwb 2024-03-19T06:13:52.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:52 smithi072 ceph-mon[78545]: pgmap v228: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:13:52.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:52.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.dvdjwb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:13:52.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:52 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:13:52.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:52 smithi172 ceph-mon[66682]: pgmap v228: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:13:52.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:13:52.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi072.dvdjwb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:13:52.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:52 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:13:53.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:53 smithi172 ceph-mon[66682]: Upgrade: Updating mds.cephfs.smithi072.dvdjwb 2024-03-19T06:13:53.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:53 smithi172 ceph-mon[66682]: Deploying daemon mds.cephfs.smithi072.dvdjwb on smithi072 2024-03-19T06:13:53.702 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:53 smithi072 ceph-mon[78545]: Upgrade: Updating mds.cephfs.smithi072.dvdjwb 2024-03-19T06:13:53.702 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:53 smithi072 ceph-mon[78545]: Deploying daemon mds.cephfs.smithi072.dvdjwb on smithi072 2024-03-19T06:13:54.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:54 smithi172 ceph-mon[66682]: pgmap v229: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:13:54.768 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:54 smithi072 ceph-mon[78545]: pgmap v229: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:13:55.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:54 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072[78541]: 2024-03-19T06:13:54.895+0000 7f9b50200700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:13:55.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:13:57.262 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:55 smithi072 ceph-mon[78545]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-19T06:13:57.262 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:55 smithi072 ceph-mon[78545]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:13:57.262 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:55 smithi072 ceph-mon[78545]: osdmap e81: 6 total, 6 up, 6 in 2024-03-19T06:13:57.263 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:55 smithi072 ceph-mon[78545]: Standby daemon mds.cephfs.smithi172.nparnw assigned to filesystem cephfs as rank 0 2024-03-19T06:13:57.263 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:55 smithi072 ceph-mon[78545]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-19T06:13:57.263 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:55 smithi072 ceph-mon[78545]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-03-19T06:13:57.263 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:55 smithi072 ceph-mon[78545]: fsmap cephfs:1/1 {0=cephfs.smithi172.nparnw=up:replay} 2 up:standby 2024-03-19T06:13:57.264 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:56 smithi072 ceph-mon[78545]: pgmap v230: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:13:57.264 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:56 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:13:57.264 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:13:57.264 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:55 smithi172 ceph-mon[66682]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-19T06:13:57.264 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:55 smithi172 ceph-mon[66682]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:13:57.264 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:55 smithi172 ceph-mon[66682]: osdmap e81: 6 total, 6 up, 6 in 2024-03-19T06:13:57.264 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:55 smithi172 ceph-mon[66682]: Standby daemon mds.cephfs.smithi172.nparnw assigned to filesystem cephfs as rank 0 2024-03-19T06:13:57.264 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:55 smithi172 ceph-mon[66682]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-19T06:13:57.264 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:55 smithi172 ceph-mon[66682]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-03-19T06:13:57.264 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:55 smithi172 ceph-mon[66682]: fsmap cephfs:1/1 {0=cephfs.smithi172.nparnw=up:replay} 2 up:standby 2024-03-19T06:13:57.265 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:56 smithi172 ceph-mon[66682]: pgmap v230: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:13:57.265 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:56 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:13:58.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:13:58 smithi172 ceph-mon[66682]: pgmap v232: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 2 op/s 2024-03-19T06:13:58.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:13:58 smithi072 ceph-mon[78545]: pgmap v232: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 2 op/s 2024-03-19T06:14:00.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:00 smithi072 ceph-mon[78545]: pgmap v233: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s rd, 2 op/s 2024-03-19T06:14:00.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:00 smithi172 ceph-mon[66682]: pgmap v233: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s rd, 2 op/s 2024-03-19T06:14:02.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:02 smithi072 ceph-mon[78545]: pgmap v234: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 9.2 MiB/s rd, 3 op/s 2024-03-19T06:14:02.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:02 smithi072 ceph-mon[78545]: reconnect by client.24271 192.168.0.1:0/1243789683 after 0.00299993 2024-03-19T06:14:02.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:02 smithi072 ceph-mon[78545]: reconnect by client.14520 192.168.0.1:0/3828438056 after 0.00299993 2024-03-19T06:14:02.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:02 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] up:reconnect 2024-03-19T06:14:02.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:02 smithi072 ceph-mon[78545]: fsmap cephfs:1/1 {0=cephfs.smithi172.nparnw=up:reconnect} 2 up:standby 2024-03-19T06:14:02.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:02 smithi172 ceph-mon[66682]: pgmap v234: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 9.2 MiB/s rd, 3 op/s 2024-03-19T06:14:02.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:02 smithi172 ceph-mon[66682]: reconnect by client.24271 192.168.0.1:0/1243789683 after 0.00299993 2024-03-19T06:14:02.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:02 smithi172 ceph-mon[66682]: reconnect by client.14520 192.168.0.1:0/3828438056 after 0.00299993 2024-03-19T06:14:02.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:02 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] up:reconnect 2024-03-19T06:14:02.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:02 smithi172 ceph-mon[66682]: fsmap cephfs:1/1 {0=cephfs.smithi172.nparnw=up:reconnect} 2 up:standby 2024-03-19T06:14:03.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:03 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] up:rejoin 2024-03-19T06:14:03.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:03 smithi172 ceph-mon[66682]: fsmap cephfs:1/1 {0=cephfs.smithi172.nparnw=up:rejoin} 2 up:standby 2024-03-19T06:14:03.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:03 smithi172 ceph-mon[66682]: daemon mds.cephfs.smithi172.nparnw is now active in filesystem cephfs as rank 0 2024-03-19T06:14:03.814 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:03 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] up:rejoin 2024-03-19T06:14:03.814 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:03 smithi072 ceph-mon[78545]: fsmap cephfs:1/1 {0=cephfs.smithi172.nparnw=up:rejoin} 2 up:standby 2024-03-19T06:14:03.814 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:03 smithi072 ceph-mon[78545]: daemon mds.cephfs.smithi172.nparnw is now active in filesystem cephfs as rank 0 2024-03-19T06:14:04.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.096+0000 7f23ac000700 1 -- 172.21.15.72:0/2280550361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a41003d0 msgr2=0x7f23a4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:04.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.096+0000 7f23ac000700 1 --2- 172.21.15.72:0/2280550361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a41003d0 0x7f23a4100840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2390009910 tx=0x7f2390009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:04.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.096+0000 7f23ac000700 1 -- 172.21.15.72:0/2280550361 shutdown_connections 2024-03-19T06:14:04.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.096+0000 7f23ac000700 1 --2- 172.21.15.72:0/2280550361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a41003d0 0x7f23a4100840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.096+0000 7f23ac000700 1 --2- 172.21.15.72:0/2280550361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23a40ff130 0x7f23a40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.096+0000 7f23ac000700 1 -- 172.21.15.72:0/2280550361 >> 172.21.15.72:0/2280550361 conn(0x7f23a40fa780 msgr2=0x7f23a40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.096+0000 7f23ac000700 1 -- 172.21.15.72:0/2280550361 shutdown_connections 2024-03-19T06:14:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.096+0000 7f23ac000700 1 -- 172.21.15.72:0/2280550361 wait complete. 2024-03-19T06:14:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.097+0000 7f23ac000700 1 Processor -- start 2024-03-19T06:14:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.097+0000 7f23ac000700 1 -- start start 2024-03-19T06:14:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.098+0000 7f23ac000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23a40ff130 0x7f23a4103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.098+0000 7f23ac000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a41003d0 0x7f23a41017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.098+0000 7f23ac000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4101cf0 con 0x7f23a41003d0 2024-03-19T06:14:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.098+0000 7f23ac000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4101e30 con 0x7f23a40ff130 2024-03-19T06:14:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.098+0000 7f23a8c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a41003d0 0x7f23a41017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.098+0000 7f23a8c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a41003d0 0x7f23a41017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52596/0 (socket says 172.21.15.72:52596) 2024-03-19T06:14:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.098+0000 7f23a8c00700 1 -- 172.21.15.72:0/2090708502 learned_addr learned my addr 172.21.15.72:0/2090708502 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:04.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.098+0000 7f23a9600700 1 --2- 172.21.15.72:0/2090708502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23a40ff130 0x7f23a4103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:04.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.099+0000 7f23a8c00700 1 -- 172.21.15.72:0/2090708502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23a40ff130 msgr2=0x7f23a4103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:04.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.099+0000 7f23a8c00700 1 --2- 172.21.15.72:0/2090708502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23a40ff130 0x7f23a4103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.099+0000 7f23a8c00700 1 -- 172.21.15.72:0/2090708502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900095f0 con 0x7f23a41003d0 2024-03-19T06:14:04.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.099+0000 7f23a8c00700 1 --2- 172.21.15.72:0/2090708502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a41003d0 0x7f23a41017b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2390005b40 tx=0x7f239000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:04.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.099+0000 7f23a2000700 1 -- 172.21.15.72:0/2090708502 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f239001d070 con 0x7f23a41003d0 2024-03-19T06:14:04.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.099+0000 7f23a2000700 1 -- 172.21.15.72:0/2090708502 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2390022470 con 0x7f23a41003d0 2024-03-19T06:14:04.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.099+0000 7f23a2000700 1 -- 172.21.15.72:0/2090708502 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f239000f690 con 0x7f23a41003d0 2024-03-19T06:14:04.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.099+0000 7f23ac000700 1 -- 172.21.15.72:0/2090708502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a41020b0 con 0x7f23a41003d0 2024-03-19T06:14:04.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.100+0000 7f23ac000700 1 -- 172.21.15.72:0/2090708502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a41025a0 con 0x7f23a41003d0 2024-03-19T06:14:04.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.101+0000 7f23ac000700 1 -- 172.21.15.72:0/2090708502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a4107c90 con 0x7f23a41003d0 2024-03-19T06:14:04.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.102+0000 7f23a2000700 1 -- 172.21.15.72:0/2090708502 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f23900225e0 con 0x7f23a41003d0 2024-03-19T06:14:04.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.103+0000 7f23a2000700 1 --2- 172.21.15.72:0/2090708502 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f238c06dfa0 0x7f238c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:04.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.103+0000 7f23a2000700 1 -- 172.21.15.72:0/2090708502 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f239008f570 con 0x7f23a41003d0 2024-03-19T06:14:04.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.103+0000 7f23a9600700 1 --2- 172.21.15.72:0/2090708502 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f238c06dfa0 0x7f238c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:04.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.104+0000 7f23a9600700 1 --2- 172.21.15.72:0/2090708502 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f238c06dfa0 0x7f238c070450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2398006fd0 tx=0x7f2398008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:04.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.108+0000 7f23a2000700 1 -- 172.21.15.72:0/2090708502 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f239005c570 con 0x7f23a41003d0 2024-03-19T06:14:04.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.358+0000 7f23ac000700 1 -- 172.21.15.72:0/2090708502 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23a4068c50 con 0x7f238c06dfa0 2024-03-19T06:14:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.361+0000 7f23a2000700 1 -- 172.21.15.72:0/2090708502 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f23a4068c50 con 0x7f238c06dfa0 2024-03-19T06:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.363+0000 7f23ac000700 1 -- 172.21.15.72:0/2090708502 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f238c06dfa0 msgr2=0x7f238c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.363+0000 7f23ac000700 1 --2- 172.21.15.72:0/2090708502 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f238c06dfa0 0x7f238c070450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2398006fd0 tx=0x7f2398008040 comp rx=0 tx=0).stop 2024-03-19T06:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.363+0000 7f23ac000700 1 -- 172.21.15.72:0/2090708502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a41003d0 msgr2=0x7f23a41017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.363+0000 7f23ac000700 1 --2- 172.21.15.72:0/2090708502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a41003d0 0x7f23a41017b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2390005b40 tx=0x7f239000be20 comp rx=0 tx=0).stop 2024-03-19T06:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.363+0000 7f23ac000700 1 -- 172.21.15.72:0/2090708502 shutdown_connections 2024-03-19T06:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.363+0000 7f23ac000700 1 --2- 172.21.15.72:0/2090708502 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f238c06dfa0 0x7f238c070450 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.363+0000 7f23ac000700 1 --2- 172.21.15.72:0/2090708502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23a40ff130 0x7f23a4103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.363+0000 7f23ac000700 1 --2- 172.21.15.72:0/2090708502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a41003d0 0x7f23a41017b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.363+0000 7f23ac000700 1 -- 172.21.15.72:0/2090708502 >> 172.21.15.72:0/2090708502 conn(0x7f23a40fa780 msgr2=0x7f23a4068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.364+0000 7f23ac000700 1 -- 172.21.15.72:0/2090708502 shutdown_connections 2024-03-19T06:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.364+0000 7f23ac000700 1 -- 172.21.15.72:0/2090708502 wait complete. 2024-03-19T06:14:04.370 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:14:04.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.530+0000 7f5b1b400700 1 -- 172.21.15.72:0/1419327970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b14101440 msgr2=0x7f5b14101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.530+0000 7f5b1b400700 1 --2- 172.21.15.72:0/1419327970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b14101440 0x7f5b14101890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009910 tx=0x7f5b00009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.531+0000 7f5b1b400700 1 -- 172.21.15.72:0/1419327970 shutdown_connections 2024-03-19T06:14:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.531+0000 7f5b1b400700 1 --2- 172.21.15.72:0/1419327970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b14101440 0x7f5b14101890 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.531+0000 7f5b1b400700 1 --2- 172.21.15.72:0/1419327970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b14100240 0x7f5b14100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.531+0000 7f5b1b400700 1 -- 172.21.15.72:0/1419327970 >> 172.21.15.72:0/1419327970 conn(0x7f5b140fb7f0 msgr2=0x7f5b140fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.531+0000 7f5b1b400700 1 -- 172.21.15.72:0/1419327970 shutdown_connections 2024-03-19T06:14:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.531+0000 7f5b1b400700 1 -- 172.21.15.72:0/1419327970 wait complete. 2024-03-19T06:14:04.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.532+0000 7f5b1b400700 1 Processor -- start 2024-03-19T06:14:04.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.532+0000 7f5b1b400700 1 -- start start 2024-03-19T06:14:04.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.532+0000 7f5b1b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b14100240 0x7f5b14195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:04.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.532+0000 7f5b1b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b14101440 0x7f5b14195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:04.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.532+0000 7f5b1b400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b14196560 con 0x7f5b14100240 2024-03-19T06:14:04.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.532+0000 7f5b1b400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b141966a0 con 0x7f5b14101440 2024-03-19T06:14:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.533+0000 7f5b18a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b14100240 0x7f5b14195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.533+0000 7f5b18a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b14100240 0x7f5b14195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52622/0 (socket says 172.21.15.72:52622) 2024-03-19T06:14:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.533+0000 7f5b18a00700 1 -- 172.21.15.72:0/55737852 learned_addr learned my addr 172.21.15.72:0/55737852 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.533+0000 7f5b13e00700 1 --2- 172.21.15.72:0/55737852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b14101440 0x7f5b14195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.533+0000 7f5b18a00700 1 -- 172.21.15.72:0/55737852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b14101440 msgr2=0x7f5b14195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.533+0000 7f5b18a00700 1 --2- 172.21.15.72:0/55737852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b14101440 0x7f5b14195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.533+0000 7f5b18a00700 1 -- 172.21.15.72:0/55737852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000095f0 con 0x7f5b14100240 2024-03-19T06:14:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.533+0000 7f5b13e00700 1 --2- 172.21.15.72:0/55737852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b14101440 0x7f5b14195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:14:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.534+0000 7f5b18a00700 1 --2- 172.21.15.72:0/55737852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b14100240 0x7f5b14195a90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c910 tx=0x7f5b0800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.534+0000 7f5b11600700 1 -- 172.21.15.72:0/55737852 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b080041f0 con 0x7f5b14100240 2024-03-19T06:14:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.534+0000 7f5b11600700 1 -- 172.21.15.72:0/55737852 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b08007db0 con 0x7f5b14100240 2024-03-19T06:14:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.534+0000 7f5b11600700 1 -- 172.21.15.72:0/55737852 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b08003d60 con 0x7f5b14100240 2024-03-19T06:14:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.534+0000 7f5b1b400700 1 -- 172.21.15.72:0/55737852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1419b160 con 0x7f5b14100240 2024-03-19T06:14:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.534+0000 7f5b1b400700 1 -- 172.21.15.72:0/55737852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1419b680 con 0x7f5b14100240 2024-03-19T06:14:04.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.535+0000 7f5b1b400700 1 -- 172.21.15.72:0/55737852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b14108d90 con 0x7f5b14100240 2024-03-19T06:14:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.536+0000 7f5b11600700 1 -- 172.21.15.72:0/55737852 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f5b08007900 con 0x7f5b14100240 2024-03-19T06:14:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.537+0000 7f5b11600700 1 --2- 172.21.15.72:0/55737852 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5afc06dfa0 0x7f5afc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.537+0000 7f5b11600700 1 -- 172.21.15.72:0/55737852 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5b0808da00 con 0x7f5b14100240 2024-03-19T06:14:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.538+0000 7f5b13e00700 1 --2- 172.21.15.72:0/55737852 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5afc06dfa0 0x7f5afc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.538+0000 7f5b13e00700 1 --2- 172.21.15.72:0/55737852 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5afc06dfa0 0x7f5afc070450 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5b00006010 tx=0x7f5b0000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:04.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.543+0000 7f5b11600700 1 -- 172.21.15.72:0/55737852 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f5b0805aa20 con 0x7f5b14100240 2024-03-19T06:14:04.685 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:04 smithi072 ceph-mon[78545]: pgmap v235: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-03-19T06:14:04.686 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:04 smithi072 ceph-mon[78545]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-19T06:14:04.686 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:04 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] up:active 2024-03-19T06:14:04.686 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:04 smithi072 ceph-mon[78545]: fsmap cephfs:1 {0=cephfs.smithi172.nparnw=up:active} 2 up:standby 2024-03-19T06:14:04.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.817+0000 7f5b1b400700 1 -- 172.21.15.72:0/55737852 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b14105d90 con 0x7f5afc06dfa0 2024-03-19T06:14:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.819+0000 7f5b11600700 1 -- 172.21.15.72:0/55737852 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5b14105d90 con 0x7f5afc06dfa0 2024-03-19T06:14:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.822+0000 7f5b1b400700 1 -- 172.21.15.72:0/55737852 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5afc06dfa0 msgr2=0x7f5afc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.822+0000 7f5b1b400700 1 --2- 172.21.15.72:0/55737852 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5afc06dfa0 0x7f5afc070450 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5b00006010 tx=0x7f5b0000b540 comp rx=0 tx=0).stop 2024-03-19T06:14:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.822+0000 7f5b1b400700 1 -- 172.21.15.72:0/55737852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b14100240 msgr2=0x7f5b14195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.822+0000 7f5b1b400700 1 --2- 172.21.15.72:0/55737852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b14100240 0x7f5b14195a90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c910 tx=0x7f5b0800ccd0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.822+0000 7f5b1b400700 1 -- 172.21.15.72:0/55737852 shutdown_connections 2024-03-19T06:14:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.822+0000 7f5b1b400700 1 --2- 172.21.15.72:0/55737852 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5afc06dfa0 0x7f5afc070450 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.822+0000 7f5b1b400700 1 --2- 172.21.15.72:0/55737852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b14100240 0x7f5b14195a90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.822+0000 7f5b1b400700 1 --2- 172.21.15.72:0/55737852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b14101440 0x7f5b14195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.822+0000 7f5b1b400700 1 -- 172.21.15.72:0/55737852 >> 172.21.15.72:0/55737852 conn(0x7f5b140fb7f0 msgr2=0x7f5b14104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.822+0000 7f5b1b400700 1 -- 172.21.15.72:0/55737852 shutdown_connections 2024-03-19T06:14:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.822+0000 7f5b1b400700 1 -- 172.21.15.72:0/55737852 wait complete. 2024-03-19T06:14:04.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:04 smithi172 ceph-mon[66682]: pgmap v235: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-03-19T06:14:04.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:04 smithi172 ceph-mon[66682]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-19T06:14:04.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:04 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] up:active 2024-03-19T06:14:04.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:04 smithi172 ceph-mon[66682]: fsmap cephfs:1 {0=cephfs.smithi172.nparnw=up:active} 2 up:standby 2024-03-19T06:14:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.978+0000 7f27fca00700 1 -- 172.21.15.72:0/189776738 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27ec0054b0 con 0x7f27f80fef20 2024-03-19T06:14:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.978+0000 7f27ff200700 1 -- 172.21.15.72:0/189776738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f80fef20 msgr2=0x7f27f80ff330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.978+0000 7f27ff200700 1 --2- 172.21.15.72:0/189776738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f80fef20 0x7f27f80ff330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009910 tx=0x7f27ec009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.978+0000 7f27ff200700 1 -- 172.21.15.72:0/189776738 shutdown_connections 2024-03-19T06:14:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.978+0000 7f27ff200700 1 --2- 172.21.15.72:0/189776738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27f8100080 0x7f27f81004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.978+0000 7f27ff200700 1 --2- 172.21.15.72:0/189776738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f80fef20 0x7f27f80ff330 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.978+0000 7f27ff200700 1 -- 172.21.15.72:0/189776738 >> 172.21.15.72:0/189776738 conn(0x7f27f80fa4d0 msgr2=0x7f27f80fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:04.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.979+0000 7f27ff200700 1 -- 172.21.15.72:0/189776738 shutdown_connections 2024-03-19T06:14:04.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.979+0000 7f27ff200700 1 -- 172.21.15.72:0/189776738 wait complete. 2024-03-19T06:14:04.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.980+0000 7f27ff200700 1 Processor -- start 2024-03-19T06:14:04.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.980+0000 7f27ff200700 1 -- start start 2024-03-19T06:14:04.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.980+0000 7f27ff200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f80fef20 0x7f27f8195880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:04.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.980+0000 7f27ff200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27f8100080 0x7f27f8195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:04.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.980+0000 7f27ff200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f81963e0 con 0x7f27f80fef20 2024-03-19T06:14:04.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.980+0000 7f27ff200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8196520 con 0x7f27f8100080 2024-03-19T06:14:04.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.980+0000 7f27fde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f80fef20 0x7f27f8195880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:04.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.980+0000 7f27fde00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f80fef20 0x7f27f8195880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52634/0 (socket says 172.21.15.72:52634) 2024-03-19T06:14:04.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.980+0000 7f27fde00700 1 -- 172.21.15.72:0/1038492597 learned_addr learned my addr 172.21.15.72:0/1038492597 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:04.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.981+0000 7f27fd400700 1 --2- 172.21.15.72:0/1038492597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27f8100080 0x7f27f8195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:04.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.981+0000 7f27fde00700 1 -- 172.21.15.72:0/1038492597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27f8100080 msgr2=0x7f27f8195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:04.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.981+0000 7f27fde00700 1 --2- 172.21.15.72:0/1038492597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27f8100080 0x7f27f8195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:04.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.981+0000 7f27fde00700 1 -- 172.21.15.72:0/1038492597 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec0095f0 con 0x7f27f80fef20 2024-03-19T06:14:04.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.981+0000 7f27fde00700 1 --2- 172.21.15.72:0/1038492597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f80fef20 0x7f27f8195880 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f27ec006010 tx=0x7f27ec00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:04.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.981+0000 7f27f2a00700 1 -- 172.21.15.72:0/1038492597 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27ec01d070 con 0x7f27f80fef20 2024-03-19T06:14:04.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.981+0000 7f27f2a00700 1 -- 172.21.15.72:0/1038492597 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f27ec00f460 con 0x7f27f80fef20 2024-03-19T06:14:04.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.982+0000 7f27ff200700 1 -- 172.21.15.72:0/1038492597 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f819af70 con 0x7f27f80fef20 2024-03-19T06:14:04.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.982+0000 7f27f2a00700 1 -- 172.21.15.72:0/1038492597 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27ec021640 con 0x7f27f80fef20 2024-03-19T06:14:04.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.982+0000 7f27ff200700 1 -- 172.21.15.72:0/1038492597 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f819b460 con 0x7f27f80fef20 2024-03-19T06:14:04.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.983+0000 7f27ff200700 1 -- 172.21.15.72:0/1038492597 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f8108ca0 con 0x7f27f80fef20 2024-03-19T06:14:04.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.984+0000 7f27f2a00700 1 -- 172.21.15.72:0/1038492597 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f27ec00fab0 con 0x7f27f80fef20 2024-03-19T06:14:04.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.985+0000 7f27f2a00700 1 --2- 172.21.15.72:0/1038492597 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f27e006dfa0 0x7f27e0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:04.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.986+0000 7f27f2a00700 1 -- 172.21.15.72:0/1038492597 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f27ec08f1e0 con 0x7f27f80fef20 2024-03-19T06:14:04.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.986+0000 7f27fd400700 1 --2- 172.21.15.72:0/1038492597 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f27e006dfa0 0x7f27e0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:04.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.986+0000 7f27fd400700 1 --2- 172.21.15.72:0/1038492597 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f27e006dfa0 0x7f27e0070450 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f27e8006fd0 tx=0x7f27e8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:04.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:04.990+0000 7f27f2a00700 1 -- 172.21.15.72:0/1038492597 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f27ec05c200 con 0x7f27f80fef20 2024-03-19T06:14:05.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.240+0000 7f27ff200700 1 -- 172.21.15.72:0/1038492597 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f27f8104a60 con 0x7f27e006dfa0 2024-03-19T06:14:05.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.253+0000 7f27f2a00700 1 -- 172.21.15.72:0/1038492597 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f27f8104a60 con 0x7f27e006dfa0 2024-03-19T06:14:05.243 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:14:05.243 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (18m) 23s ago 20m 14.3M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:14:05.243 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (20m) 23s ago 20m 9298k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:14:05.243 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (19m) 93s ago 19m 8724k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:14:05.243 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (5m) 23s ago 20m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:14:05.243 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (5m) 93s ago 19m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (18m) 23s ago 20m 73.9M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (12m) 23s ago 12m 68.8M - 18.2.0 dc2bc1663786 6cc3ccf8d921 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (31s) 23s ago 13m 11.1M - 19.0.0-1934-gb0ea271b 5c4d8774b57a d0daead2fe2a 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (12m) 93s ago 12m 17.3M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (13m) 93s ago 13m 142M - 18.2.0 dc2bc1663786 13233f399013 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (9m) 23s ago 22m 507M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (7m) 93s ago 19m 451M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (6m) 23s ago 22m 56.1M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (6m) 93s ago 18m 41.0M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (20m) 23s ago 20m 7922k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (19m) 93s ago 19m 8036k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (4m) 23s ago 18m 97.5M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (4m) 23s ago 17m 99.6M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (3m) 23s ago 16m 90.0M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (3m) 93s ago 16m 90.4M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:14:05.244 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (2m) 93s ago 15m 90.4M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:14:05.245 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (98s) 93s ago 15m 11.2M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a c47c9c7fd3c7 2024-03-19T06:14:05.245 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (7m) 23s ago 19m 70.3M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:14:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.255+0000 7f27ff200700 1 -- 172.21.15.72:0/1038492597 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f27e006dfa0 msgr2=0x7f27e0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.255+0000 7f27ff200700 1 --2- 172.21.15.72:0/1038492597 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f27e006dfa0 0x7f27e0070450 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f27e8006fd0 tx=0x7f27e8008040 comp rx=0 tx=0).stop 2024-03-19T06:14:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.255+0000 7f27ff200700 1 -- 172.21.15.72:0/1038492597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f80fef20 msgr2=0x7f27f8195880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.255+0000 7f27ff200700 1 --2- 172.21.15.72:0/1038492597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f80fef20 0x7f27f8195880 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f27ec006010 tx=0x7f27ec00be20 comp rx=0 tx=0).stop 2024-03-19T06:14:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.256+0000 7f27ff200700 1 -- 172.21.15.72:0/1038492597 shutdown_connections 2024-03-19T06:14:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.256+0000 7f27ff200700 1 --2- 172.21.15.72:0/1038492597 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f27e006dfa0 0x7f27e0070450 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.256+0000 7f27ff200700 1 --2- 172.21.15.72:0/1038492597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f80fef20 0x7f27f8195880 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.256+0000 7f27ff200700 1 --2- 172.21.15.72:0/1038492597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27f8100080 0x7f27f8195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.256+0000 7f27ff200700 1 -- 172.21.15.72:0/1038492597 >> 172.21.15.72:0/1038492597 conn(0x7f27f80fa4d0 msgr2=0x7f27f8103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.256+0000 7f27ff200700 1 -- 172.21.15.72:0/1038492597 shutdown_connections 2024-03-19T06:14:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.256+0000 7f27ff200700 1 -- 172.21.15.72:0/1038492597 wait complete. 2024-03-19T06:14:05.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.407+0000 7f4b9a400700 1 -- 172.21.15.72:0/3868774377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b941012c0 msgr2=0x7f4b94101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:05.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.407+0000 7f4b9a400700 1 --2- 172.21.15.72:0/3868774377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b941012c0 0x7f4b94101730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009910 tx=0x7f4b80009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:05.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.407+0000 7f4b9a400700 1 -- 172.21.15.72:0/3868774377 shutdown_connections 2024-03-19T06:14:05.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.407+0000 7f4b9a400700 1 --2- 172.21.15.72:0/3868774377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b941012c0 0x7f4b94101730 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:05.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.407+0000 7f4b9a400700 1 --2- 172.21.15.72:0/3868774377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b94100020 0x7f4b94100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:05.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.407+0000 7f4b9a400700 1 -- 172.21.15.72:0/3868774377 >> 172.21.15.72:0/3868774377 conn(0x7f4b940fb650 msgr2=0x7f4b940fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:05.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.407+0000 7f4b9a400700 1 -- 172.21.15.72:0/3868774377 shutdown_connections 2024-03-19T06:14:05.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.407+0000 7f4b9a400700 1 -- 172.21.15.72:0/3868774377 wait complete. 2024-03-19T06:14:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.408+0000 7f4b9a400700 1 Processor -- start 2024-03-19T06:14:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.409+0000 7f4b9a400700 1 -- start start 2024-03-19T06:14:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.409+0000 7f4b9a400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b94100020 0x7f4b94195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.409+0000 7f4b9a400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b941012c0 0x7f4b94195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.409+0000 7f4b9a400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94196360 con 0x7f4b941012c0 2024-03-19T06:14:05.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.409+0000 7f4b9a400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b941964a0 con 0x7f4b94100020 2024-03-19T06:14:05.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.409+0000 7f4b93e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b941012c0 0x7f4b94195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:05.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.409+0000 7f4b93e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b941012c0 0x7f4b94195d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52650/0 (socket says 172.21.15.72:52650) 2024-03-19T06:14:05.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.409+0000 7f4b93e00700 1 -- 172.21.15.72:0/786318279 learned_addr learned my addr 172.21.15.72:0/786318279 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:05.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.409+0000 7f4b99000700 1 --2- 172.21.15.72:0/786318279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b94100020 0x7f4b94195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:05.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.410+0000 7f4b93e00700 1 -- 172.21.15.72:0/786318279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b94100020 msgr2=0x7f4b94195800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:05.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.410+0000 7f4b93e00700 1 --2- 172.21.15.72:0/786318279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b94100020 0x7f4b94195800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:05.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.410+0000 7f4b93e00700 1 -- 172.21.15.72:0/786318279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800095f0 con 0x7f4b941012c0 2024-03-19T06:14:05.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.410+0000 7f4b93e00700 1 --2- 172.21.15.72:0/786318279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b941012c0 0x7f4b94195d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000b5c0 tx=0x7f4b8000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:05.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.410+0000 7f4b91600700 1 -- 172.21.15.72:0/786318279 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b8001d070 con 0x7f4b941012c0 2024-03-19T06:14:05.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.410+0000 7f4b91600700 1 -- 172.21.15.72:0/786318279 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4b80022470 con 0x7f4b941012c0 2024-03-19T06:14:05.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.410+0000 7f4b91600700 1 -- 172.21.15.72:0/786318279 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b8000f690 con 0x7f4b941012c0 2024-03-19T06:14:05.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.410+0000 7f4b9a400700 1 -- 172.21.15.72:0/786318279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9419aef0 con 0x7f4b941012c0 2024-03-19T06:14:05.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.411+0000 7f4b9a400700 1 -- 172.21.15.72:0/786318279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9419b3b0 con 0x7f4b941012c0 2024-03-19T06:14:05.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.412+0000 7f4b9a400700 1 -- 172.21.15.72:0/786318279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b94108b00 con 0x7f4b941012c0 2024-03-19T06:14:05.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.413+0000 7f4b91600700 1 -- 172.21.15.72:0/786318279 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f4b80004b70 con 0x7f4b941012c0 2024-03-19T06:14:05.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.414+0000 7f4b91600700 1 --2- 172.21.15.72:0/786318279 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4b7c06dfa0 0x7f4b7c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:05.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.414+0000 7f4b91600700 1 -- 172.21.15.72:0/786318279 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4b8008f3f0 con 0x7f4b941012c0 2024-03-19T06:14:05.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.414+0000 7f4b99000700 1 --2- 172.21.15.72:0/786318279 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4b7c06dfa0 0x7f4b7c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:05.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.415+0000 7f4b99000700 1 --2- 172.21.15.72:0/786318279 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4b7c06dfa0 0x7f4b7c070450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4b88005fd0 tx=0x7f4b8800a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:05.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.419+0000 7f4b91600700 1 -- 172.21.15.72:0/786318279 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f4b8005c4c0 con 0x7f4b941012c0 2024-03-19T06:14:05.524 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:05 smithi072 ceph-mon[78545]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:05.734 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:05 smithi172 ceph-mon[66682]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:05.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.775+0000 7f4b9a400700 1 -- 172.21.15.72:0/786318279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4b9419bad0 con 0x7f4b941012c0 2024-03-19T06:14:05.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.776+0000 7f4b91600700 1 -- 172.21.15.72:0/786318279 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7f4b8005c050 con 0x7f4b941012c0 2024-03-19T06:14:05.766 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:14:05.766 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:14:05.766 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:14:05.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:14:05.766 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:14:05.766 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:14:05.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:14:05.766 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:14:05.766 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 6 2024-03-19T06:14:05.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:14:05.766 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:14:05.767 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-03-19T06:14:05.767 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 1 2024-03-19T06:14:05.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:14:05.767 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:14:05.767 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-03-19T06:14:05.767 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 11 2024-03-19T06:14:05.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:14:05.767 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:14:05.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.779+0000 7f4b9a400700 1 -- 172.21.15.72:0/786318279 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4b7c06dfa0 msgr2=0x7f4b7c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:05.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.779+0000 7f4b9a400700 1 --2- 172.21.15.72:0/786318279 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4b7c06dfa0 0x7f4b7c070450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4b88005fd0 tx=0x7f4b8800a560 comp rx=0 tx=0).stop 2024-03-19T06:14:05.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.779+0000 7f4b9a400700 1 -- 172.21.15.72:0/786318279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b941012c0 msgr2=0x7f4b94195d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.779+0000 7f4b9a400700 1 --2- 172.21.15.72:0/786318279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b941012c0 0x7f4b94195d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000b5c0 tx=0x7f4b8000be20 comp rx=0 tx=0).stop 2024-03-19T06:14:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.780+0000 7f4b9a400700 1 -- 172.21.15.72:0/786318279 shutdown_connections 2024-03-19T06:14:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.780+0000 7f4b9a400700 1 --2- 172.21.15.72:0/786318279 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f4b7c06dfa0 0x7f4b7c070450 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.780+0000 7f4b9a400700 1 --2- 172.21.15.72:0/786318279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b94100020 0x7f4b94195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.780+0000 7f4b9a400700 1 --2- 172.21.15.72:0/786318279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b941012c0 0x7f4b94195d40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.780+0000 7f4b9a400700 1 -- 172.21.15.72:0/786318279 >> 172.21.15.72:0/786318279 conn(0x7f4b940fb650 msgr2=0x7f4b941044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.780+0000 7f4b9a400700 1 -- 172.21.15.72:0/786318279 shutdown_connections 2024-03-19T06:14:05.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.780+0000 7f4b9a400700 1 -- 172.21.15.72:0/786318279 wait complete. 2024-03-19T06:14:05.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.948+0000 7f31e3e00700 1 -- 172.21.15.72:0/1383380658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e4103450 msgr2=0x7f31e4105830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:05.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.948+0000 7f31e3e00700 1 --2- 172.21.15.72:0/1383380658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e4103450 0x7f31e4105830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009910 tx=0x7f31d0009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:05.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.948+0000 7f31e3e00700 1 -- 172.21.15.72:0/1383380658 shutdown_connections 2024-03-19T06:14:05.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.948+0000 7f31e3e00700 1 --2- 172.21.15.72:0/1383380658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e4103450 0x7f31e4105830 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:05.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.948+0000 7f31e3e00700 1 --2- 172.21.15.72:0/1383380658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31e4100b30 0x7f31e4102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:05.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.948+0000 7f31e3e00700 1 -- 172.21.15.72:0/1383380658 >> 172.21.15.72:0/1383380658 conn(0x7f31e40fa4d0 msgr2=0x7f31e40fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:05.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.948+0000 7f31e3e00700 1 -- 172.21.15.72:0/1383380658 shutdown_connections 2024-03-19T06:14:05.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.948+0000 7f31e3e00700 1 -- 172.21.15.72:0/1383380658 wait complete. 2024-03-19T06:14:05.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.949+0000 7f31e3e00700 1 Processor -- start 2024-03-19T06:14:05.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.950+0000 7f31e3e00700 1 -- start start 2024-03-19T06:14:05.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.950+0000 7f31e3e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e4100b30 0x7f31e4197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:05.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.950+0000 7f31e3e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31e4103450 0x7f31e4197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:05.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.950+0000 7f31e3e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e4198600 con 0x7f31e4100b30 2024-03-19T06:14:05.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.950+0000 7f31e3e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e4198740 con 0x7f31e4103450 2024-03-19T06:14:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.950+0000 7f31e2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e4100b30 0x7f31e4197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.951+0000 7f31e2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e4100b30 0x7f31e4197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52678/0 (socket says 172.21.15.72:52678) 2024-03-19T06:14:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.951+0000 7f31e2a00700 1 -- 172.21.15.72:0/1110742578 learned_addr learned my addr 172.21.15.72:0/1110742578 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.951+0000 7f31e2000700 1 --2- 172.21.15.72:0/1110742578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31e4103450 0x7f31e4197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.951+0000 7f31e2a00700 1 -- 172.21.15.72:0/1110742578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31e4103450 msgr2=0x7f31e4197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.951+0000 7f31e2a00700 1 --2- 172.21.15.72:0/1110742578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31e4103450 0x7f31e4197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.951+0000 7f31e2a00700 1 -- 172.21.15.72:0/1110742578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00095f0 con 0x7f31e4100b30 2024-03-19T06:14:05.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.951+0000 7f31e2a00700 1 --2- 172.21.15.72:0/1110742578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e4100b30 0x7f31e4197aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f31d400b4b0 tx=0x7f31d400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:05.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.952+0000 7f31db400700 1 -- 172.21.15.72:0/1110742578 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31d4011800 con 0x7f31e4100b30 2024-03-19T06:14:05.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.952+0000 7f31db400700 1 -- 172.21.15.72:0/1110742578 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f31d4011e10 con 0x7f31e4100b30 2024-03-19T06:14:05.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.952+0000 7f31e3e00700 1 -- 172.21.15.72:0/1110742578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e419d1f0 con 0x7f31e4100b30 2024-03-19T06:14:05.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.952+0000 7f31e3e00700 1 -- 172.21.15.72:0/1110742578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e419d7c0 con 0x7f31e4100b30 2024-03-19T06:14:05.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.952+0000 7f31db400700 1 -- 172.21.15.72:0/1110742578 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31d400f2e0 con 0x7f31e4100b30 2024-03-19T06:14:05.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.953+0000 7f31e3e00700 1 -- 172.21.15.72:0/1110742578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c4005320 con 0x7f31e4100b30 2024-03-19T06:14:05.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.954+0000 7f31db400700 1 -- 172.21.15.72:0/1110742578 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f31d4011960 con 0x7f31e4100b30 2024-03-19T06:14:05.944 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.955+0000 7f31db400700 1 --2- 172.21.15.72:0/1110742578 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f31c806dfa0 0x7f31c8070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:05.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.955+0000 7f31db400700 1 -- 172.21.15.72:0/1110742578 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f31d408d930 con 0x7f31e4100b30 2024-03-19T06:14:05.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.955+0000 7f31e2000700 1 --2- 172.21.15.72:0/1110742578 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f31c806dfa0 0x7f31c8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:05.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.956+0000 7f31e2000700 1 --2- 172.21.15.72:0/1110742578 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f31c806dfa0 0x7f31c8070450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f31d0006010 tx=0x7f31d000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:05.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:05.960+0000 7f31db400700 1 -- 172.21.15.72:0/1110742578 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f31d405a8b0 con 0x7f31e4100b30 2024-03-19T06:14:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.235+0000 7f31e3e00700 1 -- 172.21.15.72:0/1110742578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f31c4006200 con 0x7f31e4100b30 2024-03-19T06:14:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.236+0000 7f31db400700 1 -- 172.21.15.72:0/1110742578 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1674 (secure 0 0 0) 0x7f31d405a440 con 0x7f31e4100b30 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:e33 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 33 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:14:02.532092+0000 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:14:06.226 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 81 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24237} 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 1 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:14:06.227 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:14:06.228 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:14:06.228 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:14:06.228 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:14:06.228 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:14:06.228 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{0:24237} state up:active seq 196 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:14:06.228 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:14:06.228 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:14:06.228 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:14:06.228 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:14:06.228 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{-1:34488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:14:06.228 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{-1:44255} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/3611765575,v1:172.21.15.172:6825/3611765575] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:14:06.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.238+0000 7f31e3e00700 1 -- 172.21.15.72:0/1110742578 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f31c806dfa0 msgr2=0x7f31c8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:06.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.238+0000 7f31e3e00700 1 --2- 172.21.15.72:0/1110742578 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f31c806dfa0 0x7f31c8070450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f31d0006010 tx=0x7f31d000b540 comp rx=0 tx=0).stop 2024-03-19T06:14:06.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.238+0000 7f31e3e00700 1 -- 172.21.15.72:0/1110742578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e4100b30 msgr2=0x7f31e4197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:06.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.238+0000 7f31e3e00700 1 --2- 172.21.15.72:0/1110742578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e4100b30 0x7f31e4197aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f31d400b4b0 tx=0x7f31d400b870 comp rx=0 tx=0).stop 2024-03-19T06:14:06.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.238+0000 7f31e3e00700 1 -- 172.21.15.72:0/1110742578 shutdown_connections 2024-03-19T06:14:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.238+0000 7f31e3e00700 1 --2- 172.21.15.72:0/1110742578 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f31c806dfa0 0x7f31c8070450 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.238+0000 7f31e3e00700 1 --2- 172.21.15.72:0/1110742578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e4100b30 0x7f31e4197aa0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.239+0000 7f31e3e00700 1 --2- 172.21.15.72:0/1110742578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31e4103450 0x7f31e4197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.239+0000 7f31e3e00700 1 -- 172.21.15.72:0/1110742578 >> 172.21.15.72:0/1110742578 conn(0x7f31e40fa4d0 msgr2=0x7f31e40ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.239+0000 7f31e3e00700 1 -- 172.21.15.72:0/1110742578 shutdown_connections 2024-03-19T06:14:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.239+0000 7f31e3e00700 1 -- 172.21.15.72:0/1110742578 wait complete. 2024-03-19T06:14:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 33 2024-03-19T06:14:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.391+0000 7fe5f5600700 1 -- 172.21.15.72:0/1198975252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00737b0 msgr2=0x7fe5f0073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.391+0000 7fe5f5600700 1 --2- 172.21.15.72:0/1198975252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00737b0 0x7fe5f0073c20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009910 tx=0x7fe5d8009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.391+0000 7fe5f5600700 1 -- 172.21.15.72:0/1198975252 shutdown_connections 2024-03-19T06:14:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.391+0000 7fe5f5600700 1 --2- 172.21.15.72:0/1198975252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00737b0 0x7fe5f0073c20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.391+0000 7fe5f5600700 1 --2- 172.21.15.72:0/1198975252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f0074d80 0x7fe5f00731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.391+0000 7fe5f5600700 1 -- 172.21.15.72:0/1198975252 >> 172.21.15.72:0/1198975252 conn(0x7fe5f00fb7f0 msgr2=0x7fe5f00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:06.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.391+0000 7fe5f5600700 1 -- 172.21.15.72:0/1198975252 shutdown_connections 2024-03-19T06:14:06.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.391+0000 7fe5f5600700 1 -- 172.21.15.72:0/1198975252 wait complete. 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.392+0000 7fe5f5600700 1 Processor -- start 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.392+0000 7fe5f5600700 1 -- start start 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.393+0000 7fe5f5600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00737b0 0x7fe5f019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.393+0000 7fe5f5600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f0074d80 0x7fe5f019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.393+0000 7fe5f5600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f019cbd0 con 0x7fe5f00737b0 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.393+0000 7fe5f5600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f019cd10 con 0x7fe5f0074d80 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.393+0000 7fe5eea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00737b0 0x7fe5f019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.393+0000 7fe5eea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00737b0 0x7fe5f019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52688/0 (socket says 172.21.15.72:52688) 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.393+0000 7fe5eea00700 1 -- 172.21.15.72:0/2796225367 learned_addr learned my addr 172.21.15.72:0/2796225367 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.393+0000 7fe5e6000700 1 --2- 172.21.15.72:0/2796225367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f0074d80 0x7fe5f019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.393+0000 7fe5eea00700 1 -- 172.21.15.72:0/2796225367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f0074d80 msgr2=0x7fe5f019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.393+0000 7fe5eea00700 1 --2- 172.21.15.72:0/2796225367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f0074d80 0x7fe5f019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.394+0000 7fe5eea00700 1 -- 172.21.15.72:0/2796225367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d80095f0 con 0x7fe5f00737b0 2024-03-19T06:14:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.394+0000 7fe5eea00700 1 --2- 172.21.15.72:0/2796225367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00737b0 0x7fe5f019c070 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000c8a0 tx=0x7fe5e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.394+0000 7fe5e7e00700 1 -- 172.21.15.72:0/2796225367 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5e000cea0 con 0x7fe5f00737b0 2024-03-19T06:14:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.394+0000 7fe5e7e00700 1 -- 172.21.15.72:0/2796225367 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe5e0004830 con 0x7fe5f00737b0 2024-03-19T06:14:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.394+0000 7fe5e7e00700 1 -- 172.21.15.72:0/2796225367 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5e00055b0 con 0x7fe5f00737b0 2024-03-19T06:14:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.394+0000 7fe5f5600700 1 -- 172.21.15.72:0/2796225367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f01a17c0 con 0x7fe5f00737b0 2024-03-19T06:14:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.394+0000 7fe5f5600700 1 -- 172.21.15.72:0/2796225367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f01a1d10 con 0x7fe5f00737b0 2024-03-19T06:14:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.396+0000 7fe5f5600700 1 -- 172.21.15.72:0/2796225367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f010f380 con 0x7fe5f00737b0 2024-03-19T06:14:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.396+0000 7fe5e7e00700 1 -- 172.21.15.72:0/2796225367 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fe5e0007ad0 con 0x7fe5f00737b0 2024-03-19T06:14:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.397+0000 7fe5e7e00700 1 --2- 172.21.15.72:0/2796225367 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe5d406dfa0 0x7fe5d4070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:06.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.397+0000 7fe5e7e00700 1 -- 172.21.15.72:0/2796225367 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe5e008db20 con 0x7fe5f00737b0 2024-03-19T06:14:06.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.398+0000 7fe5e6000700 1 --2- 172.21.15.72:0/2796225367 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe5d406dfa0 0x7fe5d4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:06.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.398+0000 7fe5e6000700 1 --2- 172.21.15.72:0/2796225367 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe5d406dfa0 0x7fe5d4070450 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8006010 tx=0x7fe5d800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:06.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.402+0000 7fe5e7e00700 1 -- 172.21.15.72:0/2796225367 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fe5e005aa20 con 0x7fe5f00737b0 2024-03-19T06:14:06.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.641+0000 7fe5f5600700 1 -- 172.21.15.72:0/2796225367 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5f01031e0 con 0x7fe5d406dfa0 2024-03-19T06:14:06.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.643+0000 7fe5e7e00700 1 -- 172.21.15.72:0/2796225367 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe5f01031e0 con 0x7fe5d406dfa0 2024-03-19T06:14:06.633 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "13/23 daemons upgraded", 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mds daemons", 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:14:06.634 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:14:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.646+0000 7fe5f5600700 1 -- 172.21.15.72:0/2796225367 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe5d406dfa0 msgr2=0x7fe5d4070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.647+0000 7fe5f5600700 1 --2- 172.21.15.72:0/2796225367 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe5d406dfa0 0x7fe5d4070450 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8006010 tx=0x7fe5d800b540 comp rx=0 tx=0).stop 2024-03-19T06:14:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.647+0000 7fe5f5600700 1 -- 172.21.15.72:0/2796225367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00737b0 msgr2=0x7fe5f019c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.647+0000 7fe5f5600700 1 --2- 172.21.15.72:0/2796225367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00737b0 0x7fe5f019c070 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000c8a0 tx=0x7fe5e000cc60 comp rx=0 tx=0).stop 2024-03-19T06:14:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.647+0000 7fe5f5600700 1 -- 172.21.15.72:0/2796225367 shutdown_connections 2024-03-19T06:14:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.647+0000 7fe5f5600700 1 --2- 172.21.15.72:0/2796225367 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe5d406dfa0 0x7fe5d4070450 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.647+0000 7fe5f5600700 1 --2- 172.21.15.72:0/2796225367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00737b0 0x7fe5f019c070 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.647+0000 7fe5f5600700 1 --2- 172.21.15.72:0/2796225367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f0074d80 0x7fe5f019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.647+0000 7fe5f5600700 1 -- 172.21.15.72:0/2796225367 >> 172.21.15.72:0/2796225367 conn(0x7fe5f00fb7f0 msgr2=0x7fe5f0101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.647+0000 7fe5f5600700 1 -- 172.21.15.72:0/2796225367 shutdown_connections 2024-03-19T06:14:06.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.647+0000 7fe5f5600700 1 -- 172.21.15.72:0/2796225367 wait complete. 2024-03-19T06:14:06.650 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:06 smithi072 ceph-mon[78545]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:06.650 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:06 smithi072 ceph-mon[78545]: pgmap v236: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 6 op/s 2024-03-19T06:14:06.650 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:06 smithi072 ceph-mon[78545]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:06.650 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:06 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/786318279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:06.650 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:06 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:06.650 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:06 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:06.651 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:06 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:14:06.651 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:06 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1110742578' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:14:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.801+0000 7fbfbee00700 1 -- 172.21.15.72:0/2940674224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb8103640 msgr2=0x7fbfb8103a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.801+0000 7fbfbee00700 1 --2- 172.21.15.72:0/2940674224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb8103640 0x7fbfb8103a90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000b0a0 tx=0x7fbfa000b3b0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.801+0000 7fbfbee00700 1 -- 172.21.15.72:0/2940674224 shutdown_connections 2024-03-19T06:14:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.801+0000 7fbfbee00700 1 --2- 172.21.15.72:0/2940674224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb8103640 0x7fbfb8103a90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.801+0000 7fbfbee00700 1 --2- 172.21.15.72:0/2940674224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb8102490 0x7fbfb81028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.801+0000 7fbfbee00700 1 -- 172.21.15.72:0/2940674224 >> 172.21.15.72:0/2940674224 conn(0x7fbfb80fda60 msgr2=0x7fbfb80ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.801+0000 7fbfbee00700 1 -- 172.21.15.72:0/2940674224 shutdown_connections 2024-03-19T06:14:06.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.801+0000 7fbfbee00700 1 -- 172.21.15.72:0/2940674224 wait complete. 2024-03-19T06:14:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.802+0000 7fbfbee00700 1 Processor -- start 2024-03-19T06:14:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.802+0000 7fbfbee00700 1 -- start start 2024-03-19T06:14:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.803+0000 7fbfbee00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb8102490 0x7fbfb8197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:06.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.803+0000 7fbfbee00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb8103640 0x7fbfb8198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:06.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.803+0000 7fbfbee00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8198960 con 0x7fbfb8103640 2024-03-19T06:14:06.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.803+0000 7fbfbee00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8198aa0 con 0x7fbfb8102490 2024-03-19T06:14:06.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.803+0000 7fbfaf400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb8103640 0x7fbfb8198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:06.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.803+0000 7fbfaf400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb8103640 0x7fbfb8198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52706/0 (socket says 172.21.15.72:52706) 2024-03-19T06:14:06.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.803+0000 7fbfaf400700 1 -- 172.21.15.72:0/2543674565 learned_addr learned my addr 172.21.15.72:0/2543674565 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:06.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.803+0000 7fbfb7e00700 1 --2- 172.21.15.72:0/2543674565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb8102490 0x7fbfb8197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:06.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.804+0000 7fbfaf400700 1 -- 172.21.15.72:0/2543674565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb8102490 msgr2=0x7fbfb8197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:06.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.804+0000 7fbfaf400700 1 --2- 172.21.15.72:0/2543674565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb8102490 0x7fbfb8197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:06.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.804+0000 7fbfaf400700 1 -- 172.21.15.72:0/2543674565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa0009d00 con 0x7fbfb8103640 2024-03-19T06:14:06.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.804+0000 7fbfaf400700 1 --2- 172.21.15.72:0/2543674565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb8103640 0x7fbfb8198340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00077b0 tx=0x7fbfa0003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:06.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.804+0000 7fbfb5600700 1 -- 172.21.15.72:0/2543674565 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfa000e040 con 0x7fbfb8103640 2024-03-19T06:14:06.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.804+0000 7fbfb5600700 1 -- 172.21.15.72:0/2543674565 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbfa000ce60 con 0x7fbfb8103640 2024-03-19T06:14:06.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.804+0000 7fbfb5600700 1 -- 172.21.15.72:0/2543674565 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfa001daf0 con 0x7fbfb8103640 2024-03-19T06:14:06.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.804+0000 7fbfbee00700 1 -- 172.21.15.72:0/2543674565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb819d4f0 con 0x7fbfb8103640 2024-03-19T06:14:06.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.805+0000 7fbfbee00700 1 -- 172.21.15.72:0/2543674565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb819d9e0 con 0x7fbfb8103640 2024-03-19T06:14:06.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.806+0000 7fbfbee00700 1 -- 172.21.15.72:0/2543674565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb810b030 con 0x7fbfb8103640 2024-03-19T06:14:06.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.807+0000 7fbfb5600700 1 -- 172.21.15.72:0/2543674565 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fbfa0004250 con 0x7fbfb8103640 2024-03-19T06:14:06.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.808+0000 7fbfb5600700 1 --2- 172.21.15.72:0/2543674565 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbf9c06dfa0 0x7fbf9c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:06.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.808+0000 7fbfb5600700 1 -- 172.21.15.72:0/2543674565 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fbfa008f810 con 0x7fbfb8103640 2024-03-19T06:14:06.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.808+0000 7fbfb7e00700 1 --2- 172.21.15.72:0/2543674565 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbf9c06dfa0 0x7fbf9c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:06.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.809+0000 7fbfb7e00700 1 --2- 172.21.15.72:0/2543674565 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbf9c06dfa0 0x7fbf9c070450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8006fd0 tx=0x7fbfa8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:06.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:06.812+0000 7fbfb5600700 1 -- 172.21.15.72:0/2543674565 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fbfa005c790 con 0x7fbfb8103640 2024-03-19T06:14:06.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:06 smithi172 ceph-mon[66682]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:06.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:06 smithi172 ceph-mon[66682]: pgmap v236: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 6 op/s 2024-03-19T06:14:06.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:06 smithi172 ceph-mon[66682]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:06.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:06 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/786318279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:06.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:06 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:06.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:06 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:06.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:06 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:14:06.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:06 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1110742578' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:14:07.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.127+0000 7fbfbee00700 1 -- 172.21.15.72:0/2543674565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbfb810b220 con 0x7fbfb8103640 2024-03-19T06:14:07.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.128+0000 7fbfb5600700 1 -- 172.21.15.72:0/2543674565 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fbfa005c320 con 0x7fbfb8103640 2024-03-19T06:14:07.117 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:14:07.118 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:14:07.118 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.131+0000 7fbfbee00700 1 -- 172.21.15.72:0/2543674565 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbf9c06dfa0 msgr2=0x7fbf9c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.131+0000 7fbfbee00700 1 --2- 172.21.15.72:0/2543674565 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbf9c06dfa0 0x7fbf9c070450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8006fd0 tx=0x7fbfa8008040 comp rx=0 tx=0).stop 2024-03-19T06:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.131+0000 7fbfbee00700 1 -- 172.21.15.72:0/2543674565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb8103640 msgr2=0x7fbfb8198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.131+0000 7fbfbee00700 1 --2- 172.21.15.72:0/2543674565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb8103640 0x7fbfb8198340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00077b0 tx=0x7fbfa0003ce0 comp rx=0 tx=0).stop 2024-03-19T06:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.131+0000 7fbfbee00700 1 -- 172.21.15.72:0/2543674565 shutdown_connections 2024-03-19T06:14:07.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.131+0000 7fbfbee00700 1 --2- 172.21.15.72:0/2543674565 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbf9c06dfa0 0x7fbf9c070450 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:07.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.131+0000 7fbfbee00700 1 --2- 172.21.15.72:0/2543674565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb8102490 0x7fbfb8197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:07.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.131+0000 7fbfbee00700 1 --2- 172.21.15.72:0/2543674565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb8103640 0x7fbfb8198340 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:07.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.131+0000 7fbfbee00700 1 -- 172.21.15.72:0/2543674565 >> 172.21.15.72:0/2543674565 conn(0x7fbfb80fda60 msgr2=0x7fbfb8106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:07.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.132+0000 7fbfbee00700 1 -- 172.21.15.72:0/2543674565 shutdown_connections 2024-03-19T06:14:07.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:07.132+0000 7fbfbee00700 1 -- 172.21.15.72:0/2543674565 wait complete. 2024-03-19T06:14:07.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:07 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.72:6828/3957356790,v1:172.21.15.72:6829/3957356790] up:boot 2024-03-19T06:14:07.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:07 smithi072 ceph-mon[78545]: fsmap cephfs:1 {0=cephfs.smithi172.nparnw=up:active} 3 up:standby 2024-03-19T06:14:07.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:07 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:14:07.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:07 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:07.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:07 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:07.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:07 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2543674565' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:14:07.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:07 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.72:6828/3957356790,v1:172.21.15.72:6829/3957356790] up:boot 2024-03-19T06:14:07.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:07 smithi172 ceph-mon[66682]: fsmap cephfs:1 {0=cephfs.smithi172.nparnw=up:active} 3 up:standby 2024-03-19T06:14:07.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:07 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:14:07.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:07 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:07.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:07 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:07.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:07 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2543674565' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:14:08.804 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:08 smithi172 ceph-mon[66682]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:08.804 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:08 smithi172 ceph-mon[66682]: pgmap v237: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-03-19T06:14:08.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:08 smithi072 ceph-mon[78545]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:08.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:08 smithi072 ceph-mon[78545]: pgmap v237: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-03-19T06:14:10.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:10 smithi072 ceph-mon[78545]: pgmap v238: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-03-19T06:14:10.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:14:10.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:10 smithi172 ceph-mon[66682]: pgmap v238: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-03-19T06:14:10.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:14:12.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:12 smithi072 ceph-mon[78545]: pgmap v239: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 9.1 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-03-19T06:14:12.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:12 smithi172 ceph-mon[66682]: pgmap v239: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 9.1 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-03-19T06:14:14.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:14 smithi072 ceph-mon[78545]: pgmap v240: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-03-19T06:14:14.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:14 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:14.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:14 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:14.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:14 smithi172 ceph-mon[66682]: pgmap v240: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-03-19T06:14:14.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:14 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:14.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:14 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:16.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:16 smithi072 ceph-mon[78545]: pgmap v241: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-19T06:14:16.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:16 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:16.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:16 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:16.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:16 smithi172 ceph-mon[66682]: pgmap v241: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-19T06:14:16.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:16 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:16.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:16 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:18.764 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:18 smithi072 ceph-mon[78545]: pgmap v242: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.3 KiB/s wr, 4 op/s 2024-03-19T06:14:18.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:18 smithi172 ceph-mon[66682]: pgmap v242: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.3 KiB/s wr, 4 op/s 2024-03-19T06:14:20.760 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:20 smithi072 ceph-mon[78545]: pgmap v243: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 170 B/s wr, 0 op/s 2024-03-19T06:14:20.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:20 smithi172 ceph-mon[66682]: pgmap v243: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 255 B/s rd, 170 B/s wr, 0 op/s 2024-03-19T06:14:22.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:22 smithi072 ceph-mon[78545]: pgmap v244: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-19T06:14:22.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:22.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:22.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:14:22.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:14:22.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:22.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:14:22.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:22.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:22.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:22.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:22.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi172.xlokxp"]}]: dispatch 2024-03-19T06:14:22.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:22 smithi172 ceph-mon[66682]: pgmap v244: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-19T06:14:22.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:22.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:22.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:14:22.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:14:22.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:22.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:14:22.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:22.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:22.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:22.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:22.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi172.xlokxp"]}]: dispatch 2024-03-19T06:14:23.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:23 smithi172 ceph-mon[66682]: Upgrade: It appears safe to stop mds.cephfs.smithi172.xlokxp 2024-03-19T06:14:23.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:23 smithi072 ceph-mon[78545]: Upgrade: It appears safe to stop mds.cephfs.smithi172.xlokxp 2024-03-19T06:14:24.727 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:24 smithi072 ceph-mon[78545]: pgmap v245: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-19T06:14:24.727 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:24.727 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.xlokxp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:14:24.727 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:14:24.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:24 smithi172 ceph-mon[66682]: pgmap v245: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-19T06:14:24.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:24 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:24.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:24 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.xlokxp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:14:24.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:24 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:14:25.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:25 smithi072 ceph-mon[78545]: Upgrade: Updating mds.cephfs.smithi172.xlokxp 2024-03-19T06:14:25.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:25 smithi072 ceph-mon[78545]: Deploying daemon mds.cephfs.smithi172.xlokxp on smithi172 2024-03-19T06:14:25.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:14:25.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:25 smithi172 ceph-mon[66682]: Upgrade: Updating mds.cephfs.smithi172.xlokxp 2024-03-19T06:14:25.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:25 smithi172 ceph-mon[66682]: Deploying daemon mds.cephfs.smithi172.xlokxp on smithi172 2024-03-19T06:14:25.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:14:26.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:26 smithi072 ceph-mon[78545]: pgmap v246: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:26.897 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:26 smithi172 ceph-mon[66682]: pgmap v246: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:28.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:28 smithi072 ceph-mon[78545]: pgmap v247: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:28.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:28 smithi072 ceph-mon[78545]: osdmap e82: 6 total, 6 up, 6 in 2024-03-19T06:14:28.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:28 smithi072 ceph-mon[78545]: fsmap cephfs:1 {0=cephfs.smithi172.nparnw=up:active} 2 up:standby 2024-03-19T06:14:28.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:28 smithi172 ceph-mon[66682]: pgmap v247: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:28.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:28 smithi172 ceph-mon[66682]: osdmap e82: 6 total, 6 up, 6 in 2024-03-19T06:14:28.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:28 smithi172 ceph-mon[66682]: fsmap cephfs:1 {0=cephfs.smithi172.nparnw=up:active} 2 up:standby 2024-03-19T06:14:29.835 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:29 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:14:30.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:29 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:14:30.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:30 smithi172 ceph-mon[66682]: pgmap v249: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:31.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:30 smithi072 ceph-mon[78545]: pgmap v249: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:32.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:32 smithi072 ceph-mon[78545]: pgmap v250: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:32.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:32.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:32.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:32 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.172:6824/1022637060,v1:172.21.15.172:6825/1022637060] up:boot 2024-03-19T06:14:32.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:32 smithi072 ceph-mon[78545]: fsmap cephfs:1 {0=cephfs.smithi172.nparnw=up:active} 3 up:standby 2024-03-19T06:14:32.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:14:32.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:14:32.859 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:32 smithi172 ceph-mon[66682]: pgmap v250: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:32.860 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:32.860 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:32.860 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:32 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.172:6824/1022637060,v1:172.21.15.172:6825/1022637060] up:boot 2024-03-19T06:14:32.860 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:32 smithi172 ceph-mon[66682]: fsmap cephfs:1 {0=cephfs.smithi172.nparnw=up:active} 3 up:standby 2024-03-19T06:14:32.860 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:14:32.860 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:14:34.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:34 smithi172 ceph-mon[66682]: pgmap v251: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:34.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:34 smithi072 ceph-mon[78545]: pgmap v251: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:36.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:36 smithi172 ceph-mon[66682]: pgmap v252: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:36.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:36.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:37.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:36 smithi072 ceph-mon[78545]: pgmap v252: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:37.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:37.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:37.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.304+0000 7f2c24200700 1 -- 172.21.15.72:0/2658022109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c1c106840 msgr2=0x7f2c1c106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:37.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.304+0000 7f2c24200700 1 --2- 172.21.15.72:0/2658022109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c1c106840 0x7f2c1c106c50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009910 tx=0x7f2c10009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:37.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.304+0000 7f2c24200700 1 -- 172.21.15.72:0/2658022109 shutdown_connections 2024-03-19T06:14:37.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.304+0000 7f2c24200700 1 --2- 172.21.15.72:0/2658022109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1c107a40 0x7f2c1c107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.304+0000 7f2c24200700 1 --2- 172.21.15.72:0/2658022109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c1c106840 0x7f2c1c106c50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.304+0000 7f2c24200700 1 -- 172.21.15.72:0/2658022109 >> 172.21.15.72:0/2658022109 conn(0x7f2c1c075970 msgr2=0x7f2c1c077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:37.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.305+0000 7f2c24200700 1 -- 172.21.15.72:0/2658022109 shutdown_connections 2024-03-19T06:14:37.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.305+0000 7f2c24200700 1 -- 172.21.15.72:0/2658022109 wait complete. 2024-03-19T06:14:37.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.306+0000 7f2c24200700 1 Processor -- start 2024-03-19T06:14:37.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.306+0000 7f2c24200700 1 -- start start 2024-03-19T06:14:37.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.306+0000 7f2c24200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c1c106840 0x7f2c1c19c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:37.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.306+0000 7f2c24200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1c107a40 0x7f2c1c19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:37.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.306+0000 7f2c24200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c19cc60 con 0x7f2c1c106840 2024-03-19T06:14:37.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.306+0000 7f2c24200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c19cda0 con 0x7f2c1c107a40 2024-03-19T06:14:37.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.306+0000 7f2c21800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c1c106840 0x7f2c1c19c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:37.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.306+0000 7f2c21800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c1c106840 0x7f2c1c19c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38754/0 (socket says 172.21.15.72:38754) 2024-03-19T06:14:37.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.306+0000 7f2c21800700 1 -- 172.21.15.72:0/1205288271 learned_addr learned my addr 172.21.15.72:0/1205288271 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:37.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.307+0000 7f2c20e00700 1 --2- 172.21.15.72:0/1205288271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1c107a40 0x7f2c1c19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:37.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.307+0000 7f2c21800700 1 -- 172.21.15.72:0/1205288271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1c107a40 msgr2=0x7f2c1c19c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:37.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.307+0000 7f2c21800700 1 --2- 172.21.15.72:0/1205288271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1c107a40 0x7f2c1c19c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.307+0000 7f2c21800700 1 -- 172.21.15.72:0/1205288271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100095f0 con 0x7f2c1c106840 2024-03-19T06:14:37.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.307+0000 7f2c21800700 1 --2- 172.21.15.72:0/1205288271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c1c106840 0x7f2c1c19c100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000bd70 tx=0x7f2c1000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:37.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.308+0000 7f2c1a000700 1 -- 172.21.15.72:0/1205288271 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c1001d070 con 0x7f2c1c106840 2024-03-19T06:14:37.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.308+0000 7f2c24200700 1 -- 172.21.15.72:0/1205288271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1c1a17f0 con 0x7f2c1c106840 2024-03-19T06:14:37.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.308+0000 7f2c1a000700 1 -- 172.21.15.72:0/1205288271 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2c10005dc0 con 0x7f2c1c106840 2024-03-19T06:14:37.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.308+0000 7f2c1a000700 1 -- 172.21.15.72:0/1205288271 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c10021410 con 0x7f2c1c106840 2024-03-19T06:14:37.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.308+0000 7f2c24200700 1 -- 172.21.15.72:0/1205288271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c1a1ce0 con 0x7f2c1c106840 2024-03-19T06:14:37.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.309+0000 7f2c24200700 1 -- 172.21.15.72:0/1205288271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1c10f390 con 0x7f2c1c106840 2024-03-19T06:14:37.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.310+0000 7f2c1a000700 1 -- 172.21.15.72:0/1205288271 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f2c1000f7f0 con 0x7f2c1c106840 2024-03-19T06:14:37.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.311+0000 7f2c1a000700 1 --2- 172.21.15.72:0/1205288271 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2c0406dfa0 0x7f2c04070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:37.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.311+0000 7f2c1a000700 1 -- 172.21.15.72:0/1205288271 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f2c1008f0a0 con 0x7f2c1c106840 2024-03-19T06:14:37.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.311+0000 7f2c20e00700 1 --2- 172.21.15.72:0/1205288271 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2c0406dfa0 0x7f2c04070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:37.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.312+0000 7f2c20e00700 1 --2- 172.21.15.72:0/1205288271 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2c0406dfa0 0x7f2c04070450 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2c08005950 tx=0x7f2c0800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:37.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.316+0000 7f2c1a000700 1 -- 172.21.15.72:0/1205288271 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f2c1005bfa0 con 0x7f2c1c106840 2024-03-19T06:14:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.554+0000 7f2c24200700 1 -- 172.21.15.72:0/1205288271 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c1c1a23e0 con 0x7f2c0406dfa0 2024-03-19T06:14:37.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.556+0000 7f2c1a000700 1 -- 172.21.15.72:0/1205288271 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2c1c1a23e0 con 0x7f2c0406dfa0 2024-03-19T06:14:37.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.559+0000 7f2c24200700 1 -- 172.21.15.72:0/1205288271 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2c0406dfa0 msgr2=0x7f2c04070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:37.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.559+0000 7f2c24200700 1 --2- 172.21.15.72:0/1205288271 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2c0406dfa0 0x7f2c04070450 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2c08005950 tx=0x7f2c0800b410 comp rx=0 tx=0).stop 2024-03-19T06:14:37.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.559+0000 7f2c24200700 1 -- 172.21.15.72:0/1205288271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c1c106840 msgr2=0x7f2c1c19c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:37.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.559+0000 7f2c24200700 1 --2- 172.21.15.72:0/1205288271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c1c106840 0x7f2c1c19c100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000bd70 tx=0x7f2c1000bda0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.559+0000 7f2c24200700 1 -- 172.21.15.72:0/1205288271 shutdown_connections 2024-03-19T06:14:37.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.559+0000 7f2c24200700 1 --2- 172.21.15.72:0/1205288271 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2c0406dfa0 0x7f2c04070450 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.559+0000 7f2c24200700 1 --2- 172.21.15.72:0/1205288271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c1c106840 0x7f2c1c19c100 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.559+0000 7f2c24200700 1 --2- 172.21.15.72:0/1205288271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1c107a40 0x7f2c1c19c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.559+0000 7f2c24200700 1 -- 172.21.15.72:0/1205288271 >> 172.21.15.72:0/1205288271 conn(0x7f2c1c075970 msgr2=0x7f2c1c10ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:37.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.559+0000 7f2c24200700 1 -- 172.21.15.72:0/1205288271 shutdown_connections 2024-03-19T06:14:37.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.559+0000 7f2c24200700 1 -- 172.21.15.72:0/1205288271 wait complete. 2024-03-19T06:14:37.563 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:14:37.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.704+0000 7fdd4ea00700 1 -- 172.21.15.72:0/410748355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd48103480 msgr2=0x7fdd481038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:37.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.704+0000 7fdd4ea00700 1 --2- 172.21.15.72:0/410748355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd48103480 0x7fdd481038d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009910 tx=0x7fdd34009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:37.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.704+0000 7fdd4ea00700 1 -- 172.21.15.72:0/410748355 shutdown_connections 2024-03-19T06:14:37.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.704+0000 7fdd4ea00700 1 --2- 172.21.15.72:0/410748355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd48103480 0x7fdd481038d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.704+0000 7fdd4ea00700 1 --2- 172.21.15.72:0/410748355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48102280 0x7fdd48102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.704+0000 7fdd4ea00700 1 -- 172.21.15.72:0/410748355 >> 172.21.15.72:0/410748355 conn(0x7fdd480fd8d0 msgr2=0x7fdd480ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:37.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.704+0000 7fdd4ea00700 1 -- 172.21.15.72:0/410748355 shutdown_connections 2024-03-19T06:14:37.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.704+0000 7fdd4ea00700 1 -- 172.21.15.72:0/410748355 wait complete. 2024-03-19T06:14:37.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.705+0000 7fdd4ea00700 1 Processor -- start 2024-03-19T06:14:37.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.706+0000 7fdd4ea00700 1 -- start start 2024-03-19T06:14:37.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.706+0000 7fdd4ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd48102280 0x7fdd48197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:37.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.706+0000 7fdd4ea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48103480 0x7fdd48198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:37.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.706+0000 7fdd4ea00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd48198650 con 0x7fdd48102280 2024-03-19T06:14:37.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.706+0000 7fdd4ea00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd48198790 con 0x7fdd48103480 2024-03-19T06:14:37.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.706+0000 7fdd4d600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd48102280 0x7fdd48197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:37.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.706+0000 7fdd4d600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd48102280 0x7fdd48197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38778/0 (socket says 172.21.15.72:38778) 2024-03-19T06:14:37.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.706+0000 7fdd4d600700 1 -- 172.21.15.72:0/1309201053 learned_addr learned my addr 172.21.15.72:0/1309201053 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:37.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.707+0000 7fdd4cc00700 1 --2- 172.21.15.72:0/1309201053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48103480 0x7fdd48198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:37.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.707+0000 7fdd4d600700 1 -- 172.21.15.72:0/1309201053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48103480 msgr2=0x7fdd48198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:37.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.707+0000 7fdd4d600700 1 --2- 172.21.15.72:0/1309201053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48103480 0x7fdd48198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.707+0000 7fdd4d600700 1 -- 172.21.15.72:0/1309201053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd340095f0 con 0x7fdd48102280 2024-03-19T06:14:37.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.707+0000 7fdd4d600700 1 --2- 172.21.15.72:0/1309201053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd48102280 0x7fdd48197af0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00b480 tx=0x7fdd3c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:37.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.707+0000 7fdd46000700 1 -- 172.21.15.72:0/1309201053 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd3c0118c0 con 0x7fdd48102280 2024-03-19T06:14:37.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.707+0000 7fdd46000700 1 -- 172.21.15.72:0/1309201053 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdd3c010380 con 0x7fdd48102280 2024-03-19T06:14:37.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.707+0000 7fdd4ea00700 1 -- 172.21.15.72:0/1309201053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4819d240 con 0x7fdd48102280 2024-03-19T06:14:37.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.707+0000 7fdd46000700 1 -- 172.21.15.72:0/1309201053 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd3c00f4f0 con 0x7fdd48102280 2024-03-19T06:14:37.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.707+0000 7fdd4ea00700 1 -- 172.21.15.72:0/1309201053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4819d810 con 0x7fdd48102280 2024-03-19T06:14:37.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.709+0000 7fdd4ea00700 1 -- 172.21.15.72:0/1309201053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4810ae70 con 0x7fdd48102280 2024-03-19T06:14:37.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.710+0000 7fdd46000700 1 -- 172.21.15.72:0/1309201053 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fdd3c0104f0 con 0x7fdd48102280 2024-03-19T06:14:37.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.711+0000 7fdd46000700 1 --2- 172.21.15.72:0/1309201053 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fdd3006dfa0 0x7fdd30070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:37.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.711+0000 7fdd46000700 1 -- 172.21.15.72:0/1309201053 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fdd3c08da40 con 0x7fdd48102280 2024-03-19T06:14:37.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.711+0000 7fdd4cc00700 1 --2- 172.21.15.72:0/1309201053 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fdd3006dfa0 0x7fdd30070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:37.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.712+0000 7fdd4cc00700 1 --2- 172.21.15.72:0/1309201053 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fdd3006dfa0 0x7fdd30070450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd34006010 tx=0x7fdd3400b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:37.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.716+0000 7fdd46000700 1 -- 172.21.15.72:0/1309201053 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fdd3c05a940 con 0x7fdd48102280 2024-03-19T06:14:37.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.942+0000 7fdd4ea00700 1 -- 172.21.15.72:0/1309201053 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd48107dd0 con 0x7fdd3006dfa0 2024-03-19T06:14:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.944+0000 7fdd46000700 1 -- 172.21.15.72:0/1309201053 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdd48107dd0 con 0x7fdd3006dfa0 2024-03-19T06:14:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.946+0000 7fdd4ea00700 1 -- 172.21.15.72:0/1309201053 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fdd3006dfa0 msgr2=0x7fdd30070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.946+0000 7fdd4ea00700 1 --2- 172.21.15.72:0/1309201053 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fdd3006dfa0 0x7fdd30070450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd34006010 tx=0x7fdd3400b580 comp rx=0 tx=0).stop 2024-03-19T06:14:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.946+0000 7fdd4ea00700 1 -- 172.21.15.72:0/1309201053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd48102280 msgr2=0x7fdd48197af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.946+0000 7fdd4ea00700 1 --2- 172.21.15.72:0/1309201053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd48102280 0x7fdd48197af0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00b480 tx=0x7fdd3c00b840 comp rx=0 tx=0).stop 2024-03-19T06:14:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.947+0000 7fdd4ea00700 1 -- 172.21.15.72:0/1309201053 shutdown_connections 2024-03-19T06:14:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.947+0000 7fdd4ea00700 1 --2- 172.21.15.72:0/1309201053 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fdd3006dfa0 0x7fdd30070450 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.947+0000 7fdd4ea00700 1 --2- 172.21.15.72:0/1309201053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd48102280 0x7fdd48197af0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.947+0000 7fdd4ea00700 1 --2- 172.21.15.72:0/1309201053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48103480 0x7fdd48198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.947+0000 7fdd4ea00700 1 -- 172.21.15.72:0/1309201053 >> 172.21.15.72:0/1309201053 conn(0x7fdd480fd8d0 msgr2=0x7fdd481066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.947+0000 7fdd4ea00700 1 -- 172.21.15.72:0/1309201053 shutdown_connections 2024-03-19T06:14:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:37.947+0000 7fdd4ea00700 1 -- 172.21.15.72:0/1309201053 wait complete. 2024-03-19T06:14:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.105+0000 7f6b11600700 1 -- 172.21.15.72:0/1857964547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b0c1003d0 msgr2=0x7f6b0c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.105+0000 7f6b11600700 1 --2- 172.21.15.72:0/1857964547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b0c1003d0 0x7f6b0c100840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009910 tx=0x7f6af8009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.105+0000 7f6b11600700 1 -- 172.21.15.72:0/1857964547 shutdown_connections 2024-03-19T06:14:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.105+0000 7f6b11600700 1 --2- 172.21.15.72:0/1857964547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b0c1003d0 0x7f6b0c100840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.105+0000 7f6b11600700 1 --2- 172.21.15.72:0/1857964547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b0c0ff130 0x7f6b0c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.105+0000 7f6b11600700 1 -- 172.21.15.72:0/1857964547 >> 172.21.15.72:0/1857964547 conn(0x7f6b0c0fa780 msgr2=0x7f6b0c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.105+0000 7f6b11600700 1 -- 172.21.15.72:0/1857964547 shutdown_connections 2024-03-19T06:14:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.105+0000 7f6b11600700 1 -- 172.21.15.72:0/1857964547 wait complete. 2024-03-19T06:14:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.106+0000 7f6b11600700 1 Processor -- start 2024-03-19T06:14:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.106+0000 7f6b11600700 1 -- start start 2024-03-19T06:14:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.106+0000 7f6b11600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b0c0ff130 0x7f6b0c103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.106+0000 7f6b11600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b0c1003d0 0x7f6b0c1017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.106+0000 7f6b11600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c101cf0 con 0x7f6b0c1003d0 2024-03-19T06:14:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.106+0000 7f6b11600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c101e30 con 0x7f6b0c0ff130 2024-03-19T06:14:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.107+0000 7f6b0a000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b0c1003d0 0x7f6b0c1017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.107+0000 7f6b0a000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b0c1003d0 0x7f6b0c1017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38804/0 (socket says 172.21.15.72:38804) 2024-03-19T06:14:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.107+0000 7f6b0a000700 1 -- 172.21.15.72:0/2264527586 learned_addr learned my addr 172.21.15.72:0/2264527586 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:38.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.107+0000 7f6b0aa00700 1 --2- 172.21.15.72:0/2264527586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b0c0ff130 0x7f6b0c103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:38.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.107+0000 7f6b0a000700 1 -- 172.21.15.72:0/2264527586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b0c0ff130 msgr2=0x7f6b0c103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:38.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.107+0000 7f6b0a000700 1 --2- 172.21.15.72:0/2264527586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b0c0ff130 0x7f6b0c103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.107+0000 7f6b0a000700 1 -- 172.21.15.72:0/2264527586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af80095f0 con 0x7f6b0c1003d0 2024-03-19T06:14:38.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.108+0000 7f6b0a000700 1 --2- 172.21.15.72:0/2264527586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b0c1003d0 0x7f6b0c1017b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6af800bd70 tx=0x7f6af800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:38.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.108+0000 7f6b03400700 1 -- 172.21.15.72:0/2264527586 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6af801d070 con 0x7f6b0c1003d0 2024-03-19T06:14:38.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.108+0000 7f6b03400700 1 -- 172.21.15.72:0/2264527586 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6af8005dc0 con 0x7f6b0c1003d0 2024-03-19T06:14:38.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.108+0000 7f6b03400700 1 -- 172.21.15.72:0/2264527586 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6af8021410 con 0x7f6b0c1003d0 2024-03-19T06:14:38.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.108+0000 7f6b11600700 1 -- 172.21.15.72:0/2264527586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0c1020b0 con 0x7f6b0c1003d0 2024-03-19T06:14:38.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.108+0000 7f6b11600700 1 -- 172.21.15.72:0/2264527586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0c1025a0 con 0x7f6b0c1003d0 2024-03-19T06:14:38.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.110+0000 7f6b11600700 1 -- 172.21.15.72:0/2264527586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0c107c30 con 0x7f6b0c1003d0 2024-03-19T06:14:38.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.110+0000 7f6b03400700 1 -- 172.21.15.72:0/2264527586 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f6af800f7d0 con 0x7f6b0c1003d0 2024-03-19T06:14:38.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.111+0000 7f6b03400700 1 --2- 172.21.15.72:0/2264527586 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6af006dfa0 0x7f6af0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:38.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.111+0000 7f6b03400700 1 -- 172.21.15.72:0/2264527586 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6af808f050 con 0x7f6b0c1003d0 2024-03-19T06:14:38.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.112+0000 7f6b0aa00700 1 --2- 172.21.15.72:0/2264527586 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6af006dfa0 0x7f6af0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:38.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.112+0000 7f6b0aa00700 1 --2- 172.21.15.72:0/2264527586 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6af006dfa0 0x7f6af0070450 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6afc004630 tx=0x7f6afc00b3c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.116+0000 7f6b03400700 1 -- 172.21.15.72:0/2264527586 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f6af805bff0 con 0x7f6b0c1003d0 2024-03-19T06:14:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.350+0000 7f6b11600700 1 -- 172.21.15.72:0/2264527586 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b0c19df20 con 0x7f6af006dfa0 2024-03-19T06:14:38.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.365+0000 7f6b03400700 1 -- 172.21.15.72:0/2264527586 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f6b0c19df20 con 0x7f6af006dfa0 2024-03-19T06:14:38.355 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:14:38.355 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (19m) 24s ago 21m 14.3M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:14:38.355 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (21m) 24s ago 21m 9345k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:14:38.355 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (19m) 2s ago 19m 9210k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (5m) 24s ago 21m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (5m) 2s ago 19m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (18m) 24s ago 20m 74.1M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (32s) 24s ago 13m 10.8M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 3ea4b00e2248 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (64s) 24s ago 13m 12.0M - 19.0.0-1934-gb0ea271b 5c4d8774b57a d0daead2fe2a 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (13m) 2s ago 13m 67.9M - 18.2.0 dc2bc1663786 8807989ecf61 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (7s) 2s ago 13m 10.9M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 2cbfb6aeff05 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (9m) 24s ago 22m 508M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (8m) 2s ago 19m 452M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (7m) 24s ago 23m 57.6M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (6m) 2s ago 19m 42.4M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (21m) 24s ago 21m 8250k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (19m) 2s ago 19m 8392k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:14:38.356 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (5m) 24s ago 18m 98.4M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:14:38.357 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (4m) 24s ago 17m 101M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:14:38.357 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (4m) 24s ago 17m 91.8M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:14:38.357 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (3m) 2s ago 16m 105M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:14:38.357 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (2m) 2s ago 16m 97.1M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:14:38.357 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (2m) 2s ago 15m 89.8M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a c47c9c7fd3c7 2024-03-19T06:14:38.357 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (8m) 24s ago 20m 70.3M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:14:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.368+0000 7f6b11600700 1 -- 172.21.15.72:0/2264527586 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6af006dfa0 msgr2=0x7f6af0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.368+0000 7f6b11600700 1 --2- 172.21.15.72:0/2264527586 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6af006dfa0 0x7f6af0070450 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6afc004630 tx=0x7f6afc00b3c0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.368+0000 7f6b11600700 1 -- 172.21.15.72:0/2264527586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b0c1003d0 msgr2=0x7f6b0c1017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:38.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.368+0000 7f6b11600700 1 --2- 172.21.15.72:0/2264527586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b0c1003d0 0x7f6b0c1017b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6af800bd70 tx=0x7f6af800bda0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.368+0000 7f6b11600700 1 -- 172.21.15.72:0/2264527586 shutdown_connections 2024-03-19T06:14:38.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.368+0000 7f6b11600700 1 --2- 172.21.15.72:0/2264527586 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6af006dfa0 0x7f6af0070450 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.368+0000 7f6b11600700 1 --2- 172.21.15.72:0/2264527586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b0c0ff130 0x7f6b0c103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.368+0000 7f6b11600700 1 --2- 172.21.15.72:0/2264527586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b0c1003d0 0x7f6b0c1017b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.368+0000 7f6b11600700 1 -- 172.21.15.72:0/2264527586 >> 172.21.15.72:0/2264527586 conn(0x7f6b0c0fa780 msgr2=0x7f6b0c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:38.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.369+0000 7f6b11600700 1 -- 172.21.15.72:0/2264527586 shutdown_connections 2024-03-19T06:14:38.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.369+0000 7f6b11600700 1 -- 172.21.15.72:0/2264527586 wait complete. 2024-03-19T06:14:38.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.527+0000 7fd6f1000700 1 -- 172.21.15.72:0/2749967728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6ec102440 msgr2=0x7fd6ec102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:38.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.527+0000 7fd6f1000700 1 --2- 172.21.15.72:0/2749967728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6ec102440 0x7fd6ec102850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009910 tx=0x7fd6dc009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:38.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.527+0000 7fd6f1000700 1 -- 172.21.15.72:0/2749967728 shutdown_connections 2024-03-19T06:14:38.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.527+0000 7fd6f1000700 1 --2- 172.21.15.72:0/2749967728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6ec103640 0x7fd6ec103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.527+0000 7fd6f1000700 1 --2- 172.21.15.72:0/2749967728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6ec102440 0x7fd6ec102850 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.527+0000 7fd6f1000700 1 -- 172.21.15.72:0/2749967728 >> 172.21.15.72:0/2749967728 conn(0x7fd6ec0fd9f0 msgr2=0x7fd6ec0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:38.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.527+0000 7fd6f1000700 1 -- 172.21.15.72:0/2749967728 shutdown_connections 2024-03-19T06:14:38.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.527+0000 7fd6f1000700 1 -- 172.21.15.72:0/2749967728 wait complete. 2024-03-19T06:14:38.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.528+0000 7fd6f1000700 1 Processor -- start 2024-03-19T06:14:38.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.528+0000 7fd6f1000700 1 -- start start 2024-03-19T06:14:38.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.528+0000 7fd6f1000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6ec102440 0x7fd6ec197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:38.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.528+0000 7fd6f1000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6ec103640 0x7fd6ec198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:38.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.529+0000 7fd6f1000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec198850 con 0x7fd6ec102440 2024-03-19T06:14:38.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.529+0000 7fd6f1000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec19d260 con 0x7fd6ec103640 2024-03-19T06:14:38.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.529+0000 7fd6e9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6ec102440 0x7fd6ec197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:38.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.529+0000 7fd6e9e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6ec102440 0x7fd6ec197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38814/0 (socket says 172.21.15.72:38814) 2024-03-19T06:14:38.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.529+0000 7fd6e9e00700 1 -- 172.21.15.72:0/3500769553 learned_addr learned my addr 172.21.15.72:0/3500769553 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:38.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.529+0000 7fd6e9e00700 1 -- 172.21.15.72:0/3500769553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6ec103640 msgr2=0x7fd6ec198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:38.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.529+0000 7fd6e9e00700 1 --2- 172.21.15.72:0/3500769553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6ec103640 0x7fd6ec198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.529+0000 7fd6e9e00700 1 -- 172.21.15.72:0/3500769553 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0095f0 con 0x7fd6ec102440 2024-03-19T06:14:38.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.530+0000 7fd6e9e00700 1 --2- 172.21.15.72:0/3500769553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6ec102440 0x7fd6ec197cf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00bd70 tx=0x7fd6dc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:38.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.530+0000 7fd6e2a00700 1 -- 172.21.15.72:0/3500769553 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6dc01d070 con 0x7fd6ec102440 2024-03-19T06:14:38.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.530+0000 7fd6e2a00700 1 -- 172.21.15.72:0/3500769553 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd6dc00f460 con 0x7fd6ec102440 2024-03-19T06:14:38.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.530+0000 7fd6f1000700 1 -- 172.21.15.72:0/3500769553 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec19d400 con 0x7fd6ec102440 2024-03-19T06:14:38.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.530+0000 7fd6e2a00700 1 -- 172.21.15.72:0/3500769553 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6dc021640 con 0x7fd6ec102440 2024-03-19T06:14:38.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.530+0000 7fd6f1000700 1 -- 172.21.15.72:0/3500769553 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec19d8c0 con 0x7fd6ec102440 2024-03-19T06:14:38.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.531+0000 7fd6f1000700 1 -- 172.21.15.72:0/3500769553 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec10af90 con 0x7fd6ec102440 2024-03-19T06:14:38.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.532+0000 7fd6e2a00700 1 -- 172.21.15.72:0/3500769553 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fd6dc00fab0 con 0x7fd6ec102440 2024-03-19T06:14:38.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.533+0000 7fd6e2a00700 1 --2- 172.21.15.72:0/3500769553 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd6d006dfa0 0x7fd6d0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:38.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.533+0000 7fd6e2a00700 1 -- 172.21.15.72:0/3500769553 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd6dc08f260 con 0x7fd6ec102440 2024-03-19T06:14:38.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.533+0000 7fd6e9400700 1 --2- 172.21.15.72:0/3500769553 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd6d006dfa0 0x7fd6d0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:38.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.534+0000 7fd6e9400700 1 --2- 172.21.15.72:0/3500769553 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd6d006dfa0 0x7fd6d0070450 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800a990 tx=0x7fd6d8005c80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:38.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.538+0000 7fd6e2a00700 1 -- 172.21.15.72:0/3500769553 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fd6dc058630 con 0x7fd6ec102440 2024-03-19T06:14:38.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:38 smithi072 ceph-mon[78545]: pgmap v253: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:38.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:38 smithi072 ceph-mon[78545]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:38.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:38 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:38.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:38 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:38.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.856+0000 7fd6f1000700 1 -- 172.21.15.72:0/3500769553 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd6ec19ded0 con 0x7fd6ec102440 2024-03-19T06:14:38.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.857+0000 7fd6e2a00700 1 -- 172.21.15.72:0/3500769553 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7fd6dc05bcf0 con 0x7fd6ec102440 2024-03-19T06:14:38.847 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:14:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:14:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:14:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:14:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:14:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:14:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:14:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:14:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 6 2024-03-19T06:14:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:14:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:14:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-03-19T06:14:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 3 2024-03-19T06:14:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:14:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:14:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-03-19T06:14:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 13 2024-03-19T06:14:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:14:38.848 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:14:38.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.861+0000 7fd6f1000700 1 -- 172.21.15.72:0/3500769553 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd6d006dfa0 msgr2=0x7fd6d0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:38.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.861+0000 7fd6f1000700 1 --2- 172.21.15.72:0/3500769553 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd6d006dfa0 0x7fd6d0070450 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800a990 tx=0x7fd6d8005c80 comp rx=0 tx=0).stop 2024-03-19T06:14:38.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.861+0000 7fd6f1000700 1 -- 172.21.15.72:0/3500769553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6ec102440 msgr2=0x7fd6ec197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:38.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.861+0000 7fd6f1000700 1 --2- 172.21.15.72:0/3500769553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6ec102440 0x7fd6ec197cf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00bd70 tx=0x7fd6dc00be50 comp rx=0 tx=0).stop 2024-03-19T06:14:38.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.861+0000 7fd6f1000700 1 -- 172.21.15.72:0/3500769553 shutdown_connections 2024-03-19T06:14:38.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.861+0000 7fd6f1000700 1 --2- 172.21.15.72:0/3500769553 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd6d006dfa0 0x7fd6d0070450 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.861+0000 7fd6f1000700 1 --2- 172.21.15.72:0/3500769553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6ec102440 0x7fd6ec197cf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.861+0000 7fd6f1000700 1 --2- 172.21.15.72:0/3500769553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6ec103640 0x7fd6ec198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:38.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.861+0000 7fd6f1000700 1 -- 172.21.15.72:0/3500769553 >> 172.21.15.72:0/3500769553 conn(0x7fd6ec0fd9f0 msgr2=0x7fd6ec106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:38.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.861+0000 7fd6f1000700 1 -- 172.21.15.72:0/3500769553 shutdown_connections 2024-03-19T06:14:38.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:38.861+0000 7fd6f1000700 1 -- 172.21.15.72:0/3500769553 wait complete. 2024-03-19T06:14:38.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:38 smithi172 ceph-mon[66682]: pgmap v253: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:38.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:38 smithi172 ceph-mon[66682]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:38.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:38 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:38.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:38 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.024+0000 7f6dee400700 1 -- 172.21.15.72:0/1240669222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8100ce0 msgr2=0x7f6de81030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.024+0000 7f6dee400700 1 --2- 172.21.15.72:0/1240669222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8100ce0 0x7f6de81030c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009910 tx=0x7f6dd8009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.024+0000 7f6dee400700 1 -- 172.21.15.72:0/1240669222 shutdown_connections 2024-03-19T06:14:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.024+0000 7f6dee400700 1 --2- 172.21.15.72:0/1240669222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de8103600 0x7f6de81059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.024+0000 7f6dee400700 1 --2- 172.21.15.72:0/1240669222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8100ce0 0x7f6de81030c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.024+0000 7f6dee400700 1 -- 172.21.15.72:0/1240669222 >> 172.21.15.72:0/1240669222 conn(0x7f6de80fa700 msgr2=0x7f6de80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.024+0000 7f6dee400700 1 -- 172.21.15.72:0/1240669222 shutdown_connections 2024-03-19T06:14:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.024+0000 7f6dee400700 1 -- 172.21.15.72:0/1240669222 wait complete. 2024-03-19T06:14:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.025+0000 7f6dee400700 1 Processor -- start 2024-03-19T06:14:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.026+0000 7f6dee400700 1 -- start start 2024-03-19T06:14:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.026+0000 7f6dee400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de8100ce0 0x7f6de8100640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.026+0000 7f6dee400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8103600 0x7f6de80fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.026+0000 7f6dee400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80ff1d0 con 0x7f6de8103600 2024-03-19T06:14:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.026+0000 7f6dee400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80ff310 con 0x7f6de8100ce0 2024-03-19T06:14:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.026+0000 7f6de6a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8103600 0x7f6de80fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.026+0000 7f6de6a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8103600 0x7f6de80fec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38828/0 (socket says 172.21.15.72:38828) 2024-03-19T06:14:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.026+0000 7f6de6a00700 1 -- 172.21.15.72:0/4112673131 learned_addr learned my addr 172.21.15.72:0/4112673131 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.027+0000 7f6de7400700 1 --2- 172.21.15.72:0/4112673131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de8100ce0 0x7f6de8100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:39.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.027+0000 7f6de6a00700 1 -- 172.21.15.72:0/4112673131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de8100ce0 msgr2=0x7f6de8100640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:39.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.027+0000 7f6de6a00700 1 --2- 172.21.15.72:0/4112673131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de8100ce0 0x7f6de8100640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.027+0000 7f6de6a00700 1 -- 172.21.15.72:0/4112673131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80095f0 con 0x7f6de8103600 2024-03-19T06:14:39.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.027+0000 7f6de6a00700 1 --2- 172.21.15.72:0/4112673131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8103600 0x7f6de80fec90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400b4b0 tx=0x7f6dd400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:39.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.027+0000 7f6ddfe00700 1 -- 172.21.15.72:0/4112673131 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dd4011800 con 0x7f6de8103600 2024-03-19T06:14:39.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.028+0000 7f6ddfe00700 1 -- 172.21.15.72:0/4112673131 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6dd4011e10 con 0x7f6de8103600 2024-03-19T06:14:39.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.028+0000 7f6ddfe00700 1 -- 172.21.15.72:0/4112673131 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dd400f2e0 con 0x7f6de8103600 2024-03-19T06:14:39.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.028+0000 7f6dee400700 1 -- 172.21.15.72:0/4112673131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de80ff5f0 con 0x7f6de8103600 2024-03-19T06:14:39.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.028+0000 7f6dee400700 1 -- 172.21.15.72:0/4112673131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de819db30 con 0x7f6de8103600 2024-03-19T06:14:39.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.029+0000 7f6dee400700 1 -- 172.21.15.72:0/4112673131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de818fcf0 con 0x7f6de8103600 2024-03-19T06:14:39.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.030+0000 7f6ddfe00700 1 -- 172.21.15.72:0/4112673131 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f6dd4010380 con 0x7f6de8103600 2024-03-19T06:14:39.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.031+0000 7f6ddfe00700 1 --2- 172.21.15.72:0/4112673131 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6dcc06dfa0 0x7f6dcc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:39.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.031+0000 7f6ddfe00700 1 -- 172.21.15.72:0/4112673131 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f6dd408d9c0 con 0x7f6de8103600 2024-03-19T06:14:39.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.031+0000 7f6de7400700 1 --2- 172.21.15.72:0/4112673131 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6dcc06dfa0 0x7f6dcc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:39.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.032+0000 7f6de7400700 1 --2- 172.21.15.72:0/4112673131 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6dcc06dfa0 0x7f6dcc070450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8006010 tx=0x7f6dd800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.036+0000 7f6ddfe00700 1 -- 172.21.15.72:0/4112673131 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f6dd405a940 con 0x7f6de8103600 2024-03-19T06:14:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.305+0000 7f6dee400700 1 -- 172.21.15.72:0/4112673131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6de802cc30 con 0x7f6de8103600 2024-03-19T06:14:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.306+0000 7f6ddfe00700 1 -- 172.21.15.72:0/4112673131 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1850 (secure 0 0 0) 0x7f6dd405a4d0 con 0x7f6de8103600 2024-03-19T06:14:39.297 INFO:teuthology.orchestra.run.smithi072.stdout:e36 2024-03-19T06:14:39.297 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:14:39.297 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:14:39.297 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:14:39.297 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:14:39.297 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:14:39.297 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:14:39.297 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 33 2024-03-19T06:14:39.297 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:14:39.297 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:14:02.532092+0000 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 81 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 1 2024-03-19T06:14:39.298 INFO:teuthology.orchestra.run.smithi072.stdout:in 0 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=24237} 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 1 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{0:24237} state up:active seq 196 join_fscid=1 addr [v2:172.21.15.172:6826/363477076,v1:172.21.15.172:6827/363477076] compat {c=[1],r=[1],i=[7ff]}] 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:14:39.299 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:14:39.300 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{-1:34488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:14:39.300 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{-1:34510} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.72:6828/3957356790,v1:172.21.15.72:6829/3957356790] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:14:39.300 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/1022637060,v1:172.21.15.172:6825/1022637060] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:14:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.311+0000 7f6dee400700 1 -- 172.21.15.72:0/4112673131 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6dcc06dfa0 msgr2=0x7f6dcc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.311+0000 7f6dee400700 1 --2- 172.21.15.72:0/4112673131 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6dcc06dfa0 0x7f6dcc070450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8006010 tx=0x7f6dd800b540 comp rx=0 tx=0).stop 2024-03-19T06:14:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.311+0000 7f6dee400700 1 -- 172.21.15.72:0/4112673131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8103600 msgr2=0x7f6de80fec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.311+0000 7f6dee400700 1 --2- 172.21.15.72:0/4112673131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8103600 0x7f6de80fec90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400b4b0 tx=0x7f6dd400b870 comp rx=0 tx=0).stop 2024-03-19T06:14:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.311+0000 7f6dee400700 1 -- 172.21.15.72:0/4112673131 shutdown_connections 2024-03-19T06:14:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.311+0000 7f6dee400700 1 --2- 172.21.15.72:0/4112673131 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6dcc06dfa0 0x7f6dcc070450 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.311+0000 7f6dee400700 1 --2- 172.21.15.72:0/4112673131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de8100ce0 0x7f6de8100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.311+0000 7f6dee400700 1 --2- 172.21.15.72:0/4112673131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8103600 0x7f6de80fec90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.311+0000 7f6dee400700 1 -- 172.21.15.72:0/4112673131 >> 172.21.15.72:0/4112673131 conn(0x7f6de80fa700 msgr2=0x7f6de80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.311+0000 7f6dee400700 1 -- 172.21.15.72:0/4112673131 shutdown_connections 2024-03-19T06:14:39.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.311+0000 7f6dee400700 1 -- 172.21.15.72:0/4112673131 wait complete. 2024-03-19T06:14:39.302 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 36 2024-03-19T06:14:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.467+0000 7f17b8800700 1 -- 172.21.15.72:0/597922888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b00ff4a0 msgr2=0x7f17b00ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.467+0000 7f17b8800700 1 --2- 172.21.15.72:0/597922888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b00ff4a0 0x7f17b00ff910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009910 tx=0x7f17a0009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.467+0000 7f17b8800700 1 -- 172.21.15.72:0/597922888 shutdown_connections 2024-03-19T06:14:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.467+0000 7f17b8800700 1 --2- 172.21.15.72:0/597922888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b00ff4a0 0x7f17b00ff910 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.467+0000 7f17b8800700 1 --2- 172.21.15.72:0/597922888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b00feb50 0x7f17b00fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.467+0000 7f17b8800700 1 -- 172.21.15.72:0/597922888 >> 172.21.15.72:0/597922888 conn(0x7f17b00fa780 msgr2=0x7f17b00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.467+0000 7f17b8800700 1 -- 172.21.15.72:0/597922888 shutdown_connections 2024-03-19T06:14:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.467+0000 7f17b8800700 1 -- 172.21.15.72:0/597922888 wait complete. 2024-03-19T06:14:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.468+0000 7f17b8800700 1 Processor -- start 2024-03-19T06:14:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.468+0000 7f17b8800700 1 -- start start 2024-03-19T06:14:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.469+0000 7f17b8800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b00feb50 0x7f17b0197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.469+0000 7f17b8800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b00ff4a0 0x7f17b0198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.469+0000 7f17b8800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0198840 con 0x7f17b00feb50 2024-03-19T06:14:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.469+0000 7f17b8800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b019d250 con 0x7f17b00ff4a0 2024-03-19T06:14:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.469+0000 7f17b5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b00feb50 0x7f17b0197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.469+0000 7f17b5e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b00feb50 0x7f17b0197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38838/0 (socket says 172.21.15.72:38838) 2024-03-19T06:14:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.469+0000 7f17b5e00700 1 -- 172.21.15.72:0/1839427682 learned_addr learned my addr 172.21.15.72:0/1839427682 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.469+0000 7f17b5400700 1 --2- 172.21.15.72:0/1839427682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b00ff4a0 0x7f17b0198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.469+0000 7f17b5e00700 1 -- 172.21.15.72:0/1839427682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b00ff4a0 msgr2=0x7f17b0198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.469+0000 7f17b5e00700 1 --2- 172.21.15.72:0/1839427682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b00ff4a0 0x7f17b0198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.469+0000 7f17b5e00700 1 -- 172.21.15.72:0/1839427682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a00095f0 con 0x7f17b00feb50 2024-03-19T06:14:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.470+0000 7f17b5e00700 1 --2- 172.21.15.72:0/1839427682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b00feb50 0x7f17b0197ce0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f17a400d900 tx=0x7f17a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.470+0000 7f17aaa00700 1 -- 172.21.15.72:0/1839427682 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a40041f0 con 0x7f17b00feb50 2024-03-19T06:14:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.470+0000 7f17aaa00700 1 -- 172.21.15.72:0/1839427682 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17a4004350 con 0x7f17b00feb50 2024-03-19T06:14:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.470+0000 7f17b8800700 1 -- 172.21.15.72:0/1839427682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b019d450 con 0x7f17b00feb50 2024-03-19T06:14:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.470+0000 7f17aaa00700 1 -- 172.21.15.72:0/1839427682 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a4003da0 con 0x7f17b00feb50 2024-03-19T06:14:39.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.470+0000 7f17b8800700 1 -- 172.21.15.72:0/1839427682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b019d970 con 0x7f17b00feb50 2024-03-19T06:14:39.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.472+0000 7f17b8800700 1 -- 172.21.15.72:0/1839427682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b010aef0 con 0x7f17b00feb50 2024-03-19T06:14:39.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.472+0000 7f17aaa00700 1 -- 172.21.15.72:0/1839427682 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f17a4009730 con 0x7f17b00feb50 2024-03-19T06:14:39.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.474+0000 7f17aaa00700 1 --2- 172.21.15.72:0/1839427682 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f179806dfa0 0x7f1798070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:39.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.474+0000 7f17aaa00700 1 -- 172.21.15.72:0/1839427682 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f17a408dea0 con 0x7f17b00feb50 2024-03-19T06:14:39.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.474+0000 7f17b5400700 1 --2- 172.21.15.72:0/1839427682 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f179806dfa0 0x7f1798070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.475+0000 7f17b5400700 1 --2- 172.21.15.72:0/1839427682 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f179806dfa0 0x7f1798070450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f17a0006010 tx=0x7f17a000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:39.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.480+0000 7f17aaa00700 1 -- 172.21.15.72:0/1839427682 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f17a40572f0 con 0x7f17b00feb50 2024-03-19T06:14:39.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.715+0000 7f17b8800700 1 -- 172.21.15.72:0/1839427682 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17b01088a0 con 0x7f179806dfa0 2024-03-19T06:14:39.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.717+0000 7f17aaa00700 1 -- 172.21.15.72:0/1839427682 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f17b01088a0 con 0x7f179806dfa0 2024-03-19T06:14:39.706 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:14:39.706 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:14:39.706 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:14:39.707 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:14:39.707 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:14:39.707 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:14:39.707 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:14:39.707 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-03-19T06:14:39.707 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:14:39.707 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:14:39.707 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "15/23 daemons upgraded", 2024-03-19T06:14:39.707 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading mds daemons", 2024-03-19T06:14:39.707 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:14:39.707 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:14:39.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.719+0000 7f17b8800700 1 -- 172.21.15.72:0/1839427682 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f179806dfa0 msgr2=0x7f1798070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:39.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.719+0000 7f17b8800700 1 --2- 172.21.15.72:0/1839427682 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f179806dfa0 0x7f1798070450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f17a0006010 tx=0x7f17a000b540 comp rx=0 tx=0).stop 2024-03-19T06:14:39.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.719+0000 7f17b8800700 1 -- 172.21.15.72:0/1839427682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b00feb50 msgr2=0x7f17b0197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:39.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.719+0000 7f17b8800700 1 --2- 172.21.15.72:0/1839427682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b00feb50 0x7f17b0197ce0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f17a400d900 tx=0x7f17a400dcc0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.719+0000 7f17b8800700 1 -- 172.21.15.72:0/1839427682 shutdown_connections 2024-03-19T06:14:39.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.719+0000 7f17b8800700 1 --2- 172.21.15.72:0/1839427682 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f179806dfa0 0x7f1798070450 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.719+0000 7f17b8800700 1 --2- 172.21.15.72:0/1839427682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b00feb50 0x7f17b0197ce0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.719+0000 7f17b8800700 1 --2- 172.21.15.72:0/1839427682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17b00ff4a0 0x7f17b0198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.719+0000 7f17b8800700 1 -- 172.21.15.72:0/1839427682 >> 172.21.15.72:0/1839427682 conn(0x7f17b00fa780 msgr2=0x7f17b0107180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:39.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.720+0000 7f17b8800700 1 -- 172.21.15.72:0/1839427682 shutdown_connections 2024-03-19T06:14:39.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.720+0000 7f17b8800700 1 -- 172.21.15.72:0/1839427682 wait complete. 2024-03-19T06:14:39.779 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:39 smithi172 ceph-mon[66682]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:39.779 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:39 smithi172 ceph-mon[66682]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:39.780 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:39 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3500769553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:39.780 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:39 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/4112673131' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:14:39.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.874+0000 7f82ec200700 1 -- 172.21.15.72:0/3892660003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82e4106840 msgr2=0x7f82e4106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:39.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.874+0000 7f82ec200700 1 --2- 172.21.15.72:0/3892660003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82e4106840 0x7f82e4106c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009910 tx=0x7f82d8009c20 comp rx=0 tx=0).stop 2024-03-19T06:14:39.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.874+0000 7f82ec200700 1 -- 172.21.15.72:0/3892660003 shutdown_connections 2024-03-19T06:14:39.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.874+0000 7f82ec200700 1 --2- 172.21.15.72:0/3892660003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e4107a40 0x7f82e4107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.874+0000 7f82ec200700 1 --2- 172.21.15.72:0/3892660003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82e4106840 0x7f82e4106c50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.874+0000 7f82ec200700 1 -- 172.21.15.72:0/3892660003 >> 172.21.15.72:0/3892660003 conn(0x7f82e4075970 msgr2=0x7f82e4077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:39.864 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:39 smithi072 ceph-mon[78545]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:39.864 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:39 smithi072 ceph-mon[78545]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:39.864 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:39 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3500769553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:39.864 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:39 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/4112673131' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:14:39.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.874+0000 7f82ec200700 1 -- 172.21.15.72:0/3892660003 shutdown_connections 2024-03-19T06:14:39.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.874+0000 7f82ec200700 1 -- 172.21.15.72:0/3892660003 wait complete. 2024-03-19T06:14:39.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.876+0000 7f82ec200700 1 Processor -- start 2024-03-19T06:14:39.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.876+0000 7f82ec200700 1 -- start start 2024-03-19T06:14:39.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.877+0000 7f82ec200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82e4106840 0x7f82e419c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:39.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.877+0000 7f82ec200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e4107a40 0x7f82e419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:39.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.877+0000 7f82ec200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e419cd10 con 0x7f82e4106840 2024-03-19T06:14:39.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.877+0000 7f82ec200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e419ce50 con 0x7f82e4107a40 2024-03-19T06:14:39.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.877+0000 7f82e9800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82e4106840 0x7f82e419c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:39.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.877+0000 7f82e9800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82e4106840 0x7f82e419c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38846/0 (socket says 172.21.15.72:38846) 2024-03-19T06:14:39.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.877+0000 7f82e9800700 1 -- 172.21.15.72:0/3163880697 learned_addr learned my addr 172.21.15.72:0/3163880697 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:14:39.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.877+0000 7f82e8e00700 1 --2- 172.21.15.72:0/3163880697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e4107a40 0x7f82e419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:39.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.878+0000 7f82e9800700 1 -- 172.21.15.72:0/3163880697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e4107a40 msgr2=0x7f82e419c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:39.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.878+0000 7f82e9800700 1 --2- 172.21.15.72:0/3163880697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e4107a40 0x7f82e419c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:39.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.878+0000 7f82e9800700 1 -- 172.21.15.72:0/3163880697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d80095f0 con 0x7f82e4106840 2024-03-19T06:14:39.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.878+0000 7f82e9800700 1 --2- 172.21.15.72:0/3163880697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82e4106840 0x7f82e419c1b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f82d800bd70 tx=0x7f82d800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:39.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.878+0000 7f82e2000700 1 -- 172.21.15.72:0/3163880697 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d801d070 con 0x7f82e4106840 2024-03-19T06:14:39.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.878+0000 7f82e2000700 1 -- 172.21.15.72:0/3163880697 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f82d800f460 con 0x7f82e4106840 2024-03-19T06:14:39.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.878+0000 7f82e2000700 1 -- 172.21.15.72:0/3163880697 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d8021640 con 0x7f82e4106840 2024-03-19T06:14:39.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.878+0000 7f82ec200700 1 -- 172.21.15.72:0/3163880697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e41a18a0 con 0x7f82e4106840 2024-03-19T06:14:39.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.878+0000 7f82ec200700 1 -- 172.21.15.72:0/3163880697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e41a1d40 con 0x7f82e4106840 2024-03-19T06:14:39.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.880+0000 7f82ec200700 1 -- 172.21.15.72:0/3163880697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e410f410 con 0x7f82e4106840 2024-03-19T06:14:39.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.882+0000 7f82e2000700 1 -- 172.21.15.72:0/3163880697 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f82d800fab0 con 0x7f82e4106840 2024-03-19T06:14:39.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.882+0000 7f82e2000700 1 --2- 172.21.15.72:0/3163880697 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f82cc06dfa0 0x7f82cc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:14:39.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.883+0000 7f82e2000700 1 -- 172.21.15.72:0/3163880697 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f82d808f1d0 con 0x7f82e4106840 2024-03-19T06:14:39.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.883+0000 7f82e8e00700 1 --2- 172.21.15.72:0/3163880697 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f82cc06dfa0 0x7f82cc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:14:39.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.883+0000 7f82e8e00700 1 --2- 172.21.15.72:0/3163880697 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f82cc06dfa0 0x7f82cc070450 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f82d0006fd0 tx=0x7f82d0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:14:39.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:39.887+0000 7f82e2000700 1 -- 172.21.15.72:0/3163880697 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f82d805c150 con 0x7f82e4106840 2024-03-19T06:14:40.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.177+0000 7f82ec200700 1 -- 172.21.15.72:0/3163880697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f82e410f600 con 0x7f82e4106840 2024-03-19T06:14:40.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.178+0000 7f82e2000700 1 -- 172.21.15.72:0/3163880697 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f82d805bce0 con 0x7f82e4106840 2024-03-19T06:14:40.168 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:14:40.168 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:14:40.168 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:14:40.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.181+0000 7f82ec200700 1 -- 172.21.15.72:0/3163880697 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f82cc06dfa0 msgr2=0x7f82cc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:40.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.181+0000 7f82ec200700 1 --2- 172.21.15.72:0/3163880697 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f82cc06dfa0 0x7f82cc070450 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f82d0006fd0 tx=0x7f82d0008040 comp rx=0 tx=0).stop 2024-03-19T06:14:40.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.181+0000 7f82ec200700 1 -- 172.21.15.72:0/3163880697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82e4106840 msgr2=0x7f82e419c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:14:40.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.181+0000 7f82ec200700 1 --2- 172.21.15.72:0/3163880697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82e4106840 0x7f82e419c1b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f82d800bd70 tx=0x7f82d800be50 comp rx=0 tx=0).stop 2024-03-19T06:14:40.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.181+0000 7f82ec200700 1 -- 172.21.15.72:0/3163880697 shutdown_connections 2024-03-19T06:14:40.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.181+0000 7f82ec200700 1 --2- 172.21.15.72:0/3163880697 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f82cc06dfa0 0x7f82cc070450 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:40.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.181+0000 7f82ec200700 1 --2- 172.21.15.72:0/3163880697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82e4106840 0x7f82e419c1b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:40.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.181+0000 7f82ec200700 1 --2- 172.21.15.72:0/3163880697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e4107a40 0x7f82e419c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:14:40.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.181+0000 7f82ec200700 1 -- 172.21.15.72:0/3163880697 >> 172.21.15.72:0/3163880697 conn(0x7f82e4075970 msgr2=0x7f82e410ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:14:40.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.181+0000 7f82ec200700 1 -- 172.21.15.72:0/3163880697 shutdown_connections 2024-03-19T06:14:40.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:14:40.181+0000 7f82ec200700 1 -- 172.21.15.72:0/3163880697 wait complete. 2024-03-19T06:14:40.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:40 smithi172 ceph-mon[66682]: pgmap v254: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:40.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:40 smithi172 ceph-mon[66682]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:40.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:14:40.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:40 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3163880697' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:14:41.022 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:40 smithi072 ceph-mon[78545]: pgmap v254: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:41.022 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:40 smithi072 ceph-mon[78545]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:14:41.022 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:14:41.022 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:40 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3163880697' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:14:41.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:41 smithi172 ceph-mon[66682]: pgmap v255: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:42.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:41 smithi072 ceph-mon[78545]: pgmap v255: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:44.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:43 smithi172 ceph-mon[66682]: pgmap v256: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:44.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:44.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:44.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:14:44.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:14:44.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:44.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:43 smithi072 ceph-mon[78545]: pgmap v256: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:44.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:44.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:44.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:14:44.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:14:44.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:44.985 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:44 smithi172 ceph-mon[66682]: Detected new or changed devices on smithi172 2024-03-19T06:14:44.986 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:44 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:14:44.986 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:44 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:44.986 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:44 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:44.986 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:44 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:44.986 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:44 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:44.986 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:44 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi172.nparnw"]}]: dispatch 2024-03-19T06:14:44.986 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:44 smithi172 ceph-mon[66682]: Upgrade: It appears safe to stop mds.cephfs.smithi172.nparnw 2024-03-19T06:14:45.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:44 smithi072 ceph-mon[78545]: Detected new or changed devices on smithi172 2024-03-19T06:14:45.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:14:45.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:45.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:45.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:45.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:14:45.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:44 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi172.nparnw"]}]: dispatch 2024-03-19T06:14:45.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:44 smithi072 ceph-mon[78545]: Upgrade: It appears safe to stop mds.cephfs.smithi172.nparnw 2024-03-19T06:14:46.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:45 smithi172 ceph-mon[66682]: pgmap v257: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:46.182 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:45 smithi072 ceph-mon[78545]: pgmap v257: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:47.517 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:47 smithi172 ceph-mon[66682]: Upgrade: Updating mds.cephfs.smithi172.nparnw 2024-03-19T06:14:47.517 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:47 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:47.517 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:47 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.nparnw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:14:47.517 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:47 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:14:47.518 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:47 smithi172 ceph-mon[66682]: Deploying daemon mds.cephfs.smithi172.nparnw on smithi172 2024-03-19T06:14:47.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:47 smithi072 ceph-mon[78545]: Upgrade: Updating mds.cephfs.smithi172.nparnw 2024-03-19T06:14:47.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:47 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:47.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:47 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.nparnw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-19T06:14:47.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:47 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:14:47.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:47 smithi072 ceph-mon[78545]: Deploying daemon mds.cephfs.smithi172.nparnw on smithi172 2024-03-19T06:14:48.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:48 smithi172 ceph-mon[66682]: pgmap v258: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:48.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:48 smithi072 ceph-mon[78545]: pgmap v258: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:49.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:49 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072[78541]: 2024-03-19T06:14:49.470+0000 7f9b50200700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:14:50.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:50 smithi072 ceph-mon[78545]: pgmap v259: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:50.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:50 smithi072 ceph-mon[78545]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-19T06:14:50.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:50 smithi072 ceph-mon[78545]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:14:50.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:50 smithi072 ceph-mon[78545]: osdmap e83: 6 total, 6 up, 6 in 2024-03-19T06:14:50.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:50 smithi072 ceph-mon[78545]: Standby daemon mds.cephfs.smithi072.jhxzfi assigned to filesystem cephfs as rank 0 2024-03-19T06:14:50.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:50 smithi072 ceph-mon[78545]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-19T06:14:50.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:50 smithi072 ceph-mon[78545]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-03-19T06:14:50.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:50 smithi072 ceph-mon[78545]: fsmap cephfs:1/1 {0=cephfs.smithi072.jhxzfi=up:replay} 2 up:standby 2024-03-19T06:14:50.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:50 smithi172 ceph-mon[66682]: pgmap v259: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:50.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:50 smithi172 ceph-mon[66682]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-19T06:14:50.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:50 smithi172 ceph-mon[66682]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-19T06:14:50.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:50 smithi172 ceph-mon[66682]: osdmap e83: 6 total, 6 up, 6 in 2024-03-19T06:14:50.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:50 smithi172 ceph-mon[66682]: Standby daemon mds.cephfs.smithi072.jhxzfi assigned to filesystem cephfs as rank 0 2024-03-19T06:14:50.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:50 smithi172 ceph-mon[66682]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-19T06:14:50.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:50 smithi172 ceph-mon[66682]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-03-19T06:14:50.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:50 smithi172 ceph-mon[66682]: fsmap cephfs:1/1 {0=cephfs.smithi072.jhxzfi=up:replay} 2 up:standby 2024-03-19T06:14:52.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:52 smithi072 ceph-mon[78545]: pgmap v261: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:52.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:52 smithi172 ceph-mon[66682]: pgmap v261: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:14:54.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:54 smithi072 ceph-mon[78545]: pgmap v262: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 2 op/s 2024-03-19T06:14:54.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:54 smithi172 ceph-mon[66682]: pgmap v262: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 2 op/s 2024-03-19T06:14:55.991 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:55.991 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:14:55.991 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:55 smithi172 ceph-mon[66682]: pgmap v263: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-03-19T06:14:56.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:56.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:14:56.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:55 smithi072 ceph-mon[78545]: pgmap v263: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-03-19T06:14:57.151 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:56 smithi172 ceph-mon[66682]: reconnect by client.24271 192.168.0.1:0/1243789683 after 0.00299994 2024-03-19T06:14:57.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:56 smithi172 ceph-mon[66682]: reconnect by client.14520 192.168.0.1:0/3828438056 after 0.00399992 2024-03-19T06:14:57.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:56 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] up:reconnect 2024-03-19T06:14:57.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:56 smithi172 ceph-mon[66682]: fsmap cephfs:1/1 {0=cephfs.smithi072.jhxzfi=up:reconnect} 2 up:standby 2024-03-19T06:14:57.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:56 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:57.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:56 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:57.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:56 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:14:57.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:56 smithi072 ceph-mon[78545]: reconnect by client.24271 192.168.0.1:0/1243789683 after 0.00299994 2024-03-19T06:14:57.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:56 smithi072 ceph-mon[78545]: reconnect by client.14520 192.168.0.1:0/3828438056 after 0.00399992 2024-03-19T06:14:57.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:56 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] up:reconnect 2024-03-19T06:14:57.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:56 smithi072 ceph-mon[78545]: fsmap cephfs:1/1 {0=cephfs.smithi072.jhxzfi=up:reconnect} 2 up:standby 2024-03-19T06:14:57.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:56 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:57.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:56 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:57.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:56 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:14:58.151 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:57 smithi172 ceph-mon[66682]: pgmap v264: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-03-19T06:14:58.151 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:57 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] up:rejoin 2024-03-19T06:14:58.151 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:57 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.172:6826/3126751850,v1:172.21.15.172:6827/3126751850] up:boot 2024-03-19T06:14:58.151 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:57 smithi172 ceph-mon[66682]: fsmap cephfs:1/1 {0=cephfs.smithi072.jhxzfi=up:rejoin} 3 up:standby 2024-03-19T06:14:58.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.nparnw"}]: dispatch 2024-03-19T06:14:58.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:57 smithi172 ceph-mon[66682]: daemon mds.cephfs.smithi072.jhxzfi is now active in filesystem cephfs as rank 0 2024-03-19T06:14:58.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:58.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:58.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:57 smithi072 ceph-mon[78545]: pgmap v264: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-03-19T06:14:58.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:57 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] up:rejoin 2024-03-19T06:14:58.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:57 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.172:6826/3126751850,v1:172.21.15.172:6827/3126751850] up:boot 2024-03-19T06:14:58.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:57 smithi072 ceph-mon[78545]: fsmap cephfs:1/1 {0=cephfs.smithi072.jhxzfi=up:rejoin} 3 up:standby 2024-03-19T06:14:58.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.nparnw"}]: dispatch 2024-03-19T06:14:58.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:57 smithi072 ceph-mon[78545]: daemon mds.cephfs.smithi072.jhxzfi is now active in filesystem cephfs as rank 0 2024-03-19T06:14:58.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:58.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:14:59.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:58 smithi172 ceph-mon[66682]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-19T06:14:59.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:58 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] up:active 2024-03-19T06:14:59.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:58 smithi172 ceph-mon[66682]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:active} 3 up:standby 2024-03-19T06:14:59.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:58 smithi072 ceph-mon[78545]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-19T06:14:59.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:58 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] up:active 2024-03-19T06:14:59.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:58 smithi072 ceph-mon[78545]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:active} 3 up:standby 2024-03-19T06:15:00.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:14:59 smithi172 ceph-mon[66682]: pgmap v265: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-03-19T06:15:00.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:14:59 smithi072 ceph-mon[78545]: pgmap v265: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-03-19T06:15:02.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:02 smithi072 ceph-mon[78545]: pgmap v266: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-03-19T06:15:02.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:02 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:02.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:02 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:02.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:02 smithi172 ceph-mon[66682]: pgmap v266: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-03-19T06:15:02.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:02 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:02.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:02 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:04.860 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:04 smithi172 ceph-mon[66682]: pgmap v267: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-03-19T06:15:04.860 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:04 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:04.861 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:04 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:05.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:04 smithi072 ceph-mon[78545]: pgmap v267: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-03-19T06:15:05.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:04 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:05.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:04 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:06.852 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:06 smithi072 ceph-mon[78545]: pgmap v268: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-03-19T06:15:06.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:06 smithi172 ceph-mon[66682]: pgmap v268: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-03-19T06:15:08.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:08 smithi172 ceph-mon[66682]: pgmap v269: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-03-19T06:15:09.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:08 smithi072 ceph-mon[78545]: pgmap v269: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-03-19T06:15:10.138 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: pgmap v270: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-19T06:15:10.139 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:10.139 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:10.139 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:15:10.139 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:15:10.139 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:10.139 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:15:10.139 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:10.139 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:10.139 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:10.139 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:10.139 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:10.139 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: Upgrade: Setting container_image for all mds 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.dvdjwb"}]': finished 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.jhxzfi"}]': finished 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.nparnw"}]: dispatch 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.nparnw"}]': finished 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.xlokxp"}]': finished 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:10.140 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:09 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:15:10.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: pgmap v270: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-19T06:15:10.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:10.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:10.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:15:10.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: Upgrade: Setting container_image for all mds 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.dvdjwb"}]: dispatch 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.dvdjwb"}]': finished 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.jhxzfi"}]: dispatch 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi072.jhxzfi"}]': finished 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.nparnw"}]: dispatch 2024-03-19T06:15:10.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.nparnw"}]': finished 2024-03-19T06:15:10.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.xlokxp"}]: dispatch 2024-03-19T06:15:10.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.xlokxp"}]': finished 2024-03-19T06:15:10.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-03-19T06:15:10.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-03-19T06:15:10.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:10.326 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:09 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:15:10.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.356+0000 7fd56de00700 1 -- 172.21.15.72:0/2491408672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568101440 msgr2=0x7fd568101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:10.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.356+0000 7fd56de00700 1 --2- 172.21.15.72:0/2491408672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568101440 0x7fd568101890 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd554009910 tx=0x7fd554009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:10.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.357+0000 7fd56de00700 1 -- 172.21.15.72:0/2491408672 shutdown_connections 2024-03-19T06:15:10.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.357+0000 7fd56de00700 1 --2- 172.21.15.72:0/2491408672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568101440 0x7fd568101890 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:10.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.357+0000 7fd56de00700 1 --2- 172.21.15.72:0/2491408672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd568100240 0x7fd568100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:10.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.357+0000 7fd56de00700 1 -- 172.21.15.72:0/2491408672 >> 172.21.15.72:0/2491408672 conn(0x7fd5680fb7f0 msgr2=0x7fd5680fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:10.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.357+0000 7fd56de00700 1 -- 172.21.15.72:0/2491408672 shutdown_connections 2024-03-19T06:15:10.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.357+0000 7fd56de00700 1 -- 172.21.15.72:0/2491408672 wait complete. 2024-03-19T06:15:10.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.358+0000 7fd56de00700 1 Processor -- start 2024-03-19T06:15:10.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.358+0000 7fd56de00700 1 -- start start 2024-03-19T06:15:10.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.358+0000 7fd56de00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd568100240 0x7fd568195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:10.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.358+0000 7fd56de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568101440 0x7fd568195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:10.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.359+0000 7fd56de00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568196610 con 0x7fd568101440 2024-03-19T06:15:10.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.359+0000 7fd56de00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568196750 con 0x7fd568100240 2024-03-19T06:15:10.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.359+0000 7fd566000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568101440 0x7fd568195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:10.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.359+0000 7fd566000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568101440 0x7fd568195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46428/0 (socket says 172.21.15.72:46428) 2024-03-19T06:15:10.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.359+0000 7fd566000700 1 -- 172.21.15.72:0/2274708945 learned_addr learned my addr 172.21.15.72:0/2274708945 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:10.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.359+0000 7fd566a00700 1 --2- 172.21.15.72:0/2274708945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd568100240 0x7fd568195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:10.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.359+0000 7fd566000700 1 -- 172.21.15.72:0/2274708945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd568100240 msgr2=0x7fd568195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:10.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.359+0000 7fd566000700 1 --2- 172.21.15.72:0/2274708945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd568100240 0x7fd568195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:10.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.359+0000 7fd566000700 1 -- 172.21.15.72:0/2274708945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5540095f0 con 0x7fd568101440 2024-03-19T06:15:10.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.360+0000 7fd566000700 1 --2- 172.21.15.72:0/2274708945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568101440 0x7fd568195ff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd55400bd70 tx=0x7fd55400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:10.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.360+0000 7fd56ca00700 1 -- 172.21.15.72:0/2274708945 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd55401d070 con 0x7fd568101440 2024-03-19T06:15:10.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.360+0000 7fd56ca00700 1 -- 172.21.15.72:0/2274708945 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd554022470 con 0x7fd568101440 2024-03-19T06:15:10.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.360+0000 7fd56de00700 1 -- 172.21.15.72:0/2274708945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd568072f80 con 0x7fd568101440 2024-03-19T06:15:10.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.360+0000 7fd56ca00700 1 -- 172.21.15.72:0/2274708945 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd55400f670 con 0x7fd568101440 2024-03-19T06:15:10.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.361+0000 7fd56de00700 1 -- 172.21.15.72:0/2274708945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd568073470 con 0x7fd568101440 2024-03-19T06:15:10.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.362+0000 7fd56de00700 1 -- 172.21.15.72:0/2274708945 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd568108d90 con 0x7fd568101440 2024-03-19T06:15:10.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.363+0000 7fd56ca00700 1 -- 172.21.15.72:0/2274708945 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fd554022a50 con 0x7fd568101440 2024-03-19T06:15:10.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.364+0000 7fd56ca00700 1 --2- 172.21.15.72:0/2274708945 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd54c06dfa0 0x7fd54c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:10.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.364+0000 7fd56ca00700 1 -- 172.21.15.72:0/2274708945 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd55408f530 con 0x7fd568101440 2024-03-19T06:15:10.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.364+0000 7fd566a00700 1 --2- 172.21.15.72:0/2274708945 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd54c06dfa0 0x7fd54c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:10.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.365+0000 7fd566a00700 1 --2- 172.21.15.72:0/2274708945 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd54c06dfa0 0x7fd54c070450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd558005fd0 tx=0x7fd558005dd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:10.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.368+0000 7fd56ca00700 1 -- 172.21.15.72:0/2274708945 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fd55405c630 con 0x7fd568101440 2024-03-19T06:15:10.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.617+0000 7fd56de00700 1 -- 172.21.15.72:0/2274708945 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd568105d90 con 0x7fd54c06dfa0 2024-03-19T06:15:10.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.620+0000 7fd56ca00700 1 -- 172.21.15.72:0/2274708945 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fd568105d90 con 0x7fd54c06dfa0 2024-03-19T06:15:10.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.623+0000 7fd56de00700 1 -- 172.21.15.72:0/2274708945 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd54c06dfa0 msgr2=0x7fd54c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:10.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.623+0000 7fd56de00700 1 --2- 172.21.15.72:0/2274708945 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd54c06dfa0 0x7fd54c070450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd558005fd0 tx=0x7fd558005dd0 comp rx=0 tx=0).stop 2024-03-19T06:15:10.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.623+0000 7fd56de00700 1 -- 172.21.15.72:0/2274708945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568101440 msgr2=0x7fd568195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:10.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.623+0000 7fd56de00700 1 --2- 172.21.15.72:0/2274708945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568101440 0x7fd568195ff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd55400bd70 tx=0x7fd55400be50 comp rx=0 tx=0).stop 2024-03-19T06:15:10.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.623+0000 7fd56de00700 1 -- 172.21.15.72:0/2274708945 shutdown_connections 2024-03-19T06:15:10.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.623+0000 7fd56de00700 1 --2- 172.21.15.72:0/2274708945 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd54c06dfa0 0x7fd54c070450 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:10.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.623+0000 7fd56de00700 1 --2- 172.21.15.72:0/2274708945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd568100240 0x7fd568195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:10.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.623+0000 7fd56de00700 1 --2- 172.21.15.72:0/2274708945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568101440 0x7fd568195ff0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:10.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.623+0000 7fd56de00700 1 -- 172.21.15.72:0/2274708945 >> 172.21.15.72:0/2274708945 conn(0x7fd5680fb7f0 msgr2=0x7fd568104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:10.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.624+0000 7fd56de00700 1 -- 172.21.15.72:0/2274708945 shutdown_connections 2024-03-19T06:15:10.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.624+0000 7fd56de00700 1 -- 172.21.15.72:0/2274708945 wait complete. 2024-03-19T06:15:10.628 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:15:10.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.780+0000 7f3098a00700 1 -- 172.21.15.72:0/2552179218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3094100240 msgr2=0x7f3094100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:10.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.780+0000 7f3098a00700 1 --2- 172.21.15.72:0/2552179218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3094100240 0x7f3094100650 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3084009910 tx=0x7f3084009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:10.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.780+0000 7f3098a00700 1 -- 172.21.15.72:0/2552179218 shutdown_connections 2024-03-19T06:15:10.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.780+0000 7f3098a00700 1 --2- 172.21.15.72:0/2552179218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3094101440 0x7f3094101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:10.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.780+0000 7f3098a00700 1 --2- 172.21.15.72:0/2552179218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3094100240 0x7f3094100650 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:10.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.780+0000 7f3098a00700 1 -- 172.21.15.72:0/2552179218 >> 172.21.15.72:0/2552179218 conn(0x7f30940fb7f0 msgr2=0x7f30940fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:10.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.780+0000 7f3098a00700 1 -- 172.21.15.72:0/2552179218 shutdown_connections 2024-03-19T06:15:10.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.780+0000 7f3098a00700 1 -- 172.21.15.72:0/2552179218 wait complete. 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.781+0000 7f3098a00700 1 Processor -- start 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.782+0000 7f3098a00700 1 -- start start 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.782+0000 7f3098a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3094100240 0x7f3094197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.782+0000 7f3098a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3094101440 0x7f30941981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.782+0000 7f3098a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30941987f0 con 0x7f3094101440 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.782+0000 7f3098a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3094198960 con 0x7f3094100240 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.782+0000 7f3091400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3094101440 0x7f30941981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.782+0000 7f3091400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3094101440 0x7f30941981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46442/0 (socket says 172.21.15.72:46442) 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.782+0000 7f3091400700 1 -- 172.21.15.72:0/2205724892 learned_addr learned my addr 172.21.15.72:0/2205724892 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.782+0000 7f3091e00700 1 --2- 172.21.15.72:0/2205724892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3094100240 0x7f3094197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.783+0000 7f3091400700 1 -- 172.21.15.72:0/2205724892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3094100240 msgr2=0x7f3094197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.783+0000 7f3091400700 1 --2- 172.21.15.72:0/2205724892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3094100240 0x7f3094197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:10.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.783+0000 7f3091400700 1 -- 172.21.15.72:0/2205724892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30840095f0 con 0x7f3094101440 2024-03-19T06:15:10.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.783+0000 7f3091400700 1 --2- 172.21.15.72:0/2205724892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3094101440 0x7f30941981f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f308000d8d0 tx=0x7f308000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:10.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.783+0000 7f308aa00700 1 -- 172.21.15.72:0/2205724892 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3080009940 con 0x7f3094101440 2024-03-19T06:15:10.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.783+0000 7f308aa00700 1 -- 172.21.15.72:0/2205724892 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3080010460 con 0x7f3094101440 2024-03-19T06:15:10.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.783+0000 7f308aa00700 1 -- 172.21.15.72:0/2205724892 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f308000f5f0 con 0x7f3094101440 2024-03-19T06:15:10.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.784+0000 7f3098a00700 1 -- 172.21.15.72:0/2205724892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309419d3f0 con 0x7f3094101440 2024-03-19T06:15:10.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.784+0000 7f3098a00700 1 -- 172.21.15.72:0/2205724892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309419d940 con 0x7f3094101440 2024-03-19T06:15:10.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.785+0000 7f3098a00700 1 -- 172.21.15.72:0/2205724892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3094105520 con 0x7f3094101440 2024-03-19T06:15:10.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.786+0000 7f308aa00700 1 -- 172.21.15.72:0/2205724892 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f30800105d0 con 0x7f3094101440 2024-03-19T06:15:10.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.787+0000 7f308aa00700 1 --2- 172.21.15.72:0/2205724892 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f307806dfa0 0x7f3078070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:10.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.787+0000 7f308aa00700 1 -- 172.21.15.72:0/2205724892 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f308008dc90 con 0x7f3094101440 2024-03-19T06:15:10.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.787+0000 7f3091e00700 1 --2- 172.21.15.72:0/2205724892 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f307806dfa0 0x7f3078070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:10.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.788+0000 7f3091e00700 1 --2- 172.21.15.72:0/2205724892 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f307806dfa0 0x7f3078070450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3084005090 tx=0x7f308400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:10.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:10.792+0000 7f308aa00700 1 -- 172.21.15.72:0/2205724892 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f3080057130 con 0x7f3094101440 2024-03-19T06:15:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.045+0000 7f3098a00700 1 -- 172.21.15.72:0/2205724892 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3094061190 con 0x7f307806dfa0 2024-03-19T06:15:11.034 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: daemon mds.cephfs.smithi072.dvdjwb assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:active} 3 up:standby 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi072.dvdjwb=up:starting} 2 up:standby 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: Upgrade: Setting container_image for all rgw 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: daemon mds.cephfs.smithi072.dvdjwb is now active in filesystem cephfs as rank 1 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: Upgrade: Setting container_image for all rbd-mirror 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:11.035 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.047+0000 7f308aa00700 1 -- 172.21.15.72:0/2205724892 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f3094061190 con 0x7f307806dfa0 2024-03-19T06:15:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.050+0000 7f3098a00700 1 -- 172.21.15.72:0/2205724892 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f307806dfa0 msgr2=0x7f3078070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.050+0000 7f3098a00700 1 --2- 172.21.15.72:0/2205724892 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f307806dfa0 0x7f3078070450 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3084005090 tx=0x7f308400b540 comp rx=0 tx=0).stop 2024-03-19T06:15:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.050+0000 7f3098a00700 1 -- 172.21.15.72:0/2205724892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3094101440 msgr2=0x7f30941981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.050+0000 7f3098a00700 1 --2- 172.21.15.72:0/2205724892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3094101440 0x7f30941981f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f308000d8d0 tx=0x7f308000dc90 comp rx=0 tx=0).stop 2024-03-19T06:15:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.050+0000 7f3098a00700 1 -- 172.21.15.72:0/2205724892 shutdown_connections 2024-03-19T06:15:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.050+0000 7f3098a00700 1 --2- 172.21.15.72:0/2205724892 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f307806dfa0 0x7f3078070450 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.050+0000 7f3098a00700 1 --2- 172.21.15.72:0/2205724892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3094100240 0x7f3094197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.050+0000 7f3098a00700 1 --2- 172.21.15.72:0/2205724892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3094101440 0x7f30941981f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.050+0000 7f3098a00700 1 -- 172.21.15.72:0/2205724892 >> 172.21.15.72:0/2205724892 conn(0x7f30940fb7f0 msgr2=0x7f3094102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.050+0000 7f3098a00700 1 -- 172.21.15.72:0/2205724892 shutdown_connections 2024-03-19T06:15:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.050+0000 7f3098a00700 1 -- 172.21.15.72:0/2205724892 wait complete. 2024-03-19T06:15:11.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-19T06:15:11.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: daemon mds.cephfs.smithi072.dvdjwb assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: fsmap cephfs:1 {0=cephfs.smithi072.jhxzfi=up:active} 3 up:standby 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi072.dvdjwb=up:starting} 2 up:standby 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: Upgrade: Setting container_image for all rgw 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: daemon mds.cephfs.smithi072.dvdjwb is now active in filesystem cephfs as rank 1 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: Upgrade: Setting container_image for all rbd-mirror 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:11.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.199+0000 7fe2e8600700 1 -- 172.21.15.72:0/1585731586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e0102440 msgr2=0x7fe2e0102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.199+0000 7fe2e8600700 1 --2- 172.21.15.72:0/1585731586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e0102440 0x7fe2e0102850 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009910 tx=0x7fe2d4009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.199+0000 7fe2e8600700 1 -- 172.21.15.72:0/1585731586 shutdown_connections 2024-03-19T06:15:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.199+0000 7fe2e8600700 1 --2- 172.21.15.72:0/1585731586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2e0103640 0x7fe2e0103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.199+0000 7fe2e8600700 1 --2- 172.21.15.72:0/1585731586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e0102440 0x7fe2e0102850 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.199+0000 7fe2e8600700 1 -- 172.21.15.72:0/1585731586 >> 172.21.15.72:0/1585731586 conn(0x7fe2e00fd9f0 msgr2=0x7fe2e00ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.199+0000 7fe2e8600700 1 -- 172.21.15.72:0/1585731586 shutdown_connections 2024-03-19T06:15:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.200+0000 7fe2e8600700 1 -- 172.21.15.72:0/1585731586 wait complete. 2024-03-19T06:15:11.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.200+0000 7fe2e8600700 1 Processor -- start 2024-03-19T06:15:11.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.201+0000 7fe2e8600700 1 -- start start 2024-03-19T06:15:11.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.201+0000 7fe2e8600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2e0102440 0x7fe2e0197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:11.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.201+0000 7fe2e8600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e0103640 0x7fe2e0198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:11.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.201+0000 7fe2e8600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e0198850 con 0x7fe2e0103640 2024-03-19T06:15:11.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.201+0000 7fe2e8600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e019d260 con 0x7fe2e0102440 2024-03-19T06:15:11.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.201+0000 7fe2e5200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e0103640 0x7fe2e0198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:11.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.201+0000 7fe2e5200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e0103640 0x7fe2e0198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46462/0 (socket says 172.21.15.72:46462) 2024-03-19T06:15:11.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.201+0000 7fe2e5200700 1 -- 172.21.15.72:0/3623996933 learned_addr learned my addr 172.21.15.72:0/3623996933 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:11.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.202+0000 7fe2e5c00700 1 --2- 172.21.15.72:0/3623996933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2e0102440 0x7fe2e0197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:11.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.202+0000 7fe2e5200700 1 -- 172.21.15.72:0/3623996933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2e0102440 msgr2=0x7fe2e0197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:11.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.202+0000 7fe2e5200700 1 --2- 172.21.15.72:0/3623996933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2e0102440 0x7fe2e0197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.202+0000 7fe2e5200700 1 -- 172.21.15.72:0/3623996933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d40095f0 con 0x7fe2e0103640 2024-03-19T06:15:11.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.202+0000 7fe2e5200700 1 --2- 172.21.15.72:0/3623996933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e0103640 0x7fe2e0198230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c8a0 tx=0x7fe2cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:11.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.202+0000 7fe2de000700 1 -- 172.21.15.72:0/3623996933 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2cc00cea0 con 0x7fe2e0103640 2024-03-19T06:15:11.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.202+0000 7fe2de000700 1 -- 172.21.15.72:0/3623996933 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe2cc004830 con 0x7fe2e0103640 2024-03-19T06:15:11.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.202+0000 7fe2e8600700 1 -- 172.21.15.72:0/3623996933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e019d460 con 0x7fe2e0103640 2024-03-19T06:15:11.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.202+0000 7fe2de000700 1 -- 172.21.15.72:0/3623996933 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2cc0055b0 con 0x7fe2e0103640 2024-03-19T06:15:11.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.202+0000 7fe2e8600700 1 -- 172.21.15.72:0/3623996933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e019d980 con 0x7fe2e0103640 2024-03-19T06:15:11.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.204+0000 7fe2e8600700 1 -- 172.21.15.72:0/3623996933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e010af90 con 0x7fe2e0103640 2024-03-19T06:15:11.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.205+0000 7fe2de000700 1 -- 172.21.15.72:0/3623996933 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fe2cc007ad0 con 0x7fe2e0103640 2024-03-19T06:15:11.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.205+0000 7fe2de000700 1 --2- 172.21.15.72:0/3623996933 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe2c806dfa0 0x7fe2c8070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:11.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.206+0000 7fe2de000700 1 -- 172.21.15.72:0/3623996933 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe2cc08daf0 con 0x7fe2e0103640 2024-03-19T06:15:11.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.206+0000 7fe2e5c00700 1 --2- 172.21.15.72:0/3623996933 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe2c806dfa0 0x7fe2c8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:11.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.206+0000 7fe2e5c00700 1 --2- 172.21.15.72:0/3623996933 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe2c806dfa0 0x7fe2c8070450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009fd0 tx=0x7fe2d400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:11.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.210+0000 7fe2de000700 1 -- 172.21.15.72:0/3623996933 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fe2cc056f10 con 0x7fe2e0103640 2024-03-19T06:15:11.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.446+0000 7fe2e8600700 1 -- 172.21.15.72:0/3623996933 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2e0107f90 con 0x7fe2c806dfa0 2024-03-19T06:15:11.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.462+0000 7fe2de000700 1 -- 172.21.15.72:0/3623996933 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fe2e0107f90 con 0x7fe2c806dfa0 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (19m) 57s ago 21m 14.3M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (22m) 57s ago 22m 9345k - 18.2.0 dc2bc1663786 ba269d0f7517 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (20m) 9s ago 20m 9248k - 18.2.0 dc2bc1663786 24b36fc0db0b 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (6m) 57s ago 21m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (6m) 9s ago 20m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (19m) 57s ago 21m 74.1M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (65s) 57s ago 14m 10.8M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 3ea4b00e2248 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (97s) 57s ago 14m 12.0M - 19.0.0-1934-gb0ea271b 5c4d8774b57a d0daead2fe2a 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (15s) 9s ago 14m 10.8M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 788348d02918 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (40s) 9s ago 14m 11.9M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 2cbfb6aeff05 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (10m) 57s ago 23m 508M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (8m) 9s ago 20m 452M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (7m) 57s ago 23m 57.6M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:15:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (7m) 9s ago 20m 43.4M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:15:11.452 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (21m) 57s ago 21m 8250k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:15:11.452 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (20m) 9s ago 20m 8112k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:15:11.452 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (5m) 57s ago 19m 98.4M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:15:11.452 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (5m) 57s ago 18m 101M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:15:11.452 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (4m) 57s ago 17m 91.8M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:15:11.452 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (4m) 9s ago 17m 106M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:15:11.452 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (3m) 9s ago 16m 97.4M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:15:11.452 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (2m) 9s ago 16m 90.8M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a c47c9c7fd3c7 2024-03-19T06:15:11.452 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (8m) 57s ago 20m 70.3M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:15:11.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.465+0000 7fe2e8600700 1 -- 172.21.15.72:0/3623996933 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe2c806dfa0 msgr2=0x7fe2c8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:11.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.465+0000 7fe2e8600700 1 --2- 172.21.15.72:0/3623996933 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe2c806dfa0 0x7fe2c8070450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009fd0 tx=0x7fe2d400b540 comp rx=0 tx=0).stop 2024-03-19T06:15:11.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.465+0000 7fe2e8600700 1 -- 172.21.15.72:0/3623996933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e0103640 msgr2=0x7fe2e0198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:11.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.465+0000 7fe2e8600700 1 --2- 172.21.15.72:0/3623996933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e0103640 0x7fe2e0198230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c8a0 tx=0x7fe2cc00cc60 comp rx=0 tx=0).stop 2024-03-19T06:15:11.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.465+0000 7fe2e8600700 1 -- 172.21.15.72:0/3623996933 shutdown_connections 2024-03-19T06:15:11.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.465+0000 7fe2e8600700 1 --2- 172.21.15.72:0/3623996933 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe2c806dfa0 0x7fe2c8070450 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.465+0000 7fe2e8600700 1 --2- 172.21.15.72:0/3623996933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2e0102440 0x7fe2e0197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.465+0000 7fe2e8600700 1 --2- 172.21.15.72:0/3623996933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2e0103640 0x7fe2e0198230 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.465+0000 7fe2e8600700 1 -- 172.21.15.72:0/3623996933 >> 172.21.15.72:0/3623996933 conn(0x7fe2e00fd9f0 msgr2=0x7fe2e0106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:11.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.466+0000 7fe2e8600700 1 -- 172.21.15.72:0/3623996933 shutdown_connections 2024-03-19T06:15:11.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.466+0000 7fe2e8600700 1 -- 172.21.15.72:0/3623996933 wait complete. 2024-03-19T06:15:11.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.609+0000 7f72b1600700 1 -- 172.21.15.72:0/4273565424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ac069270 msgr2=0x7f72ac1051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:11.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.609+0000 7f72b1600700 1 --2- 172.21.15.72:0/4273565424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ac069270 0x7f72ac1051d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f729c009910 tx=0x7f729c009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:11.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.609+0000 7f72b1600700 1 -- 172.21.15.72:0/4273565424 shutdown_connections 2024-03-19T06:15:11.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.609+0000 7f72b1600700 1 --2- 172.21.15.72:0/4273565424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72ac105710 0x7f72ac107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.609+0000 7f72b1600700 1 --2- 172.21.15.72:0/4273565424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ac069270 0x7f72ac1051d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.609+0000 7f72b1600700 1 -- 172.21.15.72:0/4273565424 >> 172.21.15.72:0/4273565424 conn(0x7f72ac0fa780 msgr2=0x7f72ac0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:11.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.609+0000 7f72b1600700 1 -- 172.21.15.72:0/4273565424 shutdown_connections 2024-03-19T06:15:11.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.610+0000 7f72b1600700 1 -- 172.21.15.72:0/4273565424 wait complete. 2024-03-19T06:15:11.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.611+0000 7f72b1600700 1 Processor -- start 2024-03-19T06:15:11.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.611+0000 7f72b1600700 1 -- start start 2024-03-19T06:15:11.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.612+0000 7f72b1600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ac105710 0x7f72ac197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:11.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.612+0000 7f72b1600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72ac198220 0x7f72ac19d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:11.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.612+0000 7f72b1600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac198690 con 0x7f72ac105710 2024-03-19T06:15:11.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.612+0000 7f72b1600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac198800 con 0x7f72ac198220 2024-03-19T06:15:11.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.612+0000 7f72aaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ac105710 0x7f72ac197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:11.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.612+0000 7f72aaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ac105710 0x7f72ac197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46488/0 (socket says 172.21.15.72:46488) 2024-03-19T06:15:11.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.612+0000 7f72aaa00700 1 -- 172.21.15.72:0/3841835266 learned_addr learned my addr 172.21.15.72:0/3841835266 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:11.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.612+0000 7f72aa000700 1 --2- 172.21.15.72:0/3841835266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72ac198220 0x7f72ac19d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:11.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.612+0000 7f72aaa00700 1 -- 172.21.15.72:0/3841835266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72ac198220 msgr2=0x7f72ac19d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:11.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.612+0000 7f72aaa00700 1 --2- 172.21.15.72:0/3841835266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72ac198220 0x7f72ac19d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.612+0000 7f72aaa00700 1 -- 172.21.15.72:0/3841835266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c0095f0 con 0x7f72ac105710 2024-03-19T06:15:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.613+0000 7f72aaa00700 1 --2- 172.21.15.72:0/3841835266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ac105710 0x7f72ac197ce0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f729c00bda0 tx=0x7f729c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.613+0000 7f72a3400700 1 -- 172.21.15.72:0/3841835266 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f729c01d070 con 0x7f72ac105710 2024-03-19T06:15:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.613+0000 7f72b1600700 1 -- 172.21.15.72:0/3841835266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ac19d790 con 0x7f72ac105710 2024-03-19T06:15:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.613+0000 7f72a3400700 1 -- 172.21.15.72:0/3841835266 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f729c00f460 con 0x7f72ac105710 2024-03-19T06:15:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.613+0000 7f72a3400700 1 -- 172.21.15.72:0/3841835266 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f729c021640 con 0x7f72ac105710 2024-03-19T06:15:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.613+0000 7f72b1600700 1 -- 172.21.15.72:0/3841835266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ac19dc50 con 0x7f72ac105710 2024-03-19T06:15:11.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.615+0000 7f72a0c00700 1 -- 172.21.15.72:0/3841835266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72840052f0 con 0x7f72ac105710 2024-03-19T06:15:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.616+0000 7f72a3400700 1 -- 172.21.15.72:0/3841835266 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f729c00fa00 con 0x7f72ac105710 2024-03-19T06:15:11.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.618+0000 7f72a3400700 1 --2- 172.21.15.72:0/3841835266 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f729006dfa0 0x7f7290070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:11.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.618+0000 7f72a3400700 1 -- 172.21.15.72:0/3841835266 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f729c08f3a0 con 0x7f72ac105710 2024-03-19T06:15:11.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.618+0000 7f72aa000700 1 --2- 172.21.15.72:0/3841835266 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f729006dfa0 0x7f7290070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:11.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.619+0000 7f72aa000700 1 --2- 172.21.15.72:0/3841835266 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f729006dfa0 0x7f7290070450 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7298005950 tx=0x7f72980058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:11.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.621+0000 7f72a3400700 1 -- 172.21.15.72:0/3841835266 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f729c058840 con 0x7f72ac105710 2024-03-19T06:15:11.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.930+0000 7f72a0c00700 1 -- 172.21.15.72:0/3841835266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7284005c90 con 0x7f72ac105710 2024-03-19T06:15:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.931+0000 7f72a3400700 1 -- 172.21.15.72:0/3841835266 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f729c05bf00 con 0x7f72ac105710 2024-03-19T06:15:11.921 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:15:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:15:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:15:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:15:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:15:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:15:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:15:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:15:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 6 2024-03-19T06:15:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:15:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:15:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 4 2024-03-19T06:15:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:15:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:15:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 14 2024-03-19T06:15:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:15:11.922 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:15:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.934+0000 7f72a0c00700 1 -- 172.21.15.72:0/3841835266 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f729006dfa0 msgr2=0x7f7290070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.934+0000 7f72a0c00700 1 --2- 172.21.15.72:0/3841835266 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f729006dfa0 0x7f7290070450 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7298005950 tx=0x7f72980058e0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.934+0000 7f72a0c00700 1 -- 172.21.15.72:0/3841835266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ac105710 msgr2=0x7f72ac197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.934+0000 7f72a0c00700 1 --2- 172.21.15.72:0/3841835266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ac105710 0x7f72ac197ce0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f729c00bda0 tx=0x7f729c00be80 comp rx=0 tx=0).stop 2024-03-19T06:15:11.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.934+0000 7f72a0c00700 1 -- 172.21.15.72:0/3841835266 shutdown_connections 2024-03-19T06:15:11.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.934+0000 7f72a0c00700 1 --2- 172.21.15.72:0/3841835266 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f729006dfa0 0x7f7290070450 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.934+0000 7f72a0c00700 1 --2- 172.21.15.72:0/3841835266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72ac105710 0x7f72ac197ce0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.934+0000 7f72a0c00700 1 --2- 172.21.15.72:0/3841835266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72ac198220 0x7f72ac19d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:11.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.934+0000 7f72a0c00700 1 -- 172.21.15.72:0/3841835266 >> 172.21.15.72:0/3841835266 conn(0x7f72ac0fa780 msgr2=0x7f72ac0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:11.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.935+0000 7f72a0c00700 1 -- 172.21.15.72:0/3841835266 shutdown_connections 2024-03-19T06:15:11.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:11.935+0000 7f72a0c00700 1 -- 172.21.15.72:0/3841835266 wait complete. 2024-03-19T06:15:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.091+0000 7f5d29800700 1 -- 172.21.15.72:0/743643797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24069230 msgr2=0x7f5d24102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.091+0000 7f5d29800700 1 --2- 172.21.15.72:0/743643797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24069230 0x7f5d24102e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009910 tx=0x7f5d14009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.091+0000 7f5d29800700 1 -- 172.21.15.72:0/743643797 shutdown_connections 2024-03-19T06:15:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.091+0000 7f5d29800700 1 --2- 172.21.15.72:0/743643797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d24103350 0x7f5d24105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.091+0000 7f5d29800700 1 --2- 172.21.15.72:0/743643797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24069230 0x7f5d24102e10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.091+0000 7f5d29800700 1 -- 172.21.15.72:0/743643797 >> 172.21.15.72:0/743643797 conn(0x7f5d240fa780 msgr2=0x7f5d240fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.091+0000 7f5d29800700 1 -- 172.21.15.72:0/743643797 shutdown_connections 2024-03-19T06:15:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.091+0000 7f5d29800700 1 -- 172.21.15.72:0/743643797 wait complete. 2024-03-19T06:15:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.092+0000 7f5d29800700 1 Processor -- start 2024-03-19T06:15:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.093+0000 7f5d29800700 1 -- start start 2024-03-19T06:15:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.093+0000 7f5d29800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d24069230 0x7f5d24195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.093+0000 7f5d29800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24103350 0x7f5d24195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.093+0000 7f5d29800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d241965e0 con 0x7f5d24103350 2024-03-19T06:15:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.093+0000 7f5d29800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d24196720 con 0x7f5d24069230 2024-03-19T06:15:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.093+0000 7f5d22000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24103350 0x7f5d24195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.093+0000 7f5d22000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24103350 0x7f5d24195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46514/0 (socket says 172.21.15.72:46514) 2024-03-19T06:15:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.093+0000 7f5d22000700 1 -- 172.21.15.72:0/64585550 learned_addr learned my addr 172.21.15.72:0/64585550 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.094+0000 7f5d22a00700 1 --2- 172.21.15.72:0/64585550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d24069230 0x7f5d24195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.094+0000 7f5d22000700 1 -- 172.21.15.72:0/64585550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d24069230 msgr2=0x7f5d24195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.094+0000 7f5d22000700 1 --2- 172.21.15.72:0/64585550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d24069230 0x7f5d24195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.094+0000 7f5d22000700 1 -- 172.21.15.72:0/64585550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d140095f0 con 0x7f5d24103350 2024-03-19T06:15:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.094+0000 7f5d22000700 1 --2- 172.21.15.72:0/64585550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24103350 0x7f5d24195fc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5d1000d8d0 tx=0x7f5d1000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.094+0000 7f5d1b400700 1 -- 172.21.15.72:0/64585550 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d10009940 con 0x7f5d24103350 2024-03-19T06:15:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.094+0000 7f5d1b400700 1 -- 172.21.15.72:0/64585550 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5d10010460 con 0x7f5d24103350 2024-03-19T06:15:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.094+0000 7f5d29800700 1 -- 172.21.15.72:0/64585550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2419b1d0 con 0x7f5d24103350 2024-03-19T06:15:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.095+0000 7f5d1b400700 1 -- 172.21.15.72:0/64585550 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d1000f5f0 con 0x7f5d24103350 2024-03-19T06:15:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.095+0000 7f5d29800700 1 -- 172.21.15.72:0/64585550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2419b720 con 0x7f5d24103350 2024-03-19T06:15:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.096+0000 7f5d29800700 1 -- 172.21.15.72:0/64585550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d24108cf0 con 0x7f5d24103350 2024-03-19T06:15:12.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.098+0000 7f5d1b400700 1 -- 172.21.15.72:0/64585550 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f5d100105d0 con 0x7f5d24103350 2024-03-19T06:15:12.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.099+0000 7f5d1b400700 1 --2- 172.21.15.72:0/64585550 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5d0806dfa0 0x7f5d08070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:12.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.099+0000 7f5d1b400700 1 -- 172.21.15.72:0/64585550 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5d1008de20 con 0x7f5d24103350 2024-03-19T06:15:12.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.099+0000 7f5d22a00700 1 --2- 172.21.15.72:0/64585550 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5d0806dfa0 0x7f5d08070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:12.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.100+0000 7f5d22a00700 1 --2- 172.21.15.72:0/64585550 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5d0806dfa0 0x7f5d08070450 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009fd0 tx=0x7f5d1400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:12.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.104+0000 7f5d1b400700 1 -- 172.21.15.72:0/64585550 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f5d1005acd0 con 0x7f5d24103350 2024-03-19T06:15:12.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.388+0000 7f5d29800700 1 -- 172.21.15.72:0/64585550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5d24108eb0 con 0x7f5d24103350 2024-03-19T06:15:12.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.389+0000 7f5d1b400700 1 -- 172.21.15.72:0/64585550 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f5d1005a860 con 0x7f5d24103350 2024-03-19T06:15:12.378 INFO:teuthology.orchestra.run.smithi072.stdout:e44 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 44 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:15:10.305125+0000 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:15:12.379 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 83 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=34488,1=34510} 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:15:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:15:12.381 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:15:12.381 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:15:12.381 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:15:12.381 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:34488} state up:active seq 24 join_fscid=1 addr [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:15:12.381 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{1:34510} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.72:6828/3957356790,v1:172.21.15.72:6829/3957356790] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:15:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:15:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:15:12.381 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:15:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:15:12.381 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/1022637060,v1:172.21.15.172:6825/1022637060] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:15:12.381 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3126751850,v1:172.21.15.172:6827/3126751850] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:15:12.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.392+0000 7f5d29800700 1 -- 172.21.15.72:0/64585550 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5d0806dfa0 msgr2=0x7f5d08070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:12.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.392+0000 7f5d29800700 1 --2- 172.21.15.72:0/64585550 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5d0806dfa0 0x7f5d08070450 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009fd0 tx=0x7f5d1400b540 comp rx=0 tx=0).stop 2024-03-19T06:15:12.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.392+0000 7f5d29800700 1 -- 172.21.15.72:0/64585550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24103350 msgr2=0x7f5d24195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:12.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.392+0000 7f5d29800700 1 --2- 172.21.15.72:0/64585550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24103350 0x7f5d24195fc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5d1000d8d0 tx=0x7f5d1000dc90 comp rx=0 tx=0).stop 2024-03-19T06:15:12.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.392+0000 7f5d29800700 1 -- 172.21.15.72:0/64585550 shutdown_connections 2024-03-19T06:15:12.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.392+0000 7f5d29800700 1 --2- 172.21.15.72:0/64585550 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5d0806dfa0 0x7f5d08070450 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.392+0000 7f5d29800700 1 --2- 172.21.15.72:0/64585550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d24069230 0x7f5d24195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.392+0000 7f5d29800700 1 --2- 172.21.15.72:0/64585550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24103350 0x7f5d24195fc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.392+0000 7f5d29800700 1 -- 172.21.15.72:0/64585550 >> 172.21.15.72:0/64585550 conn(0x7f5d240fa780 msgr2=0x7f5d240fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:12.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.392+0000 7f5d29800700 1 -- 172.21.15.72:0/64585550 shutdown_connections 2024-03-19T06:15:12.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.393+0000 7f5d29800700 1 -- 172.21.15.72:0/64585550 wait complete. 2024-03-19T06:15:12.383 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 44 2024-03-19T06:15:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.543+0000 7fe7efe00700 1 -- 172.21.15.72:0/3821229295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f01012c0 msgr2=0x7fe7f0101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.543+0000 7fe7efe00700 1 --2- 172.21.15.72:0/3821229295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f01012c0 0x7fe7f0101730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009910 tx=0x7fe7d8009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:12.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.543+0000 7fe7efe00700 1 -- 172.21.15.72:0/3821229295 shutdown_connections 2024-03-19T06:15:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.543+0000 7fe7efe00700 1 --2- 172.21.15.72:0/3821229295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f01012c0 0x7fe7f0101730 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.543+0000 7fe7efe00700 1 --2- 172.21.15.72:0/3821229295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7f0100020 0x7fe7f0100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.543+0000 7fe7efe00700 1 -- 172.21.15.72:0/3821229295 >> 172.21.15.72:0/3821229295 conn(0x7fe7f00fb650 msgr2=0x7fe7f00fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.543+0000 7fe7efe00700 1 -- 172.21.15.72:0/3821229295 shutdown_connections 2024-03-19T06:15:12.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.543+0000 7fe7efe00700 1 -- 172.21.15.72:0/3821229295 wait complete. 2024-03-19T06:15:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.544+0000 7fe7efe00700 1 Processor -- start 2024-03-19T06:15:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.544+0000 7fe7efe00700 1 -- start start 2024-03-19T06:15:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.544+0000 7fe7efe00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0100020 0x7fe7f0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.544+0000 7fe7efe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7f01012c0 0x7fe7f0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.544+0000 7fe7efe00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0073680 con 0x7fe7f0100020 2024-03-19T06:15:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.544+0000 7fe7efe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00737c0 con 0x7fe7f01012c0 2024-03-19T06:15:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.545+0000 7fe7eea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0100020 0x7fe7f0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.545+0000 7fe7eea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0100020 0x7fe7f0074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46544/0 (socket says 172.21.15.72:46544) 2024-03-19T06:15:12.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.545+0000 7fe7eea00700 1 -- 172.21.15.72:0/2305369764 learned_addr learned my addr 172.21.15.72:0/2305369764 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:12.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.545+0000 7fe7e6000700 1 --2- 172.21.15.72:0/2305369764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7f01012c0 0x7fe7f0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:12.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.545+0000 7fe7eea00700 1 -- 172.21.15.72:0/2305369764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7f01012c0 msgr2=0x7fe7f0073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:12.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.545+0000 7fe7eea00700 1 --2- 172.21.15.72:0/2305369764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7f01012c0 0x7fe7f0073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.545+0000 7fe7eea00700 1 -- 172.21.15.72:0/2305369764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d80095f0 con 0x7fe7f0100020 2024-03-19T06:15:12.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.545+0000 7fe7e6000700 1 --2- 172.21.15.72:0/2305369764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7f01012c0 0x7fe7f0073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:15:12.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.546+0000 7fe7eea00700 1 --2- 172.21.15.72:0/2305369764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0100020 0x7fe7f0074af0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000c930 tx=0x7fe7e000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:12.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.546+0000 7fe7e7e00700 1 -- 172.21.15.72:0/2305369764 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e0007ad0 con 0x7fe7f0100020 2024-03-19T06:15:12.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.546+0000 7fe7e7e00700 1 -- 172.21.15.72:0/2305369764 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe7e0007c30 con 0x7fe7f0100020 2024-03-19T06:15:12.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.546+0000 7fe7efe00700 1 -- 172.21.15.72:0/2305369764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f0073aa0 con 0x7fe7f0100020 2024-03-19T06:15:12.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.546+0000 7fe7efe00700 1 -- 172.21.15.72:0/2305369764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f019d860 con 0x7fe7f0100020 2024-03-19T06:15:12.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.546+0000 7fe7e7e00700 1 -- 172.21.15.72:0/2305369764 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e0018630 con 0x7fe7f0100020 2024-03-19T06:15:12.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.548+0000 7fe7efe00700 1 -- 172.21.15.72:0/2305369764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7cc005320 con 0x7fe7f0100020 2024-03-19T06:15:12.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.549+0000 7fe7e7e00700 1 -- 172.21.15.72:0/2305369764 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fe7e0018900 con 0x7fe7f0100020 2024-03-19T06:15:12.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.549+0000 7fe7e7e00700 1 --2- 172.21.15.72:0/2305369764 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe7d406dfa0 0x7fe7d4070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:12.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.550+0000 7fe7e7e00700 1 -- 172.21.15.72:0/2305369764 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe7e008dff0 con 0x7fe7f0100020 2024-03-19T06:15:12.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.550+0000 7fe7e6000700 1 --2- 172.21.15.72:0/2305369764 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe7d406dfa0 0x7fe7d4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:12.539 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:12 smithi072 ceph-mon[78545]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:12.539 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:12 smithi072 ceph-mon[78545]: pgmap v271: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-19T06:15:12.539 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:12 smithi072 ceph-mon[78545]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:12.539 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:12 smithi072 ceph-mon[78545]: mds.? [v2:172.21.15.72:6828/3957356790,v1:172.21.15.72:6829/3957356790] up:active 2024-03-19T06:15:12.540 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:12 smithi072 ceph-mon[78545]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi072.dvdjwb=up:active} 2 up:standby 2024-03-19T06:15:12.540 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:12 smithi072 ceph-mon[78545]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:12.540 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:12 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3841835266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:12.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.551+0000 7fe7e6000700 1 --2- 172.21.15.72:0/2305369764 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe7d406dfa0 0x7fe7d4070450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8006010 tx=0x7fe7d800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:12.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.557+0000 7fe7e7e00700 1 -- 172.21.15.72:0/2305369764 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fe7e005aee0 con 0x7fe7f0100020 2024-03-19T06:15:12.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:12 smithi172 ceph-mon[66682]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:12.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:12 smithi172 ceph-mon[66682]: pgmap v271: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-19T06:15:12.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:12 smithi172 ceph-mon[66682]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:12.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:12 smithi172 ceph-mon[66682]: mds.? [v2:172.21.15.72:6828/3957356790,v1:172.21.15.72:6829/3957356790] up:active 2024-03-19T06:15:12.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:12 smithi172 ceph-mon[66682]: fsmap cephfs:2 {0=cephfs.smithi072.jhxzfi=up:active,1=cephfs.smithi072.dvdjwb=up:active} 2 up:standby 2024-03-19T06:15:12.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:12 smithi172 ceph-mon[66682]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:12.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:12 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3841835266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:12.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.802+0000 7fe7efe00700 1 -- 172.21.15.72:0/2305369764 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7cc000bf0 con 0x7fe7d406dfa0 2024-03-19T06:15:12.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.805+0000 7fe7e7e00700 1 -- 172.21.15.72:0/2305369764 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fe7cc000bf0 con 0x7fe7d406dfa0 2024-03-19T06:15:12.794 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:15:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:15:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:15:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:15:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:15:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:15:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "mds", 2024-03-19T06:15:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-03-19T06:15:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:15:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:15:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:15:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "16/23 daemons upgraded", 2024-03-19T06:15:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-03-19T06:15:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:15:12.795 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:15:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.808+0000 7fe7efe00700 1 -- 172.21.15.72:0/2305369764 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe7d406dfa0 msgr2=0x7fe7d4070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.808+0000 7fe7efe00700 1 --2- 172.21.15.72:0/2305369764 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe7d406dfa0 0x7fe7d4070450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8006010 tx=0x7fe7d800b540 comp rx=0 tx=0).stop 2024-03-19T06:15:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.808+0000 7fe7efe00700 1 -- 172.21.15.72:0/2305369764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0100020 msgr2=0x7fe7f0074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.808+0000 7fe7efe00700 1 --2- 172.21.15.72:0/2305369764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0100020 0x7fe7f0074af0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000c930 tx=0x7fe7e000ccf0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.808+0000 7fe7efe00700 1 -- 172.21.15.72:0/2305369764 shutdown_connections 2024-03-19T06:15:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.808+0000 7fe7efe00700 1 --2- 172.21.15.72:0/2305369764 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe7d406dfa0 0x7fe7d4070450 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.808+0000 7fe7efe00700 1 --2- 172.21.15.72:0/2305369764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0100020 0x7fe7f0074af0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.808+0000 7fe7efe00700 1 --2- 172.21.15.72:0/2305369764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7f01012c0 0x7fe7f0073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.808+0000 7fe7efe00700 1 -- 172.21.15.72:0/2305369764 >> 172.21.15.72:0/2305369764 conn(0x7fe7f00fb650 msgr2=0x7fe7f01044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:12.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.808+0000 7fe7efe00700 1 -- 172.21.15.72:0/2305369764 shutdown_connections 2024-03-19T06:15:12.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.808+0000 7fe7efe00700 1 -- 172.21.15.72:0/2305369764 wait complete. 2024-03-19T06:15:12.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.964+0000 7fa30ac00700 1 -- 172.21.15.72:0/254747093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa304101440 msgr2=0x7fa304101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.964+0000 7fa30ac00700 1 --2- 172.21.15.72:0/254747093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa304101440 0x7fa304101890 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009910 tx=0x7fa2ec009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.964+0000 7fa30ac00700 1 -- 172.21.15.72:0/254747093 shutdown_connections 2024-03-19T06:15:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.964+0000 7fa30ac00700 1 --2- 172.21.15.72:0/254747093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa304101440 0x7fa304101890 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.964+0000 7fa30ac00700 1 --2- 172.21.15.72:0/254747093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa304100240 0x7fa304100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.964+0000 7fa30ac00700 1 -- 172.21.15.72:0/254747093 >> 172.21.15.72:0/254747093 conn(0x7fa3040fb7f0 msgr2=0x7fa3040fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.964+0000 7fa30ac00700 1 -- 172.21.15.72:0/254747093 shutdown_connections 2024-03-19T06:15:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.964+0000 7fa30ac00700 1 -- 172.21.15.72:0/254747093 wait complete. 2024-03-19T06:15:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.965+0000 7fa30ac00700 1 Processor -- start 2024-03-19T06:15:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.965+0000 7fa30ac00700 1 -- start start 2024-03-19T06:15:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.966+0000 7fa30ac00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa304100240 0x7fa304197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.966+0000 7fa30ac00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa304101440 0x7fa304198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.966+0000 7fa30ac00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3041988b0 con 0x7fa304100240 2024-03-19T06:15:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.966+0000 7fa30ac00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3041989f0 con 0x7fa304101440 2024-03-19T06:15:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.966+0000 7fa303e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa304100240 0x7fa304197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.966+0000 7fa303e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa304100240 0x7fa304197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46550/0 (socket says 172.21.15.72:46550) 2024-03-19T06:15:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.966+0000 7fa303e00700 1 -- 172.21.15.72:0/1087671454 learned_addr learned my addr 172.21.15.72:0/1087671454 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.966+0000 7fa303400700 1 --2- 172.21.15.72:0/1087671454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa304101440 0x7fa304198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.966+0000 7fa303e00700 1 -- 172.21.15.72:0/1087671454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa304101440 msgr2=0x7fa304198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.966+0000 7fa303e00700 1 --2- 172.21.15.72:0/1087671454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa304101440 0x7fa304198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.966+0000 7fa303e00700 1 -- 172.21.15.72:0/1087671454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec0095f0 con 0x7fa304100240 2024-03-19T06:15:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.967+0000 7fa303e00700 1 --2- 172.21.15.72:0/1087671454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa304100240 0x7fa304197d50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400b480 tx=0x7fa2f400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.967+0000 7fa300c00700 1 -- 172.21.15.72:0/1087671454 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f40118c0 con 0x7fa304100240 2024-03-19T06:15:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.967+0000 7fa300c00700 1 -- 172.21.15.72:0/1087671454 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa2f4010380 con 0x7fa304100240 2024-03-19T06:15:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.967+0000 7fa30ac00700 1 -- 172.21.15.72:0/1087671454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30419d4a0 con 0x7fa304100240 2024-03-19T06:15:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.967+0000 7fa300c00700 1 -- 172.21.15.72:0/1087671454 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f400f4f0 con 0x7fa304100240 2024-03-19T06:15:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.967+0000 7fa30ac00700 1 -- 172.21.15.72:0/1087671454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30419d9f0 con 0x7fa304100240 2024-03-19T06:15:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.968+0000 7fa30ac00700 1 -- 172.21.15.72:0/1087671454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa304105520 con 0x7fa304100240 2024-03-19T06:15:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.970+0000 7fa300c00700 1 -- 172.21.15.72:0/1087671454 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fa2f40104f0 con 0x7fa304100240 2024-03-19T06:15:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.972+0000 7fa300c00700 1 --2- 172.21.15.72:0/1087671454 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa2e806dfa0 0x7fa2e8070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.972+0000 7fa300c00700 1 -- 172.21.15.72:0/1087671454 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa2f408d9f0 con 0x7fa304100240 2024-03-19T06:15:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.972+0000 7fa303400700 1 --2- 172.21.15.72:0/1087671454 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa2e806dfa0 0x7fa2e8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.973+0000 7fa303400700 1 --2- 172.21.15.72:0/1087671454 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa2e806dfa0 0x7fa2e8070450 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec006010 tx=0x7fa2ec00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:12.977+0000 7fa300c00700 1 -- 172.21.15.72:0/1087671454 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fa2f405a960 con 0x7fa304100240 2024-03-19T06:15:13.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.286+0000 7fa30ac00700 1 -- 172.21.15.72:0/1087671454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa30402cc30 con 0x7fa304100240 2024-03-19T06:15:13.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.286+0000 7fa300c00700 1 -- 172.21.15.72:0/1087671454 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fa2f405a4f0 con 0x7fa304100240 2024-03-19T06:15:13.276 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:15:13.276 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:15:13.276 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:15:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.289+0000 7fa30ac00700 1 -- 172.21.15.72:0/1087671454 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa2e806dfa0 msgr2=0x7fa2e8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.289+0000 7fa30ac00700 1 --2- 172.21.15.72:0/1087671454 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa2e806dfa0 0x7fa2e8070450 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec006010 tx=0x7fa2ec00b540 comp rx=0 tx=0).stop 2024-03-19T06:15:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.289+0000 7fa30ac00700 1 -- 172.21.15.72:0/1087671454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa304100240 msgr2=0x7fa304197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.289+0000 7fa30ac00700 1 --2- 172.21.15.72:0/1087671454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa304100240 0x7fa304197d50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400b480 tx=0x7fa2f400b840 comp rx=0 tx=0).stop 2024-03-19T06:15:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.289+0000 7fa30ac00700 1 -- 172.21.15.72:0/1087671454 shutdown_connections 2024-03-19T06:15:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.289+0000 7fa30ac00700 1 --2- 172.21.15.72:0/1087671454 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa2e806dfa0 0x7fa2e8070450 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.289+0000 7fa30ac00700 1 --2- 172.21.15.72:0/1087671454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa304100240 0x7fa304197d50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.289+0000 7fa30ac00700 1 --2- 172.21.15.72:0/1087671454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa304101440 0x7fa304198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.289+0000 7fa30ac00700 1 -- 172.21.15.72:0/1087671454 >> 172.21.15.72:0/1087671454 conn(0x7fa3040fb7f0 msgr2=0x7fa304102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.290+0000 7fa30ac00700 1 -- 172.21.15.72:0/1087671454 shutdown_connections 2024-03-19T06:15:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:13.290+0000 7fa30ac00700 1 -- 172.21.15.72:0/1087671454 wait complete. 2024-03-19T06:15:13.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:13 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/64585550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:15:13.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:13 smithi072 ceph-mon[78545]: Upgrade: Updating ceph-exporter.smithi072 (1/2) 2024-03-19T06:15:13.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:13 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:13.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:13 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T06:15:13.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:13 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:15:13.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:13 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1087671454' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:15:13.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:13 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/64585550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:15:13.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:13 smithi172 ceph-mon[66682]: Upgrade: Updating ceph-exporter.smithi072 (1/2) 2024-03-19T06:15:13.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:13 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:13.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:13 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi072", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T06:15:13.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:13 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:15:13.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:13 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1087671454' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:15:14.893 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:14 smithi072 ceph-mon[78545]: Deploying daemon ceph-exporter.smithi072 on smithi072 2024-03-19T06:15:14.893 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:14 smithi072 ceph-mon[78545]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:14.893 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:14 smithi072 ceph-mon[78545]: pgmap v272: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-19T06:15:14.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:14 smithi172 ceph-mon[66682]: Deploying daemon ceph-exporter.smithi072 on smithi072 2024-03-19T06:15:14.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:14 smithi172 ceph-mon[66682]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:14.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:14 smithi172 ceph-mon[66682]: pgmap v272: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-19T06:15:15.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:15 smithi172 ceph-mon[66682]: pgmap v273: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-03-19T06:15:16.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:15 smithi072 ceph-mon[78545]: pgmap v273: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-03-19T06:15:18.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:17 smithi072 ceph-mon[78545]: pgmap v274: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-19T06:15:18.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:17 smithi172 ceph-mon[66682]: pgmap v274: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-19T06:15:19.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:19.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:19 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:19.590 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:19.590 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:19 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:20.526 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:20 smithi172 ceph-mon[66682]: pgmap v275: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-19T06:15:20.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:20 smithi072 ceph-mon[78545]: pgmap v275: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-19T06:15:21.828 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:21 smithi172 ceph-mon[66682]: Upgrade: Updating ceph-exporter.smithi172 (2/2) 2024-03-19T06:15:21.828 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:21 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:21.828 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:21 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T06:15:21.828 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:21 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:15:21.828 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:21 smithi172 ceph-mon[66682]: Deploying daemon ceph-exporter.smithi172 on smithi172 2024-03-19T06:15:21.828 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:21 smithi172 ceph-mon[66682]: pgmap v276: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-19T06:15:22.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:21 smithi072 ceph-mon[78545]: Upgrade: Updating ceph-exporter.smithi172 (2/2) 2024-03-19T06:15:22.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:21 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:22.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:21 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-19T06:15:22.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:21 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:15:22.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:21 smithi072 ceph-mon[78545]: Deploying daemon ceph-exporter.smithi172 on smithi172 2024-03-19T06:15:22.075 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:21 smithi072 ceph-mon[78545]: pgmap v276: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-19T06:15:24.008 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:23 smithi172 ceph-mon[66682]: pgmap v277: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-19T06:15:24.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:23 smithi072 ceph-mon[78545]: pgmap v277: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-19T06:15:25.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:15:25.357 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:24 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:15:25.998 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:25 smithi072 ceph-mon[78545]: pgmap v278: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-19T06:15:26.017 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:25 smithi172 ceph-mon[66682]: pgmap v278: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 5.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-19T06:15:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:27 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:27 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:27.508 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:27 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:15:27.587 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:27 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:27.587 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:27 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:27.587 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:27 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:15:28.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:28 smithi072 ceph-mon[78545]: pgmap v279: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 3 op/s 2024-03-19T06:15:28.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:28 smithi172 ceph-mon[66682]: pgmap v279: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 3 op/s 2024-03-19T06:15:30.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:30 smithi072 ceph-mon[78545]: pgmap v280: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:30.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:30 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:30.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:30 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:30.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:30 smithi172 ceph-mon[66682]: pgmap v280: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:30.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:30 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:30.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:30 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:32.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:32 smithi072 ceph-mon[78545]: pgmap v281: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:32.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:32.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:32.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:32 smithi172 ceph-mon[66682]: pgmap v281: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:32.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:32.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:33.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:33 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:33.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:33 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:33.869 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:33 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:33.869 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:33 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:34.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:34 smithi172 ceph-mon[66682]: pgmap v282: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:35.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:34 smithi072 ceph-mon[78545]: pgmap v282: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:35.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:35 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:35.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:35 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:35.841 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:35 smithi072 ceph-mon[78545]: pgmap v283: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:35.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:35 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:35.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:35 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:35.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:35 smithi172 ceph-mon[66682]: pgmap v283: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:38.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:38 smithi072 ceph-mon[78545]: pgmap v284: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:38.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:38 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:38.325 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:38 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:38.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:38 smithi172 ceph-mon[66682]: pgmap v284: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:38.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:38 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:38.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:38 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:40.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:40 smithi172 ceph-mon[66682]: pgmap v285: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:40.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:15:40.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:40 smithi072 ceph-mon[78545]: pgmap v285: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:40.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:15:41.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:15:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:15:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:15:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi072"}]: dispatch 2024-03-19T06:15:41.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi072"}]': finished 2024-03-19T06:15:41.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi172"}]: dispatch 2024-03-19T06:15:41.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi172"}]': finished 2024-03-19T06:15:41.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:15:41.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi072"}]: dispatch 2024-03-19T06:15:41.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi072"}]': finished 2024-03-19T06:15:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi172"}]: dispatch 2024-03-19T06:15:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi172"}]': finished 2024-03-19T06:15:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:41.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:42.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:42 smithi072 ceph-mon[78545]: Upgrade: Setting container_image for all ceph-exporter 2024-03-19T06:15:42.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:42 smithi072 ceph-mon[78545]: Upgrade: Setting container_image for all iscsi 2024-03-19T06:15:42.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:42 smithi072 ceph-mon[78545]: Upgrade: Setting container_image for all nfs 2024-03-19T06:15:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:42 smithi072 ceph-mon[78545]: Upgrade: Setting container_image for all nvmeof 2024-03-19T06:15:42.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:42 smithi072 ceph-mon[78545]: pgmap v286: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:42.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:42 smithi172 ceph-mon[66682]: Upgrade: Setting container_image for all ceph-exporter 2024-03-19T06:15:42.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:42 smithi172 ceph-mon[66682]: Upgrade: Setting container_image for all iscsi 2024-03-19T06:15:42.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:42 smithi172 ceph-mon[66682]: Upgrade: Setting container_image for all nfs 2024-03-19T06:15:42.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:42 smithi172 ceph-mon[66682]: Upgrade: Setting container_image for all nvmeof 2024-03-19T06:15:42.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:42 smithi172 ceph-mon[66682]: pgmap v286: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.457+0000 7fadc1e00700 1 -- 172.21.15.72:0/2797284533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadbc1003d0 msgr2=0x7fadbc100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.457+0000 7fadc1e00700 1 --2- 172.21.15.72:0/2797284533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadbc1003d0 0x7fadbc100840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fada8009910 tx=0x7fada8009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:43.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.457+0000 7fadc1e00700 1 -- 172.21.15.72:0/2797284533 shutdown_connections 2024-03-19T06:15:43.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.457+0000 7fadc1e00700 1 --2- 172.21.15.72:0/2797284533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadbc1003d0 0x7fadbc100840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:43.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.457+0000 7fadc1e00700 1 --2- 172.21.15.72:0/2797284533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadbc0ff130 0x7fadbc0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:43.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.457+0000 7fadc1e00700 1 -- 172.21.15.72:0/2797284533 >> 172.21.15.72:0/2797284533 conn(0x7fadbc0fa780 msgr2=0x7fadbc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:43.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.457+0000 7fadc1e00700 1 -- 172.21.15.72:0/2797284533 shutdown_connections 2024-03-19T06:15:43.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.457+0000 7fadc1e00700 1 -- 172.21.15.72:0/2797284533 wait complete. 2024-03-19T06:15:43.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.458+0000 7fadc1e00700 1 Processor -- start 2024-03-19T06:15:43.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.459+0000 7fadc1e00700 1 -- start start 2024-03-19T06:15:43.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.459+0000 7fadc1e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadbc0ff130 0x7fadbc197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:43.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.459+0000 7fadc1e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadbc1003d0 0x7fadbc1981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:43.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.459+0000 7fadc1e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc1987b0 con 0x7fadbc1003d0 2024-03-19T06:15:43.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.459+0000 7fadc1e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc198920 con 0x7fadbc0ff130 2024-03-19T06:15:43.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.459+0000 7fadba000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadbc1003d0 0x7fadbc1981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:43.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.459+0000 7fadba000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadbc1003d0 0x7fadbc1981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48116/0 (socket says 172.21.15.72:48116) 2024-03-19T06:15:43.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.459+0000 7fadba000700 1 -- 172.21.15.72:0/2781025957 learned_addr learned my addr 172.21.15.72:0/2781025957 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:43.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.460+0000 7fadbaa00700 1 --2- 172.21.15.72:0/2781025957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadbc0ff130 0x7fadbc197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:43.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.460+0000 7fadba000700 1 -- 172.21.15.72:0/2781025957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadbc0ff130 msgr2=0x7fadbc197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:43.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.460+0000 7fadba000700 1 --2- 172.21.15.72:0/2781025957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadbc0ff130 0x7fadbc197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:43.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.460+0000 7fadba000700 1 -- 172.21.15.72:0/2781025957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada80095f0 con 0x7fadbc1003d0 2024-03-19T06:15:43.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.460+0000 7fadba000700 1 --2- 172.21.15.72:0/2781025957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadbc1003d0 0x7fadbc1981b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fada8005b40 tx=0x7fada800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:43.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.461+0000 7fadc0a00700 1 -- 172.21.15.72:0/2781025957 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fada801d070 con 0x7fadbc1003d0 2024-03-19T06:15:43.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.461+0000 7fadc0a00700 1 -- 172.21.15.72:0/2781025957 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fada8022470 con 0x7fadbc1003d0 2024-03-19T06:15:43.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.461+0000 7fadc1e00700 1 -- 172.21.15.72:0/2781025957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadbc19d350 con 0x7fadbc1003d0 2024-03-19T06:15:43.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.461+0000 7fadc0a00700 1 -- 172.21.15.72:0/2781025957 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fada800f690 con 0x7fadbc1003d0 2024-03-19T06:15:43.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.461+0000 7fadc1e00700 1 -- 172.21.15.72:0/2781025957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadbc19d840 con 0x7fadbc1003d0 2024-03-19T06:15:43.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.462+0000 7fadc1e00700 1 -- 172.21.15.72:0/2781025957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadbc107c10 con 0x7fadbc1003d0 2024-03-19T06:15:43.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.464+0000 7fadc0a00700 1 -- 172.21.15.72:0/2781025957 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fada80225e0 con 0x7fadbc1003d0 2024-03-19T06:15:43.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.465+0000 7fadc0a00700 1 --2- 172.21.15.72:0/2781025957 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fada006dfa0 0x7fada0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:43.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.465+0000 7fadc0a00700 1 -- 172.21.15.72:0/2781025957 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fada808f5a0 con 0x7fadbc1003d0 2024-03-19T06:15:43.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.465+0000 7fadbaa00700 1 --2- 172.21.15.72:0/2781025957 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fada006dfa0 0x7fada0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:43.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.466+0000 7fadbaa00700 1 --2- 172.21.15.72:0/2781025957 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fada006dfa0 0x7fada0070450 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fadac005950 tx=0x7fadac005ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:43.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.470+0000 7fadc0a00700 1 -- 172.21.15.72:0/2781025957 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fada8058a40 con 0x7fadbc1003d0 2024-03-19T06:15:43.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.724+0000 7fadc1e00700 1 -- 172.21.15.72:0/2781025957 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fadbc19df40 con 0x7fada006dfa0 2024-03-19T06:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.726+0000 7fadc0a00700 1 -- 172.21.15.72:0/2781025957 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7fadbc19df40 con 0x7fada006dfa0 2024-03-19T06:15:43.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.729+0000 7fadc1e00700 1 -- 172.21.15.72:0/2781025957 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fada006dfa0 msgr2=0x7fada0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:43.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.729+0000 7fadc1e00700 1 --2- 172.21.15.72:0/2781025957 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fada006dfa0 0x7fada0070450 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fadac005950 tx=0x7fadac005ed0 comp rx=0 tx=0).stop 2024-03-19T06:15:43.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.729+0000 7fadc1e00700 1 -- 172.21.15.72:0/2781025957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadbc1003d0 msgr2=0x7fadbc1981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:43.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.729+0000 7fadc1e00700 1 --2- 172.21.15.72:0/2781025957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadbc1003d0 0x7fadbc1981b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fada8005b40 tx=0x7fada800be20 comp rx=0 tx=0).stop 2024-03-19T06:15:43.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.729+0000 7fadc1e00700 1 -- 172.21.15.72:0/2781025957 shutdown_connections 2024-03-19T06:15:43.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.729+0000 7fadc1e00700 1 --2- 172.21.15.72:0/2781025957 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fada006dfa0 0x7fada0070450 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:43.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.729+0000 7fadc1e00700 1 --2- 172.21.15.72:0/2781025957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadbc0ff130 0x7fadbc197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:43.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.729+0000 7fadc1e00700 1 --2- 172.21.15.72:0/2781025957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadbc1003d0 0x7fadbc1981b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:43.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.729+0000 7fadc1e00700 1 -- 172.21.15.72:0/2781025957 >> 172.21.15.72:0/2781025957 conn(0x7fadbc0fa780 msgr2=0x7fadbc068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:43.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.729+0000 7fadc1e00700 1 -- 172.21.15.72:0/2781025957 shutdown_connections 2024-03-19T06:15:43.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.729+0000 7fadc1e00700 1 -- 172.21.15.72:0/2781025957 wait complete. 2024-03-19T06:15:43.737 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:15:43.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.913+0000 7f6220e00700 1 -- 172.21.15.72:0/840225988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621c100240 msgr2=0x7f621c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:43.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.913+0000 7f6220e00700 1 --2- 172.21.15.72:0/840225988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621c100240 0x7f621c100650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f620c009910 tx=0x7f620c009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:43.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.913+0000 7f6220e00700 1 -- 172.21.15.72:0/840225988 shutdown_connections 2024-03-19T06:15:43.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.913+0000 7f6220e00700 1 --2- 172.21.15.72:0/840225988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f621c101440 0x7f621c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:43.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.913+0000 7f6220e00700 1 --2- 172.21.15.72:0/840225988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621c100240 0x7f621c100650 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:43.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.913+0000 7f6220e00700 1 -- 172.21.15.72:0/840225988 >> 172.21.15.72:0/840225988 conn(0x7f621c0fb7f0 msgr2=0x7f621c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:43.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.913+0000 7f6220e00700 1 -- 172.21.15.72:0/840225988 shutdown_connections 2024-03-19T06:15:43.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.913+0000 7f6220e00700 1 -- 172.21.15.72:0/840225988 wait complete. 2024-03-19T06:15:43.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.915+0000 7f6220e00700 1 Processor -- start 2024-03-19T06:15:43.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.915+0000 7f6220e00700 1 -- start start 2024-03-19T06:15:43.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.915+0000 7f6220e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621c100240 0x7f621c197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:43.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.915+0000 7f6220e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f621c101440 0x7f621c1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:43.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.915+0000 7f6220e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c1987f0 con 0x7f621c100240 2024-03-19T06:15:43.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.915+0000 7f6220e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c198960 con 0x7f621c101440 2024-03-19T06:15:43.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.916+0000 7f6219e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621c100240 0x7f621c197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:43.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.916+0000 7f6219e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621c100240 0x7f621c197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34132/0 (socket says 172.21.15.72:34132) 2024-03-19T06:15:43.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.916+0000 7f6219e00700 1 -- 172.21.15.72:0/3963714068 learned_addr learned my addr 172.21.15.72:0/3963714068 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:43.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.916+0000 7f6219400700 1 --2- 172.21.15.72:0/3963714068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f621c101440 0x7f621c1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:43.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.916+0000 7f6219e00700 1 -- 172.21.15.72:0/3963714068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f621c101440 msgr2=0x7f621c1981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:43.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.916+0000 7f6219e00700 1 --2- 172.21.15.72:0/3963714068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f621c101440 0x7f621c1981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:43.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.916+0000 7f6219e00700 1 -- 172.21.15.72:0/3963714068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c0095f0 con 0x7f621c100240 2024-03-19T06:15:43.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.916+0000 7f6219400700 1 --2- 172.21.15.72:0/3963714068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f621c101440 0x7f621c1981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:15:43.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.917+0000 7f6219e00700 1 --2- 172.21.15.72:0/3963714068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621c100240 0x7f621c197cb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f620c00bda0 tx=0x7f620c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:43.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.917+0000 7f6212a00700 1 -- 172.21.15.72:0/3963714068 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f620c01d070 con 0x7f621c100240 2024-03-19T06:15:43.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.917+0000 7f6220e00700 1 -- 172.21.15.72:0/3963714068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c19d390 con 0x7f621c100240 2024-03-19T06:15:43.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.917+0000 7f6212a00700 1 -- 172.21.15.72:0/3963714068 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f620c00f460 con 0x7f621c100240 2024-03-19T06:15:43.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.917+0000 7f6212a00700 1 -- 172.21.15.72:0/3963714068 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f620c021640 con 0x7f621c100240 2024-03-19T06:15:43.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.917+0000 7f6220e00700 1 -- 172.21.15.72:0/3963714068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c19d880 con 0x7f621c100240 2024-03-19T06:15:43.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.918+0000 7f6220e00700 1 -- 172.21.15.72:0/3963714068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621c105520 con 0x7f621c100240 2024-03-19T06:15:43.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.919+0000 7f6212a00700 1 -- 172.21.15.72:0/3963714068 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f620c00f5d0 con 0x7f621c100240 2024-03-19T06:15:43.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.921+0000 7f6212a00700 1 --2- 172.21.15.72:0/3963714068 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f620006dfa0 0x7f6200070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:43.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.921+0000 7f6212a00700 1 -- 172.21.15.72:0/3963714068 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f620c08f0d0 con 0x7f621c100240 2024-03-19T06:15:43.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.921+0000 7f6219400700 1 --2- 172.21.15.72:0/3963714068 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f620006dfa0 0x7f6200070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:43.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.922+0000 7f6219400700 1 --2- 172.21.15.72:0/3963714068 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f620006dfa0 0x7f6200070450 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6208005fd0 tx=0x7f6208005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:43.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:43.925+0000 7f6212a00700 1 -- 172.21.15.72:0/3963714068 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f620c058490 con 0x7f621c100240 2024-03-19T06:15:44.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.189+0000 7f6220e00700 1 -- 172.21.15.72:0/3963714068 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f621c061190 con 0x7f620006dfa0 2024-03-19T06:15:44.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.191+0000 7f6212a00700 1 -- 172.21.15.72:0/3963714068 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f621c061190 con 0x7f620006dfa0 2024-03-19T06:15:44.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.193+0000 7f6220e00700 1 -- 172.21.15.72:0/3963714068 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f620006dfa0 msgr2=0x7f6200070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:44.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.193+0000 7f6220e00700 1 --2- 172.21.15.72:0/3963714068 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f620006dfa0 0x7f6200070450 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6208005fd0 tx=0x7f6208005ee0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.193+0000 7f6220e00700 1 -- 172.21.15.72:0/3963714068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621c100240 msgr2=0x7f621c197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:44.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.193+0000 7f6220e00700 1 --2- 172.21.15.72:0/3963714068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621c100240 0x7f621c197cb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f620c00bda0 tx=0x7f620c00be80 comp rx=0 tx=0).stop 2024-03-19T06:15:44.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.194+0000 7f6220e00700 1 -- 172.21.15.72:0/3963714068 shutdown_connections 2024-03-19T06:15:44.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.194+0000 7f6220e00700 1 --2- 172.21.15.72:0/3963714068 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f620006dfa0 0x7f6200070450 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.194+0000 7f6220e00700 1 --2- 172.21.15.72:0/3963714068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621c100240 0x7f621c197cb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.194+0000 7f6220e00700 1 --2- 172.21.15.72:0/3963714068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f621c101440 0x7f621c1981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.194+0000 7f6220e00700 1 -- 172.21.15.72:0/3963714068 >> 172.21.15.72:0/3963714068 conn(0x7f621c0fb7f0 msgr2=0x7f621c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:44.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.194+0000 7f6220e00700 1 -- 172.21.15.72:0/3963714068 shutdown_connections 2024-03-19T06:15:44.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.194+0000 7f6220e00700 1 -- 172.21.15.72:0/3963714068 wait complete. 2024-03-19T06:15:44.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.370+0000 7f025a800700 1 -- 172.21.15.72:0/3120045798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02540737b0 msgr2=0x7f0254073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:44.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.370+0000 7f025a800700 1 --2- 172.21.15.72:0/3120045798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02540737b0 0x7f0254073c20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0240009910 tx=0x7f0240009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:44.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.370+0000 7f025a800700 1 -- 172.21.15.72:0/3120045798 shutdown_connections 2024-03-19T06:15:44.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.370+0000 7f025a800700 1 --2- 172.21.15.72:0/3120045798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02540737b0 0x7f0254073c20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.370+0000 7f025a800700 1 --2- 172.21.15.72:0/3120045798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0254074d80 0x7f02540731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.370+0000 7f025a800700 1 -- 172.21.15.72:0/3120045798 >> 172.21.15.72:0/3120045798 conn(0x7f02540fb7f0 msgr2=0x7f02540fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:44.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.370+0000 7f025a800700 1 -- 172.21.15.72:0/3120045798 shutdown_connections 2024-03-19T06:15:44.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.370+0000 7f025a800700 1 -- 172.21.15.72:0/3120045798 wait complete. 2024-03-19T06:15:44.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.371+0000 7f025a800700 1 Processor -- start 2024-03-19T06:15:44.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.371+0000 7f025a800700 1 -- start start 2024-03-19T06:15:44.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.371+0000 7f025a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02540737b0 0x7f025419c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:44.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.371+0000 7f025a800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0254074d80 0x7f025419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:44.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.371+0000 7f025a800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025419cbd0 con 0x7f02540737b0 2024-03-19T06:15:44.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.371+0000 7f025a800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025419cd10 con 0x7f0254074d80 2024-03-19T06:15:44.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.372+0000 7f0253400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02540737b0 0x7f025419c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:44.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.372+0000 7f0253400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02540737b0 0x7f025419c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34140/0 (socket says 172.21.15.72:34140) 2024-03-19T06:15:44.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.372+0000 7f0253400700 1 -- 172.21.15.72:0/295856829 learned_addr learned my addr 172.21.15.72:0/295856829 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:44.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.372+0000 7f0252a00700 1 --2- 172.21.15.72:0/295856829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0254074d80 0x7f025419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:44.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.372+0000 7f0253400700 1 -- 172.21.15.72:0/295856829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0254074d80 msgr2=0x7f025419c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:44.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.372+0000 7f0253400700 1 --2- 172.21.15.72:0/295856829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0254074d80 0x7f025419c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.372+0000 7f0253400700 1 -- 172.21.15.72:0/295856829 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02400095f0 con 0x7f02540737b0 2024-03-19T06:15:44.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.372+0000 7f0253400700 1 --2- 172.21.15.72:0/295856829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02540737b0 0x7f025419c070 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f024400c8a0 tx=0x7f024400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:44.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.373+0000 7f024be00700 1 -- 172.21.15.72:0/295856829 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f024400cea0 con 0x7f02540737b0 2024-03-19T06:15:44.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.373+0000 7f025a800700 1 -- 172.21.15.72:0/295856829 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02541a17c0 con 0x7f02540737b0 2024-03-19T06:15:44.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.373+0000 7f024be00700 1 -- 172.21.15.72:0/295856829 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0244004830 con 0x7f02540737b0 2024-03-19T06:15:44.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.373+0000 7f024be00700 1 -- 172.21.15.72:0/295856829 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02440055b0 con 0x7f02540737b0 2024-03-19T06:15:44.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.373+0000 7f025a800700 1 -- 172.21.15.72:0/295856829 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02541a1d10 con 0x7f02540737b0 2024-03-19T06:15:44.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.374+0000 7f025a800700 1 -- 172.21.15.72:0/295856829 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025410f380 con 0x7f02540737b0 2024-03-19T06:15:44.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.376+0000 7f024be00700 1 -- 172.21.15.72:0/295856829 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f0244007ad0 con 0x7f02540737b0 2024-03-19T06:15:44.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.377+0000 7f024be00700 1 --2- 172.21.15.72:0/295856829 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f023806dfa0 0x7f0238070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:44.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.377+0000 7f024be00700 1 -- 172.21.15.72:0/295856829 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f024408db40 con 0x7f02540737b0 2024-03-19T06:15:44.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.377+0000 7f0252a00700 1 --2- 172.21.15.72:0/295856829 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f023806dfa0 0x7f0238070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:44.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.378+0000 7f0252a00700 1 --2- 172.21.15.72:0/295856829 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f023806dfa0 0x7f0238070450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0240006010 tx=0x7f024000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:44.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.382+0000 7f024be00700 1 -- 172.21.15.72:0/295856829 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f024405aa70 con 0x7f02540737b0 2024-03-19T06:15:44.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:44 smithi072 ceph-mon[78545]: pgmap v287: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:44.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:44 smithi072 ceph-mon[78545]: Upgrade: Updating node-exporter.smithi072 (1/2) 2024-03-19T06:15:44.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:44 smithi072 ceph-mon[78545]: Deploying daemon node-exporter.smithi072 on smithi072 2024-03-19T06:15:44.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.639+0000 7f025a800700 1 -- 172.21.15.72:0/295856829 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f02541031e0 con 0x7f023806dfa0 2024-03-19T06:15:44.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:44 smithi172 ceph-mon[66682]: pgmap v287: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:44.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:44 smithi172 ceph-mon[66682]: Upgrade: Updating node-exporter.smithi072 (1/2) 2024-03-19T06:15:44.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:44 smithi172 ceph-mon[66682]: Deploying daemon node-exporter.smithi072 on smithi072 2024-03-19T06:15:44.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.671+0000 7f024be00700 1 -- 172.21.15.72:0/295856829 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f02541031e0 con 0x7f023806dfa0 2024-03-19T06:15:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:15:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (20m) 12s ago 22m 14.3M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:15:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (26s) 12s ago 22m 7838k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 7e45101af382 2024-03-19T06:15:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (19s) 14s ago 20m 6920k - 19.0.0-1934-gb0ea271b 5c4d8774b57a d8a7d621cc29 2024-03-19T06:15:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (6m) 12s ago 22m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:15:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (6m) 14s ago 20m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:15:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (19m) 12s ago 21m 73.8M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:15:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (99s) 12s ago 14m 15.2M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 3ea4b00e2248 2024-03-19T06:15:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (2m) 12s ago 14m 67.8M - 19.0.0-1934-gb0ea271b 5c4d8774b57a d0daead2fe2a 2024-03-19T06:15:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (49s) 14s ago 14m 12.0M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 788348d02918 2024-03-19T06:15:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (73s) 14s ago 14m 12.2M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 2cbfb6aeff05 2024-03-19T06:15:44.661 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (10m) 12s ago 24m 510M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:15:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (9m) 14s ago 20m 453M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:15:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (8m) 12s ago 24m 59.9M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:15:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (7m) 14s ago 20m 45.0M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:15:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (22m) 12s ago 22m 7948k - 1.5.0 0da6a335fe13 95d232c7701c 2024-03-19T06:15:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (20m) 14s ago 20m 8158k - 1.5.0 0da6a335fe13 a19caccb8f58 2024-03-19T06:15:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (6m) 12s ago 19m 98.7M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:15:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (5m) 12s ago 19m 103M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:15:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (5m) 12s ago 18m 92.8M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:15:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (4m) 14s ago 17m 106M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:15:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (3m) 14s ago 17m 99.4M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:15:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (3m) 14s ago 16m 91.4M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a c47c9c7fd3c7 2024-03-19T06:15:44.662 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (9m) 12s ago 21m 73.5M - 2.43.0 a07b618ecd1d 7d63b55a5b38 2024-03-19T06:15:44.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.673+0000 7f025a800700 1 -- 172.21.15.72:0/295856829 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f023806dfa0 msgr2=0x7f0238070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:44.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.673+0000 7f025a800700 1 --2- 172.21.15.72:0/295856829 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f023806dfa0 0x7f0238070450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0240006010 tx=0x7f024000b540 comp rx=0 tx=0).stop 2024-03-19T06:15:44.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.673+0000 7f025a800700 1 -- 172.21.15.72:0/295856829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02540737b0 msgr2=0x7f025419c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:44.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.673+0000 7f025a800700 1 --2- 172.21.15.72:0/295856829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02540737b0 0x7f025419c070 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f024400c8a0 tx=0x7f024400cc60 comp rx=0 tx=0).stop 2024-03-19T06:15:44.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.674+0000 7f025a800700 1 -- 172.21.15.72:0/295856829 shutdown_connections 2024-03-19T06:15:44.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.674+0000 7f025a800700 1 --2- 172.21.15.72:0/295856829 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f023806dfa0 0x7f0238070450 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.674+0000 7f025a800700 1 --2- 172.21.15.72:0/295856829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02540737b0 0x7f025419c070 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.674+0000 7f025a800700 1 --2- 172.21.15.72:0/295856829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0254074d80 0x7f025419c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.674+0000 7f025a800700 1 -- 172.21.15.72:0/295856829 >> 172.21.15.72:0/295856829 conn(0x7f02540fb7f0 msgr2=0x7f0254101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:44.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.674+0000 7f025a800700 1 -- 172.21.15.72:0/295856829 shutdown_connections 2024-03-19T06:15:44.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.674+0000 7f025a800700 1 -- 172.21.15.72:0/295856829 wait complete. 2024-03-19T06:15:44.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.825+0000 7f8c2f800700 1 -- 172.21.15.72:0/2701230224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c28100240 msgr2=0x7f8c28100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:44.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.825+0000 7f8c2f800700 1 --2- 172.21.15.72:0/2701230224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c28100240 0x7f8c28100650 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009910 tx=0x7f8c1c009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:44.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.826+0000 7f8c2f800700 1 -- 172.21.15.72:0/2701230224 shutdown_connections 2024-03-19T06:15:44.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.826+0000 7f8c2f800700 1 --2- 172.21.15.72:0/2701230224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c28101440 0x7f8c28101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.826+0000 7f8c2f800700 1 --2- 172.21.15.72:0/2701230224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c28100240 0x7f8c28100650 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.826+0000 7f8c2f800700 1 -- 172.21.15.72:0/2701230224 >> 172.21.15.72:0/2701230224 conn(0x7f8c280fb7f0 msgr2=0x7f8c280fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:44.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.826+0000 7f8c2f800700 1 -- 172.21.15.72:0/2701230224 shutdown_connections 2024-03-19T06:15:44.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.826+0000 7f8c2f800700 1 -- 172.21.15.72:0/2701230224 wait complete. 2024-03-19T06:15:44.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.827+0000 7f8c2f800700 1 Processor -- start 2024-03-19T06:15:44.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.827+0000 7f8c2f800700 1 -- start start 2024-03-19T06:15:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.827+0000 7f8c2f800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c28100240 0x7f8c28195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.827+0000 7f8c2f800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c28101440 0x7f8c281960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.827+0000 7f8c2f800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c281966c0 con 0x7f8c28100240 2024-03-19T06:15:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.827+0000 7f8c2f800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28196800 con 0x7f8c28101440 2024-03-19T06:15:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.828+0000 7f8c2ce00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c28100240 0x7f8c28195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.828+0000 7f8c2ce00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c28100240 0x7f8c28195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34146/0 (socket says 172.21.15.72:34146) 2024-03-19T06:15:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.828+0000 7f8c2ce00700 1 -- 172.21.15.72:0/2469621806 learned_addr learned my addr 172.21.15.72:0/2469621806 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.828+0000 7f8c2ce00700 1 -- 172.21.15.72:0/2469621806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c28101440 msgr2=0x7f8c281960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.828+0000 7f8c2ce00700 1 --2- 172.21.15.72:0/2469621806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c28101440 0x7f8c281960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.828+0000 7f8c2ce00700 1 -- 172.21.15.72:0/2469621806 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0095f0 con 0x7f8c28100240 2024-03-19T06:15:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.828+0000 7f8c2ce00700 1 --2- 172.21.15.72:0/2469621806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c28100240 0x7f8c28195b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00bda0 tx=0x7f8c1c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.829+0000 7f8c25600700 1 -- 172.21.15.72:0/2469621806 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c1c01d070 con 0x7f8c28100240 2024-03-19T06:15:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.829+0000 7f8c25600700 1 -- 172.21.15.72:0/2469621806 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c1c004c50 con 0x7f8c28100240 2024-03-19T06:15:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.829+0000 7f8c2f800700 1 -- 172.21.15.72:0/2469621806 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2819b250 con 0x7f8c28100240 2024-03-19T06:15:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.829+0000 7f8c25600700 1 -- 172.21.15.72:0/2469621806 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c1c00f630 con 0x7f8c28100240 2024-03-19T06:15:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.829+0000 7f8c2f800700 1 -- 172.21.15.72:0/2469621806 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2819b740 con 0x7f8c28100240 2024-03-19T06:15:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.830+0000 7f8c2f800700 1 -- 172.21.15.72:0/2469621806 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c28108e10 con 0x7f8c28100240 2024-03-19T06:15:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.831+0000 7f8c25600700 1 -- 172.21.15.72:0/2469621806 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f8c1c022a20 con 0x7f8c28100240 2024-03-19T06:15:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.832+0000 7f8c25600700 1 --2- 172.21.15.72:0/2469621806 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f8c1006dfa0 0x7f8c10070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.832+0000 7f8c25600700 1 -- 172.21.15.72:0/2469621806 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8c1c08f540 con 0x7f8c28100240 2024-03-19T06:15:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.832+0000 7f8c27e00700 1 --2- 172.21.15.72:0/2469621806 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f8c1006dfa0 0x7f8c10070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.833+0000 7f8c27e00700 1 --2- 172.21.15.72:0/2469621806 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f8c1006dfa0 0x7f8c10070450 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c140097b0 tx=0x7f8c14006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:44.837+0000 7f8c25600700 1 -- 172.21.15.72:0/2469621806 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f8c1c05c4a0 con 0x7f8c28100240 2024-03-19T06:15:45.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.236+0000 7f8c2f800700 1 -- 172.21.15.72:0/2469621806 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8c2819bdd0 con 0x7f8c28100240 2024-03-19T06:15:45.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.237+0000 7f8c25600700 1 -- 172.21.15.72:0/2469621806 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f8c1c05c030 con 0x7f8c28100240 2024-03-19T06:15:45.227 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:15:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:15:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:15:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:15:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:15:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:15:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:15:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:15:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 6 2024-03-19T06:15:45.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:15:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:15:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 4 2024-03-19T06:15:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:15:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:15:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 14 2024-03-19T06:15:45.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:15:45.228 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:15:45.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.239+0000 7f8c2f800700 1 -- 172.21.15.72:0/2469621806 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f8c1006dfa0 msgr2=0x7f8c10070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:45.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.239+0000 7f8c2f800700 1 --2- 172.21.15.72:0/2469621806 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f8c1006dfa0 0x7f8c10070450 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c140097b0 tx=0x7f8c14006d20 comp rx=0 tx=0).stop 2024-03-19T06:15:45.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.239+0000 7f8c2f800700 1 -- 172.21.15.72:0/2469621806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c28100240 msgr2=0x7f8c28195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:45.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.239+0000 7f8c2f800700 1 --2- 172.21.15.72:0/2469621806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c28100240 0x7f8c28195b60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00bda0 tx=0x7f8c1c00be80 comp rx=0 tx=0).stop 2024-03-19T06:15:45.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.240+0000 7f8c2f800700 1 -- 172.21.15.72:0/2469621806 shutdown_connections 2024-03-19T06:15:45.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.240+0000 7f8c2f800700 1 --2- 172.21.15.72:0/2469621806 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f8c1006dfa0 0x7f8c10070450 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:45.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.240+0000 7f8c2f800700 1 --2- 172.21.15.72:0/2469621806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c28100240 0x7f8c28195b60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:45.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.240+0000 7f8c2f800700 1 --2- 172.21.15.72:0/2469621806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c28101440 0x7f8c281960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:45.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.240+0000 7f8c2f800700 1 -- 172.21.15.72:0/2469621806 >> 172.21.15.72:0/2469621806 conn(0x7f8c280fb7f0 msgr2=0x7f8c28104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:45.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.240+0000 7f8c2f800700 1 -- 172.21.15.72:0/2469621806 shutdown_connections 2024-03-19T06:15:45.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.240+0000 7f8c2f800700 1 -- 172.21.15.72:0/2469621806 wait complete. 2024-03-19T06:15:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.388+0000 7f038e200700 1 -- 172.21.15.72:0/1144162687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0388101440 msgr2=0x7f0388101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.388+0000 7f038e200700 1 --2- 172.21.15.72:0/1144162687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0388101440 0x7f0388101890 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0370009910 tx=0x7f0370009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:45.377 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:45 smithi072 ceph-mon[78545]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:45.378 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:45 smithi072 ceph-mon[78545]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:45.378 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:45 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2469621806' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.388+0000 7f038e200700 1 -- 172.21.15.72:0/1144162687 shutdown_connections 2024-03-19T06:15:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.388+0000 7f038e200700 1 --2- 172.21.15.72:0/1144162687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0388101440 0x7f0388101890 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.388+0000 7f038e200700 1 --2- 172.21.15.72:0/1144162687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0388100240 0x7f0388100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.388+0000 7f038e200700 1 -- 172.21.15.72:0/1144162687 >> 172.21.15.72:0/1144162687 conn(0x7f03880fb7f0 msgr2=0x7f03880fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.388+0000 7f038e200700 1 -- 172.21.15.72:0/1144162687 shutdown_connections 2024-03-19T06:15:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.388+0000 7f038e200700 1 -- 172.21.15.72:0/1144162687 wait complete. 2024-03-19T06:15:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.390+0000 7f038e200700 1 Processor -- start 2024-03-19T06:15:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.390+0000 7f038e200700 1 -- start start 2024-03-19T06:15:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.390+0000 7f038e200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0388100240 0x7f0388195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.390+0000 7f038e200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0388101440 0x7f0388195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.391+0000 7f038e200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0388196610 con 0x7f0388101440 2024-03-19T06:15:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.391+0000 7f038e200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0388196750 con 0x7f0388100240 2024-03-19T06:15:45.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.391+0000 7f037ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0388101440 0x7f0388195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.391+0000 7f037ea00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0388101440 0x7f0388195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34156/0 (socket says 172.21.15.72:34156) 2024-03-19T06:15:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.391+0000 7f037ea00700 1 -- 172.21.15.72:0/425452447 learned_addr learned my addr 172.21.15.72:0/425452447 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.391+0000 7f0387400700 1 --2- 172.21.15.72:0/425452447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0388100240 0x7f0388195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.392+0000 7f037ea00700 1 -- 172.21.15.72:0/425452447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0388100240 msgr2=0x7f0388195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.392+0000 7f037ea00700 1 --2- 172.21.15.72:0/425452447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0388100240 0x7f0388195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.392+0000 7f037ea00700 1 -- 172.21.15.72:0/425452447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700095f0 con 0x7f0388101440 2024-03-19T06:15:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.392+0000 7f0387400700 1 --2- 172.21.15.72:0/425452447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0388100240 0x7f0388195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:15:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.392+0000 7f037ea00700 1 --2- 172.21.15.72:0/425452447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0388101440 0x7f0388195ff0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0370005b40 tx=0x7f037000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.392+0000 7f0384c00700 1 -- 172.21.15.72:0/425452447 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f037001d070 con 0x7f0388101440 2024-03-19T06:15:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.392+0000 7f0384c00700 1 -- 172.21.15.72:0/425452447 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0370022470 con 0x7f0388101440 2024-03-19T06:15:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.392+0000 7f038e200700 1 -- 172.21.15.72:0/425452447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038819b1a0 con 0x7f0388101440 2024-03-19T06:15:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.393+0000 7f038e200700 1 -- 172.21.15.72:0/425452447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038819b690 con 0x7f0388101440 2024-03-19T06:15:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.393+0000 7f0384c00700 1 -- 172.21.15.72:0/425452447 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f037000f690 con 0x7f0388101440 2024-03-19T06:15:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.394+0000 7f038e200700 1 -- 172.21.15.72:0/425452447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0364005320 con 0x7f0388101440 2024-03-19T06:15:45.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.395+0000 7f0384c00700 1 -- 172.21.15.72:0/425452447 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f0370004b70 con 0x7f0388101440 2024-03-19T06:15:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.396+0000 7f0384c00700 1 --2- 172.21.15.72:0/425452447 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f036c06dfa0 0x7f036c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.396+0000 7f0384c00700 1 -- 172.21.15.72:0/425452447 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f037008f320 con 0x7f0388101440 2024-03-19T06:15:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.396+0000 7f0387400700 1 --2- 172.21.15.72:0/425452447 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f036c06dfa0 0x7f036c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:45.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.397+0000 7f0387400700 1 --2- 172.21.15.72:0/425452447 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f036c06dfa0 0x7f036c070450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f03881012a0 tx=0x7f0378005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:45.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.401+0000 7f0384c00700 1 -- 172.21.15.72:0/425452447 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f037005c4c0 con 0x7f0388101440 2024-03-19T06:15:45.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:45 smithi172 ceph-mon[66682]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:45.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:45 smithi172 ceph-mon[66682]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:45.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:45 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2469621806' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:15:45.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.713+0000 7f038e200700 1 -- 172.21.15.72:0/425452447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0364006200 con 0x7f0388101440 2024-03-19T06:15:45.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.714+0000 7f0384c00700 1 -- 172.21.15.72:0/425452447 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f037005c050 con 0x7f0388101440 2024-03-19T06:15:45.704 INFO:teuthology.orchestra.run.smithi072.stdout:e44 2024-03-19T06:15:45.704 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:15:45.704 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:15:45.704 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:15:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:15:45.704 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:15:45.704 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:15:45.704 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 44 2024-03-19T06:15:45.704 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:15:10.305125+0000 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 83 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:15:45.705 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=34488,1=34510} 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:34488} state up:active seq 24 join_fscid=1 addr [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{1:34510} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.72:6828/3957356790,v1:172.21.15.72:6829/3957356790] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:15:45.706 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/1022637060,v1:172.21.15.172:6825/1022637060] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:15:45.710 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3126751850,v1:172.21.15.172:6827/3126751850] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:15:45.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.718+0000 7f038e200700 1 -- 172.21.15.72:0/425452447 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f036c06dfa0 msgr2=0x7f036c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:45.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.718+0000 7f038e200700 1 --2- 172.21.15.72:0/425452447 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f036c06dfa0 0x7f036c070450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f03881012a0 tx=0x7f0378005f90 comp rx=0 tx=0).stop 2024-03-19T06:15:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.718+0000 7f038e200700 1 -- 172.21.15.72:0/425452447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0388101440 msgr2=0x7f0388195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.718+0000 7f038e200700 1 --2- 172.21.15.72:0/425452447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0388101440 0x7f0388195ff0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0370005b40 tx=0x7f037000be20 comp rx=0 tx=0).stop 2024-03-19T06:15:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.718+0000 7f038e200700 1 -- 172.21.15.72:0/425452447 shutdown_connections 2024-03-19T06:15:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.718+0000 7f038e200700 1 --2- 172.21.15.72:0/425452447 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f036c06dfa0 0x7f036c070450 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.718+0000 7f038e200700 1 --2- 172.21.15.72:0/425452447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0388100240 0x7f0388195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.718+0000 7f038e200700 1 --2- 172.21.15.72:0/425452447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0388101440 0x7f0388195ff0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.718+0000 7f038e200700 1 -- 172.21.15.72:0/425452447 >> 172.21.15.72:0/425452447 conn(0x7f03880fb7f0 msgr2=0x7f0388104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.718+0000 7f038e200700 1 -- 172.21.15.72:0/425452447 shutdown_connections 2024-03-19T06:15:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.719+0000 7f038e200700 1 -- 172.21.15.72:0/425452447 wait complete. 2024-03-19T06:15:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 44 2024-03-19T06:15:45.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.885+0000 7f7f5b400700 1 -- 172.21.15.72:0/1037904189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f54074d80 msgr2=0x7f7f540731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:45.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.885+0000 7f7f5b400700 1 --2- 172.21.15.72:0/1037904189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f54074d80 0x7f7f540731e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009940 tx=0x7f7f48009c50 comp rx=0 tx=0).stop 2024-03-19T06:15:45.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.885+0000 7f7f5b400700 1 -- 172.21.15.72:0/1037904189 shutdown_connections 2024-03-19T06:15:45.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.885+0000 7f7f5b400700 1 --2- 172.21.15.72:0/1037904189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f540737b0 0x7f7f54073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:45.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.885+0000 7f7f5b400700 1 --2- 172.21.15.72:0/1037904189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f54074d80 0x7f7f540731e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:45.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.885+0000 7f7f5b400700 1 -- 172.21.15.72:0/1037904189 >> 172.21.15.72:0/1037904189 conn(0x7f7f540fb7f0 msgr2=0x7f7f540fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:45.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.885+0000 7f7f5b400700 1 -- 172.21.15.72:0/1037904189 shutdown_connections 2024-03-19T06:15:45.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.885+0000 7f7f5b400700 1 -- 172.21.15.72:0/1037904189 wait complete. 2024-03-19T06:15:45.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.886+0000 7f7f5b400700 1 Processor -- start 2024-03-19T06:15:45.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.886+0000 7f7f5b400700 1 -- start start 2024-03-19T06:15:45.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.886+0000 7f7f5b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f540737b0 0x7f7f54197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:45.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.886+0000 7f7f5b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f54074d80 0x7f7f541981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:45.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.887+0000 7f7f5b400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f541987c0 con 0x7f7f540737b0 2024-03-19T06:15:45.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.887+0000 7f7f5b400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f54198930 con 0x7f7f54074d80 2024-03-19T06:15:45.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.887+0000 7f7f58a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f540737b0 0x7f7f54197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:45.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.887+0000 7f7f58a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f540737b0 0x7f7f54197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34184/0 (socket says 172.21.15.72:34184) 2024-03-19T06:15:45.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.887+0000 7f7f58a00700 1 -- 172.21.15.72:0/1724085410 learned_addr learned my addr 172.21.15.72:0/1724085410 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:45.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.887+0000 7f7f53e00700 1 --2- 172.21.15.72:0/1724085410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f54074d80 0x7f7f541981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:45.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.887+0000 7f7f58a00700 1 -- 172.21.15.72:0/1724085410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f54074d80 msgr2=0x7f7f541981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:45.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.887+0000 7f7f58a00700 1 --2- 172.21.15.72:0/1724085410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f54074d80 0x7f7f541981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:45.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.887+0000 7f7f58a00700 1 -- 172.21.15.72:0/1724085410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f480095f0 con 0x7f7f540737b0 2024-03-19T06:15:45.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.888+0000 7f7f58a00700 1 --2- 172.21.15.72:0/1724085410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f540737b0 0x7f7f54197c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7f480055f0 tx=0x7f7f480056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:45.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.888+0000 7f7f51600700 1 -- 172.21.15.72:0/1724085410 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4801d070 con 0x7f7f540737b0 2024-03-19T06:15:45.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.888+0000 7f7f51600700 1 -- 172.21.15.72:0/1724085410 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f48003ba0 con 0x7f7f540737b0 2024-03-19T06:15:45.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.888+0000 7f7f5b400700 1 -- 172.21.15.72:0/1724085410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5419d360 con 0x7f7f540737b0 2024-03-19T06:15:45.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.888+0000 7f7f51600700 1 -- 172.21.15.72:0/1724085410 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f48021710 con 0x7f7f540737b0 2024-03-19T06:15:45.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.888+0000 7f7f5b400700 1 -- 172.21.15.72:0/1724085410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5419d850 con 0x7f7f540737b0 2024-03-19T06:15:45.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.889+0000 7f7f5b400700 1 -- 172.21.15.72:0/1724085410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5410af80 con 0x7f7f540737b0 2024-03-19T06:15:45.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.890+0000 7f7f51600700 1 -- 172.21.15.72:0/1724085410 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f7f4800faa0 con 0x7f7f540737b0 2024-03-19T06:15:45.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.891+0000 7f7f51600700 1 --2- 172.21.15.72:0/1724085410 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7f3c06dfa0 0x7f7f3c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:45.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.891+0000 7f7f51600700 1 -- 172.21.15.72:0/1724085410 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7f4808f230 con 0x7f7f540737b0 2024-03-19T06:15:45.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.892+0000 7f7f53e00700 1 --2- 172.21.15.72:0/1724085410 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7f3c06dfa0 0x7f7f3c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:45.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.892+0000 7f7f53e00700 1 --2- 172.21.15.72:0/1724085410 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7f3c06dfa0 0x7f7f3c070450 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f40005fd0 tx=0x7f7f4000a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:45.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:45.897+0000 7f7f51600700 1 -- 172.21.15.72:0/1724085410 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f7f480585b0 con 0x7f7f540737b0 2024-03-19T06:15:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.156+0000 7f7f5b400700 1 -- 172.21.15.72:0/1724085410 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f5419df50 con 0x7f7f3c06dfa0 2024-03-19T06:15:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.158+0000 7f7f51600700 1 -- 172.21.15.72:0/1724085410 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f7f5419df50 con 0x7f7f3c06dfa0 2024-03-19T06:15:46.147 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:15:46.147 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:15:46.147 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:15:46.147 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:15:46.148 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:15:46.148 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:15:46.148 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph-exporter", 2024-03-19T06:15:46.148 INFO:teuthology.orchestra.run.smithi072.stdout: "mds", 2024-03-19T06:15:46.148 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-03-19T06:15:46.148 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:15:46.148 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:15:46.149 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:15:46.149 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "18/23 daemons upgraded", 2024-03-19T06:15:46.149 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading node-exporter daemons", 2024-03-19T06:15:46.149 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:15:46.149 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:15:46.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.160+0000 7f7f5b400700 1 -- 172.21.15.72:0/1724085410 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7f3c06dfa0 msgr2=0x7f7f3c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:46.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.160+0000 7f7f5b400700 1 --2- 172.21.15.72:0/1724085410 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7f3c06dfa0 0x7f7f3c070450 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f40005fd0 tx=0x7f7f4000a560 comp rx=0 tx=0).stop 2024-03-19T06:15:46.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.160+0000 7f7f5b400700 1 -- 172.21.15.72:0/1724085410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f540737b0 msgr2=0x7f7f54197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:46.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.161+0000 7f7f5b400700 1 --2- 172.21.15.72:0/1724085410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f540737b0 0x7f7f54197c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7f480055f0 tx=0x7f7f480056d0 comp rx=0 tx=0).stop 2024-03-19T06:15:46.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.161+0000 7f7f5b400700 1 -- 172.21.15.72:0/1724085410 shutdown_connections 2024-03-19T06:15:46.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.161+0000 7f7f5b400700 1 --2- 172.21.15.72:0/1724085410 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7f3c06dfa0 0x7f7f3c070450 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:46.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.161+0000 7f7f5b400700 1 --2- 172.21.15.72:0/1724085410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f540737b0 0x7f7f54197c80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.161+0000 7f7f5b400700 1 --2- 172.21.15.72:0/1724085410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f54074d80 0x7f7f541981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.161+0000 7f7f5b400700 1 -- 172.21.15.72:0/1724085410 >> 172.21.15.72:0/1724085410 conn(0x7f7f540fb7f0 msgr2=0x7f7f54106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.161+0000 7f7f5b400700 1 -- 172.21.15.72:0/1724085410 shutdown_connections 2024-03-19T06:15:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.161+0000 7f7f5b400700 1 -- 172.21.15.72:0/1724085410 wait complete. 2024-03-19T06:15:46.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.314+0000 7f7141c00700 1 -- 172.21.15.72:0/3316076471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f713c102430 msgr2=0x7f713c102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:46.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.314+0000 7f7141c00700 1 --2- 172.21.15.72:0/3316076471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f713c102430 0x7f713c102840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f712c009910 tx=0x7f712c009c20 comp rx=0 tx=0).stop 2024-03-19T06:15:46.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.314+0000 7f7141c00700 1 -- 172.21.15.72:0/3316076471 shutdown_connections 2024-03-19T06:15:46.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.314+0000 7f7141c00700 1 --2- 172.21.15.72:0/3316076471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f713c1036d0 0x7f713c103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:46.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.314+0000 7f7141c00700 1 --2- 172.21.15.72:0/3316076471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f713c102430 0x7f713c102840 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:46.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.314+0000 7f7141c00700 1 -- 172.21.15.72:0/3316076471 >> 172.21.15.72:0/3316076471 conn(0x7f713c0fda80 msgr2=0x7f713c0ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:46.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.315+0000 7f7141c00700 1 -- 172.21.15.72:0/3316076471 shutdown_connections 2024-03-19T06:15:46.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.315+0000 7f7141c00700 1 -- 172.21.15.72:0/3316076471 wait complete. 2024-03-19T06:15:46.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.316+0000 7f7141c00700 1 Processor -- start 2024-03-19T06:15:46.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.316+0000 7f7141c00700 1 -- start start 2024-03-19T06:15:46.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.316+0000 7f7141c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f713c102430 0x7f713c197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:46.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.316+0000 7f7141c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f713c1036d0 0x7f713c1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:46.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.316+0000 7f7141c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c1987e0 con 0x7f713c102430 2024-03-19T06:15:46.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.316+0000 7f7141c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c198950 con 0x7f713c1036d0 2024-03-19T06:15:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.316+0000 7f713aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f713c102430 0x7f713c197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.317+0000 7f713aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f713c102430 0x7f713c197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34202/0 (socket says 172.21.15.72:34202) 2024-03-19T06:15:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.317+0000 7f713aa00700 1 -- 172.21.15.72:0/2108110000 learned_addr learned my addr 172.21.15.72:0/2108110000 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:15:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.317+0000 7f713aa00700 1 -- 172.21.15.72:0/2108110000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f713c1036d0 msgr2=0x7f713c1981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.317+0000 7f713aa00700 1 --2- 172.21.15.72:0/2108110000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f713c1036d0 0x7f713c1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.317+0000 7f713aa00700 1 -- 172.21.15.72:0/2108110000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c0095f0 con 0x7f713c102430 2024-03-19T06:15:46.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.317+0000 7f713aa00700 1 --2- 172.21.15.72:0/2108110000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f713c102430 0x7f713c197ca0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f712c00b5c0 tx=0x7f712c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:46.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.318+0000 7f7133400700 1 -- 172.21.15.72:0/2108110000 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f712c01d070 con 0x7f713c102430 2024-03-19T06:15:46.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.318+0000 7f7133400700 1 -- 172.21.15.72:0/2108110000 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f712c022470 con 0x7f713c102430 2024-03-19T06:15:46.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.318+0000 7f7133400700 1 -- 172.21.15.72:0/2108110000 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f712c00f690 con 0x7f713c102430 2024-03-19T06:15:46.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.318+0000 7f7141c00700 1 -- 172.21.15.72:0/2108110000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c19d380 con 0x7f713c102430 2024-03-19T06:15:46.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.318+0000 7f7141c00700 1 -- 172.21.15.72:0/2108110000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c19d820 con 0x7f713c102430 2024-03-19T06:15:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.319+0000 7f7141c00700 1 -- 172.21.15.72:0/2108110000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c10af30 con 0x7f713c102430 2024-03-19T06:15:46.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.321+0000 7f7133400700 1 -- 172.21.15.72:0/2108110000 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f712c004b70 con 0x7f713c102430 2024-03-19T06:15:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.322+0000 7f7133400700 1 --2- 172.21.15.72:0/2108110000 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f712006dfa0 0x7f7120070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:15:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.322+0000 7f7133400700 1 -- 172.21.15.72:0/2108110000 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f712c08fa00 con 0x7f713c102430 2024-03-19T06:15:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.323+0000 7f713a000700 1 --2- 172.21.15.72:0/2108110000 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f712006dfa0 0x7f7120070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:15:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.323+0000 7f713a000700 1 --2- 172.21.15.72:0/2108110000 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f712006dfa0 0x7f7120070450 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f713c1991b0 tx=0x7f7128005c80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:15:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.325+0000 7f7133400700 1 -- 172.21.15.72:0/2108110000 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f712c058eb0 con 0x7f713c102430 2024-03-19T06:15:46.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:46 smithi072 ceph-mon[78545]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:46.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:46 smithi072 ceph-mon[78545]: pgmap v288: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:46.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:46 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/425452447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:15:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.629+0000 7f7141c00700 1 -- 172.21.15.72:0/2108110000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f713c19df70 con 0x7f713c102430 2024-03-19T06:15:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.630+0000 7f7133400700 1 -- 172.21.15.72:0/2108110000 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f712c0310e0 con 0x7f713c102430 2024-03-19T06:15:46.619 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:15:46.619 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:15:46.620 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:15:46.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.633+0000 7f7141c00700 1 -- 172.21.15.72:0/2108110000 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f712006dfa0 msgr2=0x7f7120070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:46.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.633+0000 7f7141c00700 1 --2- 172.21.15.72:0/2108110000 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f712006dfa0 0x7f7120070450 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f713c1991b0 tx=0x7f7128005c80 comp rx=0 tx=0).stop 2024-03-19T06:15:46.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.633+0000 7f7141c00700 1 -- 172.21.15.72:0/2108110000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f713c102430 msgr2=0x7f713c197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:15:46.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.633+0000 7f7141c00700 1 --2- 172.21.15.72:0/2108110000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f713c102430 0x7f713c197ca0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f712c00b5c0 tx=0x7f712c00be20 comp rx=0 tx=0).stop 2024-03-19T06:15:46.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.633+0000 7f7141c00700 1 -- 172.21.15.72:0/2108110000 shutdown_connections 2024-03-19T06:15:46.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.633+0000 7f7141c00700 1 --2- 172.21.15.72:0/2108110000 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f712006dfa0 0x7f7120070450 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:46.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.633+0000 7f7141c00700 1 --2- 172.21.15.72:0/2108110000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f713c102430 0x7f713c197ca0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:46.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.633+0000 7f7141c00700 1 --2- 172.21.15.72:0/2108110000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f713c1036d0 0x7f713c1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:15:46.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.633+0000 7f7141c00700 1 -- 172.21.15.72:0/2108110000 >> 172.21.15.72:0/2108110000 conn(0x7f713c0fda80 msgr2=0x7f713c106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:15:46.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.634+0000 7f7141c00700 1 -- 172.21.15.72:0/2108110000 shutdown_connections 2024-03-19T06:15:46.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:15:46.634+0000 7f7141c00700 1 -- 172.21.15.72:0/2108110000 wait complete. 2024-03-19T06:15:46.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:46 smithi172 ceph-mon[66682]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:46.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:46 smithi172 ceph-mon[66682]: pgmap v288: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:46.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:46 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/425452447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:15:47.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:47 smithi172 ceph-mon[66682]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:47.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:47 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2108110000' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:15:47.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:47 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:47.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:47 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:47.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:47 smithi072 ceph-mon[78545]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:15:47.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:47 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2108110000' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:15:47.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:47 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:47.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:47 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:48.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:48 smithi172 ceph-mon[66682]: pgmap v289: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:48.817 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:48 smithi072 ceph-mon[78545]: pgmap v289: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:50.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:50 smithi172 ceph-mon[66682]: pgmap v290: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:50.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:50 smithi172 ceph-mon[66682]: Upgrade: Updating node-exporter.smithi172 (2/2) 2024-03-19T06:15:50.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:50 smithi172 ceph-mon[66682]: Deploying daemon node-exporter.smithi172 on smithi172 2024-03-19T06:15:50.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:50 smithi072 ceph-mon[78545]: pgmap v290: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:50.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:50 smithi072 ceph-mon[78545]: Upgrade: Updating node-exporter.smithi172 (2/2) 2024-03-19T06:15:50.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:50 smithi072 ceph-mon[78545]: Deploying daemon node-exporter.smithi172 on smithi172 2024-03-19T06:15:52.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:52 smithi072 ceph-mon[78545]: pgmap v291: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:52.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:52 smithi172 ceph-mon[66682]: pgmap v291: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:54.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:54 smithi072 ceph-mon[78545]: pgmap v292: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:54.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:54 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:54.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:54 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:54.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:54 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:15:54.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:54 smithi172 ceph-mon[66682]: pgmap v292: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:54.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:54 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:54.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:54 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:54.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:54 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:15:55.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:15:55.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:15:56.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:56 smithi072 ceph-mon[78545]: pgmap v293: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:56.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:56 smithi172 ceph-mon[66682]: pgmap v293: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:58.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:57 smithi072 ceph-mon[78545]: pgmap v294: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:58.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:58.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:58.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:57 smithi172 ceph-mon[66682]: pgmap v294: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:15:58.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:15:58.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:00.311 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:59 smithi172 ceph-mon[66682]: pgmap v295: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:00.312 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:59 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:00.312 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:59 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:00.312 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:59 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:00.312 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:15:59 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:00.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:59 smithi072 ceph-mon[78545]: pgmap v295: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:00.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:59 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:00.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:59 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:00.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:59 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:00.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:15:59 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:02.151 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:01 smithi172 ceph-mon[66682]: pgmap v296: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:02.151 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:01 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:02.151 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:01 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:02.303 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:01 smithi072 ceph-mon[78545]: pgmap v296: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:02.303 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:01 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:02.303 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:01 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:04.152 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:03 smithi172 ceph-mon[66682]: pgmap v297: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:04.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:03 smithi072 ceph-mon[78545]: pgmap v297: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:05.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:05.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:05 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:05.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:05.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:05 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:06.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:06 smithi172 ceph-mon[66682]: pgmap v298: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:06.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:06 smithi072 ceph-mon[78545]: pgmap v298: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:08.630 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: pgmap v299: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:08.630 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:08.630 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:08.630 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:16:08.630 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:16:08.630 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:08.630 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:16:08.630 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.631 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.631 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.631 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.631 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.631 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.631 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.631 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.631 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.631 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.631 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.631 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.631 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:08 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: pgmap v299: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:08.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:08.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:08.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:08.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:08 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:10.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:10 smithi172 ceph-mon[66682]: pgmap v300: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:10.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:16:10.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:10 smithi072 ceph-mon[78545]: pgmap v300: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:10.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:16:11.623 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:11 smithi072 ceph-mon[78545]: Upgrade: Updating prometheus.smithi072 2024-03-19T06:16:11.623 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:11 smithi072 ceph-mon[78545]: Deploying daemon prometheus.smithi072 on smithi072 2024-03-19T06:16:11.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:11 smithi172 ceph-mon[66682]: Upgrade: Updating prometheus.smithi072 2024-03-19T06:16:11.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:11 smithi172 ceph-mon[66682]: Deploying daemon prometheus.smithi072 on smithi072 2024-03-19T06:16:12.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:12 smithi072 ceph-mon[78545]: pgmap v301: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:12.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:12 smithi172 ceph-mon[66682]: pgmap v301: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:14.598 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:14 smithi072 ceph-mon[78545]: pgmap v302: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:14.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:14 smithi172 ceph-mon[66682]: pgmap v302: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:16.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:16 smithi172 ceph-mon[66682]: pgmap v303: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:16.791 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:16 smithi072 ceph-mon[78545]: pgmap v303: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.800+0000 7f0859e00700 1 -- 172.21.15.72:0/1623473716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854100020 msgr2=0x7f0854100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.801+0000 7f0859e00700 1 --2- 172.21.15.72:0/1623473716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854100020 0x7f0854100430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0848009910 tx=0x7f0848009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.801+0000 7f0859e00700 1 -- 172.21.15.72:0/1623473716 shutdown_connections 2024-03-19T06:16:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.801+0000 7f0859e00700 1 --2- 172.21.15.72:0/1623473716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08541012c0 0x7f0854101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.801+0000 7f0859e00700 1 --2- 172.21.15.72:0/1623473716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854100020 0x7f0854100430 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.801+0000 7f0859e00700 1 -- 172.21.15.72:0/1623473716 >> 172.21.15.72:0/1623473716 conn(0x7f08540fb650 msgr2=0x7f08540fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.801+0000 7f0859e00700 1 -- 172.21.15.72:0/1623473716 shutdown_connections 2024-03-19T06:16:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.801+0000 7f0859e00700 1 -- 172.21.15.72:0/1623473716 wait complete. 2024-03-19T06:16:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.802+0000 7f0859e00700 1 Processor -- start 2024-03-19T06:16:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.802+0000 7f0859e00700 1 -- start start 2024-03-19T06:16:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.803+0000 7f0859e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854100020 0x7f0854074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.803+0000 7f0859e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08541012c0 0x7f0854073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.803+0000 7f0859e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0854073680 con 0x7f0854100020 2024-03-19T06:16:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.803+0000 7f0859e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08540737c0 con 0x7f08541012c0 2024-03-19T06:16:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.803+0000 7f0858a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854100020 0x7f0854074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.803+0000 7f0858a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854100020 0x7f0854074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46350/0 (socket says 172.21.15.72:46350) 2024-03-19T06:16:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.803+0000 7f0858a00700 1 -- 172.21.15.72:0/1545578219 learned_addr learned my addr 172.21.15.72:0/1545578219 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.804+0000 7f0853e00700 1 --2- 172.21.15.72:0/1545578219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08541012c0 0x7f0854073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.804+0000 7f0858a00700 1 -- 172.21.15.72:0/1545578219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08541012c0 msgr2=0x7f0854073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.804+0000 7f0858a00700 1 --2- 172.21.15.72:0/1545578219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08541012c0 0x7f0854073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.804+0000 7f0858a00700 1 -- 172.21.15.72:0/1545578219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480095f0 con 0x7f0854100020 2024-03-19T06:16:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.804+0000 7f0858a00700 1 --2- 172.21.15.72:0/1545578219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854100020 0x7f0854074af0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0848005b40 tx=0x7f084800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.804+0000 7f0851600700 1 -- 172.21.15.72:0/1545578219 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f084801d070 con 0x7f0854100020 2024-03-19T06:16:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.805+0000 7f0851600700 1 -- 172.21.15.72:0/1545578219 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0848022470 con 0x7f0854100020 2024-03-19T06:16:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.805+0000 7f0859e00700 1 -- 172.21.15.72:0/1545578219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0854073a40 con 0x7f0854100020 2024-03-19T06:16:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.805+0000 7f0851600700 1 -- 172.21.15.72:0/1545578219 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f084800f690 con 0x7f0854100020 2024-03-19T06:16:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.805+0000 7f0859e00700 1 -- 172.21.15.72:0/1545578219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0854073f30 con 0x7f0854100020 2024-03-19T06:16:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.806+0000 7f0859e00700 1 -- 172.21.15.72:0/1545578219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0854108b00 con 0x7f0854100020 2024-03-19T06:16:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.807+0000 7f0851600700 1 -- 172.21.15.72:0/1545578219 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f08480225e0 con 0x7f0854100020 2024-03-19T06:16:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.808+0000 7f0851600700 1 --2- 172.21.15.72:0/1545578219 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f083c06dfa0 0x7f083c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.809+0000 7f0851600700 1 -- 172.21.15.72:0/1545578219 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f084808f640 con 0x7f0854100020 2024-03-19T06:16:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.809+0000 7f0853e00700 1 --2- 172.21.15.72:0/1545578219 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f083c06dfa0 0x7f083c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.810+0000 7f0853e00700 1 --2- 172.21.15.72:0/1545578219 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f083c06dfa0 0x7f083c070450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0840005fd0 tx=0x7f084000a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:16.813+0000 7f0851600700 1 -- 172.21.15.72:0/1545578219 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f084805c590 con 0x7f0854100020 2024-03-19T06:16:17.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.076+0000 7f0859e00700 1 -- 172.21.15.72:0/1545578219 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0854105c10 con 0x7f083c06dfa0 2024-03-19T06:16:17.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.078+0000 7f0851600700 1 -- 172.21.15.72:0/1545578219 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f0854105c10 con 0x7f083c06dfa0 2024-03-19T06:16:17.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.081+0000 7f0859e00700 1 -- 172.21.15.72:0/1545578219 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f083c06dfa0 msgr2=0x7f083c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:17.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.081+0000 7f0859e00700 1 --2- 172.21.15.72:0/1545578219 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f083c06dfa0 0x7f083c070450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0840005fd0 tx=0x7f084000a560 comp rx=0 tx=0).stop 2024-03-19T06:16:17.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.081+0000 7f0859e00700 1 -- 172.21.15.72:0/1545578219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854100020 msgr2=0x7f0854074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:17.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.081+0000 7f0859e00700 1 --2- 172.21.15.72:0/1545578219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854100020 0x7f0854074af0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0848005b40 tx=0x7f084800be20 comp rx=0 tx=0).stop 2024-03-19T06:16:17.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.081+0000 7f0859e00700 1 -- 172.21.15.72:0/1545578219 shutdown_connections 2024-03-19T06:16:17.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.081+0000 7f0859e00700 1 --2- 172.21.15.72:0/1545578219 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f083c06dfa0 0x7f083c070450 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.081+0000 7f0859e00700 1 --2- 172.21.15.72:0/1545578219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854100020 0x7f0854074af0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.081+0000 7f0859e00700 1 --2- 172.21.15.72:0/1545578219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08541012c0 0x7f0854073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.081+0000 7f0859e00700 1 -- 172.21.15.72:0/1545578219 >> 172.21.15.72:0/1545578219 conn(0x7f08540fb650 msgr2=0x7f08541044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:17.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.081+0000 7f0859e00700 1 -- 172.21.15.72:0/1545578219 shutdown_connections 2024-03-19T06:16:17.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.081+0000 7f0859e00700 1 -- 172.21.15.72:0/1545578219 wait complete. 2024-03-19T06:16:17.087 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:16:17.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.238+0000 7ff421600700 1 -- 172.21.15.72:0/4191151471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41c100240 msgr2=0x7ff41c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:17.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.238+0000 7ff421600700 1 --2- 172.21.15.72:0/4191151471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41c100240 0x7ff41c100650 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009910 tx=0x7ff40c009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:17.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.239+0000 7ff421600700 1 -- 172.21.15.72:0/4191151471 shutdown_connections 2024-03-19T06:16:17.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.239+0000 7ff421600700 1 --2- 172.21.15.72:0/4191151471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff41c101440 0x7ff41c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.239+0000 7ff421600700 1 --2- 172.21.15.72:0/4191151471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41c100240 0x7ff41c100650 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.239+0000 7ff421600700 1 -- 172.21.15.72:0/4191151471 >> 172.21.15.72:0/4191151471 conn(0x7ff41c0fb7f0 msgr2=0x7ff41c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.240+0000 7ff421600700 1 -- 172.21.15.72:0/4191151471 shutdown_connections 2024-03-19T06:16:17.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.240+0000 7ff421600700 1 -- 172.21.15.72:0/4191151471 wait complete. 2024-03-19T06:16:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.241+0000 7ff421600700 1 Processor -- start 2024-03-19T06:16:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.241+0000 7ff421600700 1 -- start start 2024-03-19T06:16:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.241+0000 7ff421600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41c100240 0x7ff41c197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:17.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.241+0000 7ff421600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff41c101440 0x7ff41c198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.241+0000 7ff421600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c1988b0 con 0x7ff41c100240 2024-03-19T06:16:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.241+0000 7ff421600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c1989f0 con 0x7ff41c101440 2024-03-19T06:16:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.242+0000 7ff41aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41c100240 0x7ff41c197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.242+0000 7ff41aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41c100240 0x7ff41c197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46374/0 (socket says 172.21.15.72:46374) 2024-03-19T06:16:17.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.242+0000 7ff41aa00700 1 -- 172.21.15.72:0/391523967 learned_addr learned my addr 172.21.15.72:0/391523967 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:17.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.242+0000 7ff413e00700 1 --2- 172.21.15.72:0/391523967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff41c101440 0x7ff41c198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:17.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.243+0000 7ff41aa00700 1 -- 172.21.15.72:0/391523967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff41c101440 msgr2=0x7ff41c198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:17.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.243+0000 7ff41aa00700 1 --2- 172.21.15.72:0/391523967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff41c101440 0x7ff41c198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.243+0000 7ff41aa00700 1 -- 172.21.15.72:0/391523967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c0095f0 con 0x7ff41c100240 2024-03-19T06:16:17.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.243+0000 7ff41aa00700 1 --2- 172.21.15.72:0/391523967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41c100240 0x7ff41c197d50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00bd70 tx=0x7ff40c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:17.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.244+0000 7ff413400700 1 -- 172.21.15.72:0/391523967 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff40c01d070 con 0x7ff41c100240 2024-03-19T06:16:17.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.244+0000 7ff413400700 1 -- 172.21.15.72:0/391523967 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff40c005a00 con 0x7ff41c100240 2024-03-19T06:16:17.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.244+0000 7ff413400700 1 -- 172.21.15.72:0/391523967 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff40c021410 con 0x7ff41c100240 2024-03-19T06:16:17.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.244+0000 7ff421600700 1 -- 172.21.15.72:0/391523967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c19d440 con 0x7ff41c100240 2024-03-19T06:16:17.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.244+0000 7ff421600700 1 -- 172.21.15.72:0/391523967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c19d930 con 0x7ff41c100240 2024-03-19T06:16:17.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.245+0000 7ff421600700 1 -- 172.21.15.72:0/391523967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c105520 con 0x7ff41c100240 2024-03-19T06:16:17.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.246+0000 7ff413400700 1 -- 172.21.15.72:0/391523967 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7ff40c00f860 con 0x7ff41c100240 2024-03-19T06:16:17.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.247+0000 7ff413400700 1 --2- 172.21.15.72:0/391523967 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff40006dfa0 0x7ff400070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:17.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.247+0000 7ff413400700 1 -- 172.21.15.72:0/391523967 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff40c08f150 con 0x7ff41c100240 2024-03-19T06:16:17.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.247+0000 7ff413e00700 1 --2- 172.21.15.72:0/391523967 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff40006dfa0 0x7ff400070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:17.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.248+0000 7ff413e00700 1 --2- 172.21.15.72:0/391523967 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff40006dfa0 0x7ff400070450 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff404009a10 tx=0x7ff404009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:17.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.252+0000 7ff413400700 1 -- 172.21.15.72:0/391523967 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7ff40c05c000 con 0x7ff41c100240 2024-03-19T06:16:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.509+0000 7ff421600700 1 -- 172.21.15.72:0/391523967 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff41c061190 con 0x7ff40006dfa0 2024-03-19T06:16:17.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.510+0000 7ff413400700 1 -- 172.21.15.72:0/391523967 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7ff41c061190 con 0x7ff40006dfa0 2024-03-19T06:16:17.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.513+0000 7ff421600700 1 -- 172.21.15.72:0/391523967 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff40006dfa0 msgr2=0x7ff400070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.513+0000 7ff421600700 1 --2- 172.21.15.72:0/391523967 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff40006dfa0 0x7ff400070450 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff404009a10 tx=0x7ff404009190 comp rx=0 tx=0).stop 2024-03-19T06:16:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.513+0000 7ff421600700 1 -- 172.21.15.72:0/391523967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41c100240 msgr2=0x7ff41c197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.513+0000 7ff421600700 1 --2- 172.21.15.72:0/391523967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41c100240 0x7ff41c197d50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00bd70 tx=0x7ff40c00bda0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.513+0000 7ff421600700 1 -- 172.21.15.72:0/391523967 shutdown_connections 2024-03-19T06:16:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.513+0000 7ff421600700 1 --2- 172.21.15.72:0/391523967 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff40006dfa0 0x7ff400070450 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.513+0000 7ff421600700 1 --2- 172.21.15.72:0/391523967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41c100240 0x7ff41c197d50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.513+0000 7ff421600700 1 --2- 172.21.15.72:0/391523967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff41c101440 0x7ff41c198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.513+0000 7ff421600700 1 -- 172.21.15.72:0/391523967 >> 172.21.15.72:0/391523967 conn(0x7ff41c0fb7f0 msgr2=0x7ff41c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.513+0000 7ff421600700 1 -- 172.21.15.72:0/391523967 shutdown_connections 2024-03-19T06:16:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.514+0000 7ff421600700 1 -- 172.21.15.72:0/391523967 wait complete. 2024-03-19T06:16:17.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.708+0000 7f7420800700 1 -- 172.21.15.72:0/3594712555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74180737b0 msgr2=0x7f7418073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:17.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.708+0000 7f7420800700 1 --2- 172.21.15.72:0/3594712555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74180737b0 0x7f7418073c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7408009910 tx=0x7f7408009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:17.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.708+0000 7f7420800700 1 -- 172.21.15.72:0/3594712555 shutdown_connections 2024-03-19T06:16:17.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.708+0000 7f7420800700 1 --2- 172.21.15.72:0/3594712555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74180737b0 0x7f7418073c20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.708+0000 7f7420800700 1 --2- 172.21.15.72:0/3594712555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7418074d80 0x7f74180731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.708+0000 7f7420800700 1 -- 172.21.15.72:0/3594712555 >> 172.21.15.72:0/3594712555 conn(0x7f74180fb7f0 msgr2=0x7f74180fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:17.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.709+0000 7f7420800700 1 -- 172.21.15.72:0/3594712555 shutdown_connections 2024-03-19T06:16:17.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.709+0000 7f7420800700 1 -- 172.21.15.72:0/3594712555 wait complete. 2024-03-19T06:16:17.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.710+0000 7f7420800700 1 Processor -- start 2024-03-19T06:16:17.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.710+0000 7f7420800700 1 -- start start 2024-03-19T06:16:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.710+0000 7f7420800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74180737b0 0x7f741819c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.710+0000 7f7420800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7418074d80 0x7f741819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.710+0000 7f7420800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741819cbd0 con 0x7f7418074d80 2024-03-19T06:16:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.710+0000 7f7420800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741819cd10 con 0x7f74180737b0 2024-03-19T06:16:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.711+0000 7f741d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7418074d80 0x7f741819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.711+0000 7f741d400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7418074d80 0x7f741819c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46396/0 (socket says 172.21.15.72:46396) 2024-03-19T06:16:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.711+0000 7f741d400700 1 -- 172.21.15.72:0/2915747644 learned_addr learned my addr 172.21.15.72:0/2915747644 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.711+0000 7f741de00700 1 --2- 172.21.15.72:0/2915747644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74180737b0 0x7f741819c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.711+0000 7f741d400700 1 -- 172.21.15.72:0/2915747644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74180737b0 msgr2=0x7f741819c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:17.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.711+0000 7f741d400700 1 --2- 172.21.15.72:0/2915747644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74180737b0 0x7f741819c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.711+0000 7f741d400700 1 -- 172.21.15.72:0/2915747644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74080095f0 con 0x7f7418074d80 2024-03-19T06:16:17.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.712+0000 7f741d400700 1 --2- 172.21.15.72:0/2915747644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7418074d80 0x7f741819c5b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f740800b5c0 tx=0x7f740800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:17.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.713+0000 7f7412a00700 1 -- 172.21.15.72:0/2915747644 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f740801d070 con 0x7f7418074d80 2024-03-19T06:16:17.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.713+0000 7f7420800700 1 -- 172.21.15.72:0/2915747644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74181a1760 con 0x7f7418074d80 2024-03-19T06:16:17.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.713+0000 7f7412a00700 1 -- 172.21.15.72:0/2915747644 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f740800f460 con 0x7f7418074d80 2024-03-19T06:16:17.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.713+0000 7f7412a00700 1 -- 172.21.15.72:0/2915747644 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7408021640 con 0x7f7418074d80 2024-03-19T06:16:17.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.713+0000 7f7420800700 1 -- 172.21.15.72:0/2915747644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74181a1c50 con 0x7f7418074d80 2024-03-19T06:16:17.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.715+0000 7f7420800700 1 -- 172.21.15.72:0/2915747644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73fc005320 con 0x7f7418074d80 2024-03-19T06:16:17.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.715+0000 7f7412a00700 1 -- 172.21.15.72:0/2915747644 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f740802b440 con 0x7f7418074d80 2024-03-19T06:16:17.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.716+0000 7f7412a00700 1 --2- 172.21.15.72:0/2915747644 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f740006dfa0 0x7f7400070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:17.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.716+0000 7f7412a00700 1 -- 172.21.15.72:0/2915747644 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f740808eff0 con 0x7f7418074d80 2024-03-19T06:16:17.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.717+0000 7f741de00700 1 --2- 172.21.15.72:0/2915747644 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f740006dfa0 0x7f7400070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:17.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.717+0000 7f741de00700 1 --2- 172.21.15.72:0/2915747644 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f740006dfa0 0x7f7400070450 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f740c005950 tx=0x7f740c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:17.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.721+0000 7f7412a00700 1 -- 172.21.15.72:0/2915747644 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f740805bfd0 con 0x7f7418074d80 2024-03-19T06:16:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.969+0000 7f7420800700 1 -- 172.21.15.72:0/2915747644 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f73fc000bf0 con 0x7f740006dfa0 2024-03-19T06:16:17.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.988+0000 7f7412a00700 1 -- 172.21.15.72:0/2915747644 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f73fc000bf0 con 0x7f740006dfa0 2024-03-19T06:16:17.977 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:16:17.977 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (20m) 18s ago 22m 14.2M - 0.25.0 c8568f914cd2 dfd2e44ad943 2024-03-19T06:16:17.977 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (60s) 18s ago 23m 8074k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 7e45101af382 2024-03-19T06:16:17.977 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (52s) 21s ago 21m 7620k - 19.0.0-1934-gb0ea271b 5c4d8774b57a d8a7d621cc29 2024-03-19T06:16:17.977 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (7m) 18s ago 23m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:16:17.977 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (7m) 21s ago 21m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (20m) 18s ago 22m 75.1M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (2m) 18s ago 15m 16.0M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 3ea4b00e2248 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (2m) 18s ago 15m 68.1M - 19.0.0-1934-gb0ea271b 5c4d8774b57a d0daead2fe2a 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (82s) 21s ago 15m 12.2M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 788348d02918 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (106s) 21s ago 15m 12.4M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 2cbfb6aeff05 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (11m) 18s ago 24m 511M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (9m) 21s ago 21m 453M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (9m) 18s ago 25m 60.5M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (8m) 21s ago 21m 45.8M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (31s) 18s ago 22m 6949k - 1.5.0 0da6a335fe13 81983d103a8e 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (25s) 21s ago 21m 3019k - 1.5.0 0da6a335fe13 d533ddf64373 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (6m) 18s ago 20m 100M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (6m) 18s ago 19m 104M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:16:17.978 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (5m) 18s ago 18m 94.3M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:16:17.979 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (5m) 21s ago 18m 106M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:16:17.979 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (4m) 21s ago 17m 98.1M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:16:17.979 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (3m) 21s ago 17m 91.5M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a c47c9c7fd3c7 2024-03-19T06:16:17.979 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 starting - - - - 2024-03-19T06:16:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.990+0000 7f7420800700 1 -- 172.21.15.72:0/2915747644 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f740006dfa0 msgr2=0x7f7400070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.990+0000 7f7420800700 1 --2- 172.21.15.72:0/2915747644 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f740006dfa0 0x7f7400070450 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f740c005950 tx=0x7f740c0058e0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.990+0000 7f7420800700 1 -- 172.21.15.72:0/2915747644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7418074d80 msgr2=0x7f741819c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.990+0000 7f7420800700 1 --2- 172.21.15.72:0/2915747644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7418074d80 0x7f741819c5b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f740800b5c0 tx=0x7f740800be20 comp rx=0 tx=0).stop 2024-03-19T06:16:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.991+0000 7f7420800700 1 -- 172.21.15.72:0/2915747644 shutdown_connections 2024-03-19T06:16:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.991+0000 7f7420800700 1 --2- 172.21.15.72:0/2915747644 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f740006dfa0 0x7f7400070450 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.991+0000 7f7420800700 1 --2- 172.21.15.72:0/2915747644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74180737b0 0x7f741819c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.991+0000 7f7420800700 1 --2- 172.21.15.72:0/2915747644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7418074d80 0x7f741819c5b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.991+0000 7f7420800700 1 -- 172.21.15.72:0/2915747644 >> 172.21.15.72:0/2915747644 conn(0x7f74180fb7f0 msgr2=0x7f7418101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.991+0000 7f7420800700 1 -- 172.21.15.72:0/2915747644 shutdown_connections 2024-03-19T06:16:17.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:17.991+0000 7f7420800700 1 -- 172.21.15.72:0/2915747644 wait complete. 2024-03-19T06:16:18.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.150+0000 7f1798c00700 1 -- 172.21.15.72:0/3285988148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794101440 msgr2=0x7f1794101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:18.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.150+0000 7f1798c00700 1 --2- 172.21.15.72:0/3285988148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794101440 0x7f1794101890 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1780009910 tx=0x7f1780009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:18.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.151+0000 7f1798c00700 1 -- 172.21.15.72:0/3285988148 shutdown_connections 2024-03-19T06:16:18.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.151+0000 7f1798c00700 1 --2- 172.21.15.72:0/3285988148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794101440 0x7f1794101890 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.151+0000 7f1798c00700 1 --2- 172.21.15.72:0/3285988148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1794100240 0x7f1794100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.151+0000 7f1798c00700 1 -- 172.21.15.72:0/3285988148 >> 172.21.15.72:0/3285988148 conn(0x7f17940fb7f0 msgr2=0x7f17940fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:18.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.151+0000 7f1798c00700 1 -- 172.21.15.72:0/3285988148 shutdown_connections 2024-03-19T06:16:18.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.151+0000 7f1798c00700 1 -- 172.21.15.72:0/3285988148 wait complete. 2024-03-19T06:16:18.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.152+0000 7f1798c00700 1 Processor -- start 2024-03-19T06:16:18.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.153+0000 7f1798c00700 1 -- start start 2024-03-19T06:16:18.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.153+0000 7f1798c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794100240 0x7f1794074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:18.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.153+0000 7f1798c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1794101440 0x7f1794073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:18.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.153+0000 7f1798c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1794073680 con 0x7f1794100240 2024-03-19T06:16:18.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.153+0000 7f1798c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17940737c0 con 0x7f1794101440 2024-03-19T06:16:18.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.154+0000 7f1791e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794100240 0x7f1794074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:18.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.154+0000 7f1791e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794100240 0x7f1794074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46420/0 (socket says 172.21.15.72:46420) 2024-03-19T06:16:18.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.154+0000 7f1791e00700 1 -- 172.21.15.72:0/1642757552 learned_addr learned my addr 172.21.15.72:0/1642757552 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:18.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.154+0000 7f1791400700 1 --2- 172.21.15.72:0/1642757552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1794101440 0x7f1794073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:18.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.154+0000 7f1791e00700 1 -- 172.21.15.72:0/1642757552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1794101440 msgr2=0x7f1794073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:18.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.154+0000 7f1791e00700 1 --2- 172.21.15.72:0/1642757552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1794101440 0x7f1794073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.154+0000 7f1791e00700 1 -- 172.21.15.72:0/1642757552 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17800095f0 con 0x7f1794100240 2024-03-19T06:16:18.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.154+0000 7f1791400700 1 --2- 172.21.15.72:0/1642757552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1794101440 0x7f1794073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:16:18.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.154+0000 7f1791e00700 1 --2- 172.21.15.72:0/1642757552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794100240 0x7f1794074af0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f178400d900 tx=0x7f178400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:18.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.155+0000 7f178aa00700 1 -- 172.21.15.72:0/1642757552 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17840041f0 con 0x7f1794100240 2024-03-19T06:16:18.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.155+0000 7f1798c00700 1 -- 172.21.15.72:0/1642757552 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1794073aa0 con 0x7f1794100240 2024-03-19T06:16:18.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.155+0000 7f178aa00700 1 -- 172.21.15.72:0/1642757552 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1784004350 con 0x7f1794100240 2024-03-19T06:16:18.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.155+0000 7f1798c00700 1 -- 172.21.15.72:0/1642757552 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179419db10 con 0x7f1794100240 2024-03-19T06:16:18.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.155+0000 7f178aa00700 1 -- 172.21.15.72:0/1642757552 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1784003da0 con 0x7f1794100240 2024-03-19T06:16:18.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.156+0000 7f1798c00700 1 -- 172.21.15.72:0/1642757552 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1774005320 con 0x7f1794100240 2024-03-19T06:16:18.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.157+0000 7f178aa00700 1 -- 172.21.15.72:0/1642757552 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f1784009730 con 0x7f1794100240 2024-03-19T06:16:18.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.158+0000 7f178aa00700 1 --2- 172.21.15.72:0/1642757552 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f177806dfa0 0x7f1778070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:18.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.158+0000 7f178aa00700 1 -- 172.21.15.72:0/1642757552 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f178408de40 con 0x7f1794100240 2024-03-19T06:16:18.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.158+0000 7f1791400700 1 --2- 172.21.15.72:0/1642757552 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f177806dfa0 0x7f1778070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:18.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.159+0000 7f1791400700 1 --2- 172.21.15.72:0/1642757552 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f177806dfa0 0x7f1778070450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f178000b5c0 tx=0x7f1780005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:18.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.168+0000 7f178aa00700 1 -- 172.21.15.72:0/1642757552 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f178405ae10 con 0x7f1794100240 2024-03-19T06:16:18.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.489+0000 7f1798c00700 1 -- 172.21.15.72:0/1642757552 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1774006200 con 0x7f1794100240 2024-03-19T06:16:18.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.489+0000 7f178aa00700 1 -- 172.21.15.72:0/1642757552 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f178405a9a0 con 0x7f1794100240 2024-03-19T06:16:18.479 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:16:18.479 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:16:18.479 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:16:18.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:16:18.479 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:16:18.479 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:16:18.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:16:18.480 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:16:18.480 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 6 2024-03-19T06:16:18.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:16:18.480 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:16:18.480 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 4 2024-03-19T06:16:18.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:16:18.480 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:16:18.480 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 14 2024-03-19T06:16:18.480 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:16:18.480 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:16:18.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.492+0000 7f1798c00700 1 -- 172.21.15.72:0/1642757552 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f177806dfa0 msgr2=0x7f1778070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:18.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.492+0000 7f1798c00700 1 --2- 172.21.15.72:0/1642757552 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f177806dfa0 0x7f1778070450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f178000b5c0 tx=0x7f1780005e20 comp rx=0 tx=0).stop 2024-03-19T06:16:18.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.492+0000 7f1798c00700 1 -- 172.21.15.72:0/1642757552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794100240 msgr2=0x7f1794074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:18.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.492+0000 7f1798c00700 1 --2- 172.21.15.72:0/1642757552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794100240 0x7f1794074af0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f178400d900 tx=0x7f178400dcc0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.492+0000 7f1798c00700 1 -- 172.21.15.72:0/1642757552 shutdown_connections 2024-03-19T06:16:18.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.492+0000 7f1798c00700 1 --2- 172.21.15.72:0/1642757552 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f177806dfa0 0x7f1778070450 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.492+0000 7f1798c00700 1 --2- 172.21.15.72:0/1642757552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1794100240 0x7f1794074af0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.492+0000 7f1798c00700 1 --2- 172.21.15.72:0/1642757552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1794101440 0x7f1794073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.492+0000 7f1798c00700 1 -- 172.21.15.72:0/1642757552 >> 172.21.15.72:0/1642757552 conn(0x7f17940fb7f0 msgr2=0x7f1794104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:18.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.493+0000 7f1798c00700 1 -- 172.21.15.72:0/1642757552 shutdown_connections 2024-03-19T06:16:18.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.493+0000 7f1798c00700 1 -- 172.21.15.72:0/1642757552 wait complete. 2024-03-19T06:16:18.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.638+0000 7f47c6a00700 1 -- 172.21.15.72:0/1115832941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47c0073750 msgr2=0x7f47c0073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:18.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.638+0000 7f47c6a00700 1 --2- 172.21.15.72:0/1115832941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47c0073750 0x7f47c0073bc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009910 tx=0x7f47ac009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.638+0000 7f47c6a00700 1 -- 172.21.15.72:0/1115832941 shutdown_connections 2024-03-19T06:16:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.638+0000 7f47c6a00700 1 --2- 172.21.15.72:0/1115832941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47c0073750 0x7f47c0073bc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.638+0000 7f47c6a00700 1 --2- 172.21.15.72:0/1115832941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c0074d20 0x7f47c0073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.638+0000 7f47c6a00700 1 -- 172.21.15.72:0/1115832941 >> 172.21.15.72:0/1115832941 conn(0x7f47c00fb7f0 msgr2=0x7f47c00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:18.628 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:18 smithi072 ceph-mon[78545]: pgmap v304: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:18.628 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:18 smithi072 ceph-mon[78545]: from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:18.628 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:18 smithi072 ceph-mon[78545]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:18.628 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:18 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:18.629 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:18 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:18.629 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:18 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:16:18.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.639+0000 7f47c6a00700 1 -- 172.21.15.72:0/1115832941 shutdown_connections 2024-03-19T06:16:18.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.639+0000 7f47c6a00700 1 -- 172.21.15.72:0/1115832941 wait complete. 2024-03-19T06:16:18.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.640+0000 7f47c6a00700 1 Processor -- start 2024-03-19T06:16:18.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.640+0000 7f47c6a00700 1 -- start start 2024-03-19T06:16:18.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.640+0000 7f47c6a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c0073750 0x7f47c0197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.640+0000 7f47c6a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47c0074d20 0x7f47c0198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.640+0000 7f47c6a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c0198880 con 0x7f47c0074d20 2024-03-19T06:16:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.640+0000 7f47c6a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c019d290 con 0x7f47c0073750 2024-03-19T06:16:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.641+0000 7f47bf400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47c0074d20 0x7f47c0198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.641+0000 7f47bf400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47c0074d20 0x7f47c0198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46432/0 (socket says 172.21.15.72:46432) 2024-03-19T06:16:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.641+0000 7f47bf400700 1 -- 172.21.15.72:0/2000004542 learned_addr learned my addr 172.21.15.72:0/2000004542 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.641+0000 7f47bfe00700 1 --2- 172.21.15.72:0/2000004542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c0073750 0x7f47c0197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.641+0000 7f47bf400700 1 -- 172.21.15.72:0/2000004542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c0073750 msgr2=0x7f47c0197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.641+0000 7f47bf400700 1 --2- 172.21.15.72:0/2000004542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c0073750 0x7f47c0197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.641+0000 7f47bf400700 1 -- 172.21.15.72:0/2000004542 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac0095f0 con 0x7f47c0074d20 2024-03-19T06:16:18.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.642+0000 7f47bf400700 1 --2- 172.21.15.72:0/2000004542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47c0074d20 0x7f47c0198260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f47ac005850 tx=0x7f47ac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:18.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.642+0000 7f47bcc00700 1 -- 172.21.15.72:0/2000004542 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47ac01d070 con 0x7f47c0074d20 2024-03-19T06:16:18.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.642+0000 7f47bcc00700 1 -- 172.21.15.72:0/2000004542 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47ac00f460 con 0x7f47c0074d20 2024-03-19T06:16:18.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.642+0000 7f47c6a00700 1 -- 172.21.15.72:0/2000004542 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c019d430 con 0x7f47c0074d20 2024-03-19T06:16:18.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.642+0000 7f47bcc00700 1 -- 172.21.15.72:0/2000004542 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47ac021620 con 0x7f47c0074d20 2024-03-19T06:16:18.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.642+0000 7f47c6a00700 1 -- 172.21.15.72:0/2000004542 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c019d8f0 con 0x7f47c0074d20 2024-03-19T06:16:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.643+0000 7f47c6a00700 1 -- 172.21.15.72:0/2000004542 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c010b000 con 0x7f47c0074d20 2024-03-19T06:16:18.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.645+0000 7f47bcc00700 1 -- 172.21.15.72:0/2000004542 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f47ac00f5d0 con 0x7f47c0074d20 2024-03-19T06:16:18.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.646+0000 7f47bcc00700 1 --2- 172.21.15.72:0/2000004542 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f47a406dff0 0x7f47a40704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.646+0000 7f47bcc00700 1 -- 172.21.15.72:0/2000004542 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f47ac08f220 con 0x7f47c0074d20 2024-03-19T06:16:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.646+0000 7f47bfe00700 1 --2- 172.21.15.72:0/2000004542 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f47a406dff0 0x7f47a40704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:18.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.647+0000 7f47bfe00700 1 --2- 172.21.15.72:0/2000004542 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f47a406dff0 0x7f47a40704a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f47b0006fd0 tx=0x7f47b0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:18.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.651+0000 7f47bcc00700 1 -- 172.21.15.72:0/2000004542 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f47ac058620 con 0x7f47c0074d20 2024-03-19T06:16:18.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:18 smithi172 ceph-mon[66682]: pgmap v304: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:18.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:18 smithi172 ceph-mon[66682]: from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:18.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:18 smithi172 ceph-mon[66682]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:18.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:18 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:18.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:18 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:18.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:18 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:16:18.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.929+0000 7f47c6a00700 1 -- 172.21.15.72:0/2000004542 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f47c010b1f0 con 0x7f47c0074d20 2024-03-19T06:16:18.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.930+0000 7f47bcc00700 1 -- 172.21.15.72:0/2000004542 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f47ac05bce0 con 0x7f47c0074d20 2024-03-19T06:16:18.920 INFO:teuthology.orchestra.run.smithi072.stdout:e44 2024-03-19T06:16:18.920 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 44 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:15:10.305125+0000 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:16:18.921 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:16:18.922 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:16:18.922 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:16:18.922 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 83 2024-03-19T06:16:18.922 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-19T06:16:18.922 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:16:18.922 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:16:18.922 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=34488,1=34510} 2024-03-19T06:16:18.922 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:16:18.922 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:16:18.922 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:34488} state up:active seq 24 join_fscid=1 addr [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{1:34510} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.72:6828/3957356790,v1:172.21.15.72:6829/3957356790] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/1022637060,v1:172.21.15.172:6825/1022637060] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:16:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3126751850,v1:172.21.15.172:6827/3126751850] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:16:18.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.933+0000 7f47c6a00700 1 -- 172.21.15.72:0/2000004542 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f47a406dff0 msgr2=0x7f47a40704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:18.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.933+0000 7f47c6a00700 1 --2- 172.21.15.72:0/2000004542 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f47a406dff0 0x7f47a40704a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f47b0006fd0 tx=0x7f47b0008040 comp rx=0 tx=0).stop 2024-03-19T06:16:18.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.933+0000 7f47c6a00700 1 -- 172.21.15.72:0/2000004542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47c0074d20 msgr2=0x7f47c0198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:18.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.933+0000 7f47c6a00700 1 --2- 172.21.15.72:0/2000004542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47c0074d20 0x7f47c0198260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f47ac005850 tx=0x7f47ac00be20 comp rx=0 tx=0).stop 2024-03-19T06:16:18.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.933+0000 7f47c6a00700 1 -- 172.21.15.72:0/2000004542 shutdown_connections 2024-03-19T06:16:18.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.933+0000 7f47c6a00700 1 --2- 172.21.15.72:0/2000004542 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f47a406dff0 0x7f47a40704a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.933+0000 7f47c6a00700 1 --2- 172.21.15.72:0/2000004542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c0073750 0x7f47c0197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.933+0000 7f47c6a00700 1 --2- 172.21.15.72:0/2000004542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47c0074d20 0x7f47c0198260 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.933+0000 7f47c6a00700 1 -- 172.21.15.72:0/2000004542 >> 172.21.15.72:0/2000004542 conn(0x7f47c00fb7f0 msgr2=0x7f47c0106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.933+0000 7f47c6a00700 1 -- 172.21.15.72:0/2000004542 shutdown_connections 2024-03-19T06:16:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:18.933+0000 7f47c6a00700 1 -- 172.21.15.72:0/2000004542 wait complete. 2024-03-19T06:16:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 44 2024-03-19T06:16:19.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.087+0000 7f7a6a000700 1 -- 172.21.15.72:0/3273697195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a640737b0 msgr2=0x7f7a64073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.087+0000 7f7a6a000700 1 --2- 172.21.15.72:0/3273697195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a640737b0 0x7f7a64073c20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009910 tx=0x7f7a4c009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.087+0000 7f7a6a000700 1 -- 172.21.15.72:0/3273697195 shutdown_connections 2024-03-19T06:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.087+0000 7f7a6a000700 1 --2- 172.21.15.72:0/3273697195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a640737b0 0x7f7a64073c20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.087+0000 7f7a6a000700 1 --2- 172.21.15.72:0/3273697195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a64074d80 0x7f7a640731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.087+0000 7f7a6a000700 1 -- 172.21.15.72:0/3273697195 >> 172.21.15.72:0/3273697195 conn(0x7f7a640fb7f0 msgr2=0x7f7a640fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.087+0000 7f7a6a000700 1 -- 172.21.15.72:0/3273697195 shutdown_connections 2024-03-19T06:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.087+0000 7f7a6a000700 1 -- 172.21.15.72:0/3273697195 wait complete. 2024-03-19T06:16:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.089+0000 7f7a6a000700 1 Processor -- start 2024-03-19T06:16:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.089+0000 7f7a6a000700 1 -- start start 2024-03-19T06:16:19.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.089+0000 7f7a6a000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a640737b0 0x7f7a6419c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:19.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.089+0000 7f7a6a000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a64074d80 0x7f7a6419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.089+0000 7f7a6a000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6419cc70 con 0x7f7a64074d80 2024-03-19T06:16:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.089+0000 7f7a6a000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6419cdb0 con 0x7f7a640737b0 2024-03-19T06:16:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.090+0000 7f7a5be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a64074d80 0x7f7a6419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.090+0000 7f7a5be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a64074d80 0x7f7a6419c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46448/0 (socket says 172.21.15.72:46448) 2024-03-19T06:16:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.090+0000 7f7a5be00700 1 -- 172.21.15.72:0/2712958159 learned_addr learned my addr 172.21.15.72:0/2712958159 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.090+0000 7f7a63400700 1 --2- 172.21.15.72:0/2712958159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a640737b0 0x7f7a6419c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.090+0000 7f7a5be00700 1 -- 172.21.15.72:0/2712958159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a640737b0 msgr2=0x7f7a6419c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.090+0000 7f7a5be00700 1 --2- 172.21.15.72:0/2712958159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a640737b0 0x7f7a6419c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.090+0000 7f7a5be00700 1 -- 172.21.15.72:0/2712958159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0095f0 con 0x7f7a64074d80 2024-03-19T06:16:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.090+0000 7f7a63400700 1 --2- 172.21.15.72:0/2712958159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a640737b0 0x7f7a6419c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:16:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.091+0000 7f7a5be00700 1 --2- 172.21.15.72:0/2712958159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a64074d80 0x7f7a6419c650 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c005b40 tx=0x7f7a4c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:19.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.091+0000 7f7a60c00700 1 -- 172.21.15.72:0/2712958159 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4c01d070 con 0x7f7a64074d80 2024-03-19T06:16:19.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.091+0000 7f7a60c00700 1 -- 172.21.15.72:0/2712958159 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7a4c022470 con 0x7f7a64074d80 2024-03-19T06:16:19.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.091+0000 7f7a6a000700 1 -- 172.21.15.72:0/2712958159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a641a1800 con 0x7f7a64074d80 2024-03-19T06:16:19.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.091+0000 7f7a60c00700 1 -- 172.21.15.72:0/2712958159 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4c00f690 con 0x7f7a64074d80 2024-03-19T06:16:19.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.091+0000 7f7a6a000700 1 -- 172.21.15.72:0/2712958159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a641a1cf0 con 0x7f7a64074d80 2024-03-19T06:16:19.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.092+0000 7f7a6a000700 1 -- 172.21.15.72:0/2712958159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a6410f3f0 con 0x7f7a64074d80 2024-03-19T06:16:19.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.093+0000 7f7a60c00700 1 -- 172.21.15.72:0/2712958159 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f7a4c0225e0 con 0x7f7a64074d80 2024-03-19T06:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.095+0000 7f7a60c00700 1 --2- 172.21.15.72:0/2712958159 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7a4806dfa0 0x7f7a48070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.095+0000 7f7a60c00700 1 -- 172.21.15.72:0/2712958159 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7a4c08f700 con 0x7f7a64074d80 2024-03-19T06:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.095+0000 7f7a63400700 1 --2- 172.21.15.72:0/2712958159 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7a4806dfa0 0x7f7a48070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.096+0000 7f7a63400700 1 --2- 172.21.15.72:0/2712958159 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7a4806dfa0 0x7f7a48070450 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a54007900 tx=0x7f7a54008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.099+0000 7f7a60c00700 1 -- 172.21.15.72:0/2712958159 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f7a4c05c630 con 0x7f7a64074d80 2024-03-19T06:16:19.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.329+0000 7f7a6a000700 1 -- 172.21.15.72:0/2712958159 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a641032f0 con 0x7f7a4806dfa0 2024-03-19T06:16:19.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.331+0000 7f7a60c00700 1 -- 172.21.15.72:0/2712958159 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f7a641032f0 con 0x7f7a4806dfa0 2024-03-19T06:16:19.321 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:16:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:16:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:16:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:16:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:16:19.321 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:16:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph-exporter", 2024-03-19T06:16:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "mds", 2024-03-19T06:16:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-03-19T06:16:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:16:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:16:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:16:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "18/23 daemons upgraded", 2024-03-19T06:16:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading prometheus daemons", 2024-03-19T06:16:19.322 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:16:19.322 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:16:19.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.334+0000 7f7a6a000700 1 -- 172.21.15.72:0/2712958159 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7a4806dfa0 msgr2=0x7f7a48070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:19.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.334+0000 7f7a6a000700 1 --2- 172.21.15.72:0/2712958159 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7a4806dfa0 0x7f7a48070450 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a54007900 tx=0x7f7a54008040 comp rx=0 tx=0).stop 2024-03-19T06:16:19.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.334+0000 7f7a6a000700 1 -- 172.21.15.72:0/2712958159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a64074d80 msgr2=0x7f7a6419c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:19.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.334+0000 7f7a6a000700 1 --2- 172.21.15.72:0/2712958159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a64074d80 0x7f7a6419c650 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c005b40 tx=0x7f7a4c00be20 comp rx=0 tx=0).stop 2024-03-19T06:16:19.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.334+0000 7f7a6a000700 1 -- 172.21.15.72:0/2712958159 shutdown_connections 2024-03-19T06:16:19.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.334+0000 7f7a6a000700 1 --2- 172.21.15.72:0/2712958159 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7a4806dfa0 0x7f7a48070450 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.334+0000 7f7a6a000700 1 --2- 172.21.15.72:0/2712958159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a640737b0 0x7f7a6419c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.334+0000 7f7a6a000700 1 --2- 172.21.15.72:0/2712958159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a64074d80 0x7f7a6419c650 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.334+0000 7f7a6a000700 1 -- 172.21.15.72:0/2712958159 >> 172.21.15.72:0/2712958159 conn(0x7f7a640fb7f0 msgr2=0x7f7a64101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:19.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.334+0000 7f7a6a000700 1 -- 172.21.15.72:0/2712958159 shutdown_connections 2024-03-19T06:16:19.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.334+0000 7f7a6a000700 1 -- 172.21.15.72:0/2712958159 wait complete. 2024-03-19T06:16:19.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.515+0000 7f44bae00700 1 -- 172.21.15.72:0/2000372523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44b4073720 msgr2=0x7f44b4073b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:19.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.515+0000 7f44bae00700 1 --2- 172.21.15.72:0/2000372523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44b4073720 0x7f44b4073b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009940 tx=0x7f44a0009c50 comp rx=0 tx=0).stop 2024-03-19T06:16:19.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.516+0000 7f44bae00700 1 -- 172.21.15.72:0/2000372523 shutdown_connections 2024-03-19T06:16:19.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.516+0000 7f44bae00700 1 --2- 172.21.15.72:0/2000372523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44b4073720 0x7f44b4073b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.516+0000 7f44bae00700 1 --2- 172.21.15.72:0/2000372523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44b4074ce0 0x7f44b40731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.516+0000 7f44bae00700 1 -- 172.21.15.72:0/2000372523 >> 172.21.15.72:0/2000372523 conn(0x7f44b40fb650 msgr2=0x7f44b40fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:19.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.516+0000 7f44bae00700 1 -- 172.21.15.72:0/2000372523 shutdown_connections 2024-03-19T06:16:19.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.516+0000 7f44bae00700 1 -- 172.21.15.72:0/2000372523 wait complete. 2024-03-19T06:16:19.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.517+0000 7f44bae00700 1 Processor -- start 2024-03-19T06:16:19.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.517+0000 7f44bae00700 1 -- start start 2024-03-19T06:16:19.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.517+0000 7f44bae00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44b4073720 0x7f44b4197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:19.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.517+0000 7f44bae00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44b4074ce0 0x7f44b4198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:19.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.517+0000 7f44bae00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b41986b0 con 0x7f44b4074ce0 2024-03-19T06:16:19.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.517+0000 7f44bae00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b41987f0 con 0x7f44b4073720 2024-03-19T06:16:19.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.518+0000 7f44b9000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44b4074ce0 0x7f44b4198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.518+0000 7f44b9000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44b4074ce0 0x7f44b4198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46470/0 (socket says 172.21.15.72:46470) 2024-03-19T06:16:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.518+0000 7f44b9000700 1 -- 172.21.15.72:0/992715681 learned_addr learned my addr 172.21.15.72:0/992715681 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.518+0000 7f44b9a00700 1 --2- 172.21.15.72:0/992715681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44b4073720 0x7f44b4197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.518+0000 7f44b9000700 1 -- 172.21.15.72:0/992715681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44b4073720 msgr2=0x7f44b4197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.518+0000 7f44b9000700 1 --2- 172.21.15.72:0/992715681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44b4073720 0x7f44b4197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.518+0000 7f44b9000700 1 -- 172.21.15.72:0/992715681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00095f0 con 0x7f44b4074ce0 2024-03-19T06:16:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.518+0000 7f44b9000700 1 --2- 172.21.15.72:0/992715681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44b4074ce0 0x7f44b4198090 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f44a00055f0 tx=0x7f44a00056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.519+0000 7f44b2000700 1 -- 172.21.15.72:0/992715681 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44a001d070 con 0x7f44b4074ce0 2024-03-19T06:16:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.519+0000 7f44b2000700 1 -- 172.21.15.72:0/992715681 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44a0003ba0 con 0x7f44b4074ce0 2024-03-19T06:16:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.519+0000 7f44b2000700 1 -- 172.21.15.72:0/992715681 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44a0021710 con 0x7f44b4074ce0 2024-03-19T06:16:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.519+0000 7f44bae00700 1 -- 172.21.15.72:0/992715681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b419d240 con 0x7f44b4074ce0 2024-03-19T06:16:19.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.519+0000 7f44bae00700 1 -- 172.21.15.72:0/992715681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b419d7b0 con 0x7f44b4074ce0 2024-03-19T06:16:19.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.520+0000 7f44bae00700 1 -- 172.21.15.72:0/992715681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b410ad80 con 0x7f44b4074ce0 2024-03-19T06:16:19.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.521+0000 7f44b2000700 1 -- 172.21.15.72:0/992715681 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f44a0003d10 con 0x7f44b4074ce0 2024-03-19T06:16:19.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.522+0000 7f44b2000700 1 --2- 172.21.15.72:0/992715681 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f449c06dfa0 0x7f449c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:19.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.522+0000 7f44b2000700 1 -- 172.21.15.72:0/992715681 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f44a008f090 con 0x7f44b4074ce0 2024-03-19T06:16:19.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.523+0000 7f44b9a00700 1 --2- 172.21.15.72:0/992715681 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f449c06dfa0 0x7f449c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:19.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.523+0000 7f44b9a00700 1 --2- 172.21.15.72:0/992715681 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f449c06dfa0 0x7f449c070450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44a8006fd0 tx=0x7f44a8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:19.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.527+0000 7f44b2000700 1 -- 172.21.15.72:0/992715681 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f44a005c060 con 0x7f44b4074ce0 2024-03-19T06:16:19.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:19 smithi072 ceph-mon[78545]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:19.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:19 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1642757552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:19.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:19 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2000004542' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:16:19.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:19 smithi172 ceph-mon[66682]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:19.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:19 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1642757552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:19.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:19 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2000004542' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:16:19.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.869+0000 7f44bae00700 1 -- 172.21.15.72:0/992715681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f44b410af40 con 0x7f44b4074ce0 2024-03-19T06:16:19.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.869+0000 7f44b2000700 1 -- 172.21.15.72:0/992715681 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f44a005bbf0 con 0x7f44b4074ce0 2024-03-19T06:16:19.859 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:16:19.859 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:16:19.859 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:16:19.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.872+0000 7f44bae00700 1 -- 172.21.15.72:0/992715681 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f449c06dfa0 msgr2=0x7f449c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:19.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.872+0000 7f44bae00700 1 --2- 172.21.15.72:0/992715681 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f449c06dfa0 0x7f449c070450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44a8006fd0 tx=0x7f44a8008040 comp rx=0 tx=0).stop 2024-03-19T06:16:19.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.872+0000 7f44bae00700 1 -- 172.21.15.72:0/992715681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44b4074ce0 msgr2=0x7f44b4198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:19.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.872+0000 7f44bae00700 1 --2- 172.21.15.72:0/992715681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44b4074ce0 0x7f44b4198090 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f44a00055f0 tx=0x7f44a00056d0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.872+0000 7f44bae00700 1 -- 172.21.15.72:0/992715681 shutdown_connections 2024-03-19T06:16:19.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.872+0000 7f44bae00700 1 --2- 172.21.15.72:0/992715681 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f449c06dfa0 0x7f449c070450 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.872+0000 7f44bae00700 1 --2- 172.21.15.72:0/992715681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44b4073720 0x7f44b4197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.872+0000 7f44bae00700 1 --2- 172.21.15.72:0/992715681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44b4074ce0 0x7f44b4198090 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:19.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.872+0000 7f44bae00700 1 -- 172.21.15.72:0/992715681 >> 172.21.15.72:0/992715681 conn(0x7f44b40fb650 msgr2=0x7f44b4105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:19.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.873+0000 7f44bae00700 1 -- 172.21.15.72:0/992715681 shutdown_connections 2024-03-19T06:16:19.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:19.873+0000 7f44bae00700 1 -- 172.21.15.72:0/992715681 wait complete. 2024-03-19T06:16:20.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:20 smithi072 ceph-mon[78545]: pgmap v305: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:20.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:20 smithi072 ceph-mon[78545]: from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:20.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:20 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/992715681' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:16:20.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:20 smithi172 ceph-mon[66682]: pgmap v305: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:20.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:20 smithi172 ceph-mon[66682]: from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:20.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:20 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/992715681' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:16:22.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:22 smithi072 ceph-mon[78545]: pgmap v306: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:22.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:22 smithi172 ceph-mon[66682]: pgmap v306: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:24.635 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:24 smithi072 ceph-mon[78545]: pgmap v307: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:24.635 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:24.636 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:24 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:24.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:24 smithi172 ceph-mon[66682]: pgmap v307: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:24.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:24 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:24.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:24 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:25.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:16:25.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:16:26.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:26 smithi072 ceph-mon[78545]: pgmap v308: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:26.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:26 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:26.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:26 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:26.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:26 smithi172 ceph-mon[66682]: pgmap v308: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:26.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:26 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:26.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:26 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:28.653 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:28 smithi072 ceph-mon[78545]: pgmap v309: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:28.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:28 smithi172 ceph-mon[66682]: pgmap v309: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:30.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:30 smithi072 ceph-mon[78545]: pgmap v310: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:30.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:30 smithi172 ceph-mon[66682]: pgmap v310: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: pgmap v311: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:32 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: pgmap v311: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:32.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:32.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:32.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:32 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:33.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:33 smithi072 ceph-mon[78545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T06:16:33.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:33 smithi172 ceph-mon[66682]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-19T06:16:34.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:34 smithi072 ceph-mon[78545]: pgmap v312: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:34.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:34 smithi172 ceph-mon[66682]: pgmap v312: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:35.791 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:35 smithi072 ceph-mon[78545]: Upgrade: Updating alertmanager.smithi072 2024-03-19T06:16:35.792 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:35 smithi072 ceph-mon[78545]: Deploying daemon alertmanager.smithi072 on smithi072 2024-03-19T06:16:35.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:35 smithi172 ceph-mon[66682]: Upgrade: Updating alertmanager.smithi072 2024-03-19T06:16:35.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:35 smithi172 ceph-mon[66682]: Deploying daemon alertmanager.smithi072 on smithi072 2024-03-19T06:16:36.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:36 smithi072 ceph-mon[78545]: pgmap v313: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:36.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:36 smithi172 ceph-mon[66682]: pgmap v313: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:38.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:38 smithi072 ceph-mon[78545]: pgmap v314: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:38.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:38 smithi172 ceph-mon[66682]: pgmap v314: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:40.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:40 smithi072 ceph-mon[78545]: pgmap v315: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:40.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:16:40.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:40 smithi172 ceph-mon[66682]: pgmap v315: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:40.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:16:42.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:42 smithi072 ceph-mon[78545]: pgmap v316: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:42.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:42.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:42 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:42.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:42 smithi172 ceph-mon[66682]: pgmap v316: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:42.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:42.902 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:42 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:43.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:16:43.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:16:44.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:44 smithi072 ceph-mon[78545]: pgmap v317: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:44.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:44 smithi172 ceph-mon[66682]: pgmap v317: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:46.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:46 smithi072 ceph-mon[78545]: pgmap v318: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:46.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:46 smithi172 ceph-mon[66682]: pgmap v318: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:48.826 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:48 smithi072 ceph-mon[78545]: pgmap v319: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:48.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:48 smithi172 ceph-mon[66682]: pgmap v319: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:50.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.042+0000 7fa5a4a00700 1 -- 172.21.15.72:0/1267291334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a0101440 msgr2=0x7fa5a0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:50.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.042+0000 7fa5a4a00700 1 --2- 172.21.15.72:0/1267291334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a0101440 0x7fa5a0101890 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009910 tx=0x7fa58c009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:50.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.043+0000 7fa5a4a00700 1 -- 172.21.15.72:0/1267291334 shutdown_connections 2024-03-19T06:16:50.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.043+0000 7fa5a4a00700 1 --2- 172.21.15.72:0/1267291334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a0101440 0x7fa5a0101890 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.043+0000 7fa5a4a00700 1 --2- 172.21.15.72:0/1267291334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5a0100240 0x7fa5a0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.043+0000 7fa5a4a00700 1 -- 172.21.15.72:0/1267291334 >> 172.21.15.72:0/1267291334 conn(0x7fa5a00fb7f0 msgr2=0x7fa5a00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:50.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.043+0000 7fa5a4a00700 1 -- 172.21.15.72:0/1267291334 shutdown_connections 2024-03-19T06:16:50.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.043+0000 7fa5a4a00700 1 -- 172.21.15.72:0/1267291334 wait complete. 2024-03-19T06:16:50.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.044+0000 7fa5a4a00700 1 Processor -- start 2024-03-19T06:16:50.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.044+0000 7fa5a4a00700 1 -- start start 2024-03-19T06:16:50.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.044+0000 7fa5a4a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a0100240 0x7fa5a0197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:50.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.044+0000 7fa5a4a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5a0101440 0x7fa5a01981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:50.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.044+0000 7fa5a4a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a0198740 con 0x7fa5a0100240 2024-03-19T06:16:50.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.044+0000 7fa5a4a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a01988b0 con 0x7fa5a0101440 2024-03-19T06:16:50.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.045+0000 7fa59de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a0100240 0x7fa5a0197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:50.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.045+0000 7fa59de00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a0100240 0x7fa5a0197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41792/0 (socket says 172.21.15.72:41792) 2024-03-19T06:16:50.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.045+0000 7fa59de00700 1 -- 172.21.15.72:0/876095238 learned_addr learned my addr 172.21.15.72:0/876095238 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:50.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.045+0000 7fa59d400700 1 --2- 172.21.15.72:0/876095238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5a0101440 0x7fa5a01981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:50.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.045+0000 7fa59de00700 1 -- 172.21.15.72:0/876095238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5a0101440 msgr2=0x7fa5a01981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:50.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.045+0000 7fa59de00700 1 --2- 172.21.15.72:0/876095238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5a0101440 0x7fa5a01981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.045+0000 7fa59de00700 1 -- 172.21.15.72:0/876095238 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0095f0 con 0x7fa5a0100240 2024-03-19T06:16:50.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.046+0000 7fa59de00700 1 --2- 172.21.15.72:0/876095238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a0100240 0x7fa5a0197c90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa59000c910 tx=0x7fa59000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:50.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.046+0000 7fa596a00700 1 -- 172.21.15.72:0/876095238 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5900041f0 con 0x7fa5a0100240 2024-03-19T06:16:50.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.046+0000 7fa596a00700 1 -- 172.21.15.72:0/876095238 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa590007db0 con 0x7fa5a0100240 2024-03-19T06:16:50.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.046+0000 7fa5a4a00700 1 -- 172.21.15.72:0/876095238 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a019d350 con 0x7fa5a0100240 2024-03-19T06:16:50.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.046+0000 7fa596a00700 1 -- 172.21.15.72:0/876095238 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa590003d60 con 0x7fa5a0100240 2024-03-19T06:16:50.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.046+0000 7fa5a4a00700 1 -- 172.21.15.72:0/876095238 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a019d8a0 con 0x7fa5a0100240 2024-03-19T06:16:50.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.048+0000 7fa5a4a00700 1 -- 172.21.15.72:0/876095238 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a0105520 con 0x7fa5a0100240 2024-03-19T06:16:50.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.049+0000 7fa596a00700 1 -- 172.21.15.72:0/876095238 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fa590007900 con 0x7fa5a0100240 2024-03-19T06:16:50.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.050+0000 7fa596a00700 1 --2- 172.21.15.72:0/876095238 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa58406dfa0 0x7fa584070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:50.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.050+0000 7fa596a00700 1 -- 172.21.15.72:0/876095238 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa59008daf0 con 0x7fa5a0100240 2024-03-19T06:16:50.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.051+0000 7fa59d400700 1 --2- 172.21.15.72:0/876095238 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa58406dfa0 0x7fa584070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:50.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.051+0000 7fa59d400700 1 --2- 172.21.15.72:0/876095238 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa58406dfa0 0x7fa584070450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa5a01991a0 tx=0x7fa58c00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:50.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.056+0000 7fa596a00700 1 -- 172.21.15.72:0/876095238 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fa590056f10 con 0x7fa5a0100240 2024-03-19T06:16:50.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:50 smithi072 ceph-mon[78545]: pgmap v320: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:50.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:50.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:50 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:50.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.335+0000 7fa5a4a00700 1 -- 172.21.15.72:0/876095238 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5a0061190 con 0x7fa58406dfa0 2024-03-19T06:16:50.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.336+0000 7fa596a00700 1 -- 172.21.15.72:0/876095238 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7fa5a0061190 con 0x7fa58406dfa0 2024-03-19T06:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.340+0000 7fa5a4a00700 1 -- 172.21.15.72:0/876095238 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa58406dfa0 msgr2=0x7fa584070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.340+0000 7fa5a4a00700 1 --2- 172.21.15.72:0/876095238 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa58406dfa0 0x7fa584070450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa5a01991a0 tx=0x7fa58c00b540 comp rx=0 tx=0).stop 2024-03-19T06:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.340+0000 7fa5a4a00700 1 -- 172.21.15.72:0/876095238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a0100240 msgr2=0x7fa5a0197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.340+0000 7fa5a4a00700 1 --2- 172.21.15.72:0/876095238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a0100240 0x7fa5a0197c90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa59000c910 tx=0x7fa59000ccd0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.340+0000 7fa5a4a00700 1 -- 172.21.15.72:0/876095238 shutdown_connections 2024-03-19T06:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.340+0000 7fa5a4a00700 1 --2- 172.21.15.72:0/876095238 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa58406dfa0 0x7fa584070450 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.340+0000 7fa5a4a00700 1 --2- 172.21.15.72:0/876095238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a0100240 0x7fa5a0197c90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.340+0000 7fa5a4a00700 1 --2- 172.21.15.72:0/876095238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5a0101440 0x7fa5a01981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.340+0000 7fa5a4a00700 1 -- 172.21.15.72:0/876095238 >> 172.21.15.72:0/876095238 conn(0x7fa5a00fb7f0 msgr2=0x7fa5a0102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.340+0000 7fa5a4a00700 1 -- 172.21.15.72:0/876095238 shutdown_connections 2024-03-19T06:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.340+0000 7fa5a4a00700 1 -- 172.21.15.72:0/876095238 wait complete. 2024-03-19T06:16:50.346 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:16:50.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:50 smithi172 ceph-mon[66682]: pgmap v320: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:50.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:50.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:50 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:50.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.492+0000 7f5e5aa00700 1 -- 172.21.15.72:0/939002183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e54100250 msgr2=0x7f5e54100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:50.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.492+0000 7f5e5aa00700 1 --2- 172.21.15.72:0/939002183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e54100250 0x7f5e54100660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009910 tx=0x7f5e44009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:50.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.492+0000 7f5e5aa00700 1 -- 172.21.15.72:0/939002183 shutdown_connections 2024-03-19T06:16:50.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.492+0000 7f5e5aa00700 1 --2- 172.21.15.72:0/939002183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e54101450 0x7f5e541018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.492+0000 7f5e5aa00700 1 --2- 172.21.15.72:0/939002183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e54100250 0x7f5e54100660 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.492+0000 7f5e5aa00700 1 -- 172.21.15.72:0/939002183 >> 172.21.15.72:0/939002183 conn(0x7f5e540fb7e0 msgr2=0x7f5e540fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:50.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.492+0000 7f5e5aa00700 1 -- 172.21.15.72:0/939002183 shutdown_connections 2024-03-19T06:16:50.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.492+0000 7f5e5aa00700 1 -- 172.21.15.72:0/939002183 wait complete. 2024-03-19T06:16:50.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.494+0000 7f5e5aa00700 1 Processor -- start 2024-03-19T06:16:50.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.494+0000 7f5e5aa00700 1 -- start start 2024-03-19T06:16:50.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.494+0000 7f5e5aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e54100250 0x7f5e54197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:50.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.494+0000 7f5e5aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e54101450 0x7f5e54198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:50.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.494+0000 7f5e5aa00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e54198850 con 0x7f5e54100250 2024-03-19T06:16:50.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.494+0000 7f5e5aa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5419d260 con 0x7f5e54101450 2024-03-19T06:16:50.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.494+0000 7f5e53e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e54100250 0x7f5e54197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:50.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.494+0000 7f5e53e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e54100250 0x7f5e54197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41804/0 (socket says 172.21.15.72:41804) 2024-03-19T06:16:50.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.494+0000 7f5e53e00700 1 -- 172.21.15.72:0/3256323752 learned_addr learned my addr 172.21.15.72:0/3256323752 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:50.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.495+0000 7f5e53400700 1 --2- 172.21.15.72:0/3256323752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e54101450 0x7f5e54198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:50.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.495+0000 7f5e53e00700 1 -- 172.21.15.72:0/3256323752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e54101450 msgr2=0x7f5e54198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:50.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.495+0000 7f5e53e00700 1 --2- 172.21.15.72:0/3256323752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e54101450 0x7f5e54198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.495+0000 7f5e53e00700 1 -- 172.21.15.72:0/3256323752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440095f0 con 0x7f5e54100250 2024-03-19T06:16:50.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.495+0000 7f5e53e00700 1 --2- 172.21.15.72:0/3256323752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e54100250 0x7f5e54197cf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400bda0 tx=0x7f5e4400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:50.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.495+0000 7f5e50c00700 1 -- 172.21.15.72:0/3256323752 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4401d070 con 0x7f5e54100250 2024-03-19T06:16:50.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.495+0000 7f5e5aa00700 1 -- 172.21.15.72:0/3256323752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5419d400 con 0x7f5e54100250 2024-03-19T06:16:50.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.495+0000 7f5e50c00700 1 -- 172.21.15.72:0/3256323752 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5e4400f460 con 0x7f5e54100250 2024-03-19T06:16:50.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.495+0000 7f5e50c00700 1 -- 172.21.15.72:0/3256323752 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e44021620 con 0x7f5e54100250 2024-03-19T06:16:50.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.496+0000 7f5e5aa00700 1 -- 172.21.15.72:0/3256323752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5419d8c0 con 0x7f5e54100250 2024-03-19T06:16:50.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.497+0000 7f5e5aa00700 1 -- 172.21.15.72:0/3256323752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e54105530 con 0x7f5e54100250 2024-03-19T06:16:50.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.498+0000 7f5e50c00700 1 -- 172.21.15.72:0/3256323752 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f5e4400f5d0 con 0x7f5e54100250 2024-03-19T06:16:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.499+0000 7f5e50c00700 1 --2- 172.21.15.72:0/3256323752 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5e3806dfa0 0x7f5e38070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.499+0000 7f5e50c00700 1 -- 172.21.15.72:0/3256323752 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5e4408f150 con 0x7f5e54100250 2024-03-19T06:16:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.499+0000 7f5e53400700 1 --2- 172.21.15.72:0/3256323752 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5e3806dfa0 0x7f5e38070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.500+0000 7f5e53400700 1 --2- 172.21.15.72:0/3256323752 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5e3806dfa0 0x7f5e38070450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5e40005950 tx=0x7f5e400058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:50.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.503+0000 7f5e50c00700 1 -- 172.21.15.72:0/3256323752 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f5e44058570 con 0x7f5e54100250 2024-03-19T06:16:50.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.737+0000 7f5e5aa00700 1 -- 172.21.15.72:0/3256323752 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e54061190 con 0x7f5e3806dfa0 2024-03-19T06:16:50.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.740+0000 7f5e50c00700 1 -- 172.21.15.72:0/3256323752 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f5e54061190 con 0x7f5e3806dfa0 2024-03-19T06:16:50.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.743+0000 7f5e5aa00700 1 -- 172.21.15.72:0/3256323752 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5e3806dfa0 msgr2=0x7f5e38070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:50.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.743+0000 7f5e5aa00700 1 --2- 172.21.15.72:0/3256323752 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5e3806dfa0 0x7f5e38070450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5e40005950 tx=0x7f5e400058e0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.743+0000 7f5e5aa00700 1 -- 172.21.15.72:0/3256323752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e54100250 msgr2=0x7f5e54197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:50.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.743+0000 7f5e5aa00700 1 --2- 172.21.15.72:0/3256323752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e54100250 0x7f5e54197cf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400bda0 tx=0x7f5e4400be80 comp rx=0 tx=0).stop 2024-03-19T06:16:50.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.743+0000 7f5e5aa00700 1 -- 172.21.15.72:0/3256323752 shutdown_connections 2024-03-19T06:16:50.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.743+0000 7f5e5aa00700 1 --2- 172.21.15.72:0/3256323752 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5e3806dfa0 0x7f5e38070450 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.743+0000 7f5e5aa00700 1 --2- 172.21.15.72:0/3256323752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e54100250 0x7f5e54197cf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.743+0000 7f5e5aa00700 1 --2- 172.21.15.72:0/3256323752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e54101450 0x7f5e54198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.743+0000 7f5e5aa00700 1 -- 172.21.15.72:0/3256323752 >> 172.21.15.72:0/3256323752 conn(0x7f5e540fb7e0 msgr2=0x7f5e54102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:50.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.743+0000 7f5e5aa00700 1 -- 172.21.15.72:0/3256323752 shutdown_connections 2024-03-19T06:16:50.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.743+0000 7f5e5aa00700 1 -- 172.21.15.72:0/3256323752 wait complete. 2024-03-19T06:16:50.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.899+0000 7f090c000700 1 -- 172.21.15.72:0/3188552430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0904069270 msgr2=0x7f0904102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:50.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.899+0000 7f090c000700 1 --2- 172.21.15.72:0/3188552430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0904069270 0x7f0904102dd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009910 tx=0x7f08f8009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:50.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.899+0000 7f090c000700 1 -- 172.21.15.72:0/3188552430 shutdown_connections 2024-03-19T06:16:50.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.899+0000 7f090c000700 1 --2- 172.21.15.72:0/3188552430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0904103310 0x7f0904105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.899+0000 7f090c000700 1 --2- 172.21.15.72:0/3188552430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0904069270 0x7f0904102dd0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.899+0000 7f090c000700 1 -- 172.21.15.72:0/3188552430 >> 172.21.15.72:0/3188552430 conn(0x7f09040fa780 msgr2=0x7f09040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:50.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.899+0000 7f090c000700 1 -- 172.21.15.72:0/3188552430 shutdown_connections 2024-03-19T06:16:50.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.899+0000 7f090c000700 1 -- 172.21.15.72:0/3188552430 wait complete. 2024-03-19T06:16:50.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.900+0000 7f090c000700 1 Processor -- start 2024-03-19T06:16:50.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.900+0000 7f090c000700 1 -- start start 2024-03-19T06:16:50.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.900+0000 7f090c000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0904103310 0x7f0904195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:50.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.901+0000 7f090c000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09041960c0 0x7f090419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:50.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.901+0000 7f090c000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09041965c0 con 0x7f09041960c0 2024-03-19T06:16:50.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.901+0000 7f090c000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0904196730 con 0x7f0904103310 2024-03-19T06:16:50.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.901+0000 7f0908c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09041960c0 0x7f090419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:50.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.901+0000 7f0908c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09041960c0 0x7f090419b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41814/0 (socket says 172.21.15.72:41814) 2024-03-19T06:16:50.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.901+0000 7f0908c00700 1 -- 172.21.15.72:0/4116015074 learned_addr learned my addr 172.21.15.72:0/4116015074 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:50.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.901+0000 7f0909600700 1 --2- 172.21.15.72:0/4116015074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0904103310 0x7f0904195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:50.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.901+0000 7f0908c00700 1 -- 172.21.15.72:0/4116015074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0904103310 msgr2=0x7f0904195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:50.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.901+0000 7f0908c00700 1 --2- 172.21.15.72:0/4116015074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0904103310 0x7f0904195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:50.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.901+0000 7f0908c00700 1 -- 172.21.15.72:0/4116015074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f80095f0 con 0x7f09041960c0 2024-03-19T06:16:50.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.901+0000 7f0909600700 1 --2- 172.21.15.72:0/4116015074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0904103310 0x7f0904195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:16:50.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.902+0000 7f0908c00700 1 --2- 172.21.15.72:0/4116015074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09041960c0 0x7f090419b130 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f08f000b4b0 tx=0x7f08f000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:50.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.902+0000 7f0902000700 1 -- 172.21.15.72:0/4116015074 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f0011800 con 0x7f09041960c0 2024-03-19T06:16:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.902+0000 7f0902000700 1 -- 172.21.15.72:0/4116015074 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f08f0011e10 con 0x7f09041960c0 2024-03-19T06:16:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.902+0000 7f090c000700 1 -- 172.21.15.72:0/4116015074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090419b6d0 con 0x7f09041960c0 2024-03-19T06:16:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.902+0000 7f0902000700 1 -- 172.21.15.72:0/4116015074 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f000f2e0 con 0x7f09041960c0 2024-03-19T06:16:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.902+0000 7f090c000700 1 -- 172.21.15.72:0/4116015074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090419bbf0 con 0x7f09041960c0 2024-03-19T06:16:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.903+0000 7f090c000700 1 -- 172.21.15.72:0/4116015074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090418fc50 con 0x7f09041960c0 2024-03-19T06:16:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.904+0000 7f0902000700 1 -- 172.21.15.72:0/4116015074 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f08f0010380 con 0x7f09041960c0 2024-03-19T06:16:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.905+0000 7f0902000700 1 --2- 172.21.15.72:0/4116015074 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f08ec06dfa0 0x7f08ec070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.905+0000 7f0902000700 1 -- 172.21.15.72:0/4116015074 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f08f008dad0 con 0x7f09041960c0 2024-03-19T06:16:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.905+0000 7f0909600700 1 --2- 172.21.15.72:0/4116015074 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f08ec06dfa0 0x7f08ec070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.906+0000 7f0909600700 1 --2- 172.21.15.72:0/4116015074 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f08ec06dfa0 0x7f08ec070450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08f8006010 tx=0x7f08f800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:50.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:50.909+0000 7f0902000700 1 -- 172.21.15.72:0/4116015074 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f08f005a980 con 0x7f09041960c0 2024-03-19T06:16:51.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.151+0000 7f090c000700 1 -- 172.21.15.72:0/4116015074 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f090402ceb0 con 0x7f08ec06dfa0 2024-03-19T06:16:51.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.180+0000 7f0902000700 1 -- 172.21.15.72:0/4116015074 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f090402ceb0 con 0x7f08ec06dfa0 2024-03-19T06:16:51.170 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:16:51.170 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (9s) 2s ago 23m 13.4M - 0.25.0 c8568f914cd2 0afa852435dc 2024-03-19T06:16:51.170 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (93s) 2s ago 23m 8220k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 7e45101af382 2024-03-19T06:16:51.170 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (85s) 54s ago 22m 7620k - 19.0.0-1934-gb0ea271b 5c4d8774b57a d8a7d621cc29 2024-03-19T06:16:51.170 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (7m) 2s ago 23m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:16:51.170 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (7m) 54s ago 22m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:16:51.170 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (21m) 2s ago 22m 73.1M - 9.4.7 954c08fa6188 d3a70b1e0ab3 2024-03-19T06:16:51.170 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (2m) 2s ago 15m 17.3M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 3ea4b00e2248 2024-03-19T06:16:51.170 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (3m) 2s ago 15m 68.3M - 19.0.0-1934-gb0ea271b 5c4d8774b57a d0daead2fe2a 2024-03-19T06:16:51.171 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (115s) 54s ago 15m 12.2M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 788348d02918 2024-03-19T06:16:51.171 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (2m) 54s ago 15m 12.4M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 2cbfb6aeff05 2024-03-19T06:16:51.171 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (12m) 2s ago 25m 513M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:16:51.171 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (10m) 54s ago 21m 453M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:16:51.171 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (9m) 2s ago 25m 61.3M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:16:51.171 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (9m) 54s ago 21m 45.8M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:16:51.171 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (64s) 2s ago 23m 7436k - 1.5.0 0da6a335fe13 81983d103a8e 2024-03-19T06:16:51.171 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (58s) 54s ago 21m 3019k - 1.5.0 0da6a335fe13 d533ddf64373 2024-03-19T06:16:51.171 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (7m) 2s ago 20m 98.9M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:16:51.171 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (6m) 2s ago 20m 103M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:16:51.171 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (6m) 2s ago 19m 93.2M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:16:51.172 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (5m) 54s ago 18m 106M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:16:51.172 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (5m) 54s ago 18m 98.1M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:16:51.172 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (4m) 54s ago 17m 91.5M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a c47c9c7fd3c7 2024-03-19T06:16:51.172 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (34s) 2s ago 22m 68.3M - 2.43.0 a07b618ecd1d 380a9dd83787 2024-03-19T06:16:51.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.183+0000 7f090c000700 1 -- 172.21.15.72:0/4116015074 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f08ec06dfa0 msgr2=0x7f08ec070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:51.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.183+0000 7f090c000700 1 --2- 172.21.15.72:0/4116015074 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f08ec06dfa0 0x7f08ec070450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08f8006010 tx=0x7f08f800b540 comp rx=0 tx=0).stop 2024-03-19T06:16:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.183+0000 7f090c000700 1 -- 172.21.15.72:0/4116015074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09041960c0 msgr2=0x7f090419b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.183+0000 7f090c000700 1 --2- 172.21.15.72:0/4116015074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09041960c0 0x7f090419b130 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f08f000b4b0 tx=0x7f08f000b870 comp rx=0 tx=0).stop 2024-03-19T06:16:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.184+0000 7f090c000700 1 -- 172.21.15.72:0/4116015074 shutdown_connections 2024-03-19T06:16:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.184+0000 7f090c000700 1 --2- 172.21.15.72:0/4116015074 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f08ec06dfa0 0x7f08ec070450 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.184+0000 7f090c000700 1 --2- 172.21.15.72:0/4116015074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0904103310 0x7f0904195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.184+0000 7f090c000700 1 --2- 172.21.15.72:0/4116015074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09041960c0 0x7f090419b130 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.184+0000 7f090c000700 1 -- 172.21.15.72:0/4116015074 >> 172.21.15.72:0/4116015074 conn(0x7f09040fa780 msgr2=0x7f09040fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.184+0000 7f090c000700 1 -- 172.21.15.72:0/4116015074 shutdown_connections 2024-03-19T06:16:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.184+0000 7f090c000700 1 -- 172.21.15.72:0/4116015074 wait complete. 2024-03-19T06:16:51.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.333+0000 7f1a20400700 1 -- 172.21.15.72:0/313001114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a18103680 msgr2=0x7f1a18105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:51.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.333+0000 7f1a20400700 1 --2- 172.21.15.72:0/313001114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a18103680 0x7f1a18105a60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009910 tx=0x7f1a04009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:51.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:51 smithi072 ceph-mon[78545]: from='client.34638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:51.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:51 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:51.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:51 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.333+0000 7f1a20400700 1 -- 172.21.15.72:0/313001114 shutdown_connections 2024-03-19T06:16:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.333+0000 7f1a20400700 1 --2- 172.21.15.72:0/313001114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a18103680 0x7f1a18105a60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.333+0000 7f1a20400700 1 --2- 172.21.15.72:0/313001114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a18100d60 0x7f1a18103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.333+0000 7f1a20400700 1 -- 172.21.15.72:0/313001114 >> 172.21.15.72:0/313001114 conn(0x7f1a180fa780 msgr2=0x7f1a180fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.334+0000 7f1a20400700 1 -- 172.21.15.72:0/313001114 shutdown_connections 2024-03-19T06:16:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.334+0000 7f1a20400700 1 -- 172.21.15.72:0/313001114 wait complete. 2024-03-19T06:16:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.335+0000 7f1a20400700 1 Processor -- start 2024-03-19T06:16:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.335+0000 7f1a20400700 1 -- start start 2024-03-19T06:16:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.335+0000 7f1a20400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a18100d60 0x7f1a181006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.335+0000 7f1a20400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a18103680 0x7f1a180fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.336+0000 7f1a20400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180ff250 con 0x7f1a18103680 2024-03-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.336+0000 7f1a20400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180ff390 con 0x7f1a18100d60 2024-03-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.336+0000 7f1a1d000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a18103680 0x7f1a180fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.336+0000 7f1a1d000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a18103680 0x7f1a180fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41826/0 (socket says 172.21.15.72:41826) 2024-03-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.336+0000 7f1a1d000700 1 -- 172.21.15.72:0/4051737631 learned_addr learned my addr 172.21.15.72:0/4051737631 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.336+0000 7f1a1da00700 1 --2- 172.21.15.72:0/4051737631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a18100d60 0x7f1a181006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.336+0000 7f1a1d000700 1 -- 172.21.15.72:0/4051737631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a18100d60 msgr2=0x7f1a181006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.336+0000 7f1a1d000700 1 --2- 172.21.15.72:0/4051737631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a18100d60 0x7f1a181006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.336+0000 7f1a1d000700 1 -- 172.21.15.72:0/4051737631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a040095f0 con 0x7f1a18103680 2024-03-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.337+0000 7f1a1d000700 1 --2- 172.21.15.72:0/4051737631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a18103680 0x7f1a180fed10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1a04005b40 tx=0x7f1a0400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.337+0000 7f1a16000700 1 -- 172.21.15.72:0/4051737631 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a0401d070 con 0x7f1a18103680 2024-03-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.337+0000 7f1a16000700 1 -- 172.21.15.72:0/4051737631 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1a0400f460 con 0x7f1a18103680 2024-03-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.337+0000 7f1a16000700 1 -- 172.21.15.72:0/4051737631 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a04021640 con 0x7f1a18103680 2024-03-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.337+0000 7f1a20400700 1 -- 172.21.15.72:0/4051737631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a180ff610 con 0x7f1a18103680 2024-03-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.337+0000 7f1a20400700 1 -- 172.21.15.72:0/4051737631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a180ffb00 con 0x7f1a18103680 2024-03-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.339+0000 7f1a20400700 1 -- 172.21.15.72:0/4051737631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1818fbe0 con 0x7f1a18103680 2024-03-19T06:16:51.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.340+0000 7f1a16000700 1 -- 172.21.15.72:0/4051737631 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f1a0400fa90 con 0x7f1a18103680 2024-03-19T06:16:51.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.341+0000 7f1a16000700 1 --2- 172.21.15.72:0/4051737631 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1a0006dfa0 0x7f1a00070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:51.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.341+0000 7f1a16000700 1 -- 172.21.15.72:0/4051737631 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1a0408f410 con 0x7f1a18103680 2024-03-19T06:16:51.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.341+0000 7f1a1da00700 1 --2- 172.21.15.72:0/4051737631 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1a0006dfa0 0x7f1a00070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:51.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.342+0000 7f1a1da00700 1 --2- 172.21.15.72:0/4051737631 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1a0006dfa0 0x7f1a00070450 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c005950 tx=0x7f1a0c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:51.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.345+0000 7f1a16000700 1 -- 172.21.15.72:0/4051737631 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f1a0405c5a0 con 0x7f1a18103680 2024-03-19T06:16:51.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:51 smithi172 ceph-mon[66682]: from='client.34638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:51.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:51 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:51.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:51 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:51.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.651+0000 7f1a20400700 1 -- 172.21.15.72:0/4051737631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1a1802cc30 con 0x7f1a18103680 2024-03-19T06:16:51.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.652+0000 7f1a16000700 1 -- 172.21.15.72:0/4051737631 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f1a0405c130 con 0x7f1a18103680 2024-03-19T06:16:51.641 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:16:51.641 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:16:51.641 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:16:51.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:16:51.641 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:16:51.641 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:16:51.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:16:51.641 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:16:51.642 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 6 2024-03-19T06:16:51.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:16:51.642 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:16:51.642 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 4 2024-03-19T06:16:51.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:16:51.642 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:16:51.642 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 14 2024-03-19T06:16:51.642 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:16:51.642 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:16:51.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.654+0000 7f1a20400700 1 -- 172.21.15.72:0/4051737631 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1a0006dfa0 msgr2=0x7f1a00070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:51.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.654+0000 7f1a20400700 1 --2- 172.21.15.72:0/4051737631 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1a0006dfa0 0x7f1a00070450 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c005950 tx=0x7f1a0c0058e0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.654+0000 7f1a20400700 1 -- 172.21.15.72:0/4051737631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a18103680 msgr2=0x7f1a180fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:51.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.654+0000 7f1a20400700 1 --2- 172.21.15.72:0/4051737631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a18103680 0x7f1a180fed10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1a04005b40 tx=0x7f1a0400be20 comp rx=0 tx=0).stop 2024-03-19T06:16:51.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.654+0000 7f1a20400700 1 -- 172.21.15.72:0/4051737631 shutdown_connections 2024-03-19T06:16:51.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.654+0000 7f1a20400700 1 --2- 172.21.15.72:0/4051737631 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1a0006dfa0 0x7f1a00070450 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.655+0000 7f1a20400700 1 --2- 172.21.15.72:0/4051737631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a18100d60 0x7f1a181006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.655+0000 7f1a20400700 1 --2- 172.21.15.72:0/4051737631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a18103680 0x7f1a180fed10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.655+0000 7f1a20400700 1 -- 172.21.15.72:0/4051737631 >> 172.21.15.72:0/4051737631 conn(0x7f1a180fa780 msgr2=0x7f1a180fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:51.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.655+0000 7f1a20400700 1 -- 172.21.15.72:0/4051737631 shutdown_connections 2024-03-19T06:16:51.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.655+0000 7f1a20400700 1 -- 172.21.15.72:0/4051737631 wait complete. 2024-03-19T06:16:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.814+0000 7f6c0ee00700 1 -- 172.21.15.72:0/3494649285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c08107a40 msgr2=0x7f6c08107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.814+0000 7f6c0ee00700 1 --2- 172.21.15.72:0/3494649285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c08107a40 0x7f6c08107e90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009910 tx=0x7f6bf0009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.814+0000 7f6c0ee00700 1 -- 172.21.15.72:0/3494649285 shutdown_connections 2024-03-19T06:16:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.814+0000 7f6c0ee00700 1 --2- 172.21.15.72:0/3494649285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c08107a40 0x7f6c08107e90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.814+0000 7f6c0ee00700 1 --2- 172.21.15.72:0/3494649285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c08106840 0x7f6c08106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.814+0000 7f6c0ee00700 1 -- 172.21.15.72:0/3494649285 >> 172.21.15.72:0/3494649285 conn(0x7f6c08075970 msgr2=0x7f6c08077dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.814+0000 7f6c0ee00700 1 -- 172.21.15.72:0/3494649285 shutdown_connections 2024-03-19T06:16:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.814+0000 7f6c0ee00700 1 -- 172.21.15.72:0/3494649285 wait complete. 2024-03-19T06:16:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.815+0000 7f6c0ee00700 1 Processor -- start 2024-03-19T06:16:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.816+0000 7f6c0ee00700 1 -- start start 2024-03-19T06:16:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.816+0000 7f6c0ee00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c08106840 0x7f6c0819c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.816+0000 7f6c0ee00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c08107a40 0x7f6c0819c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.816+0000 7f6c0ee00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0819cc40 con 0x7f6c08106840 2024-03-19T06:16:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.816+0000 7f6c0ee00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0819cd80 con 0x7f6c08107a40 2024-03-19T06:16:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.816+0000 7f6c07e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c08106840 0x7f6c0819c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.816+0000 7f6c07e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c08106840 0x7f6c0819c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41850/0 (socket says 172.21.15.72:41850) 2024-03-19T06:16:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.816+0000 7f6c07e00700 1 -- 172.21.15.72:0/1421269628 learned_addr learned my addr 172.21.15.72:0/1421269628 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.816+0000 7f6c07e00700 1 -- 172.21.15.72:0/1421269628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c08107a40 msgr2=0x7f6c0819c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.816+0000 7f6bffe00700 1 --2- 172.21.15.72:0/1421269628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c08107a40 0x7f6c0819c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.816+0000 7f6c07e00700 1 --2- 172.21.15.72:0/1421269628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c08107a40 0x7f6c0819c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.816+0000 7f6c07e00700 1 -- 172.21.15.72:0/1421269628 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00095f0 con 0x7f6c08106840 2024-03-19T06:16:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.817+0000 7f6c07e00700 1 --2- 172.21.15.72:0/1421269628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c08106840 0x7f6c0819c0e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800d900 tx=0x7f6bf800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.817+0000 7f6c05600700 1 -- 172.21.15.72:0/1421269628 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf80041f0 con 0x7f6c08106840 2024-03-19T06:16:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.817+0000 7f6c05600700 1 -- 172.21.15.72:0/1421269628 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6bf8004350 con 0x7f6c08106840 2024-03-19T06:16:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.817+0000 7f6c0ee00700 1 -- 172.21.15.72:0/1421269628 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c081a1830 con 0x7f6c08106840 2024-03-19T06:16:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.817+0000 7f6c05600700 1 -- 172.21.15.72:0/1421269628 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf8003da0 con 0x7f6c08106840 2024-03-19T06:16:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.817+0000 7f6c0ee00700 1 -- 172.21.15.72:0/1421269628 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c081a1d80 con 0x7f6c08106840 2024-03-19T06:16:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.818+0000 7f6c0ee00700 1 -- 172.21.15.72:0/1421269628 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0810f390 con 0x7f6c08106840 2024-03-19T06:16:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.819+0000 7f6c05600700 1 -- 172.21.15.72:0/1421269628 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f6bf8009730 con 0x7f6c08106840 2024-03-19T06:16:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.820+0000 7f6c05600700 1 --2- 172.21.15.72:0/1421269628 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6bec06dfa0 0x7f6bec070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.820+0000 7f6c05600700 1 -- 172.21.15.72:0/1421269628 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6bf808df10 con 0x7f6c08106840 2024-03-19T06:16:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.820+0000 7f6bffe00700 1 --2- 172.21.15.72:0/1421269628 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6bec06dfa0 0x7f6bec070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.821+0000 7f6bffe00700 1 --2- 172.21.15.72:0/1421269628 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6bec06dfa0 0x7f6bec070450 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0000c00 tx=0x7f6bf0005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:51.825+0000 7f6c05600700 1 -- 172.21.15.72:0/1421269628 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f6bf805ae40 con 0x7f6c08106840 2024-03-19T06:16:52.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.095+0000 7f6c0ee00700 1 -- 172.21.15.72:0/1421269628 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6c081a2470 con 0x7f6c08106840 2024-03-19T06:16:52.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.097+0000 7f6c05600700 1 -- 172.21.15.72:0/1421269628 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f6bf805a9d0 con 0x7f6c08106840 2024-03-19T06:16:52.087 INFO:teuthology.orchestra.run.smithi072.stdout:e44 2024-03-19T06:16:52.087 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:16:52.087 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:16:52.087 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:16:52.087 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:16:52.087 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:16:52.087 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:16:52.087 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 44 2024-03-19T06:16:52.087 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:16:52.087 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:15:10.305125+0000 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 83 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:16:52.088 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=34488,1=34510} 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:34488} state up:active seq 24 join_fscid=1 addr [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{1:34510} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.72:6828/3957356790,v1:172.21.15.72:6829/3957356790] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:16:52.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:16:52.090 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/1022637060,v1:172.21.15.172:6825/1022637060] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:16:52.090 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3126751850,v1:172.21.15.172:6827/3126751850] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:16:52.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.100+0000 7f6c0ee00700 1 -- 172.21.15.72:0/1421269628 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6bec06dfa0 msgr2=0x7f6bec070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:52.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.100+0000 7f6c0ee00700 1 --2- 172.21.15.72:0/1421269628 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6bec06dfa0 0x7f6bec070450 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0000c00 tx=0x7f6bf0005fd0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.100+0000 7f6c0ee00700 1 -- 172.21.15.72:0/1421269628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c08106840 msgr2=0x7f6c0819c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:52.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.100+0000 7f6c0ee00700 1 --2- 172.21.15.72:0/1421269628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c08106840 0x7f6c0819c0e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800d900 tx=0x7f6bf800dcc0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.100+0000 7f6c0ee00700 1 -- 172.21.15.72:0/1421269628 shutdown_connections 2024-03-19T06:16:52.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.100+0000 7f6c0ee00700 1 --2- 172.21.15.72:0/1421269628 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6bec06dfa0 0x7f6bec070450 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.100+0000 7f6c0ee00700 1 --2- 172.21.15.72:0/1421269628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c08106840 0x7f6c0819c0e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.100+0000 7f6c0ee00700 1 --2- 172.21.15.72:0/1421269628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c08107a40 0x7f6c0819c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.100+0000 7f6c0ee00700 1 -- 172.21.15.72:0/1421269628 >> 172.21.15.72:0/1421269628 conn(0x7f6c08075970 msgr2=0x7f6c0810ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:52.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.100+0000 7f6c0ee00700 1 -- 172.21.15.72:0/1421269628 shutdown_connections 2024-03-19T06:16:52.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.100+0000 7f6c0ee00700 1 -- 172.21.15.72:0/1421269628 wait complete. 2024-03-19T06:16:52.095 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 44 2024-03-19T06:16:52.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.254+0000 7ff904400700 1 -- 172.21.15.72:0/1153704251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8fc074d80 msgr2=0x7ff8fc0731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:52.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.254+0000 7ff904400700 1 --2- 172.21.15.72:0/1153704251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8fc074d80 0x7ff8fc0731e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009910 tx=0x7ff8f0009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:52.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.254+0000 7ff904400700 1 -- 172.21.15.72:0/1153704251 shutdown_connections 2024-03-19T06:16:52.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.254+0000 7ff904400700 1 --2- 172.21.15.72:0/1153704251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc0737b0 0x7ff8fc073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.254+0000 7ff904400700 1 --2- 172.21.15.72:0/1153704251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8fc074d80 0x7ff8fc0731e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.254+0000 7ff904400700 1 -- 172.21.15.72:0/1153704251 >> 172.21.15.72:0/1153704251 conn(0x7ff8fc0fb7f0 msgr2=0x7ff8fc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:52.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.254+0000 7ff904400700 1 -- 172.21.15.72:0/1153704251 shutdown_connections 2024-03-19T06:16:52.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.254+0000 7ff904400700 1 -- 172.21.15.72:0/1153704251 wait complete. 2024-03-19T06:16:52.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.255+0000 7ff904400700 1 Processor -- start 2024-03-19T06:16:52.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.255+0000 7ff904400700 1 -- start start 2024-03-19T06:16:52.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.255+0000 7ff904400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8fc0737b0 0x7ff8fc19c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:52.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.255+0000 7ff904400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc074d80 0x7ff8fc19c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:52.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.255+0000 7ff904400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc19cbc0 con 0x7ff8fc0737b0 2024-03-19T06:16:52.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.255+0000 7ff904400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc19cd00 con 0x7ff8fc074d80 2024-03-19T06:16:52.246 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:52 smithi072 ceph-mon[78545]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:52.246 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:52 smithi072 ceph-mon[78545]: pgmap v321: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:52.246 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:52 smithi072 ceph-mon[78545]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:52.246 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:52 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/4051737631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:52.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.256+0000 7ff901a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8fc0737b0 0x7ff8fc19c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:52.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.256+0000 7ff901a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8fc0737b0 0x7ff8fc19c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41854/0 (socket says 172.21.15.72:41854) 2024-03-19T06:16:52.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.256+0000 7ff901a00700 1 -- 172.21.15.72:0/2110924762 learned_addr learned my addr 172.21.15.72:0/2110924762 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:52.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.256+0000 7ff901000700 1 --2- 172.21.15.72:0/2110924762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc074d80 0x7ff8fc19c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:52.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.256+0000 7ff901a00700 1 -- 172.21.15.72:0/2110924762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc074d80 msgr2=0x7ff8fc19c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:52.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.256+0000 7ff901a00700 1 --2- 172.21.15.72:0/2110924762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc074d80 0x7ff8fc19c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.256+0000 7ff901a00700 1 -- 172.21.15.72:0/2110924762 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f00095f0 con 0x7ff8fc0737b0 2024-03-19T06:16:52.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.257+0000 7ff901a00700 1 --2- 172.21.15.72:0/2110924762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8fc0737b0 0x7ff8fc19c060 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000b5c0 tx=0x7ff8f000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:52.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.257+0000 7ff8fa000700 1 -- 172.21.15.72:0/2110924762 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8f001d070 con 0x7ff8fc0737b0 2024-03-19T06:16:52.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.257+0000 7ff8fa000700 1 -- 172.21.15.72:0/2110924762 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff8f000f460 con 0x7ff8fc0737b0 2024-03-19T06:16:52.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.257+0000 7ff8fa000700 1 -- 172.21.15.72:0/2110924762 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8f0021640 con 0x7ff8fc0737b0 2024-03-19T06:16:52.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.257+0000 7ff904400700 1 -- 172.21.15.72:0/2110924762 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8fc1a1750 con 0x7ff8fc0737b0 2024-03-19T06:16:52.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.257+0000 7ff904400700 1 -- 172.21.15.72:0/2110924762 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc1a1c40 con 0x7ff8fc0737b0 2024-03-19T06:16:52.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.259+0000 7ff904400700 1 -- 172.21.15.72:0/2110924762 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc10f370 con 0x7ff8fc0737b0 2024-03-19T06:16:52.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.259+0000 7ff8fa000700 1 -- 172.21.15.72:0/2110924762 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7ff8f000f5d0 con 0x7ff8fc0737b0 2024-03-19T06:16:52.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.260+0000 7ff8fa000700 1 --2- 172.21.15.72:0/2110924762 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff8e406dfa0 0x7ff8e4070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:52.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.261+0000 7ff8fa000700 1 -- 172.21.15.72:0/2110924762 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff8f008f060 con 0x7ff8fc0737b0 2024-03-19T06:16:52.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.261+0000 7ff901000700 1 --2- 172.21.15.72:0/2110924762 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff8e406dfa0 0x7ff8e4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:52.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.262+0000 7ff901000700 1 --2- 172.21.15.72:0/2110924762 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff8e406dfa0 0x7ff8e4070450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8005950 tx=0x7ff8e80058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:52.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.265+0000 7ff8fa000700 1 -- 172.21.15.72:0/2110924762 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7ff8f005c030 con 0x7ff8fc0737b0 2024-03-19T06:16:52.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:52 smithi172 ceph-mon[66682]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:52.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:52 smithi172 ceph-mon[66682]: pgmap v321: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:52.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:52 smithi172 ceph-mon[66682]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:52.402 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:52 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/4051737631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:52.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.500+0000 7ff904400700 1 -- 172.21.15.72:0/2110924762 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8fc1a22d0 con 0x7ff8e406dfa0 2024-03-19T06:16:52.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.503+0000 7ff8fa000700 1 -- 172.21.15.72:0/2110924762 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7ff8fc1a22d0 con 0x7ff8e406dfa0 2024-03-19T06:16:52.492 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:16:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:16:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:16:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:16:52.492 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:16:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:16:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph-exporter", 2024-03-19T06:16:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "mds", 2024-03-19T06:16:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-03-19T06:16:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:16:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:16:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:16:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "18/23 daemons upgraded", 2024-03-19T06:16:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading alertmanager daemons", 2024-03-19T06:16:52.493 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:16:52.493 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:16:52.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.505+0000 7ff904400700 1 -- 172.21.15.72:0/2110924762 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff8e406dfa0 msgr2=0x7ff8e4070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.505+0000 7ff904400700 1 --2- 172.21.15.72:0/2110924762 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff8e406dfa0 0x7ff8e4070450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8005950 tx=0x7ff8e80058e0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.505+0000 7ff904400700 1 -- 172.21.15.72:0/2110924762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8fc0737b0 msgr2=0x7ff8fc19c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.505+0000 7ff904400700 1 --2- 172.21.15.72:0/2110924762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8fc0737b0 0x7ff8fc19c060 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000b5c0 tx=0x7ff8f000be20 comp rx=0 tx=0).stop 2024-03-19T06:16:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.505+0000 7ff904400700 1 -- 172.21.15.72:0/2110924762 shutdown_connections 2024-03-19T06:16:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.505+0000 7ff904400700 1 --2- 172.21.15.72:0/2110924762 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff8e406dfa0 0x7ff8e4070450 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.505+0000 7ff904400700 1 --2- 172.21.15.72:0/2110924762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8fc0737b0 0x7ff8fc19c060 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.505+0000 7ff904400700 1 --2- 172.21.15.72:0/2110924762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc074d80 0x7ff8fc19c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.505+0000 7ff904400700 1 -- 172.21.15.72:0/2110924762 >> 172.21.15.72:0/2110924762 conn(0x7ff8fc0fb7f0 msgr2=0x7ff8fc101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.506+0000 7ff904400700 1 -- 172.21.15.72:0/2110924762 shutdown_connections 2024-03-19T06:16:52.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.506+0000 7ff904400700 1 -- 172.21.15.72:0/2110924762 wait complete. 2024-03-19T06:16:52.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.663+0000 7f7c9a800700 1 -- 172.21.15.72:0/1773982505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c94102430 msgr2=0x7f7c94102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:52.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.663+0000 7f7c9a800700 1 --2- 172.21.15.72:0/1773982505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c94102430 0x7f7c94102840 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009910 tx=0x7f7c84009c20 comp rx=0 tx=0).stop 2024-03-19T06:16:52.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.663+0000 7f7c9a800700 1 -- 172.21.15.72:0/1773982505 shutdown_connections 2024-03-19T06:16:52.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.663+0000 7f7c9a800700 1 --2- 172.21.15.72:0/1773982505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c941036d0 0x7f7c94103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.663+0000 7f7c9a800700 1 --2- 172.21.15.72:0/1773982505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c94102430 0x7f7c94102840 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.663+0000 7f7c9a800700 1 -- 172.21.15.72:0/1773982505 >> 172.21.15.72:0/1773982505 conn(0x7f7c940fda80 msgr2=0x7f7c940ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:52.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.663+0000 7f7c9a800700 1 -- 172.21.15.72:0/1773982505 shutdown_connections 2024-03-19T06:16:52.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.664+0000 7f7c9a800700 1 -- 172.21.15.72:0/1773982505 wait complete. 2024-03-19T06:16:52.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.664+0000 7f7c9a800700 1 Processor -- start 2024-03-19T06:16:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.665+0000 7f7c9a800700 1 -- start start 2024-03-19T06:16:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.665+0000 7f7c9a800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c94102430 0x7f7c94197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.665+0000 7f7c9a800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c941036d0 0x7f7c94198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.665+0000 7f7c9a800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94198890 con 0x7f7c941036d0 2024-03-19T06:16:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.665+0000 7f7c9a800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941989d0 con 0x7f7c94102430 2024-03-19T06:16:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.665+0000 7f7c92a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c941036d0 0x7f7c94198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.665+0000 7f7c92a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c941036d0 0x7f7c94198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41870/0 (socket says 172.21.15.72:41870) 2024-03-19T06:16:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.665+0000 7f7c92a00700 1 -- 172.21.15.72:0/2082285804 learned_addr learned my addr 172.21.15.72:0/2082285804 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:16:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.666+0000 7f7c93400700 1 --2- 172.21.15.72:0/2082285804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c94102430 0x7f7c94197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.666+0000 7f7c92a00700 1 -- 172.21.15.72:0/2082285804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c94102430 msgr2=0x7f7c94197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:52.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.666+0000 7f7c92a00700 1 --2- 172.21.15.72:0/2082285804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c94102430 0x7f7c94197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.666+0000 7f7c92a00700 1 -- 172.21.15.72:0/2082285804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c840095f0 con 0x7f7c941036d0 2024-03-19T06:16:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.666+0000 7f7c92a00700 1 --2- 172.21.15.72:0/2082285804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c941036d0 0x7f7c94198270 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000b4b0 tx=0x7f7c8000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.666+0000 7f7c8be00700 1 -- 172.21.15.72:0/2082285804 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c80011800 con 0x7f7c941036d0 2024-03-19T06:16:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.666+0000 7f7c9a800700 1 -- 172.21.15.72:0/2082285804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9419d480 con 0x7f7c941036d0 2024-03-19T06:16:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.666+0000 7f7c8be00700 1 -- 172.21.15.72:0/2082285804 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7c80011e10 con 0x7f7c941036d0 2024-03-19T06:16:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.666+0000 7f7c8be00700 1 -- 172.21.15.72:0/2082285804 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c8000f2e0 con 0x7f7c941036d0 2024-03-19T06:16:52.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.666+0000 7f7c9a800700 1 -- 172.21.15.72:0/2082285804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9419d9d0 con 0x7f7c941036d0 2024-03-19T06:16:52.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.667+0000 7f7c9a800700 1 -- 172.21.15.72:0/2082285804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9410af90 con 0x7f7c941036d0 2024-03-19T06:16:52.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.668+0000 7f7c8be00700 1 -- 172.21.15.72:0/2082285804 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f7c80010380 con 0x7f7c941036d0 2024-03-19T06:16:52.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.669+0000 7f7c8be00700 1 --2- 172.21.15.72:0/2082285804 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7c7806dfa0 0x7f7c78070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:16:52.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.669+0000 7f7c8be00700 1 -- 172.21.15.72:0/2082285804 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7c8008dac0 con 0x7f7c941036d0 2024-03-19T06:16:52.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.670+0000 7f7c93400700 1 --2- 172.21.15.72:0/2082285804 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7c7806dfa0 0x7f7c78070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:16:52.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.670+0000 7f7c93400700 1 --2- 172.21.15.72:0/2082285804 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7c7806dfa0 0x7f7c78070450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7c84006010 tx=0x7f7c8400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:16:52.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.674+0000 7f7c8be00700 1 -- 172.21.15.72:0/2082285804 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f7c8005a970 con 0x7f7c941036d0 2024-03-19T06:16:52.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.988+0000 7f7c9a800700 1 -- 172.21.15.72:0/2082285804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7c9410b150 con 0x7f7c941036d0 2024-03-19T06:16:52.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.989+0000 7f7c8be00700 1 -- 172.21.15.72:0/2082285804 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f7c8005a500 con 0x7f7c941036d0 2024-03-19T06:16:52.978 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:16:52.978 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:16:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:16:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.991+0000 7f7c9a800700 1 -- 172.21.15.72:0/2082285804 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7c7806dfa0 msgr2=0x7f7c78070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.991+0000 7f7c9a800700 1 --2- 172.21.15.72:0/2082285804 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7c7806dfa0 0x7f7c78070450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7c84006010 tx=0x7f7c8400b540 comp rx=0 tx=0).stop 2024-03-19T06:16:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.991+0000 7f7c9a800700 1 -- 172.21.15.72:0/2082285804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c941036d0 msgr2=0x7f7c94198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:16:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.991+0000 7f7c9a800700 1 --2- 172.21.15.72:0/2082285804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c941036d0 0x7f7c94198270 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000b4b0 tx=0x7f7c8000b870 comp rx=0 tx=0).stop 2024-03-19T06:16:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.991+0000 7f7c9a800700 1 -- 172.21.15.72:0/2082285804 shutdown_connections 2024-03-19T06:16:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.991+0000 7f7c9a800700 1 --2- 172.21.15.72:0/2082285804 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7c7806dfa0 0x7f7c78070450 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.991+0000 7f7c9a800700 1 --2- 172.21.15.72:0/2082285804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c94102430 0x7f7c94197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.991+0000 7f7c9a800700 1 --2- 172.21.15.72:0/2082285804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c941036d0 0x7f7c94198270 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:16:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.991+0000 7f7c9a800700 1 -- 172.21.15.72:0/2082285804 >> 172.21.15.72:0/2082285804 conn(0x7f7c940fda80 msgr2=0x7f7c94106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:16:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.991+0000 7f7c9a800700 1 -- 172.21.15.72:0/2082285804 shutdown_connections 2024-03-19T06:16:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:16:52.992+0000 7f7c9a800700 1 -- 172.21.15.72:0/2082285804 wait complete. 2024-03-19T06:16:53.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:53 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1421269628' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:16:53.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:53 smithi072 ceph-mon[78545]: from='client.34658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:53.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:53 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2082285804' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:16:53.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:53 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1421269628' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:16:53.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:53 smithi172 ceph-mon[66682]: from='client.34658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:16:53.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:53 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2082285804' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:16:54.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:54 smithi072 ceph-mon[78545]: pgmap v322: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:54.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:54 smithi172 ceph-mon[66682]: pgmap v322: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:55.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:16:55.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:16:56.166 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:56 smithi072 ceph-mon[78545]: pgmap v323: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:56.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:56 smithi172 ceph-mon[66682]: pgmap v323: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:57.554 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:57.554 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:57.554 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.555 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.556 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:57 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:57.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:57.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:16:57.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:16:57.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:16:57.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-19T06:16:57.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-19T06:16:57.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:16:57.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:57.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:57 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:16:58.569 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:16:58 smithi072 ceph-mon[78545]: pgmap v324: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:16:58.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:16:58 smithi172 ceph-mon[66682]: pgmap v324: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:00.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:00 smithi072 ceph-mon[78545]: Upgrade: Updating grafana.smithi072 2024-03-19T06:17:00.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:00 smithi072 ceph-mon[78545]: Deploying daemon grafana.smithi072 on smithi072 2024-03-19T06:17:00.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:00 smithi072 ceph-mon[78545]: pgmap v325: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:00.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:00 smithi172 ceph-mon[66682]: Upgrade: Updating grafana.smithi072 2024-03-19T06:17:00.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:00 smithi172 ceph-mon[66682]: Deploying daemon grafana.smithi072 on smithi072 2024-03-19T06:17:00.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:00 smithi172 ceph-mon[66682]: pgmap v325: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:02.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:02 smithi072 ceph-mon[78545]: pgmap v326: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:02.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:02 smithi172 ceph-mon[66682]: pgmap v326: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:04.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:04 smithi072 ceph-mon[78545]: pgmap v327: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:04.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:04 smithi172 ceph-mon[66682]: pgmap v327: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:06.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:06 smithi072 ceph-mon[78545]: pgmap v328: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:06.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:06 smithi172 ceph-mon[66682]: pgmap v328: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:08.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:08 smithi072 ceph-mon[78545]: pgmap v329: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:08.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:08 smithi172 ceph-mon[66682]: pgmap v329: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:10.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:10 smithi172 ceph-mon[66682]: pgmap v330: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:10.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:17:10.770 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:10 smithi072 ceph-mon[78545]: pgmap v330: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:10.770 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:17:12.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:12 smithi072 ceph-mon[78545]: pgmap v331: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:12.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:12 smithi172 ceph-mon[66682]: pgmap v331: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:14.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:14 smithi172 ceph-mon[66682]: pgmap v332: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:14.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:14 smithi072 ceph-mon[78545]: pgmap v332: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:16.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:16 smithi072 ceph-mon[78545]: pgmap v333: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:16.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:16 smithi172 ceph-mon[66682]: pgmap v333: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:18.635 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:18 smithi072 ceph-mon[78545]: pgmap v334: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:18.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:18 smithi172 ceph-mon[66682]: pgmap v334: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:20.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:20 smithi072 ceph-mon[78545]: pgmap v335: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:20.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:20 smithi172 ceph-mon[66682]: pgmap v335: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:22.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:22 smithi072 ceph-mon[78545]: pgmap v336: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:22.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:22.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:22.414 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:22 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:17:22.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:22 smithi172 ceph-mon[66682]: pgmap v336: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:22.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:22.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:22.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:22 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:17:23.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.164+0000 7ffba4000700 1 -- 172.21.15.72:0/1478371823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb9c0feac0 msgr2=0x7ffb9c0feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:23.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.164+0000 7ffba4000700 1 --2- 172.21.15.72:0/1478371823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb9c0feac0 0x7ffb9c0feed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ffb90009910 tx=0x7ffb90009c20 comp rx=0 tx=0).stop 2024-03-19T06:17:23.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.164+0000 7ffba4000700 1 -- 172.21.15.72:0/1478371823 shutdown_connections 2024-03-19T06:17:23.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.164+0000 7ffba4000700 1 --2- 172.21.15.72:0/1478371823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9c0ff410 0x7ffb9c0ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.164+0000 7ffba4000700 1 --2- 172.21.15.72:0/1478371823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb9c0feac0 0x7ffb9c0feed0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.164+0000 7ffba4000700 1 -- 172.21.15.72:0/1478371823 >> 172.21.15.72:0/1478371823 conn(0x7ffb9c0fa6d0 msgr2=0x7ffb9c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:23.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.164+0000 7ffba4000700 1 -- 172.21.15.72:0/1478371823 shutdown_connections 2024-03-19T06:17:23.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.164+0000 7ffba4000700 1 -- 172.21.15.72:0/1478371823 wait complete. 2024-03-19T06:17:23.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.165+0000 7ffba4000700 1 Processor -- start 2024-03-19T06:17:23.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.165+0000 7ffba4000700 1 -- start start 2024-03-19T06:17:23.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.165+0000 7ffba4000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb9c0feac0 0x7ffb9c197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:23.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.165+0000 7ffba4000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9c0ff410 0x7ffb9c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:23.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.165+0000 7ffba4000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c198890 con 0x7ffb9c0feac0 2024-03-19T06:17:23.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.165+0000 7ffba4000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c19d2a0 con 0x7ffb9c0ff410 2024-03-19T06:17:23.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.166+0000 7ffba1600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb9c0feac0 0x7ffb9c197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:23.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.166+0000 7ffba1600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb9c0feac0 0x7ffb9c197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47024/0 (socket says 172.21.15.72:47024) 2024-03-19T06:17:23.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.166+0000 7ffba1600700 1 -- 172.21.15.72:0/2953128605 learned_addr learned my addr 172.21.15.72:0/2953128605 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:17:23.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.166+0000 7ffba0c00700 1 --2- 172.21.15.72:0/2953128605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9c0ff410 0x7ffb9c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:23.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.166+0000 7ffba1600700 1 -- 172.21.15.72:0/2953128605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9c0ff410 msgr2=0x7ffb9c198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:23.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.166+0000 7ffba1600700 1 --2- 172.21.15.72:0/2953128605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9c0ff410 0x7ffb9c198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.166+0000 7ffba1600700 1 -- 172.21.15.72:0/2953128605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb900095f0 con 0x7ffb9c0feac0 2024-03-19T06:17:23.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.166+0000 7ffba0c00700 1 --2- 172.21.15.72:0/2953128605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9c0ff410 0x7ffb9c198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:17:23.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.167+0000 7ffba1600700 1 --2- 172.21.15.72:0/2953128605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb9c0feac0 0x7ffb9c197d30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000bd70 tx=0x7ffb9000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.167+0000 7ffb9a000700 1 -- 172.21.15.72:0/2953128605 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb9001d070 con 0x7ffb9c0feac0 2024-03-19T06:17:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.167+0000 7ffb9a000700 1 -- 172.21.15.72:0/2953128605 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb90022470 con 0x7ffb9c0feac0 2024-03-19T06:17:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.167+0000 7ffba4000700 1 -- 172.21.15.72:0/2953128605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9c19d440 con 0x7ffb9c0feac0 2024-03-19T06:17:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.167+0000 7ffb9a000700 1 -- 172.21.15.72:0/2953128605 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb9000f670 con 0x7ffb9c0feac0 2024-03-19T06:17:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.167+0000 7ffba4000700 1 -- 172.21.15.72:0/2953128605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9c19d900 con 0x7ffb9c0feac0 2024-03-19T06:17:23.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.169+0000 7ffba4000700 1 -- 172.21.15.72:0/2953128605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9c10aff0 con 0x7ffb9c0feac0 2024-03-19T06:17:23.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.170+0000 7ffb9a000700 1 -- 172.21.15.72:0/2953128605 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7ffb90022a50 con 0x7ffb9c0feac0 2024-03-19T06:17:23.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.171+0000 7ffb9a000700 1 --2- 172.21.15.72:0/2953128605 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffb8406dfa0 0x7ffb84070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:23.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.172+0000 7ffb9a000700 1 -- 172.21.15.72:0/2953128605 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ffb9008f560 con 0x7ffb9c0feac0 2024-03-19T06:17:23.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.172+0000 7ffba0c00700 1 --2- 172.21.15.72:0/2953128605 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffb8406dfa0 0x7ffb84070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:23.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.173+0000 7ffba0c00700 1 --2- 172.21.15.72:0/2953128605 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffb8406dfa0 0x7ffb84070450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffb88007900 tx=0x7ffb88008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.178+0000 7ffb9a000700 1 -- 172.21.15.72:0/2953128605 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7ffb90058ab0 con 0x7ffb9c0feac0 2024-03-19T06:17:23.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.459+0000 7ffba4000700 1 -- 172.21.15.72:0/2953128605 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb9c108810 con 0x7ffb8406dfa0 2024-03-19T06:17:23.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.461+0000 7ffb9a000700 1 -- 172.21.15.72:0/2953128605 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7ffb9c108810 con 0x7ffb8406dfa0 2024-03-19T06:17:23.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.464+0000 7ffba4000700 1 -- 172.21.15.72:0/2953128605 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffb8406dfa0 msgr2=0x7ffb84070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:23.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.464+0000 7ffba4000700 1 --2- 172.21.15.72:0/2953128605 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffb8406dfa0 0x7ffb84070450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffb88007900 tx=0x7ffb88008040 comp rx=0 tx=0).stop 2024-03-19T06:17:23.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.464+0000 7ffba4000700 1 -- 172.21.15.72:0/2953128605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb9c0feac0 msgr2=0x7ffb9c197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:23.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.464+0000 7ffba4000700 1 --2- 172.21.15.72:0/2953128605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb9c0feac0 0x7ffb9c197d30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000bd70 tx=0x7ffb9000be50 comp rx=0 tx=0).stop 2024-03-19T06:17:23.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.464+0000 7ffba4000700 1 -- 172.21.15.72:0/2953128605 shutdown_connections 2024-03-19T06:17:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.464+0000 7ffba4000700 1 --2- 172.21.15.72:0/2953128605 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffb8406dfa0 0x7ffb84070450 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.464+0000 7ffba4000700 1 --2- 172.21.15.72:0/2953128605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb9c0feac0 0x7ffb9c197d30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.464+0000 7ffba4000700 1 --2- 172.21.15.72:0/2953128605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb9c0ff410 0x7ffb9c198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.464+0000 7ffba4000700 1 -- 172.21.15.72:0/2953128605 >> 172.21.15.72:0/2953128605 conn(0x7ffb9c0fa6d0 msgr2=0x7ffb9c1070f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.464+0000 7ffba4000700 1 -- 172.21.15.72:0/2953128605 shutdown_connections 2024-03-19T06:17:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.464+0000 7ffba4000700 1 -- 172.21.15.72:0/2953128605 wait complete. 2024-03-19T06:17:23.469 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:17:23.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.620+0000 7f833e400700 1 -- 172.21.15.72:0/1801823275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8338073730 msgr2=0x7f8338073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:23.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.620+0000 7f833e400700 1 --2- 172.21.15.72:0/1801823275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8338073730 0x7f8338073ba0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8324009910 tx=0x7f8324009c20 comp rx=0 tx=0).stop 2024-03-19T06:17:23.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.620+0000 7f833e400700 1 -- 172.21.15.72:0/1801823275 shutdown_connections 2024-03-19T06:17:23.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.620+0000 7f833e400700 1 --2- 172.21.15.72:0/1801823275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8338073730 0x7f8338073ba0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.620+0000 7f833e400700 1 --2- 172.21.15.72:0/1801823275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8338074d00 0x7f8338073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.620+0000 7f833e400700 1 -- 172.21.15.72:0/1801823275 >> 172.21.15.72:0/1801823275 conn(0x7f83380fb7f0 msgr2=0x7f83380fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:23.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.620+0000 7f833e400700 1 -- 172.21.15.72:0/1801823275 shutdown_connections 2024-03-19T06:17:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.620+0000 7f833e400700 1 -- 172.21.15.72:0/1801823275 wait complete. 2024-03-19T06:17:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.621+0000 7f833e400700 1 Processor -- start 2024-03-19T06:17:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.622+0000 7f833e400700 1 -- start start 2024-03-19T06:17:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.622+0000 7f833e400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8338073730 0x7f8338197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.622+0000 7f833e400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8338074d00 0x7f83381981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.622+0000 7f833e400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83381987b0 con 0x7f8338074d00 2024-03-19T06:17:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.622+0000 7f833e400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8338198920 con 0x7f8338073730 2024-03-19T06:17:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.622+0000 7f8336a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8338074d00 0x7f83381981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.622+0000 7f8336a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8338074d00 0x7f83381981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47042/0 (socket says 172.21.15.72:47042) 2024-03-19T06:17:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.622+0000 7f8336a00700 1 -- 172.21.15.72:0/4247870827 learned_addr learned my addr 172.21.15.72:0/4247870827 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:17:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.623+0000 7f8337400700 1 --2- 172.21.15.72:0/4247870827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8338073730 0x7f8338197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.623+0000 7f8336a00700 1 -- 172.21.15.72:0/4247870827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8338073730 msgr2=0x7f8338197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.623+0000 7f8336a00700 1 --2- 172.21.15.72:0/4247870827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8338073730 0x7f8338197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.623+0000 7f8336a00700 1 -- 172.21.15.72:0/4247870827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83240095f0 con 0x7f8338074d00 2024-03-19T06:17:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.623+0000 7f8336a00700 1 --2- 172.21.15.72:0/4247870827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8338074d00 0x7f83381981b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8324005b40 tx=0x7f832400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.623+0000 7f832fe00700 1 -- 172.21.15.72:0/4247870827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f832401d070 con 0x7f8338074d00 2024-03-19T06:17:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.623+0000 7f832fe00700 1 -- 172.21.15.72:0/4247870827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f832400f460 con 0x7f8338074d00 2024-03-19T06:17:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.623+0000 7f833e400700 1 -- 172.21.15.72:0/4247870827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833819d350 con 0x7f8338074d00 2024-03-19T06:17:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.623+0000 7f832fe00700 1 -- 172.21.15.72:0/4247870827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8324021640 con 0x7f8338074d00 2024-03-19T06:17:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.624+0000 7f833e400700 1 -- 172.21.15.72:0/4247870827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833819d840 con 0x7f8338074d00 2024-03-19T06:17:23.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.625+0000 7f833e400700 1 -- 172.21.15.72:0/4247870827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833810af70 con 0x7f8338074d00 2024-03-19T06:17:23.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.626+0000 7f832fe00700 1 -- 172.21.15.72:0/4247870827 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f832400fa90 con 0x7f8338074d00 2024-03-19T06:17:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.627+0000 7f832fe00700 1 --2- 172.21.15.72:0/4247870827 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f831c06dfa0 0x7f831c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.627+0000 7f832fe00700 1 -- 172.21.15.72:0/4247870827 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f832408f1a0 con 0x7f8338074d00 2024-03-19T06:17:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.627+0000 7f8337400700 1 --2- 172.21.15.72:0/4247870827 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f831c06dfa0 0x7f831c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.628+0000 7f8337400700 1 --2- 172.21.15.72:0/4247870827 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f831c06dfa0 0x7f831c070450 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8328005950 tx=0x7f83280058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:23.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.632+0000 7f832fe00700 1 -- 172.21.15.72:0/4247870827 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f8324058520 con 0x7f8338074d00 2024-03-19T06:17:23.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.884+0000 7f833e400700 1 -- 172.21.15.72:0/4247870827 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83381077c0 con 0x7f831c06dfa0 2024-03-19T06:17:23.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.887+0000 7f832fe00700 1 -- 172.21.15.72:0/4247870827 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f83381077c0 con 0x7f831c06dfa0 2024-03-19T06:17:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.891+0000 7f833e400700 1 -- 172.21.15.72:0/4247870827 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f831c06dfa0 msgr2=0x7f831c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.891+0000 7f833e400700 1 --2- 172.21.15.72:0/4247870827 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f831c06dfa0 0x7f831c070450 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8328005950 tx=0x7f83280058e0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.891+0000 7f833e400700 1 -- 172.21.15.72:0/4247870827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8338074d00 msgr2=0x7f83381981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.891+0000 7f833e400700 1 --2- 172.21.15.72:0/4247870827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8338074d00 0x7f83381981b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8324005b40 tx=0x7f832400be20 comp rx=0 tx=0).stop 2024-03-19T06:17:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.891+0000 7f833e400700 1 -- 172.21.15.72:0/4247870827 shutdown_connections 2024-03-19T06:17:23.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.891+0000 7f833e400700 1 --2- 172.21.15.72:0/4247870827 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f831c06dfa0 0x7f831c070450 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.891+0000 7f833e400700 1 --2- 172.21.15.72:0/4247870827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8338073730 0x7f8338197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.891+0000 7f833e400700 1 --2- 172.21.15.72:0/4247870827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8338074d00 0x7f83381981b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:23.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.891+0000 7f833e400700 1 -- 172.21.15.72:0/4247870827 >> 172.21.15.72:0/4247870827 conn(0x7f83380fb7f0 msgr2=0x7f83381060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:23.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.892+0000 7f833e400700 1 -- 172.21.15.72:0/4247870827 shutdown_connections 2024-03-19T06:17:23.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:23.892+0000 7f833e400700 1 -- 172.21.15.72:0/4247870827 wait complete. 2024-03-19T06:17:24.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.051+0000 7f5e18000700 1 -- 172.21.15.72:0/1122743445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10102490 msgr2=0x7f5e101028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:24.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.051+0000 7f5e18000700 1 --2- 172.21.15.72:0/1122743445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10102490 0x7f5e101028a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009910 tx=0x7f5e04009c20 comp rx=0 tx=0).stop 2024-03-19T06:17:24.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.052+0000 7f5e18000700 1 -- 172.21.15.72:0/1122743445 shutdown_connections 2024-03-19T06:17:24.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.052+0000 7f5e18000700 1 --2- 172.21.15.72:0/1122743445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e10103640 0x7f5e10103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.052+0000 7f5e18000700 1 --2- 172.21.15.72:0/1122743445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10102490 0x7f5e101028a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.052+0000 7f5e18000700 1 -- 172.21.15.72:0/1122743445 >> 172.21.15.72:0/1122743445 conn(0x7f5e100fda60 msgr2=0x7f5e100ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:24.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.052+0000 7f5e18000700 1 -- 172.21.15.72:0/1122743445 shutdown_connections 2024-03-19T06:17:24.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.052+0000 7f5e18000700 1 -- 172.21.15.72:0/1122743445 wait complete. 2024-03-19T06:17:24.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.053+0000 7f5e18000700 1 Processor -- start 2024-03-19T06:17:24.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.053+0000 7f5e18000700 1 -- start start 2024-03-19T06:17:24.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.054+0000 7f5e18000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e10102490 0x7f5e10197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:24.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.054+0000 7f5e18000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10103640 0x7f5e10198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:24.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.054+0000 7f5e18000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e10198860 con 0x7f5e10103640 2024-03-19T06:17:24.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.054+0000 7f5e18000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1019d270 con 0x7f5e10102490 2024-03-19T06:17:24.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.054+0000 7f5e14c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10103640 0x7f5e10198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:24.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.054+0000 7f5e14c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10103640 0x7f5e10198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46158/0 (socket says 172.21.15.72:46158) 2024-03-19T06:17:24.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.055+0000 7f5e14c00700 1 -- 172.21.15.72:0/121398183 learned_addr learned my addr 172.21.15.72:0/121398183 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:17:24.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.055+0000 7f5e15600700 1 --2- 172.21.15.72:0/121398183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e10102490 0x7f5e10197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:24.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.055+0000 7f5e14c00700 1 -- 172.21.15.72:0/121398183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e10102490 msgr2=0x7f5e10197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:24.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.055+0000 7f5e14c00700 1 --2- 172.21.15.72:0/121398183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e10102490 0x7f5e10197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.055+0000 7f5e14c00700 1 -- 172.21.15.72:0/121398183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e040095f0 con 0x7f5e10103640 2024-03-19T06:17:24.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.056+0000 7f5e14c00700 1 --2- 172.21.15.72:0/121398183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10103640 0x7f5e10198240 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c8a0 tx=0x7f5dfc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:24.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.056+0000 7f5e0e000700 1 -- 172.21.15.72:0/121398183 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dfc00cea0 con 0x7f5e10103640 2024-03-19T06:17:24.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.056+0000 7f5e18000700 1 -- 172.21.15.72:0/121398183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1019d470 con 0x7f5e10103640 2024-03-19T06:17:24.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.056+0000 7f5e18000700 1 -- 172.21.15.72:0/121398183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1019d990 con 0x7f5e10103640 2024-03-19T06:17:24.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.057+0000 7f5e0e000700 1 -- 172.21.15.72:0/121398183 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5dfc00f450 con 0x7f5e10103640 2024-03-19T06:17:24.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.057+0000 7f5e0e000700 1 -- 172.21.15.72:0/121398183 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dfc0175a0 con 0x7f5e10103640 2024-03-19T06:17:24.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.058+0000 7f5e18000700 1 -- 172.21.15.72:0/121398183 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df0005320 con 0x7f5e10103640 2024-03-19T06:17:24.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.059+0000 7f5e0e000700 1 -- 172.21.15.72:0/121398183 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f5dfc017700 con 0x7f5e10103640 2024-03-19T06:17:24.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.060+0000 7f5e0e000700 1 --2- 172.21.15.72:0/121398183 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5df806dfa0 0x7f5df8070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:24.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.060+0000 7f5e0e000700 1 -- 172.21.15.72:0/121398183 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5dfc08da90 con 0x7f5e10103640 2024-03-19T06:17:24.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.061+0000 7f5e15600700 1 --2- 172.21.15.72:0/121398183 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5df806dfa0 0x7f5df8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:24.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.062+0000 7f5e15600700 1 --2- 172.21.15.72:0/121398183 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5df806dfa0 0x7f5df8070450 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009fd0 tx=0x7f5e0400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:24.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.065+0000 7f5e0e000700 1 -- 172.21.15.72:0/121398183 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f5dfc056e90 con 0x7f5e10103640 2024-03-19T06:17:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.321+0000 7f5e18000700 1 -- 172.21.15.72:0/121398183 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5df0000bf0 con 0x7f5df806dfa0 2024-03-19T06:17:24.311 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:24 smithi072 ceph-mon[78545]: pgmap v337: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:24.311 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:24 smithi072 ceph-mon[78545]: from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:17:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.334+0000 7f5e0e000700 1 -- 172.21.15.72:0/121398183 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f5df0000bf0 con 0x7f5df806dfa0 2024-03-19T06:17:24.323 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:17:24.323 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (42s) 35s ago 23m 13.4M - 0.25.0 c8568f914cd2 0afa852435dc 2024-03-19T06:17:24.323 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (2m) 35s ago 24m 8220k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 7e45101af382 2024-03-19T06:17:24.323 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (118s) 87s ago 22m 7620k - 19.0.0-1934-gb0ea271b 5c4d8774b57a d8a7d621cc29 2024-03-19T06:17:24.323 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (8m) 35s ago 24m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:17:24.323 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (8m) 87s ago 22m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:17:24.323 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 starting - - - - 2024-03-19T06:17:24.323 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (3m) 35s ago 16m 17.3M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 3ea4b00e2248 2024-03-19T06:17:24.323 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (3m) 35s ago 16m 68.3M - 19.0.0-1934-gb0ea271b 5c4d8774b57a d0daead2fe2a 2024-03-19T06:17:24.323 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (2m) 87s ago 16m 12.2M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 788348d02918 2024-03-19T06:17:24.323 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (2m) 87s ago 16m 12.4M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 2cbfb6aeff05 2024-03-19T06:17:24.323 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (12m) 35s ago 25m 513M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:17:24.324 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (10m) 87s ago 22m 453M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:17:24.324 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (10m) 35s ago 26m 61.3M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:17:24.324 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (9m) 87s ago 22m 45.8M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:17:24.324 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (98s) 35s ago 24m 7436k - 1.5.0 0da6a335fe13 81983d103a8e 2024-03-19T06:17:24.324 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (91s) 87s ago 22m 3019k - 1.5.0 0da6a335fe13 d533ddf64373 2024-03-19T06:17:24.324 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (7m) 35s ago 21m 98.9M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:17:24.324 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (7m) 35s ago 20m 103M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:17:24.324 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (6m) 35s ago 20m 93.2M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:17:24.324 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (6m) 87s ago 19m 106M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:17:24.324 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (5m) 87s ago 18m 98.1M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:17:24.324 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (4m) 87s ago 18m 91.5M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a c47c9c7fd3c7 2024-03-19T06:17:24.324 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (67s) 35s ago 23m 68.3M - 2.43.0 a07b618ecd1d 380a9dd83787 2024-03-19T06:17:24.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.336+0000 7f5e18000700 1 -- 172.21.15.72:0/121398183 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5df806dfa0 msgr2=0x7f5df8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:24.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.336+0000 7f5e18000700 1 --2- 172.21.15.72:0/121398183 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5df806dfa0 0x7f5df8070450 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009fd0 tx=0x7f5e0400b540 comp rx=0 tx=0).stop 2024-03-19T06:17:24.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.336+0000 7f5e18000700 1 -- 172.21.15.72:0/121398183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10103640 msgr2=0x7f5e10198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.336+0000 7f5e18000700 1 --2- 172.21.15.72:0/121398183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10103640 0x7f5e10198240 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c8a0 tx=0x7f5dfc00cc60 comp rx=0 tx=0).stop 2024-03-19T06:17:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.336+0000 7f5e18000700 1 -- 172.21.15.72:0/121398183 shutdown_connections 2024-03-19T06:17:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.336+0000 7f5e18000700 1 --2- 172.21.15.72:0/121398183 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5df806dfa0 0x7f5df8070450 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.336+0000 7f5e18000700 1 --2- 172.21.15.72:0/121398183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e10102490 0x7f5e10197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.337+0000 7f5e18000700 1 --2- 172.21.15.72:0/121398183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e10103640 0x7f5e10198240 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.337+0000 7f5e18000700 1 -- 172.21.15.72:0/121398183 >> 172.21.15.72:0/121398183 conn(0x7f5e100fda60 msgr2=0x7f5e10106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.337+0000 7f5e18000700 1 -- 172.21.15.72:0/121398183 shutdown_connections 2024-03-19T06:17:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.337+0000 7f5e18000700 1 -- 172.21.15.72:0/121398183 wait complete. 2024-03-19T06:17:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.489+0000 7f373e600700 1 -- 172.21.15.72:0/2181418811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3738074d80 msgr2=0x7f37380731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.489+0000 7f373e600700 1 --2- 172.21.15.72:0/2181418811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3738074d80 0x7f37380731e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3728009910 tx=0x7f3728009c20 comp rx=0 tx=0).stop 2024-03-19T06:17:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.490+0000 7f373e600700 1 -- 172.21.15.72:0/2181418811 shutdown_connections 2024-03-19T06:17:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.490+0000 7f373e600700 1 --2- 172.21.15.72:0/2181418811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37380737b0 0x7f3738073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.490+0000 7f373e600700 1 --2- 172.21.15.72:0/2181418811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3738074d80 0x7f37380731e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.490+0000 7f373e600700 1 -- 172.21.15.72:0/2181418811 >> 172.21.15.72:0/2181418811 conn(0x7f37380fb7f0 msgr2=0x7f37380fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.490+0000 7f373e600700 1 -- 172.21.15.72:0/2181418811 shutdown_connections 2024-03-19T06:17:24.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.490+0000 7f373e600700 1 -- 172.21.15.72:0/2181418811 wait complete. 2024-03-19T06:17:24.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.491+0000 7f373e600700 1 Processor -- start 2024-03-19T06:17:24.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.491+0000 7f373e600700 1 -- start start 2024-03-19T06:17:24.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.492+0000 7f373e600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37380737b0 0x7f373819c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:24.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.492+0000 7f373e600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3738074d80 0x7f373819c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:24.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.492+0000 7f373e600700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373819cb30 con 0x7f3738074d80 2024-03-19T06:17:24.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.492+0000 7f373e600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373819cc70 con 0x7f37380737b0 2024-03-19T06:17:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.492+0000 7f3736a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3738074d80 0x7f373819c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.492+0000 7f3736a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3738074d80 0x7f373819c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46164/0 (socket says 172.21.15.72:46164) 2024-03-19T06:17:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.492+0000 7f3736a00700 1 -- 172.21.15.72:0/560805318 learned_addr learned my addr 172.21.15.72:0/560805318 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:17:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.492+0000 7f3737400700 1 --2- 172.21.15.72:0/560805318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37380737b0 0x7f373819c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.493+0000 7f3736a00700 1 -- 172.21.15.72:0/560805318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37380737b0 msgr2=0x7f373819c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.493+0000 7f3736a00700 1 --2- 172.21.15.72:0/560805318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37380737b0 0x7f373819c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.493+0000 7f3736a00700 1 -- 172.21.15.72:0/560805318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37280095f0 con 0x7f3738074d80 2024-03-19T06:17:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.493+0000 7f3736a00700 1 --2- 172.21.15.72:0/560805318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3738074d80 0x7f373819c5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f372400c930 tx=0x7f372400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.493+0000 7f372fe00700 1 -- 172.21.15.72:0/560805318 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3724007ad0 con 0x7f3738074d80 2024-03-19T06:17:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.493+0000 7f373e600700 1 -- 172.21.15.72:0/560805318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37381a1730 con 0x7f3738074d80 2024-03-19T06:17:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.493+0000 7f372fe00700 1 -- 172.21.15.72:0/560805318 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3724007c30 con 0x7f3738074d80 2024-03-19T06:17:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.493+0000 7f372fe00700 1 -- 172.21.15.72:0/560805318 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3724018630 con 0x7f3738074d80 2024-03-19T06:17:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.493+0000 7f373e600700 1 -- 172.21.15.72:0/560805318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37381a1c50 con 0x7f3738074d80 2024-03-19T06:17:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.494+0000 7f373e600700 1 -- 172.21.15.72:0/560805318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373810f370 con 0x7f3738074d80 2024-03-19T06:17:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.496+0000 7f372fe00700 1 -- 172.21.15.72:0/560805318 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f372400f450 con 0x7f3738074d80 2024-03-19T06:17:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.497+0000 7f372fe00700 1 --2- 172.21.15.72:0/560805318 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f371c06dfa0 0x7f371c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.497+0000 7f372fe00700 1 -- 172.21.15.72:0/560805318 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f372408df00 con 0x7f3738074d80 2024-03-19T06:17:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.497+0000 7f3737400700 1 --2- 172.21.15.72:0/560805318 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f371c06dfa0 0x7f371c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:24.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.498+0000 7f3737400700 1 --2- 172.21.15.72:0/560805318 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f371c06dfa0 0x7f371c070450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3728006010 tx=0x7f372800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:24.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.502+0000 7f372fe00700 1 -- 172.21.15.72:0/560805318 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f372405aed0 con 0x7f3738074d80 2024-03-19T06:17:24.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:24 smithi172 ceph-mon[66682]: pgmap v337: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:24.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:24 smithi172 ceph-mon[66682]: from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:17:24.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.818+0000 7f373e600700 1 -- 172.21.15.72:0/560805318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f373810f560 con 0x7f3738074d80 2024-03-19T06:17:24.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.819+0000 7f372fe00700 1 -- 172.21.15.72:0/560805318 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f3724061070 con 0x7f3738074d80 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 6 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 4 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:17:24.809 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:17:24.810 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 14 2024-03-19T06:17:24.810 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:17:24.810 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:17:24.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.821+0000 7f373e600700 1 -- 172.21.15.72:0/560805318 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f371c06dfa0 msgr2=0x7f371c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:24.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.821+0000 7f373e600700 1 --2- 172.21.15.72:0/560805318 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f371c06dfa0 0x7f371c070450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3728006010 tx=0x7f372800b540 comp rx=0 tx=0).stop 2024-03-19T06:17:24.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.822+0000 7f373e600700 1 -- 172.21.15.72:0/560805318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3738074d80 msgr2=0x7f373819c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:24.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.822+0000 7f373e600700 1 --2- 172.21.15.72:0/560805318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3738074d80 0x7f373819c5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f372400c930 tx=0x7f372400ccf0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.822+0000 7f373e600700 1 -- 172.21.15.72:0/560805318 shutdown_connections 2024-03-19T06:17:24.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.822+0000 7f373e600700 1 --2- 172.21.15.72:0/560805318 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f371c06dfa0 0x7f371c070450 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.822+0000 7f373e600700 1 --2- 172.21.15.72:0/560805318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37380737b0 0x7f373819c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.822+0000 7f373e600700 1 --2- 172.21.15.72:0/560805318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3738074d80 0x7f373819c5a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.822+0000 7f373e600700 1 -- 172.21.15.72:0/560805318 >> 172.21.15.72:0/560805318 conn(0x7f37380fb7f0 msgr2=0x7f3738101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:24.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.822+0000 7f373e600700 1 -- 172.21.15.72:0/560805318 shutdown_connections 2024-03-19T06:17:24.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.822+0000 7f373e600700 1 -- 172.21.15.72:0/560805318 wait complete. 2024-03-19T06:17:24.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.977+0000 7f9858200700 1 -- 172.21.15.72:0/2186989729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9850103680 msgr2=0x7f9850105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:24.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.977+0000 7f9858200700 1 --2- 172.21.15.72:0/2186989729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9850103680 0x7f9850105a60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f983c009910 tx=0x7f983c009c20 comp rx=0 tx=0).stop 2024-03-19T06:17:24.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.977+0000 7f9858200700 1 -- 172.21.15.72:0/2186989729 shutdown_connections 2024-03-19T06:17:24.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.977+0000 7f9858200700 1 --2- 172.21.15.72:0/2186989729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9850103680 0x7f9850105a60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.977+0000 7f9858200700 1 --2- 172.21.15.72:0/2186989729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9850100d60 0x7f9850103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.977+0000 7f9858200700 1 -- 172.21.15.72:0/2186989729 >> 172.21.15.72:0/2186989729 conn(0x7f98500fa780 msgr2=0x7f98500fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.977+0000 7f9858200700 1 -- 172.21.15.72:0/2186989729 shutdown_connections 2024-03-19T06:17:24.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.978+0000 7f9858200700 1 -- 172.21.15.72:0/2186989729 wait complete. 2024-03-19T06:17:24.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.979+0000 7f9858200700 1 Processor -- start 2024-03-19T06:17:24.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.979+0000 7f9858200700 1 -- start start 2024-03-19T06:17:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.980+0000 7f9858200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9850100d60 0x7f98501006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.980+0000 7f9858200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9850103680 0x7f98500fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.980+0000 7f9858200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98500ff250 con 0x7f9850100d60 2024-03-19T06:17:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.980+0000 7f9858200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98500ff390 con 0x7f9850103680 2024-03-19T06:17:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.980+0000 7f9855800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9850100d60 0x7f98501006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.980+0000 7f9855800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9850100d60 0x7f98501006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46180/0 (socket says 172.21.15.72:46180) 2024-03-19T06:17:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.980+0000 7f9855800700 1 -- 172.21.15.72:0/3283580133 learned_addr learned my addr 172.21.15.72:0/3283580133 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:17:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.980+0000 7f9855800700 1 -- 172.21.15.72:0/3283580133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9850103680 msgr2=0x7f98500fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.980+0000 7f9855800700 1 --2- 172.21.15.72:0/3283580133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9850103680 0x7f98500fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.980+0000 7f9855800700 1 -- 172.21.15.72:0/3283580133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c0095f0 con 0x7f9850100d60 2024-03-19T06:17:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.981+0000 7f9855800700 1 --2- 172.21.15.72:0/3283580133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9850100d60 0x7f98501006c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f984400d900 tx=0x7f984400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.981+0000 7f984e000700 1 -- 172.21.15.72:0/3283580133 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9844009900 con 0x7f9850100d60 2024-03-19T06:17:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.981+0000 7f984e000700 1 -- 172.21.15.72:0/3283580133 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9844010460 con 0x7f9850100d60 2024-03-19T06:17:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.981+0000 7f984e000700 1 -- 172.21.15.72:0/3283580133 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f984400f5f0 con 0x7f9850100d60 2024-03-19T06:17:24.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.982+0000 7f9858200700 1 -- 172.21.15.72:0/3283580133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98500ff670 con 0x7f9850100d60 2024-03-19T06:17:24.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.982+0000 7f9858200700 1 -- 172.21.15.72:0/3283580133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98500ffb70 con 0x7f9850100d60 2024-03-19T06:17:24.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.983+0000 7f9858200700 1 -- 172.21.15.72:0/3283580133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985018fbe0 con 0x7f9850100d60 2024-03-19T06:17:24.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.984+0000 7f984e000700 1 -- 172.21.15.72:0/3283580133 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f98440105d0 con 0x7f9850100d60 2024-03-19T06:17:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.985+0000 7f984e000700 1 --2- 172.21.15.72:0/3283580133 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f983806dfa0 0x7f9838070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.985+0000 7f984e000700 1 -- 172.21.15.72:0/3283580133 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f984408daa0 con 0x7f9850100d60 2024-03-19T06:17:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.986+0000 7f9854e00700 1 --2- 172.21.15.72:0/3283580133 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f983806dfa0 0x7f9838070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.986+0000 7f9854e00700 1 --2- 172.21.15.72:0/3283580133 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f983806dfa0 0x7f9838070450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f983c005090 tx=0x7f983c005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:24.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:24.990+0000 7f984e000700 1 -- 172.21.15.72:0/3283580133 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f984405a950 con 0x7f9850100d60 2024-03-19T06:17:25.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.268+0000 7f9858200700 1 -- 172.21.15.72:0/3283580133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9850061960 con 0x7f9850100d60 2024-03-19T06:17:25.256 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:25 smithi072 ceph-mon[78545]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:17:25.256 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:25 smithi072 ceph-mon[78545]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:17:25.257 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:25 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/560805318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:25.257 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:17:25.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.269+0000 7f984e000700 1 -- 172.21.15.72:0/3283580133 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f984405a4e0 con 0x7f9850100d60 2024-03-19T06:17:25.257 INFO:teuthology.orchestra.run.smithi072.stdout:e44 2024-03-19T06:17:25.257 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:17:25.257 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:17:25.257 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:17:25.257 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:17:25.258 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:17:25.258 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:17:25.258 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 44 2024-03-19T06:17:25.258 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:17:25.258 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:17:25.258 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:15:10.305125+0000 2024-03-19T06:17:25.258 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:17:25.258 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:17:25.258 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:17:25.258 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:17:25.258 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 83 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=34488,1=34510} 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:17:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:17:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:17:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:17:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:17:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:34488} state up:active seq 24 join_fscid=1 addr [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:17:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{1:34510} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.72:6828/3957356790,v1:172.21.15.72:6829/3957356790] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:17:25.260 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:17:25.260 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:17:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:17:25.260 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:17:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/1022637060,v1:172.21.15.172:6825/1022637060] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:17:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3126751850,v1:172.21.15.172:6827/3126751850] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:17:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.272+0000 7f9858200700 1 -- 172.21.15.72:0/3283580133 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f983806dfa0 msgr2=0x7f9838070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.272+0000 7f9858200700 1 --2- 172.21.15.72:0/3283580133 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f983806dfa0 0x7f9838070450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f983c005090 tx=0x7f983c005fb0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.272+0000 7f9858200700 1 -- 172.21.15.72:0/3283580133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9850100d60 msgr2=0x7f98501006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.272+0000 7f9858200700 1 --2- 172.21.15.72:0/3283580133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9850100d60 0x7f98501006c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f984400d900 tx=0x7f984400dcc0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.273+0000 7f9858200700 1 -- 172.21.15.72:0/3283580133 shutdown_connections 2024-03-19T06:17:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.273+0000 7f9858200700 1 --2- 172.21.15.72:0/3283580133 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f983806dfa0 0x7f9838070450 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.273+0000 7f9858200700 1 --2- 172.21.15.72:0/3283580133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9850100d60 0x7f98501006c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.273+0000 7f9858200700 1 --2- 172.21.15.72:0/3283580133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9850103680 0x7f98500fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.273+0000 7f9858200700 1 -- 172.21.15.72:0/3283580133 >> 172.21.15.72:0/3283580133 conn(0x7f98500fa780 msgr2=0x7f98500fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.273+0000 7f9858200700 1 -- 172.21.15.72:0/3283580133 shutdown_connections 2024-03-19T06:17:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.273+0000 7f9858200700 1 -- 172.21.15.72:0/3283580133 wait complete. 2024-03-19T06:17:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 44 2024-03-19T06:17:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.430+0000 7f26aa000700 1 -- 172.21.15.72:0/3854489507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a4103370 msgr2=0x7f26a4105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.430+0000 7f26aa000700 1 --2- 172.21.15.72:0/3854489507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a4103370 0x7f26a4105790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2690009910 tx=0x7f2690009c20 comp rx=0 tx=0).stop 2024-03-19T06:17:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.431+0000 7f26aa000700 1 -- 172.21.15.72:0/3854489507 shutdown_connections 2024-03-19T06:17:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.431+0000 7f26aa000700 1 --2- 172.21.15.72:0/3854489507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a4103370 0x7f26a4105790 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.431+0000 7f26aa000700 1 --2- 172.21.15.72:0/3854489507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a4069210 0x7f26a4102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.431+0000 7f26aa000700 1 -- 172.21.15.72:0/3854489507 >> 172.21.15.72:0/3854489507 conn(0x7f26a40fa780 msgr2=0x7f26a40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.431+0000 7f26aa000700 1 -- 172.21.15.72:0/3854489507 shutdown_connections 2024-03-19T06:17:25.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.431+0000 7f26aa000700 1 -- 172.21.15.72:0/3854489507 wait complete. 2024-03-19T06:17:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.432+0000 7f26aa000700 1 Processor -- start 2024-03-19T06:17:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.432+0000 7f26aa000700 1 -- start start 2024-03-19T06:17:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.432+0000 7f26aa000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a4069210 0x7f26a4195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.432+0000 7f26aa000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a4103370 0x7f26a4196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.433+0000 7f26aa000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a4196690 con 0x7f26a4103370 2024-03-19T06:17:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.433+0000 7f26aa000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a41967d0 con 0x7f26a4069210 2024-03-19T06:17:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.433+0000 7f26a2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a4103370 0x7f26a4196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.433+0000 7f26a2a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a4103370 0x7f26a4196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46202/0 (socket says 172.21.15.72:46202) 2024-03-19T06:17:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.433+0000 7f26a2a00700 1 -- 172.21.15.72:0/1694938416 learned_addr learned my addr 172.21.15.72:0/1694938416 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:17:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.433+0000 7f26a3400700 1 --2- 172.21.15.72:0/1694938416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a4069210 0x7f26a4195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.433+0000 7f26a2a00700 1 -- 172.21.15.72:0/1694938416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a4069210 msgr2=0x7f26a4195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.433+0000 7f26a2a00700 1 --2- 172.21.15.72:0/1694938416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a4069210 0x7f26a4195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.433+0000 7f26a2a00700 1 -- 172.21.15.72:0/1694938416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26900095f0 con 0x7f26a4103370 2024-03-19T06:17:25.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.434+0000 7f26a2a00700 1 --2- 172.21.15.72:0/1694938416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a4103370 0x7f26a4196070 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f269000bd70 tx=0x7f269000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.434+0000 7f269be00700 1 -- 172.21.15.72:0/1694938416 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f269001d070 con 0x7f26a4103370 2024-03-19T06:17:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.434+0000 7f269be00700 1 -- 172.21.15.72:0/1694938416 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2690022470 con 0x7f26a4103370 2024-03-19T06:17:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.434+0000 7f26aa000700 1 -- 172.21.15.72:0/1694938416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a419b220 con 0x7f26a4103370 2024-03-19T06:17:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.434+0000 7f269be00700 1 -- 172.21.15.72:0/1694938416 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f269000f670 con 0x7f26a4103370 2024-03-19T06:17:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.434+0000 7f26aa000700 1 -- 172.21.15.72:0/1694938416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a419b710 con 0x7f26a4103370 2024-03-19T06:17:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.435+0000 7f26aa000700 1 -- 172.21.15.72:0/1694938416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a418fc70 con 0x7f26a4103370 2024-03-19T06:17:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.437+0000 7f269be00700 1 -- 172.21.15.72:0/1694938416 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f2690022a50 con 0x7f26a4103370 2024-03-19T06:17:25.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.437+0000 7f269be00700 1 --2- 172.21.15.72:0/1694938416 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f268806dfa0 0x7f2688070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:25.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.438+0000 7f269be00700 1 -- 172.21.15.72:0/1694938416 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f269008f490 con 0x7f26a4103370 2024-03-19T06:17:25.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.438+0000 7f26a3400700 1 --2- 172.21.15.72:0/1694938416 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f268806dfa0 0x7f2688070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:25.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.439+0000 7f26a3400700 1 --2- 172.21.15.72:0/1694938416 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f268806dfa0 0x7f2688070450 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2694006fd0 tx=0x7f2694008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:25.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.442+0000 7f269be00700 1 -- 172.21.15.72:0/1694938416 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f269005c470 con 0x7f26a4103370 2024-03-19T06:17:25.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:25 smithi172 ceph-mon[66682]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:17:25.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:25 smithi172 ceph-mon[66682]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:17:25.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:25 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/560805318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:25.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:17:25.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.690+0000 7f26aa000700 1 -- 172.21.15.72:0/1694938416 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26a4061190 con 0x7f268806dfa0 2024-03-19T06:17:25.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.691+0000 7f269be00700 1 -- 172.21.15.72:0/1694938416 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f26a4061190 con 0x7f268806dfa0 2024-03-19T06:17:25.679 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:17:25.679 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399", 2024-03-19T06:17:25.679 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": true, 2024-03-19T06:17:25.679 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-19T06:17:25.679 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [ 2024-03-19T06:17:25.679 INFO:teuthology.orchestra.run.smithi072.stdout: "crash", 2024-03-19T06:17:25.680 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph-exporter", 2024-03-19T06:17:25.680 INFO:teuthology.orchestra.run.smithi072.stdout: "mds", 2024-03-19T06:17:25.680 INFO:teuthology.orchestra.run.smithi072.stdout: "osd", 2024-03-19T06:17:25.680 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr", 2024-03-19T06:17:25.680 INFO:teuthology.orchestra.run.smithi072.stdout: "mon" 2024-03-19T06:17:25.680 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-03-19T06:17:25.680 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": "18/23 daemons upgraded", 2024-03-19T06:17:25.680 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "Currently upgrading grafana daemons", 2024-03-19T06:17:25.680 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:17:25.680 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:17:25.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.694+0000 7f26aa000700 1 -- 172.21.15.72:0/1694938416 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f268806dfa0 msgr2=0x7f2688070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.694+0000 7f26aa000700 1 --2- 172.21.15.72:0/1694938416 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f268806dfa0 0x7f2688070450 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2694006fd0 tx=0x7f2694008040 comp rx=0 tx=0).stop 2024-03-19T06:17:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.694+0000 7f26aa000700 1 -- 172.21.15.72:0/1694938416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a4103370 msgr2=0x7f26a4196070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.694+0000 7f26aa000700 1 --2- 172.21.15.72:0/1694938416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a4103370 0x7f26a4196070 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f269000bd70 tx=0x7f269000be50 comp rx=0 tx=0).stop 2024-03-19T06:17:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.694+0000 7f26aa000700 1 -- 172.21.15.72:0/1694938416 shutdown_connections 2024-03-19T06:17:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.694+0000 7f26aa000700 1 --2- 172.21.15.72:0/1694938416 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f268806dfa0 0x7f2688070450 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.694+0000 7f26aa000700 1 --2- 172.21.15.72:0/1694938416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a4069210 0x7f26a4195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.694+0000 7f26aa000700 1 --2- 172.21.15.72:0/1694938416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a4103370 0x7f26a4196070 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.694+0000 7f26aa000700 1 -- 172.21.15.72:0/1694938416 >> 172.21.15.72:0/1694938416 conn(0x7f26a40fa780 msgr2=0x7f26a40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.694+0000 7f26aa000700 1 -- 172.21.15.72:0/1694938416 shutdown_connections 2024-03-19T06:17:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.694+0000 7f26aa000700 1 -- 172.21.15.72:0/1694938416 wait complete. 2024-03-19T06:17:25.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.838+0000 7f4512400700 1 -- 172.21.15.72:0/1020451984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c100240 msgr2=0x7f450c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:25.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.838+0000 7f4512400700 1 --2- 172.21.15.72:0/1020451984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c100240 0x7f450c100650 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009910 tx=0x7f44fc009c20 comp rx=0 tx=0).stop 2024-03-19T06:17:25.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.838+0000 7f4512400700 1 -- 172.21.15.72:0/1020451984 shutdown_connections 2024-03-19T06:17:25.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.838+0000 7f4512400700 1 --2- 172.21.15.72:0/1020451984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c101440 0x7f450c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.838+0000 7f4512400700 1 --2- 172.21.15.72:0/1020451984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c100240 0x7f450c100650 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.838+0000 7f4512400700 1 -- 172.21.15.72:0/1020451984 >> 172.21.15.72:0/1020451984 conn(0x7f450c0fb7f0 msgr2=0x7f450c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:25.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.839+0000 7f4512400700 1 -- 172.21.15.72:0/1020451984 shutdown_connections 2024-03-19T06:17:25.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.839+0000 7f4512400700 1 -- 172.21.15.72:0/1020451984 wait complete. 2024-03-19T06:17:25.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.839+0000 7f4512400700 1 Processor -- start 2024-03-19T06:17:25.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.840+0000 7f4512400700 1 -- start start 2024-03-19T06:17:25.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.840+0000 7f4512400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c100240 0x7f450c197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:25.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.840+0000 7f4512400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c101440 0x7f450c198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:25.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.840+0000 7f4512400700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c198850 con 0x7f450c100240 2024-03-19T06:17:25.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.840+0000 7f4512400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c19d260 con 0x7f450c101440 2024-03-19T06:17:25.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.840+0000 7f450b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c100240 0x7f450c197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:25.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.840+0000 7f450b400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c100240 0x7f450c197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46224/0 (socket says 172.21.15.72:46224) 2024-03-19T06:17:25.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.840+0000 7f450b400700 1 -- 172.21.15.72:0/1780576179 learned_addr learned my addr 172.21.15.72:0/1780576179 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:17:25.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.841+0000 7f450aa00700 1 --2- 172.21.15.72:0/1780576179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c101440 0x7f450c198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:25.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.841+0000 7f450b400700 1 -- 172.21.15.72:0/1780576179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c101440 msgr2=0x7f450c198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:25.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.841+0000 7f450b400700 1 --2- 172.21.15.72:0/1780576179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c101440 0x7f450c198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:25.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.841+0000 7f450b400700 1 -- 172.21.15.72:0/1780576179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc0095f0 con 0x7f450c100240 2024-03-19T06:17:25.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.841+0000 7f450b400700 1 --2- 172.21.15.72:0/1780576179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c100240 0x7f450c197cf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00bda0 tx=0x7f44fc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:25.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.841+0000 7f4503e00700 1 -- 172.21.15.72:0/1780576179 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44fc01d070 con 0x7f450c100240 2024-03-19T06:17:25.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.841+0000 7f4503e00700 1 -- 172.21.15.72:0/1780576179 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44fc004c50 con 0x7f450c100240 2024-03-19T06:17:25.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.841+0000 7f4512400700 1 -- 172.21.15.72:0/1780576179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c19d400 con 0x7f450c100240 2024-03-19T06:17:25.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.841+0000 7f4503e00700 1 -- 172.21.15.72:0/1780576179 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44fc00f690 con 0x7f450c100240 2024-03-19T06:17:25.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.841+0000 7f4512400700 1 -- 172.21.15.72:0/1780576179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c19d8c0 con 0x7f450c100240 2024-03-19T06:17:25.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.842+0000 7f4512400700 1 -- 172.21.15.72:0/1780576179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450c105520 con 0x7f450c100240 2024-03-19T06:17:25.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.843+0000 7f4503e00700 1 -- 172.21.15.72:0/1780576179 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f44fc00f900 con 0x7f450c100240 2024-03-19T06:17:25.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.844+0000 7f4503e00700 1 --2- 172.21.15.72:0/1780576179 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f44f006dfa0 0x7f44f0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:25.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.844+0000 7f4503e00700 1 -- 172.21.15.72:0/1780576179 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f44fc08f5d0 con 0x7f450c100240 2024-03-19T06:17:25.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.844+0000 7f450aa00700 1 --2- 172.21.15.72:0/1780576179 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f44f006dfa0 0x7f44f0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:25.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.845+0000 7f450aa00700 1 --2- 172.21.15.72:0/1780576179 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f44f006dfa0 0x7f44f0070450 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f44f8005fd0 tx=0x7f44f800a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:25.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:25.849+0000 7f4503e00700 1 -- 172.21.15.72:0/1780576179 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f44fc058950 con 0x7f450c100240 2024-03-19T06:17:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.154+0000 7f4512400700 1 -- 172.21.15.72:0/1780576179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f450c02cc30 con 0x7f450c100240 2024-03-19T06:17:26.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.155+0000 7f4503e00700 1 -- 172.21.15.72:0/1780576179 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f44fc05c010 con 0x7f450c100240 2024-03-19T06:17:26.143 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:17:26.143 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:17:26.143 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:17:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.157+0000 7f4512400700 1 -- 172.21.15.72:0/1780576179 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f44f006dfa0 msgr2=0x7f44f0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.157+0000 7f4512400700 1 --2- 172.21.15.72:0/1780576179 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f44f006dfa0 0x7f44f0070450 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f44f8005fd0 tx=0x7f44f800a560 comp rx=0 tx=0).stop 2024-03-19T06:17:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.157+0000 7f4512400700 1 -- 172.21.15.72:0/1780576179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c100240 msgr2=0x7f450c197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.157+0000 7f4512400700 1 --2- 172.21.15.72:0/1780576179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c100240 0x7f450c197cf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00bda0 tx=0x7f44fc00be80 comp rx=0 tx=0).stop 2024-03-19T06:17:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.157+0000 7f4512400700 1 -- 172.21.15.72:0/1780576179 shutdown_connections 2024-03-19T06:17:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.157+0000 7f4512400700 1 --2- 172.21.15.72:0/1780576179 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f44f006dfa0 0x7f44f0070450 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.157+0000 7f4512400700 1 --2- 172.21.15.72:0/1780576179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f450c100240 0x7f450c197cf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.157+0000 7f4512400700 1 --2- 172.21.15.72:0/1780576179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c101440 0x7f450c198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.158+0000 7f4512400700 1 -- 172.21.15.72:0/1780576179 >> 172.21.15.72:0/1780576179 conn(0x7f450c0fb7f0 msgr2=0x7f450c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.158+0000 7f4512400700 1 -- 172.21.15.72:0/1780576179 shutdown_connections 2024-03-19T06:17:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:26.158+0000 7f4512400700 1 -- 172.21.15.72:0/1780576179 wait complete. 2024-03-19T06:17:26.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:26 smithi072 ceph-mon[78545]: pgmap v338: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:26.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:26 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3283580133' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:17:26.419 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:26 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1780576179' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:17:26.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:26 smithi172 ceph-mon[66682]: pgmap v338: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:26.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:26 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3283580133' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:17:26.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:26 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1780576179' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:17:27.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:27 smithi072 ceph-mon[78545]: from='client.34686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:17:27.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:27 smithi172 ceph-mon[66682]: from='client.34686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:17:28.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:28 smithi072 ceph-mon[78545]: pgmap v339: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:28.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:28 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:28.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:28 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:28.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:28 smithi172 ceph-mon[66682]: pgmap v339: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:28.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:28 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:28.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:28 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:30.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:30 smithi072 ceph-mon[78545]: pgmap v340: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:30.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:30 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:30.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:30 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:30.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:30 smithi172 ceph-mon[66682]: pgmap v340: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:30.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:30 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:30.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:30 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:32.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:32 smithi072 ceph-mon[78545]: pgmap v341: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:32.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:32 smithi172 ceph-mon[66682]: pgmap v341: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:34.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:34 smithi172 ceph-mon[66682]: pgmap v342: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:35.074 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:34 smithi072 ceph-mon[78545]: pgmap v342: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: pgmap v343: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:17:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:17:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-19T06:17:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-19T06:17:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:17:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.575 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.576 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:36.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-19T06:17:36.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-19T06:17:36.577 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-19T06:17:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-19T06:17:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-19T06:17:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-19T06:17:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-19T06:17:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-19T06:17:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-19T06:17:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-19T06:17:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-19T06:17:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-19T06:17:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-19T06:17:36.578 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-19T06:17:36.579 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-19T06:17:36.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:17:36.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:17:36.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:17:36.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:36.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:17:36.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:17:36.580 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:36 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:17:36.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: pgmap v343: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:36.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:36.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:36.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:17:36.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:17:36.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:36.652 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-19T06:17:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-19T06:17:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:17:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.653 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.654 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:17:36.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:36.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-19T06:17:36.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-19T06:17:36.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-19T06:17:36.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-19T06:17:36.655 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-19T06:17:36.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-19T06:17:36.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-19T06:17:36.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-19T06:17:36.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-19T06:17:36.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-19T06:17:36.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-19T06:17:36.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-19T06:17:36.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-19T06:17:36.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-19T06:17:36.656 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-19T06:17:36.657 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-19T06:17:36.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-19T06:17:36.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:17:36.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:17:36.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:17:36.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:36.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:17:36.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:17:36.658 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:36 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:17:37.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:37 smithi072 ceph-mon[78545]: Upgrade: Finalizing container_image settings 2024-03-19T06:17:37.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:37 smithi072 ceph-mon[78545]: Upgrade: Complete! 2024-03-19T06:17:37.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:37 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:37.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:37 smithi172 ceph-mon[66682]: Upgrade: Finalizing container_image settings 2024-03-19T06:17:37.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:37 smithi172 ceph-mon[66682]: Upgrade: Complete! 2024-03-19T06:17:37.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:37 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:38.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:38 smithi072 ceph-mon[78545]: pgmap v344: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:38.553 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:38 smithi172 ceph-mon[66682]: pgmap v344: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:40.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:40 smithi072 ceph-mon[78545]: pgmap v345: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:40.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:17:40.574 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:40.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:40 smithi172 ceph-mon[66682]: pgmap v345: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:40.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:17:40.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:17:42.550 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:42 smithi072 ceph-mon[78545]: pgmap v346: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:42.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:42 smithi172 ceph-mon[66682]: pgmap v346: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:44.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:44 smithi072 ceph-mon[78545]: pgmap v347: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:44.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:44 smithi172 ceph-mon[66682]: pgmap v347: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:46.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:46 smithi072 ceph-mon[78545]: pgmap v348: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:46.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:46 smithi172 ceph-mon[66682]: pgmap v348: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:48.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:48 smithi072 ceph-mon[78545]: pgmap v349: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:48.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:48 smithi172 ceph-mon[66682]: pgmap v349: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:50.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:50 smithi072 ceph-mon[78545]: pgmap v350: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:50.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:50 smithi172 ceph-mon[66682]: pgmap v350: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:52.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:52 smithi072 ceph-mon[78545]: pgmap v351: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:52.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:52 smithi172 ceph-mon[66682]: pgmap v351: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:54.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:54 smithi072 ceph-mon[78545]: pgmap v352: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:54.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:54 smithi172 ceph-mon[66682]: pgmap v352: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:55.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:17:55.745 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:17:56.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.324+0000 7efcf1800700 1 -- 172.21.15.72:0/90342134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcec100240 msgr2=0x7efcec100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.324+0000 7efcf1800700 1 --2- 172.21.15.72:0/90342134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcec100240 0x7efcec100650 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009910 tx=0x7efcdc009c20 comp rx=0 tx=0).stop 2024-03-19T06:17:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.324+0000 7efcf1800700 1 -- 172.21.15.72:0/90342134 shutdown_connections 2024-03-19T06:17:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.324+0000 7efcf1800700 1 --2- 172.21.15.72:0/90342134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcec101440 0x7efcec101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.324+0000 7efcf1800700 1 --2- 172.21.15.72:0/90342134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcec100240 0x7efcec100650 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.324+0000 7efcf1800700 1 -- 172.21.15.72:0/90342134 >> 172.21.15.72:0/90342134 conn(0x7efcec0fb7f0 msgr2=0x7efcec0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.324+0000 7efcf1800700 1 -- 172.21.15.72:0/90342134 shutdown_connections 2024-03-19T06:17:56.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.324+0000 7efcf1800700 1 -- 172.21.15.72:0/90342134 wait complete. 2024-03-19T06:17:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.326+0000 7efcf1800700 1 Processor -- start 2024-03-19T06:17:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.326+0000 7efcf1800700 1 -- start start 2024-03-19T06:17:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.326+0000 7efcf1800700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcec100240 0x7efcec197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.326+0000 7efcf1800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcec101440 0x7efcec198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.326+0000 7efcf1800700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec198850 con 0x7efcec100240 2024-03-19T06:17:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.326+0000 7efcf1800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec19d260 con 0x7efcec101440 2024-03-19T06:17:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.326+0000 7efceaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcec100240 0x7efcec197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.327+0000 7efceaa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcec100240 0x7efcec197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50838/0 (socket says 172.21.15.72:50838) 2024-03-19T06:17:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.327+0000 7efceaa00700 1 -- 172.21.15.72:0/3028913304 learned_addr learned my addr 172.21.15.72:0/3028913304 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:17:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.327+0000 7efceaa00700 1 -- 172.21.15.72:0/3028913304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcec101440 msgr2=0x7efcec198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.327+0000 7efceaa00700 1 --2- 172.21.15.72:0/3028913304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcec101440 0x7efcec198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.327+0000 7efceaa00700 1 -- 172.21.15.72:0/3028913304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0095f0 con 0x7efcec100240 2024-03-19T06:17:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.327+0000 7efceaa00700 1 --2- 172.21.15.72:0/3028913304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcec100240 0x7efcec197cf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00bd70 tx=0x7efcdc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.327+0000 7efce3400700 1 -- 172.21.15.72:0/3028913304 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcdc01d070 con 0x7efcec100240 2024-03-19T06:17:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.328+0000 7efce3400700 1 -- 172.21.15.72:0/3028913304 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efcdc00f460 con 0x7efcec100240 2024-03-19T06:17:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.328+0000 7efcf1800700 1 -- 172.21.15.72:0/3028913304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcec19d400 con 0x7efcec100240 2024-03-19T06:17:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.328+0000 7efce3400700 1 -- 172.21.15.72:0/3028913304 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcdc021620 con 0x7efcec100240 2024-03-19T06:17:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.328+0000 7efcf1800700 1 -- 172.21.15.72:0/3028913304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcec19d8c0 con 0x7efcec100240 2024-03-19T06:17:56.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.329+0000 7efcf1800700 1 -- 172.21.15.72:0/3028913304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcec105520 con 0x7efcec100240 2024-03-19T06:17:56.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.330+0000 7efce3400700 1 -- 172.21.15.72:0/3028913304 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7efcdc00fa70 con 0x7efcec100240 2024-03-19T06:17:56.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.331+0000 7efce3400700 1 --2- 172.21.15.72:0/3028913304 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efcd006dfa0 0x7efcd0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:17:56.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.331+0000 7efce3400700 1 -- 172.21.15.72:0/3028913304 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efcdc08f170 con 0x7efcec100240 2024-03-19T06:17:56.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.331+0000 7efcea000700 1 --2- 172.21.15.72:0/3028913304 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efcd006dfa0 0x7efcd0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:17:56.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.332+0000 7efcea000700 1 --2- 172.21.15.72:0/3028913304 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efcd006dfa0 0x7efcd0070450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efcd800a990 tx=0x7efcd8005c80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:17:56.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.336+0000 7efce3400700 1 -- 172.21.15.72:0/3028913304 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7efcdc058570 con 0x7efcec100240 2024-03-19T06:17:56.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:56 smithi072 ceph-mon[78545]: pgmap v353: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:56.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.594+0000 7efcf1800700 1 -- 172.21.15.72:0/3028913304 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efcec061190 con 0x7efcd006dfa0 2024-03-19T06:17:56.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.596+0000 7efce3400700 1 -- 172.21.15.72:0/3028913304 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7efcec061190 con 0x7efcd006dfa0 2024-03-19T06:17:56.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.598+0000 7efcf1800700 1 -- 172.21.15.72:0/3028913304 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efcd006dfa0 msgr2=0x7efcd0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:56.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.598+0000 7efcf1800700 1 --2- 172.21.15.72:0/3028913304 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efcd006dfa0 0x7efcd0070450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efcd800a990 tx=0x7efcd8005c80 comp rx=0 tx=0).stop 2024-03-19T06:17:56.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.598+0000 7efcf1800700 1 -- 172.21.15.72:0/3028913304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcec100240 msgr2=0x7efcec197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:17:56.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.598+0000 7efcf1800700 1 --2- 172.21.15.72:0/3028913304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcec100240 0x7efcec197cf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00bd70 tx=0x7efcdc00be50 comp rx=0 tx=0).stop 2024-03-19T06:17:56.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.599+0000 7efcf1800700 1 -- 172.21.15.72:0/3028913304 shutdown_connections 2024-03-19T06:17:56.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.599+0000 7efcf1800700 1 --2- 172.21.15.72:0/3028913304 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efcd006dfa0 0x7efcd0070450 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:56.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.599+0000 7efcf1800700 1 --2- 172.21.15.72:0/3028913304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcec100240 0x7efcec197cf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:56.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.599+0000 7efcf1800700 1 --2- 172.21.15.72:0/3028913304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcec101440 0x7efcec198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:17:56.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.599+0000 7efcf1800700 1 -- 172.21.15.72:0/3028913304 >> 172.21.15.72:0/3028913304 conn(0x7efcec0fb7f0 msgr2=0x7efcec102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:17:56.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.599+0000 7efcf1800700 1 -- 172.21.15.72:0/3028913304 shutdown_connections 2024-03-19T06:17:56.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:17:56.599+0000 7efcf1800700 1 -- 172.21.15.72:0/3028913304 wait complete. 2024-03-19T06:17:56.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:56 smithi172 ceph-mon[66682]: pgmap v353: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:57.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph orch ps' 2024-03-19T06:17:57.550 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:57 smithi072 ceph-mon[78545]: from='client.34694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:17:57.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:57 smithi172 ceph-mon[66682]: from='client.34694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:17:57.884 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:17:58.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:17:58 smithi172 ceph-mon[66682]: pgmap v354: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:17:58.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:17:58 smithi072 ceph-mon[78545]: pgmap v354: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.095+0000 7fd482000700 1 -- 172.21.15.72:0/1805377133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c10c8f0 msgr2=0x7fd47c10ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.095+0000 7fd482000700 1 --2- 172.21.15.72:0/1805377133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c10c8f0 0x7fd47c10ccc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009910 tx=0x7fd46c009c20 comp rx=0 tx=0).stop 2024-03-19T06:18:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.095+0000 7fd482000700 1 -- 172.21.15.72:0/1805377133 shutdown_connections 2024-03-19T06:18:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.095+0000 7fd482000700 1 --2- 172.21.15.72:0/1805377133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd47c106b80 0x7fd47c106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.095+0000 7fd482000700 1 --2- 172.21.15.72:0/1805377133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c10c8f0 0x7fd47c10ccc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.095+0000 7fd482000700 1 -- 172.21.15.72:0/1805377133 >> 172.21.15.72:0/1805377133 conn(0x7fd47c076060 msgr2=0x7fd47c078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:18:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.095+0000 7fd482000700 1 -- 172.21.15.72:0/1805377133 shutdown_connections 2024-03-19T06:18:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.095+0000 7fd482000700 1 -- 172.21.15.72:0/1805377133 wait complete. 2024-03-19T06:18:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.096+0000 7fd482000700 1 Processor -- start 2024-03-19T06:18:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.097+0000 7fd482000700 1 -- start start 2024-03-19T06:18:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.097+0000 7fd482000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd47c106b80 0x7fd47c19c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:18:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.097+0000 7fd482000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c10c8f0 0x7fd47c19ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:18:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.097+0000 7fd482000700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c19d120 con 0x7fd47c10c8f0 2024-03-19T06:18:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.097+0000 7fd482000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c1a0eb0 con 0x7fd47c106b80 2024-03-19T06:18:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.097+0000 7fd47aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c10c8f0 0x7fd47c19ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:18:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.097+0000 7fd47aa00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c10c8f0 0x7fd47c19ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50860/0 (socket says 172.21.15.72:50860) 2024-03-19T06:18:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.097+0000 7fd47aa00700 1 -- 172.21.15.72:0/2093309292 learned_addr learned my addr 172.21.15.72:0/2093309292 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:18:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.098+0000 7fd47b400700 1 --2- 172.21.15.72:0/2093309292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd47c106b80 0x7fd47c19c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:18:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.098+0000 7fd47aa00700 1 -- 172.21.15.72:0/2093309292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd47c106b80 msgr2=0x7fd47c19c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.098+0000 7fd47aa00700 1 --2- 172.21.15.72:0/2093309292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd47c106b80 0x7fd47c19c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.098+0000 7fd47aa00700 1 -- 172.21.15.72:0/2093309292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c0095f0 con 0x7fd47c10c8f0 2024-03-19T06:18:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.098+0000 7fd47aa00700 1 --2- 172.21.15.72:0/2093309292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c10c8f0 0x7fd47c19ca40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd46800d8d0 tx=0x7fd46800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:18:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.099+0000 7fd473e00700 1 -- 172.21.15.72:0/2093309292 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd468009940 con 0x7fd47c10c8f0 2024-03-19T06:18:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.099+0000 7fd473e00700 1 -- 172.21.15.72:0/2093309292 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd468010460 con 0x7fd47c10c8f0 2024-03-19T06:18:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.099+0000 7fd482000700 1 -- 172.21.15.72:0/2093309292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47c1a1190 con 0x7fd47c10c8f0 2024-03-19T06:18:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.099+0000 7fd473e00700 1 -- 172.21.15.72:0/2093309292 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd46800f5f0 con 0x7fd47c10c8f0 2024-03-19T06:18:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.099+0000 7fd482000700 1 -- 172.21.15.72:0/2093309292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47c1a16e0 con 0x7fd47c10c8f0 2024-03-19T06:18:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.100+0000 7fd482000700 1 -- 172.21.15.72:0/2093309292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47c109b20 con 0x7fd47c10c8f0 2024-03-19T06:18:00.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.101+0000 7fd473e00700 1 -- 172.21.15.72:0/2093309292 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fd4680105d0 con 0x7fd47c10c8f0 2024-03-19T06:18:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.102+0000 7fd473e00700 1 --2- 172.21.15.72:0/2093309292 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd46006dfa0 0x7fd460070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:18:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.102+0000 7fd473e00700 1 -- 172.21.15.72:0/2093309292 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd46808de70 con 0x7fd47c10c8f0 2024-03-19T06:18:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.102+0000 7fd47b400700 1 --2- 172.21.15.72:0/2093309292 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd46006dfa0 0x7fd460070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:18:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.103+0000 7fd47b400700 1 --2- 172.21.15.72:0/2093309292 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd46006dfa0 0x7fd460070450 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd46c006010 tx=0x7fd46c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:18:00.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.107+0000 7fd473e00700 1 -- 172.21.15.72:0/2093309292 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fd4680571f0 con 0x7fd47c10c8f0 2024-03-19T06:18:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.340+0000 7fd482000700 1 -- 172.21.15.72:0/2093309292 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd47c1a1900 con 0x7fd46006dfa0 2024-03-19T06:18:00.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.365+0000 7fd473e00700 1 -- 172.21.15.72:0/2093309292 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fd47c1a1900 con 0x7fd46006dfa0 2024-03-19T06:18:00.355 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:18:00.355 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (78s) 32s ago 24m 13.5M - 0.25.0 c8568f914cd2 0afa852435dc 2024-03-19T06:18:00.355 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (2m) 32s ago 24m 8274k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 7e45101af382 2024-03-19T06:18:00.355 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (2m) 2m ago 23m 7620k - 19.0.0-1934-gb0ea271b 5c4d8774b57a d8a7d621cc29 2024-03-19T06:18:00.355 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (9m) 32s ago 24m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:18:00.355 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (8m) 2m ago 23m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:18:00.355 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (39s) 32s ago 24m 52.0M - 9.4.12 a0ea5e3c46d9 2464fb7eda5d 2024-03-19T06:18:00.355 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (3m) 32s ago 16m 18.9M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 3ea4b00e2248 2024-03-19T06:18:00.355 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (4m) 32s ago 17m 68.4M - 19.0.0-1934-gb0ea271b 5c4d8774b57a d0daead2fe2a 2024-03-19T06:18:00.355 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (3m) 2m ago 16m 12.2M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 788348d02918 2024-03-19T06:18:00.355 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (3m) 2m ago 16m 12.4M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 2cbfb6aeff05 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (13m) 32s ago 26m 513M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (11m) 2m ago 22m 453M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (10m) 32s ago 26m 61.9M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (10m) 2m ago 22m 45.8M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (2m) 32s ago 24m 7910k - 1.5.0 0da6a335fe13 81983d103a8e 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (2m) 2m ago 23m 3019k - 1.5.0 0da6a335fe13 d533ddf64373 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (8m) 32s ago 21m 100M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (7m) 32s ago 21m 105M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (7m) 32s ago 20m 93.4M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (6m) 2m ago 20m 106M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (6m) 2m ago 19m 98.1M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (5m) 2m ago 18m 91.5M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a c47c9c7fd3c7 2024-03-19T06:18:00.356 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (103s) 32s ago 23m 69.7M - 2.43.0 a07b618ecd1d 380a9dd83787 2024-03-19T06:18:00.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.369+0000 7fd482000700 1 -- 172.21.15.72:0/2093309292 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd46006dfa0 msgr2=0x7fd460070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:00.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.369+0000 7fd482000700 1 --2- 172.21.15.72:0/2093309292 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd46006dfa0 0x7fd460070450 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd46c006010 tx=0x7fd46c01a040 comp rx=0 tx=0).stop 2024-03-19T06:18:00.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.369+0000 7fd482000700 1 -- 172.21.15.72:0/2093309292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c10c8f0 msgr2=0x7fd47c19ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:00.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.369+0000 7fd482000700 1 --2- 172.21.15.72:0/2093309292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c10c8f0 0x7fd47c19ca40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd46800d8d0 tx=0x7fd46800dc90 comp rx=0 tx=0).stop 2024-03-19T06:18:00.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.369+0000 7fd482000700 1 -- 172.21.15.72:0/2093309292 shutdown_connections 2024-03-19T06:18:00.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.369+0000 7fd482000700 1 --2- 172.21.15.72:0/2093309292 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd46006dfa0 0x7fd460070450 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:00.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.369+0000 7fd482000700 1 --2- 172.21.15.72:0/2093309292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd47c106b80 0x7fd47c19c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:00.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.369+0000 7fd482000700 1 --2- 172.21.15.72:0/2093309292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c10c8f0 0x7fd47c19ca40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:00.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.369+0000 7fd482000700 1 -- 172.21.15.72:0/2093309292 >> 172.21.15.72:0/2093309292 conn(0x7fd47c076060 msgr2=0x7fd47c077aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:18:00.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.369+0000 7fd482000700 1 -- 172.21.15.72:0/2093309292 shutdown_connections 2024-03-19T06:18:00.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:00.369+0000 7fd482000700 1 -- 172.21.15.72:0/2093309292 wait complete. 2024-03-19T06:18:00.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:00 smithi172 ceph-mon[66682]: pgmap v355: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:00.710 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:00 smithi072 ceph-mon[78545]: pgmap v355: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:01.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph orch upgrade status' 2024-03-19T06:18:01.548 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:18:01.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:01 smithi172 ceph-mon[66682]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:18:01.703 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:01 smithi072 ceph-mon[78545]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:18:02.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:02 smithi072 ceph-mon[78545]: pgmap v356: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:02.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:02 smithi172 ceph-mon[66682]: pgmap v356: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:03.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.678+0000 7fb01ca00700 1 -- 172.21.15.72:0/1459281582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb018102e70 msgr2=0x7fb018106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:03.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.678+0000 7fb01ca00700 1 --2- 172.21.15.72:0/1459281582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb018102e70 0x7fb018106e40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb004009910 tx=0x7fb004009c20 comp rx=0 tx=0).stop 2024-03-19T06:18:03.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.678+0000 7fb01ca00700 1 -- 172.21.15.72:0/1459281582 shutdown_connections 2024-03-19T06:18:03.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.678+0000 7fb01ca00700 1 --2- 172.21.15.72:0/1459281582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb018102e70 0x7fb018106e40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:03.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.678+0000 7fb01ca00700 1 --2- 172.21.15.72:0/1459281582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0181024d0 0x7fb0181028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:03.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.678+0000 7fb01ca00700 1 -- 172.21.15.72:0/1459281582 >> 172.21.15.72:0/1459281582 conn(0x7fb0180fdd90 msgr2=0x7fb0181001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:18:03.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.678+0000 7fb01ca00700 1 -- 172.21.15.72:0/1459281582 shutdown_connections 2024-03-19T06:18:03.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.678+0000 7fb01ca00700 1 -- 172.21.15.72:0/1459281582 wait complete. 2024-03-19T06:18:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.679+0000 7fb01ca00700 1 Processor -- start 2024-03-19T06:18:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.680+0000 7fb01ca00700 1 -- start start 2024-03-19T06:18:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.680+0000 7fb01ca00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0181024d0 0x7fb018197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:18:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.680+0000 7fb01ca00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb018102e70 0x7fb018198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:18:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.680+0000 7fb01ca00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018198a30 con 0x7fb018102e70 2024-03-19T06:18:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.680+0000 7fb01ca00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01819c7c0 con 0x7fb0181024d0 2024-03-19T06:18:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.681+0000 7fb015e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb018102e70 0x7fb018198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:18:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.681+0000 7fb015e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb018102e70 0x7fb018198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50876/0 (socket says 172.21.15.72:50876) 2024-03-19T06:18:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.681+0000 7fb015e00700 1 -- 172.21.15.72:0/2544301008 learned_addr learned my addr 172.21.15.72:0/2544301008 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:18:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.681+0000 7fb015e00700 1 -- 172.21.15.72:0/2544301008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0181024d0 msgr2=0x7fb018197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.681+0000 7fb015e00700 1 --2- 172.21.15.72:0/2544301008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0181024d0 0x7fb018197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.681+0000 7fb015e00700 1 -- 172.21.15.72:0/2544301008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040095f0 con 0x7fb018102e70 2024-03-19T06:18:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.681+0000 7fb015e00700 1 --2- 172.21.15.72:0/2544301008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb018102e70 0x7fb018198350 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb004005f50 tx=0x7fb00400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:18:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.682+0000 7fb00f400700 1 -- 172.21.15.72:0/2544301008 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00401d070 con 0x7fb018102e70 2024-03-19T06:18:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.682+0000 7fb00f400700 1 -- 172.21.15.72:0/2544301008 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb00400f460 con 0x7fb018102e70 2024-03-19T06:18:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.682+0000 7fb01ca00700 1 -- 172.21.15.72:0/2544301008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01819ca40 con 0x7fb018102e70 2024-03-19T06:18:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.682+0000 7fb00f400700 1 -- 172.21.15.72:0/2544301008 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb004017630 con 0x7fb018102e70 2024-03-19T06:18:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.682+0000 7fb01ca00700 1 -- 172.21.15.72:0/2544301008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01819cf30 con 0x7fb018102e70 2024-03-19T06:18:03.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.683+0000 7fb01ca00700 1 -- 172.21.15.72:0/2544301008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01810a840 con 0x7fb018102e70 2024-03-19T06:18:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.684+0000 7fb00f400700 1 -- 172.21.15.72:0/2544301008 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fb00400f5d0 con 0x7fb018102e70 2024-03-19T06:18:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.685+0000 7fb00f400700 1 --2- 172.21.15.72:0/2544301008 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7faffc06dfa0 0x7faffc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:18:03.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.685+0000 7fb00f400700 1 -- 172.21.15.72:0/2544301008 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb00408f3f0 con 0x7fb018102e70 2024-03-19T06:18:03.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.685+0000 7fb016800700 1 --2- 172.21.15.72:0/2544301008 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7faffc06dfa0 0x7faffc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:18:03.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.686+0000 7fb016800700 1 --2- 172.21.15.72:0/2544301008 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7faffc06dfa0 0x7faffc070450 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb00800a990 tx=0x7fb008005c80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:18:03.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.690+0000 7fb00f400700 1 -- 172.21.15.72:0/2544301008 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fb004058770 con 0x7fb018102e70 2024-03-19T06:18:03.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.935+0000 7fb01ca00700 1 -- 172.21.15.72:0/2544301008 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb01802cca0 con 0x7faffc06dfa0 2024-03-19T06:18:03.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.938+0000 7fb00f400700 1 -- 172.21.15.72:0/2544301008 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fb01802cca0 con 0x7faffc06dfa0 2024-03-19T06:18:03.927 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:18:03.927 INFO:teuthology.orchestra.run.smithi072.stdout: "target_image": null, 2024-03-19T06:18:03.927 INFO:teuthology.orchestra.run.smithi072.stdout: "in_progress": false, 2024-03-19T06:18:03.927 INFO:teuthology.orchestra.run.smithi072.stdout: "which": "", 2024-03-19T06:18:03.927 INFO:teuthology.orchestra.run.smithi072.stdout: "services_complete": [], 2024-03-19T06:18:03.927 INFO:teuthology.orchestra.run.smithi072.stdout: "progress": null, 2024-03-19T06:18:03.927 INFO:teuthology.orchestra.run.smithi072.stdout: "message": "", 2024-03-19T06:18:03.927 INFO:teuthology.orchestra.run.smithi072.stdout: "is_paused": false 2024-03-19T06:18:03.927 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:18:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.941+0000 7fb01ca00700 1 -- 172.21.15.72:0/2544301008 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7faffc06dfa0 msgr2=0x7faffc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.941+0000 7fb01ca00700 1 --2- 172.21.15.72:0/2544301008 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7faffc06dfa0 0x7faffc070450 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb00800a990 tx=0x7fb008005c80 comp rx=0 tx=0).stop 2024-03-19T06:18:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.941+0000 7fb01ca00700 1 -- 172.21.15.72:0/2544301008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb018102e70 msgr2=0x7fb018198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:03.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.941+0000 7fb01ca00700 1 --2- 172.21.15.72:0/2544301008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb018102e70 0x7fb018198350 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb004005f50 tx=0x7fb00400be20 comp rx=0 tx=0).stop 2024-03-19T06:18:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.941+0000 7fb01ca00700 1 -- 172.21.15.72:0/2544301008 shutdown_connections 2024-03-19T06:18:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.941+0000 7fb01ca00700 1 --2- 172.21.15.72:0/2544301008 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7faffc06dfa0 0x7faffc070450 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.941+0000 7fb01ca00700 1 --2- 172.21.15.72:0/2544301008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0181024d0 0x7fb018197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.941+0000 7fb01ca00700 1 --2- 172.21.15.72:0/2544301008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb018102e70 0x7fb018198350 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.941+0000 7fb01ca00700 1 -- 172.21.15.72:0/2544301008 >> 172.21.15.72:0/2544301008 conn(0x7fb0180fdd90 msgr2=0x7fb018100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:18:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.941+0000 7fb01ca00700 1 -- 172.21.15.72:0/2544301008 shutdown_connections 2024-03-19T06:18:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:03.942+0000 7fb01ca00700 1 -- 172.21.15.72:0/2544301008 wait complete. 2024-03-19T06:18:04.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:04 smithi072 ceph-mon[78545]: pgmap v357: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:04.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:04 smithi172 ceph-mon[66682]: pgmap v357: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:04.792 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph health detail' 2024-03-19T06:18:05.207 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:18:05.628 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:05 smithi072 ceph-mon[78545]: from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:18:05.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:05 smithi172 ceph-mon[66682]: from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:18:06.507 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:06 smithi072 ceph-mon[78545]: pgmap v358: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:06.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:06 smithi172 ceph-mon[66682]: pgmap v358: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:07.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.401+0000 7fa5fec00700 1 -- 172.21.15.72:0/3113548087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f8073090 msgr2=0x7fa5f8073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:07.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.401+0000 7fa5fec00700 1 --2- 172.21.15.72:0/3113548087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f8073090 0x7fa5f8073460 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800b0d0 tx=0x7fa5e800b3e0 comp rx=0 tx=0).stop 2024-03-19T06:18:07.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.401+0000 7fa5fec00700 1 -- 172.21.15.72:0/3113548087 shutdown_connections 2024-03-19T06:18:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.401+0000 7fa5fec00700 1 --2- 172.21.15.72:0/3113548087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f80739a0 0x7fa5f810c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.401+0000 7fa5fec00700 1 --2- 172.21.15.72:0/3113548087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f8073090 0x7fa5f8073460 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.401+0000 7fa5fec00700 1 -- 172.21.15.72:0/3113548087 >> 172.21.15.72:0/3113548087 conn(0x7fa5f80fbd40 msgr2=0x7fa5f80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:18:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.401+0000 7fa5fec00700 1 -- 172.21.15.72:0/3113548087 shutdown_connections 2024-03-19T06:18:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.401+0000 7fa5fec00700 1 -- 172.21.15.72:0/3113548087 wait complete. 2024-03-19T06:18:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.402+0000 7fa5fec00700 1 Processor -- start 2024-03-19T06:18:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.402+0000 7fa5fec00700 1 -- start start 2024-03-19T06:18:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.403+0000 7fa5fec00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f8073090 0x7fa5f81980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:18:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.403+0000 7fa5fec00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f80739a0 0x7fa5f8198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:18:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.403+0000 7fa5fec00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8198ce0 con 0x7fa5f8073090 2024-03-19T06:18:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.403+0000 7fa5fec00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f819ca20 con 0x7fa5f80739a0 2024-03-19T06:18:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.403+0000 7fa5f7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f8073090 0x7fa5f81980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:18:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.403+0000 7fa5f7e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f8073090 0x7fa5f81980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58996/0 (socket says 172.21.15.72:58996) 2024-03-19T06:18:07.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.403+0000 7fa5f7e00700 1 -- 172.21.15.72:0/4157858427 learned_addr learned my addr 172.21.15.72:0/4157858427 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:18:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.403+0000 7fa5f7e00700 1 -- 172.21.15.72:0/4157858427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f80739a0 msgr2=0x7fa5f8198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.403+0000 7fa5ef400700 1 --2- 172.21.15.72:0/4157858427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f80739a0 0x7fa5f8198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:18:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.404+0000 7fa5f7e00700 1 --2- 172.21.15.72:0/4157858427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f80739a0 0x7fa5f8198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.404+0000 7fa5f7e00700 1 -- 172.21.15.72:0/4157858427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8009d00 con 0x7fa5f8073090 2024-03-19T06:18:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.404+0000 7fa5ef400700 1 --2- 172.21.15.72:0/4157858427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f80739a0 0x7fa5f8198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:18:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.404+0000 7fa5f7e00700 1 --2- 172.21.15.72:0/4157858427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f8073090 0x7fa5f81980c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8007be0 tx=0x7fa5e8007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:18:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.404+0000 7fa5f5600700 1 -- 172.21.15.72:0/4157858427 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5e800e040 con 0x7fa5f8073090 2024-03-19T06:18:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.404+0000 7fa5f5600700 1 -- 172.21.15.72:0/4157858427 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5e8003c10 con 0x7fa5f8073090 2024-03-19T06:18:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.404+0000 7fa5f5600700 1 -- 172.21.15.72:0/4157858427 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5e80127c0 con 0x7fa5f8073090 2024-03-19T06:18:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.404+0000 7fa5fec00700 1 -- 172.21.15.72:0/4157858427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f819cca0 con 0x7fa5f8073090 2024-03-19T06:18:07.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.404+0000 7fa5fec00700 1 -- 172.21.15.72:0/4157858427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f819d190 con 0x7fa5f8073090 2024-03-19T06:18:07.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.406+0000 7fa5fec00700 1 -- 172.21.15.72:0/4157858427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f8109ca0 con 0x7fa5f8073090 2024-03-19T06:18:07.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.407+0000 7fa5f5600700 1 -- 172.21.15.72:0/4157858427 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fa5e8004710 con 0x7fa5f8073090 2024-03-19T06:18:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.407+0000 7fa5f5600700 1 --2- 172.21.15.72:0/4157858427 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa5dc06dfa0 0x7fa5dc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:18:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.408+0000 7fa5f5600700 1 -- 172.21.15.72:0/4157858427 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa5e808f0e0 con 0x7fa5f8073090 2024-03-19T06:18:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.408+0000 7fa5ef400700 1 --2- 172.21.15.72:0/4157858427 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa5dc06dfa0 0x7fa5dc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:18:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.409+0000 7fa5ef400700 1 --2- 172.21.15.72:0/4157858427 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa5dc06dfa0 0x7fa5dc070450 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0005fd0 tx=0x7fa5e0005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:18:07.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.412+0000 7fa5f5600700 1 -- 172.21.15.72:0/4157858427 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fa5e8058580 con 0x7fa5f8073090 2024-03-19T06:18:07.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.757+0000 7fa5fec00700 1 -- 172.21.15.72:0/4157858427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa5f804f2a0 con 0x7fa5f8073090 2024-03-19T06:18:07.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.758+0000 7fa5f5600700 1 -- 172.21.15.72:0/4157858427 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fa5e80170e0 con 0x7fa5f8073090 2024-03-19T06:18:07.747 INFO:teuthology.orchestra.run.smithi072.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:18:07.747 INFO:teuthology.orchestra.run.smithi072.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:18:07.747 INFO:teuthology.orchestra.run.smithi072.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:18:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.761+0000 7fa5fec00700 1 -- 172.21.15.72:0/4157858427 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa5dc06dfa0 msgr2=0x7fa5dc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.761+0000 7fa5fec00700 1 --2- 172.21.15.72:0/4157858427 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa5dc06dfa0 0x7fa5dc070450 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0005fd0 tx=0x7fa5e0005dc0 comp rx=0 tx=0).stop 2024-03-19T06:18:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.761+0000 7fa5fec00700 1 -- 172.21.15.72:0/4157858427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f8073090 msgr2=0x7fa5f81980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.761+0000 7fa5fec00700 1 --2- 172.21.15.72:0/4157858427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f8073090 0x7fa5f81980c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8007be0 tx=0x7fa5e8007cc0 comp rx=0 tx=0).stop 2024-03-19T06:18:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.761+0000 7fa5fec00700 1 -- 172.21.15.72:0/4157858427 shutdown_connections 2024-03-19T06:18:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.761+0000 7fa5fec00700 1 --2- 172.21.15.72:0/4157858427 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa5dc06dfa0 0x7fa5dc070450 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.761+0000 7fa5fec00700 1 --2- 172.21.15.72:0/4157858427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f8073090 0x7fa5f81980c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.761+0000 7fa5fec00700 1 --2- 172.21.15.72:0/4157858427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f80739a0 0x7fa5f8198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:07.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.761+0000 7fa5fec00700 1 -- 172.21.15.72:0/4157858427 >> 172.21.15.72:0/4157858427 conn(0x7fa5f80fbd40 msgr2=0x7fa5f8106de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:18:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.761+0000 7fa5fec00700 1 -- 172.21.15.72:0/4157858427 shutdown_connections 2024-03-19T06:18:07.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:07.761+0000 7fa5fec00700 1 -- 172.21.15.72:0/4157858427 wait complete. 2024-03-19T06:18:08.475 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph versions' 2024-03-19T06:18:08.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:08 smithi172 ceph-mon[66682]: pgmap v359: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:08.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:08 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/4157858427' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:18:08.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:08 smithi072 ceph-mon[78545]: pgmap v359: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:08.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:08 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/4157858427' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-19T06:18:08.898 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:18:10.529 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:10 smithi072 ceph-mon[78545]: pgmap v360: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:10.529 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:18:10.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:10 smithi172 ceph-mon[66682]: pgmap v360: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:10.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:18:11.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.069+0000 7f375dc00700 1 -- 172.21.15.72:0/557532809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37581004e0 msgr2=0x7f37581008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:11.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.069+0000 7f375dc00700 1 --2- 172.21.15.72:0/557532809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37581004e0 0x7f37581008b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3748009910 tx=0x7f3748009c20 comp rx=0 tx=0).stop 2024-03-19T06:18:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.069+0000 7f375dc00700 1 -- 172.21.15.72:0/557532809 shutdown_connections 2024-03-19T06:18:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.069+0000 7f375dc00700 1 --2- 172.21.15.72:0/557532809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3758100e80 0x7f3758104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.069+0000 7f375dc00700 1 --2- 172.21.15.72:0/557532809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37581004e0 0x7f37581008b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.069+0000 7f375dc00700 1 -- 172.21.15.72:0/557532809 >> 172.21.15.72:0/557532809 conn(0x7f37580fbda0 msgr2=0x7f37580fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:18:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.069+0000 7f375dc00700 1 -- 172.21.15.72:0/557532809 shutdown_connections 2024-03-19T06:18:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.069+0000 7f375dc00700 1 -- 172.21.15.72:0/557532809 wait complete. 2024-03-19T06:18:11.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.070+0000 7f375dc00700 1 Processor -- start 2024-03-19T06:18:11.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.070+0000 7f375dc00700 1 -- start start 2024-03-19T06:18:11.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.071+0000 7f375dc00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37581004e0 0x7f37581980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:18:11.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.071+0000 7f375dc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3758100e80 0x7f3758198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:18:11.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.071+0000 7f375dc00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3758198d10 con 0x7f37581004e0 2024-03-19T06:18:11.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.071+0000 7f375dc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375819caa0 con 0x7f3758100e80 2024-03-19T06:18:11.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.071+0000 7f3756a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37581004e0 0x7f37581980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:18:11.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.071+0000 7f3756a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37581004e0 0x7f37581980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59012/0 (socket says 172.21.15.72:59012) 2024-03-19T06:18:11.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.071+0000 7f3756a00700 1 -- 172.21.15.72:0/2673864086 learned_addr learned my addr 172.21.15.72:0/2673864086 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:18:11.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.071+0000 7f374fe00700 1 --2- 172.21.15.72:0/2673864086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3758100e80 0x7f3758198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:18:11.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.071+0000 7f3756a00700 1 -- 172.21.15.72:0/2673864086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3758100e80 msgr2=0x7f3758198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:11.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.071+0000 7f3756a00700 1 --2- 172.21.15.72:0/2673864086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3758100e80 0x7f3758198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:11.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.071+0000 7f3756a00700 1 -- 172.21.15.72:0/2673864086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37480095f0 con 0x7f37581004e0 2024-03-19T06:18:11.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.072+0000 7f3756a00700 1 --2- 172.21.15.72:0/2673864086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37581004e0 0x7f37581980f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f37480092e0 tx=0x7f374800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:18:11.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.072+0000 7f374f400700 1 -- 172.21.15.72:0/2673864086 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f374801d070 con 0x7f37581004e0 2024-03-19T06:18:11.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.072+0000 7f374f400700 1 -- 172.21.15.72:0/2673864086 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3748005e00 con 0x7f37581004e0 2024-03-19T06:18:11.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.072+0000 7f375dc00700 1 -- 172.21.15.72:0/2673864086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375819cd20 con 0x7f37581004e0 2024-03-19T06:18:11.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.072+0000 7f374f400700 1 -- 172.21.15.72:0/2673864086 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3748017400 con 0x7f37581004e0 2024-03-19T06:18:11.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.072+0000 7f375dc00700 1 -- 172.21.15.72:0/2673864086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375819d210 con 0x7f37581004e0 2024-03-19T06:18:11.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.074+0000 7f375dc00700 1 -- 172.21.15.72:0/2673864086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37581045d0 con 0x7f37581004e0 2024-03-19T06:18:11.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.075+0000 7f374f400700 1 -- 172.21.15.72:0/2673864086 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f374800f460 con 0x7f37581004e0 2024-03-19T06:18:11.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.076+0000 7f374f400700 1 --2- 172.21.15.72:0/2673864086 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f373c06dfa0 0x7f373c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:18:11.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.076+0000 7f374f400700 1 -- 172.21.15.72:0/2673864086 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f374808f1e0 con 0x7f37581004e0 2024-03-19T06:18:11.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.076+0000 7f374fe00700 1 --2- 172.21.15.72:0/2673864086 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f373c06dfa0 0x7f373c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:18:11.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.077+0000 7f374fe00700 1 --2- 172.21.15.72:0/2673864086 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f373c06dfa0 0x7f373c070450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3740005950 tx=0x7f37400058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:18:11.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.081+0000 7f374f400700 1 -- 172.21.15.72:0/2673864086 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f3748058680 con 0x7f37581004e0 2024-03-19T06:18:11.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.395+0000 7f375dc00700 1 -- 172.21.15.72:0/2673864086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3758199550 con 0x7f37581004e0 2024-03-19T06:18:11.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.396+0000 7f374f400700 1 -- 172.21.15.72:0/2673864086 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f374805bd40 con 0x7f37581004e0 2024-03-19T06:18:11.385 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:18:11.385 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:18:11.385 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 6 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 4 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 14 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:18:11.386 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:18:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.399+0000 7f375dc00700 1 -- 172.21.15.72:0/2673864086 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f373c06dfa0 msgr2=0x7f373c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.399+0000 7f375dc00700 1 --2- 172.21.15.72:0/2673864086 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f373c06dfa0 0x7f373c070450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3740005950 tx=0x7f37400058e0 comp rx=0 tx=0).stop 2024-03-19T06:18:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.399+0000 7f375dc00700 1 -- 172.21.15.72:0/2673864086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37581004e0 msgr2=0x7f37581980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:18:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.400+0000 7f375dc00700 1 --2- 172.21.15.72:0/2673864086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37581004e0 0x7f37581980f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f37480092e0 tx=0x7f374800be20 comp rx=0 tx=0).stop 2024-03-19T06:18:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.400+0000 7f375dc00700 1 -- 172.21.15.72:0/2673864086 shutdown_connections 2024-03-19T06:18:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.400+0000 7f375dc00700 1 --2- 172.21.15.72:0/2673864086 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f373c06dfa0 0x7f373c070450 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.400+0000 7f375dc00700 1 --2- 172.21.15.72:0/2673864086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37581004e0 0x7f37581980f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.400+0000 7f375dc00700 1 --2- 172.21.15.72:0/2673864086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3758100e80 0x7f3758198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:18:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.400+0000 7f375dc00700 1 -- 172.21.15.72:0/2673864086 >> 172.21.15.72:0/2673864086 conn(0x7f37580fbda0 msgr2=0x7f37580fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:18:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.400+0000 7f375dc00700 1 -- 172.21.15.72:0/2673864086 shutdown_connections 2024-03-19T06:18:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:18:11.400+0000 7f375dc00700 1 -- 172.21.15.72:0/2673864086 wait complete. 2024-03-19T06:18:11.737 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:11 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2673864086' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:18:11.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:11 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2673864086' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:18:12.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-03-19T06:18:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:18:12.658 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:12 smithi072 ceph-mon[78545]: pgmap v361: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:12.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:12 smithi172 ceph-mon[66682]: pgmap v361: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:14.516 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:14 smithi072 ceph-mon[78545]: pgmap v362: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:14.707 INFO:teuthology.orchestra.run.smithi072.stdout:wait for servicemap items w/ changing names to refresh 2024-03-19T06:18:14.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:14 smithi172 ceph-mon[66682]: pgmap v362: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:15.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'sleep 60' 2024-03-19T06:18:15.897 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:18:16.821 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:16 smithi072 ceph-mon[78545]: pgmap v363: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:16.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:16 smithi172 ceph-mon[66682]: pgmap v363: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:18.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:18 smithi072 ceph-mon[78545]: pgmap v364: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:18.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:18 smithi172 ceph-mon[66682]: pgmap v364: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:20.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:20 smithi072 ceph-mon[78545]: pgmap v365: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:20.845 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:20 smithi172 ceph-mon[66682]: pgmap v365: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:22.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:22 smithi072 ceph-mon[78545]: pgmap v366: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:22.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:22 smithi172 ceph-mon[66682]: pgmap v366: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:24.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:24 smithi072 ceph-mon[78545]: pgmap v367: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:24.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:24 smithi172 ceph-mon[66682]: pgmap v367: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:25.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:18:25.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:18:26.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:26 smithi072 ceph-mon[78545]: pgmap v368: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:26.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:26 smithi172 ceph-mon[66682]: pgmap v368: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:28.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:28 smithi072 ceph-mon[78545]: pgmap v369: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:28.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:28 smithi172 ceph-mon[66682]: pgmap v369: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:30.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:30 smithi072 ceph-mon[78545]: pgmap v370: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:30.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:30 smithi172 ceph-mon[66682]: pgmap v370: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:32.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:32 smithi072 ceph-mon[78545]: pgmap v371: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:32.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:32 smithi172 ceph-mon[66682]: pgmap v371: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:34.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:34 smithi072 ceph-mon[78545]: pgmap v372: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:34.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:34 smithi172 ceph-mon[66682]: pgmap v372: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:36.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:36 smithi172 ceph-mon[66682]: pgmap v373: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:36.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:36 smithi072 ceph-mon[78545]: pgmap v373: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:37.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:37 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:18:37.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:37 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:18:38.803 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:38 smithi172 ceph-mon[66682]: pgmap v374: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:38.803 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:38 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:18:38.803 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:38 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:18:38.803 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:38 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:18:38.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:38 smithi072 ceph-mon[78545]: pgmap v374: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:38.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:38 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:18:38.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:38 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:18:38.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:38 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:18:40.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:40 smithi072 ceph-mon[78545]: pgmap v375: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:40.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:18:40.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:40 smithi172 ceph-mon[66682]: pgmap v375: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:40.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:18:42.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:42 smithi072 ceph-mon[78545]: pgmap v376: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:42.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:42 smithi172 ceph-mon[66682]: pgmap v376: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:44.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:44 smithi072 ceph-mon[78545]: pgmap v377: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:44.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:44 smithi172 ceph-mon[66682]: pgmap v377: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:46.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:46 smithi072 ceph-mon[78545]: pgmap v378: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:46.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:46 smithi172 ceph-mon[66682]: pgmap v378: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:48.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:48 smithi072 ceph-mon[78545]: pgmap v379: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:48.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:48 smithi172 ceph-mon[66682]: pgmap v379: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:50.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:50 smithi072 ceph-mon[78545]: pgmap v380: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:50.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:50 smithi172 ceph-mon[66682]: pgmap v380: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:52.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:52 smithi072 ceph-mon[78545]: pgmap v381: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:52.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:52 smithi172 ceph-mon[66682]: pgmap v381: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:54.741 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:54 smithi072 ceph-mon[78545]: pgmap v382: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:54.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:54 smithi172 ceph-mon[66682]: pgmap v382: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:55.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:18:55.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:18:56.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:56 smithi072 ceph-mon[78545]: pgmap v383: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:56.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:56 smithi172 ceph-mon[66682]: pgmap v383: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:58.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:18:58 smithi072 ceph-mon[78545]: pgmap v384: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:18:58.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:18:58 smithi172 ceph-mon[66682]: pgmap v384: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:00.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:00 smithi072 ceph-mon[78545]: pgmap v385: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:00.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:00 smithi172 ceph-mon[66682]: pgmap v385: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:02.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:02 smithi172 ceph-mon[66682]: pgmap v386: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:03.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:02 smithi072 ceph-mon[78545]: pgmap v386: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:04.824 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:04 smithi072 ceph-mon[78545]: pgmap v387: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:04.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:04 smithi172 ceph-mon[66682]: pgmap v387: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:06.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:06 smithi172 ceph-mon[66682]: pgmap v388: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:07.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:06 smithi072 ceph-mon[78545]: pgmap v388: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:08.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:08 smithi172 ceph-mon[66682]: pgmap v389: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:09.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:08 smithi072 ceph-mon[78545]: pgmap v389: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:10.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:10 smithi172 ceph-mon[66682]: pgmap v390: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:10.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:19:11.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:10 smithi072 ceph-mon[78545]: pgmap v390: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:11.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:19:12.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:12 smithi172 ceph-mon[66682]: pgmap v391: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:13.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:12 smithi072 ceph-mon[78545]: pgmap v391: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:14.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:14 smithi172 ceph-mon[66682]: pgmap v392: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:15.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:14 smithi072 ceph-mon[78545]: pgmap v392: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:16.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:16 smithi172 ceph-mon[66682]: pgmap v393: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:17.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:16 smithi072 ceph-mon[78545]: pgmap v393: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:18.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph orch ps' 2024-03-19T06:19:18.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:18 smithi172 ceph-mon[66682]: pgmap v394: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:19.068 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:19:19.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:18 smithi072 ceph-mon[78545]: pgmap v394: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:20.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:20 smithi072 ceph-mon[78545]: pgmap v395: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:20.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:20 smithi172 ceph-mon[66682]: pgmap v395: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.332+0000 7f19e3c00700 1 -- 172.21.15.72:0/1208670449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc1004e0 msgr2=0x7f19dc1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.332+0000 7f19e3c00700 1 --2- 172.21.15.72:0/1208670449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc1004e0 0x7f19dc1008b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009910 tx=0x7f19d0009c20 comp rx=0 tx=0).stop 2024-03-19T06:19:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.332+0000 7f19e3c00700 1 -- 172.21.15.72:0/1208670449 shutdown_connections 2024-03-19T06:19:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.332+0000 7f19e3c00700 1 --2- 172.21.15.72:0/1208670449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc100e80 0x7f19dc104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.332+0000 7f19e3c00700 1 --2- 172.21.15.72:0/1208670449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc1004e0 0x7f19dc1008b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.332+0000 7f19e3c00700 1 -- 172.21.15.72:0/1208670449 >> 172.21.15.72:0/1208670449 conn(0x7f19dc0fbda0 msgr2=0x7f19dc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.332+0000 7f19e3c00700 1 -- 172.21.15.72:0/1208670449 shutdown_connections 2024-03-19T06:19:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.333+0000 7f19e3c00700 1 -- 172.21.15.72:0/1208670449 wait complete. 2024-03-19T06:19:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.334+0000 7f19e3c00700 1 Processor -- start 2024-03-19T06:19:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.334+0000 7f19e3c00700 1 -- start start 2024-03-19T06:19:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.335+0000 7f19e3c00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc1004e0 0x7f19dc195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.335+0000 7f19e3c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc100e80 0x7f19dc196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.335+0000 7f19e3c00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc196b10 con 0x7f19dc1004e0 2024-03-19T06:19:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.335+0000 7f19e3c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc19a8a0 con 0x7f19dc100e80 2024-03-19T06:19:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.335+0000 7f19e1200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc1004e0 0x7f19dc195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.335+0000 7f19e1200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc1004e0 0x7f19dc195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39922/0 (socket says 172.21.15.72:39922) 2024-03-19T06:19:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.335+0000 7f19e1200700 1 -- 172.21.15.72:0/3195900752 learned_addr learned my addr 172.21.15.72:0/3195900752 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.336+0000 7f19e1200700 1 -- 172.21.15.72:0/3195900752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc100e80 msgr2=0x7f19dc196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:21.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.336+0000 7f19e1200700 1 --2- 172.21.15.72:0/3195900752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc100e80 0x7f19dc196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:21.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.336+0000 7f19e1200700 1 -- 172.21.15.72:0/3195900752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d00095f0 con 0x7f19dc1004e0 2024-03-19T06:19:21.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.336+0000 7f19e1200700 1 --2- 172.21.15.72:0/3195900752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc1004e0 0x7f19dc195ef0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f19d00092e0 tx=0x7f19d000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:21.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.336+0000 7f19d9600700 1 -- 172.21.15.72:0/3195900752 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19d001d070 con 0x7f19dc1004e0 2024-03-19T06:19:21.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.336+0000 7f19d9600700 1 -- 172.21.15.72:0/3195900752 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19d0005e00 con 0x7f19dc1004e0 2024-03-19T06:19:21.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.336+0000 7f19e3c00700 1 -- 172.21.15.72:0/3195900752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc19ab20 con 0x7f19dc1004e0 2024-03-19T06:19:21.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.336+0000 7f19d9600700 1 -- 172.21.15.72:0/3195900752 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19d0017400 con 0x7f19dc1004e0 2024-03-19T06:19:21.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.337+0000 7f19e3c00700 1 -- 172.21.15.72:0/3195900752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc19b010 con 0x7f19dc1004e0 2024-03-19T06:19:21.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.338+0000 7f19e3c00700 1 -- 172.21.15.72:0/3195900752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc1087f0 con 0x7f19dc1004e0 2024-03-19T06:19:21.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.339+0000 7f19d9600700 1 -- 172.21.15.72:0/3195900752 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f19d000f460 con 0x7f19dc1004e0 2024-03-19T06:19:21.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.340+0000 7f19d9600700 1 --2- 172.21.15.72:0/3195900752 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f19c406dfa0 0x7f19c4070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:21.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.340+0000 7f19d9600700 1 -- 172.21.15.72:0/3195900752 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f19d008f1e0 con 0x7f19dc1004e0 2024-03-19T06:19:21.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.340+0000 7f19dbe00700 1 --2- 172.21.15.72:0/3195900752 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f19c406dfa0 0x7f19c4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:21.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.341+0000 7f19dbe00700 1 --2- 172.21.15.72:0/3195900752 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f19c406dfa0 0x7f19c4070450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f19c8005950 tx=0x7f19c80058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:21.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.345+0000 7f19d9600700 1 -- 172.21.15.72:0/3195900752 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f19d0058680 con 0x7f19dc1004e0 2024-03-19T06:19:21.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.579+0000 7f19e3c00700 1 -- 172.21.15.72:0/3195900752 --> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f19dc19b280 con 0x7f19c406dfa0 2024-03-19T06:19:21.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.598+0000 7f19d9600700 1 -- 172.21.15.72:0/3195900752 <== mgr.34104 v2:172.21.15.72:6800/3993303660 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f19dc19b280 con 0x7f19c406dfa0 2024-03-19T06:19:21.587 INFO:teuthology.orchestra.run.smithi072.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-19T06:19:21.587 INFO:teuthology.orchestra.run.smithi072.stdout:alertmanager.smithi072 smithi072 *:9093,9094 running (2m) 114s ago 25m 13.5M - 0.25.0 c8568f914cd2 0afa852435dc 2024-03-19T06:19:21.587 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi072 smithi072 running (4m) 114s ago 26m 8274k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 7e45101af382 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-exporter.smithi172 smithi172 running (3m) 3m ago 24m 7620k - 19.0.0-1934-gb0ea271b 5c4d8774b57a d8a7d621cc29 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi072 smithi072 running (10m) 114s ago 26m 6665k - 19.0.0-1934-gb0ea271b 5c4d8774b57a f3d782ab2d0b 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:crash.smithi172 smithi172 running (10m) 3m ago 24m 6660k - 19.0.0-1934-gb0ea271b 5c4d8774b57a 6b7a52a5ef3a 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:grafana.smithi072 smithi072 *:3000 running (2m) 114s ago 25m 52.0M - 9.4.12 a0ea5e3c46d9 2464fb7eda5d 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.dvdjwb smithi072 running (5m) 114s ago 18m 18.9M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 3ea4b00e2248 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi072.jhxzfi smithi072 running (5m) 114s ago 18m 68.4M - 19.0.0-1934-gb0ea271b 5c4d8774b57a d0daead2fe2a 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.nparnw smithi172 running (4m) 3m ago 18m 12.2M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 788348d02918 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:mds.cephfs.smithi172.xlokxp smithi172 running (4m) 3m ago 18m 12.4M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 2cbfb6aeff05 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi072.jydpjk smithi072 *:8443,9283,8765 running (14m) 114s ago 27m 513M - 19.0.0-1934-gb0ea271b 5c4d8774b57a 716f8928f2ce 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:mgr.smithi172.qkcahs smithi172 *:8443,9283,8765 running (12m) 3m ago 24m 453M - 19.0.0-1934-gb0ea271b 5c4d8774b57a b80e0097eea4 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi072 smithi072 running (12m) 114s ago 28m 61.9M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a f8806c6c6e84 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:mon.smithi172 smithi172 running (11m) 3m ago 24m 45.8M 2048M 19.0.0-1934-gb0ea271b 5c4d8774b57a 9c31f8ad367b 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi072 smithi072 *:9100 running (3m) 114s ago 25m 7910k - 1.5.0 0da6a335fe13 81983d103a8e 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:node-exporter.smithi172 smithi172 *:9100 running (3m) 3m ago 24m 3019k - 1.5.0 0da6a335fe13 d533ddf64373 2024-03-19T06:19:21.588 INFO:teuthology.orchestra.run.smithi072.stdout:osd.0 smithi072 running (9m) 114s ago 23m 100M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 94123452ea80 2024-03-19T06:19:21.589 INFO:teuthology.orchestra.run.smithi072.stdout:osd.1 smithi072 running (9m) 114s ago 22m 105M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 5b934e3ebc97 2024-03-19T06:19:21.589 INFO:teuthology.orchestra.run.smithi072.stdout:osd.2 smithi072 running (8m) 114s ago 22m 93.4M 1216M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7d013647ed4a 2024-03-19T06:19:21.589 INFO:teuthology.orchestra.run.smithi072.stdout:osd.3 smithi172 running (8m) 3m ago 21m 106M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 7ea8347dc3cb 2024-03-19T06:19:21.589 INFO:teuthology.orchestra.run.smithi072.stdout:osd.4 smithi172 running (7m) 3m ago 20m 98.1M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a 985a6457cf21 2024-03-19T06:19:21.589 INFO:teuthology.orchestra.run.smithi072.stdout:osd.5 smithi172 running (6m) 3m ago 20m 91.5M 2241M 19.0.0-1934-gb0ea271b 5c4d8774b57a c47c9c7fd3c7 2024-03-19T06:19:21.589 INFO:teuthology.orchestra.run.smithi072.stdout:prometheus.smithi072 smithi072 *:9095 running (3m) 114s ago 25m 69.7M - 2.43.0 a07b618ecd1d 380a9dd83787 2024-03-19T06:19:21.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.601+0000 7f19e3c00700 1 -- 172.21.15.72:0/3195900752 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f19c406dfa0 msgr2=0x7f19c4070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.601+0000 7f19e3c00700 1 --2- 172.21.15.72:0/3195900752 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f19c406dfa0 0x7f19c4070450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f19c8005950 tx=0x7f19c80058e0 comp rx=0 tx=0).stop 2024-03-19T06:19:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.601+0000 7f19e3c00700 1 -- 172.21.15.72:0/3195900752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc1004e0 msgr2=0x7f19dc195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.601+0000 7f19e3c00700 1 --2- 172.21.15.72:0/3195900752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc1004e0 0x7f19dc195ef0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f19d00092e0 tx=0x7f19d000be20 comp rx=0 tx=0).stop 2024-03-19T06:19:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.601+0000 7f19e3c00700 1 -- 172.21.15.72:0/3195900752 shutdown_connections 2024-03-19T06:19:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.601+0000 7f19e3c00700 1 --2- 172.21.15.72:0/3195900752 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f19c406dfa0 0x7f19c4070450 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.601+0000 7f19e3c00700 1 --2- 172.21.15.72:0/3195900752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19dc1004e0 0x7f19dc195ef0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.601+0000 7f19e3c00700 1 --2- 172.21.15.72:0/3195900752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc100e80 0x7f19dc196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.601+0000 7f19e3c00700 1 -- 172.21.15.72:0/3195900752 >> 172.21.15.72:0/3195900752 conn(0x7f19dc0fbda0 msgr2=0x7f19dc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.601+0000 7f19e3c00700 1 -- 172.21.15.72:0/3195900752 shutdown_connections 2024-03-19T06:19:21.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:21.601+0000 7f19e3c00700 1 -- 172.21.15.72:0/3195900752 wait complete. 2024-03-19T06:19:22.390 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph versions' 2024-03-19T06:19:22.799 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:19:22.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:22 smithi172 ceph-mon[66682]: pgmap v396: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:22.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:22 smithi172 ceph-mon[66682]: from='client.34714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:19:22.949 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:22 smithi072 ceph-mon[78545]: pgmap v396: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:22.949 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:22 smithi072 ceph-mon[78545]: from='client.34714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-19T06:19:24.798 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:24 smithi072 ceph-mon[78545]: pgmap v397: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:24.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:24 smithi172 ceph-mon[66682]: pgmap v397: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:25.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.099+0000 7f8ddec00700 1 -- 172.21.15.72:0/1021583650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd8102470 msgr2=0x7f8dd81028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:25.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.099+0000 7f8ddec00700 1 --2- 172.21.15.72:0/1021583650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd8102470 0x7f8dd81028e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009910 tx=0x7f8dc4009c20 comp rx=0 tx=0).stop 2024-03-19T06:19:25.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.099+0000 7f8ddec00700 1 -- 172.21.15.72:0/1021583650 shutdown_connections 2024-03-19T06:19:25.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.099+0000 7f8ddec00700 1 --2- 172.21.15.72:0/1021583650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd8102470 0x7f8dd81028e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:25.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.099+0000 7f8ddec00700 1 --2- 172.21.15.72:0/1021583650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd8108470 0x7f8dd8108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:25.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.099+0000 7f8ddec00700 1 -- 172.21.15.72:0/1021583650 >> 172.21.15.72:0/1021583650 conn(0x7f8dd80fdf90 msgr2=0x7f8dd81003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:25.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.099+0000 7f8ddec00700 1 -- 172.21.15.72:0/1021583650 shutdown_connections 2024-03-19T06:19:25.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.099+0000 7f8ddec00700 1 -- 172.21.15.72:0/1021583650 wait complete. 2024-03-19T06:19:25.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.100+0000 7f8ddec00700 1 Processor -- start 2024-03-19T06:19:25.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.100+0000 7f8ddec00700 1 -- start start 2024-03-19T06:19:25.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.101+0000 7f8ddec00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd8102470 0x7f8dd81981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:25.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.101+0000 7f8ddec00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd8108470 0x7f8dd8198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:25.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.101+0000 7f8ddec00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd8198d80 con 0x7f8dd8108470 2024-03-19T06:19:25.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.101+0000 7f8ddec00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd8198ec0 con 0x7f8dd8102470 2024-03-19T06:19:25.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.101+0000 7f8dd7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd8108470 0x7f8dd8198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:25.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.101+0000 7f8dd7400700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd8108470 0x7f8dd8198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35858/0 (socket says 172.21.15.72:35858) 2024-03-19T06:19:25.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.101+0000 7f8dd7400700 1 -- 172.21.15.72:0/1065618787 learned_addr learned my addr 172.21.15.72:0/1065618787 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:25.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.101+0000 7f8dd7e00700 1 --2- 172.21.15.72:0/1065618787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd8102470 0x7f8dd81981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:25.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.101+0000 7f8dd7400700 1 -- 172.21.15.72:0/1065618787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd8102470 msgr2=0x7f8dd81981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:25.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.101+0000 7f8dd7400700 1 --2- 172.21.15.72:0/1065618787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd8102470 0x7f8dd81981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:25.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.101+0000 7f8dd7400700 1 -- 172.21.15.72:0/1065618787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc40095f0 con 0x7f8dd8108470 2024-03-19T06:19:25.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.102+0000 7f8dd7400700 1 --2- 172.21.15.72:0/1065618787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd8108470 0x7f8dd8198730 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400b5c0 tx=0x7f8dc400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:25.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.102+0000 7f8dd4c00700 1 -- 172.21.15.72:0/1065618787 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dc401d070 con 0x7f8dd8108470 2024-03-19T06:19:25.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.102+0000 7f8dd4c00700 1 -- 172.21.15.72:0/1065618787 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8dc400f460 con 0x7f8dd8108470 2024-03-19T06:19:25.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.102+0000 7f8ddec00700 1 -- 172.21.15.72:0/1065618787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd819ccb0 con 0x7f8dd8108470 2024-03-19T06:19:25.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.102+0000 7f8dd4c00700 1 -- 172.21.15.72:0/1065618787 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dc4017610 con 0x7f8dd8108470 2024-03-19T06:19:25.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.102+0000 7f8ddec00700 1 -- 172.21.15.72:0/1065618787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd819d1a0 con 0x7f8dd8108470 2024-03-19T06:19:25.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.103+0000 7f8ddec00700 1 -- 172.21.15.72:0/1065618787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd810a970 con 0x7f8dd8108470 2024-03-19T06:19:25.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.104+0000 7f8dd4c00700 1 -- 172.21.15.72:0/1065618787 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f8dc400f5d0 con 0x7f8dd8108470 2024-03-19T06:19:25.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.105+0000 7f8dd4c00700 1 --2- 172.21.15.72:0/1065618787 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f8dbc06dfa0 0x7f8dbc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:25.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.105+0000 7f8dd4c00700 1 -- 172.21.15.72:0/1065618787 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8dc408f3b0 con 0x7f8dd8108470 2024-03-19T06:19:25.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.106+0000 7f8dd7e00700 1 --2- 172.21.15.72:0/1065618787 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f8dbc06dfa0 0x7f8dbc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:25.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.106+0000 7f8dd7e00700 1 --2- 172.21.15.72:0/1065618787 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f8dbc06dfa0 0x7f8dbc070450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800ba60 tx=0x7f8dc8005d50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:25.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.111+0000 7f8dd4c00700 1 -- 172.21.15.72:0/1065618787 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f8dc40587b0 con 0x7f8dd8108470 2024-03-19T06:19:25.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.431+0000 7f8ddec00700 1 -- 172.21.15.72:0/1065618787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8dd804f2a0 con 0x7f8dd8108470 2024-03-19T06:19:25.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.432+0000 7f8dd4c00700 1 -- 172.21.15.72:0/1065618787 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f8dc405be70 con 0x7f8dd8108470 2024-03-19T06:19:25.420 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 2 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 6 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 4 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)": 14 2024-03-19T06:19:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-19T06:19:25.422 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-19T06:19:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.435+0000 7f8ddec00700 1 -- 172.21.15.72:0/1065618787 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f8dbc06dfa0 msgr2=0x7f8dbc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.435+0000 7f8ddec00700 1 --2- 172.21.15.72:0/1065618787 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f8dbc06dfa0 0x7f8dbc070450 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800ba60 tx=0x7f8dc8005d50 comp rx=0 tx=0).stop 2024-03-19T06:19:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.435+0000 7f8ddec00700 1 -- 172.21.15.72:0/1065618787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd8108470 msgr2=0x7f8dd8198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.435+0000 7f8ddec00700 1 --2- 172.21.15.72:0/1065618787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd8108470 0x7f8dd8198730 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400b5c0 tx=0x7f8dc400be00 comp rx=0 tx=0).stop 2024-03-19T06:19:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.435+0000 7f8ddec00700 1 -- 172.21.15.72:0/1065618787 shutdown_connections 2024-03-19T06:19:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.435+0000 7f8ddec00700 1 --2- 172.21.15.72:0/1065618787 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f8dbc06dfa0 0x7f8dbc070450 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.435+0000 7f8ddec00700 1 --2- 172.21.15.72:0/1065618787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd8102470 0x7f8dd81981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.435+0000 7f8ddec00700 1 --2- 172.21.15.72:0/1065618787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd8108470 0x7f8dd8198730 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.435+0000 7f8ddec00700 1 -- 172.21.15.72:0/1065618787 >> 172.21.15.72:0/1065618787 conn(0x7f8dd80fdf90 msgr2=0x7f8dd80ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.435+0000 7f8ddec00700 1 -- 172.21.15.72:0/1065618787 shutdown_connections 2024-03-19T06:19:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:25.435+0000 7f8ddec00700 1 -- 172.21.15.72:0/1065618787 wait complete. 2024-03-19T06:19:25.755 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:19:25.755 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:25 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1065618787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:19:25.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:19:25.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:25 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1065618787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:19:26.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-03-19T06:19:26.496 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:19:26.948 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:26 smithi072 ceph-mon[78545]: pgmap v398: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:27.150 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:26 smithi172 ceph-mon[66682]: pgmap v398: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:27.773 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:27 smithi072 ceph-mon[78545]: pgmap v399: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:28.151 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:27 smithi172 ceph-mon[66682]: pgmap v399: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.626+0000 7f0c66a00700 1 -- 172.21.15.72:0/2902820854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c60104740 msgr2=0x7f0c60104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.626+0000 7f0c66a00700 1 --2- 172.21.15.72:0/2902820854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c60104740 0x7f0c60104b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009910 tx=0x7f0c54009c20 comp rx=0 tx=0).stop 2024-03-19T06:19:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.626+0000 7f0c66a00700 1 -- 172.21.15.72:0/2902820854 shutdown_connections 2024-03-19T06:19:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.626+0000 7f0c66a00700 1 --2- 172.21.15.72:0/2902820854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c600fe740 0x7f0c600febb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.626+0000 7f0c66a00700 1 --2- 172.21.15.72:0/2902820854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c60104740 0x7f0c60104b10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.626+0000 7f0c66a00700 1 -- 172.21.15.72:0/2902820854 >> 172.21.15.72:0/2902820854 conn(0x7f0c60075400 msgr2=0x7f0c60075800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.626+0000 7f0c66a00700 1 -- 172.21.15.72:0/2902820854 shutdown_connections 2024-03-19T06:19:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.626+0000 7f0c66a00700 1 -- 172.21.15.72:0/2902820854 wait complete. 2024-03-19T06:19:28.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.627+0000 7f0c66a00700 1 Processor -- start 2024-03-19T06:19:28.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.627+0000 7f0c66a00700 1 -- start start 2024-03-19T06:19:28.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.627+0000 7f0c66a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c600fe740 0x7f0c6019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:28.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.628+0000 7f0c66a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c60104740 0x7f0c6019be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:28.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.628+0000 7f0c66a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6019c480 con 0x7f0c600fe740 2024-03-19T06:19:28.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.628+0000 7f0c66a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c601959c0 con 0x7f0c60104740 2024-03-19T06:19:28.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.628+0000 7f0c65600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c600fe740 0x7f0c6019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:28.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.628+0000 7f0c65600700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c600fe740 0x7f0c6019b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35862/0 (socket says 172.21.15.72:35862) 2024-03-19T06:19:28.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.628+0000 7f0c65600700 1 -- 172.21.15.72:0/177504549 learned_addr learned my addr 172.21.15.72:0/177504549 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:28.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.628+0000 7f0c64c00700 1 --2- 172.21.15.72:0/177504549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c60104740 0x7f0c6019be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:28.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.628+0000 7f0c65600700 1 -- 172.21.15.72:0/177504549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c60104740 msgr2=0x7f0c6019be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:28.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.628+0000 7f0c65600700 1 --2- 172.21.15.72:0/177504549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c60104740 0x7f0c6019be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:28.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.628+0000 7f0c65600700 1 -- 172.21.15.72:0/177504549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540095f0 con 0x7f0c600fe740 2024-03-19T06:19:28.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.629+0000 7f0c65600700 1 --2- 172.21.15.72:0/177504549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c600fe740 0x7f0c6019b940 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400bda0 tx=0x7f0c5400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:28.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.629+0000 7f0c5e000700 1 -- 172.21.15.72:0/177504549 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c5401d070 con 0x7f0c600fe740 2024-03-19T06:19:28.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.629+0000 7f0c5e000700 1 -- 172.21.15.72:0/177504549 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c54004fb0 con 0x7f0c600fe740 2024-03-19T06:19:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.629+0000 7f0c66a00700 1 -- 172.21.15.72:0/177504549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c60195c40 con 0x7f0c600fe740 2024-03-19T06:19:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.629+0000 7f0c5e000700 1 -- 172.21.15.72:0/177504549 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c5400f460 con 0x7f0c600fe740 2024-03-19T06:19:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.629+0000 7f0c66a00700 1 -- 172.21.15.72:0/177504549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c601961b0 con 0x7f0c600fe740 2024-03-19T06:19:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.630+0000 7f0c66a00700 1 -- 172.21.15.72:0/177504549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c60108cc0 con 0x7f0c600fe740 2024-03-19T06:19:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.631+0000 7f0c5e000700 1 -- 172.21.15.72:0/177504549 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f0c54022800 con 0x7f0c600fe740 2024-03-19T06:19:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.632+0000 7f0c5e000700 1 --2- 172.21.15.72:0/177504549 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f0c4806dfa0 0x7f0c48070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.632+0000 7f0c5e000700 1 -- 172.21.15.72:0/177504549 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0c5408f3d0 con 0x7f0c600fe740 2024-03-19T06:19:28.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.632+0000 7f0c64c00700 1 --2- 172.21.15.72:0/177504549 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f0c4806dfa0 0x7f0c48070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:28.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.633+0000 7f0c64c00700 1 --2- 172.21.15.72:0/177504549 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f0c4806dfa0 0x7f0c48070450 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0c601041a0 tx=0x7f0c4c005d50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:28.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.637+0000 7f0c5e000700 1 -- 172.21.15.72:0/177504549 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f0c5405c450 con 0x7f0c600fe740 2024-03-19T06:19:28.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.960+0000 7f0c66a00700 1 -- 172.21.15.72:0/177504549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0c60196490 con 0x7f0c600fe740 2024-03-19T06:19:28.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.962+0000 7f0c5e000700 1 -- 172.21.15.72:0/177504549 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f0c5405bfe0 con 0x7f0c600fe740 2024-03-19T06:19:28.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.965+0000 7f0c66a00700 1 -- 172.21.15.72:0/177504549 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f0c4806dfa0 msgr2=0x7f0c48070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:28.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.965+0000 7f0c66a00700 1 --2- 172.21.15.72:0/177504549 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f0c4806dfa0 0x7f0c48070450 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0c601041a0 tx=0x7f0c4c005d50 comp rx=0 tx=0).stop 2024-03-19T06:19:28.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.965+0000 7f0c66a00700 1 -- 172.21.15.72:0/177504549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c600fe740 msgr2=0x7f0c6019b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:28.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.965+0000 7f0c66a00700 1 --2- 172.21.15.72:0/177504549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c600fe740 0x7f0c6019b940 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400bda0 tx=0x7f0c5400be80 comp rx=0 tx=0).stop 2024-03-19T06:19:28.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.965+0000 7f0c66a00700 1 -- 172.21.15.72:0/177504549 shutdown_connections 2024-03-19T06:19:28.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.965+0000 7f0c66a00700 1 --2- 172.21.15.72:0/177504549 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f0c4806dfa0 0x7f0c48070450 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:28.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.965+0000 7f0c66a00700 1 --2- 172.21.15.72:0/177504549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c600fe740 0x7f0c6019b940 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:28.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.965+0000 7f0c66a00700 1 --2- 172.21.15.72:0/177504549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c60104740 0x7f0c6019be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:28.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.965+0000 7f0c66a00700 1 -- 172.21.15.72:0/177504549 >> 172.21.15.72:0/177504549 conn(0x7f0c60075400 msgr2=0x7f0c60102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:28.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.965+0000 7f0c66a00700 1 -- 172.21.15.72:0/177504549 shutdown_connections 2024-03-19T06:19:28.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:28.965+0000 7f0c66a00700 1 -- 172.21.15.72:0/177504549 wait complete. 2024-03-19T06:19:28.970 INFO:teuthology.orchestra.run.smithi072.stdout:true 2024-03-19T06:19:29.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:29 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/177504549' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:19:29.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:29 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/177504549' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:19:29.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -e sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-03-19T06:19:30.158 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:19:30.312 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:30 smithi072 ceph-mon[78545]: pgmap v400: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:30.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:30 smithi172 ceph-mon[66682]: pgmap v400: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:32.178 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:32 smithi072 ceph-mon[78545]: pgmap v401: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:32.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:32 smithi172 ceph-mon[66682]: pgmap v401: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:32.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.470+0000 7f3789a00700 1 -- 172.21.15.72:0/1406356670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3784102470 msgr2=0x7f37841028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.470+0000 7f3789a00700 1 --2- 172.21.15.72:0/1406356670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3784102470 0x7f37841028e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f376c009910 tx=0x7f376c009c20 comp rx=0 tx=0).stop 2024-03-19T06:19:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.470+0000 7f3789a00700 1 -- 172.21.15.72:0/1406356670 shutdown_connections 2024-03-19T06:19:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.470+0000 7f3789a00700 1 --2- 172.21.15.72:0/1406356670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3784102470 0x7f37841028e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.470+0000 7f3789a00700 1 --2- 172.21.15.72:0/1406356670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3784108470 0x7f3784108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.470+0000 7f3789a00700 1 -- 172.21.15.72:0/1406356670 >> 172.21.15.72:0/1406356670 conn(0x7f37840fdf90 msgr2=0x7f37841003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.471+0000 7f3789a00700 1 -- 172.21.15.72:0/1406356670 shutdown_connections 2024-03-19T06:19:32.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.471+0000 7f3789a00700 1 -- 172.21.15.72:0/1406356670 wait complete. 2024-03-19T06:19:32.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.472+0000 7f3789a00700 1 Processor -- start 2024-03-19T06:19:32.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.472+0000 7f3789a00700 1 -- start start 2024-03-19T06:19:32.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.472+0000 7f3789a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3784102470 0x7f3784198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.472+0000 7f3789a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3784108470 0x7f37841986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.472+0000 7f3789a00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3784198db0 con 0x7f3784108470 2024-03-19T06:19:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.472+0000 7f3789a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378419cb40 con 0x7f3784102470 2024-03-19T06:19:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.473+0000 7f377be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3784108470 0x7f37841986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.473+0000 7f377be00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3784108470 0x7f37841986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35872/0 (socket says 172.21.15.72:35872) 2024-03-19T06:19:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.473+0000 7f377be00700 1 -- 172.21.15.72:0/3922471771 learned_addr learned my addr 172.21.15.72:0/3922471771 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.473+0000 7f3782a00700 1 --2- 172.21.15.72:0/3922471771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3784102470 0x7f3784198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.473+0000 7f377be00700 1 -- 172.21.15.72:0/3922471771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3784102470 msgr2=0x7f3784198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.473+0000 7f377be00700 1 --2- 172.21.15.72:0/3922471771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3784102470 0x7f3784198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:32.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.473+0000 7f377be00700 1 -- 172.21.15.72:0/3922471771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c0095f0 con 0x7f3784108470 2024-03-19T06:19:32.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.473+0000 7f377be00700 1 --2- 172.21.15.72:0/3922471771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3784108470 0x7f37841986d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f376c00b5c0 tx=0x7f376c00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:32.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.474+0000 7f377b400700 1 -- 172.21.15.72:0/3922471771 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f376c01d070 con 0x7f3784108470 2024-03-19T06:19:32.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.474+0000 7f3789a00700 1 -- 172.21.15.72:0/3922471771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378419cdc0 con 0x7f3784108470 2024-03-19T06:19:32.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.474+0000 7f377b400700 1 -- 172.21.15.72:0/3922471771 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f376c00f460 con 0x7f3784108470 2024-03-19T06:19:32.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.474+0000 7f377b400700 1 -- 172.21.15.72:0/3922471771 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f376c017610 con 0x7f3784108470 2024-03-19T06:19:32.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.474+0000 7f3789a00700 1 -- 172.21.15.72:0/3922471771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378419d2b0 con 0x7f3784108470 2024-03-19T06:19:32.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.475+0000 7f3789a00700 1 -- 172.21.15.72:0/3922471771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378410aa00 con 0x7f3784108470 2024-03-19T06:19:32.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.476+0000 7f377b400700 1 -- 172.21.15.72:0/3922471771 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f376c00f5d0 con 0x7f3784108470 2024-03-19T06:19:32.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.477+0000 7f377b400700 1 --2- 172.21.15.72:0/3922471771 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f376806dfa0 0x7f3768070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:32.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.477+0000 7f377b400700 1 -- 172.21.15.72:0/3922471771 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f376c08f3d0 con 0x7f3784108470 2024-03-19T06:19:32.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.478+0000 7f3782a00700 1 --2- 172.21.15.72:0/3922471771 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f376806dfa0 0x7f3768070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:32.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.478+0000 7f3782a00700 1 --2- 172.21.15.72:0/3922471771 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f376806dfa0 0x7f3768070450 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3774006fd0 tx=0x7f3774008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:32.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.482+0000 7f377b400700 1 -- 172.21.15.72:0/3922471771 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f376c0587d0 con 0x7f3784108470 2024-03-19T06:19:32.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.797+0000 7f3789a00700 1 -- 172.21.15.72:0/3922471771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f378404f2a0 con 0x7f3784108470 2024-03-19T06:19:32.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.798+0000 7f377b400700 1 -- 172.21.15.72:0/3922471771 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f376c05be90 con 0x7f3784108470 2024-03-19T06:19:32.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.800+0000 7f3789a00700 1 -- 172.21.15.72:0/3922471771 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f376806dfa0 msgr2=0x7f3768070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:32.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.800+0000 7f3789a00700 1 --2- 172.21.15.72:0/3922471771 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f376806dfa0 0x7f3768070450 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3774006fd0 tx=0x7f3774008040 comp rx=0 tx=0).stop 2024-03-19T06:19:32.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.800+0000 7f3789a00700 1 -- 172.21.15.72:0/3922471771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3784108470 msgr2=0x7f37841986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:32.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.800+0000 7f3789a00700 1 --2- 172.21.15.72:0/3922471771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3784108470 0x7f37841986d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f376c00b5c0 tx=0x7f376c00be00 comp rx=0 tx=0).stop 2024-03-19T06:19:32.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.801+0000 7f3789a00700 1 -- 172.21.15.72:0/3922471771 shutdown_connections 2024-03-19T06:19:32.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.801+0000 7f3789a00700 1 --2- 172.21.15.72:0/3922471771 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f376806dfa0 0x7f3768070450 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:32.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.801+0000 7f3789a00700 1 --2- 172.21.15.72:0/3922471771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3784102470 0x7f3784198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:32.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.801+0000 7f3789a00700 1 --2- 172.21.15.72:0/3922471771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3784108470 0x7f37841986d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:32.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.801+0000 7f3789a00700 1 -- 172.21.15.72:0/3922471771 >> 172.21.15.72:0/3922471771 conn(0x7f37840fdf90 msgr2=0x7f37840feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:32.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.801+0000 7f3789a00700 1 -- 172.21.15.72:0/3922471771 shutdown_connections 2024-03-19T06:19:32.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:32.801+0000 7f3789a00700 1 -- 172.21.15.72:0/3922471771 wait complete. 2024-03-19T06:19:32.807 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)" 2024-03-19T06:19:33.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:33 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3922471771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:19:33.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:33 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3922471771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-19T06:19:33.625 DEBUG:teuthology.parallel:result is None 2024-03-19T06:19:33.625 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-19T06:19:33.637 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T06:19:33.638 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-19T06:19:34.059 INFO:teuthology.orchestra.run.smithi072.stderr:Inferring config /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/mon.smithi072/config 2024-03-19T06:19:34.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:34 smithi072 ceph-mon[78545]: pgmap v402: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:34.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:34 smithi172 ceph-mon[66682]: pgmap v402: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:36.252 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:36 smithi072 ceph-mon[78545]: pgmap v403: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:36.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:36 smithi172 ceph-mon[66682]: pgmap v403: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:36.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.432+0000 7f9077e00700 1 -- 172.21.15.72:0/3256177119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90701004e0 msgr2=0x7f90701008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:36.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.432+0000 7f9077e00700 1 --2- 172.21.15.72:0/3256177119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90701004e0 0x7f90701008b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9064009910 tx=0x7f9064009c20 comp rx=0 tx=0).stop 2024-03-19T06:19:36.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.432+0000 7f9077e00700 1 -- 172.21.15.72:0/3256177119 shutdown_connections 2024-03-19T06:19:36.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.432+0000 7f9077e00700 1 --2- 172.21.15.72:0/3256177119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9070100e80 0x7f9070104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:36.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.432+0000 7f9077e00700 1 --2- 172.21.15.72:0/3256177119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90701004e0 0x7f90701008b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:36.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.432+0000 7f9077e00700 1 -- 172.21.15.72:0/3256177119 >> 172.21.15.72:0/3256177119 conn(0x7f90700fbda0 msgr2=0x7f90700fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:36.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.432+0000 7f9077e00700 1 -- 172.21.15.72:0/3256177119 shutdown_connections 2024-03-19T06:19:36.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.433+0000 7f9077e00700 1 -- 172.21.15.72:0/3256177119 wait complete. 2024-03-19T06:19:36.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.434+0000 7f9077e00700 1 Processor -- start 2024-03-19T06:19:36.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.434+0000 7f9077e00700 1 -- start start 2024-03-19T06:19:36.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.434+0000 7f9077e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90701004e0 0x7f90701980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:36.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.434+0000 7f9077e00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9070100e80 0x7f9070198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:36.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.434+0000 7f9077e00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9070198d10 con 0x7f9070100e80 2024-03-19T06:19:36.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.434+0000 7f9077e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907019caa0 con 0x7f90701004e0 2024-03-19T06:19:36.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.434+0000 7f9074a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9070100e80 0x7f9070198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:36.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.435+0000 7f9074a00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9070100e80 0x7f9070198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48282/0 (socket says 172.21.15.72:48282) 2024-03-19T06:19:36.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.435+0000 7f9074a00700 1 -- 172.21.15.72:0/1797127702 learned_addr learned my addr 172.21.15.72:0/1797127702 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:36.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.435+0000 7f9075400700 1 --2- 172.21.15.72:0/1797127702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90701004e0 0x7f90701980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:36.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.435+0000 7f9074a00700 1 -- 172.21.15.72:0/1797127702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90701004e0 msgr2=0x7f90701980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:36.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.435+0000 7f9074a00700 1 --2- 172.21.15.72:0/1797127702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90701004e0 0x7f90701980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:36.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.435+0000 7f9074a00700 1 -- 172.21.15.72:0/1797127702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90640095f0 con 0x7f9070100e80 2024-03-19T06:19:36.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.435+0000 7f9074a00700 1 --2- 172.21.15.72:0/1797127702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9070100e80 0x7f9070198630 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f905c00c8f0 tx=0x7f905c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:36.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.436+0000 7f906e000700 1 -- 172.21.15.72:0/1797127702 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f905c007a50 con 0x7f9070100e80 2024-03-19T06:19:36.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.436+0000 7f906e000700 1 -- 172.21.15.72:0/1797127702 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f905c007bb0 con 0x7f9070100e80 2024-03-19T06:19:36.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.436+0000 7f906e000700 1 -- 172.21.15.72:0/1797127702 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f905c018630 con 0x7f9070100e80 2024-03-19T06:19:36.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.436+0000 7f9077e00700 1 -- 172.21.15.72:0/1797127702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907019cd80 con 0x7f9070100e80 2024-03-19T06:19:36.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.436+0000 7f9077e00700 1 -- 172.21.15.72:0/1797127702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907019d2d0 con 0x7f9070100e80 2024-03-19T06:19:36.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.437+0000 7f9077e00700 1 -- 172.21.15.72:0/1797127702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90701045d0 con 0x7f9070100e80 2024-03-19T06:19:36.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.438+0000 7f906e000700 1 -- 172.21.15.72:0/1797127702 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f905c007d20 con 0x7f9070100e80 2024-03-19T06:19:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.439+0000 7f906e000700 1 --2- 172.21.15.72:0/1797127702 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f905806dfa0 0x7f9058070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.439+0000 7f906e000700 1 -- 172.21.15.72:0/1797127702 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f905c08dd50 con 0x7f9070100e80 2024-03-19T06:19:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.439+0000 7f9075400700 1 --2- 172.21.15.72:0/1797127702 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f905806dfa0 0x7f9058070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.440+0000 7f9075400700 1 --2- 172.21.15.72:0/1797127702 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f905806dfa0 0x7f9058070450 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9064006010 tx=0x7f906401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:36.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.445+0000 7f906e000700 1 -- 172.21.15.72:0/1797127702 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f905c057150 con 0x7f9070100e80 2024-03-19T06:19:36.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.718+0000 7f9077e00700 1 -- 172.21.15.72:0/1797127702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f907004f2a0 con 0x7f9070100e80 2024-03-19T06:19:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.719+0000 7f906e000700 1 -- 172.21.15.72:0/1797127702 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f905c05a810 con 0x7f9070100e80 2024-03-19T06:19:36.708 INFO:teuthology.orchestra.run.smithi072.stdout:e44 2024-03-19T06:19:36.708 INFO:teuthology.orchestra.run.smithi072.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-19T06:19:36.708 INFO:teuthology.orchestra.run.smithi072.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-19T06:19:36.708 INFO:teuthology.orchestra.run.smithi072.stdout:legacy client fscid: 1 2024-03-19T06:19:36.708 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:36.708 INFO:teuthology.orchestra.run.smithi072.stdout:Filesystem 'cephfs' (1) 2024-03-19T06:19:36.708 INFO:teuthology.orchestra.run.smithi072.stdout:fs_name cephfs 2024-03-19T06:19:36.708 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 44 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-19T06:00:52.215249+0000 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:modified 2024-03-19T06:15:10.305125+0000 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:tableserver 0 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:root 0 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:session_timeout 60 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:session_autoclose 300 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:max_file_size 1099511627776 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:max_xattr_size 65536 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:required_client_features {} 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure 0 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:last_failure_osd_epoch 83 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:max_mds 2 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:in 0,1 2024-03-19T06:19:36.709 INFO:teuthology.orchestra.run.smithi072.stdout:up {0=34488,1=34510} 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:failed 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:damaged 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:stopped 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:data_pools [3] 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:metadata_pool 2 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:inline_data enabled 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:balancer 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:bal_rank_mask -1 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:standby_count_wanted 1 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.jhxzfi{0:34488} state up:active seq 24 join_fscid=1 addr [v2:172.21.15.72:6826/4267492414,v1:172.21.15.72:6827/4267492414] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi072.dvdjwb{1:34510} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.72:6828/3957356790,v1:172.21.15.72:6829/3957356790] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:36.710 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:36.711 INFO:teuthology.orchestra.run.smithi072.stdout:Standby daemons: 2024-03-19T06:19:36.711 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:36.711 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.xlokxp{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/1022637060,v1:172.21.15.172:6825/1022637060] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:19:36.711 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.cephfs.smithi172.nparnw{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3126751850,v1:172.21.15.172:6827/3126751850] compat {c=[1],r=[1],i=[fff]}] 2024-03-19T06:19:36.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.722+0000 7f9077e00700 1 -- 172.21.15.72:0/1797127702 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f905806dfa0 msgr2=0x7f9058070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.722+0000 7f9077e00700 1 --2- 172.21.15.72:0/1797127702 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f905806dfa0 0x7f9058070450 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9064006010 tx=0x7f906401a040 comp rx=0 tx=0).stop 2024-03-19T06:19:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.722+0000 7f9077e00700 1 -- 172.21.15.72:0/1797127702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9070100e80 msgr2=0x7f9070198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.722+0000 7f9077e00700 1 --2- 172.21.15.72:0/1797127702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9070100e80 0x7f9070198630 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f905c00c8f0 tx=0x7f905c00ccb0 comp rx=0 tx=0).stop 2024-03-19T06:19:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.722+0000 7f9077e00700 1 -- 172.21.15.72:0/1797127702 shutdown_connections 2024-03-19T06:19:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.722+0000 7f9077e00700 1 --2- 172.21.15.72:0/1797127702 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f905806dfa0 0x7f9058070450 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.722+0000 7f9077e00700 1 --2- 172.21.15.72:0/1797127702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90701004e0 0x7f90701980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.722+0000 7f9077e00700 1 --2- 172.21.15.72:0/1797127702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9070100e80 0x7f9070198630 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.722+0000 7f9077e00700 1 -- 172.21.15.72:0/1797127702 >> 172.21.15.72:0/1797127702 conn(0x7f90700fbda0 msgr2=0x7f90700fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.722+0000 7f9077e00700 1 -- 172.21.15.72:0/1797127702 shutdown_connections 2024-03-19T06:19:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:36.722+0000 7f9077e00700 1 -- 172.21.15.72:0/1797127702 wait complete. 2024-03-19T06:19:36.713 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 44 2024-03-19T06:19:37.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:37 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1797127702' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:19:37.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:37 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1797127702' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-19T06:19:37.580 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-03-19T06:19:37.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:19:37.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.828+0000 7f2ffa400640 1 -- 172.21.15.72:0/1138063444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ff40750a0 msgr2=0x7f2ff410ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:37.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.828+0000 7f2ffa400640 1 --2- 172.21.15.72:0/1138063444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ff40750a0 0x7f2ff410ffd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009880 tx=0x7f2fdc02bcf0 comp rx=0 tx=0).stop 2024-03-19T06:19:37.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.829+0000 7f2ffa400640 1 -- 172.21.15.72:0/1138063444 shutdown_connections 2024-03-19T06:19:37.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.829+0000 7f2ffa400640 1 --2- 172.21.15.72:0/1138063444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ff40750a0 0x7f2ff410ffd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:37.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.829+0000 7f2ffa400640 1 --2- 172.21.15.72:0/1138063444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff4074790 0x7f2ff4074b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:37.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.829+0000 7f2ffa400640 1 -- 172.21.15.72:0/1138063444 >> 172.21.15.72:0/1138063444 conn(0x7f2ff40fd370 msgr2=0x7f2ff40ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:37.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.829+0000 7f2ffa400640 1 -- 172.21.15.72:0/1138063444 shutdown_connections 2024-03-19T06:19:37.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.829+0000 7f2ffa400640 1 -- 172.21.15.72:0/1138063444 wait complete. 2024-03-19T06:19:37.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.830+0000 7f2ffa400640 1 Processor -- start 2024-03-19T06:19:37.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.830+0000 7f2ffa400640 1 -- start start 2024-03-19T06:19:37.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.830+0000 7f2ffa400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ff4074790 0x7f2ff41a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:37.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.830+0000 7f2ffa400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff40750a0 0x7f2ff41a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:37.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.830+0000 7f2ffa400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff41a2240 con 0x7f2ff4074790 2024-03-19T06:19:37.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.830+0000 7f2ffa400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff419b720 con 0x7f2ff40750a0 2024-03-19T06:19:37.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.830+0000 7f2ff3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ff4074790 0x7f2ff41a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:37.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.830+0000 7f2ff3400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ff4074790 0x7f2ff41a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48292/0 (socket says 172.21.15.72:48292) 2024-03-19T06:19:37.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.830+0000 7f2ff3400640 1 -- 172.21.15.72:0/985995578 learned_addr learned my addr 172.21.15.72:0/985995578 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:37.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.831+0000 7f2feaa00640 1 --2- 172.21.15.72:0/985995578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff40750a0 0x7f2ff41a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:37.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.831+0000 7f2ff3400640 1 -- 172.21.15.72:0/985995578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff40750a0 msgr2=0x7f2ff41a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:37.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.831+0000 7f2ff3400640 1 --2- 172.21.15.72:0/985995578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff40750a0 0x7f2ff41a1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.831+0000 7f2ff3400640 1 -- 172.21.15.72:0/985995578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc009560 con 0x7f2ff4074790 2024-03-19T06:19:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.831+0000 7f2ff3400640 1 --2- 172.21.15.72:0/985995578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ff4074790 0x7f2ff41a16b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400c8a0 tx=0x7f2fe400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.831+0000 7f2ff0c00640 1 -- 172.21.15.72:0/985995578 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fe4007b80 con 0x7f2ff4074790 2024-03-19T06:19:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.831+0000 7f2ff0c00640 1 -- 172.21.15.72:0/985995578 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2fe4007ce0 con 0x7f2ff4074790 2024-03-19T06:19:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.831+0000 7f2ffa400640 1 -- 172.21.15.72:0/985995578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff419b9d0 con 0x7f2ff4074790 2024-03-19T06:19:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.831+0000 7f2ff0c00640 1 -- 172.21.15.72:0/985995578 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fe4018810 con 0x7f2ff4074790 2024-03-19T06:19:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.832+0000 7f2ffa400640 1 -- 172.21.15.72:0/985995578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff419bf30 con 0x7f2ff4074790 2024-03-19T06:19:37.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.833+0000 7f2ffa400640 1 -- 172.21.15.72:0/985995578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff404e000 con 0x7f2ff4074790 2024-03-19T06:19:37.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.834+0000 7f2ff0c00640 1 -- 172.21.15.72:0/985995578 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f2fe4018970 con 0x7f2ff4074790 2024-03-19T06:19:37.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.834+0000 7f2ff0c00640 1 --2- 172.21.15.72:0/985995578 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2fd806dfd0 0x7f2fd8070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:37.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.835+0000 7f2ff0c00640 1 -- 172.21.15.72:0/985995578 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2fe408ded0 con 0x7f2ff4074790 2024-03-19T06:19:37.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.835+0000 7f2feaa00640 1 --2- 172.21.15.72:0/985995578 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2fd806dfd0 0x7f2fd8070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:37.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.836+0000 7f2feaa00640 1 --2- 172.21.15.72:0/985995578 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2fd806dfd0 0x7f2fd8070480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc02c8b0 tx=0x7f2fdc000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:37.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:37.840+0000 7f2ff0c00640 1 -- 172.21.15.72:0/985995578 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f2fe4057370 con 0x7f2ff4074790 2024-03-19T06:19:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.044+0000 7f2ffa400640 1 -- 172.21.15.72:0/985995578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ff410d6b0 con 0x7f2ff4074790 2024-03-19T06:19:38.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.046+0000 7f2ff0c00640 1 -- 172.21.15.72:0/985995578 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16764 (secure 0 0 0) 0x7f2fe405aa30 con 0x7f2ff4074790 2024-03-19T06:19:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:38.035 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":83,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","created":"2024-03-19T05:51:14.734187+0000","modified":"2024-03-19T06:14:49.470998+0000","last_up_change":"2024-03-19T06:12:35.210984+0000","last_in_change":"2024-03-19T05:58:47.988240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T05:57:27.222850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-03-19T06:00:50.787240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-03-19T06:00:51.727393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"215fcddf-0352-4fb1-b006-edd278832a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":823954487},{"type":"v1","addr":"172.21.15.72:6803","nonce":823954487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":823954487},{"type":"v1","addr":"172.21.15.72:6805","nonce":823954487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":823954487},{"type":"v1","addr":"172.21.15.72:6809","nonce":823954487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":823954487},{"type":"v1","addr":"172.21.15.72:6807","nonce":823954487}]},"public_addr":"172.21.15.72:6803/823954487","cluster_addr":"172.21.15.72:6805/823954487","heartbeat_back_addr":"172.21.15.72:6809/823954487","heartbeat_front_addr":"172.21.15.72:6807/823954487","state":["exists","up"]},{"osd":1,"uuid":"f52e39bf-bbfe-48c3-bf4f-70cae6b4e57c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2275618942},{"type":"v1","addr":"172.21.15.72:6811","nonce":2275618942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2275618942},{"type":"v1","addr":"172.21.15.72:6813","nonce":2275618942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2275618942},{"type":"v1","addr":"172.21.15.72:6817","nonce":2275618942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2275618942},{"type":"v1","addr":"172.21.15.72:6815","nonce":2275618942}]},"public_addr":"172.21.15.72:6811/2275618942","cluster_addr":"172.21.15.72:6813/2275618942","heartbeat_back_addr":"172.21.15.72:6817/2275618942","heartbeat_front_addr":"172.21.15.72:6815/2275618942","state":["exists","up"]},{"osd":2,"uuid":"ddcccb72-1a1e-4d0a-8d61-4fa48d91cba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":517254227},{"type":"v1","addr":"172.21.15.72:6819","nonce":517254227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":517254227},{"type":"v1","addr":"172.21.15.72:6821","nonce":517254227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":517254227},{"type":"v1","addr":"172.21.15.72:6825","nonce":517254227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":517254227},{"type":"v1","addr":"172.21.15.72:6823","nonce":517254227}]},"public_addr":"172.21.15.72:6819/517254227","cluster_addr":"172.21.15.72:6821/517254227","heartbeat_back_addr":"172.21.15.72:6825/517254227","heartbeat_front_addr":"172.21.15.72:6823/517254227","state":["exists","up"]},{"osd":3,"uuid":"27291f1a-1705-4da7-a15a-4ddc099c08ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2721074858},{"type":"v1","addr":"172.21.15.172:6801","nonce":2721074858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2721074858},{"type":"v1","addr":"172.21.15.172:6803","nonce":2721074858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2721074858},{"type":"v1","addr":"172.21.15.172:6807","nonce":2721074858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2721074858},{"type":"v1","addr":"172.21.15.172:6805","nonce":2721074858}]},"public_addr":"172.21.15.172:6801/2721074858","cluster_addr":"172.21.15.172:6803/2721074858","heartbeat_back_addr":"172.21.15.172:6807/2721074858","heartbeat_front_addr":"172.21.15.172:6805/2721074858","state":["exists","up"]},{"osd":4,"uuid":"88b90845-3e0a-4e4d-80e9-7a70e25dbfac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1295620546},{"type":"v1","addr":"172.21.15.172:6809","nonce":1295620546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1295620546},{"type":"v1","addr":"172.21.15.172:6811","nonce":1295620546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1295620546},{"type":"v1","addr":"172.21.15.172:6815","nonce":1295620546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1295620546},{"type":"v1","addr":"172.21.15.172:6813","nonce":1295620546}]},"public_addr":"172.21.15.172:6809/1295620546","cluster_addr":"172.21.15.172:6811/1295620546","heartbeat_back_addr":"172.21.15.172:6815/1295620546","heartbeat_front_addr":"172.21.15.172:6813/1295620546","state":["exists","up"]},{"osd":5,"uuid":"6095500f-8c30-475a-8f69-ab85226b2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1857818067},{"type":"v1","addr":"172.21.15.172:6817","nonce":1857818067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1857818067},{"type":"v1","addr":"172.21.15.172:6819","nonce":1857818067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1857818067},{"type":"v1","addr":"172.21.15.172:6823","nonce":1857818067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1857818067},{"type":"v1","addr":"172.21.15.172:6821","nonce":1857818067}]},"public_addr":"172.21.15.172:6817/1857818067","cluster_addr":"172.21.15.172:6819/1857818067","heartbeat_back_addr":"172.21.15.172:6823/1857818067","heartbeat_front_addr":"172.21.15.172:6821/1857818067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:10.113377+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:46.911606+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:57:24.691482+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:01.632867+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:35.570288+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:59:10.181140+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6826/363477076":"2024-03-20T06:14:49.470935+0000","172.21.15.172:6827/363477076":"2024-03-20T06:14:49.470935+0000","172.21.15.72:6827/772635337":"2024-03-20T06:13:19.631192+0000","172.21.15.72:0/4199454850":"2024-03-20T06:04:03.942401+0000","172.21.15.172:0/2707855483":"2024-03-20T06:05:12.456606+0000","172.21.15.72:6800/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/3195993518":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/3627388017":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/3141025630":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6800/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6828/1218260294":"2024-03-20T06:13:54.895628+0000","172.21.15.72:0/1631679569":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6801/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/1450624542":"2024-03-20T05:54:30.519459+0000","172.21.15.172:0/1790535528":"2024-03-20T06:05:12.456606+0000","172.21.15.72:0/3229768069":"2024-03-20T05:52:50.595473+0000","172.21.15.172:6828/1633747146":"2024-03-20T06:05:12.456606+0000","172.21.15.72:0/2295310555":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6829/1218260294":"2024-03-20T06:13:54.895628+0000","172.21.15.172:0/268667195":"2024-03-20T06:05:12.456606+0000","172.21.15.172:0/3155967807":"2024-03-20T06:05:12.456606+0000","172.21.15.72:0/1795725640":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6800/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6801/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6800/1154232723":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/495048474":"2024-03-20T06:07:24.636011+0000","172.21.15.72:6801/1154232723":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/2582270882":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/1827861673":"2024-03-20T05:54:30.519459+0000","172.21.15.172:0/3565787740":"2024-03-20T06:05:12.456606+0000","172.21.15.172:6829/1633747146":"2024-03-20T06:05:12.456606+0000","172.21.15.72:6800/2640845307":"2024-03-20T06:07:24.636011+0000","172.21.15.72:6801/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/1944964087":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/3793616122":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/1127443989":"2024-03-20T06:07:24.636011+0000","172.21.15.172:0/3813007324":"2024-03-20T06:05:12.456606+0000","172.21.15.72:0/939742318":"2024-03-20T06:07:24.636011+0000","172.21.15.72:0/986207477":"2024-03-20T06:07:24.636011+0000","172.21.15.72:6801/2640845307":"2024-03-20T06:07:24.636011+0000","172.21.15.72:6826/772635337":"2024-03-20T06:13:19.631192+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:19:38.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.049+0000 7f2ffa400640 1 -- 172.21.15.72:0/985995578 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2fd806dfd0 msgr2=0x7f2fd8070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:38.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.049+0000 7f2ffa400640 1 --2- 172.21.15.72:0/985995578 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2fd806dfd0 0x7f2fd8070480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc02c8b0 tx=0x7f2fdc000bc0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.049+0000 7f2ffa400640 1 -- 172.21.15.72:0/985995578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ff4074790 msgr2=0x7f2ff41a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:38.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.049+0000 7f2ffa400640 1 --2- 172.21.15.72:0/985995578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ff4074790 0x7f2ff41a16b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400c8a0 tx=0x7f2fe400cd60 comp rx=0 tx=0).stop 2024-03-19T06:19:38.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.049+0000 7f2ffa400640 1 -- 172.21.15.72:0/985995578 shutdown_connections 2024-03-19T06:19:38.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.049+0000 7f2ffa400640 1 --2- 172.21.15.72:0/985995578 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2fd806dfd0 0x7f2fd8070480 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.049+0000 7f2ffa400640 1 --2- 172.21.15.72:0/985995578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff40750a0 0x7f2ff41a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.049+0000 7f2ffa400640 1 --2- 172.21.15.72:0/985995578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ff4074790 0x7f2ff41a16b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.049+0000 7f2ffa400640 1 -- 172.21.15.72:0/985995578 >> 172.21.15.72:0/985995578 conn(0x7f2ff40fd370 msgr2=0x7f2ff40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:38.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.049+0000 7f2ffa400640 1 -- 172.21.15.72:0/985995578 shutdown_connections 2024-03-19T06:19:38.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.049+0000 7f2ffa400640 1 -- 172.21.15.72:0/985995578 wait complete. 2024-03-19T06:19:38.056 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T05:57:27.222850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-03-19T06:00:50.787240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-03-19T06:00:51.727393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:19:38.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:19:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.269+0000 7f0527400640 1 -- 172.21.15.72:0/1246609839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0520100a40 msgr2=0x7f0520100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.269+0000 7f0527400640 1 --2- 172.21.15.72:0/1246609839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0520100a40 0x7f0520100e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f05140098b0 tx=0x7f051402bd70 comp rx=0 tx=0).stop 2024-03-19T06:19:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.269+0000 7f0527400640 1 -- 172.21.15.72:0/1246609839 shutdown_connections 2024-03-19T06:19:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.269+0000 7f0527400640 1 --2- 172.21.15.72:0/1246609839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0520101350 0x7f0520109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.269+0000 7f0527400640 1 --2- 172.21.15.72:0/1246609839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0520100a40 0x7f0520100e10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.269+0000 7f0527400640 1 -- 172.21.15.72:0/1246609839 >> 172.21.15.72:0/1246609839 conn(0x7f05200fa2b0 msgr2=0x7f05200fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.269+0000 7f0527400640 1 -- 172.21.15.72:0/1246609839 shutdown_connections 2024-03-19T06:19:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.269+0000 7f0527400640 1 -- 172.21.15.72:0/1246609839 wait complete. 2024-03-19T06:19:38.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.270+0000 7f0527400640 1 Processor -- start 2024-03-19T06:19:38.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.270+0000 7f0527400640 1 -- start start 2024-03-19T06:19:38.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.270+0000 7f0527400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0520100a40 0x7f0520195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:38.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.270+0000 7f0527400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0520101350 0x7f0520195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.270+0000 7f0527400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0520196100 con 0x7f0520101350 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.270+0000 7f0527400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0520199ed0 con 0x7f0520100a40 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.271+0000 7f051fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0520101350 0x7f0520195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.271+0000 7f051fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0520101350 0x7f0520195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48310/0 (socket says 172.21.15.72:48310) 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.271+0000 7f051fe00640 1 -- 172.21.15.72:0/136044138 learned_addr learned my addr 172.21.15.72:0/136044138 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.271+0000 7f0524a00640 1 --2- 172.21.15.72:0/136044138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0520100a40 0x7f0520195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.271+0000 7f051fe00640 1 -- 172.21.15.72:0/136044138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0520100a40 msgr2=0x7f0520195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.271+0000 7f051fe00640 1 --2- 172.21.15.72:0/136044138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0520100a40 0x7f0520195530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.271+0000 7f051fe00640 1 -- 172.21.15.72:0/136044138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514009560 con 0x7f0520101350 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.271+0000 7f051fe00640 1 --2- 172.21.15.72:0/136044138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0520101350 0x7f0520195a70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f050c00e970 tx=0x7f050c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.272+0000 7f051d600640 1 -- 172.21.15.72:0/136044138 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f050c00cc90 con 0x7f0520101350 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.272+0000 7f051d600640 1 -- 172.21.15.72:0/136044138 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f050c00cdf0 con 0x7f0520101350 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.272+0000 7f0527400640 1 -- 172.21.15.72:0/136044138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052019a1b0 con 0x7f0520101350 2024-03-19T06:19:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.272+0000 7f051d600640 1 -- 172.21.15.72:0/136044138 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f050c010430 con 0x7f0520101350 2024-03-19T06:19:38.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.272+0000 7f0527400640 1 -- 172.21.15.72:0/136044138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052019a710 con 0x7f0520101350 2024-03-19T06:19:38.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.273+0000 7f0527400640 1 -- 172.21.15.72:0/136044138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052004e000 con 0x7f0520101350 2024-03-19T06:19:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.275+0000 7f051d600640 1 -- 172.21.15.72:0/136044138 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f050c0046c0 con 0x7f0520101350 2024-03-19T06:19:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.276+0000 7f051d600640 1 --2- 172.21.15.72:0/136044138 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f050806df10 0x7f05080703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.276+0000 7f051d600640 1 -- 172.21.15.72:0/136044138 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f050c014070 con 0x7f0520101350 2024-03-19T06:19:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.276+0000 7f0524a00640 1 --2- 172.21.15.72:0/136044138 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f050806df10 0x7f05080703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.277+0000 7f0524a00640 1 --2- 172.21.15.72:0/136044138 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f050806df10 0x7f05080703c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0514000c00 tx=0x7f0514005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:38.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.281+0000 7f051d600640 1 -- 172.21.15.72:0/136044138 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f050c057690 con 0x7f0520101350 2024-03-19T06:19:38.301 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:38 smithi172 ceph-mon[66682]: pgmap v404: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:38.301 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:38 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/985995578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T06:19:38.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:38 smithi072 ceph-mon[78545]: pgmap v404: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:38.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:38 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/985995578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T06:19:38.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.481+0000 7f0527400640 1 -- 172.21.15.72:0/136044138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0520196880 con 0x7f0520101350 2024-03-19T06:19:38.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.482+0000 7f051d600640 1 -- 172.21.15.72:0/136044138 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f050c05ad50 con 0x7f0520101350 2024-03-19T06:19:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-19T06:19:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.485+0000 7f0527400640 1 -- 172.21.15.72:0/136044138 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f050806df10 msgr2=0x7f05080703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.485+0000 7f0527400640 1 --2- 172.21.15.72:0/136044138 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f050806df10 0x7f05080703c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0514000c00 tx=0x7f0514005fd0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.485+0000 7f0527400640 1 -- 172.21.15.72:0/136044138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0520101350 msgr2=0x7f0520195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.485+0000 7f0527400640 1 --2- 172.21.15.72:0/136044138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0520101350 0x7f0520195a70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f050c00e970 tx=0x7f050c00ed70 comp rx=0 tx=0).stop 2024-03-19T06:19:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.485+0000 7f0527400640 1 -- 172.21.15.72:0/136044138 shutdown_connections 2024-03-19T06:19:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.485+0000 7f0527400640 1 --2- 172.21.15.72:0/136044138 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f050806df10 0x7f05080703c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.485+0000 7f0527400640 1 --2- 172.21.15.72:0/136044138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0520101350 0x7f0520195a70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.485+0000 7f0527400640 1 --2- 172.21.15.72:0/136044138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0520100a40 0x7f0520195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.485+0000 7f0527400640 1 -- 172.21.15.72:0/136044138 >> 172.21.15.72:0/136044138 conn(0x7f05200fa2b0 msgr2=0x7f0520104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.485+0000 7f0527400640 1 -- 172.21.15.72:0/136044138 shutdown_connections 2024-03-19T06:19:38.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.485+0000 7f0527400640 1 -- 172.21.15.72:0/136044138 wait complete. 2024-03-19T06:19:38.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-03-19T06:19:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.703+0000 7fa671400640 1 -- 172.21.15.72:0/4194590684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa66c072eb0 msgr2=0x7fa66c10bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.703+0000 7fa671400640 1 --2- 172.21.15.72:0/4194590684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa66c072eb0 0x7fa66c10bbd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa654009880 tx=0x7fa65402bd70 comp rx=0 tx=0).stop 2024-03-19T06:19:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.703+0000 7fa671400640 1 -- 172.21.15.72:0/4194590684 shutdown_connections 2024-03-19T06:19:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.703+0000 7fa671400640 1 --2- 172.21.15.72:0/4194590684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa66c072eb0 0x7fa66c10bbd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.703+0000 7fa671400640 1 --2- 172.21.15.72:0/4194590684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66c0725a0 0x7fa66c072970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.703+0000 7fa671400640 1 -- 172.21.15.72:0/4194590684 >> 172.21.15.72:0/4194590684 conn(0x7fa66c0fb370 msgr2=0x7fa66c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.704+0000 7fa671400640 1 -- 172.21.15.72:0/4194590684 shutdown_connections 2024-03-19T06:19:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.704+0000 7fa671400640 1 -- 172.21.15.72:0/4194590684 wait complete. 2024-03-19T06:19:38.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.705+0000 7fa671400640 1 Processor -- start 2024-03-19T06:19:38.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.705+0000 7fa671400640 1 -- start start 2024-03-19T06:19:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.705+0000 7fa671400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66c0725a0 0x7fa66c197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.705+0000 7fa671400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa66c072eb0 0x7fa66c197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.705+0000 7fa671400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c198290 con 0x7fa66c072eb0 2024-03-19T06:19:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.705+0000 7fa671400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c19aff0 con 0x7fa66c0725a0 2024-03-19T06:19:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.706+0000 7fa663e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa66c072eb0 0x7fa66c197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.706+0000 7fa663e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa66c072eb0 0x7fa66c197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48334/0 (socket says 172.21.15.72:48334) 2024-03-19T06:19:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.706+0000 7fa663e00640 1 -- 172.21.15.72:0/2609755768 learned_addr learned my addr 172.21.15.72:0/2609755768 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.706+0000 7fa66a800640 1 --2- 172.21.15.72:0/2609755768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66c0725a0 0x7fa66c197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.706+0000 7fa663e00640 1 -- 172.21.15.72:0/2609755768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66c0725a0 msgr2=0x7fa66c197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.706+0000 7fa663e00640 1 --2- 172.21.15.72:0/2609755768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66c0725a0 0x7fa66c197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.706+0000 7fa663e00640 1 -- 172.21.15.72:0/2609755768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654009560 con 0x7fa66c072eb0 2024-03-19T06:19:38.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.707+0000 7fa663e00640 1 --2- 172.21.15.72:0/2609755768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa66c072eb0 0x7fa66c197c40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa654009230 tx=0x7fa654004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:38.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.707+0000 7fa663400640 1 -- 172.21.15.72:0/2609755768 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6540037c0 con 0x7fa66c072eb0 2024-03-19T06:19:38.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.707+0000 7fa671400640 1 -- 172.21.15.72:0/2609755768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c19b270 con 0x7fa66c072eb0 2024-03-19T06:19:38.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.707+0000 7fa663400640 1 -- 172.21.15.72:0/2609755768 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa654004aa0 con 0x7fa66c072eb0 2024-03-19T06:19:38.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.707+0000 7fa663400640 1 -- 172.21.15.72:0/2609755768 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa65403e450 con 0x7fa66c072eb0 2024-03-19T06:19:38.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.707+0000 7fa671400640 1 -- 172.21.15.72:0/2609755768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c19b7d0 con 0x7fa66c072eb0 2024-03-19T06:19:38.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.708+0000 7fa671400640 1 -- 172.21.15.72:0/2609755768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c04e000 con 0x7fa66c072eb0 2024-03-19T06:19:38.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.710+0000 7fa663400640 1 -- 172.21.15.72:0/2609755768 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fa654005060 con 0x7fa66c072eb0 2024-03-19T06:19:38.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.710+0000 7fa663400640 1 --2- 172.21.15.72:0/2609755768 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa65006df10 0x7fa6500703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:38.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.711+0000 7fa663400640 1 -- 172.21.15.72:0/2609755768 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa6540b0b50 con 0x7fa66c072eb0 2024-03-19T06:19:38.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.711+0000 7fa66a800640 1 --2- 172.21.15.72:0/2609755768 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa65006df10 0x7fa6500703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:38.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.712+0000 7fa66a800640 1 --2- 172.21.15.72:0/2609755768 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa65006df10 0x7fa6500703c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa65c005e10 tx=0x7fa65c005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:38.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.717+0000 7fa663400640 1 -- 172.21.15.72:0/2609755768 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fa654079ff0 con 0x7fa66c072eb0 2024-03-19T06:19:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.915+0000 7fa671400640 1 -- 172.21.15.72:0/2609755768 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fa66c066860 con 0x7fa66c072eb0 2024-03-19T06:19:38.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.916+0000 7fa663400640 1 -- 172.21.15.72:0/2609755768 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa65407d6b0 con 0x7fa66c072eb0 2024-03-19T06:19:38.905 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-19T06:19:38.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.918+0000 7fa671400640 1 -- 172.21.15.72:0/2609755768 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa65006df10 msgr2=0x7fa6500703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:38.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.919+0000 7fa671400640 1 --2- 172.21.15.72:0/2609755768 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa65006df10 0x7fa6500703c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa65c005e10 tx=0x7fa65c005da0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.919+0000 7fa671400640 1 -- 172.21.15.72:0/2609755768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa66c072eb0 msgr2=0x7fa66c197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:38.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.919+0000 7fa671400640 1 --2- 172.21.15.72:0/2609755768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa66c072eb0 0x7fa66c197c40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa654009230 tx=0x7fa654004270 comp rx=0 tx=0).stop 2024-03-19T06:19:38.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.919+0000 7fa671400640 1 -- 172.21.15.72:0/2609755768 shutdown_connections 2024-03-19T06:19:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.919+0000 7fa671400640 1 --2- 172.21.15.72:0/2609755768 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fa65006df10 0x7fa6500703c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.919+0000 7fa671400640 1 --2- 172.21.15.72:0/2609755768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa66c072eb0 0x7fa66c197c40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.919+0000 7fa671400640 1 --2- 172.21.15.72:0/2609755768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66c0725a0 0x7fa66c197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.919+0000 7fa671400640 1 -- 172.21.15.72:0/2609755768 >> 172.21.15.72:0/2609755768 conn(0x7fa66c0fb370 msgr2=0x7fa66c106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.919+0000 7fa671400640 1 -- 172.21.15.72:0/2609755768 shutdown_connections 2024-03-19T06:19:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:38.919+0000 7fa671400640 1 -- 172.21.15.72:0/2609755768 wait complete. 2024-03-19T06:19:38.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-03-19T06:19:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.114+0000 7f23af200640 1 -- 172.21.15.72:0/683891653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b01055c0 msgr2=0x7f23b0105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.114+0000 7f23af200640 1 --2- 172.21.15.72:0/683891653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b01055c0 0x7f23b0105990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009880 tx=0x7f23a002bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.114+0000 7f23af200640 1 -- 172.21.15.72:0/683891653 shutdown_connections 2024-03-19T06:19:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.114+0000 7f23af200640 1 --2- 172.21.15.72:0/683891653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23b0067310 0x7f23b0067760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.114+0000 7f23af200640 1 --2- 172.21.15.72:0/683891653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b01055c0 0x7f23b0105990 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.114+0000 7f23af200640 1 -- 172.21.15.72:0/683891653 >> 172.21.15.72:0/683891653 conn(0x7f23b00743d0 msgr2=0x7f23b00747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:39.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.114+0000 7f23af200640 1 -- 172.21.15.72:0/683891653 shutdown_connections 2024-03-19T06:19:39.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.115+0000 7f23af200640 1 -- 172.21.15.72:0/683891653 wait complete. 2024-03-19T06:19:39.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.115+0000 7f23af200640 1 Processor -- start 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.116+0000 7f23af200640 1 -- start start 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.116+0000 7f23af200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23b0067310 0x7f23b01973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.116+0000 7f23af200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b01055c0 0x7f23b0197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.116+0000 7f23af200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0197f90 con 0x7f23b01055c0 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.116+0000 7f23af200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b019bd60 con 0x7f23b0067310 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.116+0000 7f23a5400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b01055c0 0x7f23b0197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.116+0000 7f23a5400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b01055c0 0x7f23b0197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48356/0 (socket says 172.21.15.72:48356) 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.116+0000 7f23a5400640 1 -- 172.21.15.72:0/500544838 learned_addr learned my addr 172.21.15.72:0/500544838 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.117+0000 7f23ade00640 1 --2- 172.21.15.72:0/500544838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23b0067310 0x7f23b01973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.117+0000 7f23a5400640 1 -- 172.21.15.72:0/500544838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23b0067310 msgr2=0x7f23b01973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.117+0000 7f23a5400640 1 --2- 172.21.15.72:0/500544838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23b0067310 0x7f23b01973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.117+0000 7f23a5400640 1 -- 172.21.15.72:0/500544838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a0009560 con 0x7f23b01055c0 2024-03-19T06:19:39.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.117+0000 7f23a5400640 1 --2- 172.21.15.72:0/500544838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b01055c0 0x7f23b0197900 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f239800c8f0 tx=0x7f239800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.117+0000 7f23a7400640 1 -- 172.21.15.72:0/500544838 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2398007b80 con 0x7f23b01055c0 2024-03-19T06:19:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.117+0000 7f23a7400640 1 -- 172.21.15.72:0/500544838 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23980054e0 con 0x7f23b01055c0 2024-03-19T06:19:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.117+0000 7f23af200640 1 -- 172.21.15.72:0/500544838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b019c040 con 0x7f23b01055c0 2024-03-19T06:19:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.117+0000 7f23a7400640 1 -- 172.21.15.72:0/500544838 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f239800f450 con 0x7f23b01055c0 2024-03-19T06:19:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.117+0000 7f23af200640 1 -- 172.21.15.72:0/500544838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b019c5a0 con 0x7f23b01055c0 2024-03-19T06:19:39.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.118+0000 7f23af200640 1 -- 172.21.15.72:0/500544838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b004e000 con 0x7f23b01055c0 2024-03-19T06:19:39.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.120+0000 7f23a7400640 1 -- 172.21.15.72:0/500544838 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f2398004f60 con 0x7f23b01055c0 2024-03-19T06:19:39.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.121+0000 7f23a7400640 1 --2- 172.21.15.72:0/500544838 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f239406df10 0x7f23940703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:39.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.121+0000 7f23a7400640 1 -- 172.21.15.72:0/500544838 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f239808dc10 con 0x7f23b01055c0 2024-03-19T06:19:39.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.122+0000 7f23ade00640 1 --2- 172.21.15.72:0/500544838 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f239406df10 0x7f23940703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:39.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.122+0000 7f23ade00640 1 --2- 172.21.15.72:0/500544838 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f239406df10 0x7f23940703c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f23a0036040 tx=0x7f23a002cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:39.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.126+0000 7f23a7400640 1 -- 172.21.15.72:0/500544838 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f2398057030 con 0x7f23b01055c0 2024-03-19T06:19:39.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.321+0000 7f23af200640 1 -- 172.21.15.72:0/500544838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f23b0198710 con 0x7f23b01055c0 2024-03-19T06:19:39.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.321+0000 7f23a7400640 1 -- 172.21.15.72:0/500544838 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f239805a6f0 con 0x7f23b01055c0 2024-03-19T06:19:39.310 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-19T06:19:39.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.324+0000 7f23af200640 1 -- 172.21.15.72:0/500544838 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f239406df10 msgr2=0x7f23940703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:39.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.324+0000 7f23af200640 1 --2- 172.21.15.72:0/500544838 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f239406df10 0x7f23940703c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f23a0036040 tx=0x7f23a002cf90 comp rx=0 tx=0).stop 2024-03-19T06:19:39.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.324+0000 7f23af200640 1 -- 172.21.15.72:0/500544838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b01055c0 msgr2=0x7f23b0197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:39.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.324+0000 7f23af200640 1 --2- 172.21.15.72:0/500544838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b01055c0 0x7f23b0197900 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f239800c8f0 tx=0x7f239800cdb0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.324+0000 7f23af200640 1 -- 172.21.15.72:0/500544838 shutdown_connections 2024-03-19T06:19:39.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.324+0000 7f23af200640 1 --2- 172.21.15.72:0/500544838 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f239406df10 0x7f23940703c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.324+0000 7f23af200640 1 --2- 172.21.15.72:0/500544838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b01055c0 0x7f23b0197900 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.324+0000 7f23af200640 1 --2- 172.21.15.72:0/500544838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23b0067310 0x7f23b01973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.324+0000 7f23af200640 1 -- 172.21.15.72:0/500544838 >> 172.21.15.72:0/500544838 conn(0x7f23b00743d0 msgr2=0x7f23b00fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:39.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.324+0000 7f23af200640 1 -- 172.21.15.72:0/500544838 shutdown_connections 2024-03-19T06:19:39.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.324+0000 7f23af200640 1 -- 172.21.15.72:0/500544838 wait complete. 2024-03-19T06:19:39.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:39 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:19:39.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:39 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/136044138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-19T06:19:39.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:39 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2609755768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-19T06:19:39.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:19:39.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:39 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:19:39.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:39 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/136044138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-19T06:19:39.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:39 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2609755768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-19T06:19:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.539+0000 7f5afc800640 1 -- 172.21.15.72:0/1797910123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4101870 msgr2=0x7f5af4101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.539+0000 7f5afc800640 1 --2- 172.21.15.72:0/1797910123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4101870 0x7f5af4101ce0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009880 tx=0x7f5ae802bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.539+0000 7f5afc800640 1 -- 172.21.15.72:0/1797910123 shutdown_connections 2024-03-19T06:19:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.539+0000 7f5afc800640 1 --2- 172.21.15.72:0/1797910123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4101870 0x7f5af4101ce0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.539+0000 7f5afc800640 1 --2- 172.21.15.72:0/1797910123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5af4107880 0x7f5af4107c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.539+0000 7f5afc800640 1 -- 172.21.15.72:0/1797910123 >> 172.21.15.72:0/1797910123 conn(0x7f5af40fd370 msgr2=0x7f5af40ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.539+0000 7f5afc800640 1 -- 172.21.15.72:0/1797910123 shutdown_connections 2024-03-19T06:19:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.539+0000 7f5afc800640 1 -- 172.21.15.72:0/1797910123 wait complete. 2024-03-19T06:19:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.541+0000 7f5afc800640 1 Processor -- start 2024-03-19T06:19:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.541+0000 7f5afc800640 1 -- start start 2024-03-19T06:19:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.541+0000 7f5afc800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4101870 0x7f5af41a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.541+0000 7f5afc800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5af4107880 0x7f5af41a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.541+0000 7f5afc800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af41a1150 con 0x7f5af4101870 2024-03-19T06:19:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.541+0000 7f5afc800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af4077770 con 0x7f5af4107880 2024-03-19T06:19:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.541+0000 7f5af9e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4101870 0x7f5af41a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.542+0000 7f5af9e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4101870 0x7f5af41a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48374/0 (socket says 172.21.15.72:48374) 2024-03-19T06:19:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.542+0000 7f5af9e00640 1 -- 172.21.15.72:0/3331129886 learned_addr learned my addr 172.21.15.72:0/3331129886 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.542+0000 7f5af9e00640 1 -- 172.21.15.72:0/3331129886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5af4107880 msgr2=0x7f5af41a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.542+0000 7f5af9e00640 1 --2- 172.21.15.72:0/3331129886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5af4107880 0x7f5af41a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.542+0000 7f5af9e00640 1 -- 172.21.15.72:0/3331129886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8009560 con 0x7f5af4101870 2024-03-19T06:19:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.542+0000 7f5af9e00640 1 --2- 172.21.15.72:0/3331129886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4101870 0x7f5af41a0640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400b3d0 tx=0x7f5ae400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.542+0000 7f5aeea00640 1 -- 172.21.15.72:0/3331129886 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ae4011800 con 0x7f5af4101870 2024-03-19T06:19:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.543+0000 7f5aeea00640 1 -- 172.21.15.72:0/3331129886 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ae4011e20 con 0x7f5af4101870 2024-03-19T06:19:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.543+0000 7f5afc800640 1 -- 172.21.15.72:0/3331129886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af4077a50 con 0x7f5af4101870 2024-03-19T06:19:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.543+0000 7f5aeea00640 1 -- 172.21.15.72:0/3331129886 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ae400f510 con 0x7f5af4101870 2024-03-19T06:19:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.543+0000 7f5afc800640 1 -- 172.21.15.72:0/3331129886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af4078030 con 0x7f5af4101870 2024-03-19T06:19:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.544+0000 7f5afc800640 1 -- 172.21.15.72:0/3331129886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af404e000 con 0x7f5af4101870 2024-03-19T06:19:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.545+0000 7f5aeea00640 1 -- 172.21.15.72:0/3331129886 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f5ae4010380 con 0x7f5af4101870 2024-03-19T06:19:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.546+0000 7f5aeea00640 1 --2- 172.21.15.72:0/3331129886 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5adc06dfd0 0x7f5adc070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.546+0000 7f5aeea00640 1 -- 172.21.15.72:0/3331129886 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5ae408db80 con 0x7f5af4101870 2024-03-19T06:19:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.546+0000 7f5af9400640 1 --2- 172.21.15.72:0/3331129886 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5adc06dfd0 0x7f5adc070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.547+0000 7f5af9400640 1 --2- 172.21.15.72:0/3331129886 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5adc06dfd0 0x7f5adc070480 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8036040 tx=0x7f5ae8000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.552+0000 7f5aeea00640 1 -- 172.21.15.72:0/3331129886 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f5ae4056f00 con 0x7f5af4101870 2024-03-19T06:19:39.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.790+0000 7f5afc800640 1 -- 172.21.15.72:0/3331129886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5af410ece0 con 0x7f5af4101870 2024-03-19T06:19:39.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.791+0000 7f5aeea00640 1 -- 172.21.15.72:0/3331129886 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5019 (secure 0 0 0) 0x7f5ae405a5c0 con 0x7f5af4101870 2024-03-19T06:19:39.780 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:39.780 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44287,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/1022637060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1022637060},{"type":"v1","addr":"172.21.15.172:6825","nonce":1022637060}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":44309,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3126751850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3126751850},{"type":"v1","addr":"172.21.15.172:6827","nonce":3126751850}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:15:10.305125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34488,"mds_1":34510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34488":{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":38,"state":"up:active","state_seq":24,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34510":{"gid":34510,"name":"cephfs.smithi072.dvdjwb","rank":1,"incarnation":43,"state":"up:active","state_seq":18,"addr":"172.21.15.72:6829/3957356790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3957356790},{"type":"v1","addr":"172.21.15.72:6829","nonce":3957356790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:39.780 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 44 2024-03-19T06:19:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.794+0000 7f5afc800640 1 -- 172.21.15.72:0/3331129886 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5adc06dfd0 msgr2=0x7f5adc070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.794+0000 7f5afc800640 1 --2- 172.21.15.72:0/3331129886 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5adc06dfd0 0x7f5adc070480 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8036040 tx=0x7f5ae8000bc0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.794+0000 7f5afc800640 1 -- 172.21.15.72:0/3331129886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4101870 msgr2=0x7f5af41a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.794+0000 7f5afc800640 1 --2- 172.21.15.72:0/3331129886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4101870 0x7f5af41a0640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400b3d0 tx=0x7f5ae400b890 comp rx=0 tx=0).stop 2024-03-19T06:19:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.794+0000 7f5afc800640 1 -- 172.21.15.72:0/3331129886 shutdown_connections 2024-03-19T06:19:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.794+0000 7f5afc800640 1 --2- 172.21.15.72:0/3331129886 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f5adc06dfd0 0x7f5adc070480 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.794+0000 7f5afc800640 1 --2- 172.21.15.72:0/3331129886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5af4107880 0x7f5af41a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.794+0000 7f5afc800640 1 --2- 172.21.15.72:0/3331129886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4101870 0x7f5af41a0640 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.794+0000 7f5afc800640 1 -- 172.21.15.72:0/3331129886 >> 172.21.15.72:0/3331129886 conn(0x7f5af40fd370 msgr2=0x7f5af40feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.794+0000 7f5afc800640 1 -- 172.21.15.72:0/3331129886 shutdown_connections 2024-03-19T06:19:39.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:39.794+0000 7f5afc800640 1 -- 172.21.15.72:0/3331129886 wait complete. 2024-03-19T06:19:39.800 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 2, 'flags': 18} 2024-03-19T06:19:39.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 14 2024-03-19T06:19:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.023+0000 7f4027000640 1 -- 172.21.15.72:0/1539433325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4020074790 msgr2=0x7f4020074b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.023+0000 7f4027000640 1 --2- 172.21.15.72:0/1539433325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4020074790 0x7f4020074b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4010009c20 tx=0x7f401002c1b0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.023+0000 7f4027000640 1 -- 172.21.15.72:0/1539433325 shutdown_connections 2024-03-19T06:19:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.023+0000 7f4027000640 1 --2- 172.21.15.72:0/1539433325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40200750a0 0x7f402010fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.023+0000 7f4027000640 1 --2- 172.21.15.72:0/1539433325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4020074790 0x7f4020074b60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.023+0000 7f4027000640 1 -- 172.21.15.72:0/1539433325 >> 172.21.15.72:0/1539433325 conn(0x7f40200fd330 msgr2=0x7f40200ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.023+0000 7f4027000640 1 -- 172.21.15.72:0/1539433325 shutdown_connections 2024-03-19T06:19:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.023+0000 7f4027000640 1 -- 172.21.15.72:0/1539433325 wait complete. 2024-03-19T06:19:40.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.024+0000 7f4027000640 1 Processor -- start 2024-03-19T06:19:40.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.024+0000 7f4027000640 1 -- start start 2024-03-19T06:19:40.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.024+0000 7f4027000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4020074790 0x7f40201a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:40.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.024+0000 7f4027000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40200750a0 0x7f40201a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:40.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.024+0000 7f4027000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402019b840 con 0x7f4020074790 2024-03-19T06:19:40.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.024+0000 7f4027000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402019b9b0 con 0x7f40200750a0 2024-03-19T06:19:40.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.025+0000 7f401fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4020074790 0x7f40201a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:40.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.025+0000 7f401fe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4020074790 0x7f40201a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48382/0 (socket says 172.21.15.72:48382) 2024-03-19T06:19:40.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.025+0000 7f401fe00640 1 -- 172.21.15.72:0/526475048 learned_addr learned my addr 172.21.15.72:0/526475048 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:40.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.025+0000 7f401fe00640 1 -- 172.21.15.72:0/526475048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40200750a0 msgr2=0x7f40201a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:40.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.025+0000 7f401fe00640 1 --2- 172.21.15.72:0/526475048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40200750a0 0x7f40201a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.025+0000 7f401fe00640 1 -- 172.21.15.72:0/526475048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4010009900 con 0x7f4020074790 2024-03-19T06:19:40.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.025+0000 7f401fe00640 1 --2- 172.21.15.72:0/526475048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4020074790 0x7f40201a17d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4010000f80 tx=0x7f4010032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:40.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.026+0000 7f401cc00640 1 -- 172.21.15.72:0/526475048 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4010034820 con 0x7f4020074790 2024-03-19T06:19:40.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.026+0000 7f401cc00640 1 -- 172.21.15.72:0/526475048 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4010003e30 con 0x7f4020074790 2024-03-19T06:19:40.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.026+0000 7f4027000640 1 -- 172.21.15.72:0/526475048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402019bc90 con 0x7f4020074790 2024-03-19T06:19:40.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.026+0000 7f401cc00640 1 -- 172.21.15.72:0/526475048 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f401003f440 con 0x7f4020074790 2024-03-19T06:19:40.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.026+0000 7f4027000640 1 -- 172.21.15.72:0/526475048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402019c1f0 con 0x7f4020074790 2024-03-19T06:19:40.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.027+0000 7f4027000640 1 -- 172.21.15.72:0/526475048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402004e000 con 0x7f4020074790 2024-03-19T06:19:40.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.028+0000 7f401cc00640 1 -- 172.21.15.72:0/526475048 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f401003b040 con 0x7f4020074790 2024-03-19T06:19:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.029+0000 7f401cc00640 1 --2- 172.21.15.72:0/526475048 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f400406df10 0x7f40040703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.029+0000 7f401cc00640 1 -- 172.21.15.72:0/526475048 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f40100b0b70 con 0x7f4020074790 2024-03-19T06:19:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.029+0000 7f401f400640 1 --2- 172.21.15.72:0/526475048 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f400406df10 0x7f40040703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:40.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.030+0000 7f401f400640 1 --2- 172.21.15.72:0/526475048 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f400406df10 0x7f40040703c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4020077540 tx=0x7f4008006c90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:40.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.034+0000 7f401cc00640 1 -- 172.21.15.72:0/526475048 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f4010079f90 con 0x7f4020074790 2024-03-19T06:19:40.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.272+0000 7f4027000640 1 -- 172.21.15.72:0/526475048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7f402010d6d0 con 0x7f4020074790 2024-03-19T06:19:40.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.274+0000 7f401cc00640 1 -- 172.21.15.72:0/526475048 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v44) v1 ==== 107+0+4839 (secure 0 0 0) 0x7f401007d650 con 0x7f4020074790 2024-03-19T06:19:40.262 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:40.262 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:03:33.243075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.72:6827/772635337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":772635337},{"type":"v1","addr":"172.21.15.72:6827","nonce":772635337}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24227":{"gid":24227,"name":"cephfs.smithi172.xlokxp","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.172:6825/2806079216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2806079216},{"type":"v1","addr":"172.21.15.172:6825","nonce":2806079216}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:40.263 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 14 2024-03-19T06:19:40.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.277+0000 7f4027000640 1 -- 172.21.15.72:0/526475048 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f400406df10 msgr2=0x7f40040703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.277+0000 7f4027000640 1 --2- 172.21.15.72:0/526475048 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f400406df10 0x7f40040703c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4020077540 tx=0x7f4008006c90 comp rx=0 tx=0).stop 2024-03-19T06:19:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.277+0000 7f4027000640 1 -- 172.21.15.72:0/526475048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4020074790 msgr2=0x7f40201a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.277+0000 7f4027000640 1 --2- 172.21.15.72:0/526475048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4020074790 0x7f40201a17d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4010000f80 tx=0x7f4010032b60 comp rx=0 tx=0).stop 2024-03-19T06:19:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.277+0000 7f4027000640 1 -- 172.21.15.72:0/526475048 shutdown_connections 2024-03-19T06:19:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.277+0000 7f4027000640 1 --2- 172.21.15.72:0/526475048 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f400406df10 0x7f40040703c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.277+0000 7f4027000640 1 --2- 172.21.15.72:0/526475048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40200750a0 0x7f40201a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.277+0000 7f4027000640 1 --2- 172.21.15.72:0/526475048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4020074790 0x7f40201a17d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.277+0000 7f4027000640 1 -- 172.21.15.72:0/526475048 >> 172.21.15.72:0/526475048 conn(0x7f40200fd330 msgr2=0x7f40200fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.277+0000 7f4027000640 1 -- 172.21.15.72:0/526475048 shutdown_connections 2024-03-19T06:19:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.277+0000 7f4027000640 1 -- 172.21.15.72:0/526475048 wait complete. 2024-03-19T06:19:40.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-03-19T06:19:40.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:40 smithi072 ceph-mon[78545]: pgmap v405: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:40.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:40 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/500544838' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-19T06:19:40.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:19:40.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:19:40.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:19:40.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:40 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3331129886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-19T06:19:40.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:19:40.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:40 smithi172 ceph-mon[66682]: pgmap v405: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:40.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:40 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/500544838' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-19T06:19:40.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:19:40.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:19:40.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:19:40.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:40 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3331129886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-19T06:19:40.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:19:40.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.503+0000 7f2d1c400640 1 -- 172.21.15.72:0/607852323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d14105690 msgr2=0x7f2d14105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:40.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.503+0000 7f2d1c400640 1 --2- 172.21.15.72:0/607852323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d14105690 0x7f2d14105a60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009880 tx=0x7f2d0802bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.504+0000 7f2d1c400640 1 -- 172.21.15.72:0/607852323 shutdown_connections 2024-03-19T06:19:40.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.504+0000 7f2d1c400640 1 --2- 172.21.15.72:0/607852323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d14067350 0x7f2d140677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.504+0000 7f2d1c400640 1 --2- 172.21.15.72:0/607852323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d14105690 0x7f2d14105a60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.504+0000 7f2d1c400640 1 -- 172.21.15.72:0/607852323 >> 172.21.15.72:0/607852323 conn(0x7f2d140743d0 msgr2=0x7f2d140747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:40.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.504+0000 7f2d1c400640 1 -- 172.21.15.72:0/607852323 shutdown_connections 2024-03-19T06:19:40.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.504+0000 7f2d1c400640 1 -- 172.21.15.72:0/607852323 wait complete. 2024-03-19T06:19:40.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.505+0000 7f2d1c400640 1 Processor -- start 2024-03-19T06:19:40.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.505+0000 7f2d1c400640 1 -- start start 2024-03-19T06:19:40.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.505+0000 7f2d1c400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d14067350 0x7f2d141975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:40.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.505+0000 7f2d1c400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d14105690 0x7f2d14197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:40.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.505+0000 7f2d1c400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d141981b0 con 0x7f2d14067350 2024-03-19T06:19:40.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.505+0000 7f2d1c400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1419bf10 con 0x7f2d14105690 2024-03-19T06:19:40.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.505+0000 7f2d19a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d14067350 0x7f2d141975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:40.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.505+0000 7f2d19a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d14067350 0x7f2d141975e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48388/0 (socket says 172.21.15.72:48388) 2024-03-19T06:19:40.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.505+0000 7f2d19a00640 1 -- 172.21.15.72:0/3461333665 learned_addr learned my addr 172.21.15.72:0/3461333665 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:40.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.506+0000 7f2d19a00640 1 -- 172.21.15.72:0/3461333665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d14105690 msgr2=0x7f2d14197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:40.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.506+0000 7f2d19a00640 1 --2- 172.21.15.72:0/3461333665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d14105690 0x7f2d14197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.506+0000 7f2d19a00640 1 -- 172.21.15.72:0/3461333665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08009560 con 0x7f2d14067350 2024-03-19T06:19:40.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.506+0000 7f2d19a00640 1 --2- 172.21.15.72:0/3461333665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d14067350 0x7f2d141975e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009230 tx=0x7f2d08004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:40.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.506+0000 7f2d12000640 1 -- 172.21.15.72:0/3461333665 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d080035f0 con 0x7f2d14067350 2024-03-19T06:19:40.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.507+0000 7f2d1c400640 1 -- 172.21.15.72:0/3461333665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1419c190 con 0x7f2d14067350 2024-03-19T06:19:40.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.507+0000 7f2d12000640 1 -- 172.21.15.72:0/3461333665 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d08003c10 con 0x7f2d14067350 2024-03-19T06:19:40.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.507+0000 7f2d12000640 1 -- 172.21.15.72:0/3461333665 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d08034440 con 0x7f2d14067350 2024-03-19T06:19:40.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.507+0000 7f2d1c400640 1 -- 172.21.15.72:0/3461333665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1419c710 con 0x7f2d14067350 2024-03-19T06:19:40.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.508+0000 7f2d1c400640 1 -- 172.21.15.72:0/3461333665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1404e000 con 0x7f2d14067350 2024-03-19T06:19:40.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.510+0000 7f2d12000640 1 -- 172.21.15.72:0/3461333665 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f2d08004fd0 con 0x7f2d14067350 2024-03-19T06:19:40.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.511+0000 7f2d12000640 1 --2- 172.21.15.72:0/3461333665 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2cfc06df10 0x7f2cfc0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:40.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.511+0000 7f2d12000640 1 -- 172.21.15.72:0/3461333665 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2d080b0220 con 0x7f2d14067350 2024-03-19T06:19:40.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.511+0000 7f2d19000640 1 --2- 172.21.15.72:0/3461333665 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2cfc06df10 0x7f2cfc0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:40.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.512+0000 7f2d19000640 1 --2- 172.21.15.72:0/3461333665 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2cfc06df10 0x7f2cfc0703c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d14198b80 tx=0x7f2d00006c90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:40.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.515+0000 7f2d12000640 1 -- 172.21.15.72:0/3461333665 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f2d08079640 con 0x7f2d14067350 2024-03-19T06:19:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.752+0000 7f2d1c400640 1 -- 172.21.15.72:0/3461333665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f2d14198930 con 0x7f2d14067350 2024-03-19T06:19:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.753+0000 7f2d12000640 1 -- 172.21.15.72:0/3461333665 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v44) v1 ==== 107+0+4840 (secure 0 0 0) 0x7f2d0807cd00 con 0x7f2d14067350 2024-03-19T06:19:40.742 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:40.742 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:04:57.207619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.72:6827/772635337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":772635337},{"type":"v1","addr":"172.21.15.72:6827","nonce":772635337}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24227":{"gid":24227,"name":"cephfs.smithi172.xlokxp","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.172:6825/2806079216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2806079216},{"type":"v1","addr":"172.21.15.172:6825","nonce":2806079216}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:40.742 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2024-03-19T06:19:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.756+0000 7f2d1c400640 1 -- 172.21.15.72:0/3461333665 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2cfc06df10 msgr2=0x7f2cfc0703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.756+0000 7f2d1c400640 1 --2- 172.21.15.72:0/3461333665 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2cfc06df10 0x7f2cfc0703c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d14198b80 tx=0x7f2d00006c90 comp rx=0 tx=0).stop 2024-03-19T06:19:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.756+0000 7f2d1c400640 1 -- 172.21.15.72:0/3461333665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d14067350 msgr2=0x7f2d141975e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.756+0000 7f2d1c400640 1 --2- 172.21.15.72:0/3461333665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d14067350 0x7f2d141975e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009230 tx=0x7f2d08004040 comp rx=0 tx=0).stop 2024-03-19T06:19:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.756+0000 7f2d1c400640 1 -- 172.21.15.72:0/3461333665 shutdown_connections 2024-03-19T06:19:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.756+0000 7f2d1c400640 1 --2- 172.21.15.72:0/3461333665 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2cfc06df10 0x7f2cfc0703c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.756+0000 7f2d1c400640 1 --2- 172.21.15.72:0/3461333665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d14105690 0x7f2d14197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.756+0000 7f2d1c400640 1 --2- 172.21.15.72:0/3461333665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d14067350 0x7f2d141975e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.756+0000 7f2d1c400640 1 -- 172.21.15.72:0/3461333665 >> 172.21.15.72:0/3461333665 conn(0x7f2d140743d0 msgr2=0x7f2d140fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.756+0000 7f2d1c400640 1 -- 172.21.15.72:0/3461333665 shutdown_connections 2024-03-19T06:19:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:40.756+0000 7f2d1c400640 1 -- 172.21.15.72:0/3461333665 wait complete. 2024-03-19T06:19:40.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-03-19T06:19:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.032+0000 7f0d59c00640 1 -- 172.21.15.72:0/1867198698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d54072600 msgr2=0x7f0d540729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.032+0000 7f0d59c00640 1 --2- 172.21.15.72:0/1867198698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d54072600 0x7f0d540729d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009c20 tx=0x7f0d4c02c230 comp rx=0 tx=0).stop 2024-03-19T06:19:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.032+0000 7f0d59c00640 1 -- 172.21.15.72:0/1867198698 shutdown_connections 2024-03-19T06:19:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.032+0000 7f0d59c00640 1 --2- 172.21.15.72:0/1867198698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d54072f10 0x7f0d5410b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.032+0000 7f0d59c00640 1 --2- 172.21.15.72:0/1867198698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d54072600 0x7f0d540729d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.032+0000 7f0d59c00640 1 -- 172.21.15.72:0/1867198698 >> 172.21.15.72:0/1867198698 conn(0x7f0d540fafb0 msgr2=0x7f0d540fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.032+0000 7f0d59c00640 1 -- 172.21.15.72:0/1867198698 shutdown_connections 2024-03-19T06:19:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.032+0000 7f0d59c00640 1 -- 172.21.15.72:0/1867198698 wait complete. 2024-03-19T06:19:41.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.033+0000 7f0d59c00640 1 Processor -- start 2024-03-19T06:19:41.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.034+0000 7f0d59c00640 1 -- start start 2024-03-19T06:19:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.034+0000 7f0d59c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d54072600 0x7f0d540ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.034+0000 7f0d59c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d54072f10 0x7f0d540ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.034+0000 7f0d59c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d541035b0 con 0x7f0d54072600 2024-03-19T06:19:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.034+0000 7f0d59c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540ffe90 con 0x7f0d54072f10 2024-03-19T06:19:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.034+0000 7f0d53e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d54072600 0x7f0d540ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.034+0000 7f0d53e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d54072600 0x7f0d540ff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48412/0 (socket says 172.21.15.72:48412) 2024-03-19T06:19:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.034+0000 7f0d53e00640 1 -- 172.21.15.72:0/1010083351 learned_addr learned my addr 172.21.15.72:0/1010083351 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.035+0000 7f0d53e00640 1 -- 172.21.15.72:0/1010083351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d54072f10 msgr2=0x7f0d540ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.035+0000 7f0d53400640 1 --2- 172.21.15.72:0/1010083351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d54072f10 0x7f0d540ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.035+0000 7f0d53e00640 1 --2- 172.21.15.72:0/1010083351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d54072f10 0x7f0d540ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.035+0000 7f0d53e00640 1 -- 172.21.15.72:0/1010083351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c009900 con 0x7f0d54072600 2024-03-19T06:19:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.035+0000 7f0d53e00640 1 --2- 172.21.15.72:0/1010083351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d54072600 0x7f0d540ff410 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c037040 tx=0x7f0d4c034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.035+0000 7f0d50c00640 1 -- 172.21.15.72:0/1010083351 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d4c003b40 con 0x7f0d54072600 2024-03-19T06:19:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.035+0000 7f0d50c00640 1 -- 172.21.15.72:0/1010083351 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d4c032e60 con 0x7f0d54072600 2024-03-19T06:19:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.035+0000 7f0d50c00640 1 -- 172.21.15.72:0/1010083351 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d4c03f440 con 0x7f0d54072600 2024-03-19T06:19:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.035+0000 7f0d59c00640 1 -- 172.21.15.72:0/1010083351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d541000b0 con 0x7f0d54072600 2024-03-19T06:19:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.036+0000 7f0d59c00640 1 -- 172.21.15.72:0/1010083351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d541a5ac0 con 0x7f0d54072600 2024-03-19T06:19:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.037+0000 7f0d59c00640 1 -- 172.21.15.72:0/1010083351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5404e000 con 0x7f0d54072600 2024-03-19T06:19:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.037+0000 7f0d50c00640 1 -- 172.21.15.72:0/1010083351 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f0d4c03b040 con 0x7f0d54072600 2024-03-19T06:19:41.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.038+0000 7f0d50c00640 1 --2- 172.21.15.72:0/1010083351 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f0d3806df10 0x7f0d380703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:41.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.038+0000 7f0d50c00640 1 -- 172.21.15.72:0/1010083351 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0d4c0b09c0 con 0x7f0d54072600 2024-03-19T06:19:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.039+0000 7f0d53400640 1 --2- 172.21.15.72:0/1010083351 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f0d3806df10 0x7f0d380703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.039+0000 7f0d53400640 1 --2- 172.21.15.72:0/1010083351 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f0d3806df10 0x7f0d380703c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d540fc630 tx=0x7f0d3c005c60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.043+0000 7f0d50c00640 1 -- 172.21.15.72:0/1010083351 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f0d4c079e60 con 0x7f0d54072600 2024-03-19T06:19:41.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.279+0000 7f0d59c00640 1 -- 172.21.15.72:0/1010083351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f0d5410e8b0 con 0x7f0d54072600 2024-03-19T06:19:41.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.281+0000 7f0d50c00640 1 -- 172.21.15.72:0/1010083351 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v44) v1 ==== 107+0+4839 (secure 0 0 0) 0x7f0d4c07d520 con 0x7f0d54072600 2024-03-19T06:19:41.270 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:41.270 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:09:23.789448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.72:6827/772635337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":772635337},{"type":"v1","addr":"172.21.15.72:6827","nonce":772635337}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24227":{"gid":24227,"name":"cephfs.smithi172.xlokxp","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.172:6825/2806079216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2806079216},{"type":"v1","addr":"172.21.15.172:6825","nonce":2806079216}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:41.270 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 16 2024-03-19T06:19:41.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.284+0000 7f0d59c00640 1 -- 172.21.15.72:0/1010083351 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f0d3806df10 msgr2=0x7f0d380703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:41.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.284+0000 7f0d59c00640 1 --2- 172.21.15.72:0/1010083351 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f0d3806df10 0x7f0d380703c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d540fc630 tx=0x7f0d3c005c60 comp rx=0 tx=0).stop 2024-03-19T06:19:41.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.284+0000 7f0d59c00640 1 -- 172.21.15.72:0/1010083351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d54072600 msgr2=0x7f0d540ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:41.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.284+0000 7f0d59c00640 1 --2- 172.21.15.72:0/1010083351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d54072600 0x7f0d540ff410 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c037040 tx=0x7f0d4c034670 comp rx=0 tx=0).stop 2024-03-19T06:19:41.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.284+0000 7f0d59c00640 1 -- 172.21.15.72:0/1010083351 shutdown_connections 2024-03-19T06:19:41.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.284+0000 7f0d59c00640 1 --2- 172.21.15.72:0/1010083351 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f0d3806df10 0x7f0d380703c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.284+0000 7f0d59c00640 1 --2- 172.21.15.72:0/1010083351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d54072f10 0x7f0d540ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.284+0000 7f0d59c00640 1 --2- 172.21.15.72:0/1010083351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d54072600 0x7f0d540ff410 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.284+0000 7f0d59c00640 1 -- 172.21.15.72:0/1010083351 >> 172.21.15.72:0/1010083351 conn(0x7f0d540fafb0 msgr2=0x7f0d54105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:41.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.284+0000 7f0d59c00640 1 -- 172.21.15.72:0/1010083351 shutdown_connections 2024-03-19T06:19:41.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.284+0000 7f0d59c00640 1 -- 172.21.15.72:0/1010083351 wait complete. 2024-03-19T06:19:41.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-03-19T06:19:41.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:41 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/526475048' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-03-19T06:19:41.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:41 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3461333665' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-03-19T06:19:41.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:41 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/526475048' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-03-19T06:19:41.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:41 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3461333665' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-03-19T06:19:41.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.515+0000 7f13cbc00640 1 -- 172.21.15.72:0/537031985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c4067c60 msgr2=0x7f13c410bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:41.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.515+0000 7f13cbc00640 1 --2- 172.21.15.72:0/537031985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c4067c60 0x7f13c410bbe0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009880 tx=0x7f13ac02bcf0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.515+0000 7f13cbc00640 1 -- 172.21.15.72:0/537031985 shutdown_connections 2024-03-19T06:19:41.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.515+0000 7f13cbc00640 1 --2- 172.21.15.72:0/537031985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c4067c60 0x7f13c410bbe0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.515+0000 7f13cbc00640 1 --2- 172.21.15.72:0/537031985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13c4067350 0x7f13c4067720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.515+0000 7f13cbc00640 1 -- 172.21.15.72:0/537031985 >> 172.21.15.72:0/537031985 conn(0x7f13c40743d0 msgr2=0x7f13c40747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:41.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.515+0000 7f13cbc00640 1 -- 172.21.15.72:0/537031985 shutdown_connections 2024-03-19T06:19:41.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.515+0000 7f13cbc00640 1 -- 172.21.15.72:0/537031985 wait complete. 2024-03-19T06:19:41.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.517+0000 7f13cbc00640 1 Processor -- start 2024-03-19T06:19:41.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.517+0000 7f13cbc00640 1 -- start start 2024-03-19T06:19:41.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.517+0000 7f13cbc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13c4067350 0x7f13c41975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:41.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.517+0000 7f13cbc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c4067c60 0x7f13c4197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:41.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.517+0000 7f13cbc00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c41981b0 con 0x7f13c4067c60 2024-03-19T06:19:41.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.517+0000 7f13cbc00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c419bf80 con 0x7f13c4067350 2024-03-19T06:19:41.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.517+0000 7f13c3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c4067c60 0x7f13c4197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:41.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.518+0000 7f13c3e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c4067c60 0x7f13c4197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48426/0 (socket says 172.21.15.72:48426) 2024-03-19T06:19:41.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.518+0000 7f13c3e00640 1 -- 172.21.15.72:0/2790349914 learned_addr learned my addr 172.21.15.72:0/2790349914 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:41.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.518+0000 7f13c9200640 1 --2- 172.21.15.72:0/2790349914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13c4067350 0x7f13c41975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:41.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.518+0000 7f13c3e00640 1 -- 172.21.15.72:0/2790349914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13c4067350 msgr2=0x7f13c41975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:41.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.518+0000 7f13c3e00640 1 --2- 172.21.15.72:0/2790349914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13c4067350 0x7f13c41975e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.518+0000 7f13c3e00640 1 -- 172.21.15.72:0/2790349914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac009560 con 0x7f13c4067c60 2024-03-19T06:19:41.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.518+0000 7f13c3e00640 1 --2- 172.21.15.72:0/2790349914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c4067c60 0x7f13c4197b20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f13ac036040 tx=0x7f13ac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:41.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.519+0000 7f13c1600640 1 -- 172.21.15.72:0/2790349914 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13ac0035f0 con 0x7f13c4067c60 2024-03-19T06:19:41.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.519+0000 7f13cbc00640 1 -- 172.21.15.72:0/2790349914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c419c200 con 0x7f13c4067c60 2024-03-19T06:19:41.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.519+0000 7f13c1600640 1 -- 172.21.15.72:0/2790349914 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13ac003c10 con 0x7f13c4067c60 2024-03-19T06:19:41.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.519+0000 7f13cbc00640 1 -- 172.21.15.72:0/2790349914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c419c760 con 0x7f13c4067c60 2024-03-19T06:19:41.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.519+0000 7f13c1600640 1 -- 172.21.15.72:0/2790349914 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13ac046450 con 0x7f13c4067c60 2024-03-19T06:19:41.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.520+0000 7f13cbc00640 1 -- 172.21.15.72:0/2790349914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c404e000 con 0x7f13c4067c60 2024-03-19T06:19:41.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.521+0000 7f13c1600640 1 -- 172.21.15.72:0/2790349914 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f13ac005060 con 0x7f13c4067c60 2024-03-19T06:19:41.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.522+0000 7f13c1600640 1 --2- 172.21.15.72:0/2790349914 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f13a806df10 0x7f13a80703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:41.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.522+0000 7f13c1600640 1 -- 172.21.15.72:0/2790349914 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f13ac0b0680 con 0x7f13c4067c60 2024-03-19T06:19:41.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.522+0000 7f13c9200640 1 --2- 172.21.15.72:0/2790349914 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f13a806df10 0x7f13a80703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:41.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.523+0000 7f13c9200640 1 --2- 172.21.15.72:0/2790349914 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f13a806df10 0x7f13a80703c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f13b4007dc0 tx=0x7f13b40072f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:41.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.526+0000 7f13c1600640 1 -- 172.21.15.72:0/2790349914 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f13ac079a00 con 0x7f13c4067c60 2024-03-19T06:19:41.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.762+0000 7f13cbc00640 1 -- 172.21.15.72:0/2790349914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f13c410eaa0 con 0x7f13c4067c60 2024-03-19T06:19:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.764+0000 7f13c1600640 1 -- 172.21.15.72:0/2790349914 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v44) v1 ==== 107+0+4838 (secure 0 0 0) 0x7f13ac07d0c0 con 0x7f13c4067c60 2024-03-19T06:19:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:41.753 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:10:32.464152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.72:6827/772635337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":772635337},{"type":"v1","addr":"172.21.15.72:6827","nonce":772635337}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24227":{"gid":24227,"name":"cephfs.smithi172.xlokxp","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.172:6825/2806079216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2806079216},{"type":"v1","addr":"172.21.15.172:6825","nonce":2806079216}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:41.753 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2024-03-19T06:19:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.766+0000 7f13cbc00640 1 -- 172.21.15.72:0/2790349914 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f13a806df10 msgr2=0x7f13a80703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.766+0000 7f13cbc00640 1 --2- 172.21.15.72:0/2790349914 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f13a806df10 0x7f13a80703c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f13b4007dc0 tx=0x7f13b40072f0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.766+0000 7f13cbc00640 1 -- 172.21.15.72:0/2790349914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c4067c60 msgr2=0x7f13c4197b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.766+0000 7f13cbc00640 1 --2- 172.21.15.72:0/2790349914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c4067c60 0x7f13c4197b20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f13ac036040 tx=0x7f13ac004270 comp rx=0 tx=0).stop 2024-03-19T06:19:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.767+0000 7f13cbc00640 1 -- 172.21.15.72:0/2790349914 shutdown_connections 2024-03-19T06:19:41.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.767+0000 7f13cbc00640 1 --2- 172.21.15.72:0/2790349914 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f13a806df10 0x7f13a80703c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.767+0000 7f13cbc00640 1 --2- 172.21.15.72:0/2790349914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c4067c60 0x7f13c4197b20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.767+0000 7f13cbc00640 1 --2- 172.21.15.72:0/2790349914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13c4067350 0x7f13c41975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:41.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.767+0000 7f13cbc00640 1 -- 172.21.15.72:0/2790349914 >> 172.21.15.72:0/2790349914 conn(0x7f13c40743d0 msgr2=0x7f13c40fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:41.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.767+0000 7f13cbc00640 1 -- 172.21.15.72:0/2790349914 shutdown_connections 2024-03-19T06:19:41.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:41.767+0000 7f13cbc00640 1 -- 172.21.15.72:0/2790349914 wait complete. 2024-03-19T06:19:41.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-03-19T06:19:42.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.040+0000 7fd7bbc00640 1 -- 172.21.15.72:0/3291437144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b4072f10 msgr2=0x7fd7b4110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:42.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.040+0000 7fd7bbc00640 1 --2- 172.21.15.72:0/3291437144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b4072f10 0x7fd7b4110120 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009c20 tx=0x7fd79c02c230 comp rx=0 tx=0).stop 2024-03-19T06:19:42.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.040+0000 7fd7bbc00640 1 -- 172.21.15.72:0/3291437144 shutdown_connections 2024-03-19T06:19:42.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.040+0000 7fd7bbc00640 1 --2- 172.21.15.72:0/3291437144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b4072f10 0x7fd7b4110120 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.040+0000 7fd7bbc00640 1 --2- 172.21.15.72:0/3291437144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7b4072600 0x7fd7b40729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.040+0000 7fd7bbc00640 1 -- 172.21.15.72:0/3291437144 >> 172.21.15.72:0/3291437144 conn(0x7fd7b40fb170 msgr2=0x7fd7b40fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:42.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.040+0000 7fd7bbc00640 1 -- 172.21.15.72:0/3291437144 shutdown_connections 2024-03-19T06:19:42.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.040+0000 7fd7bbc00640 1 -- 172.21.15.72:0/3291437144 wait complete. 2024-03-19T06:19:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.041+0000 7fd7bbc00640 1 Processor -- start 2024-03-19T06:19:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.041+0000 7fd7bbc00640 1 -- start start 2024-03-19T06:19:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.042+0000 7fd7bbc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b4072600 0x7fd7b41a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.042+0000 7fd7bbc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7b4072f10 0x7fd7b41a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.042+0000 7fd7bbc00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b419b870 con 0x7fd7b4072600 2024-03-19T06:19:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.042+0000 7fd7bbc00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b419b9e0 con 0x7fd7b4072f10 2024-03-19T06:19:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.042+0000 7fd7b9200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b4072600 0x7fd7b41a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.042+0000 7fd7b9200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b4072600 0x7fd7b41a1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48434/0 (socket says 172.21.15.72:48434) 2024-03-19T06:19:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.042+0000 7fd7b9200640 1 -- 172.21.15.72:0/715480678 learned_addr learned my addr 172.21.15.72:0/715480678 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.042+0000 7fd7b9200640 1 -- 172.21.15.72:0/715480678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7b4072f10 msgr2=0x7fd7b41a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.042+0000 7fd7b3e00640 1 --2- 172.21.15.72:0/715480678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7b4072f10 0x7fd7b41a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.042+0000 7fd7b9200640 1 --2- 172.21.15.72:0/715480678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7b4072f10 0x7fd7b41a1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.042+0000 7fd7b9200640 1 -- 172.21.15.72:0/715480678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c009900 con 0x7fd7b4072600 2024-03-19T06:19:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.043+0000 7fd7b9200640 1 --2- 172.21.15.72:0/715480678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b4072600 0x7fd7b41a1800 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400b420 tx=0x7fd7a400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.043+0000 7fd7b1600640 1 -- 172.21.15.72:0/715480678 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a4011800 con 0x7fd7b4072600 2024-03-19T06:19:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.043+0000 7fd7b1600640 1 -- 172.21.15.72:0/715480678 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7a4011e20 con 0x7fd7b4072600 2024-03-19T06:19:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.043+0000 7fd7b1600640 1 -- 172.21.15.72:0/715480678 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a400f2e0 con 0x7fd7b4072600 2024-03-19T06:19:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.043+0000 7fd7bbc00640 1 -- 172.21.15.72:0/715480678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b419bcc0 con 0x7fd7b4072600 2024-03-19T06:19:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.043+0000 7fd7bbc00640 1 -- 172.21.15.72:0/715480678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b419c220 con 0x7fd7b4072600 2024-03-19T06:19:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.044+0000 7fd7bbc00640 1 -- 172.21.15.72:0/715480678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b404e000 con 0x7fd7b4072600 2024-03-19T06:19:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.045+0000 7fd7b1600640 1 -- 172.21.15.72:0/715480678 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fd7a4010380 con 0x7fd7b4072600 2024-03-19T06:19:42.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.046+0000 7fd7b1600640 1 --2- 172.21.15.72:0/715480678 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd79406df10 0x7fd7940703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:42.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.046+0000 7fd7b1600640 1 -- 172.21.15.72:0/715480678 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd7a408d650 con 0x7fd7b4072600 2024-03-19T06:19:42.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.046+0000 7fd7b3e00640 1 --2- 172.21.15.72:0/715480678 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd79406df10 0x7fd7940703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:42.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.047+0000 7fd7b3e00640 1 --2- 172.21.15.72:0/715480678 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd79406df10 0x7fd7940703c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd79c037040 tx=0x7fd79c000f40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:42.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.051+0000 7fd7b1600640 1 -- 172.21.15.72:0/715480678 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fd7a4056af0 con 0x7fd7b4072600 2024-03-19T06:19:42.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.291+0000 7fd7bbc00640 1 -- 172.21.15.72:0/715480678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fd7b419c4f0 con 0x7fd7b4072600 2024-03-19T06:19:42.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.293+0000 7fd7b1600640 1 -- 172.21.15.72:0/715480678 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v44) v1 ==== 107+0+4838 (secure 0 0 0) 0x7fd7a405a1b0 con 0x7fd7b4072600 2024-03-19T06:19:42.282 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:42.282 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:12:40.353828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.72:6827/772635337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":772635337},{"type":"v1","addr":"172.21.15.72:6827","nonce":772635337}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24227":{"gid":24227,"name":"cephfs.smithi172.xlokxp","rank":1,"incarnation":7,"state":"up:active","state_seq":5,"addr":"172.21.15.172:6825/2806079216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2806079216},{"type":"v1","addr":"172.21.15.172:6825","nonce":2806079216}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:42.282 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 18 2024-03-19T06:19:42.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.296+0000 7fd7bbc00640 1 -- 172.21.15.72:0/715480678 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd79406df10 msgr2=0x7fd7940703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:42.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.296+0000 7fd7bbc00640 1 --2- 172.21.15.72:0/715480678 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd79406df10 0x7fd7940703c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd79c037040 tx=0x7fd79c000f40 comp rx=0 tx=0).stop 2024-03-19T06:19:42.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.296+0000 7fd7bbc00640 1 -- 172.21.15.72:0/715480678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b4072600 msgr2=0x7fd7b41a1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:42.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.296+0000 7fd7bbc00640 1 --2- 172.21.15.72:0/715480678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b4072600 0x7fd7b41a1800 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400b420 tx=0x7fd7a400b8e0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.296+0000 7fd7bbc00640 1 -- 172.21.15.72:0/715480678 shutdown_connections 2024-03-19T06:19:42.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.296+0000 7fd7bbc00640 1 --2- 172.21.15.72:0/715480678 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fd79406df10 0x7fd7940703c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.296+0000 7fd7bbc00640 1 --2- 172.21.15.72:0/715480678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7b4072f10 0x7fd7b41a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.296+0000 7fd7bbc00640 1 --2- 172.21.15.72:0/715480678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b4072600 0x7fd7b41a1800 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.296+0000 7fd7bbc00640 1 -- 172.21.15.72:0/715480678 >> 172.21.15.72:0/715480678 conn(0x7fd7b40fb170 msgr2=0x7fd7b4101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:42.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.297+0000 7fd7bbc00640 1 -- 172.21.15.72:0/715480678 shutdown_connections 2024-03-19T06:19:42.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.297+0000 7fd7bbc00640 1 -- 172.21.15.72:0/715480678 wait complete. 2024-03-19T06:19:42.304 DEBUG:tasks.fs:max_mds reduced in epoch 18 2024-03-19T06:19:42.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-03-19T06:19:42.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:42 smithi072 ceph-mon[78545]: pgmap v406: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:42.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:42 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1010083351' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-03-19T06:19:42.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:42 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2790349914' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-03-19T06:19:42.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:42 smithi172 ceph-mon[66682]: pgmap v406: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:42.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:42 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1010083351' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-03-19T06:19:42.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:42 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2790349914' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-03-19T06:19:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.525+0000 7f9a5dc00640 1 -- 172.21.15.72:0/2890191472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a58074790 msgr2=0x7f9a58074b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.525+0000 7f9a5dc00640 1 --2- 172.21.15.72:0/2890191472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a58074790 0x7f9a58074b60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9a48009c20 tx=0x7f9a4802c1b0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.525+0000 7f9a5dc00640 1 -- 172.21.15.72:0/2890191472 shutdown_connections 2024-03-19T06:19:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.525+0000 7f9a5dc00640 1 --2- 172.21.15.72:0/2890191472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a580750a0 0x7f9a5810fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.525+0000 7f9a5dc00640 1 --2- 172.21.15.72:0/2890191472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a58074790 0x7f9a58074b60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.525+0000 7f9a5dc00640 1 -- 172.21.15.72:0/2890191472 >> 172.21.15.72:0/2890191472 conn(0x7f9a580fd390 msgr2=0x7f9a580ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.525+0000 7f9a5dc00640 1 -- 172.21.15.72:0/2890191472 shutdown_connections 2024-03-19T06:19:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.525+0000 7f9a5dc00640 1 -- 172.21.15.72:0/2890191472 wait complete. 2024-03-19T06:19:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.526+0000 7f9a5dc00640 1 Processor -- start 2024-03-19T06:19:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.527+0000 7f9a5dc00640 1 -- start start 2024-03-19T06:19:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.527+0000 7f9a5dc00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a58074790 0x7f9a581a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.527+0000 7f9a5dc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a580750a0 0x7f9a581a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.527+0000 7f9a5dc00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a581a22a0 con 0x7f9a58074790 2024-03-19T06:19:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.527+0000 7f9a5dc00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5819b7a0 con 0x7f9a580750a0 2024-03-19T06:19:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.527+0000 7f9a56a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a58074790 0x7f9a581a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.527+0000 7f9a56a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a58074790 0x7f9a581a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48452/0 (socket says 172.21.15.72:48452) 2024-03-19T06:19:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.527+0000 7f9a56a00640 1 -- 172.21.15.72:0/250525664 learned_addr learned my addr 172.21.15.72:0/250525664 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.528+0000 7f9a56a00640 1 -- 172.21.15.72:0/250525664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a580750a0 msgr2=0x7f9a581a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.528+0000 7f9a56a00640 1 --2- 172.21.15.72:0/250525664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a580750a0 0x7f9a581a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.528+0000 7f9a56a00640 1 -- 172.21.15.72:0/250525664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a48009900 con 0x7f9a58074790 2024-03-19T06:19:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.528+0000 7f9a56a00640 1 --2- 172.21.15.72:0/250525664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a58074790 0x7f9a581a16d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9a48037040 tx=0x7f9a48032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:42.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.528+0000 7f9a4fe00640 1 -- 172.21.15.72:0/250525664 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a48034820 con 0x7f9a58074790 2024-03-19T06:19:42.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.528+0000 7f9a5dc00640 1 -- 172.21.15.72:0/250525664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5819ba80 con 0x7f9a58074790 2024-03-19T06:19:42.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.528+0000 7f9a4fe00640 1 -- 172.21.15.72:0/250525664 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a48003e30 con 0x7f9a58074790 2024-03-19T06:19:42.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.528+0000 7f9a4fe00640 1 -- 172.21.15.72:0/250525664 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a4803f440 con 0x7f9a58074790 2024-03-19T06:19:42.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.528+0000 7f9a5dc00640 1 -- 172.21.15.72:0/250525664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5819bfe0 con 0x7f9a58074790 2024-03-19T06:19:42.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.530+0000 7f9a5dc00640 1 -- 172.21.15.72:0/250525664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5804e000 con 0x7f9a58074790 2024-03-19T06:19:42.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.531+0000 7f9a4fe00640 1 -- 172.21.15.72:0/250525664 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f9a4803b040 con 0x7f9a58074790 2024-03-19T06:19:42.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.531+0000 7f9a4fe00640 1 --2- 172.21.15.72:0/250525664 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9a3c06df10 0x7f9a3c0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:42.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.532+0000 7f9a4fe00640 1 -- 172.21.15.72:0/250525664 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9a480b0e20 con 0x7f9a58074790 2024-03-19T06:19:42.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.532+0000 7f9a4e000640 1 --2- 172.21.15.72:0/250525664 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9a3c06df10 0x7f9a3c0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:42.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.532+0000 7f9a4e000640 1 --2- 172.21.15.72:0/250525664 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9a3c06df10 0x7f9a3c0703c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9a40005fd0 tx=0x7f9a40005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:42.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.536+0000 7f9a4fe00640 1 -- 172.21.15.72:0/250525664 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f9a4807a260 con 0x7f9a58074790 2024-03-19T06:19:42.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.772+0000 7f9a5dc00640 1 -- 172.21.15.72:0/250525664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f9a5810d6d0 con 0x7f9a58074790 2024-03-19T06:19:42.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.773+0000 7f9a4fe00640 1 -- 172.21.15.72:0/250525664 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v44) v1 ==== 107+0+4840 (secure 0 0 0) 0x7f9a4807d920 con 0x7f9a58074790 2024-03-19T06:19:42.762 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:42.762 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:12:41.363653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.72:6827/772635337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":772635337},{"type":"v1","addr":"172.21.15.72:6827","nonce":772635337}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24227":{"gid":24227,"name":"cephfs.smithi172.xlokxp","rank":1,"incarnation":7,"state":"up:stopping","state_seq":5,"addr":"172.21.15.172:6825/2806079216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2806079216},{"type":"v1","addr":"172.21.15.172:6825","nonce":2806079216}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:42.762 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-03-19T06:19:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.776+0000 7f9a5dc00640 1 -- 172.21.15.72:0/250525664 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9a3c06df10 msgr2=0x7f9a3c0703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.776+0000 7f9a5dc00640 1 --2- 172.21.15.72:0/250525664 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9a3c06df10 0x7f9a3c0703c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9a40005fd0 tx=0x7f9a40005850 comp rx=0 tx=0).stop 2024-03-19T06:19:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.776+0000 7f9a5dc00640 1 -- 172.21.15.72:0/250525664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a58074790 msgr2=0x7f9a581a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.776+0000 7f9a5dc00640 1 --2- 172.21.15.72:0/250525664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a58074790 0x7f9a581a16d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9a48037040 tx=0x7f9a48032b60 comp rx=0 tx=0).stop 2024-03-19T06:19:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.776+0000 7f9a5dc00640 1 -- 172.21.15.72:0/250525664 shutdown_connections 2024-03-19T06:19:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.776+0000 7f9a5dc00640 1 --2- 172.21.15.72:0/250525664 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f9a3c06df10 0x7f9a3c0703c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.776+0000 7f9a5dc00640 1 --2- 172.21.15.72:0/250525664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a580750a0 0x7f9a581a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.776+0000 7f9a5dc00640 1 --2- 172.21.15.72:0/250525664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a58074790 0x7f9a581a16d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.776+0000 7f9a5dc00640 1 -- 172.21.15.72:0/250525664 >> 172.21.15.72:0/250525664 conn(0x7f9a580fd390 msgr2=0x7f9a580ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.776+0000 7f9a5dc00640 1 -- 172.21.15.72:0/250525664 shutdown_connections 2024-03-19T06:19:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:42.776+0000 7f9a5dc00640 1 -- 172.21.15.72:0/250525664 wait complete. 2024-03-19T06:19:42.784 DEBUG:tasks.fs:max_mds reduced in epoch 19 2024-03-19T06:19:42.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-03-19T06:19:43.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.058+0000 7f6c0b000640 1 -- 172.21.15.72:0/3166533908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c04101890 msgr2=0x7f6c04101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:43.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.058+0000 7f6c0b000640 1 --2- 172.21.15.72:0/3166533908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c04101890 0x7f6c04101d00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009880 tx=0x7f6bec02bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.058+0000 7f6c0b000640 1 -- 172.21.15.72:0/3166533908 shutdown_connections 2024-03-19T06:19:43.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.058+0000 7f6c0b000640 1 --2- 172.21.15.72:0/3166533908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c04101890 0x7f6c04101d00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.058+0000 7f6c0b000640 1 --2- 172.21.15.72:0/3166533908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c041078a0 0x7f6c04107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.058+0000 7f6c0b000640 1 -- 172.21.15.72:0/3166533908 >> 172.21.15.72:0/3166533908 conn(0x7f6c040fd390 msgr2=0x7f6c040ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:43.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.058+0000 7f6c0b000640 1 -- 172.21.15.72:0/3166533908 shutdown_connections 2024-03-19T06:19:43.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.058+0000 7f6c0b000640 1 -- 172.21.15.72:0/3166533908 wait complete. 2024-03-19T06:19:43.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.059+0000 7f6c0b000640 1 Processor -- start 2024-03-19T06:19:43.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.059+0000 7f6c0b000640 1 -- start start 2024-03-19T06:19:43.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.059+0000 7f6c0b000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c04101890 0x7f6c04197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:43.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.060+0000 7f6c0b000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c041078a0 0x7f6c04197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:43.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.060+0000 7f6c0b000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c041980e0 con 0x7f6c04101890 2024-03-19T06:19:43.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.060+0000 7f6c0b000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0419beb0 con 0x7f6c041078a0 2024-03-19T06:19:43.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.060+0000 7f6c03e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c04101890 0x7f6c04197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:43.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.060+0000 7f6c03e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c04101890 0x7f6c04197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48470/0 (socket says 172.21.15.72:48470) 2024-03-19T06:19:43.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.060+0000 7f6c03e00640 1 -- 172.21.15.72:0/1087916182 learned_addr learned my addr 172.21.15.72:0/1087916182 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:43.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.060+0000 7f6bfb400640 1 --2- 172.21.15.72:0/1087916182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c041078a0 0x7f6c04197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:43.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.060+0000 7f6c03e00640 1 -- 172.21.15.72:0/1087916182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c041078a0 msgr2=0x7f6c04197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:43.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.060+0000 7f6c03e00640 1 --2- 172.21.15.72:0/1087916182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c041078a0 0x7f6c04197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.060+0000 7f6c03e00640 1 -- 172.21.15.72:0/1087916182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec009560 con 0x7f6c04101890 2024-03-19T06:19:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.061+0000 7f6c03e00640 1 --2- 172.21.15.72:0/1087916182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c04101890 0x7f6c04197510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400cc30 tx=0x7f6bf400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.061+0000 7f6c01600640 1 -- 172.21.15.72:0/1087916182 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf4004b20 con 0x7f6c04101890 2024-03-19T06:19:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.061+0000 7f6c01600640 1 -- 172.21.15.72:0/1087916182 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bf4003e50 con 0x7f6c04101890 2024-03-19T06:19:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.061+0000 7f6c01600640 1 -- 172.21.15.72:0/1087916182 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf4004830 con 0x7f6c04101890 2024-03-19T06:19:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.061+0000 7f6c0b000640 1 -- 172.21.15.72:0/1087916182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0419c190 con 0x7f6c04101890 2024-03-19T06:19:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.061+0000 7f6c0b000640 1 -- 172.21.15.72:0/1087916182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0419c770 con 0x7f6c04101890 2024-03-19T06:19:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.062+0000 7f6c0b000640 1 -- 172.21.15.72:0/1087916182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0404e000 con 0x7f6c04101890 2024-03-19T06:19:43.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.063+0000 7f6c01600640 1 -- 172.21.15.72:0/1087916182 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f6bf4004c80 con 0x7f6c04101890 2024-03-19T06:19:43.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.064+0000 7f6c01600640 1 --2- 172.21.15.72:0/1087916182 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6be806df10 0x7f6be80703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:43.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.064+0000 7f6c01600640 1 -- 172.21.15.72:0/1087916182 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6bf408df80 con 0x7f6c04101890 2024-03-19T06:19:43.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.064+0000 7f6bfb400640 1 --2- 172.21.15.72:0/1087916182 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6be806df10 0x7f6be80703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:43.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.065+0000 7f6bfb400640 1 --2- 172.21.15.72:0/1087916182 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6be806df10 0x7f6be80703c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6bec036040 tx=0x7f6bec005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:43.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.069+0000 7f6c01600640 1 -- 172.21.15.72:0/1087916182 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f6bf4057380 con 0x7f6c04101890 2024-03-19T06:19:43.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.305+0000 7f6c0b000640 1 -- 172.21.15.72:0/1087916182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f6c04198860 con 0x7f6c04101890 2024-03-19T06:19:43.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.307+0000 7f6c01600640 1 -- 172.21.15.72:0/1087916182 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v44) v1 ==== 107+0+4841 (secure 0 0 0) 0x7f6bf401d020 con 0x7f6c04101890 2024-03-19T06:19:43.296 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:43.296 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:12:47.467520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.72:6827/772635337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":772635337},{"type":"v1","addr":"172.21.15.72:6827","nonce":772635337}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24227":{"gid":24227,"name":"cephfs.smithi172.xlokxp","rank":1,"incarnation":7,"state":"up:stopping","state_seq":5,"addr":"172.21.15.172:6825/2806079216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2806079216},{"type":"v1","addr":"172.21.15.172:6825","nonce":2806079216}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:43.296 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 20 2024-03-19T06:19:43.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.312+0000 7f6c0b000640 1 -- 172.21.15.72:0/1087916182 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6be806df10 msgr2=0x7f6be80703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:43.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.312+0000 7f6c0b000640 1 --2- 172.21.15.72:0/1087916182 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6be806df10 0x7f6be80703c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6bec036040 tx=0x7f6bec005fd0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.312+0000 7f6c0b000640 1 -- 172.21.15.72:0/1087916182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c04101890 msgr2=0x7f6c04197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:43.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.312+0000 7f6c0b000640 1 --2- 172.21.15.72:0/1087916182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c04101890 0x7f6c04197510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400cc30 tx=0x7f6bf400a620 comp rx=0 tx=0).stop 2024-03-19T06:19:43.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.315+0000 7f6c0b000640 1 -- 172.21.15.72:0/1087916182 shutdown_connections 2024-03-19T06:19:43.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.315+0000 7f6c0b000640 1 --2- 172.21.15.72:0/1087916182 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6be806df10 0x7f6be80703c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.315+0000 7f6c0b000640 1 --2- 172.21.15.72:0/1087916182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c041078a0 0x7f6c04197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.315+0000 7f6c0b000640 1 --2- 172.21.15.72:0/1087916182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c04101890 0x7f6c04197510 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.315+0000 7f6c0b000640 1 -- 172.21.15.72:0/1087916182 >> 172.21.15.72:0/1087916182 conn(0x7f6c040fd390 msgr2=0x7f6c040fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:43.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.315+0000 7f6c0b000640 1 -- 172.21.15.72:0/1087916182 shutdown_connections 2024-03-19T06:19:43.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.315+0000 7f6c0b000640 1 -- 172.21.15.72:0/1087916182 wait complete. 2024-03-19T06:19:43.324 DEBUG:tasks.fs:max_mds reduced in epoch 20 2024-03-19T06:19:43.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-03-19T06:19:43.398 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:43 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/715480678' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-03-19T06:19:43.398 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:43 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/250525664' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-03-19T06:19:43.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:43 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/715480678' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-03-19T06:19:43.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:43 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/250525664' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-03-19T06:19:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.543+0000 7fb7ff400640 1 -- 172.21.15.72:0/3515099589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f8074790 msgr2=0x7fb7f8074b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.543+0000 7fb7ff400640 1 --2- 172.21.15.72:0/3515099589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f8074790 0x7fb7f8074b60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009c20 tx=0x7fb7e802c1b0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.543+0000 7fb7ff400640 1 -- 172.21.15.72:0/3515099589 shutdown_connections 2024-03-19T06:19:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.543+0000 7fb7ff400640 1 --2- 172.21.15.72:0/3515099589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7f80750a0 0x7fb7f810fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.543+0000 7fb7ff400640 1 --2- 172.21.15.72:0/3515099589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f8074790 0x7fb7f8074b60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.543+0000 7fb7ff400640 1 -- 172.21.15.72:0/3515099589 >> 172.21.15.72:0/3515099589 conn(0x7fb7f80fd390 msgr2=0x7fb7f80ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:43.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.543+0000 7fb7ff400640 1 -- 172.21.15.72:0/3515099589 shutdown_connections 2024-03-19T06:19:43.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.543+0000 7fb7ff400640 1 -- 172.21.15.72:0/3515099589 wait complete. 2024-03-19T06:19:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.544+0000 7fb7ff400640 1 Processor -- start 2024-03-19T06:19:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.545+0000 7fb7ff400640 1 -- start start 2024-03-19T06:19:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.545+0000 7fb7ff400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f8074790 0x7fb7f81a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.545+0000 7fb7ff400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7f80750a0 0x7fb7f81a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.545+0000 7fb7ff400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f81a22a0 con 0x7fb7f8074790 2024-03-19T06:19:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.545+0000 7fb7ff400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f819b7a0 con 0x7fb7f80750a0 2024-03-19T06:19:43.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.545+0000 7fb7fca00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f8074790 0x7fb7f81a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.545+0000 7fb7fca00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f8074790 0x7fb7f81a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48490/0 (socket says 172.21.15.72:48490) 2024-03-19T06:19:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.545+0000 7fb7fca00640 1 -- 172.21.15.72:0/3015687073 learned_addr learned my addr 172.21.15.72:0/3015687073 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.546+0000 7fb7f7e00640 1 --2- 172.21.15.72:0/3015687073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7f80750a0 0x7fb7f81a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.546+0000 7fb7fca00640 1 -- 172.21.15.72:0/3015687073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7f80750a0 msgr2=0x7fb7f81a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.546+0000 7fb7fca00640 1 --2- 172.21.15.72:0/3015687073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7f80750a0 0x7fb7f81a1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.546+0000 7fb7fca00640 1 -- 172.21.15.72:0/3015687073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e8009900 con 0x7fb7f8074790 2024-03-19T06:19:43.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.546+0000 7fb7fca00640 1 --2- 172.21.15.72:0/3015687073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f8074790 0x7fb7f81a16d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8000f80 tx=0x7fb7e8032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:43.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.546+0000 7fb7f5600640 1 -- 172.21.15.72:0/3015687073 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7e8034820 con 0x7fb7f8074790 2024-03-19T06:19:43.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.546+0000 7fb7f5600640 1 -- 172.21.15.72:0/3015687073 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7e8003e30 con 0x7fb7f8074790 2024-03-19T06:19:43.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.546+0000 7fb7ff400640 1 -- 172.21.15.72:0/3015687073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f819ba80 con 0x7fb7f8074790 2024-03-19T06:19:43.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.546+0000 7fb7f5600640 1 -- 172.21.15.72:0/3015687073 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7e803f440 con 0x7fb7f8074790 2024-03-19T06:19:43.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.546+0000 7fb7ff400640 1 -- 172.21.15.72:0/3015687073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f819bfe0 con 0x7fb7f8074790 2024-03-19T06:19:43.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.548+0000 7fb7ff400640 1 -- 172.21.15.72:0/3015687073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f804e000 con 0x7fb7f8074790 2024-03-19T06:19:43.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.548+0000 7fb7f5600640 1 -- 172.21.15.72:0/3015687073 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fb7e803b040 con 0x7fb7f8074790 2024-03-19T06:19:43.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.549+0000 7fb7f5600640 1 --2- 172.21.15.72:0/3015687073 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb7dc06df10 0x7fb7dc0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:43.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.549+0000 7fb7f5600640 1 -- 172.21.15.72:0/3015687073 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb7e80b0b70 con 0x7fb7f8074790 2024-03-19T06:19:43.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.550+0000 7fb7f7e00640 1 --2- 172.21.15.72:0/3015687073 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb7dc06df10 0x7fb7dc0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:43.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.550+0000 7fb7f7e00640 1 --2- 172.21.15.72:0/3015687073 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb7dc06df10 0x7fb7dc0703c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb7f819cf90 tx=0x7fb7e0005c60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.554+0000 7fb7f5600640 1 -- 172.21.15.72:0/3015687073 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fb7e8079f90 con 0x7fb7f8074790 2024-03-19T06:19:43.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.792+0000 7fb7ff400640 1 -- 172.21.15.72:0/3015687073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fb7f810d6d0 con 0x7fb7f8074790 2024-03-19T06:19:43.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.793+0000 7fb7f5600640 1 -- 172.21.15.72:0/3015687073 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v44) v1 ==== 107+0+4042 (secure 0 0 0) 0x7fb7f810d6d0 con 0x7fb7f8074790 2024-03-19T06:19:43.782 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:43.782 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:13:12.469582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.72:6827/772635337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":772635337},{"type":"v1","addr":"172.21.15.72:6827","nonce":772635337}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:43.782 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 21 2024-03-19T06:19:43.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.796+0000 7fb7ff400640 1 -- 172.21.15.72:0/3015687073 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb7dc06df10 msgr2=0x7fb7dc0703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:43.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.796+0000 7fb7ff400640 1 --2- 172.21.15.72:0/3015687073 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb7dc06df10 0x7fb7dc0703c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb7f819cf90 tx=0x7fb7e0005c60 comp rx=0 tx=0).stop 2024-03-19T06:19:43.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.796+0000 7fb7ff400640 1 -- 172.21.15.72:0/3015687073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f8074790 msgr2=0x7fb7f81a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:43.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.796+0000 7fb7ff400640 1 --2- 172.21.15.72:0/3015687073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f8074790 0x7fb7f81a16d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8000f80 tx=0x7fb7e8032b60 comp rx=0 tx=0).stop 2024-03-19T06:19:43.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.796+0000 7fb7ff400640 1 -- 172.21.15.72:0/3015687073 shutdown_connections 2024-03-19T06:19:43.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.796+0000 7fb7ff400640 1 --2- 172.21.15.72:0/3015687073 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb7dc06df10 0x7fb7dc0703c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.796+0000 7fb7ff400640 1 --2- 172.21.15.72:0/3015687073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7f80750a0 0x7fb7f81a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.796+0000 7fb7ff400640 1 --2- 172.21.15.72:0/3015687073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f8074790 0x7fb7f81a16d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:43.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.796+0000 7fb7ff400640 1 -- 172.21.15.72:0/3015687073 >> 172.21.15.72:0/3015687073 conn(0x7fb7f80fd390 msgr2=0x7fb7f80ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:43.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.796+0000 7fb7ff400640 1 -- 172.21.15.72:0/3015687073 shutdown_connections 2024-03-19T06:19:43.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:43.796+0000 7fb7ff400640 1 -- 172.21.15.72:0/3015687073 wait complete. 2024-03-19T06:19:43.803 DEBUG:tasks.fs:max_mds reduced in epoch 21 2024-03-19T06:19:43.804 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-03-19T06:19:44.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.027+0000 7f06e6c00640 1 -- 172.21.15.72:0/912816517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e0107840 msgr2=0x7f06e0107c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:44.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.027+0000 7f06e6c00640 1 --2- 172.21.15.72:0/912816517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e0107840 0x7f06e0107c10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009880 tx=0x7f06d002bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.028+0000 7f06e6c00640 1 -- 172.21.15.72:0/912816517 shutdown_connections 2024-03-19T06:19:44.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.028+0000 7f06e6c00640 1 --2- 172.21.15.72:0/912816517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06e0101830 0x7f06e0101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.028+0000 7f06e6c00640 1 --2- 172.21.15.72:0/912816517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e0107840 0x7f06e0107c10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.028+0000 7f06e6c00640 1 -- 172.21.15.72:0/912816517 >> 172.21.15.72:0/912816517 conn(0x7f06e00fd330 msgr2=0x7f06e00ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:44.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.028+0000 7f06e6c00640 1 -- 172.21.15.72:0/912816517 shutdown_connections 2024-03-19T06:19:44.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.028+0000 7f06e6c00640 1 -- 172.21.15.72:0/912816517 wait complete. 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.029+0000 7f06e6c00640 1 Processor -- start 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.029+0000 7f06e6c00640 1 -- start start 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.029+0000 7f06e6c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e0101830 0x7f06e01974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.029+0000 7f06e6c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06e0107840 0x7f06e0197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.029+0000 7f06e6c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e01980a0 con 0x7f06e0101830 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.029+0000 7f06e6c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e019be70 con 0x7f06e0107840 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.029+0000 7f06dfe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e0101830 0x7f06e01974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.029+0000 7f06dfe00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e0101830 0x7f06e01974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54892/0 (socket says 172.21.15.72:54892) 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.029+0000 7f06dfe00640 1 -- 172.21.15.72:0/1978954258 learned_addr learned my addr 172.21.15.72:0/1978954258 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.030+0000 7f06dfe00640 1 -- 172.21.15.72:0/1978954258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06e0107840 msgr2=0x7f06e0197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.030+0000 7f06dfe00640 1 --2- 172.21.15.72:0/1978954258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06e0107840 0x7f06e0197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.030+0000 7f06dfe00640 1 -- 172.21.15.72:0/1978954258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d0009560 con 0x7f06e0101830 2024-03-19T06:19:44.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.030+0000 7f06dfe00640 1 --2- 172.21.15.72:0/1978954258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e0101830 0x7f06e01974d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009230 tx=0x7f06d002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:44.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.030+0000 7f06dcc00640 1 -- 172.21.15.72:0/1978954258 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06d00035f0 con 0x7f06e0101830 2024-03-19T06:19:44.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.030+0000 7f06dcc00640 1 -- 172.21.15.72:0/1978954258 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06d0003c10 con 0x7f06e0101830 2024-03-19T06:19:44.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.030+0000 7f06dcc00640 1 -- 172.21.15.72:0/1978954258 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06d0005690 con 0x7f06e0101830 2024-03-19T06:19:44.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.030+0000 7f06e6c00640 1 -- 172.21.15.72:0/1978954258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e019c0f0 con 0x7f06e0101830 2024-03-19T06:19:44.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.030+0000 7f06e6c00640 1 -- 172.21.15.72:0/1978954258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e019c670 con 0x7f06e0101830 2024-03-19T06:19:44.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.031+0000 7f06e6c00640 1 -- 172.21.15.72:0/1978954258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e004e000 con 0x7f06e0101830 2024-03-19T06:19:44.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.032+0000 7f06dcc00640 1 -- 172.21.15.72:0/1978954258 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f06d0004ed0 con 0x7f06e0101830 2024-03-19T06:19:44.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.033+0000 7f06dcc00640 1 --2- 172.21.15.72:0/1978954258 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f06c406df10 0x7f06c40703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:44.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.033+0000 7f06dcc00640 1 -- 172.21.15.72:0/1978954258 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f06d00b0290 con 0x7f06e0101830 2024-03-19T06:19:44.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.034+0000 7f06df400640 1 --2- 172.21.15.72:0/1978954258 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f06c406df10 0x7f06c40703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:44.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.034+0000 7f06df400640 1 --2- 172.21.15.72:0/1978954258 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f06c406df10 0x7f06c40703c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f06cc005fd0 tx=0x7f06cc005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:44.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.038+0000 7f06dcc00640 1 -- 172.21.15.72:0/1978954258 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f06d0079610 con 0x7f06e0101830 2024-03-19T06:19:44.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.278+0000 7f06e6c00640 1 -- 172.21.15.72:0/1978954258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f06e0109d10 con 0x7f06e0101830 2024-03-19T06:19:44.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.280+0000 7f06dcc00640 1 -- 172.21.15.72:0/1978954258 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v44) v1 ==== 107+0+4824 (secure 0 0 0) 0x7f06d007ccd0 con 0x7f06e0101830 2024-03-19T06:19:44.269 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:44.269 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:13:12.469582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.72:6827/772635337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":772635337},{"type":"v1","addr":"172.21.15.72:6827","nonce":772635337}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:44.269 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2024-03-19T06:19:44.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.283+0000 7f06e6c00640 1 -- 172.21.15.72:0/1978954258 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f06c406df10 msgr2=0x7f06c40703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:44.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.283+0000 7f06e6c00640 1 --2- 172.21.15.72:0/1978954258 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f06c406df10 0x7f06c40703c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f06cc005fd0 tx=0x7f06cc005850 comp rx=0 tx=0).stop 2024-03-19T06:19:44.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.283+0000 7f06e6c00640 1 -- 172.21.15.72:0/1978954258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e0101830 msgr2=0x7f06e01974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:44.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.283+0000 7f06e6c00640 1 --2- 172.21.15.72:0/1978954258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e0101830 0x7f06e01974d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009230 tx=0x7f06d002c850 comp rx=0 tx=0).stop 2024-03-19T06:19:44.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.283+0000 7f06e6c00640 1 -- 172.21.15.72:0/1978954258 shutdown_connections 2024-03-19T06:19:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.283+0000 7f06e6c00640 1 --2- 172.21.15.72:0/1978954258 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f06c406df10 0x7f06c40703c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.283+0000 7f06e6c00640 1 --2- 172.21.15.72:0/1978954258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06e0107840 0x7f06e0197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.283+0000 7f06e6c00640 1 --2- 172.21.15.72:0/1978954258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e0101830 0x7f06e01974d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.283+0000 7f06e6c00640 1 -- 172.21.15.72:0/1978954258 >> 172.21.15.72:0/1978954258 conn(0x7f06e00fd330 msgr2=0x7f06e00fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.283+0000 7f06e6c00640 1 -- 172.21.15.72:0/1978954258 shutdown_connections 2024-03-19T06:19:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.283+0000 7f06e6c00640 1 -- 172.21.15.72:0/1978954258 wait complete. 2024-03-19T06:19:44.290 DEBUG:tasks.fs:max_mds reduced in epoch 22 2024-03-19T06:19:44.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-03-19T06:19:44.368 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:44 smithi072 ceph-mon[78545]: pgmap v407: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:44.368 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:44 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1087916182' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-03-19T06:19:44.368 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:44 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3015687073' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-03-19T06:19:44.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:44 smithi172 ceph-mon[66682]: pgmap v407: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:44.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:44 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1087916182' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-03-19T06:19:44.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:44 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3015687073' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-03-19T06:19:44.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.516+0000 7f58aca00640 1 -- 172.21.15.72:0/4235732850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8101670 msgr2=0x7f58a8101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:44.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.517+0000 7f58aca00640 1 --2- 172.21.15.72:0/4235732850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8101670 0x7f58a8101ae0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5890009880 tx=0x7f589002bcf0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.517+0000 7f58aca00640 1 -- 172.21.15.72:0/4235732850 shutdown_connections 2024-03-19T06:19:44.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.517+0000 7f58aca00640 1 --2- 172.21.15.72:0/4235732850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8101670 0x7f58a8101ae0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.517+0000 7f58aca00640 1 --2- 172.21.15.72:0/4235732850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58a8107680 0x7f58a8107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.517+0000 7f58aca00640 1 -- 172.21.15.72:0/4235732850 >> 172.21.15.72:0/4235732850 conn(0x7f58a80fd170 msgr2=0x7f58a80ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:44.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.517+0000 7f58aca00640 1 -- 172.21.15.72:0/4235732850 shutdown_connections 2024-03-19T06:19:44.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.517+0000 7f58aca00640 1 -- 172.21.15.72:0/4235732850 wait complete. 2024-03-19T06:19:44.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.518+0000 7f58aca00640 1 Processor -- start 2024-03-19T06:19:44.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.518+0000 7f58aca00640 1 -- start start 2024-03-19T06:19:44.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.519+0000 7f58aca00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58a8101670 0x7f58a8197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:44.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.519+0000 7f58aca00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8107680 0x7f58a8197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:44.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.519+0000 7f58aca00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8197e90 con 0x7f58a8107680 2024-03-19T06:19:44.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.519+0000 7f58aca00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8198000 con 0x7f58a8101670 2024-03-19T06:19:44.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.519+0000 7f589de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8107680 0x7f58a8197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:44.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.519+0000 7f589de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8107680 0x7f58a8197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54912/0 (socket says 172.21.15.72:54912) 2024-03-19T06:19:44.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.519+0000 7f589de00640 1 -- 172.21.15.72:0/3890153250 learned_addr learned my addr 172.21.15.72:0/3890153250 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:44.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.519+0000 7f58a6800640 1 --2- 172.21.15.72:0/3890153250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58a8101670 0x7f58a8197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:44.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.519+0000 7f589de00640 1 -- 172.21.15.72:0/3890153250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58a8101670 msgr2=0x7f58a8197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:44.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.519+0000 7f589de00640 1 --2- 172.21.15.72:0/3890153250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58a8101670 0x7f58a8197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.519+0000 7f589de00640 1 -- 172.21.15.72:0/3890153250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009560 con 0x7f58a8107680 2024-03-19T06:19:44.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.520+0000 7f589de00640 1 --2- 172.21.15.72:0/3890153250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8107680 0x7f58a8197890 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5890009230 tx=0x7f5890004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:44.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.520+0000 7f589fe00640 1 -- 172.21.15.72:0/3890153250 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58900035f0 con 0x7f58a8107680 2024-03-19T06:19:44.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.520+0000 7f589fe00640 1 -- 172.21.15.72:0/3890153250 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5890003c10 con 0x7f58a8107680 2024-03-19T06:19:44.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.520+0000 7f58aca00640 1 -- 172.21.15.72:0/3890153250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a819be30 con 0x7f58a8107680 2024-03-19T06:19:44.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.520+0000 7f589fe00640 1 -- 172.21.15.72:0/3890153250 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f589003e460 con 0x7f58a8107680 2024-03-19T06:19:44.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.520+0000 7f58aca00640 1 -- 172.21.15.72:0/3890153250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a819c410 con 0x7f58a8107680 2024-03-19T06:19:44.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.522+0000 7f58aca00640 1 -- 172.21.15.72:0/3890153250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a804e000 con 0x7f58a8107680 2024-03-19T06:19:44.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.522+0000 7f589fe00640 1 -- 172.21.15.72:0/3890153250 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f5890004fd0 con 0x7f58a8107680 2024-03-19T06:19:44.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.523+0000 7f589fe00640 1 --2- 172.21.15.72:0/3890153250 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f588c06df10 0x7f588c0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:44.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.523+0000 7f589fe00640 1 -- 172.21.15.72:0/3890153250 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f58900b05f0 con 0x7f58a8107680 2024-03-19T06:19:44.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.524+0000 7f58a6800640 1 --2- 172.21.15.72:0/3890153250 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f588c06df10 0x7f588c0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:44.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.524+0000 7f58a6800640 1 --2- 172.21.15.72:0/3890153250 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f588c06df10 0x7f588c0703c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58980058c0 tx=0x7f5898005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.529+0000 7f589fe00640 1 -- 172.21.15.72:0/3890153250 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f5890079a90 con 0x7f58a8107680 2024-03-19T06:19:44.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.766+0000 7f58aca00640 1 -- 172.21.15.72:0/3890153250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f58a8109b50 con 0x7f58a8107680 2024-03-19T06:19:44.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.767+0000 7f589fe00640 1 -- 172.21.15.72:0/3890153250 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v44) v1 ==== 107+0+4039 (secure 0 0 0) 0x7f589007d150 con 0x7f58a8107680 2024-03-19T06:19:44.756 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:44.756 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:13:19.631229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:44.757 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 23 2024-03-19T06:19:44.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.770+0000 7f58aca00640 1 -- 172.21.15.72:0/3890153250 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f588c06df10 msgr2=0x7f588c0703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:44.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.770+0000 7f58aca00640 1 --2- 172.21.15.72:0/3890153250 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f588c06df10 0x7f588c0703c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58980058c0 tx=0x7f5898005850 comp rx=0 tx=0).stop 2024-03-19T06:19:44.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.770+0000 7f58aca00640 1 -- 172.21.15.72:0/3890153250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8107680 msgr2=0x7f58a8197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:44.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.770+0000 7f58aca00640 1 --2- 172.21.15.72:0/3890153250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8107680 0x7f58a8197890 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5890009230 tx=0x7f5890004040 comp rx=0 tx=0).stop 2024-03-19T06:19:44.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.771+0000 7f58aca00640 1 -- 172.21.15.72:0/3890153250 shutdown_connections 2024-03-19T06:19:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.771+0000 7f58aca00640 1 --2- 172.21.15.72:0/3890153250 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f588c06df10 0x7f588c0703c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.771+0000 7f58aca00640 1 --2- 172.21.15.72:0/3890153250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a8107680 0x7f58a8197890 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.771+0000 7f58aca00640 1 --2- 172.21.15.72:0/3890153250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58a8101670 0x7f58a8197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.771+0000 7f58aca00640 1 -- 172.21.15.72:0/3890153250 >> 172.21.15.72:0/3890153250 conn(0x7f58a80fd170 msgr2=0x7f58a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.771+0000 7f58aca00640 1 -- 172.21.15.72:0/3890153250 shutdown_connections 2024-03-19T06:19:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.771+0000 7f58aca00640 1 -- 172.21.15.72:0/3890153250 wait complete. 2024-03-19T06:19:44.778 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-03-19T06:19:44.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-03-19T06:19:44.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.994+0000 7f6122e00640 1 -- 172.21.15.72:0/3392497090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0750a0 msgr2=0x7f611c10fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:44.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.994+0000 7f6122e00640 1 --2- 172.21.15.72:0/3392497090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0750a0 0x7f611c10fff0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6104009880 tx=0x7f610402bcf0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.994+0000 7f6122e00640 1 -- 172.21.15.72:0/3392497090 shutdown_connections 2024-03-19T06:19:44.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.994+0000 7f6122e00640 1 --2- 172.21.15.72:0/3392497090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0750a0 0x7f611c10fff0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.994+0000 7f6122e00640 1 --2- 172.21.15.72:0/3392497090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f611c074790 0x7f611c074b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.994+0000 7f6122e00640 1 -- 172.21.15.72:0/3392497090 >> 172.21.15.72:0/3392497090 conn(0x7f611c0fd330 msgr2=0x7f611c0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:44.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.995+0000 7f6122e00640 1 -- 172.21.15.72:0/3392497090 shutdown_connections 2024-03-19T06:19:44.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.995+0000 7f6122e00640 1 -- 172.21.15.72:0/3392497090 wait complete. 2024-03-19T06:19:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.996+0000 7f6122e00640 1 Processor -- start 2024-03-19T06:19:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.996+0000 7f6122e00640 1 -- start start 2024-03-19T06:19:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.996+0000 7f6122e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f611c074790 0x7f611c19b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.996+0000 7f6122e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0750a0 0x7f611c19bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.996+0000 7f6122e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c19c580 con 0x7f611c0750a0 2024-03-19T06:19:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.996+0000 7f6122e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c1a0330 con 0x7f611c074790 2024-03-19T06:19:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.996+0000 7f6113e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0750a0 0x7f611c19bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.996+0000 7f6113e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0750a0 0x7f611c19bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54918/0 (socket says 172.21.15.72:54918) 2024-03-19T06:19:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.996+0000 7f6113e00640 1 -- 172.21.15.72:0/3581785340 learned_addr learned my addr 172.21.15.72:0/3581785340 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.997+0000 7f6113e00640 1 -- 172.21.15.72:0/3581785340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f611c074790 msgr2=0x7f611c19b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.997+0000 7f6113e00640 1 --2- 172.21.15.72:0/3581785340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f611c074790 0x7f611c19b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.997+0000 7f6113e00640 1 -- 172.21.15.72:0/3581785340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6104009560 con 0x7f611c0750a0 2024-03-19T06:19:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.997+0000 7f6113e00640 1 --2- 172.21.15.72:0/3581785340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0750a0 0x7f611c19bea0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f61040099a0 tx=0x7f6104004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.997+0000 7f6119600640 1 -- 172.21.15.72:0/3581785340 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6104004b00 con 0x7f611c0750a0 2024-03-19T06:19:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.997+0000 7f6119600640 1 -- 172.21.15.72:0/3581785340 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6104003c80 con 0x7f611c0750a0 2024-03-19T06:19:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.997+0000 7f6122e00640 1 -- 172.21.15.72:0/3581785340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611c1a05b0 con 0x7f611c0750a0 2024-03-19T06:19:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.997+0000 7f6119600640 1 -- 172.21.15.72:0/3581785340 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f610403e460 con 0x7f611c0750a0 2024-03-19T06:19:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.997+0000 7f6122e00640 1 -- 172.21.15.72:0/3581785340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611c1a0b10 con 0x7f611c0750a0 2024-03-19T06:19:44.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:44.999+0000 7f6122e00640 1 -- 172.21.15.72:0/3581785340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611c04e000 con 0x7f611c0750a0 2024-03-19T06:19:44.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.000+0000 7f6119600640 1 -- 172.21.15.72:0/3581785340 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f6104004fd0 con 0x7f611c0750a0 2024-03-19T06:19:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.000+0000 7f6119600640 1 --2- 172.21.15.72:0/3581785340 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f60fc06df10 0x7f60fc0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.001+0000 7f6119600640 1 -- 172.21.15.72:0/3581785340 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f61040b07a0 con 0x7f611c0750a0 2024-03-19T06:19:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.001+0000 7f611be00640 1 --2- 172.21.15.72:0/3581785340 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f60fc06df10 0x7f60fc0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.001+0000 7f611be00640 1 --2- 172.21.15.72:0/3581785340 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f60fc06df10 0x7f60fc0703c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f610c00a8f0 tx=0x7f610c005bf0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:44.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.005+0000 7f6119600640 1 -- 172.21.15.72:0/3581785340 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f6104079b20 con 0x7f611c0750a0 2024-03-19T06:19:45.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.244+0000 7f6122e00640 1 -- 172.21.15.72:0/3581785340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f611c112f20 con 0x7f611c0750a0 2024-03-19T06:19:45.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.245+0000 7f6119600640 1 -- 172.21.15.72:0/3581785340 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v44) v1 ==== 107+0+4050 (secure 0 0 0) 0x7f610407d1e0 con 0x7f611c0750a0 2024-03-19T06:19:45.234 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:45.234 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:13:19.639089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":0,"incarnation":24,"state":"up:replay","state_seq":3,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:45.234 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 24 2024-03-19T06:19:45.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.248+0000 7f6122e00640 1 -- 172.21.15.72:0/3581785340 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f60fc06df10 msgr2=0x7f60fc0703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:45.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.248+0000 7f6122e00640 1 --2- 172.21.15.72:0/3581785340 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f60fc06df10 0x7f60fc0703c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f610c00a8f0 tx=0x7f610c005bf0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.248+0000 7f6122e00640 1 -- 172.21.15.72:0/3581785340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0750a0 msgr2=0x7f611c19bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:45.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.248+0000 7f6122e00640 1 --2- 172.21.15.72:0/3581785340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0750a0 0x7f611c19bea0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f61040099a0 tx=0x7f6104004270 comp rx=0 tx=0).stop 2024-03-19T06:19:45.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.248+0000 7f6122e00640 1 -- 172.21.15.72:0/3581785340 shutdown_connections 2024-03-19T06:19:45.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.248+0000 7f6122e00640 1 --2- 172.21.15.72:0/3581785340 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f60fc06df10 0x7f60fc0703c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.248+0000 7f6122e00640 1 --2- 172.21.15.72:0/3581785340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0750a0 0x7f611c19bea0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.248+0000 7f6122e00640 1 --2- 172.21.15.72:0/3581785340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f611c074790 0x7f611c19b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.248+0000 7f6122e00640 1 -- 172.21.15.72:0/3581785340 >> 172.21.15.72:0/3581785340 conn(0x7f611c0fd330 msgr2=0x7f611c0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:45.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.248+0000 7f6122e00640 1 -- 172.21.15.72:0/3581785340 shutdown_connections 2024-03-19T06:19:45.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.248+0000 7f6122e00640 1 -- 172.21.15.72:0/3581785340 wait complete. 2024-03-19T06:19:45.255 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-03-19T06:19:45.255 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-03-19T06:19:45.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:45 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1978954258' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-03-19T06:19:45.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:45 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3890153250' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-03-19T06:19:45.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.474+0000 7f4336a00640 1 -- 172.21.15.72:0/3109536565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4330101890 msgr2=0x7f4330101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:45.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.474+0000 7f4336a00640 1 --2- 172.21.15.72:0/3109536565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4330101890 0x7f4330101d00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4318009880 tx=0x7f431802bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.474+0000 7f4336a00640 1 -- 172.21.15.72:0/3109536565 shutdown_connections 2024-03-19T06:19:45.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.474+0000 7f4336a00640 1 --2- 172.21.15.72:0/3109536565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4330101890 0x7f4330101d00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.474+0000 7f4336a00640 1 --2- 172.21.15.72:0/3109536565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43301078a0 0x7f4330107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.474+0000 7f4336a00640 1 -- 172.21.15.72:0/3109536565 >> 172.21.15.72:0/3109536565 conn(0x7f43300fd390 msgr2=0x7f43300ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:45.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.474+0000 7f4336a00640 1 -- 172.21.15.72:0/3109536565 shutdown_connections 2024-03-19T06:19:45.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.474+0000 7f4336a00640 1 -- 172.21.15.72:0/3109536565 wait complete. 2024-03-19T06:19:45.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.475+0000 7f4336a00640 1 Processor -- start 2024-03-19T06:19:45.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.475+0000 7f4336a00640 1 -- start start 2024-03-19T06:19:45.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.475+0000 7f4336a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4330101890 0x7f43301974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:45.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.475+0000 7f4336a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43301078a0 0x7f4330197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:45.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.475+0000 7f4336a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43301980c0 con 0x7f43301078a0 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.475+0000 7f4336a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433019be90 con 0x7f4330101890 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.476+0000 7f4327400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43301078a0 0x7f4330197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.476+0000 7f4327400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43301078a0 0x7f4330197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54946/0 (socket says 172.21.15.72:54946) 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.476+0000 7f4327400640 1 -- 172.21.15.72:0/4261416572 learned_addr learned my addr 172.21.15.72:0/4261416572 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.476+0000 7f4327400640 1 -- 172.21.15.72:0/4261416572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4330101890 msgr2=0x7f43301974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.476+0000 7f4327400640 1 --2- 172.21.15.72:0/4261416572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4330101890 0x7f43301974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.476+0000 7f4327400640 1 -- 172.21.15.72:0/4261416572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4318009560 con 0x7f43301078a0 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.476+0000 7f4327400640 1 --2- 172.21.15.72:0/4261416572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43301078a0 0x7f4330197a30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4318009230 tx=0x7f4318004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.476+0000 7f432d600640 1 -- 172.21.15.72:0/4261416572 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43180035f0 con 0x7f43301078a0 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.477+0000 7f432d600640 1 -- 172.21.15.72:0/4261416572 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4318003c10 con 0x7f43301078a0 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.477+0000 7f4336a00640 1 -- 172.21.15.72:0/4261416572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433019c110 con 0x7f43301078a0 2024-03-19T06:19:45.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.477+0000 7f432d600640 1 -- 172.21.15.72:0/4261416572 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4318005670 con 0x7f43301078a0 2024-03-19T06:19:45.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.477+0000 7f4336a00640 1 -- 172.21.15.72:0/4261416572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433019c690 con 0x7f43301078a0 2024-03-19T06:19:45.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.478+0000 7f4336a00640 1 -- 172.21.15.72:0/4261416572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433004e000 con 0x7f43301078a0 2024-03-19T06:19:45.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.479+0000 7f432d600640 1 -- 172.21.15.72:0/4261416572 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f4318004dd0 con 0x7f43301078a0 2024-03-19T06:19:45.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.480+0000 7f432d600640 1 --2- 172.21.15.72:0/4261416572 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f431406dec0 0x7f4314070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:45.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.480+0000 7f432d600640 1 -- 172.21.15.72:0/4261416572 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f43180b0250 con 0x7f43301078a0 2024-03-19T06:19:45.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.480+0000 7f432fe00640 1 --2- 172.21.15.72:0/4261416572 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f431406dec0 0x7f4314070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:45.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.480+0000 7f432fe00640 1 --2- 172.21.15.72:0/4261416572 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f431406dec0 0x7f4314070370 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f43301029d0 tx=0x7f43200093c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:45.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.485+0000 7f432d600640 1 -- 172.21.15.72:0/4261416572 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f43180795d0 con 0x7f43301078a0 2024-03-19T06:19:45.543 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:45 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1978954258' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-03-19T06:19:45.543 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:45 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3890153250' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-03-19T06:19:45.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.729+0000 7f4336a00640 1 -- 172.21.15.72:0/4261416572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f4330198840 con 0x7f43301078a0 2024-03-19T06:19:45.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.730+0000 7f432d600640 1 -- 172.21.15.72:0/4261416572 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v44) v1 ==== 107+0+4055 (secure 0 0 0) 0x7f431807cc90 con 0x7f43301078a0 2024-03-19T06:19:45.718 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:45.719 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:13:25.680250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":186,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:45.719 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 25 2024-03-19T06:19:45.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.733+0000 7f4336a00640 1 -- 172.21.15.72:0/4261416572 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f431406dec0 msgr2=0x7f4314070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:45.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.733+0000 7f4336a00640 1 --2- 172.21.15.72:0/4261416572 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f431406dec0 0x7f4314070370 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f43301029d0 tx=0x7f43200093c0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.733+0000 7f4336a00640 1 -- 172.21.15.72:0/4261416572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43301078a0 msgr2=0x7f4330197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:45.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.733+0000 7f4336a00640 1 --2- 172.21.15.72:0/4261416572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43301078a0 0x7f4330197a30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4318009230 tx=0x7f4318004040 comp rx=0 tx=0).stop 2024-03-19T06:19:45.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.733+0000 7f4336a00640 1 -- 172.21.15.72:0/4261416572 shutdown_connections 2024-03-19T06:19:45.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.733+0000 7f4336a00640 1 --2- 172.21.15.72:0/4261416572 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f431406dec0 0x7f4314070370 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.733+0000 7f4336a00640 1 --2- 172.21.15.72:0/4261416572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43301078a0 0x7f4330197a30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.733+0000 7f4336a00640 1 --2- 172.21.15.72:0/4261416572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4330101890 0x7f43301974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.733+0000 7f4336a00640 1 -- 172.21.15.72:0/4261416572 >> 172.21.15.72:0/4261416572 conn(0x7f43300fd390 msgr2=0x7f43300fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:45.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.733+0000 7f4336a00640 1 -- 172.21.15.72:0/4261416572 shutdown_connections 2024-03-19T06:19:45.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.733+0000 7f4336a00640 1 -- 172.21.15.72:0/4261416572 wait complete. 2024-03-19T06:19:45.739 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-03-19T06:19:45.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-03-19T06:19:45.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.963+0000 7ff3a2a00640 1 -- 172.21.15.72:0/2586796110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff39c101890 msgr2=0x7ff39c101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:45.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.963+0000 7ff3a2a00640 1 --2- 172.21.15.72:0/2586796110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff39c101890 0x7ff39c101d00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff384009880 tx=0x7ff38402bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.963+0000 7ff3a2a00640 1 -- 172.21.15.72:0/2586796110 shutdown_connections 2024-03-19T06:19:45.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.963+0000 7ff3a2a00640 1 --2- 172.21.15.72:0/2586796110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff39c101890 0x7ff39c101d00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.963+0000 7ff3a2a00640 1 --2- 172.21.15.72:0/2586796110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39c1078a0 0x7ff39c107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.963+0000 7ff3a2a00640 1 -- 172.21.15.72:0/2586796110 >> 172.21.15.72:0/2586796110 conn(0x7ff39c0fd330 msgr2=0x7ff39c0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:45.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.963+0000 7ff3a2a00640 1 -- 172.21.15.72:0/2586796110 shutdown_connections 2024-03-19T06:19:45.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.963+0000 7ff3a2a00640 1 -- 172.21.15.72:0/2586796110 wait complete. 2024-03-19T06:19:45.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.964+0000 7ff3a2a00640 1 Processor -- start 2024-03-19T06:19:45.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.965+0000 7ff3a2a00640 1 -- start start 2024-03-19T06:19:45.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.965+0000 7ff3a2a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff39c101890 0x7ff39c1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:45.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.965+0000 7ff3a2a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39c1078a0 0x7ff39c197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:45.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.965+0000 7ff3a2a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c1980b0 con 0x7ff39c101890 2024-03-19T06:19:45.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.965+0000 7ff3a2a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c19be80 con 0x7ff39c1078a0 2024-03-19T06:19:45.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.965+0000 7ff39be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff39c101890 0x7ff39c1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:45.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.965+0000 7ff39be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff39c101890 0x7ff39c1974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54958/0 (socket says 172.21.15.72:54958) 2024-03-19T06:19:45.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.965+0000 7ff39be00640 1 -- 172.21.15.72:0/1226071650 learned_addr learned my addr 172.21.15.72:0/1226071650 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:45.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.966+0000 7ff393e00640 1 --2- 172.21.15.72:0/1226071650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39c1078a0 0x7ff39c197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:45.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.966+0000 7ff39be00640 1 -- 172.21.15.72:0/1226071650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39c1078a0 msgr2=0x7ff39c197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:45.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.966+0000 7ff39be00640 1 --2- 172.21.15.72:0/1226071650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39c1078a0 0x7ff39c197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:45.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.966+0000 7ff39be00640 1 -- 172.21.15.72:0/1226071650 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff384009560 con 0x7ff39c101890 2024-03-19T06:19:45.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.966+0000 7ff393e00640 1 --2- 172.21.15.72:0/1226071650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39c1078a0 0x7ff39c197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:19:45.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.966+0000 7ff39be00640 1 --2- 172.21.15.72:0/1226071650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff39c101890 0x7ff39c1974e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c8f0 tx=0x7ff38c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:45.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.966+0000 7ff399600640 1 -- 172.21.15.72:0/1226071650 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff38c0041f0 con 0x7ff39c101890 2024-03-19T06:19:45.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.966+0000 7ff399600640 1 -- 172.21.15.72:0/1226071650 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff38c007e70 con 0x7ff39c101890 2024-03-19T06:19:45.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.966+0000 7ff399600640 1 -- 172.21.15.72:0/1226071650 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff38c0049d0 con 0x7ff39c101890 2024-03-19T06:19:45.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.966+0000 7ff3a2a00640 1 -- 172.21.15.72:0/1226071650 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39c19c160 con 0x7ff39c101890 2024-03-19T06:19:45.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.966+0000 7ff3a2a00640 1 -- 172.21.15.72:0/1226071650 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39c19c740 con 0x7ff39c101890 2024-03-19T06:19:45.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.967+0000 7ff3a2a00640 1 -- 172.21.15.72:0/1226071650 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39c04e000 con 0x7ff39c101890 2024-03-19T06:19:45.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.968+0000 7ff399600640 1 -- 172.21.15.72:0/1226071650 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7ff38c004350 con 0x7ff39c101890 2024-03-19T06:19:45.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.969+0000 7ff399600640 1 --2- 172.21.15.72:0/1226071650 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff38006df10 0x7ff3800703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:45.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.969+0000 7ff399600640 1 -- 172.21.15.72:0/1226071650 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff38c08dbb0 con 0x7ff39c101890 2024-03-19T06:19:45.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.970+0000 7ff393e00640 1 --2- 172.21.15.72:0/1226071650 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff38006df10 0x7ff3800703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:45.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.970+0000 7ff393e00640 1 --2- 172.21.15.72:0/1226071650 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff38006df10 0x7ff3800703c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff384036040 tx=0x7ff38402cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:45.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:45.974+0000 7ff399600640 1 -- 172.21.15.72:0/1226071650 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7ff38c056fb0 con 0x7ff39c101890 2024-03-19T06:19:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.220+0000 7ff3a2a00640 1 -- 172.21.15.72:0/1226071650 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7ff39c198830 con 0x7ff39c101890 2024-03-19T06:19:46.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.221+0000 7ff399600640 1 -- 172.21.15.72:0/1226071650 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v44) v1 ==== 107+0+4052 (secure 0 0 0) 0x7ff38c01d090 con 0x7ff39c101890 2024-03-19T06:19:46.210 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:46.210 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:13:26.517004+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":187,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:46.210 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 26 2024-03-19T06:19:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.224+0000 7ff3a2a00640 1 -- 172.21.15.72:0/1226071650 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff38006df10 msgr2=0x7ff3800703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.224+0000 7ff3a2a00640 1 --2- 172.21.15.72:0/1226071650 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff38006df10 0x7ff3800703c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff384036040 tx=0x7ff38402cf90 comp rx=0 tx=0).stop 2024-03-19T06:19:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.224+0000 7ff3a2a00640 1 -- 172.21.15.72:0/1226071650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff39c101890 msgr2=0x7ff39c1974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.224+0000 7ff3a2a00640 1 --2- 172.21.15.72:0/1226071650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff39c101890 0x7ff39c1974e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c8f0 tx=0x7ff38c00cdb0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.224+0000 7ff3a2a00640 1 -- 172.21.15.72:0/1226071650 shutdown_connections 2024-03-19T06:19:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.224+0000 7ff3a2a00640 1 --2- 172.21.15.72:0/1226071650 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff38006df10 0x7ff3800703c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.224+0000 7ff3a2a00640 1 --2- 172.21.15.72:0/1226071650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39c1078a0 0x7ff39c197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.224+0000 7ff3a2a00640 1 --2- 172.21.15.72:0/1226071650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff39c101890 0x7ff39c1974e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.224+0000 7ff3a2a00640 1 -- 172.21.15.72:0/1226071650 >> 172.21.15.72:0/1226071650 conn(0x7ff39c0fd330 msgr2=0x7ff39c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.225+0000 7ff3a2a00640 1 -- 172.21.15.72:0/1226071650 shutdown_connections 2024-03-19T06:19:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.225+0000 7ff3a2a00640 1 -- 172.21.15.72:0/1226071650 wait complete. 2024-03-19T06:19:46.232 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-03-19T06:19:46.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-03-19T06:19:46.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:46 smithi172 ceph-mon[66682]: pgmap v408: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:46.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:46 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3581785340' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-03-19T06:19:46.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:46 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/4261416572' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-03-19T06:19:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.454+0000 7f1bb2600640 1 -- 172.21.15.72:0/1299530689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bac10ac40 msgr2=0x7f1bac10b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.454+0000 7f1bb2600640 1 --2- 172.21.15.72:0/1299530689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bac10ac40 0x7f1bac10b010 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009880 tx=0x7f1b9c02bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.455+0000 7f1bb2600640 1 -- 172.21.15.72:0/1299530689 shutdown_connections 2024-03-19T06:19:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.455+0000 7f1bb2600640 1 --2- 172.21.15.72:0/1299530689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bac106090 0x7f1bac1064e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.455+0000 7f1bb2600640 1 --2- 172.21.15.72:0/1299530689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bac10ac40 0x7f1bac10b010 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.455+0000 7f1bb2600640 1 -- 172.21.15.72:0/1299530689 >> 172.21.15.72:0/1299530689 conn(0x7f1bac075490 msgr2=0x7f1bac0778a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:46.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.455+0000 7f1bb2600640 1 -- 172.21.15.72:0/1299530689 shutdown_connections 2024-03-19T06:19:46.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.455+0000 7f1bb2600640 1 -- 172.21.15.72:0/1299530689 wait complete. 2024-03-19T06:19:46.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.456+0000 7f1bb2600640 1 Processor -- start 2024-03-19T06:19:46.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.456+0000 7f1bb2600640 1 -- start start 2024-03-19T06:19:46.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.456+0000 7f1bb2600640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bac106090 0x7f1bac1a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:46.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.456+0000 7f1bb2600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bac10ac40 0x7f1bac1a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:46.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.456+0000 7f1bb2600640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac19b880 con 0x7f1bac106090 2024-03-19T06:19:46.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.456+0000 7f1bb2600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac19b9f0 con 0x7f1bac10ac40 2024-03-19T06:19:46.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.456+0000 7f1bab400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bac106090 0x7f1bac1a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:46.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.456+0000 7f1bab400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bac106090 0x7f1bac1a1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54988/0 (socket says 172.21.15.72:54988) 2024-03-19T06:19:46.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.456+0000 7f1bab400640 1 -- 172.21.15.72:0/3596908996 learned_addr learned my addr 172.21.15.72:0/3596908996 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:46.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.457+0000 7f1bab400640 1 -- 172.21.15.72:0/3596908996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bac10ac40 msgr2=0x7f1bac1a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:46.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.457+0000 7f1bab400640 1 --2- 172.21.15.72:0/3596908996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bac10ac40 0x7f1bac1a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.457+0000 7f1bab400640 1 -- 172.21.15.72:0/3596908996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c009560 con 0x7f1bac106090 2024-03-19T06:19:46.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.457+0000 7f1bab400640 1 --2- 172.21.15.72:0/3596908996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bac106090 0x7f1bac1a1810 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009230 tx=0x7f1b9c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:46.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.457+0000 7f1ba3e00640 1 -- 172.21.15.72:0/3596908996 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b9c0035f0 con 0x7f1bac106090 2024-03-19T06:19:46.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.457+0000 7f1ba3e00640 1 -- 172.21.15.72:0/3596908996 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b9c003c10 con 0x7f1bac106090 2024-03-19T06:19:46.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.457+0000 7f1bb2600640 1 -- 172.21.15.72:0/3596908996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bac19bc70 con 0x7f1bac106090 2024-03-19T06:19:46.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.457+0000 7f1ba3e00640 1 -- 172.21.15.72:0/3596908996 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b9c034440 con 0x7f1bac106090 2024-03-19T06:19:46.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.457+0000 7f1bb2600640 1 -- 172.21.15.72:0/3596908996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bac19c170 con 0x7f1bac106090 2024-03-19T06:19:46.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.459+0000 7f1bb2600640 1 -- 172.21.15.72:0/3596908996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bac04e000 con 0x7f1bac106090 2024-03-19T06:19:46.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.459+0000 7f1ba3e00640 1 -- 172.21.15.72:0/3596908996 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f1b9c004fd0 con 0x7f1bac106090 2024-03-19T06:19:46.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.461+0000 7f1ba3e00640 1 --2- 172.21.15.72:0/3596908996 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1b9006df10 0x7f1b900703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:46.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.461+0000 7f1ba3e00640 1 -- 172.21.15.72:0/3596908996 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1b9c0b02c0 con 0x7f1bac106090 2024-03-19T06:19:46.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.461+0000 7f1baaa00640 1 --2- 172.21.15.72:0/3596908996 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1b9006df10 0x7f1b900703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:46.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.462+0000 7f1baaa00640 1 --2- 172.21.15.72:0/3596908996 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1b9006df10 0x7f1b900703c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1bac075b40 tx=0x7f1b98006c90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:46.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.466+0000 7f1ba3e00640 1 -- 172.21.15.72:0/3596908996 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f1b9c079640 con 0x7f1bac106090 2024-03-19T06:19:46.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:46 smithi072 ceph-mon[78545]: pgmap v408: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:46.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:46 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3581785340' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-03-19T06:19:46.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:46 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/4261416572' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-03-19T06:19:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.703+0000 7f1bb2600640 1 -- 172.21.15.72:0/3596908996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f1bac19ce60 con 0x7f1bac106090 2024-03-19T06:19:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.704+0000 7f1ba3e00640 1 -- 172.21.15.72:0/3596908996 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v44) v1 ==== 107+0+4052 (secure 0 0 0) 0x7f1b9c07cd00 con 0x7f1bac106090 2024-03-19T06:19:46.693 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:46.693 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:13:27.604181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":0,"incarnation":24,"state":"up:active","state_seq":188,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 27 2024-03-19T06:19:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.707+0000 7f1bb2600640 1 -- 172.21.15.72:0/3596908996 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1b9006df10 msgr2=0x7f1b900703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.707+0000 7f1bb2600640 1 --2- 172.21.15.72:0/3596908996 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1b9006df10 0x7f1b900703c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1bac075b40 tx=0x7f1b98006c90 comp rx=0 tx=0).stop 2024-03-19T06:19:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.707+0000 7f1bb2600640 1 -- 172.21.15.72:0/3596908996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bac106090 msgr2=0x7f1bac1a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.707+0000 7f1bb2600640 1 --2- 172.21.15.72:0/3596908996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bac106090 0x7f1bac1a1810 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009230 tx=0x7f1b9c004040 comp rx=0 tx=0).stop 2024-03-19T06:19:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.707+0000 7f1bb2600640 1 -- 172.21.15.72:0/3596908996 shutdown_connections 2024-03-19T06:19:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.707+0000 7f1bb2600640 1 --2- 172.21.15.72:0/3596908996 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1b9006df10 0x7f1b900703c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.707+0000 7f1bb2600640 1 --2- 172.21.15.72:0/3596908996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bac10ac40 0x7f1bac1a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.707+0000 7f1bb2600640 1 --2- 172.21.15.72:0/3596908996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bac106090 0x7f1bac1a1810 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.707+0000 7f1bb2600640 1 -- 172.21.15.72:0/3596908996 >> 172.21.15.72:0/3596908996 conn(0x7f1bac075490 msgr2=0x7f1bac076010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.708+0000 7f1bb2600640 1 -- 172.21.15.72:0/3596908996 shutdown_connections 2024-03-19T06:19:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.708+0000 7f1bb2600640 1 -- 172.21.15.72:0/3596908996 wait complete. 2024-03-19T06:19:46.715 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-03-19T06:19:46.715 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-03-19T06:19:46.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.942+0000 7ffa73800640 1 -- 172.21.15.72:0/3401128256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa6c1078a0 msgr2=0x7ffa6c107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.942+0000 7ffa73800640 1 --2- 172.21.15.72:0/3401128256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa6c1078a0 0x7ffa6c107c70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009880 tx=0x7ffa6002bcf0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.942+0000 7ffa73800640 1 -- 172.21.15.72:0/3401128256 shutdown_connections 2024-03-19T06:19:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.942+0000 7ffa73800640 1 --2- 172.21.15.72:0/3401128256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa6c101890 0x7ffa6c101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.942+0000 7ffa73800640 1 --2- 172.21.15.72:0/3401128256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa6c1078a0 0x7ffa6c107c70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.942+0000 7ffa73800640 1 -- 172.21.15.72:0/3401128256 >> 172.21.15.72:0/3401128256 conn(0x7ffa6c0fd330 msgr2=0x7ffa6c0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.942+0000 7ffa73800640 1 -- 172.21.15.72:0/3401128256 shutdown_connections 2024-03-19T06:19:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.942+0000 7ffa73800640 1 -- 172.21.15.72:0/3401128256 wait complete. 2024-03-19T06:19:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.943+0000 7ffa73800640 1 Processor -- start 2024-03-19T06:19:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.943+0000 7ffa73800640 1 -- start start 2024-03-19T06:19:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.943+0000 7ffa73800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa6c101890 0x7ffa6c197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.943+0000 7ffa73800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa6c1078a0 0x7ffa6c197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.943+0000 7ffa73800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c198220 con 0x7ffa6c1078a0 2024-03-19T06:19:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.943+0000 7ffa73800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c19bff0 con 0x7ffa6c101890 2024-03-19T06:19:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.944+0000 7ffa6be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa6c1078a0 0x7ffa6c197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.944+0000 7ffa6be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa6c1078a0 0x7ffa6c197b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55006/0 (socket says 172.21.15.72:55006) 2024-03-19T06:19:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.944+0000 7ffa6be00640 1 -- 172.21.15.72:0/3080985107 learned_addr learned my addr 172.21.15.72:0/3080985107 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.944+0000 7ffa6be00640 1 -- 172.21.15.72:0/3080985107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa6c101890 msgr2=0x7ffa6c197650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.944+0000 7ffa70e00640 1 --2- 172.21.15.72:0/3080985107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa6c101890 0x7ffa6c197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.944+0000 7ffa6be00640 1 --2- 172.21.15.72:0/3080985107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa6c101890 0x7ffa6c197650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.944+0000 7ffa6be00640 1 -- 172.21.15.72:0/3080985107 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa60009560 con 0x7ffa6c1078a0 2024-03-19T06:19:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.944+0000 7ffa6be00640 1 --2- 172.21.15.72:0/3080985107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa6c1078a0 0x7ffa6c197b90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800b420 tx=0x7ffa5800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.945+0000 7ffa69600640 1 -- 172.21.15.72:0/3080985107 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa58011800 con 0x7ffa6c1078a0 2024-03-19T06:19:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.945+0000 7ffa69600640 1 -- 172.21.15.72:0/3080985107 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa58011e20 con 0x7ffa6c1078a0 2024-03-19T06:19:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.945+0000 7ffa73800640 1 -- 172.21.15.72:0/3080985107 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c19c2d0 con 0x7ffa6c1078a0 2024-03-19T06:19:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.945+0000 7ffa69600640 1 -- 172.21.15.72:0/3080985107 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa5800f2e0 con 0x7ffa6c1078a0 2024-03-19T06:19:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.945+0000 7ffa73800640 1 -- 172.21.15.72:0/3080985107 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c19c830 con 0x7ffa6c1078a0 2024-03-19T06:19:46.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.946+0000 7ffa73800640 1 -- 172.21.15.72:0/3080985107 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c04e000 con 0x7ffa6c1078a0 2024-03-19T06:19:46.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.947+0000 7ffa69600640 1 -- 172.21.15.72:0/3080985107 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7ffa58010380 con 0x7ffa6c1078a0 2024-03-19T06:19:46.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.948+0000 7ffa69600640 1 --2- 172.21.15.72:0/3080985107 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffa5406df10 0x7ffa540703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:46.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.948+0000 7ffa69600640 1 -- 172.21.15.72:0/3080985107 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ffa5808d7e0 con 0x7ffa6c1078a0 2024-03-19T06:19:46.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.948+0000 7ffa70e00640 1 --2- 172.21.15.72:0/3080985107 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffa5406df10 0x7ffa540703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:46.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.949+0000 7ffa70e00640 1 --2- 172.21.15.72:0/3080985107 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffa5406df10 0x7ffa540703c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffa60036040 tx=0x7ffa60005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:46.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:46.952+0000 7ffa69600640 1 -- 172.21.15.72:0/3080985107 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7ffa58056b60 con 0x7ffa6c1078a0 2024-03-19T06:19:47.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.192+0000 7ffa73800640 1 -- 172.21.15.72:0/3080985107 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7ffa6c10eae0 con 0x7ffa6c1078a0 2024-03-19T06:19:47.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.194+0000 7ffa69600640 1 -- 172.21.15.72:0/3080985107 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v44) v1 ==== 107+0+4865 (secure 0 0 0) 0x7ffa5805a220 con 0x7ffa6c1078a0 2024-03-19T06:19:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:47.182 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:13:27.604181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi072.dvdjwb","rank":0,"incarnation":24,"state":"up:active","state_seq":188,"addr":"172.21.15.72:6829/1218260294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1218260294},{"type":"v1","addr":"172.21.15.72:6829","nonce":1218260294}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:47.183 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 28 2024-03-19T06:19:47.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.197+0000 7ffa73800640 1 -- 172.21.15.72:0/3080985107 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffa5406df10 msgr2=0x7ffa540703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:47.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.197+0000 7ffa73800640 1 --2- 172.21.15.72:0/3080985107 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffa5406df10 0x7ffa540703c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffa60036040 tx=0x7ffa60005fd0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.197+0000 7ffa73800640 1 -- 172.21.15.72:0/3080985107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa6c1078a0 msgr2=0x7ffa6c197b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:47.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.197+0000 7ffa73800640 1 --2- 172.21.15.72:0/3080985107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa6c1078a0 0x7ffa6c197b90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800b420 tx=0x7ffa5800b8e0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.197+0000 7ffa73800640 1 -- 172.21.15.72:0/3080985107 shutdown_connections 2024-03-19T06:19:47.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.197+0000 7ffa73800640 1 --2- 172.21.15.72:0/3080985107 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffa5406df10 0x7ffa540703c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.197+0000 7ffa73800640 1 --2- 172.21.15.72:0/3080985107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa6c1078a0 0x7ffa6c197b90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.197+0000 7ffa73800640 1 --2- 172.21.15.72:0/3080985107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa6c101890 0x7ffa6c197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.197+0000 7ffa73800640 1 -- 172.21.15.72:0/3080985107 >> 172.21.15.72:0/3080985107 conn(0x7ffa6c0fd330 msgr2=0x7ffa6c0fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:47.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.197+0000 7ffa73800640 1 -- 172.21.15.72:0/3080985107 shutdown_connections 2024-03-19T06:19:47.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.197+0000 7ffa73800640 1 -- 172.21.15.72:0/3080985107 wait complete. 2024-03-19T06:19:47.204 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-03-19T06:19:47.204 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-03-19T06:19:47.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:47 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1226071650' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-03-19T06:19:47.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:47 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3596908996' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-03-19T06:19:47.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.425+0000 7fbbc8400640 1 -- 172.21.15.72:0/110483161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbc0067880 msgr2=0x7fbbc0107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:47.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.425+0000 7fbbc8400640 1 --2- 172.21.15.72:0/110483161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbc0067880 0x7fbbc0107af0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009880 tx=0x7fbbb402bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.425+0000 7fbbc8400640 1 -- 172.21.15.72:0/110483161 shutdown_connections 2024-03-19T06:19:47.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.425+0000 7fbbc8400640 1 --2- 172.21.15.72:0/110483161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbc010e2c0 0x7fbbc01106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.425+0000 7fbbc8400640 1 --2- 172.21.15.72:0/110483161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbc0067880 0x7fbbc0107af0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.425+0000 7fbbc8400640 1 -- 172.21.15.72:0/110483161 >> 172.21.15.72:0/110483161 conn(0x7fbbc006bc20 msgr2=0x7fbbc006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:47.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.425+0000 7fbbc8400640 1 -- 172.21.15.72:0/110483161 shutdown_connections 2024-03-19T06:19:47.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.425+0000 7fbbc8400640 1 -- 172.21.15.72:0/110483161 wait complete. 2024-03-19T06:19:47.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.426+0000 7fbbc8400640 1 Processor -- start 2024-03-19T06:19:47.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.426+0000 7fbbc8400640 1 -- start start 2024-03-19T06:19:47.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.427+0000 7fbbc8400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbc0067880 0x7fbbc019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:47.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.427+0000 7fbbc8400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbc010e2c0 0x7fbbc01a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.427+0000 7fbbc8400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc01a0970 con 0x7fbbc0067880 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.427+0000 7fbbc8400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc01a4740 con 0x7fbbc010e2c0 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.427+0000 7fbbc5a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbc0067880 0x7fbbc019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.427+0000 7fbbc5a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbc0067880 0x7fbbc019fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55020/0 (socket says 172.21.15.72:55020) 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.427+0000 7fbbc5a00640 1 -- 172.21.15.72:0/1522405734 learned_addr learned my addr 172.21.15.72:0/1522405734 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.427+0000 7fbbc5a00640 1 -- 172.21.15.72:0/1522405734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbc010e2c0 msgr2=0x7fbbc01a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.427+0000 7fbbc5000640 1 --2- 172.21.15.72:0/1522405734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbc010e2c0 0x7fbbc01a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.427+0000 7fbbc5a00640 1 --2- 172.21.15.72:0/1522405734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbc010e2c0 0x7fbbc01a02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.427+0000 7fbbc5a00640 1 -- 172.21.15.72:0/1522405734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb4009560 con 0x7fbbc0067880 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.428+0000 7fbbc5a00640 1 --2- 172.21.15.72:0/1522405734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbc0067880 0x7fbbc019fda0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4000c00 tx=0x7fbbb402c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.428+0000 7fbbbe000640 1 -- 172.21.15.72:0/1522405734 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbb4004520 con 0x7fbbc0067880 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.428+0000 7fbbbe000640 1 -- 172.21.15.72:0/1522405734 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbbb4003ab0 con 0x7fbbc0067880 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.428+0000 7fbbc8400640 1 -- 172.21.15.72:0/1522405734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc01a49c0 con 0x7fbbc0067880 2024-03-19T06:19:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.428+0000 7fbbbe000640 1 -- 172.21.15.72:0/1522405734 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbb4034440 con 0x7fbbc0067880 2024-03-19T06:19:47.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.428+0000 7fbbc8400640 1 -- 172.21.15.72:0/1522405734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc01a4ec0 con 0x7fbbc0067880 2024-03-19T06:19:47.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.429+0000 7fbbc8400640 1 -- 172.21.15.72:0/1522405734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc004e000 con 0x7fbbc0067880 2024-03-19T06:19:47.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.430+0000 7fbbbe000640 1 -- 172.21.15.72:0/1522405734 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fbbb4003c20 con 0x7fbbc0067880 2024-03-19T06:19:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.431+0000 7fbbbe000640 1 --2- 172.21.15.72:0/1522405734 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbba806df10 0x7fbba80703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.431+0000 7fbbbe000640 1 -- 172.21.15.72:0/1522405734 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fbbb40b00a0 con 0x7fbbc0067880 2024-03-19T06:19:47.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.431+0000 7fbbc5000640 1 --2- 172.21.15.72:0/1522405734 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbba806df10 0x7fbba80703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:47.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.432+0000 7fbbc5000640 1 --2- 172.21.15.72:0/1522405734 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbba806df10 0x7fbba80703c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbc01a13b0 tx=0x7fbbac005ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:47.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.438+0000 7fbbbe000640 1 -- 172.21.15.72:0/1522405734 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fbbb4079540 con 0x7fbbc0067880 2024-03-19T06:19:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:47 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1226071650' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-03-19T06:19:47.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:47 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3596908996' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-03-19T06:19:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.670+0000 7fbbc8400640 1 -- 172.21.15.72:0/1522405734 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fbbc01a10f0 con 0x7fbbc0067880 2024-03-19T06:19:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.671+0000 7fbbbe000640 1 -- 172.21.15.72:0/1522405734 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v44) v1 ==== 107+0+4073 (secure 0 0 0) 0x7fbbb407cc00 con 0x7fbbc0067880 2024-03-19T06:19:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:47.659 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:13:54.895686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:47.660 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 29 2024-03-19T06:19:47.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.673+0000 7fbbc8400640 1 -- 172.21.15.72:0/1522405734 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbba806df10 msgr2=0x7fbba80703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:47.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.673+0000 7fbbc8400640 1 --2- 172.21.15.72:0/1522405734 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbba806df10 0x7fbba80703c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbc01a13b0 tx=0x7fbbac005ed0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.673+0000 7fbbc8400640 1 -- 172.21.15.72:0/1522405734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbc0067880 msgr2=0x7fbbc019fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:47.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.673+0000 7fbbc8400640 1 --2- 172.21.15.72:0/1522405734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbc0067880 0x7fbbc019fda0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4000c00 tx=0x7fbbb402c850 comp rx=0 tx=0).stop 2024-03-19T06:19:47.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.673+0000 7fbbc8400640 1 -- 172.21.15.72:0/1522405734 shutdown_connections 2024-03-19T06:19:47.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.673+0000 7fbbc8400640 1 --2- 172.21.15.72:0/1522405734 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fbba806df10 0x7fbba80703c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.673+0000 7fbbc8400640 1 --2- 172.21.15.72:0/1522405734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbc010e2c0 0x7fbbc01a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.673+0000 7fbbc8400640 1 --2- 172.21.15.72:0/1522405734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbc0067880 0x7fbbc019fda0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.673+0000 7fbbc8400640 1 -- 172.21.15.72:0/1522405734 >> 172.21.15.72:0/1522405734 conn(0x7fbbc006bc20 msgr2=0x7fbbc0070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:47.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.673+0000 7fbbc8400640 1 -- 172.21.15.72:0/1522405734 shutdown_connections 2024-03-19T06:19:47.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.673+0000 7fbbc8400640 1 -- 172.21.15.72:0/1522405734 wait complete. 2024-03-19T06:19:47.681 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-03-19T06:19:47.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-03-19T06:19:47.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.896+0000 7fe6c3200640 1 -- 172.21.15.72:0/2168238828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c410bb60 msgr2=0x7fe6c410bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.896+0000 7fe6c3200640 1 --2- 172.21.15.72:0/2168238828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c410bb60 0x7fe6c410bf30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009880 tx=0x7fe6b402bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.896+0000 7fe6c3200640 1 -- 172.21.15.72:0/2168238828 shutdown_connections 2024-03-19T06:19:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.896+0000 7fe6c3200640 1 --2- 172.21.15.72:0/2168238828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c4106090 0x7fe6c41064e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.896+0000 7fe6c3200640 1 --2- 172.21.15.72:0/2168238828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c410bb60 0x7fe6c410bf30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.896+0000 7fe6c3200640 1 -- 172.21.15.72:0/2168238828 >> 172.21.15.72:0/2168238828 conn(0x7fe6c4075260 msgr2=0x7fe6c4077670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.896+0000 7fe6c3200640 1 -- 172.21.15.72:0/2168238828 shutdown_connections 2024-03-19T06:19:47.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.896+0000 7fe6c3200640 1 -- 172.21.15.72:0/2168238828 wait complete. 2024-03-19T06:19:47.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.897+0000 7fe6c3200640 1 Processor -- start 2024-03-19T06:19:47.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.897+0000 7fe6c3200640 1 -- start start 2024-03-19T06:19:47.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.897+0000 7fe6c3200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c4106090 0x7fe6c41a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:47.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.897+0000 7fe6c3200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c410bb60 0x7fe6c41a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:47.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.897+0000 7fe6c3200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c419b5e0 con 0x7fe6c410bb60 2024-03-19T06:19:47.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.897+0000 7fe6c3200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c419b750 con 0x7fe6c4106090 2024-03-19T06:19:47.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.898+0000 7fe6c1400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c410bb60 0x7fe6c41a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:47.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.898+0000 7fe6c1400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c410bb60 0x7fe6c41a1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55044/0 (socket says 172.21.15.72:55044) 2024-03-19T06:19:47.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.898+0000 7fe6c1400640 1 -- 172.21.15.72:0/1536547293 learned_addr learned my addr 172.21.15.72:0/1536547293 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.898+0000 7fe6c1e00640 1 --2- 172.21.15.72:0/1536547293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c4106090 0x7fe6c41a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.898+0000 7fe6c1400640 1 -- 172.21.15.72:0/1536547293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c4106090 msgr2=0x7fe6c41a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.898+0000 7fe6c1400640 1 --2- 172.21.15.72:0/1536547293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c4106090 0x7fe6c41a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.898+0000 7fe6c1400640 1 -- 172.21.15.72:0/1536547293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b4009560 con 0x7fe6c410bb60 2024-03-19T06:19:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.898+0000 7fe6c1400640 1 --2- 172.21.15.72:0/1536547293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c410bb60 0x7fe6c41a1ab0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00c8f0 tx=0x7fe6ac00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.899+0000 7fe6baa00640 1 -- 172.21.15.72:0/1536547293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ac007b80 con 0x7fe6c410bb60 2024-03-19T06:19:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.899+0000 7fe6baa00640 1 -- 172.21.15.72:0/1536547293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe6ac0054e0 con 0x7fe6c410bb60 2024-03-19T06:19:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.899+0000 7fe6c3200640 1 -- 172.21.15.72:0/1536547293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c419ba30 con 0x7fe6c410bb60 2024-03-19T06:19:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.899+0000 7fe6baa00640 1 -- 172.21.15.72:0/1536547293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ac00f450 con 0x7fe6c410bb60 2024-03-19T06:19:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.899+0000 7fe6c3200640 1 -- 172.21.15.72:0/1536547293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c419bf90 con 0x7fe6c410bb60 2024-03-19T06:19:47.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.900+0000 7fe6c3200640 1 -- 172.21.15.72:0/1536547293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c404e000 con 0x7fe6c410bb60 2024-03-19T06:19:47.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.901+0000 7fe6baa00640 1 -- 172.21.15.72:0/1536547293 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fe6ac004f60 con 0x7fe6c410bb60 2024-03-19T06:19:47.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.902+0000 7fe6baa00640 1 --2- 172.21.15.72:0/1536547293 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe6a806df10 0x7fe6a80703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:47.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.902+0000 7fe6baa00640 1 -- 172.21.15.72:0/1536547293 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe6ac08dca0 con 0x7fe6c410bb60 2024-03-19T06:19:47.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.902+0000 7fe6c1e00640 1 --2- 172.21.15.72:0/1536547293 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe6a806df10 0x7fe6a80703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:47.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.902+0000 7fe6c1e00640 1 --2- 172.21.15.72:0/1536547293 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe6a806df10 0x7fe6a80703c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4036040 tx=0x7fe6b4005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:47.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:47.907+0000 7fe6baa00640 1 -- 172.21.15.72:0/1536547293 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fe6ac057020 con 0x7fe6c410bb60 2024-03-19T06:19:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.133+0000 7fe6c3200640 1 -- 172.21.15.72:0/1536547293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fe6c410df10 con 0x7fe6c410bb60 2024-03-19T06:19:48.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.134+0000 7fe6baa00640 1 -- 172.21.15.72:0/1536547293 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v44) v1 ==== 107+0+4084 (secure 0 0 0) 0x7fe6ac05a6e0 con 0x7fe6c410bb60 2024-03-19T06:19:48.123 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:48.123 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:13:54.906431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":0,"incarnation":30,"state":"up:replay","state_seq":2,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 30 2024-03-19T06:19:48.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.137+0000 7fe6c3200640 1 -- 172.21.15.72:0/1536547293 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe6a806df10 msgr2=0x7fe6a80703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:48.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.137+0000 7fe6c3200640 1 --2- 172.21.15.72:0/1536547293 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe6a806df10 0x7fe6a80703c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4036040 tx=0x7fe6b4005fd0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.137+0000 7fe6c3200640 1 -- 172.21.15.72:0/1536547293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c410bb60 msgr2=0x7fe6c41a1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:48.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.137+0000 7fe6c3200640 1 --2- 172.21.15.72:0/1536547293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c410bb60 0x7fe6c41a1ab0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00c8f0 tx=0x7fe6ac00cdb0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.137+0000 7fe6c3200640 1 -- 172.21.15.72:0/1536547293 shutdown_connections 2024-03-19T06:19:48.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.137+0000 7fe6c3200640 1 --2- 172.21.15.72:0/1536547293 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe6a806df10 0x7fe6a80703c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.137+0000 7fe6c3200640 1 --2- 172.21.15.72:0/1536547293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c410bb60 0x7fe6c41a1ab0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.137+0000 7fe6c3200640 1 --2- 172.21.15.72:0/1536547293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c4106090 0x7fe6c41a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.137+0000 7fe6c3200640 1 -- 172.21.15.72:0/1536547293 >> 172.21.15.72:0/1536547293 conn(0x7fe6c4075260 msgr2=0x7fe6c4076d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:48.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.137+0000 7fe6c3200640 1 -- 172.21.15.72:0/1536547293 shutdown_connections 2024-03-19T06:19:48.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.137+0000 7fe6c3200640 1 -- 172.21.15.72:0/1536547293 wait complete. 2024-03-19T06:19:48.143 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-03-19T06:19:48.144 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-03-19T06:19:48.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:48 smithi072 ceph-mon[78545]: pgmap v409: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:48.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:48 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3080985107' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-03-19T06:19:48.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:48 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1522405734' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-03-19T06:19:48.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.362+0000 7f347ee00640 1 -- 172.21.15.72:0/3882255767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34780ff870 msgr2=0x7f34780ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:48.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.362+0000 7f347ee00640 1 --2- 172.21.15.72:0/3882255767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34780ff870 0x7f34780ffce0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3468009880 tx=0x7f346802bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.362+0000 7f347ee00640 1 -- 172.21.15.72:0/3882255767 shutdown_connections 2024-03-19T06:19:48.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.362+0000 7f347ee00640 1 --2- 172.21.15.72:0/3882255767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34780ff870 0x7f34780ffce0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.362+0000 7f347ee00640 1 --2- 172.21.15.72:0/3882255767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3478105880 0x7f3478105c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.362+0000 7f347ee00640 1 -- 172.21.15.72:0/3882255767 >> 172.21.15.72:0/3882255767 conn(0x7f34780fb370 msgr2=0x7f34780fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:48.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.362+0000 7f347ee00640 1 -- 172.21.15.72:0/3882255767 shutdown_connections 2024-03-19T06:19:48.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.362+0000 7f347ee00640 1 -- 172.21.15.72:0/3882255767 wait complete. 2024-03-19T06:19:48.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.363+0000 7f347ee00640 1 Processor -- start 2024-03-19T06:19:48.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.363+0000 7f347ee00640 1 -- start start 2024-03-19T06:19:48.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.363+0000 7f347ee00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34780ff870 0x7f3478072560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:48.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.363+0000 7f347ee00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3478105880 0x7f3478072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:48.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.363+0000 7f347ee00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3478072fe0 con 0x7f3478105880 2024-03-19T06:19:48.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.363+0000 7f347ee00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3478073150 con 0x7f34780ff870 2024-03-19T06:19:48.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.364+0000 7f3477400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3478105880 0x7f3478072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:48.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.364+0000 7f3477400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3478105880 0x7f3478072aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55056/0 (socket says 172.21.15.72:55056) 2024-03-19T06:19:48.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.364+0000 7f3477400640 1 -- 172.21.15.72:0/812443735 learned_addr learned my addr 172.21.15.72:0/812443735 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:48.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.364+0000 7f3477400640 1 -- 172.21.15.72:0/812443735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34780ff870 msgr2=0x7f3478072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:48.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.364+0000 7f3477400640 1 --2- 172.21.15.72:0/812443735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34780ff870 0x7f3478072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.364+0000 7f3477400640 1 -- 172.21.15.72:0/812443735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3468009560 con 0x7f3478105880 2024-03-19T06:19:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.364+0000 7f3477400640 1 --2- 172.21.15.72:0/812443735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3478105880 0x7f3478072aa0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3468000c00 tx=0x7f3468004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.365+0000 7f3474c00640 1 -- 172.21.15.72:0/812443735 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34680037c0 con 0x7f3478105880 2024-03-19T06:19:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.365+0000 7f3474c00640 1 -- 172.21.15.72:0/812443735 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3468003de0 con 0x7f3478105880 2024-03-19T06:19:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.365+0000 7f3474c00640 1 -- 172.21.15.72:0/812443735 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3468034460 con 0x7f3478105880 2024-03-19T06:19:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.365+0000 7f347ee00640 1 -- 172.21.15.72:0/812443735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3478073370 con 0x7f3478105880 2024-03-19T06:19:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.365+0000 7f347ee00640 1 -- 172.21.15.72:0/812443735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34781a1b70 con 0x7f3478105880 2024-03-19T06:19:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.366+0000 7f347ee00640 1 -- 172.21.15.72:0/812443735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347804e000 con 0x7f3478105880 2024-03-19T06:19:48.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.368+0000 7f3474c00640 1 -- 172.21.15.72:0/812443735 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f3468003920 con 0x7f3478105880 2024-03-19T06:19:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.369+0000 7f3474c00640 1 --2- 172.21.15.72:0/812443735 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f345c06df10 0x7f345c0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.369+0000 7f3474c00640 1 -- 172.21.15.72:0/812443735 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f34680b0260 con 0x7f3478105880 2024-03-19T06:19:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.369+0000 7f3477e00640 1 --2- 172.21.15.72:0/812443735 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f345c06df10 0x7f345c0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:48.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.370+0000 7f3477e00640 1 --2- 172.21.15.72:0/812443735 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f345c06df10 0x7f345c0703c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f34781009b0 tx=0x7f3460006c90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:48.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.374+0000 7f3474c00640 1 -- 172.21.15.72:0/812443735 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f3468079760 con 0x7f3478105880 2024-03-19T06:19:48.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:48 smithi172 ceph-mon[66682]: pgmap v409: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:48.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:48 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3080985107' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-03-19T06:19:48.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:48 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1522405734' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-03-19T06:19:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.612+0000 7f347ee00640 1 -- 172.21.15.72:0/812443735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f3478066860 con 0x7f3478105880 2024-03-19T06:19:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.613+0000 7f3474c00640 1 -- 172.21.15.72:0/812443735 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v44) v1 ==== 107+0+4089 (secure 0 0 0) 0x7f346807ce20 con 0x7f3478105880 2024-03-19T06:19:48.600 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:48.601 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:14:00.936953+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":194,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 31 2024-03-19T06:19:48.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.615+0000 7f347ee00640 1 -- 172.21.15.72:0/812443735 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f345c06df10 msgr2=0x7f345c0703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:48.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.615+0000 7f347ee00640 1 --2- 172.21.15.72:0/812443735 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f345c06df10 0x7f345c0703c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f34781009b0 tx=0x7f3460006c90 comp rx=0 tx=0).stop 2024-03-19T06:19:48.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.615+0000 7f347ee00640 1 -- 172.21.15.72:0/812443735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3478105880 msgr2=0x7f3478072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:48.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.615+0000 7f347ee00640 1 --2- 172.21.15.72:0/812443735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3478105880 0x7f3478072aa0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3468000c00 tx=0x7f3468004270 comp rx=0 tx=0).stop 2024-03-19T06:19:48.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.616+0000 7f347ee00640 1 -- 172.21.15.72:0/812443735 shutdown_connections 2024-03-19T06:19:48.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.616+0000 7f347ee00640 1 --2- 172.21.15.72:0/812443735 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f345c06df10 0x7f345c0703c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.616+0000 7f347ee00640 1 --2- 172.21.15.72:0/812443735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3478105880 0x7f3478072aa0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.616+0000 7f347ee00640 1 --2- 172.21.15.72:0/812443735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34780ff870 0x7f3478072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.616+0000 7f347ee00640 1 -- 172.21.15.72:0/812443735 >> 172.21.15.72:0/812443735 conn(0x7f34780fb370 msgr2=0x7f34780fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:48.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.616+0000 7f347ee00640 1 -- 172.21.15.72:0/812443735 shutdown_connections 2024-03-19T06:19:48.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.616+0000 7f347ee00640 1 -- 172.21.15.72:0/812443735 wait complete. 2024-03-19T06:19:48.621 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-03-19T06:19:48.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-03-19T06:19:48.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.847+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1573593018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad0101330 msgr2=0x7f2ad0109820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:48.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.847+0000 7f2ad7c00640 1 --2- 172.21.15.72:0/1573593018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad0101330 0x7f2ad0109820 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0098b0 tx=0x7f2abc02bd60 comp rx=0 tx=0).stop 2024-03-19T06:19:48.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.847+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1573593018 shutdown_connections 2024-03-19T06:19:48.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.847+0000 7f2ad7c00640 1 --2- 172.21.15.72:0/1573593018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad0101330 0x7f2ad0109820 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.847+0000 7f2ad7c00640 1 --2- 172.21.15.72:0/1573593018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ad0100a20 0x7f2ad0100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.847+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1573593018 >> 172.21.15.72:0/1573593018 conn(0x7f2ad00fa250 msgr2=0x7f2ad00fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:48.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.847+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1573593018 shutdown_connections 2024-03-19T06:19:48.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.847+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1573593018 wait complete. 2024-03-19T06:19:48.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.848+0000 7f2ad7c00640 1 Processor -- start 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.848+0000 7f2ad7c00640 1 -- start start 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.848+0000 7f2ad7c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad0100a20 0x7f2ad019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.848+0000 7f2ad7c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ad0101330 0x7f2ad019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.848+0000 7f2ad7c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad01976a0 con 0x7f2ad0100a20 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.848+0000 7f2ad7c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0197810 con 0x7f2ad0101330 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.849+0000 7f2ad5200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad0100a20 0x7f2ad019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.849+0000 7f2ad5200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad0100a20 0x7f2ad019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55076/0 (socket says 172.21.15.72:55076) 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.849+0000 7f2ad5200640 1 -- 172.21.15.72:0/1795538540 learned_addr learned my addr 172.21.15.72:0/1795538540 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.849+0000 7f2ad5200640 1 -- 172.21.15.72:0/1795538540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ad0101330 msgr2=0x7f2ad019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.849+0000 7f2ad5200640 1 --2- 172.21.15.72:0/1795538540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ad0101330 0x7f2ad019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.849+0000 7f2ad5200640 1 -- 172.21.15.72:0/1795538540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc009560 con 0x7f2ad0100a20 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.849+0000 7f2ad5200640 1 --2- 172.21.15.72:0/1795538540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad0100a20 0x7f2ad019d630 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400b420 tx=0x7f2ac400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.850+0000 7f2acd600640 1 -- 172.21.15.72:0/1795538540 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac4011800 con 0x7f2ad0100a20 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.850+0000 7f2acd600640 1 -- 172.21.15.72:0/1795538540 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ac4011e20 con 0x7f2ad0100a20 2024-03-19T06:19:48.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.850+0000 7f2acd600640 1 -- 172.21.15.72:0/1795538540 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac400f2e0 con 0x7f2ad0100a20 2024-03-19T06:19:48.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.850+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1795538540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad0197af0 con 0x7f2ad0100a20 2024-03-19T06:19:48.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.850+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1795538540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad0198050 con 0x7f2ad0100a20 2024-03-19T06:19:48.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.851+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1795538540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad004e000 con 0x7f2ad0100a20 2024-03-19T06:19:48.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.852+0000 7f2acd600640 1 -- 172.21.15.72:0/1795538540 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f2ac4010380 con 0x7f2ad0100a20 2024-03-19T06:19:48.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.853+0000 7f2acd600640 1 --2- 172.21.15.72:0/1795538540 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2ab806df10 0x7f2ab80703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:48.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.853+0000 7f2acd600640 1 -- 172.21.15.72:0/1795538540 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2ac408d650 con 0x7f2ad0100a20 2024-03-19T06:19:48.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.853+0000 7f2acfe00640 1 --2- 172.21.15.72:0/1795538540 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2ab806df10 0x7f2ab80703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:48.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.854+0000 7f2acfe00640 1 --2- 172.21.15.72:0/1795538540 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2ab806df10 0x7f2ab80703c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2abc036040 tx=0x7f2abc000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:48.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:48.857+0000 7f2acd600640 1 -- 172.21.15.72:0/1795538540 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f2ac4056af0 con 0x7f2ad0100a20 2024-03-19T06:19:49.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.093+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1795538540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f2ad0066860 con 0x7f2ad0100a20 2024-03-19T06:19:49.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.094+0000 7f2acd600640 1 -- 172.21.15.72:0/1795538540 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v44) v1 ==== 107+0+4086 (secure 0 0 0) 0x7f2ac405a1b0 con 0x7f2ad0100a20 2024-03-19T06:19:49.082 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:49.082 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:14:01.445290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":195,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:49.082 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 32 2024-03-19T06:19:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.097+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1795538540 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2ab806df10 msgr2=0x7f2ab80703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.097+0000 7f2ad7c00640 1 --2- 172.21.15.72:0/1795538540 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2ab806df10 0x7f2ab80703c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2abc036040 tx=0x7f2abc000bc0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.097+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1795538540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad0100a20 msgr2=0x7f2ad019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.097+0000 7f2ad7c00640 1 --2- 172.21.15.72:0/1795538540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad0100a20 0x7f2ad019d630 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400b420 tx=0x7f2ac400b8e0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.097+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1795538540 shutdown_connections 2024-03-19T06:19:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.097+0000 7f2ad7c00640 1 --2- 172.21.15.72:0/1795538540 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2ab806df10 0x7f2ab80703c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.097+0000 7f2ad7c00640 1 --2- 172.21.15.72:0/1795538540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ad0101330 0x7f2ad019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.097+0000 7f2ad7c00640 1 --2- 172.21.15.72:0/1795538540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad0100a20 0x7f2ad019d630 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.097+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1795538540 >> 172.21.15.72:0/1795538540 conn(0x7f2ad00fa250 msgr2=0x7f2ad00fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.097+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1795538540 shutdown_connections 2024-03-19T06:19:49.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.097+0000 7f2ad7c00640 1 -- 172.21.15.72:0/1795538540 wait complete. 2024-03-19T06:19:49.100 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-03-19T06:19:49.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-03-19T06:19:49.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.313+0000 7f31d4800640 1 -- 172.21.15.72:0/3157542034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc101850 msgr2=0x7f31cc101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:49.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.313+0000 7f31d4800640 1 --2- 172.21.15.72:0/3157542034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc101850 0x7f31cc101cc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009880 tx=0x7f31bc02bcf0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.313+0000 7f31d4800640 1 -- 172.21.15.72:0/3157542034 shutdown_connections 2024-03-19T06:19:49.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.313+0000 7f31d4800640 1 --2- 172.21.15.72:0/3157542034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc101850 0x7f31cc101cc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.313+0000 7f31d4800640 1 --2- 172.21.15.72:0/3157542034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31cc107860 0x7f31cc107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.313+0000 7f31d4800640 1 -- 172.21.15.72:0/3157542034 >> 172.21.15.72:0/3157542034 conn(0x7f31cc0fd370 msgr2=0x7f31cc0ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:49.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.313+0000 7f31d4800640 1 -- 172.21.15.72:0/3157542034 shutdown_connections 2024-03-19T06:19:49.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.313+0000 7f31d4800640 1 -- 172.21.15.72:0/3157542034 wait complete. 2024-03-19T06:19:49.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.314+0000 7f31d4800640 1 Processor -- start 2024-03-19T06:19:49.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.314+0000 7f31d4800640 1 -- start start 2024-03-19T06:19:49.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.314+0000 7f31d4800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc101850 0x7f31cc197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:49.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.314+0000 7f31d4800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31cc107860 0x7f31cc197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:49.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.314+0000 7f31d4800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1981e0 con 0x7f31cc101850 2024-03-19T06:19:49.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.315+0000 7f31d4800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc19bf60 con 0x7f31cc107860 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.315+0000 7f31d1e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc101850 0x7f31cc197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.315+0000 7f31d1e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc101850 0x7f31cc197610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55102/0 (socket says 172.21.15.72:55102) 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.315+0000 7f31d1e00640 1 -- 172.21.15.72:0/3459275607 learned_addr learned my addr 172.21.15.72:0/3459275607 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.315+0000 7f31d1e00640 1 -- 172.21.15.72:0/3459275607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31cc107860 msgr2=0x7f31cc197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.315+0000 7f31d1400640 1 --2- 172.21.15.72:0/3459275607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31cc107860 0x7f31cc197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.315+0000 7f31d1e00640 1 --2- 172.21.15.72:0/3459275607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31cc107860 0x7f31cc197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.315+0000 7f31d1e00640 1 -- 172.21.15.72:0/3459275607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc009560 con 0x7f31cc101850 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.315+0000 7f31d1e00640 1 --2- 172.21.15.72:0/3459275607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc101850 0x7f31cc197610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f31c000b3d0 tx=0x7f31c000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.316+0000 7f31c6a00640 1 -- 172.21.15.72:0/3459275607 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31c0011800 con 0x7f31cc101850 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.316+0000 7f31c6a00640 1 -- 172.21.15.72:0/3459275607 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31c0011e20 con 0x7f31cc101850 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.316+0000 7f31d4800640 1 -- 172.21.15.72:0/3459275607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31cc19c240 con 0x7f31cc101850 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.316+0000 7f31c6a00640 1 -- 172.21.15.72:0/3459275607 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31c000f510 con 0x7f31cc101850 2024-03-19T06:19:49.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.316+0000 7f31d4800640 1 -- 172.21.15.72:0/3459275607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc19c820 con 0x7f31cc101850 2024-03-19T06:19:49.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.317+0000 7f31d4800640 1 -- 172.21.15.72:0/3459275607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31cc04e000 con 0x7f31cc101850 2024-03-19T06:19:49.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.318+0000 7f31c6a00640 1 -- 172.21.15.72:0/3459275607 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f31c0010380 con 0x7f31cc101850 2024-03-19T06:19:49.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.319+0000 7f31c6a00640 1 --2- 172.21.15.72:0/3459275607 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f31b406df10 0x7f31b40703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:49.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.319+0000 7f31c6a00640 1 -- 172.21.15.72:0/3459275607 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f31c008dab0 con 0x7f31cc101850 2024-03-19T06:19:49.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.319+0000 7f31d1400640 1 --2- 172.21.15.72:0/3459275607 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f31b406df10 0x7f31b40703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:49.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.320+0000 7f31d1400640 1 --2- 172.21.15.72:0/3459275607 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f31b406df10 0x7f31b40703c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f31bc036040 tx=0x7f31bc005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:49.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.323+0000 7f31c6a00640 1 -- 172.21.15.72:0/3459275607 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f31c008fe60 con 0x7f31cc101850 2024-03-19T06:19:49.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:49 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1536547293' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-03-19T06:19:49.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:49 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/812443735' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-03-19T06:19:49.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:49 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1795538540' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-03-19T06:19:49.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.542+0000 7f31d4800640 1 -- 172.21.15.72:0/3459275607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f31cc10eac0 con 0x7f31cc101850 2024-03-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.543+0000 7f31c6a00640 1 -- 172.21.15.72:0/3459275607 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v44) v1 ==== 107+0+4086 (secure 0 0 0) 0x7f31c0056eb0 con 0x7f31cc101850 2024-03-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:14:02.532092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":0,"incarnation":30,"state":"up:active","state_seq":196,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 33 2024-03-19T06:19:49.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.545+0000 7f31d4800640 1 -- 172.21.15.72:0/3459275607 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f31b406df10 msgr2=0x7f31b40703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:49.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.545+0000 7f31d4800640 1 --2- 172.21.15.72:0/3459275607 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f31b406df10 0x7f31b40703c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f31bc036040 tx=0x7f31bc005fd0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.545+0000 7f31d4800640 1 -- 172.21.15.72:0/3459275607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc101850 msgr2=0x7f31cc197610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:49.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.545+0000 7f31d4800640 1 --2- 172.21.15.72:0/3459275607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc101850 0x7f31cc197610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f31c000b3d0 tx=0x7f31c000b890 comp rx=0 tx=0).stop 2024-03-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.545+0000 7f31d4800640 1 -- 172.21.15.72:0/3459275607 shutdown_connections 2024-03-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.546+0000 7f31d4800640 1 --2- 172.21.15.72:0/3459275607 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f31b406df10 0x7f31b40703c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.546+0000 7f31d4800640 1 --2- 172.21.15.72:0/3459275607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31cc107860 0x7f31cc197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.546+0000 7f31d4800640 1 --2- 172.21.15.72:0/3459275607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc101850 0x7f31cc197610 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.546+0000 7f31d4800640 1 -- 172.21.15.72:0/3459275607 >> 172.21.15.72:0/3459275607 conn(0x7f31cc0fd370 msgr2=0x7f31cc0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.546+0000 7f31d4800640 1 -- 172.21.15.72:0/3459275607 shutdown_connections 2024-03-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.546+0000 7f31d4800640 1 -- 172.21.15.72:0/3459275607 wait complete. 2024-03-19T06:19:49.548 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:49 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1536547293' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-03-19T06:19:49.548 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:49 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/812443735' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-03-19T06:19:49.548 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:49 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1795538540' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-03-19T06:19:49.552 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-03-19T06:19:49.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-03-19T06:19:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.770+0000 7efd5e400640 1 -- 172.21.15.72:0/94742944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd58101890 msgr2=0x7efd58101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.770+0000 7efd5e400640 1 --2- 172.21.15.72:0/94742944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd58101890 0x7efd58101d00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efd44009880 tx=0x7efd4402bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.770+0000 7efd5e400640 1 -- 172.21.15.72:0/94742944 shutdown_connections 2024-03-19T06:19:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.770+0000 7efd5e400640 1 --2- 172.21.15.72:0/94742944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd58101890 0x7efd58101d00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.770+0000 7efd5e400640 1 --2- 172.21.15.72:0/94742944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd581078a0 0x7efd58107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.770+0000 7efd5e400640 1 -- 172.21.15.72:0/94742944 >> 172.21.15.72:0/94742944 conn(0x7efd580fd330 msgr2=0x7efd580ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.770+0000 7efd5e400640 1 -- 172.21.15.72:0/94742944 shutdown_connections 2024-03-19T06:19:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.770+0000 7efd5e400640 1 -- 172.21.15.72:0/94742944 wait complete. 2024-03-19T06:19:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.771+0000 7efd5e400640 1 Processor -- start 2024-03-19T06:19:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.771+0000 7efd5e400640 1 -- start start 2024-03-19T06:19:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.771+0000 7efd5e400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd58101890 0x7efd581974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.771+0000 7efd5e400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd581078a0 0x7efd58197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.771+0000 7efd5e400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd581980b0 con 0x7efd581078a0 2024-03-19T06:19:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.771+0000 7efd5e400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5819be80 con 0x7efd58101890 2024-03-19T06:19:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.772+0000 7efd56a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd581078a0 0x7efd58197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.772+0000 7efd56a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd581078a0 0x7efd58197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55110/0 (socket says 172.21.15.72:55110) 2024-03-19T06:19:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.772+0000 7efd56a00640 1 -- 172.21.15.72:0/2466066026 learned_addr learned my addr 172.21.15.72:0/2466066026 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.772+0000 7efd56a00640 1 -- 172.21.15.72:0/2466066026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd58101890 msgr2=0x7efd581974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.772+0000 7efd56a00640 1 --2- 172.21.15.72:0/2466066026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd58101890 0x7efd581974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.772+0000 7efd56a00640 1 -- 172.21.15.72:0/2466066026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd44009560 con 0x7efd581078a0 2024-03-19T06:19:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.773+0000 7efd56a00640 1 --2- 172.21.15.72:0/2466066026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd581078a0 0x7efd58197a20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efd44009230 tx=0x7efd44004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.773+0000 7efd4fe00640 1 -- 172.21.15.72:0/2466066026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd440035f0 con 0x7efd581078a0 2024-03-19T06:19:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.773+0000 7efd4fe00640 1 -- 172.21.15.72:0/2466066026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd44003c10 con 0x7efd581078a0 2024-03-19T06:19:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.773+0000 7efd4fe00640 1 -- 172.21.15.72:0/2466066026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd44005670 con 0x7efd581078a0 2024-03-19T06:19:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.773+0000 7efd5e400640 1 -- 172.21.15.72:0/2466066026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5819c100 con 0x7efd581078a0 2024-03-19T06:19:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.773+0000 7efd5e400640 1 -- 172.21.15.72:0/2466066026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5819c630 con 0x7efd581078a0 2024-03-19T06:19:49.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.774+0000 7efd5e400640 1 -- 172.21.15.72:0/2466066026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5804e000 con 0x7efd581078a0 2024-03-19T06:19:49.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.775+0000 7efd4fe00640 1 -- 172.21.15.72:0/2466066026 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7efd44004dd0 con 0x7efd581078a0 2024-03-19T06:19:49.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.776+0000 7efd4fe00640 1 --2- 172.21.15.72:0/2466066026 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efd3c06dec0 0x7efd3c070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:49.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.777+0000 7efd4fe00640 1 -- 172.21.15.72:0/2466066026 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efd440b0240 con 0x7efd581078a0 2024-03-19T06:19:49.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.777+0000 7efd57400640 1 --2- 172.21.15.72:0/2466066026 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efd3c06dec0 0x7efd3c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:49.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.777+0000 7efd57400640 1 --2- 172.21.15.72:0/2466066026 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efd3c06dec0 0x7efd3c070370 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efd48005fd0 tx=0x7efd4800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:49.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:49.781+0000 7efd4fe00640 1 -- 172.21.15.72:0/2466066026 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7efd440795c0 con 0x7efd581078a0 2024-03-19T06:19:50.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.020+0000 7efd5e400640 1 -- 172.21.15.72:0/2466066026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7efd5810eb50 con 0x7efd581078a0 2024-03-19T06:19:50.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.022+0000 7efd4fe00640 1 -- 172.21.15.72:0/2466066026 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v44) v1 ==== 107+0+4899 (secure 0 0 0) 0x7efd4407cc80 con 0x7efd581078a0 2024-03-19T06:19:50.010 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:50.010 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":34510,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/3957356790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3957356790},{"type":"v1","addr":"172.21.15.72:6829","nonce":3957356790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44255,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/3611765575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3611765575},{"type":"v1","addr":"172.21.15.172:6825","nonce":3611765575}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:14:02.532092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":0,"incarnation":30,"state":"up:active","state_seq":196,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:50.010 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 34 2024-03-19T06:19:50.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.025+0000 7efd5e400640 1 -- 172.21.15.72:0/2466066026 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efd3c06dec0 msgr2=0x7efd3c070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:50.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.025+0000 7efd5e400640 1 --2- 172.21.15.72:0/2466066026 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efd3c06dec0 0x7efd3c070370 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efd48005fd0 tx=0x7efd4800b410 comp rx=0 tx=0).stop 2024-03-19T06:19:50.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.025+0000 7efd5e400640 1 -- 172.21.15.72:0/2466066026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd581078a0 msgr2=0x7efd58197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:50.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.025+0000 7efd5e400640 1 --2- 172.21.15.72:0/2466066026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd581078a0 0x7efd58197a20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efd44009230 tx=0x7efd44004040 comp rx=0 tx=0).stop 2024-03-19T06:19:50.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.025+0000 7efd5e400640 1 -- 172.21.15.72:0/2466066026 shutdown_connections 2024-03-19T06:19:50.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.025+0000 7efd5e400640 1 --2- 172.21.15.72:0/2466066026 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efd3c06dec0 0x7efd3c070370 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.025+0000 7efd5e400640 1 --2- 172.21.15.72:0/2466066026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd581078a0 0x7efd58197a20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.025+0000 7efd5e400640 1 --2- 172.21.15.72:0/2466066026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd58101890 0x7efd581974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.025+0000 7efd5e400640 1 -- 172.21.15.72:0/2466066026 >> 172.21.15.72:0/2466066026 conn(0x7efd580fd330 msgr2=0x7efd580fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:50.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.025+0000 7efd5e400640 1 -- 172.21.15.72:0/2466066026 shutdown_connections 2024-03-19T06:19:50.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.025+0000 7efd5e400640 1 -- 172.21.15.72:0/2466066026 wait complete. 2024-03-19T06:19:50.030 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-03-19T06:19:50.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-03-19T06:19:50.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.257+0000 7f83e0400640 1 -- 172.21.15.72:0/2787213606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d81078a0 msgr2=0x7f83d8107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:50.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.257+0000 7f83e0400640 1 --2- 172.21.15.72:0/2787213606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d81078a0 0x7f83d8107c70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009880 tx=0x7f83c802bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.258+0000 7f83e0400640 1 -- 172.21.15.72:0/2787213606 shutdown_connections 2024-03-19T06:19:50.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.258+0000 7f83e0400640 1 --2- 172.21.15.72:0/2787213606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8101890 0x7f83d8101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.258+0000 7f83e0400640 1 --2- 172.21.15.72:0/2787213606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d81078a0 0x7f83d8107c70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.258+0000 7f83e0400640 1 -- 172.21.15.72:0/2787213606 >> 172.21.15.72:0/2787213606 conn(0x7f83d80fd390 msgr2=0x7f83d80ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:50.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.258+0000 7f83e0400640 1 -- 172.21.15.72:0/2787213606 shutdown_connections 2024-03-19T06:19:50.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.258+0000 7f83e0400640 1 -- 172.21.15.72:0/2787213606 wait complete. 2024-03-19T06:19:50.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.259+0000 7f83e0400640 1 Processor -- start 2024-03-19T06:19:50.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.259+0000 7f83e0400640 1 -- start start 2024-03-19T06:19:50.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.259+0000 7f83e0400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8101890 0x7f83d81975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:50.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.259+0000 7f83e0400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d81078a0 0x7f83d8197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.259+0000 7f83e0400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d81981b0 con 0x7f83d81078a0 2024-03-19T06:19:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.259+0000 7f83e0400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d819bf80 con 0x7f83d8101890 2024-03-19T06:19:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.260+0000 7f83dd000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d81078a0 0x7f83d8197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.260+0000 7f83dd000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d81078a0 0x7f83d8197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55140/0 (socket says 172.21.15.72:55140) 2024-03-19T06:19:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.260+0000 7f83dd000640 1 -- 172.21.15.72:0/3122292121 learned_addr learned my addr 172.21.15.72:0/3122292121 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.260+0000 7f83dd000640 1 -- 172.21.15.72:0/3122292121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8101890 msgr2=0x7f83d81975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.260+0000 7f83dda00640 1 --2- 172.21.15.72:0/3122292121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8101890 0x7f83d81975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.260+0000 7f83dd000640 1 --2- 172.21.15.72:0/3122292121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8101890 0x7f83d81975e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.260+0000 7f83dd000640 1 -- 172.21.15.72:0/3122292121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009560 con 0x7f83d81078a0 2024-03-19T06:19:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.260+0000 7f83dd000640 1 --2- 172.21.15.72:0/3122292121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d81078a0 0x7f83d8197b20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f83c400d6f0 tx=0x7f83c400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:50.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.260+0000 7f83d6000640 1 -- 172.21.15.72:0/3122292121 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83c4009a30 con 0x7f83d81078a0 2024-03-19T06:19:50.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.261+0000 7f83d6000640 1 -- 172.21.15.72:0/3122292121 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83c40054e0 con 0x7f83d81078a0 2024-03-19T06:19:50.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.261+0000 7f83e0400640 1 -- 172.21.15.72:0/3122292121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d819c260 con 0x7f83d81078a0 2024-03-19T06:19:50.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.261+0000 7f83d6000640 1 -- 172.21.15.72:0/3122292121 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83c4010460 con 0x7f83d81078a0 2024-03-19T06:19:50.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.261+0000 7f83e0400640 1 -- 172.21.15.72:0/3122292121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d819c7c0 con 0x7f83d81078a0 2024-03-19T06:19:50.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.262+0000 7f83e0400640 1 -- 172.21.15.72:0/3122292121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d804e000 con 0x7f83d81078a0 2024-03-19T06:19:50.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.263+0000 7f83d6000640 1 -- 172.21.15.72:0/3122292121 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f83c4009b90 con 0x7f83d81078a0 2024-03-19T06:19:50.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.264+0000 7f83d6000640 1 --2- 172.21.15.72:0/3122292121 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f83bc06df10 0x7f83bc0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:50.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.264+0000 7f83d6000640 1 -- 172.21.15.72:0/3122292121 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f83c408d9f0 con 0x7f83d81078a0 2024-03-19T06:19:50.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.264+0000 7f83dda00640 1 --2- 172.21.15.72:0/3122292121 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f83bc06df10 0x7f83bc0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:50.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.265+0000 7f83dda00640 1 --2- 172.21.15.72:0/3122292121 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f83bc06df10 0x7f83bc0703c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83c8036040 tx=0x7f83c8005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:50.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.269+0000 7f83d6000640 1 -- 172.21.15.72:0/3122292121 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f83c4056d70 con 0x7f83d81078a0 2024-03-19T06:19:50.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:50 smithi072 ceph-mon[78545]: pgmap v410: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:50.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:50 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3459275607' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-03-19T06:19:50.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:50 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2466066026' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-03-19T06:19:50.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:50 smithi172 ceph-mon[66682]: pgmap v410: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:50.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:50 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3459275607' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-03-19T06:19:50.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:50 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2466066026' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-03-19T06:19:50.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.508+0000 7f83e0400640 1 -- 172.21.15.72:0/3122292121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f83d8198930 con 0x7f83d81078a0 2024-03-19T06:19:50.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.509+0000 7f83d6000640 1 -- 172.21.15.72:0/3122292121 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v44) v1 ==== 107+0+4117 (secure 0 0 0) 0x7f83c405a430 con 0x7f83d81078a0 2024-03-19T06:19:50.497 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:50.497 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":34510,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/3957356790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3957356790},{"type":"v1","addr":"172.21.15.72:6829","nonce":3957356790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:14:02.532092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":0,"incarnation":30,"state":"up:active","state_seq":196,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:50.497 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 35 2024-03-19T06:19:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.511+0000 7f83e0400640 1 -- 172.21.15.72:0/3122292121 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f83bc06df10 msgr2=0x7f83bc0703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.511+0000 7f83e0400640 1 --2- 172.21.15.72:0/3122292121 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f83bc06df10 0x7f83bc0703c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83c8036040 tx=0x7f83c8005fd0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.512+0000 7f83e0400640 1 -- 172.21.15.72:0/3122292121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d81078a0 msgr2=0x7f83d8197b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.512+0000 7f83e0400640 1 --2- 172.21.15.72:0/3122292121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d81078a0 0x7f83d8197b20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f83c400d6f0 tx=0x7f83c400dbb0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.512+0000 7f83e0400640 1 -- 172.21.15.72:0/3122292121 shutdown_connections 2024-03-19T06:19:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.512+0000 7f83e0400640 1 --2- 172.21.15.72:0/3122292121 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f83bc06df10 0x7f83bc0703c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.512+0000 7f83e0400640 1 --2- 172.21.15.72:0/3122292121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d81078a0 0x7f83d8197b20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.512+0000 7f83e0400640 1 --2- 172.21.15.72:0/3122292121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8101890 0x7f83d81975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.512+0000 7f83e0400640 1 -- 172.21.15.72:0/3122292121 >> 172.21.15.72:0/3122292121 conn(0x7f83d80fd390 msgr2=0x7f83d80fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.512+0000 7f83e0400640 1 -- 172.21.15.72:0/3122292121 shutdown_connections 2024-03-19T06:19:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.512+0000 7f83e0400640 1 -- 172.21.15.72:0/3122292121 wait complete. 2024-03-19T06:19:50.517 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-03-19T06:19:50.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-03-19T06:19:50.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.745+0000 7ff319000640 1 -- 172.21.15.72:0/2230459011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3141076c0 msgr2=0x7ff314107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:50.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.745+0000 7ff319000640 1 --2- 172.21.15.72:0/2230459011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3141076c0 0x7ff314107a90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff304009880 tx=0x7ff30402bcf0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.745+0000 7ff319000640 1 -- 172.21.15.72:0/2230459011 shutdown_connections 2024-03-19T06:19:50.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.745+0000 7ff319000640 1 --2- 172.21.15.72:0/2230459011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3141016b0 0x7ff314101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.745+0000 7ff319000640 1 --2- 172.21.15.72:0/2230459011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3141076c0 0x7ff314107a90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.745+0000 7ff319000640 1 -- 172.21.15.72:0/2230459011 >> 172.21.15.72:0/2230459011 conn(0x7ff3140fd1b0 msgr2=0x7ff3140ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:50.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.745+0000 7ff319000640 1 -- 172.21.15.72:0/2230459011 shutdown_connections 2024-03-19T06:19:50.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.745+0000 7ff319000640 1 -- 172.21.15.72:0/2230459011 wait complete. 2024-03-19T06:19:50.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.746+0000 7ff319000640 1 Processor -- start 2024-03-19T06:19:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.746+0000 7ff319000640 1 -- start start 2024-03-19T06:19:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.747+0000 7ff319000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3141016b0 0x7ff3141972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.747+0000 7ff319000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3141076c0 0x7ff314197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.747+0000 7ff319000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff314197e30 con 0x7ff3141016b0 2024-03-19T06:19:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.747+0000 7ff319000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff314197fa0 con 0x7ff3141076c0 2024-03-19T06:19:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.747+0000 7ff313400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3141016b0 0x7ff3141972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.747+0000 7ff313400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3141016b0 0x7ff3141972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55168/0 (socket says 172.21.15.72:55168) 2024-03-19T06:19:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.747+0000 7ff313400640 1 -- 172.21.15.72:0/2872928586 learned_addr learned my addr 172.21.15.72:0/2872928586 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.747+0000 7ff30aa00640 1 --2- 172.21.15.72:0/2872928586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3141076c0 0x7ff314197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.747+0000 7ff313400640 1 -- 172.21.15.72:0/2872928586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3141076c0 msgr2=0x7ff314197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.747+0000 7ff313400640 1 --2- 172.21.15.72:0/2872928586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3141076c0 0x7ff314197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.747+0000 7ff313400640 1 -- 172.21.15.72:0/2872928586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff304009560 con 0x7ff3141016b0 2024-03-19T06:19:50.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.747+0000 7ff30aa00640 1 --2- 172.21.15.72:0/2872928586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3141076c0 0x7ff314197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:19:50.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.748+0000 7ff313400640 1 --2- 172.21.15.72:0/2872928586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3141016b0 0x7ff3141972f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff304036040 tx=0x7ff304004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:50.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.748+0000 7ff310c00640 1 -- 172.21.15.72:0/2872928586 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3040035f0 con 0x7ff3141016b0 2024-03-19T06:19:50.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.748+0000 7ff310c00640 1 -- 172.21.15.72:0/2872928586 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff304003c10 con 0x7ff3141016b0 2024-03-19T06:19:50.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.748+0000 7ff319000640 1 -- 172.21.15.72:0/2872928586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31419bdd0 con 0x7ff3141016b0 2024-03-19T06:19:50.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.748+0000 7ff310c00640 1 -- 172.21.15.72:0/2872928586 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff304034440 con 0x7ff3141016b0 2024-03-19T06:19:50.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.748+0000 7ff319000640 1 -- 172.21.15.72:0/2872928586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31419c3b0 con 0x7ff3141016b0 2024-03-19T06:19:50.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.749+0000 7ff319000640 1 -- 172.21.15.72:0/2872928586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31404e000 con 0x7ff3141016b0 2024-03-19T06:19:50.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.750+0000 7ff310c00640 1 -- 172.21.15.72:0/2872928586 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7ff304003750 con 0x7ff3141016b0 2024-03-19T06:19:50.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.752+0000 7ff310c00640 1 --2- 172.21.15.72:0/2872928586 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff2f806df10 0x7ff2f80703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:50.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.752+0000 7ff310c00640 1 -- 172.21.15.72:0/2872928586 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff3040b02b0 con 0x7ff3141016b0 2024-03-19T06:19:50.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.752+0000 7ff30aa00640 1 --2- 172.21.15.72:0/2872928586 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff2f806df10 0x7ff2f80703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:50.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.753+0000 7ff30aa00640 1 --2- 172.21.15.72:0/2872928586 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff2f806df10 0x7ff2f80703c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff314198900 tx=0x7ff2fc005d90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:50.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:50.756+0000 7ff310c00640 1 -- 172.21.15.72:0/2872928586 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7ff3040796d0 con 0x7ff3141016b0 2024-03-19T06:19:50.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.003+0000 7ff319000640 1 -- 172.21.15.72:0/2872928586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7ff314198640 con 0x7ff3141016b0 2024-03-19T06:19:50.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.004+0000 7ff310c00640 1 -- 172.21.15.72:0/2872928586 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v44) v1 ==== 107+0+4933 (secure 0 0 0) 0x7ff30407cd90 con 0x7ff3141016b0 2024-03-19T06:19:50.992 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:50.992 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":34510,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/3957356790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3957356790},{"type":"v1","addr":"172.21.15.72:6829","nonce":3957356790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44287,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/1022637060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1022637060},{"type":"v1","addr":"172.21.15.172:6825","nonce":1022637060}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:14:02.532092+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24237},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24237":{"gid":24237,"name":"cephfs.smithi172.nparnw","rank":0,"incarnation":30,"state":"up:active","state_seq":196,"addr":"172.21.15.172:6827/363477076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":363477076},{"type":"v1","addr":"172.21.15.172:6827","nonce":363477076}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:50.992 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 36 2024-03-19T06:19:50.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.007+0000 7ff319000640 1 -- 172.21.15.72:0/2872928586 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff2f806df10 msgr2=0x7ff2f80703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:50.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.007+0000 7ff319000640 1 --2- 172.21.15.72:0/2872928586 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff2f806df10 0x7ff2f80703c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff314198900 tx=0x7ff2fc005d90 comp rx=0 tx=0).stop 2024-03-19T06:19:50.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.007+0000 7ff319000640 1 -- 172.21.15.72:0/2872928586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3141016b0 msgr2=0x7ff3141972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:50.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.007+0000 7ff319000640 1 --2- 172.21.15.72:0/2872928586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3141016b0 0x7ff3141972f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff304036040 tx=0x7ff304004040 comp rx=0 tx=0).stop 2024-03-19T06:19:50.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.007+0000 7ff319000640 1 -- 172.21.15.72:0/2872928586 shutdown_connections 2024-03-19T06:19:50.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.007+0000 7ff319000640 1 --2- 172.21.15.72:0/2872928586 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ff2f806df10 0x7ff2f80703c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.007+0000 7ff319000640 1 --2- 172.21.15.72:0/2872928586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3141076c0 0x7ff314197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.007+0000 7ff319000640 1 --2- 172.21.15.72:0/2872928586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3141016b0 0x7ff3141972f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:50.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.007+0000 7ff319000640 1 -- 172.21.15.72:0/2872928586 >> 172.21.15.72:0/2872928586 conn(0x7ff3140fd1b0 msgr2=0x7ff3140feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:50.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.007+0000 7ff319000640 1 -- 172.21.15.72:0/2872928586 shutdown_connections 2024-03-19T06:19:50.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.007+0000 7ff319000640 1 -- 172.21.15.72:0/2872928586 wait complete. 2024-03-19T06:19:51.014 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-03-19T06:19:51.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-03-19T06:19:51.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.235+0000 7f055a200640 1 -- 172.21.15.72:0/2915772273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0554074790 msgr2=0x7f0554074b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:51.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.235+0000 7f055a200640 1 --2- 172.21.15.72:0/2915772273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0554074790 0x7f0554074b60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0544009880 tx=0x7f054402bcf0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.235+0000 7f055a200640 1 -- 172.21.15.72:0/2915772273 shutdown_connections 2024-03-19T06:19:51.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.235+0000 7f055a200640 1 --2- 172.21.15.72:0/2915772273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05540750a0 0x7f055410fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.235+0000 7f055a200640 1 --2- 172.21.15.72:0/2915772273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0554074790 0x7f0554074b60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.235+0000 7f055a200640 1 -- 172.21.15.72:0/2915772273 >> 172.21.15.72:0/2915772273 conn(0x7f05540fd330 msgr2=0x7f05540ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:51.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.235+0000 7f055a200640 1 -- 172.21.15.72:0/2915772273 shutdown_connections 2024-03-19T06:19:51.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.235+0000 7f055a200640 1 -- 172.21.15.72:0/2915772273 wait complete. 2024-03-19T06:19:51.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.236+0000 7f055a200640 1 Processor -- start 2024-03-19T06:19:51.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.236+0000 7f055a200640 1 -- start start 2024-03-19T06:19:51.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.237+0000 7f055a200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0554074790 0x7f05541a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.237+0000 7f055a200640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05540750a0 0x7f05541a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.237+0000 7f055a200640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055419b8c0 con 0x7f05540750a0 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.237+0000 7f055a200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055419ba30 con 0x7f0554074790 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.237+0000 7f054be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05540750a0 0x7f05541a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.237+0000 7f054be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05540750a0 0x7f05541a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55186/0 (socket says 172.21.15.72:55186) 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.237+0000 7f054be00640 1 -- 172.21.15.72:0/3646049771 learned_addr learned my addr 172.21.15.72:0/3646049771 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.237+0000 7f054be00640 1 -- 172.21.15.72:0/3646049771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0554074790 msgr2=0x7f05541a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.237+0000 7f054be00640 1 --2- 172.21.15.72:0/3646049771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0554074790 0x7f05541a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.238+0000 7f054be00640 1 -- 172.21.15.72:0/3646049771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0544009560 con 0x7f05540750a0 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.238+0000 7f054be00640 1 --2- 172.21.15.72:0/3646049771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05540750a0 0x7f05541a1d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f053c00b420 tx=0x7f053c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.238+0000 7f0550c00640 1 -- 172.21.15.72:0/3646049771 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053c011800 con 0x7f05540750a0 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.238+0000 7f0550c00640 1 -- 172.21.15.72:0/3646049771 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f053c011e20 con 0x7f05540750a0 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.238+0000 7f055a200640 1 -- 172.21.15.72:0/3646049771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055419bd10 con 0x7f05540750a0 2024-03-19T06:19:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.238+0000 7f0550c00640 1 -- 172.21.15.72:0/3646049771 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053c00f2e0 con 0x7f05540750a0 2024-03-19T06:19:51.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.238+0000 7f055a200640 1 -- 172.21.15.72:0/3646049771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055419c270 con 0x7f05540750a0 2024-03-19T06:19:51.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.239+0000 7f055a200640 1 -- 172.21.15.72:0/3646049771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055404e000 con 0x7f05540750a0 2024-03-19T06:19:51.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.241+0000 7f0550c00640 1 -- 172.21.15.72:0/3646049771 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f053c010380 con 0x7f05540750a0 2024-03-19T06:19:51.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.241+0000 7f0550c00640 1 --2- 172.21.15.72:0/3646049771 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f053806df10 0x7f05380703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:51.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.242+0000 7f0550c00640 1 -- 172.21.15.72:0/3646049771 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f053c08d740 con 0x7f05540750a0 2024-03-19T06:19:51.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.242+0000 7f0553400640 1 --2- 172.21.15.72:0/3646049771 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f053806df10 0x7f05380703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:51.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.242+0000 7f0553400640 1 --2- 172.21.15.72:0/3646049771 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f053806df10 0x7f05380703c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0544036040 tx=0x7f0544000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:51.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.246+0000 7f0550c00640 1 -- 172.21.15.72:0/3646049771 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f053c056b60 con 0x7f05540750a0 2024-03-19T06:19:51.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:51 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3122292121' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-03-19T06:19:51.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:51 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2872928586' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-03-19T06:19:51.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:51 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3122292121' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-03-19T06:19:51.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:51 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2872928586' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-03-19T06:19:51.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.467+0000 7f055a200640 1 -- 172.21.15.72:0/3646049771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f055419c4f0 con 0x7f05540750a0 2024-03-19T06:19:51.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.469+0000 7f0550c00640 1 -- 172.21.15.72:0/3646049771 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v44) v1 ==== 107+0+4141 (secure 0 0 0) 0x7f053c05a220 con 0x7f05540750a0 2024-03-19T06:19:51.456 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:51.456 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":34510,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/3957356790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3957356790},{"type":"v1","addr":"172.21.15.72:6829","nonce":3957356790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44287,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/1022637060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1022637060},{"type":"v1","addr":"172.21.15.172:6825","nonce":1022637060}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:14:49.470964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:51.457 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 37 2024-03-19T06:19:51.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.471+0000 7f055a200640 1 -- 172.21.15.72:0/3646049771 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f053806df10 msgr2=0x7f05380703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:51.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.471+0000 7f055a200640 1 --2- 172.21.15.72:0/3646049771 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f053806df10 0x7f05380703c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0544036040 tx=0x7f0544000bc0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.471+0000 7f055a200640 1 -- 172.21.15.72:0/3646049771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05540750a0 msgr2=0x7f05541a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:51.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.471+0000 7f055a200640 1 --2- 172.21.15.72:0/3646049771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05540750a0 0x7f05541a1d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f053c00b420 tx=0x7f053c00b8e0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.472+0000 7f055a200640 1 -- 172.21.15.72:0/3646049771 shutdown_connections 2024-03-19T06:19:51.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.472+0000 7f055a200640 1 --2- 172.21.15.72:0/3646049771 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f053806df10 0x7f05380703c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.472+0000 7f055a200640 1 --2- 172.21.15.72:0/3646049771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05540750a0 0x7f05541a1d90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.472+0000 7f055a200640 1 --2- 172.21.15.72:0/3646049771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0554074790 0x7f05541a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.472+0000 7f055a200640 1 -- 172.21.15.72:0/3646049771 >> 172.21.15.72:0/3646049771 conn(0x7f05540fd330 msgr2=0x7f05540fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:51.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.472+0000 7f055a200640 1 -- 172.21.15.72:0/3646049771 shutdown_connections 2024-03-19T06:19:51.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.472+0000 7f055a200640 1 -- 172.21.15.72:0/3646049771 wait complete. 2024-03-19T06:19:51.477 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-03-19T06:19:51.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-03-19T06:19:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.699+0000 7fe186400640 1 -- 172.21.15.72:0/3161873178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1801078a0 msgr2=0x7fe180107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.699+0000 7fe186400640 1 --2- 172.21.15.72:0/3161873178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1801078a0 0x7fe180107c70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe170009880 tx=0x7fe17002bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.699+0000 7fe186400640 1 -- 172.21.15.72:0/3161873178 shutdown_connections 2024-03-19T06:19:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.699+0000 7fe186400640 1 --2- 172.21.15.72:0/3161873178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe180101890 0x7fe180101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.699+0000 7fe186400640 1 --2- 172.21.15.72:0/3161873178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1801078a0 0x7fe180107c70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.699+0000 7fe186400640 1 -- 172.21.15.72:0/3161873178 >> 172.21.15.72:0/3161873178 conn(0x7fe1800fd330 msgr2=0x7fe1800ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.699+0000 7fe186400640 1 -- 172.21.15.72:0/3161873178 shutdown_connections 2024-03-19T06:19:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.699+0000 7fe186400640 1 -- 172.21.15.72:0/3161873178 wait complete. 2024-03-19T06:19:51.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.700+0000 7fe186400640 1 Processor -- start 2024-03-19T06:19:51.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.700+0000 7fe186400640 1 -- start start 2024-03-19T06:19:51.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.700+0000 7fe186400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe180101890 0x7fe1801974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:51.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.700+0000 7fe186400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1801078a0 0x7fe180197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:51.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.700+0000 7fe186400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe180198010 con 0x7fe1801078a0 2024-03-19T06:19:51.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.700+0000 7fe186400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe180198180 con 0x7fe180101890 2024-03-19T06:19:51.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.701+0000 7fe17ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1801078a0 0x7fe180197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.701+0000 7fe17ea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1801078a0 0x7fe180197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55194/0 (socket says 172.21.15.72:55194) 2024-03-19T06:19:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.701+0000 7fe17ea00640 1 -- 172.21.15.72:0/3965265043 learned_addr learned my addr 172.21.15.72:0/3965265043 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.701+0000 7fe17ea00640 1 -- 172.21.15.72:0/3965265043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe180101890 msgr2=0x7fe1801974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.701+0000 7fe17f400640 1 --2- 172.21.15.72:0/3965265043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe180101890 0x7fe1801974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.701+0000 7fe17ea00640 1 --2- 172.21.15.72:0/3965265043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe180101890 0x7fe1801974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.701+0000 7fe17ea00640 1 -- 172.21.15.72:0/3965265043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe170009560 con 0x7fe1801078a0 2024-03-19T06:19:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.701+0000 7fe17ea00640 1 --2- 172.21.15.72:0/3965265043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1801078a0 0x7fe180197a10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c8a0 tx=0x7fe16800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.702+0000 7fe177e00640 1 -- 172.21.15.72:0/3965265043 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe168007b80 con 0x7fe1801078a0 2024-03-19T06:19:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.702+0000 7fe177e00640 1 -- 172.21.15.72:0/3965265043 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe168007ce0 con 0x7fe1801078a0 2024-03-19T06:19:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.702+0000 7fe186400640 1 -- 172.21.15.72:0/3965265043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18019c010 con 0x7fe1801078a0 2024-03-19T06:19:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.702+0000 7fe177e00640 1 -- 172.21.15.72:0/3965265043 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe168018810 con 0x7fe1801078a0 2024-03-19T06:19:51.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.702+0000 7fe186400640 1 -- 172.21.15.72:0/3965265043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18019c5f0 con 0x7fe1801078a0 2024-03-19T06:19:51.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.703+0000 7fe186400640 1 -- 172.21.15.72:0/3965265043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18004e000 con 0x7fe1801078a0 2024-03-19T06:19:51.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.704+0000 7fe177e00640 1 -- 172.21.15.72:0/3965265043 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fe168018a80 con 0x7fe1801078a0 2024-03-19T06:19:51.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.705+0000 7fe177e00640 1 --2- 172.21.15.72:0/3965265043 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe16406df10 0x7fe1640703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:51.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.705+0000 7fe177e00640 1 -- 172.21.15.72:0/3965265043 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe16808dff0 con 0x7fe1801078a0 2024-03-19T06:19:51.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.706+0000 7fe17f400640 1 --2- 172.21.15.72:0/3965265043 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe16406df10 0x7fe1640703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:51.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.706+0000 7fe17f400640 1 --2- 172.21.15.72:0/3965265043 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe16406df10 0x7fe1640703c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe170036040 tx=0x7fe170005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:51.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.710+0000 7fe177e00640 1 -- 172.21.15.72:0/3965265043 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fe168057390 con 0x7fe1801078a0 2024-03-19T06:19:51.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.946+0000 7fe186400640 1 -- 172.21.15.72:0/3965265043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7fe180198820 con 0x7fe1801078a0 2024-03-19T06:19:51.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.947+0000 7fe177e00640 1 -- 172.21.15.72:0/3965265043 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v44) v1 ==== 107+0+4186 (secure 0 0 0) 0x7fe16805aa50 con 0x7fe1801078a0 2024-03-19T06:19:51.934 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:51.935 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34510,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/3957356790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3957356790},{"type":"v1","addr":"172.21.15.72:6829","nonce":3957356790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44287,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/1022637060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1022637060},{"type":"v1","addr":"172.21.15.172:6825","nonce":1022637060}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:14:49.483853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34488},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34488":{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:51.935 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 38 2024-03-19T06:19:51.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.950+0000 7fe186400640 1 -- 172.21.15.72:0/3965265043 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe16406df10 msgr2=0x7fe1640703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:51.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.950+0000 7fe186400640 1 --2- 172.21.15.72:0/3965265043 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe16406df10 0x7fe1640703c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe170036040 tx=0x7fe170005fd0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.950+0000 7fe186400640 1 -- 172.21.15.72:0/3965265043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1801078a0 msgr2=0x7fe180197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:51.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.950+0000 7fe186400640 1 --2- 172.21.15.72:0/3965265043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1801078a0 0x7fe180197a10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c8a0 tx=0x7fe16800cd60 comp rx=0 tx=0).stop 2024-03-19T06:19:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.950+0000 7fe186400640 1 -- 172.21.15.72:0/3965265043 shutdown_connections 2024-03-19T06:19:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.950+0000 7fe186400640 1 --2- 172.21.15.72:0/3965265043 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fe16406df10 0x7fe1640703c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.950+0000 7fe186400640 1 --2- 172.21.15.72:0/3965265043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1801078a0 0x7fe180197a10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.950+0000 7fe186400640 1 --2- 172.21.15.72:0/3965265043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe180101890 0x7fe1801974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.950+0000 7fe186400640 1 -- 172.21.15.72:0/3965265043 >> 172.21.15.72:0/3965265043 conn(0x7fe1800fd330 msgr2=0x7fe1800feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.950+0000 7fe186400640 1 -- 172.21.15.72:0/3965265043 shutdown_connections 2024-03-19T06:19:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:51.950+0000 7fe186400640 1 -- 172.21.15.72:0/3965265043 wait complete. 2024-03-19T06:19:51.955 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-03-19T06:19:51.955 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-03-19T06:19:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.174+0000 7ffac4400640 1 -- 172.21.15.72:0/402484239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffabc107890 msgr2=0x7ffabc107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.174+0000 7ffac4400640 1 --2- 172.21.15.72:0/402484239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffabc107890 0x7ffabc107c60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009880 tx=0x7ffab002bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.175+0000 7ffac4400640 1 -- 172.21.15.72:0/402484239 shutdown_connections 2024-03-19T06:19:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.175+0000 7ffac4400640 1 --2- 172.21.15.72:0/402484239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffabc101880 0x7ffabc101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.175+0000 7ffac4400640 1 --2- 172.21.15.72:0/402484239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffabc107890 0x7ffabc107c60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.175+0000 7ffac4400640 1 -- 172.21.15.72:0/402484239 >> 172.21.15.72:0/402484239 conn(0x7ffabc0fd360 msgr2=0x7ffabc0ff770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.175+0000 7ffac4400640 1 -- 172.21.15.72:0/402484239 shutdown_connections 2024-03-19T06:19:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.175+0000 7ffac4400640 1 -- 172.21.15.72:0/402484239 wait complete. 2024-03-19T06:19:52.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.176+0000 7ffac4400640 1 Processor -- start 2024-03-19T06:19:52.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.176+0000 7ffac4400640 1 -- start start 2024-03-19T06:19:52.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.176+0000 7ffac4400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffabc101880 0x7ffabc1975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:52.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.176+0000 7ffac4400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffabc107890 0x7ffabc197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:52.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.176+0000 7ffac4400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc1981b0 con 0x7ffabc107890 2024-03-19T06:19:52.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.176+0000 7ffac4400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc19bf80 con 0x7ffabc101880 2024-03-19T06:19:52.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.177+0000 7ffac1000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffabc107890 0x7ffabc197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:52.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.177+0000 7ffac1000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffabc107890 0x7ffabc197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55226/0 (socket says 172.21.15.72:55226) 2024-03-19T06:19:52.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.177+0000 7ffac1000640 1 -- 172.21.15.72:0/966653416 learned_addr learned my addr 172.21.15.72:0/966653416 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:52.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.177+0000 7ffac1000640 1 -- 172.21.15.72:0/966653416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffabc101880 msgr2=0x7ffabc1975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:52.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.177+0000 7ffac1000640 1 --2- 172.21.15.72:0/966653416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffabc101880 0x7ffabc1975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.177+0000 7ffac1000640 1 -- 172.21.15.72:0/966653416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0009560 con 0x7ffabc107890 2024-03-19T06:19:52.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.177+0000 7ffac1000640 1 --2- 172.21.15.72:0/966653416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffabc107890 0x7ffabc197b20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800b420 tx=0x7ffaa800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:52.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.178+0000 7ffaba000640 1 -- 172.21.15.72:0/966653416 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa8011800 con 0x7ffabc107890 2024-03-19T06:19:52.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.178+0000 7ffaba000640 1 -- 172.21.15.72:0/966653416 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffaa8011e20 con 0x7ffabc107890 2024-03-19T06:19:52.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.178+0000 7ffac4400640 1 -- 172.21.15.72:0/966653416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc19c260 con 0x7ffabc107890 2024-03-19T06:19:52.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.178+0000 7ffaba000640 1 -- 172.21.15.72:0/966653416 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa800f2e0 con 0x7ffabc107890 2024-03-19T06:19:52.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.178+0000 7ffac4400640 1 -- 172.21.15.72:0/966653416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc19c840 con 0x7ffabc107890 2024-03-19T06:19:52.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.179+0000 7ffac4400640 1 -- 172.21.15.72:0/966653416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc04e000 con 0x7ffabc107890 2024-03-19T06:19:52.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.180+0000 7ffaba000640 1 -- 172.21.15.72:0/966653416 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7ffaa8010380 con 0x7ffabc107890 2024-03-19T06:19:52.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.181+0000 7ffaba000640 1 --2- 172.21.15.72:0/966653416 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffaa406df10 0x7ffaa40703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:52.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.181+0000 7ffaba000640 1 -- 172.21.15.72:0/966653416 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ffaa808d740 con 0x7ffabc107890 2024-03-19T06:19:52.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.181+0000 7ffac1a00640 1 --2- 172.21.15.72:0/966653416 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffaa406df10 0x7ffaa40703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:52.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.182+0000 7ffac1a00640 1 --2- 172.21.15.72:0/966653416 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffaa406df10 0x7ffaa40703c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffab0036040 tx=0x7ffab0000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:52.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.186+0000 7ffaba000640 1 -- 172.21.15.72:0/966653416 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7ffaa8056b60 con 0x7ffabc107890 2024-03-19T06:19:52.301 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:52 smithi072 ceph-mon[78545]: pgmap v411: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:52.302 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:52 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3646049771' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-03-19T06:19:52.302 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:52 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3965265043' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-03-19T06:19:52.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.407+0000 7ffac4400640 1 -- 172.21.15.72:0/966653416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7ffabc0008d0 con 0x7ffabc107890 2024-03-19T06:19:52.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.409+0000 7ffaba000640 1 -- 172.21.15.72:0/966653416 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v44) v1 ==== 107+0+4190 (secure 0 0 0) 0x7ffaa805a220 con 0x7ffabc107890 2024-03-19T06:19:52.396 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:52.396 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34510,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/3957356790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3957356790},{"type":"v1","addr":"172.21.15.72:6829","nonce":3957356790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44287,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/1022637060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1022637060},{"type":"v1","addr":"172.21.15.172:6825","nonce":1022637060}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:14:55.402701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34488},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34488":{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":38,"state":"up:reconnect","state_seq":22,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:52.397 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 39 2024-03-19T06:19:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.411+0000 7ffac4400640 1 -- 172.21.15.72:0/966653416 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffaa406df10 msgr2=0x7ffaa40703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.411+0000 7ffac4400640 1 --2- 172.21.15.72:0/966653416 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffaa406df10 0x7ffaa40703c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffab0036040 tx=0x7ffab0000bc0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.411+0000 7ffac4400640 1 -- 172.21.15.72:0/966653416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffabc107890 msgr2=0x7ffabc197b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.411+0000 7ffac4400640 1 --2- 172.21.15.72:0/966653416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffabc107890 0x7ffabc197b20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800b420 tx=0x7ffaa800b8e0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.411+0000 7ffac4400640 1 -- 172.21.15.72:0/966653416 shutdown_connections 2024-03-19T06:19:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.411+0000 7ffac4400640 1 --2- 172.21.15.72:0/966653416 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7ffaa406df10 0x7ffaa40703c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.411+0000 7ffac4400640 1 --2- 172.21.15.72:0/966653416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffabc107890 0x7ffabc197b20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.411+0000 7ffac4400640 1 --2- 172.21.15.72:0/966653416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffabc101880 0x7ffabc1975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.411+0000 7ffac4400640 1 -- 172.21.15.72:0/966653416 >> 172.21.15.72:0/966653416 conn(0x7ffabc0fd360 msgr2=0x7ffabc0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.412+0000 7ffac4400640 1 -- 172.21.15.72:0/966653416 shutdown_connections 2024-03-19T06:19:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.412+0000 7ffac4400640 1 -- 172.21.15.72:0/966653416 wait complete. 2024-03-19T06:19:52.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:52 smithi172 ceph-mon[66682]: pgmap v411: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:52.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:52 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3646049771' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-03-19T06:19:52.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:52 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3965265043' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-03-19T06:19:52.415 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-03-19T06:19:52.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 40 2024-03-19T06:19:52.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.636+0000 7f7e20a00640 1 -- 172.21.15.72:0/1223111382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c101890 msgr2=0x7f7e1c101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:52.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.636+0000 7f7e20a00640 1 --2- 172.21.15.72:0/1223111382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c101890 0x7f7e1c101d00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009880 tx=0x7f7e0402bcf0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.636+0000 7f7e20a00640 1 -- 172.21.15.72:0/1223111382 shutdown_connections 2024-03-19T06:19:52.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.636+0000 7f7e20a00640 1 --2- 172.21.15.72:0/1223111382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c101890 0x7f7e1c101d00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.636+0000 7f7e20a00640 1 --2- 172.21.15.72:0/1223111382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e1c1078a0 0x7f7e1c107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.636+0000 7f7e20a00640 1 -- 172.21.15.72:0/1223111382 >> 172.21.15.72:0/1223111382 conn(0x7f7e1c0fd390 msgr2=0x7f7e1c0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:52.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.636+0000 7f7e20a00640 1 -- 172.21.15.72:0/1223111382 shutdown_connections 2024-03-19T06:19:52.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.636+0000 7f7e20a00640 1 -- 172.21.15.72:0/1223111382 wait complete. 2024-03-19T06:19:52.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.637+0000 7f7e20a00640 1 Processor -- start 2024-03-19T06:19:52.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.637+0000 7f7e20a00640 1 -- start start 2024-03-19T06:19:52.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.638+0000 7f7e20a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e1c101890 0x7f7e1c197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:52.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.638+0000 7f7e20a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c1078a0 0x7f7e1c197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:52.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.638+0000 7f7e20a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c1980e0 con 0x7f7e1c1078a0 2024-03-19T06:19:52.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.638+0000 7f7e20a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c19beb0 con 0x7f7e1c101890 2024-03-19T06:19:52.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.638+0000 7f7e19400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c1078a0 0x7f7e1c197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:52.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.638+0000 7f7e19400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c1078a0 0x7f7e1c197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55250/0 (socket says 172.21.15.72:55250) 2024-03-19T06:19:52.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.638+0000 7f7e19400640 1 -- 172.21.15.72:0/2835685900 learned_addr learned my addr 172.21.15.72:0/2835685900 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:52.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.638+0000 7f7e19400640 1 -- 172.21.15.72:0/2835685900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e1c101890 msgr2=0x7f7e1c197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:52.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.638+0000 7f7e19400640 1 --2- 172.21.15.72:0/2835685900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e1c101890 0x7f7e1c197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.638+0000 7f7e19400640 1 -- 172.21.15.72:0/2835685900 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04009560 con 0x7f7e1c1078a0 2024-03-19T06:19:52.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.639+0000 7f7e19400640 1 --2- 172.21.15.72:0/2835685900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c1078a0 0x7f7e1c197a50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7e04036040 tx=0x7f7e04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:52.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.639+0000 7f7e12a00640 1 -- 172.21.15.72:0/2835685900 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e040035f0 con 0x7f7e1c1078a0 2024-03-19T06:19:52.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.639+0000 7f7e12a00640 1 -- 172.21.15.72:0/2835685900 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e04003c10 con 0x7f7e1c1078a0 2024-03-19T06:19:52.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.639+0000 7f7e12a00640 1 -- 172.21.15.72:0/2835685900 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e04034440 con 0x7f7e1c1078a0 2024-03-19T06:19:52.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.639+0000 7f7e20a00640 1 -- 172.21.15.72:0/2835685900 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c19c130 con 0x7f7e1c1078a0 2024-03-19T06:19:52.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.639+0000 7f7e20a00640 1 -- 172.21.15.72:0/2835685900 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c19c710 con 0x7f7e1c1078a0 2024-03-19T06:19:52.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.640+0000 7f7e20a00640 1 -- 172.21.15.72:0/2835685900 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c04e000 con 0x7f7e1c1078a0 2024-03-19T06:19:52.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.641+0000 7f7e12a00640 1 -- 172.21.15.72:0/2835685900 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f7e04005060 con 0x7f7e1c1078a0 2024-03-19T06:19:52.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.642+0000 7f7e12a00640 1 --2- 172.21.15.72:0/2835685900 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7e0006df10 0x7f7e000703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:52.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.642+0000 7f7e12a00640 1 -- 172.21.15.72:0/2835685900 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7e040b02b0 con 0x7f7e1c1078a0 2024-03-19T06:19:52.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.642+0000 7f7e19e00640 1 --2- 172.21.15.72:0/2835685900 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7e0006df10 0x7f7e000703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:52.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.643+0000 7f7e19e00640 1 --2- 172.21.15.72:0/2835685900 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7e0006df10 0x7f7e000703c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c1029d0 tx=0x7f7e0c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:52.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.647+0000 7f7e12a00640 1 -- 172.21.15.72:0/2835685900 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f7e04079630 con 0x7f7e1c1078a0 2024-03-19T06:19:52.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.881+0000 7f7e20a00640 1 -- 172.21.15.72:0/2835685900 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f7e1c198860 con 0x7f7e1c1078a0 2024-03-19T06:19:52.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.882+0000 7f7e12a00640 1 -- 172.21.15.72:0/2835685900 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v44) v1 ==== 107+0+5003 (secure 0 0 0) 0x7f7e0407ccf0 con 0x7f7e1c1078a0 2024-03-19T06:19:52.870 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:52.870 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34510,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/3957356790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3957356790},{"type":"v1","addr":"172.21.15.72:6829","nonce":3957356790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44287,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/1022637060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1022637060},{"type":"v1","addr":"172.21.15.172:6825","nonce":1022637060}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":44309,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3126751850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3126751850},{"type":"v1","addr":"172.21.15.172:6827","nonce":3126751850}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:14:55.853268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34488},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34488":{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":38,"state":"up:rejoin","state_seq":23,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:52.870 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 40 2024-03-19T06:19:52.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.885+0000 7f7e20a00640 1 -- 172.21.15.72:0/2835685900 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7e0006df10 msgr2=0x7f7e000703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.885+0000 7f7e20a00640 1 --2- 172.21.15.72:0/2835685900 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7e0006df10 0x7f7e000703c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c1029d0 tx=0x7f7e0c005f90 comp rx=0 tx=0).stop 2024-03-19T06:19:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.885+0000 7f7e20a00640 1 -- 172.21.15.72:0/2835685900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c1078a0 msgr2=0x7f7e1c197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.885+0000 7f7e20a00640 1 --2- 172.21.15.72:0/2835685900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c1078a0 0x7f7e1c197a50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7e04036040 tx=0x7f7e04004270 comp rx=0 tx=0).stop 2024-03-19T06:19:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.885+0000 7f7e20a00640 1 -- 172.21.15.72:0/2835685900 shutdown_connections 2024-03-19T06:19:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.885+0000 7f7e20a00640 1 --2- 172.21.15.72:0/2835685900 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f7e0006df10 0x7f7e000703c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.885+0000 7f7e20a00640 1 --2- 172.21.15.72:0/2835685900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c1078a0 0x7f7e1c197a50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.885+0000 7f7e20a00640 1 --2- 172.21.15.72:0/2835685900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e1c101890 0x7f7e1c197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.885+0000 7f7e20a00640 1 -- 172.21.15.72:0/2835685900 >> 172.21.15.72:0/2835685900 conn(0x7f7e1c0fd390 msgr2=0x7f7e1c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.885+0000 7f7e20a00640 1 -- 172.21.15.72:0/2835685900 shutdown_connections 2024-03-19T06:19:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:52.885+0000 7f7e20a00640 1 -- 172.21.15.72:0/2835685900 wait complete. 2024-03-19T06:19:52.891 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-03-19T06:19:52.892 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 41 2024-03-19T06:19:53.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.116+0000 7f06a3c00640 1 -- 172.21.15.72:0/227410512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069c1078a0 msgr2=0x7f069c107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:53.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.116+0000 7f06a3c00640 1 --2- 172.21.15.72:0/227410512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069c1078a0 0x7f069c107c70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0690009880 tx=0x7f069002bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.117+0000 7f06a3c00640 1 -- 172.21.15.72:0/227410512 shutdown_connections 2024-03-19T06:19:53.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.117+0000 7f06a3c00640 1 --2- 172.21.15.72:0/227410512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f069c101890 0x7f069c101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.117+0000 7f06a3c00640 1 --2- 172.21.15.72:0/227410512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069c1078a0 0x7f069c107c70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.117+0000 7f06a3c00640 1 -- 172.21.15.72:0/227410512 >> 172.21.15.72:0/227410512 conn(0x7f069c0fd390 msgr2=0x7f069c0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:53.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.117+0000 7f06a3c00640 1 -- 172.21.15.72:0/227410512 shutdown_connections 2024-03-19T06:19:53.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.117+0000 7f06a3c00640 1 -- 172.21.15.72:0/227410512 wait complete. 2024-03-19T06:19:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.118+0000 7f06a3c00640 1 Processor -- start 2024-03-19T06:19:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.118+0000 7f06a3c00640 1 -- start start 2024-03-19T06:19:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.118+0000 7f06a3c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f069c101890 0x7f069c1975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.118+0000 7f06a3c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069c1078a0 0x7f069c197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.118+0000 7f06a3c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c1981b0 con 0x7f069c1078a0 2024-03-19T06:19:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.118+0000 7f06a3c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c19bf80 con 0x7f069c101890 2024-03-19T06:19:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.118+0000 7f069be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069c1078a0 0x7f069c197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.118+0000 7f069be00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069c1078a0 0x7f069c197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55264/0 (socket says 172.21.15.72:55264) 2024-03-19T06:19:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.118+0000 7f069be00640 1 -- 172.21.15.72:0/3557662156 learned_addr learned my addr 172.21.15.72:0/3557662156 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.119+0000 7f069be00640 1 -- 172.21.15.72:0/3557662156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f069c101890 msgr2=0x7f069c1975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.119+0000 7f069be00640 1 --2- 172.21.15.72:0/3557662156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f069c101890 0x7f069c1975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.119+0000 7f069be00640 1 -- 172.21.15.72:0/3557662156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690009560 con 0x7f069c1078a0 2024-03-19T06:19:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.119+0000 7f069be00640 1 --2- 172.21.15.72:0/3557662156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069c1078a0 0x7f069c197b20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f068800d6f0 tx=0x7f068800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:53.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.119+0000 7f0699600640 1 -- 172.21.15.72:0/3557662156 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0688009a30 con 0x7f069c1078a0 2024-03-19T06:19:53.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.119+0000 7f0699600640 1 -- 172.21.15.72:0/3557662156 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06880054e0 con 0x7f069c1078a0 2024-03-19T06:19:53.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.119+0000 7f0699600640 1 -- 172.21.15.72:0/3557662156 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0688010460 con 0x7f069c1078a0 2024-03-19T06:19:53.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.119+0000 7f06a3c00640 1 -- 172.21.15.72:0/3557662156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c19c260 con 0x7f069c1078a0 2024-03-19T06:19:53.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.120+0000 7f06a3c00640 1 -- 172.21.15.72:0/3557662156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c19c7c0 con 0x7f069c1078a0 2024-03-19T06:19:53.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.121+0000 7f06a3c00640 1 -- 172.21.15.72:0/3557662156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c04e000 con 0x7f069c1078a0 2024-03-19T06:19:53.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.122+0000 7f0699600640 1 -- 172.21.15.72:0/3557662156 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f0688009b90 con 0x7f069c1078a0 2024-03-19T06:19:53.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.123+0000 7f0699600640 1 --2- 172.21.15.72:0/3557662156 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f068406df10 0x7f06840703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:53.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.123+0000 7f0699600640 1 -- 172.21.15.72:0/3557662156 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f068808d9f0 con 0x7f069c1078a0 2024-03-19T06:19:53.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.123+0000 7f06a1200640 1 --2- 172.21.15.72:0/3557662156 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f068406df10 0x7f06840703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:53.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.124+0000 7f06a1200640 1 --2- 172.21.15.72:0/3557662156 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f068406df10 0x7f06840703c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f069002efd0 tx=0x7f0690000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:53.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.129+0000 7f0699600640 1 -- 172.21.15.72:0/3557662156 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f0688056d70 con 0x7f069c1078a0 2024-03-19T06:19:53.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.365+0000 7f06a3c00640 1 -- 172.21.15.72:0/3557662156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f069c10ebc0 con 0x7f069c1078a0 2024-03-19T06:19:53.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.366+0000 7f0699600640 1 -- 172.21.15.72:0/3557662156 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v44) v1 ==== 107+0+5003 (secure 0 0 0) 0x7f068805a430 con 0x7f069c1078a0 2024-03-19T06:19:53.354 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:53.354 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34510,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/3957356790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3957356790},{"type":"v1","addr":"172.21.15.72:6829","nonce":3957356790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44287,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/1022637060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1022637060},{"type":"v1","addr":"172.21.15.172:6825","nonce":1022637060}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":44309,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3126751850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3126751850},{"type":"v1","addr":"172.21.15.172:6827","nonce":3126751850}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:14:56.933834+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34488},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34488":{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":38,"state":"up:active","state_seq":24,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:53.354 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 41 2024-03-19T06:19:53.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.369+0000 7f06a3c00640 1 -- 172.21.15.72:0/3557662156 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f068406df10 msgr2=0x7f06840703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:53.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.369+0000 7f06a3c00640 1 --2- 172.21.15.72:0/3557662156 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f068406df10 0x7f06840703c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f069002efd0 tx=0x7f0690000bc0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.369+0000 7f06a3c00640 1 -- 172.21.15.72:0/3557662156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069c1078a0 msgr2=0x7f069c197b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.369+0000 7f06a3c00640 1 --2- 172.21.15.72:0/3557662156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069c1078a0 0x7f069c197b20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f068800d6f0 tx=0x7f068800dbb0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.369+0000 7f06a3c00640 1 -- 172.21.15.72:0/3557662156 shutdown_connections 2024-03-19T06:19:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.369+0000 7f06a3c00640 1 --2- 172.21.15.72:0/3557662156 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f068406df10 0x7f06840703c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.369+0000 7f06a3c00640 1 --2- 172.21.15.72:0/3557662156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069c1078a0 0x7f069c197b20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.369+0000 7f06a3c00640 1 --2- 172.21.15.72:0/3557662156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f069c101890 0x7f069c1975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.369+0000 7f06a3c00640 1 -- 172.21.15.72:0/3557662156 >> 172.21.15.72:0/3557662156 conn(0x7f069c0fd390 msgr2=0x7f069c0fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.369+0000 7f06a3c00640 1 -- 172.21.15.72:0/3557662156 shutdown_connections 2024-03-19T06:19:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.369+0000 7f06a3c00640 1 -- 172.21.15.72:0/3557662156 wait complete. 2024-03-19T06:19:53.376 DEBUG:tasks.fs:max_mds reduced in epoch 41 2024-03-19T06:19:53.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 42 2024-03-19T06:19:53.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:53 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/966653416' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-03-19T06:19:53.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:53 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2835685900' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-03-19T06:19:53.453 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:53 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/966653416' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-03-19T06:19:53.453 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:53 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2835685900' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-03-19T06:19:53.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.604+0000 7f074da00640 1 -- 172.21.15.72:0/2532331602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0748072600 msgr2=0x7f07480729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:53.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.604+0000 7f074da00640 1 --2- 172.21.15.72:0/2532331602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0748072600 0x7f07480729d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0738009880 tx=0x7f073802bd90 comp rx=0 tx=0).stop 2024-03-19T06:19:53.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.604+0000 7f074da00640 1 -- 172.21.15.72:0/2532331602 shutdown_connections 2024-03-19T06:19:53.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.604+0000 7f074da00640 1 --2- 172.21.15.72:0/2532331602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0748072f10 0x7f074810ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.604+0000 7f074da00640 1 --2- 172.21.15.72:0/2532331602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0748072600 0x7f07480729d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.604+0000 7f074da00640 1 -- 172.21.15.72:0/2532331602 >> 172.21.15.72:0/2532331602 conn(0x7f07480fafb0 msgr2=0x7f07480fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:53.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.604+0000 7f074da00640 1 -- 172.21.15.72:0/2532331602 shutdown_connections 2024-03-19T06:19:53.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.604+0000 7f074da00640 1 -- 172.21.15.72:0/2532331602 wait complete. 2024-03-19T06:19:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.605+0000 7f074da00640 1 Processor -- start 2024-03-19T06:19:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.605+0000 7f074da00640 1 -- start start 2024-03-19T06:19:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.606+0000 7f074da00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0748072600 0x7f074819b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.606+0000 7f074da00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0748072f10 0x7f074819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.606+0000 7f074da00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074819c260 con 0x7f0748072f10 2024-03-19T06:19:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.606+0000 7f074da00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074819efc0 con 0x7f0748072600 2024-03-19T06:19:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.606+0000 7f073f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0748072f10 0x7f074819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.606+0000 7f073f400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0748072f10 0x7f074819bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55282/0 (socket says 172.21.15.72:55282) 2024-03-19T06:19:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.606+0000 7f073f400640 1 -- 172.21.15.72:0/1033799583 learned_addr learned my addr 172.21.15.72:0/1033799583 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.606+0000 7f0747e00640 1 --2- 172.21.15.72:0/1033799583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0748072600 0x7f074819b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.606+0000 7f073f400640 1 -- 172.21.15.72:0/1033799583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0748072600 msgr2=0x7f074819b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.606+0000 7f073f400640 1 --2- 172.21.15.72:0/1033799583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0748072600 0x7f074819b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.607+0000 7f073f400640 1 -- 172.21.15.72:0/1033799583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0738009560 con 0x7f0748072f10 2024-03-19T06:19:53.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.607+0000 7f073f400640 1 --2- 172.21.15.72:0/1033799583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0748072f10 0x7f074819bc10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f073000c8a0 tx=0x7f073000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.607+0000 7f0745600640 1 -- 172.21.15.72:0/1033799583 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0730007b80 con 0x7f0748072f10 2024-03-19T06:19:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.607+0000 7f0745600640 1 -- 172.21.15.72:0/1033799583 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0730007ce0 con 0x7f0748072f10 2024-03-19T06:19:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.607+0000 7f074da00640 1 -- 172.21.15.72:0/1033799583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074819f2a0 con 0x7f0748072f10 2024-03-19T06:19:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.607+0000 7f0745600640 1 -- 172.21.15.72:0/1033799583 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0730018810 con 0x7f0748072f10 2024-03-19T06:19:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.607+0000 7f074da00640 1 -- 172.21.15.72:0/1033799583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074819f800 con 0x7f0748072f10 2024-03-19T06:19:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.608+0000 7f074da00640 1 -- 172.21.15.72:0/1033799583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074804e000 con 0x7f0748072f10 2024-03-19T06:19:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.609+0000 7f0745600640 1 -- 172.21.15.72:0/1033799583 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f0730018970 con 0x7f0748072f10 2024-03-19T06:19:53.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.610+0000 7f0745600640 1 --2- 172.21.15.72:0/1033799583 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f072c06df10 0x7f072c0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:53.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.610+0000 7f0745600640 1 -- 172.21.15.72:0/1033799583 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f073008df70 con 0x7f0748072f10 2024-03-19T06:19:53.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.610+0000 7f0747e00640 1 --2- 172.21.15.72:0/1033799583 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f072c06df10 0x7f072c0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:53.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.611+0000 7f0747e00640 1 --2- 172.21.15.72:0/1033799583 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f072c06df10 0x7f072c0703c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0738036040 tx=0x7f0738005a40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.615+0000 7f0745600640 1 -- 172.21.15.72:0/1033799583 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f0730057370 con 0x7f0748072f10 2024-03-19T06:19:53.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.851+0000 7f074da00640 1 -- 172.21.15.72:0/1033799583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7f074810d670 con 0x7f0748072f10 2024-03-19T06:19:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.853+0000 7f0745600640 1 -- 172.21.15.72:0/1033799583 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v44) v1 ==== 107+0+5003 (secure 0 0 0) 0x7f073005aa30 con 0x7f0748072f10 2024-03-19T06:19:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:53.841 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34510,"name":"cephfs.smithi072.dvdjwb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6829/3957356790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3957356790},{"type":"v1","addr":"172.21.15.72:6829","nonce":3957356790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34},{"gid":44287,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/1022637060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1022637060},{"type":"v1","addr":"172.21.15.172:6825","nonce":1022637060}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":44309,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3126751850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3126751850},{"type":"v1","addr":"172.21.15.172:6827","nonce":3126751850}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:15:09.281830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0],"up":{"mds_0":34488},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34488":{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":38,"state":"up:active","state_seq":24,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 42 2024-03-19T06:19:53.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.855+0000 7f074da00640 1 -- 172.21.15.72:0/1033799583 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f072c06df10 msgr2=0x7f072c0703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:53.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.855+0000 7f074da00640 1 --2- 172.21.15.72:0/1033799583 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f072c06df10 0x7f072c0703c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0738036040 tx=0x7f0738005a40 comp rx=0 tx=0).stop 2024-03-19T06:19:53.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.855+0000 7f074da00640 1 -- 172.21.15.72:0/1033799583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0748072f10 msgr2=0x7f074819bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:53.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.855+0000 7f074da00640 1 --2- 172.21.15.72:0/1033799583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0748072f10 0x7f074819bc10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f073000c8a0 tx=0x7f073000cd60 comp rx=0 tx=0).stop 2024-03-19T06:19:53.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.856+0000 7f074da00640 1 -- 172.21.15.72:0/1033799583 shutdown_connections 2024-03-19T06:19:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.856+0000 7f074da00640 1 --2- 172.21.15.72:0/1033799583 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f072c06df10 0x7f072c0703c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.856+0000 7f074da00640 1 --2- 172.21.15.72:0/1033799583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0748072f10 0x7f074819bc10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.856+0000 7f074da00640 1 --2- 172.21.15.72:0/1033799583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0748072600 0x7f074819b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.856+0000 7f074da00640 1 -- 172.21.15.72:0/1033799583 >> 172.21.15.72:0/1033799583 conn(0x7f07480fafb0 msgr2=0x7f0748101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.856+0000 7f074da00640 1 -- 172.21.15.72:0/1033799583 shutdown_connections 2024-03-19T06:19:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:53.856+0000 7f074da00640 1 -- 172.21.15.72:0/1033799583 wait complete. 2024-03-19T06:19:53.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 43 2024-03-19T06:19:54.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.083+0000 7f2f83e00640 1 -- 172.21.15.72:0/2456663537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f841016b0 msgr2=0x7f2f84101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:54.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.083+0000 7f2f83e00640 1 --2- 172.21.15.72:0/2456663537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f841016b0 0x7f2f84101b20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009880 tx=0x7f2f7002bcf0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.083+0000 7f2f83e00640 1 -- 172.21.15.72:0/2456663537 shutdown_connections 2024-03-19T06:19:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.083+0000 7f2f83e00640 1 --2- 172.21.15.72:0/2456663537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f841016b0 0x7f2f84101b20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.083+0000 7f2f83e00640 1 --2- 172.21.15.72:0/2456663537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f841076c0 0x7f2f84107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.083+0000 7f2f83e00640 1 -- 172.21.15.72:0/2456663537 >> 172.21.15.72:0/2456663537 conn(0x7f2f840fd1b0 msgr2=0x7f2f840ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.083+0000 7f2f83e00640 1 -- 172.21.15.72:0/2456663537 shutdown_connections 2024-03-19T06:19:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.083+0000 7f2f83e00640 1 -- 172.21.15.72:0/2456663537 wait complete. 2024-03-19T06:19:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.084+0000 7f2f83e00640 1 Processor -- start 2024-03-19T06:19:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.084+0000 7f2f83e00640 1 -- start start 2024-03-19T06:19:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.084+0000 7f2f83e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f841016b0 0x7f2f84197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.085+0000 7f2f83e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f841076c0 0x7f2f841978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.085+0000 7f2f83e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84197eb0 con 0x7f2f841076c0 2024-03-19T06:19:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.085+0000 7f2f83e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84198020 con 0x7f2f841016b0 2024-03-19T06:19:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.085+0000 7f2f82000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f841076c0 0x7f2f841978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.085+0000 7f2f82000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f841076c0 0x7f2f841978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47288/0 (socket says 172.21.15.72:47288) 2024-03-19T06:19:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.085+0000 7f2f82000640 1 -- 172.21.15.72:0/4055446182 learned_addr learned my addr 172.21.15.72:0/4055446182 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.085+0000 7f2f82000640 1 -- 172.21.15.72:0/4055446182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f841016b0 msgr2=0x7f2f84197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.085+0000 7f2f82000640 1 --2- 172.21.15.72:0/4055446182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f841016b0 0x7f2f84197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.085+0000 7f2f82000640 1 -- 172.21.15.72:0/4055446182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70009560 con 0x7f2f841076c0 2024-03-19T06:19:54.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.085+0000 7f2f82000640 1 --2- 172.21.15.72:0/4055446182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f841076c0 0x7f2f841978b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2f70036040 tx=0x7f2f70004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:54.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.086+0000 7f2f7b400640 1 -- 172.21.15.72:0/4055446182 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f700035f0 con 0x7f2f841076c0 2024-03-19T06:19:54.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.086+0000 7f2f7b400640 1 -- 172.21.15.72:0/4055446182 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f70003c10 con 0x7f2f841076c0 2024-03-19T06:19:54.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.086+0000 7f2f83e00640 1 -- 172.21.15.72:0/4055446182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8419be50 con 0x7f2f841076c0 2024-03-19T06:19:54.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.086+0000 7f2f7b400640 1 -- 172.21.15.72:0/4055446182 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f70034440 con 0x7f2f841076c0 2024-03-19T06:19:54.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.086+0000 7f2f83e00640 1 -- 172.21.15.72:0/4055446182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8419c3b0 con 0x7f2f841076c0 2024-03-19T06:19:54.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.087+0000 7f2f83e00640 1 -- 172.21.15.72:0/4055446182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8404e000 con 0x7f2f841076c0 2024-03-19T06:19:54.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.088+0000 7f2f7b400640 1 -- 172.21.15.72:0/4055446182 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f2f70005060 con 0x7f2f841076c0 2024-03-19T06:19:54.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.089+0000 7f2f7b400640 1 --2- 172.21.15.72:0/4055446182 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2f6806df10 0x7f2f680703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:54.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.089+0000 7f2f7b400640 1 -- 172.21.15.72:0/4055446182 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2f700b0230 con 0x7f2f841076c0 2024-03-19T06:19:54.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.090+0000 7f2f82a00640 1 --2- 172.21.15.72:0/4055446182 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2f6806df10 0x7f2f680703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:54.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.090+0000 7f2f82a00640 1 --2- 172.21.15.72:0/4055446182 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2f6806df10 0x7f2f680703c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2f841027f0 tx=0x7f2f74005c90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:54.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.094+0000 7f2f7b400640 1 -- 172.21.15.72:0/4055446182 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f2f70079650 con 0x7f2f841076c0 2024-03-19T06:19:54.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.330+0000 7f2f83e00640 1 -- 172.21.15.72:0/4055446182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 43, "format": "json"} v 0) v1 -- 0x7f2f840008d0 con 0x7f2f841076c0 2024-03-19T06:19:54.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.331+0000 7f2f7b400640 1 -- 172.21.15.72:0/4055446182 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 43, "format": "json"}]=0 dumped fsmap epoch 43 v44) v1 ==== 107+0+5020 (secure 0 0 0) 0x7f2f7007cd10 con 0x7f2f841076c0 2024-03-19T06:19:54.319 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:54.319 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44287,"name":"cephfs.smithi172.xlokxp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/1022637060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1022637060},{"type":"v1","addr":"172.21.15.172:6825","nonce":1022637060}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36},{"gid":44309,"name":"cephfs.smithi172.nparnw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3126751850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3126751850},{"type":"v1","addr":"172.21.15.172:6827","nonce":3126751850}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:00:52.215249+0000","modified":"2024-03-19T06:15:10.281818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34488,"mds_1":34510},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34488":{"gid":34488,"name":"cephfs.smithi072.jhxzfi","rank":0,"incarnation":38,"state":"up:active","state_seq":24,"addr":"172.21.15.72:6827/4267492414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4267492414},{"type":"v1","addr":"172.21.15.72:6827","nonce":4267492414}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34510":{"gid":34510,"name":"cephfs.smithi072.dvdjwb","rank":1,"incarnation":43,"state":"up:starting","state_seq":1,"addr":"172.21.15.72:6829/3957356790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3957356790},{"type":"v1","addr":"172.21.15.72:6829","nonce":3957356790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:19:54.319 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 43 2024-03-19T06:19:54.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.334+0000 7f2f83e00640 1 -- 172.21.15.72:0/4055446182 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2f6806df10 msgr2=0x7f2f680703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:54.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.334+0000 7f2f83e00640 1 --2- 172.21.15.72:0/4055446182 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2f6806df10 0x7f2f680703c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2f841027f0 tx=0x7f2f74005c90 comp rx=0 tx=0).stop 2024-03-19T06:19:54.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.334+0000 7f2f83e00640 1 -- 172.21.15.72:0/4055446182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f841076c0 msgr2=0x7f2f841978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:54.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.334+0000 7f2f83e00640 1 --2- 172.21.15.72:0/4055446182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f841076c0 0x7f2f841978b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2f70036040 tx=0x7f2f70004270 comp rx=0 tx=0).stop 2024-03-19T06:19:54.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.334+0000 7f2f83e00640 1 -- 172.21.15.72:0/4055446182 shutdown_connections 2024-03-19T06:19:54.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.334+0000 7f2f83e00640 1 --2- 172.21.15.72:0/4055446182 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f2f6806df10 0x7f2f680703c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.334+0000 7f2f83e00640 1 --2- 172.21.15.72:0/4055446182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f841076c0 0x7f2f841978b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.334+0000 7f2f83e00640 1 --2- 172.21.15.72:0/4055446182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f841016b0 0x7f2f84197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.334+0000 7f2f83e00640 1 -- 172.21.15.72:0/4055446182 >> 172.21.15.72:0/4055446182 conn(0x7f2f840fd1b0 msgr2=0x7f2f840feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:54.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.335+0000 7f2f83e00640 1 -- 172.21.15.72:0/4055446182 shutdown_connections 2024-03-19T06:19:54.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.335+0000 7f2f83e00640 1 -- 172.21.15.72:0/4055446182 wait complete. 2024-03-19T06:19:54.341 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-19T06:19:54.353 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-19T06:19:54.354 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T06:19:54.354 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:19:54.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:54 smithi172 ceph-mon[66682]: pgmap v412: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:54.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:54 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3557662156' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-03-19T06:19:54.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:54 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1033799583' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-03-19T06:19:54.406 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T06:19:54.406 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:19:54.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:19:54.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:54 smithi072 ceph-mon[78545]: pgmap v412: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:54.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:54 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3557662156' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-03-19T06:19:54.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:54 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1033799583' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-03-19T06:19:54.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.748+0000 7fb60a000640 1 -- 172.21.15.72:0/3888963110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb604100a40 msgr2=0x7fb604100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:54.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.748+0000 7fb60a000640 1 --2- 172.21.15.72:0/3888963110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb604100a40 0x7fb604100e10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40098b0 tx=0x7fb5f402bcd0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.748+0000 7fb60a000640 1 -- 172.21.15.72:0/3888963110 shutdown_connections 2024-03-19T06:19:54.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.748+0000 7fb60a000640 1 --2- 172.21.15.72:0/3888963110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb604101350 0x7fb604109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.748+0000 7fb60a000640 1 --2- 172.21.15.72:0/3888963110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb604100a40 0x7fb604100e10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.748+0000 7fb60a000640 1 -- 172.21.15.72:0/3888963110 >> 172.21.15.72:0/3888963110 conn(0x7fb6040fa270 msgr2=0x7fb6040fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:54.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.749+0000 7fb60a000640 1 -- 172.21.15.72:0/3888963110 shutdown_connections 2024-03-19T06:19:54.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.749+0000 7fb60a000640 1 -- 172.21.15.72:0/3888963110 wait complete. 2024-03-19T06:19:54.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.749+0000 7fb60a000640 1 Processor -- start 2024-03-19T06:19:54.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.750+0000 7fb60a000640 1 -- start start 2024-03-19T06:19:54.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.750+0000 7fb60a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb604100a40 0x7fb604197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:54.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.750+0000 7fb60a000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb604101350 0x7fb604197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:54.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.750+0000 7fb60a000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb604198230 con 0x7fb604100a40 2024-03-19T06:19:54.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.750+0000 7fb60a000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60419c000 con 0x7fb604101350 2024-03-19T06:19:54.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.750+0000 7fb603400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb604100a40 0x7fb604197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:54.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.750+0000 7fb603400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb604100a40 0x7fb604197660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47318/0 (socket says 172.21.15.72:47318) 2024-03-19T06:19:54.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.750+0000 7fb603400640 1 -- 172.21.15.72:0/3107218123 learned_addr learned my addr 172.21.15.72:0/3107218123 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:54.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.751+0000 7fb603400640 1 -- 172.21.15.72:0/3107218123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb604101350 msgr2=0x7fb604197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:54.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.751+0000 7fb603400640 1 --2- 172.21.15.72:0/3107218123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb604101350 0x7fb604197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.751+0000 7fb603400640 1 -- 172.21.15.72:0/3107218123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4009560 con 0x7fb604100a40 2024-03-19T06:19:54.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.751+0000 7fb603400640 1 --2- 172.21.15.72:0/3107218123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb604100a40 0x7fb604197660 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb5f402c210 tx=0x7fb5f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:54.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.751+0000 7fb5fbe00640 1 -- 172.21.15.72:0/3107218123 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f40037c0 con 0x7fb604100a40 2024-03-19T06:19:54.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.751+0000 7fb5fbe00640 1 -- 172.21.15.72:0/3107218123 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5f4003de0 con 0x7fb604100a40 2024-03-19T06:19:54.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.751+0000 7fb60a000640 1 -- 172.21.15.72:0/3107218123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60419c280 con 0x7fb604100a40 2024-03-19T06:19:54.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.751+0000 7fb5fbe00640 1 -- 172.21.15.72:0/3107218123 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f403e680 con 0x7fb604100a40 2024-03-19T06:19:54.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.751+0000 7fb60a000640 1 -- 172.21.15.72:0/3107218123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60419c7e0 con 0x7fb604100a40 2024-03-19T06:19:54.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.752+0000 7fb60a000640 1 -- 172.21.15.72:0/3107218123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60404e000 con 0x7fb604100a40 2024-03-19T06:19:54.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.753+0000 7fb5fbe00640 1 -- 172.21.15.72:0/3107218123 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fb5f4003920 con 0x7fb604100a40 2024-03-19T06:19:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.754+0000 7fb5fbe00640 1 --2- 172.21.15.72:0/3107218123 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb5e806dfd0 0x7fb5e8070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.754+0000 7fb5fbe00640 1 -- 172.21.15.72:0/3107218123 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb5f40b0bb0 con 0x7fb604100a40 2024-03-19T06:19:54.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.754+0000 7fb602a00640 1 --2- 172.21.15.72:0/3107218123 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb5e806dfd0 0x7fb5e8070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:54.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.755+0000 7fb602a00640 1 --2- 172.21.15.72:0/3107218123 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb5e806dfd0 0x7fb5e8070480 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb604198c70 tx=0x7fb5f0005bf0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:54.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.758+0000 7fb5fbe00640 1 -- 172.21.15.72:0/3107218123 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fb5f4079f30 con 0x7fb604100a40 2024-03-19T06:19:54.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.976+0000 7fb60a000640 1 -- 172.21.15.72:0/3107218123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb604198a50 con 0x7fb604100a40 2024-03-19T06:19:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.979+0000 7fb5fbe00640 1 -- 172.21.15.72:0/3107218123 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16764 (secure 0 0 0) 0x7fb5f407d5f0 con 0x7fb604100a40 2024-03-19T06:19:54.967 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:54.967 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":83,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","created":"2024-03-19T05:51:14.734187+0000","modified":"2024-03-19T06:14:49.470998+0000","last_up_change":"2024-03-19T06:12:35.210984+0000","last_in_change":"2024-03-19T05:58:47.988240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T05:57:27.222850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-03-19T06:00:50.787240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-03-19T06:00:51.727393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"215fcddf-0352-4fb1-b006-edd278832a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":823954487},{"type":"v1","addr":"172.21.15.72:6803","nonce":823954487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":823954487},{"type":"v1","addr":"172.21.15.72:6805","nonce":823954487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":823954487},{"type":"v1","addr":"172.21.15.72:6809","nonce":823954487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":823954487},{"type":"v1","addr":"172.21.15.72:6807","nonce":823954487}]},"public_addr":"172.21.15.72:6803/823954487","cluster_addr":"172.21.15.72:6805/823954487","heartbeat_back_addr":"172.21.15.72:6809/823954487","heartbeat_front_addr":"172.21.15.72:6807/823954487","state":["exists","up"]},{"osd":1,"uuid":"f52e39bf-bbfe-48c3-bf4f-70cae6b4e57c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2275618942},{"type":"v1","addr":"172.21.15.72:6811","nonce":2275618942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2275618942},{"type":"v1","addr":"172.21.15.72:6813","nonce":2275618942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2275618942},{"type":"v1","addr":"172.21.15.72:6817","nonce":2275618942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2275618942},{"type":"v1","addr":"172.21.15.72:6815","nonce":2275618942}]},"public_addr":"172.21.15.72:6811/2275618942","cluster_addr":"172.21.15.72:6813/2275618942","heartbeat_back_addr":"172.21.15.72:6817/2275618942","heartbeat_front_addr":"172.21.15.72:6815/2275618942","state":["exists","up"]},{"osd":2,"uuid":"ddcccb72-1a1e-4d0a-8d61-4fa48d91cba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":517254227},{"type":"v1","addr":"172.21.15.72:6819","nonce":517254227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":517254227},{"type":"v1","addr":"172.21.15.72:6821","nonce":517254227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":517254227},{"type":"v1","addr":"172.21.15.72:6825","nonce":517254227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":517254227},{"type":"v1","addr":"172.21.15.72:6823","nonce":517254227}]},"public_addr":"172.21.15.72:6819/517254227","cluster_addr":"172.21.15.72:6821/517254227","heartbeat_back_addr":"172.21.15.72:6825/517254227","heartbeat_front_addr":"172.21.15.72:6823/517254227","state":["exists","up"]},{"osd":3,"uuid":"27291f1a-1705-4da7-a15a-4ddc099c08ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2721074858},{"type":"v1","addr":"172.21.15.172:6801","nonce":2721074858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2721074858},{"type":"v1","addr":"172.21.15.172:6803","nonce":2721074858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2721074858},{"type":"v1","addr":"172.21.15.172:6807","nonce":2721074858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2721074858},{"type":"v1","addr":"172.21.15.172:6805","nonce":2721074858}]},"public_addr":"172.21.15.172:6801/2721074858","cluster_addr":"172.21.15.172:6803/2721074858","heartbeat_back_addr":"172.21.15.172:6807/2721074858","heartbeat_front_addr":"172.21.15.172:6805/2721074858","state":["exists","up"]},{"osd":4,"uuid":"88b90845-3e0a-4e4d-80e9-7a70e25dbfac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1295620546},{"type":"v1","addr":"172.21.15.172:6809","nonce":1295620546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1295620546},{"type":"v1","addr":"172.21.15.172:6811","nonce":1295620546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1295620546},{"type":"v1","addr":"172.21.15.172:6815","nonce":1295620546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1295620546},{"type":"v1","addr":"172.21.15.172:6813","nonce":1295620546}]},"public_addr":"172.21.15.172:6809/1295620546","cluster_addr":"172.21.15.172:6811/1295620546","heartbeat_back_addr":"172.21.15.172:6815/1295620546","heartbeat_front_addr":"172.21.15.172:6813/1295620546","state":["exists","up"]},{"osd":5,"uuid":"6095500f-8c30-475a-8f69-ab85226b2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1857818067},{"type":"v1","addr":"172.21.15.172:6817","nonce":1857818067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1857818067},{"type":"v1","addr":"172.21.15.172:6819","nonce":1857818067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1857818067},{"type":"v1","addr":"172.21.15.172:6823","nonce":1857818067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1857818067},{"type":"v1","addr":"172.21.15.172:6821","nonce":1857818067}]},"public_addr":"172.21.15.172:6817/1857818067","cluster_addr":"172.21.15.172:6819/1857818067","heartbeat_back_addr":"172.21.15.172:6823/1857818067","heartbeat_front_addr":"172.21.15.172:6821/1857818067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:10.113377+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:46.911606+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:57:24.691482+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:01.632867+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:35.570288+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:59:10.181140+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6826/363477076":"2024-03-20T06:14:49.470935+0000","172.21.15.172:6827/363477076":"2024-03-20T06:14:49.470935+0000","172.21.15.72:6827/772635337":"2024-03-20T06:13:19.631192+0000","172.21.15.72:0/4199454850":"2024-03-20T06:04:03.942401+0000","172.21.15.172:0/2707855483":"2024-03-20T06:05:12.456606+0000","172.21.15.72:6800/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/3195993518":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/3627388017":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/3141025630":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6800/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6828/1218260294":"2024-03-20T06:13:54.895628+0000","172.21.15.72:0/1631679569":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6801/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/1450624542":"2024-03-20T05:54:30.519459+0000","172.21.15.172:0/1790535528":"2024-03-20T06:05:12.456606+0000","172.21.15.72:0/3229768069":"2024-03-20T05:52:50.595473+0000","172.21.15.172:6828/1633747146":"2024-03-20T06:05:12.456606+0000","172.21.15.72:0/2295310555":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6829/1218260294":"2024-03-20T06:13:54.895628+0000","172.21.15.172:0/268667195":"2024-03-20T06:05:12.456606+0000","172.21.15.172:0/3155967807":"2024-03-20T06:05:12.456606+0000","172.21.15.72:0/1795725640":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6800/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6801/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6800/1154232723":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/495048474":"2024-03-20T06:07:24.636011+0000","172.21.15.72:6801/1154232723":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/2582270882":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/1827861673":"2024-03-20T05:54:30.519459+0000","172.21.15.172:0/3565787740":"2024-03-20T06:05:12.456606+0000","172.21.15.172:6829/1633747146":"2024-03-20T06:05:12.456606+0000","172.21.15.72:6800/2640845307":"2024-03-20T06:07:24.636011+0000","172.21.15.72:6801/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/1944964087":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/3793616122":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/1127443989":"2024-03-20T06:07:24.636011+0000","172.21.15.172:0/3813007324":"2024-03-20T06:05:12.456606+0000","172.21.15.72:0/939742318":"2024-03-20T06:07:24.636011+0000","172.21.15.72:0/986207477":"2024-03-20T06:07:24.636011+0000","172.21.15.72:6801/2640845307":"2024-03-20T06:07:24.636011+0000","172.21.15.72:6826/772635337":"2024-03-20T06:13:19.631192+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:19:54.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.982+0000 7fb60a000640 1 -- 172.21.15.72:0/3107218123 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb5e806dfd0 msgr2=0x7fb5e8070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.982+0000 7fb60a000640 1 --2- 172.21.15.72:0/3107218123 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb5e806dfd0 0x7fb5e8070480 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb604198c70 tx=0x7fb5f0005bf0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.982+0000 7fb60a000640 1 -- 172.21.15.72:0/3107218123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb604100a40 msgr2=0x7fb604197660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.982+0000 7fb60a000640 1 --2- 172.21.15.72:0/3107218123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb604100a40 0x7fb604197660 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb5f402c210 tx=0x7fb5f4004270 comp rx=0 tx=0).stop 2024-03-19T06:19:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.982+0000 7fb60a000640 1 -- 172.21.15.72:0/3107218123 shutdown_connections 2024-03-19T06:19:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.982+0000 7fb60a000640 1 --2- 172.21.15.72:0/3107218123 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fb5e806dfd0 0x7fb5e8070480 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.982+0000 7fb60a000640 1 --2- 172.21.15.72:0/3107218123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb604101350 0x7fb604197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.982+0000 7fb60a000640 1 --2- 172.21.15.72:0/3107218123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb604100a40 0x7fb604197660 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.982+0000 7fb60a000640 1 -- 172.21.15.72:0/3107218123 >> 172.21.15.72:0/3107218123 conn(0x7fb6040fa270 msgr2=0x7fb6040fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.982+0000 7fb60a000640 1 -- 172.21.15.72:0/3107218123 shutdown_connections 2024-03-19T06:19:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:54.982+0000 7fb60a000640 1 -- 172.21.15.72:0/3107218123 wait complete. 2024-03-19T06:19:54.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T05:57:27.222850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-03-19T06:00:50.787240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-03-19T06:00:51.727393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:19:54.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:19:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.249+0000 7efe69c00640 1 -- 172.21.15.72:0/4019052945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe64104590 msgr2=0x7efe64104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.249+0000 7efe69c00640 1 --2- 172.21.15.72:0/4019052945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe64104590 0x7efe64104960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efe54009c20 tx=0x7efe5402c1b0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.249+0000 7efe69c00640 1 -- 172.21.15.72:0/4019052945 shutdown_connections 2024-03-19T06:19:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.249+0000 7efe69c00640 1 --2- 172.21.15.72:0/4019052945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe640fe5b0 0x7efe640fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.249+0000 7efe69c00640 1 --2- 172.21.15.72:0/4019052945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe64104590 0x7efe64104960 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.249+0000 7efe69c00640 1 -- 172.21.15.72:0/4019052945 >> 172.21.15.72:0/4019052945 conn(0x7efe640743d0 msgr2=0x7efe640747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.249+0000 7efe69c00640 1 -- 172.21.15.72:0/4019052945 shutdown_connections 2024-03-19T06:19:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.249+0000 7efe69c00640 1 -- 172.21.15.72:0/4019052945 wait complete. 2024-03-19T06:19:55.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.250+0000 7efe69c00640 1 Processor -- start 2024-03-19T06:19:55.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.250+0000 7efe69c00640 1 -- start start 2024-03-19T06:19:55.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.251+0000 7efe69c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe640fe5b0 0x7efe641952e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:55.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.251+0000 7efe69c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe64104590 0x7efe64195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.251+0000 7efe69c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe64195eb0 con 0x7efe64104590 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.251+0000 7efe69c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe64199c80 con 0x7efe640fe5b0 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.251+0000 7efe5a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe64104590 0x7efe64195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.251+0000 7efe5a000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe64104590 0x7efe64195820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47338/0 (socket says 172.21.15.72:47338) 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.251+0000 7efe5a000640 1 -- 172.21.15.72:0/769568573 learned_addr learned my addr 172.21.15.72:0/769568573 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.251+0000 7efe62a00640 1 --2- 172.21.15.72:0/769568573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe640fe5b0 0x7efe641952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.251+0000 7efe5a000640 1 -- 172.21.15.72:0/769568573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe640fe5b0 msgr2=0x7efe641952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.251+0000 7efe5a000640 1 --2- 172.21.15.72:0/769568573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe640fe5b0 0x7efe641952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.251+0000 7efe5a000640 1 -- 172.21.15.72:0/769568573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe54009900 con 0x7efe64104590 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.251+0000 7efe62a00640 1 --2- 172.21.15.72:0/769568573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe640fe5b0 0x7efe641952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.252+0000 7efe5a000640 1 --2- 172.21.15.72:0/769568573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe64104590 0x7efe64195820 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00d6f0 tx=0x7efe4c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.252+0000 7efe5be00640 1 -- 172.21.15.72:0/769568573 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe4c009a30 con 0x7efe64104590 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.252+0000 7efe5be00640 1 -- 172.21.15.72:0/769568573 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe4c0054e0 con 0x7efe64104590 2024-03-19T06:19:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.252+0000 7efe5be00640 1 -- 172.21.15.72:0/769568573 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe4c010460 con 0x7efe64104590 2024-03-19T06:19:55.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.252+0000 7efe69c00640 1 -- 172.21.15.72:0/769568573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe64199f60 con 0x7efe64104590 2024-03-19T06:19:55.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.252+0000 7efe69c00640 1 -- 172.21.15.72:0/769568573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6419a540 con 0x7efe64104590 2024-03-19T06:19:55.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.254+0000 7efe69c00640 1 -- 172.21.15.72:0/769568573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6404e000 con 0x7efe64104590 2024-03-19T06:19:55.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.255+0000 7efe5be00640 1 -- 172.21.15.72:0/769568573 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7efe4c009b90 con 0x7efe64104590 2024-03-19T06:19:55.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.256+0000 7efe5be00640 1 --2- 172.21.15.72:0/769568573 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efe4806df10 0x7efe480703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:55.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.256+0000 7efe5be00640 1 -- 172.21.15.72:0/769568573 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efe4c08d850 con 0x7efe64104590 2024-03-19T06:19:55.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.256+0000 7efe62a00640 1 --2- 172.21.15.72:0/769568573 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efe4806df10 0x7efe480703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:55.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.257+0000 7efe62a00640 1 --2- 172.21.15.72:0/769568573 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efe4806df10 0x7efe480703c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efe54009430 tx=0x7efe54000f40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:55.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.261+0000 7efe5be00640 1 -- 172.21.15.72:0/769568573 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7efe4c056cf0 con 0x7efe64104590 2024-03-19T06:19:55.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:55 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/4055446182' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-03-19T06:19:55.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:19:55.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:55 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3107218123' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T06:19:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.464+0000 7efe69c00640 1 -- 172.21.15.72:0/769568573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe6410b860 con 0x7efe64104590 2024-03-19T06:19:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.465+0000 7efe5be00640 1 -- 172.21.15.72:0/769568573 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe4c05a3b0 con 0x7efe64104590 2024-03-19T06:19:55.452 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-19T06:19:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.468+0000 7efe69c00640 1 -- 172.21.15.72:0/769568573 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efe4806df10 msgr2=0x7efe480703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.468+0000 7efe69c00640 1 --2- 172.21.15.72:0/769568573 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efe4806df10 0x7efe480703c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efe54009430 tx=0x7efe54000f40 comp rx=0 tx=0).stop 2024-03-19T06:19:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.468+0000 7efe69c00640 1 -- 172.21.15.72:0/769568573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe64104590 msgr2=0x7efe64195820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.468+0000 7efe69c00640 1 --2- 172.21.15.72:0/769568573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe64104590 0x7efe64195820 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00d6f0 tx=0x7efe4c00dbb0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.468+0000 7efe69c00640 1 -- 172.21.15.72:0/769568573 shutdown_connections 2024-03-19T06:19:55.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.468+0000 7efe69c00640 1 --2- 172.21.15.72:0/769568573 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7efe4806df10 0x7efe480703c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.468+0000 7efe69c00640 1 --2- 172.21.15.72:0/769568573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe64104590 0x7efe64195820 secure :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00d6f0 tx=0x7efe4c00dbb0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.468+0000 7efe69c00640 1 --2- 172.21.15.72:0/769568573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe640fe5b0 0x7efe641952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.468+0000 7efe69c00640 1 -- 172.21.15.72:0/769568573 >> 172.21.15.72:0/769568573 conn(0x7efe640743d0 msgr2=0x7efe64067310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:55.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.468+0000 7efe69c00640 1 -- 172.21.15.72:0/769568573 shutdown_connections 2024-03-19T06:19:55.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.468+0000 7efe69c00640 1 -- 172.21.15.72:0/769568573 wait complete. 2024-03-19T06:19:55.471 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-03-19T06:19:55.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:55 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/4055446182' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-03-19T06:19:55.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:19:55.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:55 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3107218123' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T06:19:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.678+0000 7f6f7ee00640 1 -- 172.21.15.72:0/52064358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f78067310 msgr2=0x7f6f78067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.678+0000 7f6f7ee00640 1 --2- 172.21.15.72:0/52064358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f78067310 0x7f6f78067780 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009880 tx=0x7f6f6402bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.678+0000 7f6f7ee00640 1 -- 172.21.15.72:0/52064358 shutdown_connections 2024-03-19T06:19:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.678+0000 7f6f7ee00640 1 --2- 172.21.15.72:0/52064358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f78067310 0x7f6f78067780 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.678+0000 7f6f7ee00640 1 --2- 172.21.15.72:0/52064358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f78105550 0x7f6f78105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.678+0000 7f6f7ee00640 1 -- 172.21.15.72:0/52064358 >> 172.21.15.72:0/52064358 conn(0x7f6f780743d0 msgr2=0x7f6f780747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:55.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.678+0000 7f6f7ee00640 1 -- 172.21.15.72:0/52064358 shutdown_connections 2024-03-19T06:19:55.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.679+0000 7f6f7ee00640 1 -- 172.21.15.72:0/52064358 wait complete. 2024-03-19T06:19:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.679+0000 7f6f7ee00640 1 Processor -- start 2024-03-19T06:19:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.680+0000 7f6f7ee00640 1 -- start start 2024-03-19T06:19:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.680+0000 7f6f7ee00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f78067310 0x7f6f780fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.680+0000 7f6f7ee00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f78105550 0x7f6f780ff3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.680+0000 7f6f7ee00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780ff910 con 0x7f6f78105550 2024-03-19T06:19:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.680+0000 7f6f7ee00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780ffa80 con 0x7f6f78067310 2024-03-19T06:19:55.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.680+0000 7f6f7d000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f78105550 0x7f6f780ff3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:55.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.680+0000 7f6f7d000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f78105550 0x7f6f780ff3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47360/0 (socket says 172.21.15.72:47360) 2024-03-19T06:19:55.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.680+0000 7f6f7d000640 1 -- 172.21.15.72:0/2531020722 learned_addr learned my addr 172.21.15.72:0/2531020722 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:55.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.680+0000 7f6f7da00640 1 --2- 172.21.15.72:0/2531020722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f78067310 0x7f6f780fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:55.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.681+0000 7f6f7d000640 1 -- 172.21.15.72:0/2531020722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f78067310 msgr2=0x7f6f780fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:55.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.681+0000 7f6f7d000640 1 --2- 172.21.15.72:0/2531020722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f78067310 0x7f6f780fee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.681+0000 7f6f7d000640 1 -- 172.21.15.72:0/2531020722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f64009560 con 0x7f6f78105550 2024-03-19T06:19:55.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.681+0000 7f6f7da00640 1 --2- 172.21.15.72:0/2531020722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f78067310 0x7f6f780fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:19:55.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.681+0000 7f6f7d000640 1 --2- 172.21.15.72:0/2531020722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f78105550 0x7f6f780ff3d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009230 tx=0x7f6f64004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:55.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.681+0000 7f6f76000640 1 -- 172.21.15.72:0/2531020722 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f640035f0 con 0x7f6f78105550 2024-03-19T06:19:55.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.681+0000 7f6f76000640 1 -- 172.21.15.72:0/2531020722 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f64003c10 con 0x7f6f78105550 2024-03-19T06:19:55.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.681+0000 7f6f7ee00640 1 -- 172.21.15.72:0/2531020722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f780ffd00 con 0x7f6f78105550 2024-03-19T06:19:55.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.681+0000 7f6f76000640 1 -- 172.21.15.72:0/2531020722 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f64034440 con 0x7f6f78105550 2024-03-19T06:19:55.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.681+0000 7f6f7ee00640 1 -- 172.21.15.72:0/2531020722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f781a1580 con 0x7f6f78105550 2024-03-19T06:19:55.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.682+0000 7f6f7ee00640 1 -- 172.21.15.72:0/2531020722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7804e000 con 0x7f6f78105550 2024-03-19T06:19:55.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.684+0000 7f6f76000640 1 -- 172.21.15.72:0/2531020722 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f6f64004fd0 con 0x7f6f78105550 2024-03-19T06:19:55.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.684+0000 7f6f76000640 1 --2- 172.21.15.72:0/2531020722 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6f6006df10 0x7f6f600703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:55.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.685+0000 7f6f76000640 1 -- 172.21.15.72:0/2531020722 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6f640b0070 con 0x7f6f78105550 2024-03-19T06:19:55.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.685+0000 7f6f7da00640 1 --2- 172.21.15.72:0/2531020722 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6f6006df10 0x7f6f600703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:55.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.685+0000 7f6f7da00640 1 --2- 172.21.15.72:0/2531020722 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6f6006df10 0x7f6f600703c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00baa0 tx=0x7f6f6c005d90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:55.680 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.693+0000 7f6f76000640 1 -- 172.21.15.72:0/2531020722 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f6f64079470 con 0x7f6f78105550 2024-03-19T06:19:55.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.901+0000 7f6f7ee00640 1 -- 172.21.15.72:0/2531020722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f6f780ffd00 con 0x7f6f78105550 2024-03-19T06:19:55.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.901+0000 7f6f76000640 1 -- 172.21.15.72:0/2531020722 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6f64041020 con 0x7f6f78105550 2024-03-19T06:19:55.889 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-19T06:19:55.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.904+0000 7f6f7ee00640 1 -- 172.21.15.72:0/2531020722 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6f6006df10 msgr2=0x7f6f600703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:55.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.905+0000 7f6f7ee00640 1 --2- 172.21.15.72:0/2531020722 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6f6006df10 0x7f6f600703c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00baa0 tx=0x7f6f6c005d90 comp rx=0 tx=0).stop 2024-03-19T06:19:55.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.905+0000 7f6f7ee00640 1 -- 172.21.15.72:0/2531020722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f78105550 msgr2=0x7f6f780ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.905+0000 7f6f7ee00640 1 --2- 172.21.15.72:0/2531020722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f78105550 0x7f6f780ff3d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009230 tx=0x7f6f64004040 comp rx=0 tx=0).stop 2024-03-19T06:19:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.905+0000 7f6f7ee00640 1 -- 172.21.15.72:0/2531020722 shutdown_connections 2024-03-19T06:19:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.905+0000 7f6f7ee00640 1 --2- 172.21.15.72:0/2531020722 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f6f6006df10 0x7f6f600703c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.905+0000 7f6f7ee00640 1 --2- 172.21.15.72:0/2531020722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f78105550 0x7f6f780ff3d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.905+0000 7f6f7ee00640 1 --2- 172.21.15.72:0/2531020722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f78067310 0x7f6f780fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.905+0000 7f6f7ee00640 1 -- 172.21.15.72:0/2531020722 >> 172.21.15.72:0/2531020722 conn(0x7f6f780743d0 msgr2=0x7f6f780fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.905+0000 7f6f7ee00640 1 -- 172.21.15.72:0/2531020722 shutdown_connections 2024-03-19T06:19:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:55.905+0000 7f6f7ee00640 1 -- 172.21.15.72:0/2531020722 wait complete. 2024-03-19T06:19:55.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-03-19T06:19:56.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.126+0000 7f56a7e00640 1 -- 172.21.15.72:0/1870720378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56a00750a0 msgr2=0x7f56a010ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.126+0000 7f56a7e00640 1 --2- 172.21.15.72:0/1870720378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56a00750a0 0x7f56a010ff90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f568c009880 tx=0x7f568c02bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.126+0000 7f56a7e00640 1 -- 172.21.15.72:0/1870720378 shutdown_connections 2024-03-19T06:19:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.126+0000 7f56a7e00640 1 --2- 172.21.15.72:0/1870720378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56a00750a0 0x7f56a010ff90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.126+0000 7f56a7e00640 1 --2- 172.21.15.72:0/1870720378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0074790 0x7f56a0074b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.126+0000 7f56a7e00640 1 -- 172.21.15.72:0/1870720378 >> 172.21.15.72:0/1870720378 conn(0x7f56a00fd330 msgr2=0x7f56a00ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.126+0000 7f56a7e00640 1 -- 172.21.15.72:0/1870720378 shutdown_connections 2024-03-19T06:19:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.126+0000 7f56a7e00640 1 -- 172.21.15.72:0/1870720378 wait complete. 2024-03-19T06:19:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.127+0000 7f56a7e00640 1 Processor -- start 2024-03-19T06:19:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.127+0000 7f56a7e00640 1 -- start start 2024-03-19T06:19:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.127+0000 7f56a7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0074790 0x7f56a01a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.127+0000 7f56a7e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56a00750a0 0x7f56a01a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.127+0000 7f56a7e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a019b680 con 0x7f56a00750a0 2024-03-19T06:19:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.127+0000 7f56a7e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a019b7f0 con 0x7f56a0074790 2024-03-19T06:19:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.127+0000 7f56a4a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56a00750a0 0x7f56a01a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.127+0000 7f56a4a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56a00750a0 0x7f56a01a1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47382/0 (socket says 172.21.15.72:47382) 2024-03-19T06:19:56.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.127+0000 7f56a4a00640 1 -- 172.21.15.72:0/1204964946 learned_addr learned my addr 172.21.15.72:0/1204964946 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:56.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.128+0000 7f56a4a00640 1 -- 172.21.15.72:0/1204964946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0074790 msgr2=0x7f56a01a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:56.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.128+0000 7f56a5400640 1 --2- 172.21.15.72:0/1204964946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0074790 0x7f56a01a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:56.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.128+0000 7f56a4a00640 1 --2- 172.21.15.72:0/1204964946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0074790 0x7f56a01a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.128+0000 7f56a4a00640 1 -- 172.21.15.72:0/1204964946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c009560 con 0x7f56a00750a0 2024-03-19T06:19:56.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.128+0000 7f56a5400640 1 --2- 172.21.15.72:0/1204964946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0074790 0x7f56a01a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:19:56.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.128+0000 7f56a4a00640 1 --2- 172.21.15.72:0/1204964946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56a00750a0 0x7f56a01a1b50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f568c005ab0 tx=0x7f568c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:56.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.129+0000 7f569e000640 1 -- 172.21.15.72:0/1204964946 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f568c0035f0 con 0x7f56a00750a0 2024-03-19T06:19:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.129+0000 7f569e000640 1 -- 172.21.15.72:0/1204964946 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f568c003c10 con 0x7f56a00750a0 2024-03-19T06:19:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.129+0000 7f56a7e00640 1 -- 172.21.15.72:0/1204964946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a019ba70 con 0x7f56a00750a0 2024-03-19T06:19:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.129+0000 7f569e000640 1 -- 172.21.15.72:0/1204964946 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f568c034440 con 0x7f56a00750a0 2024-03-19T06:19:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.129+0000 7f56a7e00640 1 -- 172.21.15.72:0/1204964946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a019bf70 con 0x7f56a00750a0 2024-03-19T06:19:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.130+0000 7f56a7e00640 1 -- 172.21.15.72:0/1204964946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a004e000 con 0x7f56a00750a0 2024-03-19T06:19:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.131+0000 7f569e000640 1 -- 172.21.15.72:0/1204964946 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f568c004fd0 con 0x7f56a00750a0 2024-03-19T06:19:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.132+0000 7f569e000640 1 --2- 172.21.15.72:0/1204964946 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f568806df60 0x7f5688070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.132+0000 7f569e000640 1 -- 172.21.15.72:0/1204964946 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f568c0b03e0 con 0x7f56a00750a0 2024-03-19T06:19:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.132+0000 7f56a5400640 1 --2- 172.21.15.72:0/1204964946 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f568806df60 0x7f5688070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.133+0000 7f56a5400640 1 --2- 172.21.15.72:0/1204964946 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f568806df60 0x7f5688070410 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f56940058c0 tx=0x7f5694005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:56.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.136+0000 7f569e000640 1 -- 172.21.15.72:0/1204964946 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f568c079760 con 0x7f56a00750a0 2024-03-19T06:19:56.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.338+0000 7f56a7e00640 1 -- 172.21.15.72:0/1204964946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f56a019cbf0 con 0x7f56a00750a0 2024-03-19T06:19:56.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.339+0000 7f569e000640 1 -- 172.21.15.72:0/1204964946 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f568c07ce20 con 0x7f56a00750a0 2024-03-19T06:19:56.327 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-19T06:19:56.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.342+0000 7f56a7e00640 1 -- 172.21.15.72:0/1204964946 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f568806df60 msgr2=0x7f5688070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:56.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.342+0000 7f56a7e00640 1 --2- 172.21.15.72:0/1204964946 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f568806df60 0x7f5688070410 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f56940058c0 tx=0x7f5694005d30 comp rx=0 tx=0).stop 2024-03-19T06:19:56.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.342+0000 7f56a7e00640 1 -- 172.21.15.72:0/1204964946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56a00750a0 msgr2=0x7f56a01a1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:56.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.342+0000 7f56a7e00640 1 --2- 172.21.15.72:0/1204964946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56a00750a0 0x7f56a01a1b50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f568c005ab0 tx=0x7f568c004270 comp rx=0 tx=0).stop 2024-03-19T06:19:56.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.342+0000 7f56a7e00640 1 -- 172.21.15.72:0/1204964946 shutdown_connections 2024-03-19T06:19:56.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.342+0000 7f56a7e00640 1 --2- 172.21.15.72:0/1204964946 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f568806df60 0x7f5688070410 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.342+0000 7f56a7e00640 1 --2- 172.21.15.72:0/1204964946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56a00750a0 0x7f56a01a1b50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.342+0000 7f56a7e00640 1 --2- 172.21.15.72:0/1204964946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a0074790 0x7f56a01a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.342+0000 7f56a7e00640 1 -- 172.21.15.72:0/1204964946 >> 172.21.15.72:0/1204964946 conn(0x7f56a00fd330 msgr2=0x7f56a00fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:56.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.342+0000 7f56a7e00640 1 -- 172.21.15.72:0/1204964946 shutdown_connections 2024-03-19T06:19:56.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.342+0000 7f56a7e00640 1 -- 172.21.15.72:0/1204964946 wait complete. 2024-03-19T06:19:56.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:19:56.424 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:56 smithi072 ceph-mon[78545]: pgmap v413: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:56.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:56 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/769568573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-19T06:19:56.425 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:56 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/2531020722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-19T06:19:56.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.568+0000 7f55f5800640 1 -- 172.21.15.72:0/1574843958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55f0072600 msgr2=0x7f55f00729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:56.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.568+0000 7f55f5800640 1 --2- 172.21.15.72:0/1574843958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55f0072600 0x7f55f00729d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009880 tx=0x7f55e002bd80 comp rx=0 tx=0).stop 2024-03-19T06:19:56.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.568+0000 7f55f5800640 1 -- 172.21.15.72:0/1574843958 shutdown_connections 2024-03-19T06:19:56.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.568+0000 7f55f5800640 1 --2- 172.21.15.72:0/1574843958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55f0072f10 0x7f55f010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.568+0000 7f55f5800640 1 --2- 172.21.15.72:0/1574843958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55f0072600 0x7f55f00729d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.568+0000 7f55f5800640 1 -- 172.21.15.72:0/1574843958 >> 172.21.15.72:0/1574843958 conn(0x7f55f00fb320 msgr2=0x7f55f00fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:56.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.568+0000 7f55f5800640 1 -- 172.21.15.72:0/1574843958 shutdown_connections 2024-03-19T06:19:56.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.568+0000 7f55f5800640 1 -- 172.21.15.72:0/1574843958 wait complete. 2024-03-19T06:19:56.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.569+0000 7f55f5800640 1 Processor -- start 2024-03-19T06:19:56.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.569+0000 7f55f5800640 1 -- start start 2024-03-19T06:19:56.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.570+0000 7f55f5800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55f0072600 0x7f55f019d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:56.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.570+0000 7f55f5800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55f0072f10 0x7f55f019da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:56.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.570+0000 7f55f5800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0197580 con 0x7f55f0072600 2024-03-19T06:19:56.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.570+0000 7f55f5800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f01976f0 con 0x7f55f0072f10 2024-03-19T06:19:56.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.570+0000 7f55eea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55f0072600 0x7f55f019d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:56.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.570+0000 7f55eea00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55f0072600 0x7f55f019d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47404/0 (socket says 172.21.15.72:47404) 2024-03-19T06:19:56.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.570+0000 7f55eea00640 1 -- 172.21.15.72:0/3678675707 learned_addr learned my addr 172.21.15.72:0/3678675707 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:56.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.570+0000 7f55eea00640 1 -- 172.21.15.72:0/3678675707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55f0072f10 msgr2=0x7f55f019da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:56.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.570+0000 7f55ee000640 1 --2- 172.21.15.72:0/3678675707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55f0072f10 0x7f55f019da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:56.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.571+0000 7f55eea00640 1 --2- 172.21.15.72:0/3678675707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55f0072f10 0x7f55f019da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.571+0000 7f55eea00640 1 -- 172.21.15.72:0/3678675707 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e0009560 con 0x7f55f0072600 2024-03-19T06:19:56.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.571+0000 7f55eea00640 1 --2- 172.21.15.72:0/3678675707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55f0072600 0x7f55f019d510 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009230 tx=0x7f55e0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:56.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.571+0000 7f55e7400640 1 -- 172.21.15.72:0/3678675707 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55e00035f0 con 0x7f55f0072600 2024-03-19T06:19:56.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.571+0000 7f55e7400640 1 -- 172.21.15.72:0/3678675707 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55e0003c10 con 0x7f55f0072600 2024-03-19T06:19:56.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.571+0000 7f55f5800640 1 -- 172.21.15.72:0/3678675707 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f0197970 con 0x7f55f0072600 2024-03-19T06:19:56.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.571+0000 7f55e7400640 1 -- 172.21.15.72:0/3678675707 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55e003e450 con 0x7f55f0072600 2024-03-19T06:19:56.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.571+0000 7f55f5800640 1 -- 172.21.15.72:0/3678675707 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f0197ed0 con 0x7f55f0072600 2024-03-19T06:19:56.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.572+0000 7f55f5800640 1 -- 172.21.15.72:0/3678675707 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f004e000 con 0x7f55f0072600 2024-03-19T06:19:56.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.573+0000 7f55e7400640 1 -- 172.21.15.72:0/3678675707 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f55e0004ff0 con 0x7f55f0072600 2024-03-19T06:19:56.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.574+0000 7f55e7400640 1 --2- 172.21.15.72:0/3678675707 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f55d406dfd0 0x7f55d4070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:56.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.574+0000 7f55e7400640 1 -- 172.21.15.72:0/3678675707 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f55e00b09f0 con 0x7f55f0072600 2024-03-19T06:19:56.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.574+0000 7f55ee000640 1 --2- 172.21.15.72:0/3678675707 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f55d406dfd0 0x7f55d4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:56.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.575+0000 7f55ee000640 1 --2- 172.21.15.72:0/3678675707 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f55d406dfd0 0x7f55d4070480 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55f00fca50 tx=0x7f55dc008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:56.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.579+0000 7f55e7400640 1 -- 172.21.15.72:0/3678675707 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f55e0079df0 con 0x7f55f0072600 2024-03-19T06:19:56.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:56 smithi172 ceph-mon[66682]: pgmap v413: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:56.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:56 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/769568573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-19T06:19:56.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:56 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/2531020722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-19T06:19:56.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.787+0000 7f55f5800640 1 -- 172.21.15.72:0/3678675707 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f55f0198a90 con 0x7f55f0072600 2024-03-19T06:19:56.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.788+0000 7f55e7400640 1 -- 172.21.15.72:0/3678675707 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v83) v1 ==== 81+0+2434 (secure 0 0 0) 0x7f55e007d4b0 con 0x7f55f0072600 2024-03-19T06:19:56.775 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:6826/363477076 2024-03-20T06:14:49.470935+0000 2024-03-19T06:19:56.775 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:6827/363477076 2024-03-20T06:14:49.470935+0000 2024-03-19T06:19:56.775 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6827/772635337 2024-03-20T06:13:19.631192+0000 2024-03-19T06:19:56.775 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/4199454850 2024-03-20T06:04:03.942401+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:0/2707855483 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/2294511988 2024-03-20T05:52:50.595473+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3195993518 2024-03-20T06:04:03.942401+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3627388017 2024-03-20T05:52:08.433691+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3141025630 2024-03-20T05:52:50.595473+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/3022348314 2024-03-20T05:52:08.433691+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6828/1218260294 2024-03-20T06:13:54.895628+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1631679569 2024-03-20T05:52:50.595473+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/3022348314 2024-03-20T05:52:08.433691+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1450624542 2024-03-20T05:54:30.519459+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:0/1790535528 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3229768069 2024-03-20T05:52:50.595473+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:6828/1633747146 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:56.776 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2295310555 2024-03-20T05:52:08.433691+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6829/1218260294 2024-03-20T06:13:54.895628+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:0/268667195 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:0/3155967807 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1795725640 2024-03-20T05:52:08.433691+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/1922058375 2024-03-20T05:54:30.519459+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/1922058375 2024-03-20T05:54:30.519459+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/1154232723 2024-03-20T06:04:03.942401+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/495048474 2024-03-20T06:07:24.636011+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/1154232723 2024-03-20T06:04:03.942401+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2582270882 2024-03-20T05:54:30.519459+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1827861673 2024-03-20T05:54:30.519459+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:0/3565787740 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:6829/1633747146 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/2640845307 2024-03-20T06:07:24.636011+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/2294511988 2024-03-20T05:52:50.595473+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1944964087 2024-03-20T06:04:03.942401+0000 2024-03-19T06:19:56.777 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3793616122 2024-03-20T06:04:03.942401+0000 2024-03-19T06:19:56.778 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1127443989 2024-03-20T06:07:24.636011+0000 2024-03-19T06:19:56.778 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:0/3813007324 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:56.778 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/939742318 2024-03-20T06:07:24.636011+0000 2024-03-19T06:19:56.778 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/986207477 2024-03-20T06:07:24.636011+0000 2024-03-19T06:19:56.778 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/2640845307 2024-03-20T06:07:24.636011+0000 2024-03-19T06:19:56.778 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6826/772635337 2024-03-20T06:13:19.631192+0000 2024-03-19T06:19:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:listed 41 entries 2024-03-19T06:19:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.790+0000 7f55f5800640 1 -- 172.21.15.72:0/3678675707 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f55d406dfd0 msgr2=0x7f55d4070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.790+0000 7f55f5800640 1 --2- 172.21.15.72:0/3678675707 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f55d406dfd0 0x7f55d4070480 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55f00fca50 tx=0x7f55dc008040 comp rx=0 tx=0).stop 2024-03-19T06:19:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.790+0000 7f55f5800640 1 -- 172.21.15.72:0/3678675707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55f0072600 msgr2=0x7f55f019d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.790+0000 7f55f5800640 1 --2- 172.21.15.72:0/3678675707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55f0072600 0x7f55f019d510 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009230 tx=0x7f55e0004040 comp rx=0 tx=0).stop 2024-03-19T06:19:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.791+0000 7f55f5800640 1 -- 172.21.15.72:0/3678675707 shutdown_connections 2024-03-19T06:19:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.791+0000 7f55f5800640 1 --2- 172.21.15.72:0/3678675707 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f55d406dfd0 0x7f55d4070480 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.791+0000 7f55f5800640 1 --2- 172.21.15.72:0/3678675707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55f0072f10 0x7f55f019da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.791+0000 7f55f5800640 1 --2- 172.21.15.72:0/3678675707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55f0072600 0x7f55f019d510 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:56.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.791+0000 7f55f5800640 1 -- 172.21.15.72:0/3678675707 >> 172.21.15.72:0/3678675707 conn(0x7f55f00fb320 msgr2=0x7f55f0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:56.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.791+0000 7f55f5800640 1 -- 172.21.15.72:0/3678675707 shutdown_connections 2024-03-19T06:19:56.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:56.791+0000 7f55f5800640 1 -- 172.21.15.72:0/3678675707 wait complete. 2024-03-19T06:19:56.797 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-19T06:19:56.797 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:19:56.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:19:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.065+0000 7f3a71c00640 1 -- 172.21.15.72:0/3474423253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a6c101870 msgr2=0x7f3a6c101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.065+0000 7f3a71c00640 1 --2- 172.21.15.72:0/3474423253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a6c101870 0x7f3a6c101ce0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009880 tx=0x7f3a5802bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.065+0000 7f3a71c00640 1 -- 172.21.15.72:0/3474423253 shutdown_connections 2024-03-19T06:19:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.065+0000 7f3a71c00640 1 --2- 172.21.15.72:0/3474423253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a6c101870 0x7f3a6c101ce0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.065+0000 7f3a71c00640 1 --2- 172.21.15.72:0/3474423253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a6c107880 0x7f3a6c107c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.065+0000 7f3a71c00640 1 -- 172.21.15.72:0/3474423253 >> 172.21.15.72:0/3474423253 conn(0x7f3a6c0fd370 msgr2=0x7f3a6c0ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.065+0000 7f3a71c00640 1 -- 172.21.15.72:0/3474423253 shutdown_connections 2024-03-19T06:19:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.065+0000 7f3a71c00640 1 -- 172.21.15.72:0/3474423253 wait complete. 2024-03-19T06:19:57.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.066+0000 7f3a71c00640 1 Processor -- start 2024-03-19T06:19:57.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.066+0000 7f3a71c00640 1 -- start start 2024-03-19T06:19:57.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.067+0000 7f3a71c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a6c101870 0x7f3a6c197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:57.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.067+0000 7f3a71c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a6c107880 0x7f3a6c1978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:57.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.067+0000 7f3a71c00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c197f60 con 0x7f3a6c101870 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.067+0000 7f3a71c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c19bd30 con 0x7f3a6c107880 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.067+0000 7f3a6aa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a6c101870 0x7f3a6c197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.067+0000 7f3a6aa00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a6c101870 0x7f3a6c197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47428/0 (socket says 172.21.15.72:47428) 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.067+0000 7f3a6aa00640 1 -- 172.21.15.72:0/982938883 learned_addr learned my addr 172.21.15.72:0/982938883 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.067+0000 7f3a6aa00640 1 -- 172.21.15.72:0/982938883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a6c107880 msgr2=0x7f3a6c1978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.067+0000 7f3a6aa00640 1 --2- 172.21.15.72:0/982938883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a6c107880 0x7f3a6c1978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.067+0000 7f3a6aa00640 1 -- 172.21.15.72:0/982938883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a58009560 con 0x7f3a6c101870 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.067+0000 7f3a6aa00640 1 --2- 172.21.15.72:0/982938883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a6c101870 0x7f3a6c197390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c8f0 tx=0x7f3a5c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.068+0000 7f3a63400640 1 -- 172.21.15.72:0/982938883 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a5c007b80 con 0x7f3a6c101870 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.068+0000 7f3a63400640 1 -- 172.21.15.72:0/982938883 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a5c007ce0 con 0x7f3a6c101870 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.068+0000 7f3a71c00640 1 -- 172.21.15.72:0/982938883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c19c010 con 0x7f3a6c101870 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.068+0000 7f3a63400640 1 -- 172.21.15.72:0/982938883 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a5c018870 con 0x7f3a6c101870 2024-03-19T06:19:57.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.068+0000 7f3a71c00640 1 -- 172.21.15.72:0/982938883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c19c5f0 con 0x7f3a6c101870 2024-03-19T06:19:57.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.069+0000 7f3a71c00640 1 -- 172.21.15.72:0/982938883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c04e000 con 0x7f3a6c101870 2024-03-19T06:19:57.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.070+0000 7f3a63400640 1 -- 172.21.15.72:0/982938883 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f3a5c0189d0 con 0x7f3a6c101870 2024-03-19T06:19:57.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.071+0000 7f3a63400640 1 --2- 172.21.15.72:0/982938883 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3a5006dfd0 0x7f3a50070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:57.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.071+0000 7f3a63400640 1 -- 172.21.15.72:0/982938883 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3a5c08deb0 con 0x7f3a6c101870 2024-03-19T06:19:57.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.071+0000 7f3a6a000640 1 --2- 172.21.15.72:0/982938883 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3a5006dfd0 0x7f3a50070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:57.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.072+0000 7f3a6a000640 1 --2- 172.21.15.72:0/982938883 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3a5006dfd0 0x7f3a50070480 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3a5802efd0 tx=0x7f3a58000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:57.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.075+0000 7f3a63400640 1 -- 172.21.15.72:0/982938883 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f3a5c0572b0 con 0x7f3a6c101870 2024-03-19T06:19:57.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.276+0000 7f3a71c00640 1 -- 172.21.15.72:0/982938883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a6c1986e0 con 0x7f3a6c101870 2024-03-19T06:19:57.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.278+0000 7f3a63400640 1 -- 172.21.15.72:0/982938883 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16764 (secure 0 0 0) 0x7f3a5c05a970 con 0x7f3a6c101870 2024-03-19T06:19:57.266 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-19T06:19:57.266 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":83,"fsid":"9ad98512-e5b4-11ee-95c9-87774f69a715","created":"2024-03-19T05:51:14.734187+0000","modified":"2024-03-19T06:14:49.470998+0000","last_up_change":"2024-03-19T06:12:35.210984+0000","last_in_change":"2024-03-19T05:58:47.988240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T05:57:27.222850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-03-19T06:00:50.787240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-03-19T06:00:51.727393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"215fcddf-0352-4fb1-b006-edd278832a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":823954487},{"type":"v1","addr":"172.21.15.72:6803","nonce":823954487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":823954487},{"type":"v1","addr":"172.21.15.72:6805","nonce":823954487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":823954487},{"type":"v1","addr":"172.21.15.72:6809","nonce":823954487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":823954487},{"type":"v1","addr":"172.21.15.72:6807","nonce":823954487}]},"public_addr":"172.21.15.72:6803/823954487","cluster_addr":"172.21.15.72:6805/823954487","heartbeat_back_addr":"172.21.15.72:6809/823954487","heartbeat_front_addr":"172.21.15.72:6807/823954487","state":["exists","up"]},{"osd":1,"uuid":"f52e39bf-bbfe-48c3-bf4f-70cae6b4e57c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2275618942},{"type":"v1","addr":"172.21.15.72:6811","nonce":2275618942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2275618942},{"type":"v1","addr":"172.21.15.72:6813","nonce":2275618942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":2275618942},{"type":"v1","addr":"172.21.15.72:6817","nonce":2275618942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2275618942},{"type":"v1","addr":"172.21.15.72:6815","nonce":2275618942}]},"public_addr":"172.21.15.72:6811/2275618942","cluster_addr":"172.21.15.72:6813/2275618942","heartbeat_back_addr":"172.21.15.72:6817/2275618942","heartbeat_front_addr":"172.21.15.72:6815/2275618942","state":["exists","up"]},{"osd":2,"uuid":"ddcccb72-1a1e-4d0a-8d61-4fa48d91cba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":517254227},{"type":"v1","addr":"172.21.15.72:6819","nonce":517254227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":517254227},{"type":"v1","addr":"172.21.15.72:6821","nonce":517254227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":517254227},{"type":"v1","addr":"172.21.15.72:6825","nonce":517254227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":517254227},{"type":"v1","addr":"172.21.15.72:6823","nonce":517254227}]},"public_addr":"172.21.15.72:6819/517254227","cluster_addr":"172.21.15.72:6821/517254227","heartbeat_back_addr":"172.21.15.72:6825/517254227","heartbeat_front_addr":"172.21.15.72:6823/517254227","state":["exists","up"]},{"osd":3,"uuid":"27291f1a-1705-4da7-a15a-4ddc099c08ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2721074858},{"type":"v1","addr":"172.21.15.172:6801","nonce":2721074858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2721074858},{"type":"v1","addr":"172.21.15.172:6803","nonce":2721074858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2721074858},{"type":"v1","addr":"172.21.15.172:6807","nonce":2721074858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2721074858},{"type":"v1","addr":"172.21.15.172:6805","nonce":2721074858}]},"public_addr":"172.21.15.172:6801/2721074858","cluster_addr":"172.21.15.172:6803/2721074858","heartbeat_back_addr":"172.21.15.172:6807/2721074858","heartbeat_front_addr":"172.21.15.172:6805/2721074858","state":["exists","up"]},{"osd":4,"uuid":"88b90845-3e0a-4e4d-80e9-7a70e25dbfac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":1295620546},{"type":"v1","addr":"172.21.15.172:6809","nonce":1295620546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":1295620546},{"type":"v1","addr":"172.21.15.172:6811","nonce":1295620546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":1295620546},{"type":"v1","addr":"172.21.15.172:6815","nonce":1295620546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":1295620546},{"type":"v1","addr":"172.21.15.172:6813","nonce":1295620546}]},"public_addr":"172.21.15.172:6809/1295620546","cluster_addr":"172.21.15.172:6811/1295620546","heartbeat_back_addr":"172.21.15.172:6815/1295620546","heartbeat_front_addr":"172.21.15.172:6813/1295620546","state":["exists","up"]},{"osd":5,"uuid":"6095500f-8c30-475a-8f69-ab85226b2d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1857818067},{"type":"v1","addr":"172.21.15.172:6817","nonce":1857818067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1857818067},{"type":"v1","addr":"172.21.15.172:6819","nonce":1857818067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1857818067},{"type":"v1","addr":"172.21.15.172:6823","nonce":1857818067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1857818067},{"type":"v1","addr":"172.21.15.172:6821","nonce":1857818067}]},"public_addr":"172.21.15.172:6817/1857818067","cluster_addr":"172.21.15.172:6819/1857818067","heartbeat_back_addr":"172.21.15.172:6823/1857818067","heartbeat_front_addr":"172.21.15.172:6821/1857818067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:10.113377+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:56:46.911606+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:57:24.691482+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:01.632867+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:58:35.570288+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T05:59:10.181140+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6826/363477076":"2024-03-20T06:14:49.470935+0000","172.21.15.172:6827/363477076":"2024-03-20T06:14:49.470935+0000","172.21.15.72:6827/772635337":"2024-03-20T06:13:19.631192+0000","172.21.15.72:0/4199454850":"2024-03-20T06:04:03.942401+0000","172.21.15.172:0/2707855483":"2024-03-20T06:05:12.456606+0000","172.21.15.72:6800/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/3195993518":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/3627388017":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/3141025630":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6800/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6828/1218260294":"2024-03-20T06:13:54.895628+0000","172.21.15.72:0/1631679569":"2024-03-20T05:52:50.595473+0000","172.21.15.72:6801/3022348314":"2024-03-20T05:52:08.433691+0000","172.21.15.72:0/1450624542":"2024-03-20T05:54:30.519459+0000","172.21.15.172:0/1790535528":"2024-03-20T06:05:12.456606+0000","172.21.15.72:0/3229768069":"2024-03-20T05:52:50.595473+0000","172.21.15.172:6828/1633747146":"2024-03-20T06:05:12.456606+0000","172.21.15.72:0/2295310555":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6829/1218260294":"2024-03-20T06:13:54.895628+0000","172.21.15.172:0/268667195":"2024-03-20T06:05:12.456606+0000","172.21.15.172:0/3155967807":"2024-03-20T06:05:12.456606+0000","172.21.15.72:0/1795725640":"2024-03-20T05:52:08.433691+0000","172.21.15.72:6800/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6801/1922058375":"2024-03-20T05:54:30.519459+0000","172.21.15.72:6800/1154232723":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/495048474":"2024-03-20T06:07:24.636011+0000","172.21.15.72:6801/1154232723":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/2582270882":"2024-03-20T05:54:30.519459+0000","172.21.15.72:0/1827861673":"2024-03-20T05:54:30.519459+0000","172.21.15.172:0/3565787740":"2024-03-20T06:05:12.456606+0000","172.21.15.172:6829/1633747146":"2024-03-20T06:05:12.456606+0000","172.21.15.72:6800/2640845307":"2024-03-20T06:07:24.636011+0000","172.21.15.72:6801/2294511988":"2024-03-20T05:52:50.595473+0000","172.21.15.72:0/1944964087":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/3793616122":"2024-03-20T06:04:03.942401+0000","172.21.15.72:0/1127443989":"2024-03-20T06:07:24.636011+0000","172.21.15.172:0/3813007324":"2024-03-20T06:05:12.456606+0000","172.21.15.72:0/939742318":"2024-03-20T06:07:24.636011+0000","172.21.15.72:0/986207477":"2024-03-20T06:07:24.636011+0000","172.21.15.72:6801/2640845307":"2024-03-20T06:07:24.636011+0000","172.21.15.72:6826/772635337":"2024-03-20T06:13:19.631192+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:19:57.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.281+0000 7f3a71c00640 1 -- 172.21.15.72:0/982938883 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3a5006dfd0 msgr2=0x7f3a50070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:57.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.281+0000 7f3a71c00640 1 --2- 172.21.15.72:0/982938883 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3a5006dfd0 0x7f3a50070480 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3a5802efd0 tx=0x7f3a58000bc0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.281+0000 7f3a71c00640 1 -- 172.21.15.72:0/982938883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a6c101870 msgr2=0x7f3a6c197390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.281+0000 7f3a71c00640 1 --2- 172.21.15.72:0/982938883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a6c101870 0x7f3a6c197390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c8f0 tx=0x7f3a5c00cdb0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.281+0000 7f3a71c00640 1 -- 172.21.15.72:0/982938883 shutdown_connections 2024-03-19T06:19:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.281+0000 7f3a71c00640 1 --2- 172.21.15.72:0/982938883 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f3a5006dfd0 0x7f3a50070480 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.281+0000 7f3a71c00640 1 --2- 172.21.15.72:0/982938883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a6c107880 0x7f3a6c1978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.281+0000 7f3a71c00640 1 --2- 172.21.15.72:0/982938883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a6c101870 0x7f3a6c197390 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.281+0000 7f3a71c00640 1 -- 172.21.15.72:0/982938883 >> 172.21.15.72:0/982938883 conn(0x7f3a6c0fd370 msgr2=0x7f3a6c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.281+0000 7f3a71c00640 1 -- 172.21.15.72:0/982938883 shutdown_connections 2024-03-19T06:19:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.281+0000 7f3a71c00640 1 -- 172.21.15.72:0/982938883 wait complete. 2024-03-19T06:19:57.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T05:57:27.222850+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-03-19T06:00:50.787240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-03-19T06:00:51.727393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:19:57.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:19:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.511+0000 7fef65a00640 1 -- 172.21.15.72:0/1505683972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6010ac40 msgr2=0x7fef6010b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.511+0000 7fef65a00640 1 --2- 172.21.15.72:0/1505683972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6010ac40 0x7fef6010b010 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fef50009c20 tx=0x7fef5002c1b0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.511+0000 7fef65a00640 1 -- 172.21.15.72:0/1505683972 shutdown_connections 2024-03-19T06:19:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.511+0000 7fef65a00640 1 --2- 172.21.15.72:0/1505683972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef60106090 0x7fef601064e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.511+0000 7fef65a00640 1 --2- 172.21.15.72:0/1505683972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6010ac40 0x7fef6010b010 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.511+0000 7fef65a00640 1 -- 172.21.15.72:0/1505683972 >> 172.21.15.72:0/1505683972 conn(0x7fef60075490 msgr2=0x7fef600778a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.511+0000 7fef65a00640 1 -- 172.21.15.72:0/1505683972 shutdown_connections 2024-03-19T06:19:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.511+0000 7fef65a00640 1 -- 172.21.15.72:0/1505683972 wait complete. 2024-03-19T06:19:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.512+0000 7fef65a00640 1 Processor -- start 2024-03-19T06:19:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.512+0000 7fef65a00640 1 -- start start 2024-03-19T06:19:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.512+0000 7fef65a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef60106090 0x7fef601a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.512+0000 7fef65a00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6010ac40 0x7fef601a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.512+0000 7fef65a00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6019b6f0 con 0x7fef6010ac40 2024-03-19T06:19:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.513+0000 7fef65a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6019b860 con 0x7fef60106090 2024-03-19T06:19:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.513+0000 7fef56000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6010ac40 0x7fef601a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.513+0000 7fef56000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6010ac40 0x7fef601a1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47442/0 (socket says 172.21.15.72:47442) 2024-03-19T06:19:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.513+0000 7fef56000640 1 -- 172.21.15.72:0/1068845853 learned_addr learned my addr 172.21.15.72:0/1068845853 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.513+0000 7fef5ea00640 1 --2- 172.21.15.72:0/1068845853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef60106090 0x7fef601a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.513+0000 7fef56000640 1 -- 172.21.15.72:0/1068845853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef60106090 msgr2=0x7fef601a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.513+0000 7fef56000640 1 --2- 172.21.15.72:0/1068845853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef60106090 0x7fef601a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.513+0000 7fef56000640 1 -- 172.21.15.72:0/1068845853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50009900 con 0x7fef6010ac40 2024-03-19T06:19:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.514+0000 7fef56000640 1 --2- 172.21.15.72:0/1068845853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6010ac40 0x7fef601a1bc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fef4800c8f0 tx=0x7fef4800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.514+0000 7fef57e00640 1 -- 172.21.15.72:0/1068845853 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef48007b80 con 0x7fef6010ac40 2024-03-19T06:19:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.514+0000 7fef57e00640 1 -- 172.21.15.72:0/1068845853 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef480054e0 con 0x7fef6010ac40 2024-03-19T06:19:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.514+0000 7fef65a00640 1 -- 172.21.15.72:0/1068845853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6019bb40 con 0x7fef6010ac40 2024-03-19T06:19:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.514+0000 7fef57e00640 1 -- 172.21.15.72:0/1068845853 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef4800f450 con 0x7fef6010ac40 2024-03-19T06:19:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.514+0000 7fef65a00640 1 -- 172.21.15.72:0/1068845853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6019c120 con 0x7fef6010ac40 2024-03-19T06:19:57.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.515+0000 7fef65a00640 1 -- 172.21.15.72:0/1068845853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6004e000 con 0x7fef6010ac40 2024-03-19T06:19:57.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.517+0000 7fef57e00640 1 -- 172.21.15.72:0/1068845853 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7fef48004f60 con 0x7fef6010ac40 2024-03-19T06:19:57.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.518+0000 7fef57e00640 1 --2- 172.21.15.72:0/1068845853 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fef4406df10 0x7fef440703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:57.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.518+0000 7fef57e00640 1 -- 172.21.15.72:0/1068845853 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fef4808dc60 con 0x7fef6010ac40 2024-03-19T06:19:57.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.518+0000 7fef5ea00640 1 --2- 172.21.15.72:0/1068845853 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fef4406df10 0x7fef440703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:57.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.519+0000 7fef5ea00640 1 --2- 172.21.15.72:0/1068845853 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fef4406df10 0x7fef440703c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef50006010 tx=0x7fef50000f40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:57.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.523+0000 7fef57e00640 1 -- 172.21.15.72:0/1068845853 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7fef48057020 con 0x7fef6010ac40 2024-03-19T06:19:57.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:57 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1204964946' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-19T06:19:57.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:57 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3678675707' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-19T06:19:57.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:57 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1204964946' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-19T06:19:57.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:57 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3678675707' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-19T06:19:57.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.721+0000 7fef65a00640 1 -- 172.21.15.72:0/1068845853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef6019cc00 con 0x7fef6010ac40 2024-03-19T06:19:57.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.722+0000 7fef57e00640 1 -- 172.21.15.72:0/1068845853 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef6019cc00 con 0x7fef6010ac40 2024-03-19T06:19:57.710 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-19T06:19:57.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.725+0000 7fef65a00640 1 -- 172.21.15.72:0/1068845853 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fef4406df10 msgr2=0x7fef440703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:57.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.725+0000 7fef65a00640 1 --2- 172.21.15.72:0/1068845853 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fef4406df10 0x7fef440703c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fef50006010 tx=0x7fef50000f40 comp rx=0 tx=0).stop 2024-03-19T06:19:57.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.725+0000 7fef65a00640 1 -- 172.21.15.72:0/1068845853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6010ac40 msgr2=0x7fef601a1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:57.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.725+0000 7fef65a00640 1 --2- 172.21.15.72:0/1068845853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6010ac40 0x7fef601a1bc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fef4800c8f0 tx=0x7fef4800cdb0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.725+0000 7fef65a00640 1 -- 172.21.15.72:0/1068845853 shutdown_connections 2024-03-19T06:19:57.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.725+0000 7fef65a00640 1 --2- 172.21.15.72:0/1068845853 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7fef4406df10 0x7fef440703c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.725+0000 7fef65a00640 1 --2- 172.21.15.72:0/1068845853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6010ac40 0x7fef601a1bc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.725+0000 7fef65a00640 1 --2- 172.21.15.72:0/1068845853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef60106090 0x7fef601a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.725+0000 7fef65a00640 1 -- 172.21.15.72:0/1068845853 >> 172.21.15.72:0/1068845853 conn(0x7fef60075490 msgr2=0x7fef60075e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:57.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.725+0000 7fef65a00640 1 -- 172.21.15.72:0/1068845853 shutdown_connections 2024-03-19T06:19:57.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.725+0000 7fef65a00640 1 -- 172.21.15.72:0/1068845853 wait complete. 2024-03-19T06:19:57.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-03-19T06:19:57.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.945+0000 7f4401800640 1 -- 172.21.15.72:0/430079136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43fc10ac40 msgr2=0x7f43fc10b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:57.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.945+0000 7f4401800640 1 --2- 172.21.15.72:0/430079136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43fc10ac40 0x7f43fc10b010 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009880 tx=0x7f43ec02bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.945+0000 7f4401800640 1 -- 172.21.15.72:0/430079136 shutdown_connections 2024-03-19T06:19:57.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.945+0000 7f4401800640 1 --2- 172.21.15.72:0/430079136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc106090 0x7f43fc1064e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.945+0000 7f4401800640 1 --2- 172.21.15.72:0/430079136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43fc10ac40 0x7f43fc10b010 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.945+0000 7f4401800640 1 -- 172.21.15.72:0/430079136 >> 172.21.15.72:0/430079136 conn(0x7f43fc075490 msgr2=0x7f43fc0778a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:57.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.945+0000 7f4401800640 1 -- 172.21.15.72:0/430079136 shutdown_connections 2024-03-19T06:19:57.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.945+0000 7f4401800640 1 -- 172.21.15.72:0/430079136 wait complete. 2024-03-19T06:19:57.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.946+0000 7f4401800640 1 Processor -- start 2024-03-19T06:19:57.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.946+0000 7f4401800640 1 -- start start 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.946+0000 7f4401800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc106090 0x7f43fc1a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.946+0000 7f4401800640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43fc10ac40 0x7f43fc1a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.946+0000 7f4401800640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc19b6f0 con 0x7f43fc10ac40 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.946+0000 7f4401800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc19b860 con 0x7f43fc106090 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.947+0000 7f43fa000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43fc10ac40 0x7f43fc1a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.947+0000 7f43fa000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43fc10ac40 0x7f43fc1a1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47466/0 (socket says 172.21.15.72:47466) 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.947+0000 7f43fa000640 1 -- 172.21.15.72:0/3469111390 learned_addr learned my addr 172.21.15.72:0/3469111390 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.947+0000 7f43fa000640 1 -- 172.21.15.72:0/3469111390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc106090 msgr2=0x7f43fc1a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.947+0000 7f43faa00640 1 --2- 172.21.15.72:0/3469111390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc106090 0x7f43fc1a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.947+0000 7f43fa000640 1 --2- 172.21.15.72:0/3469111390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc106090 0x7f43fc1a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.947+0000 7f43fa000640 1 -- 172.21.15.72:0/3469111390 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec009560 con 0x7f43fc10ac40 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.947+0000 7f43faa00640 1 --2- 172.21.15.72:0/3469111390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc106090 0x7f43fc1a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.947+0000 7f43fa000640 1 --2- 172.21.15.72:0/3469111390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43fc10ac40 0x7f43fc1a1bc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f43e800d6f0 tx=0x7f43e800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:57.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.948+0000 7f43f3400640 1 -- 172.21.15.72:0/3469111390 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e8009a30 con 0x7f43fc10ac40 2024-03-19T06:19:57.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.948+0000 7f43f3400640 1 -- 172.21.15.72:0/3469111390 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43e80054e0 con 0x7f43fc10ac40 2024-03-19T06:19:57.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.948+0000 7f43f3400640 1 -- 172.21.15.72:0/3469111390 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e8010460 con 0x7f43fc10ac40 2024-03-19T06:19:57.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.948+0000 7f4401800640 1 -- 172.21.15.72:0/3469111390 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43fc19bb40 con 0x7f43fc10ac40 2024-03-19T06:19:57.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.948+0000 7f4401800640 1 -- 172.21.15.72:0/3469111390 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43fc19c120 con 0x7f43fc10ac40 2024-03-19T06:19:57.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.949+0000 7f4401800640 1 -- 172.21.15.72:0/3469111390 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43fc04e000 con 0x7f43fc10ac40 2024-03-19T06:19:57.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.950+0000 7f43f3400640 1 -- 172.21.15.72:0/3469111390 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f43e8009b90 con 0x7f43fc10ac40 2024-03-19T06:19:57.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.951+0000 7f43f3400640 1 --2- 172.21.15.72:0/3469111390 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f43e006df10 0x7f43e00703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:57.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.951+0000 7f43f3400640 1 -- 172.21.15.72:0/3469111390 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f43e808d8f0 con 0x7f43fc10ac40 2024-03-19T06:19:57.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.951+0000 7f43faa00640 1 --2- 172.21.15.72:0/3469111390 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f43e006df10 0x7f43e00703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:57.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.952+0000 7f43faa00640 1 --2- 172.21.15.72:0/3469111390 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f43e006df10 0x7f43e00703c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f43ec005ec0 tx=0x7f43ec005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:57.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:57.955+0000 7f43f3400640 1 -- 172.21.15.72:0/3469111390 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f43e8056cf0 con 0x7f43fc10ac40 2024-03-19T06:19:58.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.154+0000 7f4401800640 1 -- 172.21.15.72:0/3469111390 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f43fc19cc00 con 0x7f43fc10ac40 2024-03-19T06:19:58.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.155+0000 7f43f3400640 1 -- 172.21.15.72:0/3469111390 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f43e805a3b0 con 0x7f43fc10ac40 2024-03-19T06:19:58.142 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-19T06:19:58.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.158+0000 7f4401800640 1 -- 172.21.15.72:0/3469111390 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f43e006df10 msgr2=0x7f43e00703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:58.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.158+0000 7f4401800640 1 --2- 172.21.15.72:0/3469111390 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f43e006df10 0x7f43e00703c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f43ec005ec0 tx=0x7f43ec005fd0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.158+0000 7f4401800640 1 -- 172.21.15.72:0/3469111390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43fc10ac40 msgr2=0x7f43fc1a1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:58.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.158+0000 7f4401800640 1 --2- 172.21.15.72:0/3469111390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43fc10ac40 0x7f43fc1a1bc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f43e800d6f0 tx=0x7f43e800dbb0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.158+0000 7f4401800640 1 -- 172.21.15.72:0/3469111390 shutdown_connections 2024-03-19T06:19:58.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.158+0000 7f4401800640 1 --2- 172.21.15.72:0/3469111390 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f43e006df10 0x7f43e00703c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.158+0000 7f4401800640 1 --2- 172.21.15.72:0/3469111390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43fc10ac40 0x7f43fc1a1bc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.158+0000 7f4401800640 1 --2- 172.21.15.72:0/3469111390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc106090 0x7f43fc1a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.158+0000 7f4401800640 1 -- 172.21.15.72:0/3469111390 >> 172.21.15.72:0/3469111390 conn(0x7f43fc075490 msgr2=0x7f43fc075e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:58.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.158+0000 7f4401800640 1 -- 172.21.15.72:0/3469111390 shutdown_connections 2024-03-19T06:19:58.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.158+0000 7f4401800640 1 -- 172.21.15.72:0/3469111390 wait complete. 2024-03-19T06:19:58.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-03-19T06:19:58.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:58 smithi072 ceph-mon[78545]: pgmap v414: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:58.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:58 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/982938883' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T06:19:58.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:58 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/1068845853' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-19T06:19:58.324 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:58 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3469111390' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-19T06:19:58.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.392+0000 7f1a84e00640 1 -- 172.21.15.72:0/3245933942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a80072600 msgr2=0x7f1a800729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:58.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.392+0000 7f1a84e00640 1 --2- 172.21.15.72:0/3245933942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a80072600 0x7f1a800729d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009880 tx=0x7f1a7002bd80 comp rx=0 tx=0).stop 2024-03-19T06:19:58.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.392+0000 7f1a84e00640 1 -- 172.21.15.72:0/3245933942 shutdown_connections 2024-03-19T06:19:58.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.392+0000 7f1a84e00640 1 --2- 172.21.15.72:0/3245933942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a80072f10 0x7f1a8010b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.392+0000 7f1a84e00640 1 --2- 172.21.15.72:0/3245933942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a80072600 0x7f1a800729d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.392+0000 7f1a84e00640 1 -- 172.21.15.72:0/3245933942 >> 172.21.15.72:0/3245933942 conn(0x7f1a800fb150 msgr2=0x7f1a800fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:58.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.392+0000 7f1a84e00640 1 -- 172.21.15.72:0/3245933942 shutdown_connections 2024-03-19T06:19:58.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.392+0000 7f1a84e00640 1 -- 172.21.15.72:0/3245933942 wait complete. 2024-03-19T06:19:58.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.394+0000 7f1a84e00640 1 Processor -- start 2024-03-19T06:19:58.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.394+0000 7f1a84e00640 1 -- start start 2024-03-19T06:19:58.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.394+0000 7f1a84e00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a80072600 0x7f1a80197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:58.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.394+0000 7f1a84e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a80072f10 0x7f1a80197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:58.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.394+0000 7f1a84e00640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801981e0 con 0x7f1a80072600 2024-03-19T06:19:58.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.394+0000 7f1a84e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8019bfb0 con 0x7f1a80072f10 2024-03-19T06:19:58.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.395+0000 7f1a7de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a80072600 0x7f1a80197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:58.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.395+0000 7f1a7de00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a80072600 0x7f1a80197610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47498/0 (socket says 172.21.15.72:47498) 2024-03-19T06:19:58.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.395+0000 7f1a7de00640 1 -- 172.21.15.72:0/3200244100 learned_addr learned my addr 172.21.15.72:0/3200244100 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:58.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.395+0000 7f1a7de00640 1 -- 172.21.15.72:0/3200244100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a80072f10 msgr2=0x7f1a80197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:58.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.395+0000 7f1a77e00640 1 --2- 172.21.15.72:0/3200244100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a80072f10 0x7f1a80197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:58.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.395+0000 7f1a7de00640 1 --2- 172.21.15.72:0/3200244100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a80072f10 0x7f1a80197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.395+0000 7f1a7de00640 1 -- 172.21.15.72:0/3200244100 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a70009560 con 0x7f1a80072600 2024-03-19T06:19:58.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.395+0000 7f1a77e00640 1 --2- 172.21.15.72:0/3200244100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a80072f10 0x7f1a80197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:19:58.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.396+0000 7f1a7de00640 1 --2- 172.21.15.72:0/3200244100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a80072600 0x7f1a80197610 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009230 tx=0x7f1a70004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:58.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.396+0000 7f1a76a00640 1 -- 172.21.15.72:0/3200244100 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a700035f0 con 0x7f1a80072600 2024-03-19T06:19:58.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.396+0000 7f1a76a00640 1 -- 172.21.15.72:0/3200244100 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a70003c10 con 0x7f1a80072600 2024-03-19T06:19:58.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.396+0000 7f1a84e00640 1 -- 172.21.15.72:0/3200244100 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8019c230 con 0x7f1a80072600 2024-03-19T06:19:58.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.396+0000 7f1a76a00640 1 -- 172.21.15.72:0/3200244100 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7003e450 con 0x7f1a80072600 2024-03-19T06:19:58.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.396+0000 7f1a84e00640 1 -- 172.21.15.72:0/3200244100 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8019c790 con 0x7f1a80072600 2024-03-19T06:19:58.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.397+0000 7f1a84e00640 1 -- 172.21.15.72:0/3200244100 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8004e000 con 0x7f1a80072600 2024-03-19T06:19:58.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.398+0000 7f1a76a00640 1 -- 172.21.15.72:0/3200244100 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7f1a70004ff0 con 0x7f1a80072600 2024-03-19T06:19:58.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.399+0000 7f1a76a00640 1 --2- 172.21.15.72:0/3200244100 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1a6406df10 0x7f1a640703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:58.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.399+0000 7f1a76a00640 1 -- 172.21.15.72:0/3200244100 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1a700b0ab0 con 0x7f1a80072600 2024-03-19T06:19:58.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.400+0000 7f1a77e00640 1 --2- 172.21.15.72:0/3200244100 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1a6406df10 0x7f1a640703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:58.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.400+0000 7f1a77e00640 1 --2- 172.21.15.72:0/3200244100 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1a6406df10 0x7f1a640703c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1a68006fd0 tx=0x7f1a68008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:58.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.405+0000 7f1a76a00640 1 -- 172.21.15.72:0/3200244100 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7f1a700b2e60 con 0x7f1a80072600 2024-03-19T06:19:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.600+0000 7f1a84e00640 1 -- 172.21.15.72:0/3200244100 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f1a80109000 con 0x7f1a80072600 2024-03-19T06:19:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.601+0000 7f1a76a00640 1 -- 172.21.15.72:0/3200244100 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1a70079e30 con 0x7f1a80072600 2024-03-19T06:19:58.590 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-19T06:19:58.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.604+0000 7f1a84e00640 1 -- 172.21.15.72:0/3200244100 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1a6406df10 msgr2=0x7f1a640703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.604+0000 7f1a84e00640 1 --2- 172.21.15.72:0/3200244100 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1a6406df10 0x7f1a640703c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1a68006fd0 tx=0x7f1a68008040 comp rx=0 tx=0).stop 2024-03-19T06:19:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.604+0000 7f1a84e00640 1 -- 172.21.15.72:0/3200244100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a80072600 msgr2=0x7f1a80197610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.604+0000 7f1a84e00640 1 --2- 172.21.15.72:0/3200244100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a80072600 0x7f1a80197610 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009230 tx=0x7f1a70004040 comp rx=0 tx=0).stop 2024-03-19T06:19:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.604+0000 7f1a84e00640 1 -- 172.21.15.72:0/3200244100 shutdown_connections 2024-03-19T06:19:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.604+0000 7f1a84e00640 1 --2- 172.21.15.72:0/3200244100 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7f1a6406df10 0x7f1a640703c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.604+0000 7f1a84e00640 1 --2- 172.21.15.72:0/3200244100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a80072f10 0x7f1a80197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.604+0000 7f1a84e00640 1 --2- 172.21.15.72:0/3200244100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a80072600 0x7f1a80197610 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.604+0000 7f1a84e00640 1 -- 172.21.15.72:0/3200244100 >> 172.21.15.72:0/3200244100 conn(0x7f1a800fb150 msgr2=0x7f1a801061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.604+0000 7f1a84e00640 1 -- 172.21.15.72:0/3200244100 shutdown_connections 2024-03-19T06:19:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.604+0000 7f1a84e00640 1 -- 172.21.15.72:0/3200244100 wait complete. 2024-03-19T06:19:58.611 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:19:58.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:58 smithi172 ceph-mon[66682]: pgmap v414: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:19:58.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:58 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/982938883' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-19T06:19:58.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:58 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/1068845853' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-19T06:19:58.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:58 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3469111390' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-19T06:19:58.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.836+0000 7efff4000640 1 -- 172.21.15.72:0/1751573806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effec074790 msgr2=0x7effec074b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:58.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.836+0000 7efff4000640 1 --2- 172.21.15.72:0/1751573806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effec074790 0x7effec074b60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7effe0009880 tx=0x7effe002bce0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.836+0000 7efff4000640 1 -- 172.21.15.72:0/1751573806 shutdown_connections 2024-03-19T06:19:58.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.836+0000 7efff4000640 1 --2- 172.21.15.72:0/1751573806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effec0750a0 0x7effec10ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.836+0000 7efff4000640 1 --2- 172.21.15.72:0/1751573806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effec074790 0x7effec074b60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.836+0000 7efff4000640 1 -- 172.21.15.72:0/1751573806 >> 172.21.15.72:0/1751573806 conn(0x7effec0fd330 msgr2=0x7effec0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:58.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.837+0000 7efff4000640 1 -- 172.21.15.72:0/1751573806 shutdown_connections 2024-03-19T06:19:58.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.837+0000 7efff4000640 1 -- 172.21.15.72:0/1751573806 wait complete. 2024-03-19T06:19:58.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.837+0000 7efff4000640 1 Processor -- start 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.838+0000 7efff4000640 1 -- start start 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.838+0000 7efff4000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effec074790 0x7effec1a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.838+0000 7efff4000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effec0750a0 0x7effec1a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.838+0000 7efff4000640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec19b620 con 0x7effec0750a0 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.838+0000 7efff4000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec19b790 con 0x7effec074790 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.838+0000 7efff0c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effec0750a0 0x7effec1a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.838+0000 7efff0c00640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effec0750a0 0x7effec1a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47518/0 (socket says 172.21.15.72:47518) 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.838+0000 7efff0c00640 1 -- 172.21.15.72:0/971813908 learned_addr learned my addr 172.21.15.72:0/971813908 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.838+0000 7efff1600640 1 --2- 172.21.15.72:0/971813908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effec074790 0x7effec1a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.839+0000 7efff0c00640 1 -- 172.21.15.72:0/971813908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effec074790 msgr2=0x7effec1a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.839+0000 7efff0c00640 1 --2- 172.21.15.72:0/971813908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effec074790 0x7effec1a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.839+0000 7efff0c00640 1 -- 172.21.15.72:0/971813908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe0009560 con 0x7effec0750a0 2024-03-19T06:19:58.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.839+0000 7efff1600640 1 --2- 172.21.15.72:0/971813908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effec074790 0x7effec1a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:19:58.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.839+0000 7efff0c00640 1 --2- 172.21.15.72:0/971813908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effec0750a0 0x7effec1a1af0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7effd800c8f0 tx=0x7effd800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:58.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.839+0000 7effea000640 1 -- 172.21.15.72:0/971813908 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effd8007b80 con 0x7effec0750a0 2024-03-19T06:19:58.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.839+0000 7effea000640 1 -- 172.21.15.72:0/971813908 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effd80054e0 con 0x7effec0750a0 2024-03-19T06:19:58.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.839+0000 7effea000640 1 -- 172.21.15.72:0/971813908 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effd800f450 con 0x7effec0750a0 2024-03-19T06:19:58.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.839+0000 7efff4000640 1 -- 172.21.15.72:0/971813908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec19ba70 con 0x7effec0750a0 2024-03-19T06:19:58.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.839+0000 7efff4000640 1 -- 172.21.15.72:0/971813908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec19bfd0 con 0x7effec0750a0 2024-03-19T06:19:58.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.840+0000 7efff4000640 1 -- 172.21.15.72:0/971813908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec04e000 con 0x7effec0750a0 2024-03-19T06:19:58.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.842+0000 7effea000640 1 -- 172.21.15.72:0/971813908 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 91841+0+0 (secure 0 0 0) 0x7effd8004f60 con 0x7effec0750a0 2024-03-19T06:19:58.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.843+0000 7effea000640 1 --2- 172.21.15.72:0/971813908 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7effd406dfd0 0x7effd4070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:19:58.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.843+0000 7effea000640 1 -- 172.21.15.72:0/971813908 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7effd808dbb0 con 0x7effec0750a0 2024-03-19T06:19:58.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.843+0000 7efff1600640 1 --2- 172.21.15.72:0/971813908 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7effd406dfd0 0x7effd4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:19:58.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.844+0000 7efff1600640 1 --2- 172.21.15.72:0/971813908 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7effd406dfd0 0x7effd4070480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7effe0036040 tx=0x7effe002cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:19:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:58.848+0000 7effea000640 1 -- 172.21.15.72:0/971813908 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184781 (secure 0 0 0) 0x7effd8056fb0 con 0x7effec0750a0 2024-03-19T06:19:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.043+0000 7efff4000640 1 -- 172.21.15.72:0/971813908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7effec10d690 con 0x7effec0750a0 2024-03-19T06:19:59.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.044+0000 7effea000640 1 -- 172.21.15.72:0/971813908 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v83) v1 ==== 81+0+2434 (secure 0 0 0) 0x7effd801d080 con 0x7effec0750a0 2024-03-19T06:19:59.033 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:6826/363477076 2024-03-20T06:14:49.470935+0000 2024-03-19T06:19:59.033 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:6827/363477076 2024-03-20T06:14:49.470935+0000 2024-03-19T06:19:59.033 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6827/772635337 2024-03-20T06:13:19.631192+0000 2024-03-19T06:19:59.033 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/4199454850 2024-03-20T06:04:03.942401+0000 2024-03-19T06:19:59.033 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:0/2707855483 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:59.033 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/2294511988 2024-03-20T05:52:50.595473+0000 2024-03-19T06:19:59.033 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3195993518 2024-03-20T06:04:03.942401+0000 2024-03-19T06:19:59.033 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3627388017 2024-03-20T05:52:08.433691+0000 2024-03-19T06:19:59.033 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3141025630 2024-03-20T05:52:50.595473+0000 2024-03-19T06:19:59.033 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/3022348314 2024-03-20T05:52:08.433691+0000 2024-03-19T06:19:59.033 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6828/1218260294 2024-03-20T06:13:54.895628+0000 2024-03-19T06:19:59.033 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1631679569 2024-03-20T05:52:50.595473+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/3022348314 2024-03-20T05:52:08.433691+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1450624542 2024-03-20T05:54:30.519459+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:0/1790535528 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3229768069 2024-03-20T05:52:50.595473+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:6828/1633747146 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2295310555 2024-03-20T05:52:08.433691+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6829/1218260294 2024-03-20T06:13:54.895628+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:0/268667195 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:0/3155967807 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1795725640 2024-03-20T05:52:08.433691+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/1922058375 2024-03-20T05:54:30.519459+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/1922058375 2024-03-20T05:54:30.519459+0000 2024-03-19T06:19:59.034 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/1154232723 2024-03-20T06:04:03.942401+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/495048474 2024-03-20T06:07:24.636011+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/1154232723 2024-03-20T06:04:03.942401+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2582270882 2024-03-20T05:54:30.519459+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1827861673 2024-03-20T05:54:30.519459+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:0/3565787740 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:6829/1633747146 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6800/2640845307 2024-03-20T06:07:24.636011+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/2294511988 2024-03-20T05:52:50.595473+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1944964087 2024-03-20T06:04:03.942401+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3793616122 2024-03-20T06:04:03.942401+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1127443989 2024-03-20T06:07:24.636011+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.172:0/3813007324 2024-03-20T06:05:12.456606+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/939742318 2024-03-20T06:07:24.636011+0000 2024-03-19T06:19:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/986207477 2024-03-20T06:07:24.636011+0000 2024-03-19T06:19:59.036 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6801/2640845307 2024-03-20T06:07:24.636011+0000 2024-03-19T06:19:59.036 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6826/772635337 2024-03-20T06:13:19.631192+0000 2024-03-19T06:19:59.036 INFO:teuthology.orchestra.run.smithi072.stderr:listed 41 entries 2024-03-19T06:19:59.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.047+0000 7efff4000640 1 -- 172.21.15.72:0/971813908 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7effd406dfd0 msgr2=0x7effd4070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.047+0000 7efff4000640 1 --2- 172.21.15.72:0/971813908 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7effd406dfd0 0x7effd4070480 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7effe0036040 tx=0x7effe002cf90 comp rx=0 tx=0).stop 2024-03-19T06:19:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.047+0000 7efff4000640 1 -- 172.21.15.72:0/971813908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effec0750a0 msgr2=0x7effec1a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:19:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.047+0000 7efff4000640 1 --2- 172.21.15.72:0/971813908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effec0750a0 0x7effec1a1af0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7effd800c8f0 tx=0x7effd800cdb0 comp rx=0 tx=0).stop 2024-03-19T06:19:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.047+0000 7efff4000640 1 -- 172.21.15.72:0/971813908 shutdown_connections 2024-03-19T06:19:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.047+0000 7efff4000640 1 --2- 172.21.15.72:0/971813908 >> [v2:172.21.15.72:6800/3993303660,v1:172.21.15.72:6801/3993303660] conn(0x7effd406dfd0 0x7effd4070480 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.047+0000 7efff4000640 1 --2- 172.21.15.72:0/971813908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effec0750a0 0x7effec1a1af0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.047+0000 7efff4000640 1 --2- 172.21.15.72:0/971813908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effec074790 0x7effec1a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:19:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.047+0000 7efff4000640 1 -- 172.21.15.72:0/971813908 >> 172.21.15.72:0/971813908 conn(0x7effec0fd330 msgr2=0x7effec0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:19:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.047+0000 7efff4000640 1 -- 172.21.15.72:0/971813908 shutdown_connections 2024-03-19T06:19:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-19T06:19:59.047+0000 7efff4000640 1 -- 172.21.15.72:0/971813908 wait complete. 2024-03-19T06:19:59.052 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2024-03-19T06:19:59.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:19:59.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-19T06:19:59.140 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:19:59.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:59 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/3200244100' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-19T06:19:59.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:19:59 smithi072 ceph-mon[78545]: from='client.? 172.21.15.72:0/971813908' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-19T06:19:59.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:59 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/3200244100' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-19T06:19:59.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:19:59 smithi172 ceph-mon[66682]: from='client.? 172.21.15.72:0/971813908' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-19T06:20:00.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:00 smithi072 ceph-mon[78545]: pgmap v415: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:00.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:00 smithi072 ceph-mon[78545]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:20:00.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:00 smithi072 ceph-mon[78545]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:20:00.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:00 smithi072 ceph-mon[78545]: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:20:00.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:00 smithi172 ceph-mon[66682]: pgmap v415: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:00.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:00 smithi172 ceph-mon[66682]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-03-19T06:20:00.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:00 smithi172 ceph-mon[66682]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-03-19T06:20:00.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:00 smithi172 ceph-mon[66682]: fs cephfs has deprecated feature inline_data enabled. 2024-03-19T06:20:02.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:02 smithi072 ceph-mon[78545]: pgmap v416: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:02.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:02 smithi172 ceph-mon[66682]: pgmap v416: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:04.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:04 smithi072 ceph-mon[78545]: pgmap v417: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:04.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:04 smithi172 ceph-mon[66682]: pgmap v417: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:06.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:06 smithi072 ceph-mon[78545]: pgmap v418: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:06.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:06 smithi172 ceph-mon[66682]: pgmap v418: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:08.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:08 smithi072 ceph-mon[78545]: pgmap v419: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:08.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:08 smithi172 ceph-mon[66682]: pgmap v419: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:10.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:10 smithi072 ceph-mon[78545]: pgmap v420: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:10.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:20:10.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:10 smithi172 ceph-mon[66682]: pgmap v420: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:10.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:20:12.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:12 smithi072 ceph-mon[78545]: pgmap v421: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:12.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:12 smithi172 ceph-mon[66682]: pgmap v421: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:14.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:14 smithi172 ceph-mon[66682]: pgmap v422: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:14.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:14 smithi072 ceph-mon[78545]: pgmap v422: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:16.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:16 smithi072 ceph-mon[78545]: pgmap v423: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:16.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:16 smithi172 ceph-mon[66682]: pgmap v423: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:18.323 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:18 smithi072 ceph-mon[78545]: pgmap v424: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:18.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:18 smithi172 ceph-mon[66682]: pgmap v424: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:20.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:20 smithi072 ceph-mon[78545]: pgmap v425: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:20.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:20 smithi172 ceph-mon[66682]: pgmap v425: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:22.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:22 smithi072 ceph-mon[78545]: pgmap v426: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:22.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:22 smithi172 ceph-mon[66682]: pgmap v426: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:24.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:24 smithi072 ceph-mon[78545]: pgmap v427: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:24.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:24 smithi172 ceph-mon[66682]: pgmap v427: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:25.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:20:25.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:20:26.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:26 smithi072 ceph-mon[78545]: pgmap v428: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:26.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:26 smithi172 ceph-mon[66682]: pgmap v428: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:28.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:28 smithi072 ceph-mon[78545]: pgmap v429: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:28.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:28 smithi172 ceph-mon[66682]: pgmap v429: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:30.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:30 smithi072 ceph-mon[78545]: pgmap v430: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:30.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:30 smithi172 ceph-mon[66682]: pgmap v430: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:32.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:32 smithi072 ceph-mon[78545]: pgmap v431: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:32 smithi172 ceph-mon[66682]: pgmap v431: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:34.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:34 smithi072 ceph-mon[78545]: pgmap v432: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:34.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:34 smithi172 ceph-mon[66682]: pgmap v432: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:36.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:36 smithi072 ceph-mon[78545]: pgmap v433: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:36.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:36 smithi172 ceph-mon[66682]: pgmap v433: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:38.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:38 smithi072 ceph-mon[78545]: pgmap v434: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:38.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:38 smithi172 ceph-mon[66682]: pgmap v434: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:40.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:40 smithi072 ceph-mon[78545]: pgmap v435: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:40.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:20:40.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:20:40.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:40 smithi172 ceph-mon[66682]: pgmap v435: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:40.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:20:40.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:20:41.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:20:41.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:20:41.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:20:41.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:20:41.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:20:41.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:20:42.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:42 smithi072 ceph-mon[78545]: pgmap v436: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:42.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:42 smithi172 ceph-mon[66682]: pgmap v436: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:44.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:44 smithi172 ceph-mon[66682]: pgmap v437: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:44.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:44 smithi072 ceph-mon[78545]: pgmap v437: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:46.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:46 smithi172 ceph-mon[66682]: pgmap v438: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:46.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:46 smithi072 ceph-mon[78545]: pgmap v438: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:48.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:48 smithi172 ceph-mon[66682]: pgmap v439: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:48.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:48 smithi072 ceph-mon[78545]: pgmap v439: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:50.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:50 smithi172 ceph-mon[66682]: pgmap v440: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:50.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:50 smithi072 ceph-mon[78545]: pgmap v440: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:52.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:52 smithi072 ceph-mon[78545]: pgmap v441: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:52.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:52 smithi172 ceph-mon[66682]: pgmap v441: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:54.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:54 smithi172 ceph-mon[66682]: pgmap v442: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:54.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:54 smithi072 ceph-mon[78545]: pgmap v442: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:55.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:20:55.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:20:56.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:56 smithi172 ceph-mon[66682]: pgmap v443: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:56.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:56 smithi072 ceph-mon[78545]: pgmap v443: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:58.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:20:58 smithi172 ceph-mon[66682]: pgmap v444: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:20:58.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:20:58 smithi072 ceph-mon[78545]: pgmap v444: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:00.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:00 smithi172 ceph-mon[66682]: pgmap v445: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:00.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:00 smithi072 ceph-mon[78545]: pgmap v445: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:02.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:02 smithi072 ceph-mon[78545]: pgmap v446: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:02.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:02 smithi172 ceph-mon[66682]: pgmap v446: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:04.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:04 smithi072 ceph-mon[78545]: pgmap v447: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:04.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:04 smithi172 ceph-mon[66682]: pgmap v447: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:06.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:06 smithi072 ceph-mon[78545]: pgmap v448: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:06.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:06 smithi172 ceph-mon[66682]: pgmap v448: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:08.703 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:08 smithi172 ceph-mon[66682]: pgmap v449: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:08.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:08 smithi072 ceph-mon[78545]: pgmap v449: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:10.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:10 smithi072 ceph-mon[78545]: pgmap v450: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:10.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:21:10.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:10 smithi172 ceph-mon[66682]: pgmap v450: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:10.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:21:12.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:12 smithi072 ceph-mon[78545]: pgmap v451: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:12.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:12 smithi172 ceph-mon[66682]: pgmap v451: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:14.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:14 smithi072 ceph-mon[78545]: pgmap v452: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:14.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:14 smithi172 ceph-mon[66682]: pgmap v452: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:16.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:16 smithi072 ceph-mon[78545]: pgmap v453: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:16.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:16 smithi172 ceph-mon[66682]: pgmap v453: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:18.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:18 smithi072 ceph-mon[78545]: pgmap v454: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:18.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:18 smithi172 ceph-mon[66682]: pgmap v454: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:20.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:20 smithi072 ceph-mon[78545]: pgmap v455: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:20.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:20 smithi172 ceph-mon[66682]: pgmap v455: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:22.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:22 smithi072 ceph-mon[78545]: pgmap v456: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:22.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:22 smithi172 ceph-mon[66682]: pgmap v456: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:24.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:24 smithi072 ceph-mon[78545]: pgmap v457: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:24.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:24 smithi172 ceph-mon[66682]: pgmap v457: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:25.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:21:25.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:21:26.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:26 smithi072 ceph-mon[78545]: pgmap v458: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:26.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:26 smithi172 ceph-mon[66682]: pgmap v458: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:28.814 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:28 smithi072 ceph-mon[78545]: pgmap v459: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:28.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:28 smithi172 ceph-mon[66682]: pgmap v459: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:30.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:30 smithi072 ceph-mon[78545]: pgmap v460: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:30.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:30 smithi172 ceph-mon[66682]: pgmap v460: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:32.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:32 smithi072 ceph-mon[78545]: pgmap v461: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:32.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:32 smithi172 ceph-mon[66682]: pgmap v461: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:34.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:34 smithi072 ceph-mon[78545]: pgmap v462: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:34.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:34 smithi172 ceph-mon[66682]: pgmap v462: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:36.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:36 smithi172 ceph-mon[66682]: pgmap v463: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:36.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:36 smithi072 ceph-mon[78545]: pgmap v463: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:38.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:38 smithi072 ceph-mon[78545]: pgmap v464: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:38.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:38 smithi172 ceph-mon[66682]: pgmap v464: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:40.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:40 smithi072 ceph-mon[78545]: pgmap v465: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:40.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:21:40.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:40 smithi172 ceph-mon[66682]: pgmap v465: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:40.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:21:41.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:41 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:21:41.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:41 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:21:42.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:42 smithi072 ceph-mon[78545]: pgmap v466: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:42.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:42 smithi172 ceph-mon[66682]: pgmap v466: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:43.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:21:43.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:21:43.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:21:43.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:21:43.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:21:43.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:21:44.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:44 smithi072 ceph-mon[78545]: pgmap v467: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:44.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:44 smithi172 ceph-mon[66682]: pgmap v467: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:46.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:46 smithi072 ceph-mon[78545]: pgmap v468: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:46.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:46 smithi172 ceph-mon[66682]: pgmap v468: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:48.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:48 smithi072 ceph-mon[78545]: pgmap v469: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:48.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:48 smithi172 ceph-mon[66682]: pgmap v469: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:50.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:50 smithi072 ceph-mon[78545]: pgmap v470: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:50.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:50 smithi172 ceph-mon[66682]: pgmap v470: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:52.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:52 smithi172 ceph-mon[66682]: pgmap v471: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:53.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:52 smithi072 ceph-mon[78545]: pgmap v471: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:54.876 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:54 smithi072 ceph-mon[78545]: pgmap v472: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:54.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:54 smithi172 ceph-mon[66682]: pgmap v472: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:55.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:21:56.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:21:56.850 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:56 smithi172 ceph-mon[66682]: pgmap v473: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:57.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:56 smithi072 ceph-mon[78545]: pgmap v473: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:58.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:21:58 smithi172 ceph-mon[66682]: pgmap v474: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:21:59.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:21:58 smithi072 ceph-mon[78545]: pgmap v474: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:00.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:00 smithi172 ceph-mon[66682]: pgmap v475: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:01.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:00 smithi072 ceph-mon[78545]: pgmap v475: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:02.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:02 smithi172 ceph-mon[66682]: pgmap v476: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:03.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:02 smithi072 ceph-mon[78545]: pgmap v476: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:04.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:04 smithi172 ceph-mon[66682]: pgmap v477: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:05.010 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:04 smithi072 ceph-mon[78545]: pgmap v477: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:06.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:06 smithi172 ceph-mon[66682]: pgmap v478: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:07.072 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:06 smithi072 ceph-mon[78545]: pgmap v478: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:08.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:08 smithi172 ceph-mon[66682]: pgmap v479: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:09.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:08 smithi072 ceph-mon[78545]: pgmap v479: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:10.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:10 smithi172 ceph-mon[66682]: pgmap v480: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:10.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:22:11.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:10 smithi072 ceph-mon[78545]: pgmap v480: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:11.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:22:12.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:12 smithi172 ceph-mon[66682]: pgmap v481: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:13.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:12 smithi072 ceph-mon[78545]: pgmap v481: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:15.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:14 smithi072 ceph-mon[78545]: pgmap v482: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:15.150 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:14 smithi172 ceph-mon[66682]: pgmap v482: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:17.072 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:16 smithi072 ceph-mon[78545]: pgmap v483: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:17.150 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:16 smithi172 ceph-mon[66682]: pgmap v483: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:19.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:18 smithi072 ceph-mon[78545]: pgmap v484: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:19.150 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:18 smithi172 ceph-mon[66682]: pgmap v484: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:20.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:20 smithi072 ceph-mon[78545]: pgmap v485: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:21.150 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:20 smithi172 ceph-mon[66682]: pgmap v485: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:22.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:22 smithi172 ceph-mon[66682]: pgmap v486: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:23.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:22 smithi072 ceph-mon[78545]: pgmap v486: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:25.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:24 smithi072 ceph-mon[78545]: pgmap v487: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:25.150 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:24 smithi172 ceph-mon[66682]: pgmap v487: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:26.073 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:22:26.150 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:22:27.072 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:26 smithi072 ceph-mon[78545]: pgmap v488: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:27.150 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:26 smithi172 ceph-mon[66682]: pgmap v488: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:28.025 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:27 smithi072 ceph-mon[78545]: pgmap v489: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:28.150 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:27 smithi172 ceph-mon[66682]: pgmap v489: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:30.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:30 smithi072 ceph-mon[78545]: pgmap v490: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:30.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:30 smithi172 ceph-mon[66682]: pgmap v490: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:32.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:32 smithi172 ceph-mon[66682]: pgmap v491: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:32.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:32 smithi072 ceph-mon[78545]: pgmap v491: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:34.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:34 smithi172 ceph-mon[66682]: pgmap v492: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:34.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:34 smithi072 ceph-mon[78545]: pgmap v492: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:36.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:36 smithi072 ceph-mon[78545]: pgmap v493: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:36.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:36 smithi172 ceph-mon[66682]: pgmap v493: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:38.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:38 smithi072 ceph-mon[78545]: pgmap v494: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:38.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:38 smithi172 ceph-mon[66682]: pgmap v494: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:40.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:40 smithi172 ceph-mon[66682]: pgmap v495: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:40.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:22:40.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:40 smithi072 ceph-mon[78545]: pgmap v495: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:40.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:22:42.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:42 smithi172 ceph-mon[66682]: pgmap v496: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:42.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:42 smithi072 ceph-mon[78545]: pgmap v496: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:43.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:43 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:22:43.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:43 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:22:44.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:44 smithi172 ceph-mon[66682]: pgmap v497: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:44.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:44 smithi072 ceph-mon[78545]: pgmap v497: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:45.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:45 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:22:45.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:45 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:22:45.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:45 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:22:45.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:45 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:22:45.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:45 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:22:45.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:45 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:22:46.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:46 smithi072 ceph-mon[78545]: pgmap v498: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:46.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:46 smithi172 ceph-mon[66682]: pgmap v498: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:48.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:48 smithi172 ceph-mon[66682]: pgmap v499: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:48.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:48 smithi072 ceph-mon[78545]: pgmap v499: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:50.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:50 smithi072 ceph-mon[78545]: pgmap v500: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:50.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:50 smithi172 ceph-mon[66682]: pgmap v500: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:52.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:52 smithi072 ceph-mon[78545]: pgmap v501: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:52.901 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:52 smithi172 ceph-mon[66682]: pgmap v501: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:54.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:54 smithi072 ceph-mon[78545]: pgmap v502: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:54.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:54 smithi172 ceph-mon[66682]: pgmap v502: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:55.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:22:55.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:22:56.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:56 smithi072 ceph-mon[78545]: pgmap v503: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:56.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:56 smithi172 ceph-mon[66682]: pgmap v503: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:58.825 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:22:58 smithi072 ceph-mon[78545]: pgmap v504: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:22:58.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:22:58 smithi172 ceph-mon[66682]: pgmap v504: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:00.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:00 smithi072 ceph-mon[78545]: pgmap v505: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:00.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:00 smithi172 ceph-mon[66682]: pgmap v505: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:02.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:02 smithi072 ceph-mon[78545]: pgmap v506: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:02.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:02 smithi172 ceph-mon[66682]: pgmap v506: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:04.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:04 smithi072 ceph-mon[78545]: pgmap v507: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:04.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:04 smithi172 ceph-mon[66682]: pgmap v507: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:06.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:06 smithi072 ceph-mon[78545]: pgmap v508: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:06.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:06 smithi172 ceph-mon[66682]: pgmap v508: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:08.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:08 smithi072 ceph-mon[78545]: pgmap v509: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:08.828 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:08 smithi172 ceph-mon[66682]: pgmap v509: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:10.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:10 smithi072 ceph-mon[78545]: pgmap v510: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:10.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:23:10.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:10 smithi172 ceph-mon[66682]: pgmap v510: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:10.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:23:12.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:12 smithi072 ceph-mon[78545]: pgmap v511: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:12.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:12 smithi172 ceph-mon[66682]: pgmap v511: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:14.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:14 smithi072 ceph-mon[78545]: pgmap v512: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:14.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:14 smithi172 ceph-mon[66682]: pgmap v512: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:16.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:16 smithi072 ceph-mon[78545]: pgmap v513: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:16.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:16 smithi172 ceph-mon[66682]: pgmap v513: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:18.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:18 smithi072 ceph-mon[78545]: pgmap v514: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:18.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:18 smithi172 ceph-mon[66682]: pgmap v514: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:20.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:20 smithi172 ceph-mon[66682]: pgmap v515: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:21.072 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:20 smithi072 ceph-mon[78545]: pgmap v515: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:22.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:22 smithi172 ceph-mon[66682]: pgmap v516: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:23.072 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:22 smithi072 ceph-mon[78545]: pgmap v516: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:24.876 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:24 smithi072 ceph-mon[78545]: pgmap v517: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:24.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:24 smithi172 ceph-mon[66682]: pgmap v517: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:25.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:23:26.072 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:23:26.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:26 smithi172 ceph-mon[66682]: pgmap v518: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:27.072 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:26 smithi072 ceph-mon[78545]: pgmap v518: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:28.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:28 smithi172 ceph-mon[66682]: pgmap v519: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:29.072 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:28 smithi072 ceph-mon[78545]: pgmap v519: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:30.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:30 smithi172 ceph-mon[66682]: pgmap v520: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:31.072 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:30 smithi072 ceph-mon[78545]: pgmap v520: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:32.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:32 smithi172 ceph-mon[66682]: pgmap v521: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:32.919 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:32 smithi072 ceph-mon[78545]: pgmap v521: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:34.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:34 smithi072 ceph-mon[78545]: pgmap v522: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:34.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:34 smithi172 ceph-mon[66682]: pgmap v522: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:36.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:36 smithi172 ceph-mon[66682]: pgmap v523: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:36.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:36 smithi072 ceph-mon[78545]: pgmap v523: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:38.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:38 smithi072 ceph-mon[78545]: pgmap v524: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:38.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:38 smithi172 ceph-mon[66682]: pgmap v524: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:40.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:40 smithi172 ceph-mon[66682]: pgmap v525: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:40.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:23:40.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:40 smithi072 ceph-mon[78545]: pgmap v525: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:40.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:23:42.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:42 smithi172 ceph-mon[66682]: pgmap v526: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:42.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:42 smithi072 ceph-mon[78545]: pgmap v526: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:44.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:44 smithi172 ceph-mon[66682]: pgmap v527: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:44.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:44 smithi072 ceph-mon[78545]: pgmap v527: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:45.399 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:45 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:23:45.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:45 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:23:46.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:46 smithi172 ceph-mon[66682]: pgmap v528: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:46.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:46 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:23:46.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:46 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:23:46.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:46 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:23:46.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:46 smithi072 ceph-mon[78545]: pgmap v528: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:46.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:46 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:23:46.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:46 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:23:46.573 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:46 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:23:48.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:48 smithi072 ceph-mon[78545]: pgmap v529: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:48.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:48 smithi172 ceph-mon[66682]: pgmap v529: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:50.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:50 smithi172 ceph-mon[66682]: pgmap v530: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:50.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:50 smithi072 ceph-mon[78545]: pgmap v530: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:52.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:52 smithi072 ceph-mon[78545]: pgmap v531: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:52.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:52 smithi172 ceph-mon[66682]: pgmap v531: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:54.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:54 smithi072 ceph-mon[78545]: pgmap v532: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:54.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:54 smithi172 ceph-mon[66682]: pgmap v532: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:55.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:23:55.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:23:56.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:56 smithi072 ceph-mon[78545]: pgmap v533: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:56.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:56 smithi172 ceph-mon[66682]: pgmap v533: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:58.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:23:58 smithi072 ceph-mon[78545]: pgmap v534: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:23:58.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:23:58 smithi172 ceph-mon[66682]: pgmap v534: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:00.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:00 smithi072 ceph-mon[78545]: pgmap v535: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:00.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:00 smithi172 ceph-mon[66682]: pgmap v535: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:02.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:02 smithi072 ceph-mon[78545]: pgmap v536: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:02.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:02 smithi172 ceph-mon[66682]: pgmap v536: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:04.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:04 smithi072 ceph-mon[78545]: pgmap v537: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:04.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:04 smithi172 ceph-mon[66682]: pgmap v537: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:06.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:06 smithi072 ceph-mon[78545]: pgmap v538: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:06.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:06 smithi172 ceph-mon[66682]: pgmap v538: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:08.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:08 smithi072 ceph-mon[78545]: pgmap v539: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:08.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:08 smithi172 ceph-mon[66682]: pgmap v539: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:10.518 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:10 smithi172 ceph-mon[66682]: pgmap v540: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:10.518 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:10 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:24:10.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:10 smithi072 ceph-mon[78545]: pgmap v540: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:10.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:10 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:24:12.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:12 smithi072 ceph-mon[78545]: pgmap v541: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:12.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:12 smithi172 ceph-mon[66682]: pgmap v541: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:14.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:14 smithi072 ceph-mon[78545]: pgmap v542: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:14.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:14 smithi172 ceph-mon[66682]: pgmap v542: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:16.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:16 smithi072 ceph-mon[78545]: pgmap v543: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:16.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:16 smithi172 ceph-mon[66682]: pgmap v543: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:18.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:18 smithi072 ceph-mon[78545]: pgmap v544: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:18.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:18 smithi172 ceph-mon[66682]: pgmap v544: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:20.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:20 smithi072 ceph-mon[78545]: pgmap v545: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:20.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:20 smithi172 ceph-mon[66682]: pgmap v545: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:22.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:22 smithi072 ceph-mon[78545]: pgmap v546: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:22.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:22 smithi172 ceph-mon[66682]: pgmap v546: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:24.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:24 smithi072 ceph-mon[78545]: pgmap v547: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:24.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:24 smithi172 ceph-mon[66682]: pgmap v547: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:25.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:25 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:24:25.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:25 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:24:26.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:26 smithi072 ceph-mon[78545]: pgmap v548: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:26.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:26 smithi172 ceph-mon[66682]: pgmap v548: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:28.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:28 smithi072 ceph-mon[78545]: pgmap v549: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:28.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:28 smithi172 ceph-mon[66682]: pgmap v549: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:30.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:30 smithi072 ceph-mon[78545]: pgmap v550: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:30.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:30 smithi172 ceph-mon[66682]: pgmap v550: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:32.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:32 smithi072 ceph-mon[78545]: pgmap v551: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:32 smithi172 ceph-mon[66682]: pgmap v551: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:34.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:34 smithi072 ceph-mon[78545]: pgmap v552: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:34.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:34 smithi172 ceph-mon[66682]: pgmap v552: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:36.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:36 smithi072 ceph-mon[78545]: pgmap v553: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:36.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:36 smithi172 ceph-mon[66682]: pgmap v553: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:38.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:38 smithi072 ceph-mon[78545]: pgmap v554: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:38.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:38 smithi172 ceph-mon[66682]: pgmap v554: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:40.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:40 smithi072 ceph-mon[78545]: pgmap v555: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:40.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:40 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:24:40.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:40 smithi172 ceph-mon[66682]: pgmap v555: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:40.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:40 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:24:42.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:42 smithi072 ceph-mon[78545]: pgmap v556: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:42.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:42 smithi172 ceph-mon[66682]: pgmap v556: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:44.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:44 smithi172 ceph-mon[66682]: pgmap v557: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:44.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:44 smithi072 ceph-mon[78545]: pgmap v557: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:46.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:46 smithi172 ceph-mon[66682]: pgmap v558: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:46.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:46 smithi072 ceph-mon[78545]: pgmap v558: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:47.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:47 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:24:47.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:47 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:24:47.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:47 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:24:47.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:47 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-19T06:24:47.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:47 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:24:47.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:47 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:24:48.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:48 smithi172 ceph-mon[66682]: pgmap v559: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:48.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:48 smithi072 ceph-mon[78545]: pgmap v559: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:49.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:24:49.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:24:49.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:49 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:24:49.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-19T06:24:49.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-19T06:24:49.823 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:49 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' 2024-03-19T06:24:50.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:50 smithi072 ceph-mon[78545]: pgmap v560: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:50.899 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:50 smithi172 ceph-mon[66682]: pgmap v560: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:52.572 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:52 smithi072 ceph-mon[78545]: pgmap v561: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:52.899 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:52 smithi172 ceph-mon[66682]: pgmap v561: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:54.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:54 smithi072 ceph-mon[78545]: pgmap v562: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:54.899 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:54 smithi172 ceph-mon[66682]: pgmap v562: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:55.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:55 smithi072 ceph-mon[78545]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:24:55.899 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:55 smithi172 ceph-mon[66682]: from='mgr.34104 172.21.15.72:0/3269297590' entity='mgr.smithi072.jydpjk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-19T06:24:56.899 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:56 smithi172 ceph-mon[66682]: pgmap v563: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:57.072 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:56 smithi072 ceph-mon[78545]: pgmap v563: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:58.211 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-03-19T06:24:58.212 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-03-19T06:24:58.214 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-19T06:24:58.225 INFO:tasks.cephadm:Teardown begin 2024-03-19T06:24:58.226 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/cephadm.py", line 1867, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-03-19T06:24:58.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-19T06:24:58.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-19T06:24:58.447 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-19T06:24:58.447 DEBUG:teuthology.orchestra.run.smithi072:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-19T06:24:58.506 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-19T06:24:58.563 INFO:tasks.cephadm:Stopping all daemons... 2024-03-19T06:24:58.564 INFO:tasks.cephadm.mon.smithi072:Stopping mon.smithi072... 2024-03-19T06:24:58.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi072 2024-03-19T06:24:58.899 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:24:58 smithi172 ceph-mon[66682]: pgmap v564: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:59.072 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:58 smithi072 ceph-mon[78545]: pgmap v564: 65 pgs: 65 active+clean; 187 MiB data, 808 MiB used, 536 GiB / 536 GiB avail 2024-03-19T06:24:59.072 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:58 smithi072 systemd[1]: Stopping Ceph mon.smithi072 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:24:59.537 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:59 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072[78541]: 2024-03-19T06:24:59.154+0000 7f9b57000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi072 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:24:59.538 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:59 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072[78541]: 2024-03-19T06:24:59.154+0000 7f9b57000700 -1 mon.smithi072@0(leader) e3 *** Got Signal Terminated *** 2024-03-19T06:24:59.538 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:59 smithi072 podman[132426]: 2024-03-19 06:24:59.247920794 +0000 UTC m=+0.246036640 container died f8806c6c6e84a69cb23a6e37e6d806b4c961d406ea5bbd016e57616e5c5825ec (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_BRANCH=HEAD, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b) 2024-03-19T06:24:59.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:59 smithi072 podman[132426]: 2024-03-19 06:24:59.777010067 +0000 UTC m=+0.775125950 container cleanup f8806c6c6e84a69cb23a6e37e6d806b4c961d406ea5bbd016e57616e5c5825ec (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:24:59.822 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:24:59 smithi072 bash[132426]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072 2024-03-19T06:25:00.322 INFO:journalctl@ceph.mon.smithi072.smithi072.stdout:Mar 19 06:25:00 smithi072 podman[132451]: 2024-03-19 06:25:00.073632762 +0000 UTC m=+0.815177918 container remove f8806c6c6e84a69cb23a6e37e6d806b4c961d406ea5bbd016e57616e5c5825ec (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi072, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-19T06:25:00.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi072.service' 2024-03-19T06:25:00.710 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-19T06:25:00.710 INFO:tasks.cephadm.mon.smithi072:Stopped mon.smithi072 2024-03-19T06:25:00.710 INFO:tasks.cephadm.mon.smithi172:Stopping mon.smithi172... 2024-03-19T06:25:00.710 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi172 2024-03-19T06:25:01.149 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:25:00 smithi172 systemd[1]: Stopping Ceph mon.smithi172 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:25:01.537 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:25:01 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172[66678]: 2024-03-19T06:25:01.282+0000 7f8f2ea00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi172 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:25:01.537 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:25:01 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172[66678]: 2024-03-19T06:25:01.282+0000 7f8f2ea00700 -1 mon.smithi172@1(peon) e3 *** Got Signal Terminated *** 2024-03-19T06:25:01.900 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:25:01 smithi172 podman[96919]: 2024-03-19 06:25:01.550320614 +0000 UTC m=+0.394513514 container died 9c31f8ad367b1466910f80900331caf9e8247623f5caa1c2423400ca8c500b00 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-19T06:25:02.366 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:25:02 smithi172 podman[96919]: 2024-03-19 06:25:02.160747496 +0000 UTC m=+1.004940386 container cleanup 9c31f8ad367b1466910f80900331caf9e8247623f5caa1c2423400ca8c500b00 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172, org.label-schema.build-date=20240222, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b) 2024-03-19T06:25:02.366 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:25:02 smithi172 bash[96919]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172 2024-03-19T06:25:02.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Mar 19 06:25:02 smithi172 podman[96933]: 2024-03-19 06:25:02.378853566 +0000 UTC m=+0.815182642 container remove 9c31f8ad367b1466910f80900331caf9e8247623f5caa1c2423400ca8c500b00 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-mon-smithi172, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_CLEAN=True) 2024-03-19T06:25:02.902 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@mon.smithi172.service' 2024-03-19T06:25:03.041 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-19T06:25:03.042 INFO:tasks.cephadm.mon.smithi172:Stopped mon.smithi172 2024-03-19T06:25:03.042 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-19T06:25:03.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.0 2024-03-19T06:25:03.572 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:03 smithi072 systemd[1]: Stopping Ceph osd.0 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:25:04.072 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:03 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0[85276]: 2024-03-19T06:25:03.624+0000 7f7fb0400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:25:04.072 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:03 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0[85276]: 2024-03-19T06:25:03.624+0000 7f7fb0400700 -1 osd.0 83 *** Got signal Terminated *** 2024-03-19T06:25:04.072 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:03 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0[85276]: 2024-03-19T06:25:03.624+0000 7f7fb0400700 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-19T06:25:09.274 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:08 smithi072 podman[132569]: 2024-03-19 06:25:08.990221216 +0000 UTC m=+5.518059158 container died 94123452ea80f58f061e0607c02abe65e48b2a5c0de22295c3669000d366952a (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-03-19T06:25:09.572 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:09 smithi072 podman[132569]: 2024-03-19 06:25:09.432034823 +0000 UTC m=+5.959872793 container cleanup 94123452ea80f58f061e0607c02abe65e48b2a5c0de22295c3669000d366952a (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS) 2024-03-19T06:25:09.572 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:09 smithi072 bash[132569]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0 2024-03-19T06:25:10.072 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:09 smithi072 podman[132587]: 2024-03-19 06:25:09.701632818 +0000 UTC m=+0.701310652 container remove 94123452ea80f58f061e0607c02abe65e48b2a5c0de22295c3669000d366952a (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-19T06:25:10.822 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:10 smithi072 podman[132675]: 2024-03-19 06:25:10.424840012 +0000 UTC m=+0.032554474 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:25:10.823 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:10 smithi072 podman[132675]: 2024-03-19 06:25:10.528450291 +0000 UTC m=+0.136164781 container create 3114989591b9bcbdcdab15d4a6c7b11c3f94d8c742884d11b9169bfbc66176f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-19T06:25:11.156 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:10 smithi072 podman[132675]: 2024-03-19 06:25:10.85284486 +0000 UTC m=+0.460559367 container init 3114989591b9bcbdcdab15d4a6c7b11c3f94d8c742884d11b9169bfbc66176f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b) 2024-03-19T06:25:11.156 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:10 smithi072 podman[132675]: 2024-03-19 06:25:10.863691834 +0000 UTC m=+0.471406361 container start 3114989591b9bcbdcdab15d4a6c7b11c3f94d8c742884d11b9169bfbc66176f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-19T06:25:11.156 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:10 smithi072 podman[132675]: 2024-03-19 06:25:10.943000217 +0000 UTC m=+0.550714764 container attach 3114989591b9bcbdcdab15d4a6c7b11c3f94d8c742884d11b9169bfbc66176f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=) 2024-03-19T06:25:11.572 INFO:journalctl@ceph.osd.0.smithi072.stdout:Mar 19 06:25:11 smithi072 podman[132675]: 2024-03-19 06:25:11.307937693 +0000 UTC m=+0.915652199 container died 3114989591b9bcbdcdab15d4a6c7b11c3f94d8c742884d11b9169bfbc66176f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271) 2024-03-19T06:25:12.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.0.service' 2024-03-19T06:25:12.230 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-19T06:25:12.230 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-19T06:25:12.231 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-19T06:25:12.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.1 2024-03-19T06:25:12.572 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:12 smithi072 systemd[1]: Stopping Ceph osd.1 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:25:13.072 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:12 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1[88635]: 2024-03-19T06:25:12.862+0000 7f0c93000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:25:13.072 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:12 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1[88635]: 2024-03-19T06:25:12.862+0000 7f0c93000700 -1 osd.1 83 *** Got signal Terminated *** 2024-03-19T06:25:13.073 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:12 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1[88635]: 2024-03-19T06:25:12.862+0000 7f0c93000700 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-19T06:25:18.686 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:18 smithi072 podman[132784]: 2024-03-19 06:25:18.428174773 +0000 UTC m=+5.679038635 container died 5b934e3ebc97d0414944c086d7ed398563a0521be48e1bd17c6d2788f35528b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b) 2024-03-19T06:25:19.072 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:18 smithi072 podman[132784]: 2024-03-19 06:25:18.835845177 +0000 UTC m=+6.086709056 container cleanup 5b934e3ebc97d0414944c086d7ed398563a0521be48e1bd17c6d2788f35528b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240222) 2024-03-19T06:25:19.072 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:18 smithi072 bash[132784]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1 2024-03-19T06:25:19.572 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:19 smithi072 podman[132803]: 2024-03-19 06:25:19.180874362 +0000 UTC m=+0.746076218 container remove 5b934e3ebc97d0414944c086d7ed398563a0521be48e1bd17c6d2788f35528b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True) 2024-03-19T06:25:20.311 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:20 smithi072 podman[132896]: 2024-03-19 06:25:19.920913816 +0000 UTC m=+0.037564667 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:25:20.311 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:20 smithi072 podman[132896]: 2024-03-19 06:25:20.076100178 +0000 UTC m=+0.192751063 container create 45e935b307f88d9cebff0ed060d620d0f615b3ca0d7187155ae5296112c3a87f (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-03-19T06:25:20.311 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:20 smithi072 podman[132896]: 2024-03-19 06:25:20.323290677 +0000 UTC m=+0.439941592 container init 45e935b307f88d9cebff0ed060d620d0f615b3ca0d7187155ae5296112c3a87f (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-19T06:25:20.572 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:20 smithi072 podman[132896]: 2024-03-19 06:25:20.334717614 +0000 UTC m=+0.451368471 container start 45e935b307f88d9cebff0ed060d620d0f615b3ca0d7187155ae5296112c3a87f (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-19T06:25:20.572 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:20 smithi072 podman[132896]: 2024-03-19 06:25:20.431019943 +0000 UTC m=+0.547670875 container attach 45e935b307f88d9cebff0ed060d620d0f615b3ca0d7187155ae5296112c3a87f (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-deactivate, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:25:21.072 INFO:journalctl@ceph.osd.1.smithi072.stdout:Mar 19 06:25:20 smithi072 podman[132896]: 2024-03-19 06:25:20.778801426 +0000 UTC m=+0.895452382 container died 45e935b307f88d9cebff0ed060d620d0f615b3ca0d7187155ae5296112c3a87f (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-1-deactivate, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-19T06:25:21.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.1.service' 2024-03-19T06:25:21.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-19T06:25:21.685 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-19T06:25:21.685 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-19T06:25:21.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.2 2024-03-19T06:25:22.072 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:21 smithi072 systemd[1]: Stopping Ceph osd.2 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:25:22.572 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:22 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2[91979]: 2024-03-19T06:25:22.248+0000 7f6d42000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:25:22.572 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:22 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2[91979]: 2024-03-19T06:25:22.248+0000 7f6d42000700 -1 osd.2 83 *** Got signal Terminated *** 2024-03-19T06:25:22.572 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:22 smithi072 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2[91979]: 2024-03-19T06:25:22.248+0000 7f6d42000700 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-19T06:25:27.822 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:27 smithi072 podman[133002]: 2024-03-19 06:25:27.710378891 +0000 UTC m=+5.595996129 container died 7d013647ed4a0a6709e8124fcbc663f19e33967970ff0c779828ab3f90a8cc3c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222) 2024-03-19T06:25:28.322 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:28 smithi072 podman[133002]: 2024-03-19 06:25:28.205494174 +0000 UTC m=+6.091111460 container cleanup 7d013647ed4a0a6709e8124fcbc663f19e33967970ff0c779828ab3f90a8cc3c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271) 2024-03-19T06:25:28.323 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:28 smithi072 bash[133002]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2 2024-03-19T06:25:28.822 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:28 smithi072 podman[133033]: 2024-03-19 06:25:28.541919466 +0000 UTC m=+0.819064024 container remove 7d013647ed4a0a6709e8124fcbc663f19e33967970ff0c779828ab3f90a8cc3c (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-19T06:25:29.454 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:29 smithi072 podman[133123]: 2024-03-19 06:25:29.047261842 +0000 UTC m=+0.035502427 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:25:29.455 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:29 smithi072 podman[133123]: 2024-03-19 06:25:29.168874221 +0000 UTC m=+0.157114830 container create 9f14e365ee732acc0dc8cb4f3a6994359aa8126cfd0aeb324f9c2512e46b9f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:25:29.455 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:29 smithi072 podman[133123]: 2024-03-19 06:25:29.467601643 +0000 UTC m=+0.455842256 container init 9f14e365ee732acc0dc8cb4f3a6994359aa8126cfd0aeb324f9c2512e46b9f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-03-19T06:25:29.822 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:29 smithi072 podman[133123]: 2024-03-19 06:25:29.480389584 +0000 UTC m=+0.468630188 container start 9f14e365ee732acc0dc8cb4f3a6994359aa8126cfd0aeb324f9c2512e46b9f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-deactivate, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222) 2024-03-19T06:25:29.822 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:29 smithi072 podman[133123]: 2024-03-19 06:25:29.558509025 +0000 UTC m=+0.546749688 container attach 9f14e365ee732acc0dc8cb4f3a6994359aa8126cfd0aeb324f9c2512e46b9f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:25:30.247 INFO:journalctl@ceph.osd.2.smithi072.stdout:Mar 19 06:25:29 smithi072 podman[133123]: 2024-03-19 06:25:29.909614523 +0000 UTC m=+0.897855092 container died 9f14e365ee732acc0dc8cb4f3a6994359aa8126cfd0aeb324f9c2512e46b9f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.schema-version=1.0, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222) 2024-03-19T06:25:30.650 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:30 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:25:30.393+0000 7f7948000700 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.062850+0000 front 2024-03-19T06:25:06.063060+0000 (oldest deadline 2024-03-19T06:25:29.562936+0000) 2024-03-19T06:25:30.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.2.service' 2024-03-19T06:25:30.811 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-19T06:25:30.812 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-19T06:25:30.812 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-19T06:25:30.813 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.3 2024-03-19T06:25:30.939 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:30 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:30.692+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:31.366 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:30 smithi172 systemd[1]: Stopping Ceph osd.3 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:25:31.650 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:31 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:25:31.379+0000 7f794be00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:25:31.650 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:31 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:25:31.379+0000 7f794be00700 -1 osd.3 83 *** Got signal Terminated *** 2024-03-19T06:25:31.650 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:31 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:25:31.379+0000 7f794be00700 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-19T06:25:31.650 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:31 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:25:31.397+0000 7f7948000700 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.062850+0000 front 2024-03-19T06:25:06.063060+0000 (oldest deadline 2024-03-19T06:25:29.562936+0000) 2024-03-19T06:25:32.149 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:31 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:31.690+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:32.683 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:32 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:25:32.420+0000 7f7948000700 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.062850+0000 front 2024-03-19T06:25:06.063060+0000 (oldest deadline 2024-03-19T06:25:29.562936+0000) 2024-03-19T06:25:33.149 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:32 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:32.696+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:33.660 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:33 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:25:33.420+0000 7f7948000700 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.062850+0000 front 2024-03-19T06:25:06.063060+0000 (oldest deadline 2024-03-19T06:25:29.562936+0000) 2024-03-19T06:25:33.660 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:33 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:33.508+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:34.149 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:33 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:33.672+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:34.650 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:34 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:25:34.396+0000 7f7948000700 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.062850+0000 front 2024-03-19T06:25:06.063060+0000 (oldest deadline 2024-03-19T06:25:29.562936+0000) 2024-03-19T06:25:34.650 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:34 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:34.642+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:34.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:34 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:34.461+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:35.899 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:35 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3[71855]: 2024-03-19T06:25:35.446+0000 7f7948000700 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.062850+0000 front 2024-03-19T06:25:06.063060+0000 (oldest deadline 2024-03-19T06:25:29.562936+0000) 2024-03-19T06:25:35.900 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:35 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:35.618+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:35.900 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:35 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:35.463+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:36.899 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:36 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:36.631+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:36.900 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:36 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:36.507+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:37.199 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:36 smithi172 podman[97053]: 2024-03-19 06:25:36.931848422 +0000 UTC m=+5.694749597 container died 7ea8347dc3cb03140a518f4c04ae8470103338b6e23d423ff8fd6485e3221831 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:25:37.490 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:37 smithi172 podman[97053]: 2024-03-19 06:25:37.378161571 +0000 UTC m=+6.141062812 container cleanup 7ea8347dc3cb03140a518f4c04ae8470103338b6e23d423ff8fd6485e3221831 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, maintainer=Guillaume Abrioux , GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-19T06:25:37.490 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:37 smithi172 bash[97053]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3 2024-03-19T06:25:37.826 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:37 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:37.593+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:37.827 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:37 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:37.502+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:37.827 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:37 smithi172 podman[97071]: 2024-03-19 06:25:37.597923424 +0000 UTC m=+0.650555448 container remove 7ea8347dc3cb03140a518f4c04ae8470103338b6e23d423ff8fd6485e3221831 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-19T06:25:38.663 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:38 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:38.561+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:38.663 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:38 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:38.481+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:38.664 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:38 smithi172 podman[97160]: 2024-03-19 06:25:38.325062655 +0000 UTC m=+0.035180984 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:25:38.664 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:38 smithi172 podman[97160]: 2024-03-19 06:25:38.507265612 +0000 UTC m=+0.217383991 container create 9bd40696b70fed32131501cfaa791e366f199e635726cdd0d2046723db362bb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b) 2024-03-19T06:25:39.151 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:38 smithi172 podman[97160]: 2024-03-19 06:25:38.786146923 +0000 UTC m=+0.496265301 container init 9bd40696b70fed32131501cfaa791e366f199e635726cdd0d2046723db362bb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-03-19T06:25:39.151 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:38 smithi172 podman[97160]: 2024-03-19 06:25:38.797566784 +0000 UTC m=+0.507685169 container start 9bd40696b70fed32131501cfaa791e366f199e635726cdd0d2046723db362bb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-19T06:25:39.151 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:38 smithi172 podman[97160]: 2024-03-19 06:25:38.892976281 +0000 UTC m=+0.603094686 container attach 9bd40696b70fed32131501cfaa791e366f199e635726cdd0d2046723db362bb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b) 2024-03-19T06:25:39.494 INFO:journalctl@ceph.osd.3.smithi172.stdout:Mar 19 06:25:39 smithi172 podman[97160]: 2024-03-19 06:25:39.230670871 +0000 UTC m=+0.940789230 container died 9bd40696b70fed32131501cfaa791e366f199e635726cdd0d2046723db362bb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222) 2024-03-19T06:25:39.892 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:39 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:39.606+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:39.892 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:39 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:39.506+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:39.892 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:39 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:39.506+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:40.042 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.3.service' 2024-03-19T06:25:40.151 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-19T06:25:40.152 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-19T06:25:40.152 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-19T06:25:40.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.4 2024-03-19T06:25:40.399 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:40 smithi172 systemd[1]: Stopping Ceph osd.4 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:25:40.820 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:40 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:40.633+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:40.821 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:40 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:40.633+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:16.489856+0000 front 2024-03-19T06:25:16.489924+0000 (oldest deadline 2024-03-19T06:25:39.989703+0000) 2024-03-19T06:25:40.821 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:40 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:40.723+0000 7f35eb200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:25:40.821 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:40 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:40.723+0000 7f35eb200700 -1 osd.4 83 *** Got signal Terminated *** 2024-03-19T06:25:40.821 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:40 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:40.723+0000 7f35eb200700 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-19T06:25:40.822 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:40 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:40.485+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:40.822 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:40 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:40.485+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:41.900 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:41 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:41.654+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:41.900 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:41 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:41.654+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:16.489856+0000 front 2024-03-19T06:25:16.489924+0000 (oldest deadline 2024-03-19T06:25:39.989703+0000) 2024-03-19T06:25:41.900 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:41 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:41.442+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:41.900 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:41 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:41.442+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:42.649 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:42 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:42.408+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:42.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:42 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:42.408+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:42.909 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:42 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:42.677+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:42.910 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:42 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:42.677+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:16.489856+0000 front 2024-03-19T06:25:16.489924+0000 (oldest deadline 2024-03-19T06:25:39.989703+0000) 2024-03-19T06:25:43.699 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:43 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:43.687+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:43.699 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:43 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:43.687+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:16.489856+0000 front 2024-03-19T06:25:16.489924+0000 (oldest deadline 2024-03-19T06:25:39.989703+0000) 2024-03-19T06:25:43.699 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:43 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:43.450+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:43.700 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:43 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:43.450+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:44.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:44 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:44.411+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:44.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:44 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:44.411+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:45.149 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:44 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:44.668+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:45.150 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:44 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:44.668+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:16.489856+0000 front 2024-03-19T06:25:16.489924+0000 (oldest deadline 2024-03-19T06:25:39.989703+0000) 2024-03-19T06:25:45.625 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:45 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:45.362+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:45.625 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:45 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:45.362+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:45.900 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:45 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:45.638+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:05.388365+0000 front 2024-03-19T06:25:05.388221+0000 (oldest deadline 2024-03-19T06:25:30.087764+0000) 2024-03-19T06:25:45.900 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:45 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4[74746]: 2024-03-19T06:25:45.638+0000 7f35e7400700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:16.489856+0000 front 2024-03-19T06:25:16.489924+0000 (oldest deadline 2024-03-19T06:25:39.989703+0000) 2024-03-19T06:25:46.484 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:46 smithi172 podman[97276]: 2024-03-19 06:25:46.180150924 +0000 UTC m=+5.593273372 container died 985a6457cf21c7a7efea5c93dd8b3cb14fc99e961173cd80c1fc7faa2d82cec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:25:46.485 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:46 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:46.351+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:46.485 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:46 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:46.351+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:46.854 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:46 smithi172 podman[97276]: 2024-03-19 06:25:46.616415142 +0000 UTC m=+6.029537584 container cleanup 985a6457cf21c7a7efea5c93dd8b3cb14fc99e961173cd80c1fc7faa2d82cec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-19T06:25:46.855 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:46 smithi172 bash[97276]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4 2024-03-19T06:25:47.149 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:46 smithi172 podman[97296]: 2024-03-19 06:25:46.867641103 +0000 UTC m=+0.668116858 container remove 985a6457cf21c7a7efea5c93dd8b3cb14fc99e961173cd80c1fc7faa2d82cec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.build-date=20240222, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-19T06:25:47.649 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:47 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:47.306+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:47.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:47 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:47.306+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:48.001 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:47 smithi172 podman[97386]: 2024-03-19 06:25:47.606162806 +0000 UTC m=+0.034015958 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:25:48.001 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:47 smithi172 podman[97386]: 2024-03-19 06:25:47.718950287 +0000 UTC m=+0.146803509 container create 35b8896d775c0686e2431669b4edbcbbbeba1c92d0e0daf61a7b60a750d973e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-deactivate, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240222) 2024-03-19T06:25:48.001 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:48 smithi172 podman[97386]: 2024-03-19 06:25:48.014127152 +0000 UTC m=+0.441980348 container init 35b8896d775c0686e2431669b4edbcbbbeba1c92d0e0daf61a7b60a750d973e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-deactivate, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-03-19T06:25:48.305 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:48 smithi172 podman[97386]: 2024-03-19 06:25:48.025843398 +0000 UTC m=+0.453696583 container start 35b8896d775c0686e2431669b4edbcbbbeba1c92d0e0daf61a7b60a750d973e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-03-19T06:25:48.305 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:48 smithi172 podman[97386]: 2024-03-19 06:25:48.121329547 +0000 UTC m=+0.549182749 container attach 35b8896d775c0686e2431669b4edbcbbbeba1c92d0e0daf61a7b60a750d973e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-deactivate, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, CEPH_POINT_RELEASE=, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-03-19T06:25:48.650 INFO:journalctl@ceph.osd.4.smithi172.stdout:Mar 19 06:25:48 smithi172 podman[97411]: 2024-03-19 06:25:48.522201762 +0000 UTC m=+0.035017959 container died 35b8896d775c0686e2431669b4edbcbbbeba1c92d0e0daf61a7b60a750d973e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-4-deactivate, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b) 2024-03-19T06:25:48.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:48 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:48.316+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:48.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:48 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:48.316+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:49.141 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.4.service' 2024-03-19T06:25:49.272 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-19T06:25:49.273 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-19T06:25:49.273 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-19T06:25:49.273 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.5 2024-03-19T06:25:49.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:49 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:49.358+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:49.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:49 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:49.358+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:49.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:49 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:49.358+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-19T06:25:26.232669+0000 front 2024-03-19T06:25:26.232714+0000 (oldest deadline 2024-03-19T06:25:48.532180+0000) 2024-03-19T06:25:49.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:49 smithi172 systemd[1]: Stopping Ceph osd.5 for 9ad98512-e5b4-11ee-95c9-87774f69a715... 2024-03-19T06:25:50.150 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:49 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:49.907+0000 7f930a400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-19T06:25:50.150 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:49 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:49.907+0000 7f930a400700 -1 osd.5 83 *** Got signal Terminated *** 2024-03-19T06:25:50.150 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:49 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:49.907+0000 7f930a400700 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-19T06:25:50.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:50 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:50.326+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:50.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:50 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:50.326+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:50.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:50 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:50.326+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-19T06:25:26.232669+0000 front 2024-03-19T06:25:26.232714+0000 (oldest deadline 2024-03-19T06:25:48.532180+0000) 2024-03-19T06:25:51.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:51 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:51.357+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:51.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:51 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:51.357+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:51.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:51 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:51.357+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-19T06:25:26.232669+0000 front 2024-03-19T06:25:26.232714+0000 (oldest deadline 2024-03-19T06:25:48.532180+0000) 2024-03-19T06:25:52.649 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:52 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:52.382+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:52.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:52 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:52.382+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:52.650 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:52 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:52.382+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-19T06:25:26.232669+0000 front 2024-03-19T06:25:26.232714+0000 (oldest deadline 2024-03-19T06:25:48.532180+0000) 2024-03-19T06:25:53.724 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:53 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:53.414+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:53.724 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:53 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:53.414+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:53.724 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:53 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:53.414+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-19T06:25:26.232669+0000 front 2024-03-19T06:25:26.232714+0000 (oldest deadline 2024-03-19T06:25:48.532180+0000) 2024-03-19T06:25:54.900 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:54 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:54.455+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6806 osd.0 since back 2024-03-19T06:25:06.829833+0000 front 2024-03-19T06:25:06.829944+0000 (oldest deadline 2024-03-19T06:25:32.729870+0000) 2024-03-19T06:25:54.900 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:54 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:54.455+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6814 osd.1 since back 2024-03-19T06:25:12.730673+0000 front 2024-03-19T06:25:12.730771+0000 (oldest deadline 2024-03-19T06:25:38.630341+0000) 2024-03-19T06:25:54.900 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:54 smithi172 ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5[77627]: 2024-03-19T06:25:54.455+0000 7f9301600700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.72:6822 osd.2 since back 2024-03-19T06:25:26.232669+0000 front 2024-03-19T06:25:26.232714+0000 (oldest deadline 2024-03-19T06:25:48.532180+0000) 2024-03-19T06:25:55.611 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:55 smithi172 podman[97490]: 2024-03-19 06:25:55.330115599 +0000 UTC m=+5.548213344 container died c47c9c7fd3c72cfbd2616d5b65258bfc493b24b1616f14d9fd5bf1ca98697b2b (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-19T06:25:55.901 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:55 smithi172 podman[97490]: 2024-03-19 06:25:55.743811235 +0000 UTC m=+5.961908979 container cleanup c47c9c7fd3c72cfbd2616d5b65258bfc493b24b1616f14d9fd5bf1ca98697b2b (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-19T06:25:55.901 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:55 smithi172 bash[97490]: ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5 2024-03-19T06:25:56.399 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:56 smithi172 podman[97510]: 2024-03-19 06:25:56.044938174 +0000 UTC m=+0.706323390 container remove c47c9c7fd3c72cfbd2616d5b65258bfc493b24b1616f14d9fd5bf1ca98697b2b (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5, org.label-schema.license=GPLv2, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-03-19T06:25:57.150 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:56 smithi172 podman[97597]: 2024-03-19 06:25:56.776410358 +0000 UTC m=+0.032592629 image pull 5c4d8774b57af167d3cf2a188cfe4e5a13db88a347a566641dd1419fada547ef quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399 2024-03-19T06:25:57.150 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:56 smithi172 podman[97597]: 2024-03-19 06:25:56.920737972 +0000 UTC m=+0.176920272 container create ec2c09c870104a24e9279a6164fdacf09ed8d4969b289505610f4bf7930c6298 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-19T06:25:57.443 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:57 smithi172 podman[97597]: 2024-03-19 06:25:57.183702955 +0000 UTC m=+0.439885316 container init ec2c09c870104a24e9279a6164fdacf09ed8d4969b289505610f4bf7930c6298 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-19T06:25:57.443 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:57 smithi172 podman[97597]: 2024-03-19 06:25:57.196690647 +0000 UTC m=+0.452872925 container start ec2c09c870104a24e9279a6164fdacf09ed8d4969b289505610f4bf7930c6298 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-deactivate, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-19T06:25:57.443 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:57 smithi172 podman[97597]: 2024-03-19 06:25:57.456458405 +0000 UTC m=+0.712640713 container attach ec2c09c870104a24e9279a6164fdacf09ed8d4969b289505610f4bf7930c6298 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240222, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-19T06:25:57.900 INFO:journalctl@ceph.osd.5.smithi172.stdout:Mar 19 06:25:57 smithi172 podman[97622]: 2024-03-19 06:25:57.679863196 +0000 UTC m=+0.030775737 container died ec2c09c870104a24e9279a6164fdacf09ed8d4969b289505610f4bf7930c6298 (image=quay.ceph.io/ceph-ci/ceph@sha256:d391e7e45b77a730144bfdd358ea9eaadaf152d531e9d5c25f3130c108024399, name=ceph-9ad98512-e5b4-11ee-95c9-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240307.022905-b0ea271, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=6d53bc8ece767735a31d32bfc429296668de9e0b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222) 2024-03-19T06:25:58.378 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9ad98512-e5b4-11ee-95c9-87774f69a715@osd.5.service' 2024-03-19T06:25:58.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-19T06:25:58.502 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-19T06:25:58.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 --force --keep-logs 2024-03-19T06:25:58.789 INFO:teuthology.orchestra.run.smithi072.stdout:Deleting cluster with fsid: 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T06:26:06.330 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[66577]: fuse finished with error 0 and tester_r 0 2024-03-19T06:26:29.875 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 --force --keep-logs 2024-03-19T06:26:30.158 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T06:26:50.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-19T06:26:50.611 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-19T06:26:50.711 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-19T06:26:50.713 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647/remote/smithi072/crash 2024-03-19T06:26:50.714 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/crash -- . 2024-03-19T06:26:50.807 INFO:teuthology.orchestra.run.smithi072.stderr:tar: /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/crash: Cannot open: No such file or directory 2024-03-19T06:26:50.807 INFO:teuthology.orchestra.run.smithi072.stderr:tar: Error is not recoverable: exiting now 2024-03-19T06:26:50.811 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647/remote/smithi172/crash 2024-03-19T06:26:50.812 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/crash -- . 2024-03-19T06:26:50.908 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/crash: Cannot open: No such file or directory 2024-03-19T06:26:50.908 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2024-03-19T06:26:50.912 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-19T06:26:50.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-03-19T06:26:51.014 INFO:tasks.cephadm:Compressing logs... 2024-03-19T06:26:51.015 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-19T06:26:51.019 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-19T06:26:51.088 INFO:teuthology.orchestra.run.smithi072.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-03-19T06:26:51.088 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-19T06:26:51.089 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-03-19T06:26:51.090 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mon.smithi072.log 2024-03-19T06:26:51.091 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.audit.log 2024-03-19T06:26:51.092 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mon.smithi072.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mds.cephfs.smithi072.jhxzfi.log 2024-03-19T06:26:51.094 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-client.ceph-exporter.smithi072.log 2024-03-19T06:26:51.096 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mds.cephfs.smithi072.jhxzfi.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.1.log 2024-03-19T06:26:51.097 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-client.ceph-exporter.smithi072.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mgr.smithi072.jydpjk.log 2024-03-19T06:26:51.100 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.1.log: /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mgr.smithi072.jydpjk.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.0.log 2024-03-19T06:26:51.102 INFO:teuthology.orchestra.run.smithi072.stderr: 94.2% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-client.ceph-exporter.smithi072.log.gz 2024-03-19T06:26:51.102 INFO:teuthology.orchestra.run.smithi072.stderr: 91.3% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.audit.log.gz 2024-03-19T06:26:51.105 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.cephadm.log 2024-03-19T06:26:51.106 INFO:teuthology.orchestra.run.smithi072.stderr: 90.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-19T06:26:51.107 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.log 2024-03-19T06:26:51.110 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.2.log 2024-03-19T06:26:51.110 INFO:teuthology.orchestra.run.smithi072.stderr: 85.6% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.cephadm.log.gz 2024-03-19T06:26:51.111 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-19T06:26:51.111 INFO:teuthology.orchestra.run.smithi172.stderr:: No such file or directory 2024-03-19T06:26:51.111 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-volume.log 2024-03-19T06:26:51.112 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mgr.smithi172.qkcahs.log 2024-03-19T06:26:51.113 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.audit.log 2024-03-19T06:26:51.114 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.2.log: /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mds.cephfs.smithi072.dvdjwb.log 2024-03-19T06:26:51.114 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.log.gz 2024-03-19T06:26:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mgr.smithi172.qkcahs.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.4.log 2024-03-19T06:26:51.115 INFO:teuthology.orchestra.run.smithi172.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-19T06:26:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-client.ceph-exporter.smithi172.log 2024-03-19T06:26:51.116 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mon.smithi172.log 2024-03-19T06:26:51.118 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-client.ceph-exporter.smithi172.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.5.log 2024-03-19T06:26:51.119 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mon.smithi172.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.3.log 2024-03-19T06:26:51.119 INFO:teuthology.orchestra.run.smithi172.stderr: 91.5% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.audit.log.gz 2024-03-19T06:26:51.120 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.cephadm.log 2024-03-19T06:26:51.121 INFO:teuthology.orchestra.run.smithi172.stderr: 94.2% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-client.ceph-exporter.smithi172.log.gz 2024-03-19T06:26:51.122 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.log 2024-03-19T06:26:51.124 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mds.cephfs.smithi172.nparnw.log 2024-03-19T06:26:51.125 INFO:teuthology.orchestra.run.smithi172.stderr: 85.5% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.cephadm.log.gz/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.log: 2024-03-19T06:26:51.125 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mds.cephfs.smithi172.xlokxp.log 2024-03-19T06:26:51.130 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mds.cephfs.smithi172.nparnw.log: /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mds.cephfs.smithi172.xlokxp.log: 88.6% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph.log.gz 2024-03-19T06:26:51.130 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-volume.log 2024-03-19T06:26:51.131 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-03-19T06:26:51.132 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mds.cephfs.smithi072.dvdjwb.log: 91.5% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-volume.log.gz 2024-03-19T06:26:51.148 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-volume.log: /var/log/ceph/ceph-client.1.log: 91.7% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-volume.log.gz 2024-03-19T06:26:51.174 INFO:teuthology.orchestra.run.smithi172.stderr: 89.3% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mgr.smithi172.qkcahs.log.gz 2024-03-19T06:26:51.629 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mgr.smithi072.jydpjk.log.gz 2024-03-19T06:26:51.703 INFO:teuthology.orchestra.run.smithi172.stderr: 92.5% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mon.smithi172.log.gz 2024-03-19T06:26:52.625 INFO:teuthology.orchestra.run.smithi072.stderr: 90.4% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mon.smithi072.log.gz 2024-03-19T06:26:55.544 INFO:teuthology.orchestra.run.smithi072.stderr: 95.1% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mds.cephfs.smithi072.dvdjwb.log.gz 2024-03-19T06:26:56.034 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.0.log.gz 2024-03-19T06:26:56.410 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.2.log.gz 2024-03-19T06:26:56.728 INFO:teuthology.orchestra.run.smithi172.stderr: 93.7% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.5.log.gz 2024-03-19T06:26:56.891 INFO:teuthology.orchestra.run.smithi172.stderr: 93.7% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.3.log.gz 2024-03-19T06:26:56.979 INFO:teuthology.orchestra.run.smithi172.stderr: 93.7% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.4.log.gz 2024-03-19T06:26:57.424 INFO:teuthology.orchestra.run.smithi172.stderr: 95.1% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mds.cephfs.smithi172.nparnw.log.gz 2024-03-19T06:26:57.528 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-osd.1.log.gz 2024-03-19T06:27:07.825 INFO:teuthology.orchestra.run.smithi072.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-03-19T06:27:08.123 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-03-19T06:27:08.123 INFO:teuthology.orchestra.run.smithi172.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-03-19T06:27:36.349 INFO:teuthology.orchestra.run.smithi172.stderr: 93.4% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mds.cephfs.smithi172.xlokxp.log.gz 2024-03-19T06:27:36.354 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-03-19T06:27:36.354 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m45.283s 2024-03-19T06:27:36.354 INFO:teuthology.orchestra.run.smithi172.stderr:user 1m20.600s 2024-03-19T06:27:36.355 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m5.910s 2024-03-19T06:27:44.483 INFO:teuthology.orchestra.run.smithi072.stderr: 93.5% -- replaced with /var/log/ceph/9ad98512-e5b4-11ee-95c9-87774f69a715/ceph-mds.cephfs.smithi072.jhxzfi.log.gz 2024-03-19T06:27:44.487 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-03-19T06:27:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:real 0m53.435s 2024-03-19T06:27:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:user 1m26.404s 2024-03-19T06:27:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m6.707s 2024-03-19T06:27:44.489 INFO:tasks.cephadm:Archiving logs... 2024-03-19T06:27:44.489 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647/remote/smithi072/log 2024-03-19T06:27:44.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-19T06:27:56.883 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647/remote/smithi172/log 2024-03-19T06:27:56.884 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-19T06:28:08.330 INFO:tasks.cephadm:Removing cluster... 2024-03-19T06:28:08.331 DEBUG:teuthology.orchestra.run.smithi072:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 --force 2024-03-19T06:28:08.614 INFO:teuthology.orchestra.run.smithi072.stdout:Deleting cluster with fsid: 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T06:28:09.506 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9ad98512-e5b4-11ee-95c9-87774f69a715 --force 2024-03-19T06:28:09.795 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 9ad98512-e5b4-11ee-95c9-87774f69a715 2024-03-19T06:28:10.694 INFO:tasks.cephadm:Removing cephadm ... 2024-03-19T06:28:10.695 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-19T06:28:10.751 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-19T06:28:10.806 INFO:tasks.cephadm:Teardown complete 2024-03-19T06:28:10.806 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-19T06:28:10.820 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-03-19T06:28:10.821 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-19T06:28:10.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-19T06:28:10.828 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-19T06:28:10.973 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-19T06:28:10.987 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-19T06:28:10.987 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-19T06:28:10.995 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-19T06:28:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:bash: line 1: ntpq: command not found 2024-03-19T06:28:11.046 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-19T06:28:11.046 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2024-03-19T06:28:11.046 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 +845us[ +853us] +/- 72ms 2024-03-19T06:28:11.046 INFO:teuthology.orchestra.run.smithi072.stdout:^* hv02.front.sepia.ceph.com 3 6 377 55 -1869us[-1861us] +/- 54ms 2024-03-19T06:28:11.046 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 116 +2251us[+2255us] +/- 98ms 2024-03-19T06:28:11.046 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T06:28:11.047 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-03-19T06:28:11.055 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-19T06:28:11.055 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-03-19T06:28:11.055 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 54 +852us[ +852us] +/- 72ms 2024-03-19T06:28:11.055 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv02.front.sepia.ceph.com 3 6 377 56 -1845us[-1833us] +/- 54ms 2024-03-19T06:28:11.055 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +2265us[+2265us] +/- 99ms 2024-03-19T06:28:11.055 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T06:28:11.056 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-19T06:28:11.068 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-19T06:28:11.069 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-19T06:28:11.081 DEBUG:teuthology.orchestra.run.smithi072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-19T06:28:11.288 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-19T06:28:11.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-19T06:28:11.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:28:11.625 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-19T06:28:11.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:28:11.730 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-19T06:28:11.742 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-19T06:28:11.753 INFO:teuthology.task.internal:Duration was 2824.007187 seconds 2024-03-19T06:28:11.753 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-19T06:28:11.765 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-19T06:28:11.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-19T06:28:11.773 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-19T06:28:11.927 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-19T06:28:11.935 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-19T06:28:12.422 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-19T06:28:12.423 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2024-03-19T06:28:12.423 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-19T06:28:12.486 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-03-19T06:28:12.486 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-19T06:28:12.560 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-19T06:28:12.560 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-19T06:28:12.565 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-19T06:28:12.647 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-19T06:28:12.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-19T06:28:12.657 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-19T06:28:13.554 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-19T06:28:13.567 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-19T06:28:13.567 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-19T06:28:13.658 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-19T06:28:13.759 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-19T06:28:13.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-19T06:28:13.779 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-19T06:28:13.875 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2024-03-19T06:28:13.886 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-03-19T06:28:13.947 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-19T06:28:13.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:28:13.997 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-19T06:28:14.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:28:14.049 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-19T06:28:14.063 INFO:teuthology.task.internal:Transferring archived files... 2024-03-19T06:28:14.064 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647/remote/smithi072 2024-03-19T06:28:14.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-19T06:28:14.185 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647/remote/smithi172 2024-03-19T06:28:14.185 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-19T06:28:14.300 INFO:teuthology.task.internal:Removing archive directory... 2024-03-19T06:28:14.300 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-19T06:28:14.308 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-19T06:28:14.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-19T06:28:14.406 INFO:teuthology.task.internal:Not uploading archives. 2024-03-19T06:28:14.406 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-19T06:28:14.418 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-19T06:28:14.418 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-19T06:28:14.426 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-19T06:28:14.476 INFO:teuthology.orchestra.run.smithi072.stdout: 393229 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 19 06:28 /home/ubuntu/cephtest 2024-03-19T06:28:14.476 INFO:teuthology.orchestra.run.smithi072.stdout: 656510 4 d--------- 2 ubuntu ubuntu 4096 Mar 19 06:01 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:28:14.476 INFO:teuthology.orchestra.run.smithi072.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-03-19T06:28:14.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:28:14.478 INFO:teuthology.orchestra.run.smithi072.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-03-19T06:28:14.479 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-03-19T06:28:14.479 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-19T06:28:14.493 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-19T06:28:14.506 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-03-19T06:28:14.506 INFO:teuthology.nuke:Checking targets against current locks 2024-03-19T06:28:14.532 DEBUG:teuthology.nuke:shortname: smithi072 2024-03-19T06:28:14.532 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-19T06:28:14.556 DEBUG:teuthology.nuke:shortname: smithi172 2024-03-19T06:28:14.557 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-19T06:28:14.560 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-19 05:30:56.042661', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqyZgD4jPKhAzQmn+z4vqr2pRCZq5L7elDiDPYP9mZQv56VJtzXZIVELaCpm/SHteMfmXpQ+KybIByZOudfII8='} 2024-03-19T06:28:14.586 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610647', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-19 05:30:56.044279', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO5GF5fwSWAVIVgm5TrCQYWrWEchpHlC7c6rSuj4MHaGSzJSwgmxKOcv+zUsO2QG1/NN7F9ND3ujvHDsZahRdqY='} 2024-03-19T06:28:14.619 INFO:teuthology.orchestra.console.smithi072:Power off 2024-03-19T06:28:14.619 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-19T06:28:14.642 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2024-03-19T06:28:14.642 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:28:14.657 INFO:teuthology.orchestra.console.smithi172:Power off 2024-03-19T06:28:14.657 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-19T06:28:14.666 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-03-19T06:28:14.677 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-03-19T06:28:14.677 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:28:14.700 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-19T06:28:18.667 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:28:18.701 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:28:18.779 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-03-19T06:28:18.813 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-19T06:28:22.782 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:28:22.814 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:28:22.892 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-03-19T06:28:22.924 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-19T06:28:26.894 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:28:26.925 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:28:27.006 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-03-19T06:28:27.035 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-03-19T06:28:27.107 INFO:teuthology.orchestra.console.smithi072:Power off completed 2024-03-19T06:28:27.136 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-03-19T06:28:27.242 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2824.007187128067 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default host.a-kernel-sha1: 908b6b276e8f14e16032b32a9770077cd37b6bd4 host.b-kernel-sha1: 908b6b276e8f14e16032b32a9770077cd37b6bd4 owner: scheduled_vshankar@teuthology status: fail success: false 2024-03-19T06:28:27.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T06:28:27.330 INFO:teuthology.run:FAIL